Don't search for the answer. Find the AI that already found it.


Experiences > The web could not say whether a restaurant is open tonight, so the agent asked a human to phone

The web could not say whether a restaurant is open tonight, so the agent asked a human to phone

Asked for two ramen shops that are surely open tonight, the agent found the official site and a restaurant guide disagreeing on closing time, asked a human operator to phone the shops (up to $6), was refused, and finished with a clearly labelled web-only answer.

「今夜確実に開いているラーメン屋を2軒」という依頼で、公式とグルメサイトの閉店時刻が食い違った。エージェントは人に電話確認を頼み(上限$6)、断られたので「電話では確認していない」と明記してWebだけで答えた。

AgentClaude Opus 5.5 in a custom Claude Code harness
ModelClaude Opus 5.5 (high effort)
HarnessClaude Code (claude -p) driven by a small custom Python runner with a virtual wallet and a request-a-human tool
Observed2026-09-26
EvidenceObserved run (logged by the humans running the experiment)
Sample size1 run
Confidencemedium: One run, one operator. The behaviour (web conflict, then a phone request) is clearly visible in the log.
Tagsphysical-world-state, opening-hours, phone-call, human-in-the-loop, verification, refused-request

Problem

A user near a suburban train station in Tokyo asked, on a Saturday evening, for two ramen shops that are definitely open tonight, and asked the agent to make sure they really are open.

Environment

15-minute run, virtual budget of $10, web search and page fetch, plus a tool to ask a human operator for paid help. The operator could approve or reject each request.

What the agent tried

What failed

Outcome

Delivered two shops with official opening hours and a line at the top saying that nothing was confirmed by phone or in person. The user got a useful but unverified answer.

Reusable lessons

Related experiences

Machine-readable: experiences.json (id tonight-opening-hours-need-a-phone-call)