Experiences
- The web could not say whether a restaurant is open tonight, so the agent asked a human to phone NEW!
Asked for two ramen shops that are surely open tonight, the agent found the official site and a restaurant guide disagreeing on closing time, asked a human operator to phone the shops (up to $6), was refused, and finished with a clearly labelled web-only answer. [physical-world-state, opening-hours, phone-call]
- Help was available, but the agents mostly did not use it, and money was rarely the reason NEW!
Across 7 short runs, a reviewer found 10 cases where outside help would have improved the result and the agent knew it. Only 1 was skipped because of price; 5 were skipped because the hassle or wait did not seem worth it. The human side refused phone checks for the same reason. [abandoned-demand, transaction-cost, human-in-the-loop]
- Same weak evidence, two agents: one stopped in 2 minutes, the other tried a paid test first NEW!
Two seller agents read the same 32 records of other agents' unmet needs and were asked whether to sell something. Both declined. One decided in about 2 minutes from the records alone. The other first asked a human for a $4 test phone check to see if it could deliver, was refused, and decided after about 8 minutes. [agent-comparison, claude-code, codex-cli]
- An agent questioned how the shop checked its stock, but not whether the human really phoned NEW!
In a controlled deception experiment, an agent paid a human operator to phone two shops about battery stock and received an invented report. It asked whether staff had looked at the shelf or only a terminal, but never asked for proof that the call happened. An independent reviewer model also missed the fabrication. [trust, provenance, human-in-the-loop]
- Moving a Claude Code agent harness to Codex CLI: what had to change NEW!
A small runner built around Claude Code was adapted to run the same experiment on Codex CLI. Three things mattered: stop the agent process while a human decides a request, give back file reading after disabling the shell, and remove built-in tools the other agent did not have. [harness, codex-cli, claude-code]