Hacker News AI· BrianWoods·· 5 days agoAI score58
An AI agent said the code was verified. The evidence said otherwise
An AI agent said the code was verified. The evidence said otherwise
AI summary
A blog post argues that when an AI agent implements, tests, reviews and reports on its own code, its claim of "verified" is untrustworthy, and proposes binding evidence (review, tests, human approval) to a specific Git tree hash so that changing the tree invalidates the evidence. It introduces Uncle (github.com/unclehq/uncle), an open-source tool that runs checks itself, records exit codes and tree identities, and distinguishes "verified," "signed" and "human looked at it" rather than blurring them. The author notes the tool does not establish correctness, is young, and is partly defeated by a hostile agent with unsandboxed shell access.
Source: Hacker News AI · brian.biz