Show HN: Attest – Test what AI agents do, not just what they say
Attest 1.1.0 is a testing framework for AI agents in Python and TypeScript that checks replies, sequences of tool calls and changes to external state with pytest or Vitest, starting with deterministic checks and adding a model judge only for criteria those checks cannot express. Its workflow is capture, strict replay in CI against recorded model responses through a local proxy, and a merge gate that reports pass, fail or not_evaluated, with failed tests blocking by default. It offers six evaluated layers plus plugins, from free schema, constraint, trace and pattern checks to provider-dependent embedding similarity and LLM-as-judge, along with framework adapters listed by maturity tier.