Introducing the Artificial Analysis Decision Index v2

Artificial Analysis released Decision Index v2, with 45% of the Index built on private datasets (up from 25% in v1) and a new Decision Score that rewards both correctness and calibrated confidence. Drex Max v1.1 (Nace AI) and GLiDE v1.2 (Fastino Labs) both score 73, with Mammoth 27B (Baseten) at 72, while cost per 1M Tasks ranges from $14 for Celeris-1.1 Decision to $859 for Clef. The update adds AA-Paperclip (1,500 private documents), AA-Symmetry, revised AA-Omniscience-Decision and HLE-MultiChoice benchmarks, and EvalSafe-O*NET-AA, while reducing When2Call to 10% and removing WildGuardTest.