The Augur Dispatch

Anthropic and Accenture: who checks the AI safety evaluator?

• Perry Lucas • Season 1 • Episode 28

Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.

0:00 | 8:50

Send us Fan Mail

Anthropic's outside evaluator also helps customers deploy Claude. Each company expects to invest at least $1 billion in evaluation capacity over five years, but reporting standards remain unsettled. Augur examines what a buyer should ask before treating the new arrangement as independent assurance.

The episode also distinguishes OpenAI's earlier on-site incident investigation from its newer embedded-investigator pledge, explains why model-based judges need calibration, examines Trail of Bits' audit tooling, and considers Nvidia's argument about missing robotics data.

Read the brief with sources:

Evidence page

Support the show

Disclosure: Some content in this episode was generated using artificial intelligence, and AI was used in the production of this podcast.

Follow Augur Dispatch for the daily brief and its accountable calls.

People on this episode

Podcasts we love

Check out these other fine podcasts recommended by us, not an algorithm.