Friday, 16 October 202602:05 UTCWire updated 02:05 UTC

Follow @0xNotMarc

Notes from the Terminal
Delayed ·

Models & Labs

Anthropic is working with METR and SecureBio as embedded evaluators

Anthropic is working with METR and SecureBio as embedded evaluators

Anthropic says it is working with the nonprofits METR and SecureBio to embed independent evaluators within the company. METR is a third-tier evaluator, Anthropic said, and has onboarded six employees with access to Anthropic hardware, office spaces and tools that are "roughly on par" with its own risk assessment teams. SecureBio, a first-tier evaluator with more limited access, is reviewing the chemical and biological weapons section of the risk report Anthropic released in August.

NoteThe access tiers are Anthropic's own, and the company has said there are, as yet, no standards for what embedded evaluators should have access to.

Read the original