A METR team is embedded inside Anthropic with employee-like access (company hardware, office space and internal tools on par with Anthropic's own risk teams), and METR can publish its risk assessments without an Anthropic veto.
● OPEN · settles 2026-10-19
| Claim made in | An update on independent evaluators (anthropic.com) |
| Bank record | Anthropic — see its full delivery record in the bank |
| Market opened | 2026-10-16 |
| Market type | Flash market (1–3 days) |
| Calls lock | 2026-10-18 08:00 Eastern Time (12:00 UTC) — 24 hours before the check, so nobody can call it with the answer already visible |
| Check time | 2026-10-19 08:00 Eastern Time (12:00 UTC) |
| Source of record | anthropic.com |
Background
Anthropic has put outside auditors inside the building. Six staff from METR, the nonprofit that evaluates frontier AI models, now work on Anthropic hardware, in Anthropic office space, with access to internal tools and systems roughly on par with the company's own risk assessment teams, including visibility into how models were trained and how safeguards function. The carve-outs are narrow and named in advance: customer data, attorney-client privileged material and model architecture details. METR will publish its analysis of Anthropic's risk levels, incidents and practices, and Anthropic cannot veto publication. It can require redactions only inside those predefined categories, and METR is free to say publicly whether it believes a redaction was justified. The rest of the ladder is filling in below that top tier: SecureBio is reviewing the chemical and biological weapons chapter of the August Risk Report after publishing a pilot review of the previous one, Accenture and Faculty are building a partnership covering evaluation, red-teaming and alignment assessment, and early talks are under way with Hugging Face and others. Anthropic presents its three tiers of evaluator access as a template every frontier lab should adopt voluntarily, and compares the logic to bank supervisors stationed inside the largest banks.
This market exists because launch announcements are easy to make and hard to grade. Press releases describe what a company intends to ship; they rarely come back later to say whether it shipped. AI Rank Bank pulls one checkable sentence out of the coverage — the sentence above — gives it a date, and lets readers price it in public. The launch itself stays with its publisher; what lives here is the claim, the crowd's call, and eventually the receipt.
How this claim is judged
Judging criteria, fixed when the market opened: Delivered if, at the check time, Anthropic's announcement and METR's public materials still describe the embedded team as active with employee-like access and publication rights Anthropic cannot veto, subject only to narrow predefined redactions. The embedding having ended, access cut back to ordinary external evaluation, or a publication veto having been introduced does not count.
The source of record is the publisher's own page linked above. A claim about a company's product is judged against that company's public output — its product pages, documentation, changelogs and official posts — not against rumors or third-party summaries. Only yes-or-no outcomes count: partial credit is not a verdict, and a claim that needs a paragraph of excuses has already answered itself.
How readers called it
No calls yet — the bar is empty and the claim is unpriced.
No reader calls yet. The first call on a claim is priced against a neutral crowd, and pays 50 points if it lands.
Points reward being right against the crowd. A correct call pays 100 × (1 − the share of readers who agreed with you when you placed it), with a floor of 10: side with a 90% consensus and a win pays 10, stand alone and a win pays up to 100. Wrong calls pay nothing. The price is locked in when the call is placed, so early readers are paid for judging before the crowd forms, not for copying it.
How readers split
The split line starts with this market's first snapshots — a point is recorded whenever a reader calls the claim, and at least once an hour while it stays open. Check back after the crowd has moved and the line will be here.
Verdict
No verdict yet. This claim is checked on 2026-10-19 08:00 Eastern Time (12:00 UTC) against the source of record below. When the check happens, one of three stamps lands on this page permanently: delivered if the claim came true as stated, busted if it did not, or unproven if the date passes without public evidence either way. Unproven claims pay no points and do not count against any reader's hit rate.
About this market
AI Rank Bank is an AI news front page with a memory. Every launch on the homepage carries one claim like this one, with a check date. Readers call claims with points, build a public record, and climb the leaderboard. Companies build a record too: every settled claim lands on the company's bank page, where its delivery rate is simple arithmetic that nobody gets to edit afterwards. There is no money in the market — points buy bragging rights only, which keeps the incentives pointed at being right.