RESEARCH · RESEARCH · #993
FRI interim report finds experts underestimated recent AI progress
An interim report from the Forecasting Research Institute (FRI) finds that senior AI experts and superforecasters significantly underestimated recent AI advances across benchmarks and some adoption/economic metrics. Notable gaps include AI reaching IMO gold-medal level in July 2025 earlier than forecasted, a possible (but unverified) solution to a Millennium Prize Problem, faster-than-expected virology and cybersecurity capabilities, and higher-than-expected company revenue figures (FRI cites roughly $100 billion for Anthropic in September 2026).
KEY POINTS
- An interim report from the Forecasting Research Institute (FRI) finds that senior AI experts and superforecasters significantly underestimated recent AI advances across benchmarks and some adoption/economic metrics.
- Notable gaps include AI reaching IMO gold-medal level in July 2025 earlier than forecasted, a possible (but unverified) solution to a Millennium Prize Problem, faster-than-expected virology and cybersecurity capabilities, and higher-than-expected company revenue figures (FRI cites roughly $100 billion for Anthropic in September 2026).
- If experts systematically undershot AI progress, policymakers, companies, and funders may need to update plans for regulation, safety research, and strategic investment.
WHY IT MATTERS
If experts systematically undershot AI progress, policymakers, companies, and funders may need to update plans for regulation, safety research, and strategic investment.