RESEARCH · RESEARCH · #2445
Microsoft’s MAI-DxO outperformed generalist doctors on simulated complex cases, study in Science
Microsoft published a Science paper reporting that its AI orchestration system MAI-DxO correctly diagnosed 83% of complex New England Journal of Medicine cases in a simulation, compared with 36% for individual generalist physicians using reference materials; specialists or physician teams (who typically handle such cases) were not included in the comparison. The study tested multiple base models (best results used OpenAI’s GPT-5 and GPT-5.5), found DxO added most value on complex cases and weaker models, and Microsoft said it will train a Mayo Clinic-backed healthcare foundation model and run real‑world evaluations at Beth Israel Deaconess.
KEY POINTS
- Microsoft published a Science paper reporting that its AI orchestration system MAI-DxO correctly diagnosed 83% of complex New England Journal of Medicine cases in a simulation, compared with 36% for individual generalist physicians using reference materials; specialists or physician teams (who typically handle such cases) were not included in the comparison.
- The study tested multiple base models (best results used OpenAI’s GPT-5 and GPT-5.5), found DxO added most value on complex cases and weaker models, and Microsoft said it will train a Mayo Clinic-backed healthcare foundation model and run real‑world evaluations at Beth Israel Deaconess.
- If validated outside simulations, orchestration layers like DxO combined with stronger base models could materially change diagnostic accuracy and the delivery of specialist expertise.
WHY IT MATTERS
If validated outside simulations, orchestration layers like DxO combined with stronger base models could materially change diagnostic accuracy and the delivery of specialist expertise.