AI Science Tracker

AMIE: conversational diagnostic AI rated above primary care physicians in simulated consultations

Google Research; Google DeepMind · 9 Apr 2025 · medicine

Discovery

AMIE: conversational diagnostic AI rated above primary care physicians in simulated consultations

In a blinded remote OSCE with 149 case scenarios, AMIE and primary care physicians held text consultations with simulated patients. Specialist physicians rated AMIE superior on 30 of 32 axes and patient actors on 25 of 26, and non-inferior on the rest. The evidence comes from simulated scenarios, not real patients, and the authors state that further research is needed before real-world use.

Technology: AMIE (Articulate Medical Intelligence Explorer), a large language model agent for diagnostic dialogue

Publication: Peer-reviewed paper · Test context: direct test. Catalog categories, not an evidence grade.

Result, AI contribution and limits

Evidence context (descriptions follow the cited sources; test type is a catalog classification):

  • Publication status: Peer-reviewed paper
  • Test type: direct test
  • Tested: A randomized, double-blind crossover study of text consultations with patient-actors across 159 case scenarios compared AMIE with 20 primary care physicians, rated by specialist physicians and patient actors on several axes.
  • Still unknown: The authors note the unfamiliar synchronous text-chat format and state that further research is needed before real-world use.
  • AI role: AMIE, an LLM-based diagnostic dialogue system trained by self-play with automated feedback, conducted the consultations.

Evidence sources: https://www.ebi.ac.uk/europepmc/webservices/rest/search?query=DOI:10.1038/s41586-025-08866-7&resultType=core&format=json

Source checked · editorial details

The source page was checked against this entry. Independent confirmation is not assessed by this label.

Source type: paper. Paper: linked separately.

Review scope and date are not recorded; source checked does not establish full-text review.

Citations: in the top 1% of works of the same type, year and subfield (OpenAlex work metrics, 824 citations; as of 15 Nov 2026). Attention, not a measure of correctness; not part of the score.

Editorial assessment: Impact 4/5 · Validation 3/5 · Novelty 4/5. Impact and novelty are editorial judgments; validation follows the annotated test type where one exists. Not an evidence grade. Scoring criteria.

Follow-up and relationships

No follow-up recorded; this is not a claim that no follow-up exists.

Follow-up review scope and date are not recorded.

No source-supported relationships recorded.

Open in the full catalog for filters, charts and related discoveries.