AI Science Tracker

Combining AI algorithms with radiologists improves mammography specificity

Sage Bionetworks; and DREAM challenge collaborators, with US and Swedish screening programmes · 2 Mar 2020 · medicine

Discovery

Combining AI algorithms with radiologists improves mammography specificity

An international crowdsourced challenge (over 1,100 participants, 126 teams, 44 countries) tested AI on screening mammograms from 144,231 US and 166,578 Swedish examinations. The best single algorithm did not beat radiologists (US AUC 0.858), but an ensemble of top algorithms combined with US radiologists' recall decisions reached AUC 0.942 and 92.0% specificity at the same sensitivity. The study is retrospective, uses challenge data and does not report recall rates.

Technology: Ensemble of crowdsourced deep-learning mammography algorithms combined with radiologist recall

Publication: Peer-reviewed paper · Test context: retrospective or benchmark. Catalog categories, not an evidence grade.

Result, AI contribution and limits

Evidence context (descriptions follow the cited sources; test type is a catalog classification):

  • Publication status: Peer-reviewed paper
  • Test type: retrospective or benchmark
  • Tested: A crowdsourced challenge of 126 teams was tested on 144,231 US and 166,578 Swedish screening examinations, with an ensemble of top algorithms combined with US radiologists' recall decisions compared on AUC and specificity.
  • Still unknown: The study is retrospective, no single algorithm beat radiologists, the ensemble was evaluated only against US radiologists, and recall rates are not reported.
  • AI role: Algorithms produced cancer risk scores; an ensemble of top algorithms was combined with radiologist recall decisions.

Evidence sources: https://www.ebi.ac.uk/europepmc/webservices/rest/search?query=DOI:10.1001/jamanetworkopen.2020.0265&resultType=core&format=json

Source checked · editorial details

The source page was checked against this entry. Independent confirmation is not assessed by this label.

Source type: paper. Paper: linked separately.

Review scope and date are not recorded; source checked does not establish full-text review.

Citations: in the top 1% of works of the same type, year and subfield (OpenAlex work metrics, 438 citations; as of 15 Nov 2026). Attention, not a measure of correctness; not part of the score.

Editorial assessment: Impact 4/5 · Validation 2/5 · Novelty 3/5. Impact and novelty are editorial judgments; validation follows the annotated test type where one exists. Not an evidence grade. Scoring criteria.

Follow-up and relationships

No follow-up recorded; this is not a claim that no follow-up exists.

Follow-up review scope and date are not recorded.

No source-supported relationships recorded.

Open in the full catalog for filters, charts and related discoveries.