AI Science Tracker

The levers of political persuasion with conversational AI

University of Oxford; UK AI Security Institute; London School of Economics; Stanford University; MIT · 4 Dec 2025 · multidisciplinary

Discovery

The levers of political persuasion with conversational AI

In three large experiments with 76,977 participants, 19 LLMs argued 707 British political positions in dialogue. Persuasiveness was driven mainly by information density, while tailoring to user traits added little, and post-training for persuasion raised effectiveness by up to 50%. The most persuasive models also produced the most inaccurate claims. Caveat: the persuasion effects are measured in survey experiments, and accuracy was tested on a subset of claims.

Technology: 19 open and closed LLMs (including GPT-4.5, GPT-4o, Grok-3)

Family GPT-4: profile · models page

Publication: Peer-reviewed paper · Test context: direct test. Catalog categories, not an evidence grade.

Result, AI contribution and limits

Evidence context (descriptions follow the cited sources; test type is a catalog classification):

  • Publication status: Peer-reviewed paper
  • Test type: direct test
  • Tested: Three large experiments with 76,977 participants tested 19 LLMs arguing 707 British political positions in dialogue, and the factual accuracy of claims was checked on a subset.
  • Still unknown: Persuasion effects are measured in survey experiments, and accuracy was tested only on a subset of claims.
  • AI role: LLMs, some post-trained for persuasion, were the persuaders in dialogue.

Evidence sources: https://www.ebi.ac.uk/europepmc/webservices/rest/search?query=DOI:10.1126/science.aea3884&resultType=core&format=json

Source checked · editorial details

The source page was checked against this entry. Independent confirmation is not assessed by this label.

Source type: paper. Paper: linked separately.

Review scope and date are not recorded; source checked does not establish full-text review.

Editorial assessment: Impact 4/5 · Validation 3/5 · Novelty 4/5. Impact and novelty are editorial judgments; validation follows the annotated test type where one exists. Not an evidence grade. Scoring criteria.

Follow-up and relationships

No follow-up recorded; this is not a claim that no follow-up exists.

Follow-up review scope and date are not recorded.

No source-supported relationships recorded.

Open in the full catalog for filters, charts and related discoveries.