AI Science Tracker
EN

Model-scored concrete examples tracked successful replies in online debates

École Polytechnique; Northwestern University · 27 Oct 2026 · humanities

Discovery

Model-scored concrete examples tracked successful replies in online debates

Source check: Source checked. Not independent scientific confirmation.

Finding: Across 800 held-out pairs of Reddit ChangeMyView replies to the same post, the reply that earned the original poster’s change-of-view award scored higher for concrete examples in 60.4% of pairs and for qualified rebuttals in 59.6%. The language model scores describe associations with human-awarded outcomes.

Technology: GPT-5.4 mini; GPT-5.4; statistical choice model

Family GPT-5: profile · models page

Publication: Preprint · Test context: retrospective or benchmark. Catalog categories, not an evidence grade.

AI contribution
GPT-5.4 mini compared and scored Reddit discussion replies. GPT-5.4 grouped rationales into features, and the fitted choice model and reliability filter assessed which features to retain.
Test and result
Among 800 held-out same-topic pairs, the user-awarded successful reply had a higher concrete-illustration score in 60.4% of pairs (95% CI 57.0–63.8), qualified rebuttal score in 59.6%, and evidentiary support score in 57.5%.
Limitation / still unknown
Model ratings were not independently human-annotated for each feature. The comparisons use filtered pairs in one forum, and the associations do not show that adding a feature would change a reader’s mind.
Evidence sources and annotation context

Evidence context (descriptions follow the cited sources; test type is a catalog classification):

Evidence sources: https://arxiv.org/abs/2610.38082v1 · https://arxiv.org/html/2610.38082v1

Source checked · editorial details

The source page was checked against this entry. Independent confirmation is not assessed by this label.

Source type: paper. Paper: linked separately.

Review date: 21 Nov 2026. Review scope: arXiv v1 §§3 and 5, Appendix D.1–D.3, Fig. 21 and Table 10.

No follow-up recorded; this is not a claim that no follow-up exists. Follow-up review scope and date are not recorded. No source-supported relationships recorded.

Editorial assessment: Impact 2/5 · Validation 2/5 · Novelty 2/5. Impact and novelty are editorial judgments; validation follows the annotated test type where one exists. Not an evidence grade. Scoring criteria.

Open in the full catalog for filters, charts and related discoveries. Browse humanities discoveries.

Related catalog entries

Links use documented relationships where available, plus shared catalog context. A shared topic or model family does not establish a scientific dependency.