AI Science Tracker
EN

École Polytechnique

1 discovery from 2026

Discoveries

Model-scored concrete examples tracked successful replies in online debates

Source check: Source checked. Not independent scientific confirmation.

Finding: Across 800 held-out pairs of Reddit ChangeMyView replies to the same post, the reply that earned the original poster’s change-of-view award scored higher for concrete examples in 60.4% of pairs and for qualified rebuttals in 59.6%. The language model scores describe associations with human-awarded outcomes.

Technology: GPT-5.4 mini; GPT-5.4; statistical choice model

Family GPT-5: profile · models page

Publication: Preprint · Test context: retrospective or benchmark. Catalog categories, not an evidence grade.

AI contribution
GPT-5.4 mini compared and scored Reddit discussion replies. GPT-5.4 grouped rationales into features, and the fitted choice model and reliability filter assessed which features to retain.
Test and result
Among 800 held-out same-topic pairs, the user-awarded successful reply had a higher concrete-illustration score in 60.4% of pairs (95% CI 57.0–63.8), qualified rebuttal score in 59.6%, and evidentiary support score in 57.5%.
Limitation / still unknown
Model ratings were not independently human-annotated for each feature. The comparisons use filtered pairs in one forum, and the associations do not show that adding a feature would change a reader’s mind.
Evidence sources and annotation context

Evidence context (descriptions follow the cited sources; test type is a catalog classification):

Evidence sources: https://arxiv.org/abs/2610.38082v1 · https://arxiv.org/html/2610.38082v1

Source checked · editorial details

The source page was checked against this entry. Independent confirmation is not assessed by this label.

Source type: paper. Paper: linked separately.

Review date: 21 Nov 2026. Review scope: arXiv v1 §§3 and 5, Appendix D.1–D.3, Fig. 21 and Table 10.

No follow-up recorded; this is not a claim that no follow-up exists. Follow-up review scope and date are not recorded. No source-supported relationships recorded.

Editorial assessment: Impact 2/5 · Validation 2/5 · Novelty 2/5. Impact and novelty are editorial judgments; validation follows the annotated test type where one exists. Not an evidence grade. Scoring criteria.

Open the interactive profile for the timeline, or browse all organizations and model families.