AI reviewers favored confident wording in matched research papers
Source check: Source checked. Not independent scientific confirmation.
Finding: In a 504-paper experiment, all six model reviewers more often gave higher scores to rewrites with confident wording. Claude Sonnet 4.6 favored the confident version in 40% of pairs and the less confident version in 6%, with 54% tied. Researchers checked text similarity and wording shifts before comparing evaluations.
Technology: Claude Sonnet 4.6; GPT-5.5; Gemini; Gemma; Qwen; GLM
Family Claude: profile · models page
Publication: Preprint · Test context: direct test. Catalog categories, not an evidence grade.
- AI contribution
- Language models generated matched high- and low-confidence prose variants and six model reviewers independently scored the rewritten versions.
- Test and result
- Each model independently evaluated one rewrite at a time for each pair under standardized review instructions. The study checked style manipulation and content similarity on the rewritten manuscripts.
- Limitation / still unknown
- Rewriting can introduce small uncontrolled meaning changes. The experiment concerns model scores and does not measure actual conference decisions.
Evidence sources and annotation context
Evidence context (descriptions follow the cited sources; test type is a catalog classification):
Evidence sources: https://arxiv.org/abs/2610.35254v1 · https://arxiv.org/html/2610.35254v1
Source checked · editorial details
The source page was checked against this entry. Independent confirmation is not assessed by this label.
Source type: paper. Paper: linked separately.
Review date: 21 Nov 2026. Review scope: v1 paired rewrite checks and 504-paper comparative review experiment, Table 4.
No follow-up recorded; this is not a claim that no follow-up exists. Follow-up review scope and date are not recorded. No source-supported relationships recorded.
Editorial assessment: Impact 2/5 · Validation 3/5 · Novelty 3/5. Impact and novelty are editorial judgments; validation follows the annotated test type where one exists. Not an evidence grade. Scoring criteria.