An unstated country representation guides Qwen’s capital answers
Source check: Source checked. Not independent scientific confirmation.
Finding: In a controlled two-step geography task, researchers changed a representation of a country that was never named in the prompt. At the city token, the intervention redirected Qwen2.5-7B to the paired country’s capital in 79% of 1,038 pairs. The country was also readable later in the prompt, where the intervention had no effect at the tested layers. This experiment is reported in the November 11 preprint version.
Technology: Qwen2.5-7B, cross-fitted country subspaces
Family Qwen: profile · models page
Publication: Preprint · Test context: direct test. Catalog categories, not an evidence grade.
- AI contribution
- Country subspaces were estimated on one half of the pretrained Qwen2.5-7B city examples, then used in a controlled intervention on matched held-out city examples.
- Test and result
- The preregistered intervention compared held-out matched city pairs against random and copied-embedding subspaces, whole-state replacement, and same-country pairs.
- Limitation / still unknown
- The test concerns one model and a constrained task on cities the model already answered correctly. Other tasks and weak latent signals remain unestablished.
Evidence sources and annotation context
Evidence context (descriptions follow the cited sources; test type is a catalog classification):
Evidence sources: https://arxiv.org/abs/2610.28498 · https://arxiv.org/html/2610.28498v3 · https://arxiv.org/html/2610.28498v1 · https://arxiv.org/html/2610.28498v2
Source checked · editorial details
The source page was checked against this entry. Independent confirmation is not assessed by this label.
Source type: paper. Paper: linked separately.
Review date: 21 Nov 2026. Review scope: arXiv metadata and v3 §5 and Appendix E, with v1/v2 text checked for the country-to-capital experiment.
No follow-up recorded; this is not a claim that no follow-up exists. Follow-up review scope and date are not recorded. No source-supported relationships recorded.
Editorial assessment: Impact 2/5 · Validation 3/5 · Novelty 3/5. Impact and novelty are editorial judgments; validation follows the annotated test type where one exists. Not an evidence grade. Scoring criteria.