AI Science Tracker
EN

A two-feature interface lost information for controlling SmolLM2 responses

University of California, Irvine · 20 Oct 2026 · computer science

Discovery

A two-feature interface lost information for controlling SmolLM2 responses

Source check: Source checked. Not independent scientific confirmation.

Finding: In a 96-state SmolLM2 evaluation, giving a response controller only two learned sparse features and the governing policy raised the best attainable average loss by 0.1166 and 0.1082 for two separately trained autoencoders, compared with access to the full state. Two human raters scored responses used in the calculation. The reported differences concern a fixed set of scored responses and a composite quality measure.

Technology: SmolLM2; sparse autoencoders

Publication: Preprint · Test context: direct test. Catalog categories, not an evidence grade.

AI contribution
Two separately trained sparse autoencoders encoded SmolLM2 activations. Restricting the controller to two selected binary feature indicators made different response states indistinguishable to it, allowing exact calculation of the information cost under the fixed outcome table.
Test and result
Researchers computed best achievable scores for predefined strategies on the same outcomes under two inputs: full state, or policy plus two feature indicators. The 96 states were held out by policy area. Both autoencoders showed positive differences while keeping responses and scores fixed.
Limitation / still unknown
The calculations concern finite scored tables and are not a tested policy's future error rate. The composite score is not an unsafe-event rate. Two selected features do not establish general information loss across sparse autoencoder interfaces.
Evidence sources and annotation context

Evidence context (descriptions follow the cited sources; test type is a catalog classification):

Evidence sources: https://arxiv.org/abs/2610.27446 · https://arxiv.org/html/2610.27446

Source checked · editorial details

The source page was checked against this entry. Independent confirmation is not assessed by this label.

Source type: paper. Paper: linked separately.

Review date: 21 Nov 2026. Review scope: Original arXiv v1 abstract/metadata and full-text HTML §§1, 4.3–4.4 and 5.1, including human ratings and Table 3.

No follow-up recorded; this is not a claim that no follow-up exists. Follow-up review scope and date are not recorded. No source-supported relationships recorded.

Editorial assessment: Impact 2/5 · Validation 3/5 · Novelty 2/5. Impact and novelty are editorial judgments; validation follows the annotated test type where one exists. Not an evidence grade. Scoring criteria.

Open in the full catalog for filters, charts and related discoveries. Browse computer science discoveries.

Related catalog entries

Links use documented relationships where available, plus shared catalog context. A shared topic or model family does not establish a scientific dependency.