Mind captioning: text descriptions of viewed videos decoded from fMRI
In six participants, a language-model pipeline translated fMRI responses to viewed videos into descriptions of their semantic content. Video identification reached about 50% among 100 candidates, compared with 1% chance. Results also extended to instructed video recall and persisted when the canonical language network was excluded, supporting a shared semantic representation beyond that network. The experiment used extensive participant-specific training; it was not unrestricted reading of private thoughts or a clinical aphasia trial.
Technology: Deep language model semantic-feature decoder with text generation search
Publication: Peer-reviewed paper · Test context: retrospective or benchmark. Catalog categories, not an evidence grade.
Result, AI contribution and limits
Evidence context (descriptions follow the cited sources; test type is a catalog classification):
- Publication status: Peer-reviewed paper
- Test type: retrospective or benchmark
- Tested: Video viewing and instructed recall in six participants; 2,180 unique videos in training and comparisons with analyses excluding the canonical language network.
- Still unknown: Small participant group and extensive per-person training. Clinical communication benefits and arbitrary private-thought decoding were not tested.
- AI role: Linear decoders mapped fMRI signals to deep-language-model semantic features; a language model guided text optimization.
Evidence sources: https://pmc.ncbi.nlm.nih.gov/articles/PMC12588295/ · https://www.ebi.ac.uk/europepmc/webservices/rest/search?query=DOI%3A%2210.1126%2Fsciadv.adw1464%22&resultType=core&format=json
Source checked · editorial details
The source page was checked against this entry. Independent confirmation is not assessed by this label.
Source type: paper. Paper: not linked in this catalog; this does not mean no paper exists.
Review scope and date are not recorded; source checked does not establish full-text review.
Citations: in the top 10% of works of the same type, year and subfield (OpenAlex work metrics, 15 citations; as of 15 Nov 2026). Attention, not a measure of correctness; not part of the score.
Editorial assessment: Impact 4/5 · Validation 2/5 · Novelty 5/5. Impact and novelty are editorial judgments; validation follows the annotated test type where one exists. Not an evidence grade. Scoring criteria.
Follow-up and relationships
No follow-up recorded; this is not a claim that no follow-up exists.
Follow-up review scope and date are not recorded.
No source-supported relationships recorded.