AI Science Tracker
EN

External ALS trial data show limited added prediction accuracy from learned progression models

University of Michigan; Genentech · 30 Aug 2020 · medicine

Discovery

External ALS trial data show limited added prediction accuracy from learned progression models

Source check: Source checked. Not independent scientific confirmation.

Finding: Random-forest and ensemble models trained on 3160 ALS trial participants were evaluated in a separate 509-patient trial dataset. They predicted later functional scores with performance similar to a linear mixed-effects model, with only marginal improvements in error and explained variation. Missing-data handling improved generalization. The result is retrospective clinical prediction validation; suggested clinical-trial power gains came from simulations, not an actual improved treatment trial.

Technology: Random forest; super learner ensemble; random-forest missing-data imputation

Publication: Peer-reviewed paper · Test context: retrospective or benchmark. Catalog categories, not an evidence grade.

AI contribution
Random forests and an ensemble learn relationships between baseline clinical covariates, time from baseline and later functional scores. Predicted trajectories are evaluated against an independent historical trial and used separately in trial-power simulations.
Test and result
Final models trained on 3160 PRO-ACT patients were compared against observed ALSFRS-R trajectories in 509 patients from a separate completed olesoxime trial. The learned models marginally outperformed a conventional mixed-effects comparator, with roughly 1percentage-point additional explained variation.
Limitation / still unknown
Both datasets were existing clinical-trial records. Prediction became poorer farther from baseline, and results do not establish treatment-effect estimation or patient benefit. A simulated16% effective-sample-size gain under a hypothetical treatment effect is not an observed clinical-trial gain. Random-forest and ensemble models do not explicitly account for within-person longitudinal correlation; missing-at-random assumptions may fail outside these data.
Evidence sources and annotation context

Evidence context (descriptions follow the cited sources; test type is a catalog classification):

Evidence sources: https://pmc.ncbi.nlm.nih.gov/articles/PMC7545604/

Source checked · editorial details

The source page was checked against this entry. Independent confirmation is not assessed by this label.

Source type: paper. Paper: not linked in this catalog; this does not mean no paper exists.

Review date: 21 Nov 2026. Review scope: Exact primary XML article-front identity/date, clinical cohorts, covariates, model/imputation and validation Methods, observed prediction Results and simulation/longitudinal limitations; fresh primary notice metadata..

No follow-up recorded; this is not a claim that no follow-up exists. Follow-up review scope and date are not recorded. No source-supported relationships recorded.

Editorial assessment: Impact 2/5 · Validation 2/5 · Novelty 2/5. Impact and novelty are editorial judgments; validation follows the annotated test type where one exists. Not an evidence grade. Scoring criteria.

Open in the full catalog for filters, charts and related discoveries. Browse medicine discoveries.

Related catalog entries

Links use documented relationships where available, plus shared catalog context. A shared topic or model family does not establish a scientific dependency.