ChemCrow: a language-model agent with chemistry tools
An agent with 18 tools and GPT-4 planned and carried out the synthesis of DEET and three thiourea organocatalysts on a cloud platform, and guided discovery of a chromophore absorbing at 336 nm against a 369 nm target; evaluated on 14 cases by four expert chemists. Hallucinations, limited tasks and dual-use risks; 12 of 18 tools were released.
Technology: ChemCrow (GPT-4 with tools)
Family GPT-4: profile · models page
Publication: Preprint · Test context: direct test. Catalog categories, not an evidence grade.
Result, AI contribution and limits
Evidence context (descriptions follow the cited sources; test type is a catalog classification):
- Publication status: Preprint
- Test type: direct test
- Tested: Expert and LLM judgments were used to evaluate the agent, which planned and executed syntheses of an insect repellent and three organocatalysts and guided discovery of a chromophore.
- Still unknown: The abstract says LLMs struggle with chemistry and lack external knowledge, and GPT-4 as evaluator could not distinguish clearly wrong completions from ChemCrow's performance.
- AI role: An LLM agent with 18 expert-designed chemistry tools planned and executed syntheses and guided molecular discovery; the page does not name the underlying model.
Evidence sources: https://arxiv.org/abs/2304.05376
Source checked · editorial details
The source page was checked against this entry. Independent confirmation is not assessed by this label.
Source type: paper. Paper: not linked in this catalog; this does not mean no paper exists.
Review scope and date are not recorded; source checked does not establish full-text review.
Citations: in the top 1% of works of the same type, year and subfield (OpenAlex work metrics, 1741 citations; as of 15 Nov 2026). Attention, not a measure of correctness; not part of the score.
Editorial assessment: Impact 3/5 · Validation 3/5 · Novelty 3/5. Impact and novelty are editorial judgments; validation follows the annotated test type where one exists. Not an evidence grade. Scoring criteria.
Follow-up and relationships
No follow-up recorded; this is not a claim that no follow-up exists.
Follow-up review scope and date are not recorded.
No source-supported relationships recorded.