AI Science Tracker

Barbarians at the Gate: AI-driven research for systems (ADRS)

UC Berkeley · 7 Oct 2025 · computer science

Discovery

UC Berkeley

Barbarians at the Gate: AI-driven research for systems (ADRS)

An LLM-driven generate-evaluate-refine loop built on OpenEvolve produced systems algorithms in case studies, with the abstract reporting up to 5.0x runtime improvements or 50% cost reductions over baselines. Solutions are checked with simulators or real systems, which is the validation basis. The results are on specific case studies rather than a general claim, and the work is a preprint.

Technology: OpenEvolve (LLM-driven evolutionary code search, ADRS framework)

Publication: Preprint · Test context: retrospective or benchmark. Catalog categories, not an evidence grade.

Result, AI contribution and limits

Evidence context (descriptions follow the cited sources; test type is a catalog classification):

  • Publication status: Preprint
  • Test type: retrospective or benchmark
  • Tested: Generated systems algorithms were run against predefined workloads in real systems or simulators and compared with state-of-the-art human designs across case studies (cloud load balancing, MoE inference, LLM SQL queries, transaction scheduling). The abstract reports up to 5.0x runtime improvement or 50% cost reduction.
  • Still unknown: The method assumes a reliable verifier, which the authors present as a precondition; the page has no dedicated limitations section and the work is a preprint.
  • AI role: An LLM-driven generate-evaluate-refine loop (penEvolve, an open-source ADRS instance) proposed the algorithms.

Evidence sources: https://arxiv.org/abs/2510.06189

Source checked · editorial details

The source page was checked against this entry. Independent confirmation is not assessed by this label.

Source type: paper. Paper: linked separately.

Review scope and date are not recorded; source checked does not establish full-text review.

Editorial assessment: Impact 3/5 · Validation 2/5 · Novelty 3/5. Impact and novelty are editorial judgments; validation follows the annotated test type where one exists. Not an evidence grade. Scoring criteria.

Follow-up and relationships

No follow-up recorded; this is not a claim that no follow-up exists.

Follow-up review scope and date are not recorded.

No source-supported relationships recorded.

Open in the full catalog for filters, charts and related discoveries.