Nature 655, 497–505 (page range taken from the running footers)
A multi-agent system for automating scientific discovery
Robin (Ghareeb et al., Nature, 2026)
What the paper does
A FutureHouse and Fordham team describes Robin, a workflow of language agents that, given a disease name, proposes in vitro assays and drug candidates and then analyses the laboratory data a human produces. Two literature agents built on PaperQA2, Crow (short reviews) and Falcon (long reports on each candidate), feed an LLM-judged pairwise tournament that ranks assays and candidates. A data analysis agent, Finch, writes and runs Jupyter notebooks on raw data (flow cytometry, RNA sequencing). Robin uses o4-mini to synthesise literature and Claude 3.7 Sonnet as judge. The Methods say Robin "almost always called tools in the same order", so the paper's experiments were run as a fixed notebook sequence rather than free agent choice.
It was asked for treatments for dry age-related macular degeneration (dAMD). Robin proposed boosting phagocytosis by retinal pigment epithelium (RPE) cells, a flow-cytometry assay, and 30 existing drugs. The human team tested five (exendin-4, fingolimod, MFGE8 as a known positive control, Y-27632, and AICAR plus TUDCA). Y-27632, a Rho kinase (ROCK) inhibitor, increased phagocytosis. Robin then proposed RNA-seq, which showed upregulation of ABCA1, and a second candidate round, which led to ripasudil (another ROCK inhibitor, approved for glaucoma in Japan) and KL001.
Results worth quoting
How results were checked, and by whom
- Bench experiments (external to the agents). Done by the authors' laboratory: ARPE-19 cells first (n = 3 wells), then primary RPE stem cells from one donor over 60 (four technical replicates), with fluorescent bovine rod outer segments instead of beads. Ripasudil raised phagocytosis 1.89-fold over DMSO in ARPE-19 by Finch's analysis (human analysis 1.75-fold; Fig. 4b). In primary cells ripasudil and Y-27632 were again hits and ripasudil more potent (Fig. 4d,e). KL001 was a hit in the primary cells. ABCA1 upregulation was repeated by RNA-seq in primary cells (Supplementary Fig. 17). No animal or clinical work, and ABCA1 was not tested functionally.
- Human reanalysis of Finch. A human scientist reanalysed the flow data and the RNA-seq results; the text says these "confirmed" Finch (Supplementary Figs 13–16; not read). Read alignment for RNA-seq was done by a human; Finch did the differential expression.
- Hallucinated references (Extended Data Fig. 4). One scientist, blinded to the source, tried to find every cited paper in ten randomly chosen proposals; an unidentifiable reference counted as hallucinated. Replacing Crow and Falcon with o4-mini alone sharply raised hallucinated references. For assay proposals, 44.5 ± 6.37% (mean ± s.e.m., n = 15) of o4-mini's references were hallucinated, against none from Crow. Ablating Crow alone did not raise the rate for drug-candidate reports, because Falcon corrected Crow's invented references.
- LLM judge versus experts. The judge's top ten matched the experts' top ten on 7.25 items on average, and repeated the same choice in 88% of repeated comparisons against 61% for human experts (Methods). The judge's prompt was itself written by Gemini 2.5 Pro from expert comparisons.
- Finch benchmarks. On 170 BixBench questions (n = 3 runs) Finch scored 22.8 ± 1.7% overall against 1.6 ± 1.2% for the base model with no data or tools; 47.9% on biostatistics, 15.3% on bioinformatics. On the paper's own round-two tasks, against expert rubrics, Finch scored 86 ± 0% for RNA-seq and 100 ± 0% for flow cytometry (n = 3 runs). Those tasks had task-specific prompts that the authors say they "thoroughly explored", so these two scores say little about unseen analyses (my reading).
- Comparison with OpenAI Deep Research. Given the same prompt, it produced 17 unique candidates; none was a hit in the primary-cell assay and none was a ROCK inhibitor (Extended Data Fig. 6). One run of one baseline.
Counts. 151 papers read to propose 10 mechanisms; about 400 papers for assay and candidate review; 30 candidates, of which five were tested in round one and ten in round two. Whether the other drugs in each round were hits is not stated in the text I extracted (Fig. 4b marks significance per drug). The Deep Research comparison says 19 Robin candidates in total; five plus ten is 15, so the count of 19 is unexplained (probably candidates added in later steps; uncertain).
What the humans did. Chose the disease; reviewed the ranked list and picked the top candidates; ran every experiment; chose the assay materials (used pHrodo beads and ARPE-19 cells although Robin suggested outer segments and primary or stem-cell RPE); picked drug concentrations from the literature (the highest proposed); chose which analysis to ask for ("flow cytometry", "differential expression analysis"); did RNA-seq alignment; chose which round-two drugs to test; and formatted the figures for publication. The abstract says "All hypotheses, experimental directions, data analyses and data figures in the main text of this report were produced by Robin"; the paper also says "The cycle continues until a human has a satisfactory drug candidate". Time claims (359–424 human hours against under 2 h; "200-fold") come from survey-based estimates, not measured human work (Table 1). Cost per Robin run was US$10.76.
The authors' own caveats
- The system needs expert prompt engineering: "Finch ... is also reliant on prompt engineering by domain experts". Finch's analyses "can vary between runs, even when given identical prompts and data"; the authors run eight trajectories and take a consensus (the same genes called in over 50% of trajectories, Fig. 3c).
- Robin gives experiment outlines, not executable protocols.
- Finch struggles on multi-step pipelines (15.3% on bioinformatics questions).
- All validation is in vitro; ripasudil needs in vivo work and ultimately a randomised trial. ROCK inhibitors were already known to enhance RPE phagocytosis (refs 35–37, including work by a co-author's laboratory); the authors describe Robin as targeting "low-hanging fruit".
- Reproducibility: Robin and Finch code, sample trajectories and RNA-seq data (SRA PRJNA1464762) are public. A tension: the reporting summary says "No data was excluded", while Fig. 4c and 4e label outliers (one in c, several in e) that were left out of the fits.
- Competing interests: most authors hold shares in Edison Scientific, a FutureHouse spin-out.
Ideas that travel beyond drug repurposing
- Output must be checkable (supports). Each recommendation is a specific drug and a specific assay; every literature claim has a reference that can be looked up, and the authors did look them up. The hallucination figures show the check mattering: an unaided model invented nearly half its references.
- External checks the agent cannot alter (supports, with qualification). The cell experiments are external, run by people. But human selection came between the agent's list and the bench, the agent's analysis of those data was only partly independently re-run, and the agent-versus-agent comparisons (ablations, Crow/Falcon quality) are judged by another LLM, whose agreement with experts is moderate (7.25 of 10).
- "Done"/"verified" as claims (supports). Falcon corrected Crow's hallucinated references, and the paper reports no signal that this happened until the authors ablated Falcon to find out; a clean final report did not show the stage before it was clean. Finch's consensus across eight runs is agreement among runs of one model, not verification; agreement with the human analysis is the stronger evidence.
- Silent omission (supports). The text does not say how many of each tested set failed, nor what happened to the untested drugs (25 of 30 in round one). The ablation of one agent that hid the errors of another is a clear case of omission by correction.
- Councils and multiple models (mixed). Three model families appear: o4-mini generates, Claude judges, Gemini writes the judge's prompt. Eight Finch trajectories give a consensus. The judge shows lower variability than experts (88% against 61%), but consistency is not the same as correctness.
- Disclosure (complicated). Prompts, trajectories and code are public, which is strong. But "produced by Robin" is a stronger statement than the Methods support, given the listed human choices and the deviation from Robin's suggested assay materials. The human-versus-agent split is detailed in the Methods; the abstract does not mention it.
Limits for our purposes
One disease, one assay, one laboratory, one donor for the primary-cell step, and replicates that are wells, not independent experiments. The headline candidate belongs to a drug class already known to work on the assay, so novelty is mostly in the specific drug, not the mechanism. The time-saving numbers are modelled estimates. For research outside wet-lab biology, the useful pieces are the reference-checking ablation, the practice of re-running the analysis agent several times, and the repeated check against a human analysis of the same data.