About the collection

Progress in using AI agents to empower researchers is rapid but still very unevenly distributed. Many researchers have been reporting great benefits while others are still complaining about ChatGPT hallucinating references. This is a collection of public accounts by researchers who shared their usage and lessons learned. It was compiled by AI agents at the direction of Dominik Lukeš who also provided some of his own use cases.

The page has 39 accounts from researchers across many disciplines, with the most recent accounts first and accounts dated only to a year at the end. Accounts written before March 2026 are flagged with the models current at the time, because models and agent tools have changed fast. The seven lessons draw first on accounts from June 2026 onwards and use earlier examples where they explain a specific point. Earlier accounts, including those from 2025, are still in the collection. There are 20 records of systematic attempts to have agents or language models replicate published research, also with the most recent first. And there are notes on five key papers: Paper2Agent, the agentic AI methods primer, and three 2026 Nature papers on AI scientist systems. The public resources include workflow guides, software, and workshop slides and recordings.

The first three lessons ask what makes a question worth answering, how to build the method and its checks together, and how to use a council of models to get separate opinions on a decision. The thread running through the lessons is that agents are most dependable where the output can be checked, and the work is in building those checks. Where there is a right answer, that means a check target the agent can test itself against. Where there is not, it means cheap 'checksums': a second, independent route to the same result, or a way of making the result visible so that someone who knows the field can judge it. The replication studies point the same way: agents do well rerunning a package of code and data that the authors supplied, and much worse rebuilding the analysis from the paper alone. And a score a system gives its own work is not a check. Much of what matters is unglamorous: keeping the plan in a file, using version control, comparing counts against an independent source.

Take these accounts as reported practice, mostly from enthusiasts. People write up what worked, so they are not evidence of typical results. The collection was assembled and summarised with AI assistance from public sources. It is a working collection, not a survey.

Search the collection

↑ ↓ move · Enter open · Shift+Enter original source · Esc close · Search index for agents

Keyboard shortcuts

Single keys work when you are not typing and no dialog is open. Turn them off if stray key presses move the page. ⌘K / Ctrl+K and Esc keep working.

/
Search the collection
⌘K / Ctrl+K
Open or close search
?
Show these shortcuts
h
Home
l
Lessons
a
Accounts
r
Replications
p
Papers
g
Guides and tools
d
Timeline
b
Bookmark the record you are reading (press again to remove it)
s
Your saved list and notes
← →
Previous and next record on an account, lesson, replication or paper page, and in a quick look
m
Switch between system, light and dark theme
t
Back to the top of the page
Open full page