historyblog
Joshua Sternfeld
More in humanities
- John H Boyerphilosophy, 20 Nov 2026
- Lawrence Evalynliterary studies, 18 Sep 2026
- Simon Goldsteinphilosophy, 13 Aug 2026
- Gus Skorburgphilosophy, 11 Aug 2026
- Jia Yu, Weiwei Yu, Pengfei Xiao, Fukun Xinglinguistics, 8 Apr 2026
What they did
Sternfeld had Claude Code build, from a short prompt pointing at the API's README, an MCP server over Chronicling America (nearly 24 million digitised newspaper pages), with twelve tools including full-text search and retrieval of page OCR text. A first test for "artificial intelligence" in the nineteenth century returned 592,736 results, which Claude itself flagged as wrong and traced to the server missing a database migration. After the fix, a twentieth-century search showed the server dropping results the website returned, because an agent-chosen limit looked only at the first 8,000 characters of each page. He concludes that validating against the website is essential.
In their words
"The initial configuration was relatively easy and required little-to-no coding knowledge."
"should always test results against traditional search results on the website."
"we are farther from the promise of offloading historical research legwork than we may wish to acknowledge."
Lessons they draw
- Test agent retrieval against the source's own search, because plausible-looking results can silently omit hits (Sternfeld).
- An agent-proposed default (an 8,000-character context cap) became a hidden research bias until he noticed missing results (Sternfeld).
- Setup is within a non-programmer historian's reach, debugging took minutes to hours rather than days (Sternfeld).
Limits of this account
Part I of two; Part II (the Jenny Lind research example) was not read. Read from the page text, which was long; the opening and the debugging sections were read in full. Claude Sonnet 4.6 is named on the page; the Claude Code version is not. The second quote is a lightly truncated sentence ("I recommend that anyone ... should always test results ..."), shown verbatim from "should always" onward.