historyblog

Add a note

Joshua Sternfeld

What they did

Sternfeld had Claude Code build, from a short prompt pointing at the API's README, an MCP server over Chronicling America (nearly 24 million digitised newspaper pages), with twelve tools including full-text search and retrieval of page OCR text. A first test for "artificial intelligence" in the nineteenth century returned 592,736 results, which Claude itself flagged as wrong and traced to the server missing a database migration. After the fix, a twentieth-century search showed the server dropping results the website returned, because an agent-chosen limit looked only at the first 8,000 characters of each page. He concludes that validating against the website is essential.

In their words

"The initial configuration was relatively easy and required little-to-no coding knowledge."

"should always test results against traditional search results on the website."

"we are farther from the promise of offloading historical research legwork than we may wish to acknowledge."

Lessons they draw

  • Test agent retrieval against the source's own search, because plausible-looking results can silently omit hits (Sternfeld).
  • An agent-proposed default (an 8,000-character context cap) became a hidden research bias until he noticed missing results (Sternfeld).
  • Setup is within a non-programmer historian's reach, debugging took minutes to hours rather than days (Sternfeld).

Limits of this account

Part I of two; Part II (the Jenny Lind research example) was not read. Read from the page text, which was long; the opening and the debugging sections were read in full. Claude Sonnet 4.6 is named on the page; the Claude Code version is not. The second quote is a lightly truncated sentence ("I recommend that anyone ... should always test results ..."), shown verbatim from "should always" onward.

Search the collection

↑ ↓ move · Enter open · Shift+Enter original source · Esc close · Search index for agents

Keyboard shortcuts

Single keys work when you are not typing and no dialog is open. Turn them off if stray key presses move the page. ⌘K / Ctrl+K and Esc keep working.

/
Search the collection
⌘K / Ctrl+K
Open or close search
?
Show these shortcuts
h
Home
l
Lessons
a
Accounts
r
Replications
p
Papers
g
Guides and tools
d
Timeline
b
Bookmark the record you are reading (press again to remove it)
s
Your saved list and notes
← →
Previous and next record on an account, lesson, replication or paper page, and in a quick look
m
Switch between system, light and dark theme
t
Back to the top of the page
Open full page