linguisticspaper

Add a note

Jia Yu, Weiwei Yu, Pengfei Xiao, Fukun Xing

What they did

The authors link an LLM agent (Claude Opus in a command-line coding environment) to a CQP-indexed corpus through MCP and give it the single instruction to investigate English intensifiers in a 5-million-token Gutenberg corpus. The agent produced a diachronic chain (so+ADJ to very to really), pathways of semantic change and register patterns; a baseline with the same model without corpus access isolates what grounding adds. To test validity, the agent replicated two published studies on the CLMET corpus (Claridge 2025 on the decline of "reader", De Smet 2013 on gerund complements) with close quantitative agreement, as the authors report.

In their words

"The sole human instruction was: “Investigate the use of English intensifiers in this corpus.”"

"The human researcher sets the research direction and evaluates the final output."

"the agent replicated two published studies on the CLMET corpus (40 million tokens)"

Lessons they draw

  • Ground the agent in verifiable corpus evidence through tools, and run a with/without-corpus baseline to see what the model brings from training data (Yu et al.).
  • Test external validity by having the agent replicate published studies (Yu et al.).
  • Stated limits: the 5-million-word Gutenberg corpus is small and skewed to the 19th century, low-frequency items give unreliable statistics, and interpretive frameworks may draw on parametric knowledge that is hard to disentangle (Yu et al.).

Limits of this account

A proposal-and-demonstration paper by the framework's authors; one corpus task plus two replications, and I did not read the full results and discussion sections.

Search the collection

↑ ↓ move · Enter open · Shift+Enter original source · Esc close · Search index for agents

Keyboard shortcuts

Single keys work when you are not typing and no dialog is open. Turn them off if stray key presses move the page. ⌘K / Ctrl+K and Esc keep working.

/
Search the collection
⌘K / Ctrl+K
Open or close search
?
Show these shortcuts
h
Home
l
Lessons
a
Accounts
r
Replications
p
Papers
g
Guides and tools
d
Timeline
b
Bookmark the record you are reading (press again to remove it)
s
Your saved list and notes
← →
Previous and next record on an account, lesson, replication or paper page, and in a quick look
m
Switch between system, light and dark theme
t
Back to the top of the page
Open full page