philosophyblog

Add a note

Simon Goldstein

What they did

Goldstein gave Claude a one-paragraph thesis and general instructions on writing philosophy papers; Claude did the literature review and wrote outlines and drafts, and he commented on every round and made many corrections. The resulting paper, "Epistocracy and the Commitment Problem", appeared in Philosophy & Public Affairs with Claude's role disclosed in the acknowledgments and a long report linked. Afterwards he built a general drafting agent, Deep Drafter, that splits paper writing into literature review, outlining, drafting, style editing and referee reviews.

In their words

"I worked with Claude the way a heavy-handed supervisor writes with a PhD student in some fields."

"Use AI agents, not chatbots. Write using Claude Code or Codex, with AIs managing a folder of documents."

"AIs have trouble coherently structuring long papers. AIs tend to repeat the same points."

Lessons they draw

  • Draft in many steps, with three rounds of outlines before the full paper, to fix organisation, redundancy and vagueness (Goldstein).
  • Give style examples and keep a style-principles document; give detailed comments on intermediate work, since more commenting gives better results (Goldstein).
  • Have the AI generate several candidate solutions and critique them before you read anything (Goldstein).
  • Failure modes: weak long-form structure, repetition, describing an argument without making it, obscure idiosyncratic terms (Goldstein).
  • Be transparent: disclose how AI was used and have the agent write a report at the end of who did what (Goldstein).
  • He deliberately intervened little in this paper, so he says its argument is more complex and its prose more bloated than he would like (Goldstein).

Limits of this account

Self-report by an author who advocates the practice; the journal editor describes it as an experiment, and I read the post from the section after the editor's introduction onward.

Search the collection

↑ ↓ move · Enter open · Shift+Enter original source · Esc close · Search index for agents

Keyboard shortcuts

Single keys work when you are not typing and no dialog is open. Turn them off if stray key presses move the page. ⌘K / Ctrl+K and Esc keep working.

/
Search the collection
⌘K / Ctrl+K
Open or close search
?
Show these shortcuts
h
Home
l
Lessons
a
Accounts
r
Replications
p
Papers
g
Guides and tools
d
Timeline
b
Bookmark the record you are reading (press again to remove it)
s
Your saved list and notes
← →
Previous and next record on an account, lesson, replication or paper page, and in a quick look
m
Switch between system, light and dark theme
t
Back to the top of the page
Open full page