Skip to the content

The Court of Public Prose

In re Dead Writing Theory

Case No.
DWT-008
Matter
The delve study, done properly
Filed
Verdict
Verdict for the prosecution

The machine's words spread through medicine, measured without a detector.

For the prosecution every exhibit in this case · P-11 to P-12
The question
How widely were large language models used to write biomedical research abstracts by 2024, judged from the words that rose above their expected frequency?
The sample
15.1 million English-language PubMed abstracts from 2010 to 2024; each word's 2024 frequency compared with a projection from its 2021 to 2022 trend
Filed
The study
Delving into LLM-assisted writing in biomedical publications through excess vocabulary Dmitry Kobak, Rita González-Márquez, Emőke-Ágnes Horvát, Jan Lause. University of Tübingen and Northwestern University. Science Advances 11(27), 2025.

§ IFindings of fact

What the study found.

  1. "Delves" was used 28.0 times as often as expected in 2024; "underscores" 13.8 times and "showcasing" 10.7 times.
  2. 379 style words showed excess use in 2024: 66% were verbs and 14% adjectives. In earlier years the excess words were content words, such as Covid terms.
  3. At least 13.5% of 2024 abstracts were processed with LLMs: at least 200,000 papers a year.
  4. The lower bound ranged from below 5% to over 40% across fields, countries and journals.
  5. The LLM words gave a frequency gap of 0.135 against 0.069 for the four Covid words of 2021: LLM usage in 2024 was at least two times the size of the Covid-related literature in 2021.

§ IICaveats for the jury

What this study cannot tell the court.

  • A lower bound: abstracts that went through an LLM without using any of the marker words are not counted, so the true share is likely higher.
  • Abstracts only, a short and formulaic genre.
  • It measures uptake of the machine's words, not rhythm, sentence shape or punctuation.

§ IVThe exhibits entered in this case

Prosecution v. Defence

Any tally counts the evidence items below; it is not a measure of truth.

Evidence for the theory

For the prosecution

2 exhibits
  1. Exhibit P-11Case No. DWT-008

    28.0×

    expected use of "delves" in 2024 PubMed abstracts

    "Delves" turned up 28 times as often as expected

    Expected from the 2021 to 2022 trend, across 15.1 million abstracts. "Underscores" 13.8×, "showcasing" 10.7×. 379 style words showed excess use in 2024.

    Entered for the prosecution · Kobak et al., Science Advances 11(27), 2025 · third-party study

  2. Exhibit P-12Case No. DWT-008

    13.5%

    of 2024 PubMed abstracts, a lower bound

    At least 13.5% of 2024 biomedical abstracts were processed with LLMs

    From excess style words, not a detector. Below 5% to over 40% across fields, countries and journals; at least two times the size of the 2021 Covid literature.

    Entered for the prosecution · Kobak et al., Science Advances 11(27), 2025 · third-party study

Evidence against the theory

For the defence

0 exhibits

No exhibit entered for the defence in this case.

§ VThe finding

The finding

Excess words in 15.1 million PubMed abstracts: "delves" ran 28.0 times its expected rate in 2024, and at least 13.5% of 2024 abstracts were processed with LLMs.
Verdict for the prosecutionCase No. DWT-008 · The delve study, done properly
Read the original studyKobak et al., Science Advances 11(27), 2025. Not our study.

§ VIQuestions for the court

Asked and answered.

How much biomedical writing involves AI?

At least 13.5% of 2024 PubMed abstracts were processed with LLMs, according to Kobak, González-Márquez, Horvát and Lause (Science Advances, 2025). That is a lower bound, and it ranged from below 5% to over 40% across fields, countries and journals.

How did they measure it without an AI detector?

Like excess deaths in a pandemic. They projected each word's 2024 frequency from its 2021 to 2022 trend across 15.1 million abstracts, then counted the words that overshot. "Delves" ran 28.0 times its expected rate.

Is this evidence that writing is converging?

On vocabulary, partly: 379 style words rose together in 2024. It says nothing about rhythm or punctuation, and abstracts are a narrow genre.

Is this a ScriptGrain study?

No. It is a third-party, peer-reviewed study, credited to its authors and linked to the original.