Daylila

Sunday, 17 May 2026

ArXiv's Ban on AI-Generated Papers

6 min How quality-control systems work in knowledge infrastructure
Source: The Verge
0:00

Hook

ArXiv just announced it will ban researchers who submit AI-generated papers. Not reject the papers — ban the submitters.

Some readers call it panic or censorship. It’s neither. It’s infrastructure maintenance. When the cost of producing bad submissions drops to near-zero, the gatekeeping architecture has to change. ArXiv is moving the gate.

What does that reveal about how quality control actually works?

What Arxiv Is

ArXiv is a preprint server. Researchers upload papers before peer review — sometimes months before publication, sometimes instead of publication.

It hosts physics, math, computer science, and related fields. Roughly 200,000 papers per year. Scientists use it to share findings fast and claim priority. They get feedback before formal review.

The trade-off: speed versus filtering. Peer review takes months. ArXiv takes hours. You get access to new work immediately, but without the quality check that journal review provides. That trade-off made sense when submissions required effort.

Old Threat New Threat

ArXiv always had a fraud problem. Researchers could submit nonsense, plagiarism, or crank theories. But each bad submission cost time — writing it, formatting it, making it look plausible.

AI changed the economics. Generating a plausible-looking paper now costs minutes, not weeks. The effort barrier collapsed. Volume became trivial.

The threat shifted from occasional fraud to industrial-scale pollution. One person can now submit hundreds of papers per day. The old filtering system — trust most submissions, catch fraud case-by-case — breaks when production cost hits zero.

Gatekeeping Architecture

Quality systems filter at two points: upstream (before entry) or downstream (after entry, through correction or removal).

Upstream filtering prevents pollution. Downstream filtering cleans it up. ArXiv was built for downstream — let most things in, remove the bad ones after the fact. That works when bad submissions are rare.

When bad submissions become cheap, downstream filtering fails. The system fills faster than moderators can clean. The pollution spreads before removal. Upstream filtering — stricter submission rules, identity verification, repeat-offender bans — becomes necessary.

ArXiv is moving the gate earlier. That’s not censorship. That’s choosing where the filter sits.

Ban Not Reject

ArXiv isn’t just rejecting AI-generated papers. It’s banning the researchers who submit them repeatedly.

Why ban submitters instead of papers? Because repeat offenders signal adversarial behavior, not honest mistakes. Someone who submits one AI-generated paper might not know the rules. ArXiv’s policy announcement noted cases where single accounts submitted over 100 machine-generated papers in a week.

The ban treats this as infrastructure defense. The goal isn’t to judge content quality on each paper individually. The goal is to stop actors who treat the platform as free distribution for machine-generated text. The system protects the ratio of useful papers to junk.

What This Reveals

Every knowledge system makes a speed-versus-review trade-off. Google Search filters spam before you see results. Wikipedia locks pages that attract vandalism. Academic journals gate before publication. Preprint servers traditionally gated less.

When automation changes the attack surface — when producing bad submissions becomes free — institutions redesign the gates. They don’t abandon filtering. They move it.

Old model: fraud is expensive, filter downstream. New model: fraud is cheap, filter upstream.

This pattern applies beyond academic preprints. Anywhere information moves through infrastructure, someone maintains the gates. When conditions change, the gates move.

Close

ArXiv’s policy isn’t panic. It’s not an anti-AI statement. It’s infrastructure doing what infrastructure does when the threat model shifts: adjusting tolerances.

Quality control is architecture. Architecture adapts when conditions change. You live downstream of these gates — in search results, news feeds, product reviews, research databases — whether you notice them or not.

Companion lab

Upstream versus Downstream Filtering

A system can stop bad inputs before they enter or remove them after they arrive—the choice depends on how cheap production becomes and how fast pollution spreads compared to how fast cleaners can work.

Try the lab

Then check the pattern