↖︎ Vishal Singh

Data Article · Digital Sociology

The Commons Was Already Dying

Everyone knows ChatGPT emptied Stack Overflow. But 23 million questions tell an older story: the greatest knowledge commons ever built for programmers peaked in 2016, hardened against its own newcomers, and had been shrinking for six years before an AI wrote a single answer.

Freshness bound: the archive analyzed here is frozen at September 25, 2022 — ten weeks before ChatGPT launched. That is a limitation and a feature: everything below describes the commons before generative AI touched it. Nothing in this article measures the post-2022 cliff.

Stack Overflow is one of the most consequential institutions programming ever produced: a public archive where, for a decade and a half, practitioners wrote each other's documentation. At its peak it absorbed a new question every fourteen seconds. The standard story is that ChatGPT killed it. The data says something more uncomfortable: by the time the AI arrived, the commons had already lost a third of its volume, most of its answering capacity, and nearly all of its warmth toward strangers.

1  The arc

Question volume grew explosively to 2.2 million in 2016 — and then declined, year over year, to 1.63 million by 2021. No AI existed to blame. The decline coincided with the maturing of the archive itself: by the mid-2010s, most beginner questions had already been asked and answered, and new questions were increasingly either duplicates (closed) or hard specialty questions (unanswered).

Questions per month, 2008–2022

Monthly count · bold = 12-month average

Data table (annual)
Figure 1. The archive ends 2022-09-25 (marked); the final partial month is dropped. Deleted questions are absent from the archive, so early-year totals are modestly understated relative to what users saw at the time. Peak: March 2016.

2  The commons hardened

Volume is the least of it. In 2009, 99.7% of questions received at least one answer, typically within 12 minutes. By 2021 the answer rate had fallen to 76% and the median wait had quintupled to about an hour. The accepted-answer rate — the asker confirming their problem was actually solved — fell from 58% to 40%. The machine that turned questions into documentation was seizing up, one percentage point a year, for a decade.

The answering machine slows down

Left: share of questions answered / accepted. Right: median minutes until first answer.

Data table (annual)
Figure 2. The last 9 months before the freeze (shaded) are unreliable for these measures: a question asked in mid-2022 had less time to accumulate answers before the archive stopped, so the apparent 2022 collapse is partly a measurement artifact. Trends are read through 2021 only. Median wait is conditional on being answered at all.

3  What it did to newcomers

Track each user cohort by the quarter they created their account, and look at what happened to the first question they ever asked. For the 2009 cohorts, first questions were answered 99.7% of the time. For 2020 cohorts: 78%. The share of first questions downvoted into negative territory — the community's way of saying "you asked wrong" — quadrupled from 4% to a peak of 16% around 2018. A newcomer's first contact with the commons went from a welcome to a toll gate.

The newcomer experience, by signup cohort

Outcomes of each cohort's first questions (asked within a year of signup)

Data table
Figure 3. ~57 quarterly cohorts, each with ≥100 first-time askers (2009 cohorts: ~8K askers; 2015–22 cohorts: 60–90K each). The negative-score line falls after 2018 — partly genuine softening, partly newcomers learning to expect less and self-censor. Cohorts near the freeze inherit the same censoring caveat as Figure 2.

4  Empires rise and fall inside the archive

The tag time-series double as a stratigraphy of software itself. jQuery — the most-asked-about technology on earth in 2013, 2.4% of all questions — decays to a rounding error by 2022. React crosses it in 2018 and keeps climbing. Python grows from 1.3% to 5.3%, quietly becoming the language of the archive's second half. Each panel below is a technology's life story in one shape.

Twelve technologies' life stories

Share of all questions per month, 2009–2022 · panels sorted by peak date · independent y-scales

Data table (peak share per tag)
Figure 4. Share of questions, not absolute volume — so a flat line means "growing exactly as fast as the site." Peak share and month labeled per panel. y-scales differ; the shapes, not the heights, are comparable.

5  The weekend index

One more register, a happier one: divide each tag's weekend share of questions by the site-wide weekend share, and you get a clean instrument for what programmers do for love. Weekend tags: Discord bots, pygame, Haskell, Rust, x86 assembly — and linked lists and time-complexity, because interview prep is a weekend sport. Weekday tags: SSIS, SharePoint, Azure DevOps, reporting services — nobody builds an enterprise report pipeline for fun on a Sunday.

What programmers do for love vs. for money

Weekend index: tag's weekend question share ÷ site-wide weekend share · 2017–2022 · tags with ≥5,000 questions

Data table
Figure 5. Index 1.0 = asked evenly through the week; 1.6 = 60% over-represented on weekends (UTC). Weekends are defined in UTC — a global approximation that smears Friday evenings and Monday mornings across time zones, biasing all indices toward 1. True separation is larger.

Epilogue: then the machine came

This archive stops 66 days before ChatGPT launched. What happened next is outside our data and deserves its own careful treatment with a different source — Stack Overflow's own traffic disclosures and the Internet Archive's later dumps. But the numbers above reframe that story before it starts. Generative AI did not kill a healthy commons; it arrived at one that had spent six years losing volume and a decade losing the ability to answer its own questions, and it offered the people the commons had been turning away — the newcomers of Figure 3 — an oracle that never downvotes.

Data & methods

  • Source. The Stack Overflow public archive as mirrored in BigQuery (bigquery-public-data.stackoverflow), frozen at 2022-09-25 (verified as MAX(creation_date); the mirror was last refreshed from the Internet Archive data dump in late 2022). 23,020,127 questions, 18.7M user accounts. Content is CC BY-SA; no question text is reproduced here — only counts and timings.
  • Deletion bias. Deleted questions (spam, very low quality, some duplicates) are absent, and deletion is not random: answered-rate levels are flattered throughout, but the decade-scale trends dwarf plausible deletion effects.
  • Right-censoring. Questions asked shortly before the freeze had little time to be answered or accepted. All trend claims stop at 2021-12; 2022 is displayed but shaded as unreliable in Figures 2–3.
  • Cohorts. A "newcomer" is a user whose first question came within 365 days of account creation, grouped by signup quarter; cohorts under 100 such askers are dropped.
  • Weekend index. Computed over 2017-09–2022-08 (the site's stable-decline era) in UTC. Tags below 5,000 questions in the window are excluded.
  • Median time-to-answer is conditional on having an answer; a handful of first answers predating their question (merge artifacts) are excluded.