Skip to main content
4 of 7
added 5 characters in body

Model collapse when content generated by humans becomes contaminated by A.I.-generated content

In a forthcoming article in the New York Times, Jon Gertner explores the future of Wikipedia in the times of generative artificial intelligence. Near the end of the article, Gertner discusses a preprint "The curse of recursion: training on generated data makes models forget" introducing the concept of "model collapse" that occurs when training future generations of LLMs with content generated by previous ones. One of the conclusions of the paper is that "To make sure that learning is sustained over a long time period, one needs to make sure that access to the original data source is preserved and that additional data not generated by LLMs remain available over time."

My question is how Stack Overflow can adapt to preserve value in this environment. Is there a way to incentivize human-written content? Are there new ways of documenting authorship (e.g. a short video talking about what you just posted) that will replace a simple signature under a hand-written document. Is there a way to document the provenance of contributions? Is there a way to disincentivize humans posting questions generated by A.I. and answers generated by A.I. just to get imaginary reputation points.

How can we continue to motivate knowledgeable humans to make voluntary contributions to a repository not tainted by A.I. regurgitation? The answer to this question ensures the future of Stack Overflow and other repositories of knowledge and, as a bonus, would prevent model collapse.