Skip to main content
deleted 16 characters in body
Source Link
cottontail
  • 22.4k
  • 6
  • 24
  • 53

In a forthcoming article in the New York Times (non-paywalled link), Jon Gertner explores the future of Wikipedia in the times of generative artificial intelligence. Near the end of the article, Gertner discusses a preprint "The curse of recursion: training on generated data makes models forget" introducing the concept of "model collapse" that occurs when training future generations of LLMs with content generated by previous ones. One of the conclusions of the paper is that "To make sure that learning is sustained over a long time period, one needs to make sure that access to the original data source is preserved and that additional data not generated by LLMs remain available over time."

My question is how Stack Overflow can adapt to preserve value in this environment. Is there a way to incentivize human-written content? Are there new ways of documenting authorship (e.g. a short video talking about what you just posted) that will replace a simple signature under a hand-written document. Is there a way to document the provenance of contributions? Is there a way to disincentivize humans posting questions generated by A.I. and/or answers generated by A.I. just to get imaginary reputation points.?

How can we continue to motivate knowledgeable humans to make voluntary contributions to a repository not tainted by A.I. regurgitation? The answer to this question ensures the future of Stack Overflow and other repositories of knowledge and, as a bonus, would prevent model collapse.

In a forthcoming article in the New York Times (non-paywalled link), Jon Gertner explores the future of Wikipedia in the times of generative artificial intelligence. Near the end of the article, Gertner discusses a preprint "The curse of recursion: training on generated data makes models forget" introducing the concept of "model collapse" that occurs when training future generations of LLMs with content generated by previous ones. One of the conclusions of the paper is that "To make sure that learning is sustained over a long time period, one needs to make sure that access to the original data source is preserved and that additional data not generated by LLMs remain available over time."

My question is how Stack Overflow can adapt to preserve value in this environment. Is there a way to incentivize human-written content? Are there new ways of documenting authorship (e.g. a short video talking about what you just posted) that will replace a simple signature under a hand-written document. Is there a way to document the provenance of contributions? Is there a way to disincentivize humans posting questions generated by A.I. and answers generated by A.I. just to get imaginary reputation points.

How can we continue to motivate knowledgeable humans to make voluntary contributions to a repository not tainted by A.I. regurgitation? The answer to this question ensures the future of Stack Overflow and other repositories of knowledge and, as a bonus, would prevent model collapse.

In a forthcoming article in the New York Times (non-paywalled link), Jon Gertner explores the future of Wikipedia in the times of generative artificial intelligence. Near the end of the article, Gertner discusses a preprint "The curse of recursion: training on generated data makes models forget" introducing the concept of "model collapse" that occurs when training future generations of LLMs with content generated by previous ones. One of the conclusions of the paper is that "To make sure that learning is sustained over a long time period, one needs to make sure that access to the original data source is preserved and that additional data not generated by LLMs remain available over time."

My question is how Stack Overflow can adapt to preserve value in this environment. Is there a way to incentivize human-written content? Are there new ways of documenting authorship (e.g. a short video talking about what you just posted) that will replace a simple signature under a hand-written document. Is there a way to document the provenance of contributions? Is there a way to disincentivize humans posting questions and/or answers generated by A.I. just to get imaginary reputation points?

How can we continue to motivate knowledgeable humans to make voluntary contributions to a repository not tainted by A.I. regurgitation? The answer to this question ensures the future of Stack Overflow and other repositories of knowledge and, as a bonus, would prevent model collapse.

Adding non-paywalled link for those who can't access NYT.
Source Link
TylerH
  • 21.2k
  • 22
  • 229
  • 328

In a forthcoming article in the New York Times (non-paywalled link), Jon Gertner explores the future of Wikipedia in the times of generative artificial intelligence. Near the end of the article, Gertner discusses a preprint "The curse of recursion: training on generated data makes models forget" introducing the concept of "model collapse" that occurs when training future generations of LLMs with content generated by previous ones. One of the conclusions of the paper is that "To make sure that learning is sustained over a long time period, one needs to make sure that access to the original data source is preserved and that additional data not generated by LLMs remain available over time."

My question is how Stack Overflow can adapt to preserve value in this environment. Is there a way to incentivize human-written content? Are there new ways of documenting authorship (e.g. a short video talking about what you just posted) that will replace a simple signature under a hand-written document. Is there a way to document the provenance of contributions? Is there a way to disincentivize humans posting questions generated by A.I. and answers generated by A.I. just to get imaginary reputation points.

How can we continue to motivate knowledgeable humans to make voluntary contributions to a repository not tainted by A.I. regurgitation? The answer to this question ensures the future of Stack Overflow and other repositories of knowledge and, as a bonus, would prevent model collapse.

In a forthcoming article in the New York Times, Jon Gertner explores the future of Wikipedia in the times of generative artificial intelligence. Near the end of the article, Gertner discusses a preprint "The curse of recursion: training on generated data makes models forget" introducing the concept of "model collapse" that occurs when training future generations of LLMs with content generated by previous ones. One of the conclusions of the paper is that "To make sure that learning is sustained over a long time period, one needs to make sure that access to the original data source is preserved and that additional data not generated by LLMs remain available over time."

My question is how Stack Overflow can adapt to preserve value in this environment. Is there a way to incentivize human-written content? Are there new ways of documenting authorship (e.g. a short video talking about what you just posted) that will replace a simple signature under a hand-written document. Is there a way to document the provenance of contributions? Is there a way to disincentivize humans posting questions generated by A.I. and answers generated by A.I. just to get imaginary reputation points.

How can we continue to motivate knowledgeable humans to make voluntary contributions to a repository not tainted by A.I. regurgitation? The answer to this question ensures the future of Stack Overflow and other repositories of knowledge and, as a bonus, would prevent model collapse.

In a forthcoming article in the New York Times (non-paywalled link), Jon Gertner explores the future of Wikipedia in the times of generative artificial intelligence. Near the end of the article, Gertner discusses a preprint "The curse of recursion: training on generated data makes models forget" introducing the concept of "model collapse" that occurs when training future generations of LLMs with content generated by previous ones. One of the conclusions of the paper is that "To make sure that learning is sustained over a long time period, one needs to make sure that access to the original data source is preserved and that additional data not generated by LLMs remain available over time."

My question is how Stack Overflow can adapt to preserve value in this environment. Is there a way to incentivize human-written content? Are there new ways of documenting authorship (e.g. a short video talking about what you just posted) that will replace a simple signature under a hand-written document. Is there a way to document the provenance of contributions? Is there a way to disincentivize humans posting questions generated by A.I. and answers generated by A.I. just to get imaginary reputation points.

How can we continue to motivate knowledgeable humans to make voluntary contributions to a repository not tainted by A.I. regurgitation? The answer to this question ensures the future of Stack Overflow and other repositories of knowledge and, as a bonus, would prevent model collapse.

Became Hot Meta Post
edited title
Link

Model collapse when content generatedwritten by humans becomes contaminated by A.I.-generated content

added 5 characters in body
Source Link
Loading
deleted 138 characters in body; edited tags
Source Link
M--
  • 28.5k
  • 4
  • 31
  • 61
Loading
added 7 characters in body
Source Link
Thom A
  • 95.1k
  • 7
  • 113
  • 165
Loading
Source Link
Loading