Timeline for Policy: Generative AI (e.g., ChatGPT) is banned
Current License: CC BY-SA 4.0
17 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Mar 3 at 0:28 | comment | added | Peter Mortensen | Bogus answers (for example, likely most code dumps (answers without any explanation whatsoever)) and plagiarised answers were already a problem before ChatGPT. ChatGPT made it orders of magnitude worse. | |
Feb 15 at 8:08 | comment | added | markalex | If you have proposition, how to workaround mentioned abuse with existing right now technologies, please share it: many people would like to here it. But be warned, simply saying "community should go and verify every answer" wouldn't cut it. | |
Feb 15 at 8:04 | comment | added | markalex | @FNia, if or when tooling to factually check answers will exist, this very much will be a reason to reconsider this policy (and I'd personally say reconsider existence of SO in its current form). Until then, in light of extreme abuse by the generatedanswers, threatening usability of the site, this ban deemed to be the only viable solution. | |
Feb 15 at 5:13 | comment | added | user5349916 | @FNia "These are of course not ready solutions to deploy on this platform" Exactly. The tooling required for the proposed policy change does not practically exist - for all intents and purposes, they are functionally magic in any policy. Mind, that does not mean it cannot exist in the future, but it means any policy that relies on it cannot work today. SO does not exist to provide the focus for future AI research, it exists to be SO today. Mind, AI research is well able to set their own focus and not affected by the ban here. | |
Feb 15 at 1:23 | comment | added | FNia | These are of course not ready solutions to deploy on this platform, but are the general trends and approach to the matter of validity-checking human+AI-generated content. It's only a matter of time before we get there, and I believe the focus should be on going in that direction, rather than suppressing AI use altogether. | |
Feb 15 at 1:16 | comment | added | FNia | - Defending Against Neural Fake News: arxiv.org/abs/1905.12616 - FACT-GPT: Fact-Checking Augmentation via Claim Matching with LLMs: arxiv.org/html/2402.05904v1 - Are Large Language Models Good Fact Checkers: A Preliminary Study: arxiv.org/abs/2311.17355 - The perils and promises of fact-checking with large language models: frontiersin.org/articles/10.3389/frai.2024.1341697/full - (Probabilistic classification:) Generative AI Text Classification using Ensemble LLM Approaches: arxiv.org/pdf/2309.07755.pdf | |
Feb 15 at 1:01 | comment | added | FNia | There is no way to make sure the poster did verify it, and there is no way to make sure LLMs have not been used in part or all of the answer. You can only verify the answer itself for correctness, and LLMs can help with that. There are many studies on the use of LLMs for fact checking. It's definitely a new and evolving field, but the general understanding seems to be that "the best defense against [LLM] is [LLM] itself". I'll put some citations below. | |
Feb 15 at 0:12 | comment | added | Ryan M Mod | Could you please explain how to tell whether a poster did verify it? (without verifying it ourselves; see my previous comment for why that doesn't work) Plenty of people claim to have verified their AI-generated answers, and yet their answers are still wrong. | |
Feb 15 at 0:08 | comment | added | FNia | @RyanM The verification responsibility is on the poster. Yes, definitely ban the "10-second blind copy-pasted answers from ChatGPT", but that's not what this ban says. It simply doesn't care if you spent 10 seconds to paste it, or spent minutes or hours to verify and edit the answer before posting it. It bans all cases, which doesn't make sense. | |
Feb 15 at 0:03 | comment | added | Ryan M Mod | @FNia Please cite sources for your claims (especially the claim that LLMs can probabilistically classify the truth of answers). Our overwhelming experience is that current LLM technology cannot reliably do any of those things, at least within the domain to which it's being applied here. If we enter a world in which the way people use LLMs does not generate large quantities of plausible-looking incorrect information, then we may reconsider the ban. That is not the world we live in, however; thus, the ban. | |
Feb 14 at 23:57 | comment | added | FNia | @markalex Do you understand what it means to "understand", before making any claim about LLMs' understanding? And does it matter if a calculator "understands" numbers, as long it produces correct answers? Depending on the model quality and task at hand, LLMs can be very likely to produce correct and useful outputs (so a blanket ban on them is nonsensical) and they can probabilistically classify other answers to be true or false. This can be used to increase the speed and accuracy of human validators, not to replace them. | |
Feb 14 at 23:55 | comment | added | Ryan M Mod | The problem with "verify them" is that the amount of time, effort, and expertise it takes to verify an answer is often multiple orders of magnitude greater than the 10 seconds the poster spent blindly copy-pasting the question into ChatGPT. It's not sustainable to spend that much more effort removing bad content than it takes to create it, particularly when there are more people creating it than trying to remove it. | |
Feb 14 at 23:41 | comment | added | FNia | @MisterMiyagi, AI generated answers "look correct" and are a lot of times correct. Of course not always, but that's true for human answers too. That's why you verify them! "There is no harm assigned to verified answers," There is a ban placed on them presumably because of a harm assigned to them. And there is no "magical tooling" that claim to exist. | |
Feb 10 at 8:38 | comment | added | markalex | Do you understand that LLMs do not and will not understand meaning of the text? And if you do, how you imagine "actually use AI to find and flag potentially bad/incorrect answers"? | |
Feb 10 at 5:03 | comment | added | user5349916 | There is no logic here to counter. The ban makes it clear it is a blanket ban because AI generated answers look correct no matter if they are. There is no harm assigned to verified answers, and the magical tooling by which you want verified and unverified answers to be separated simply does not exist. | |
Feb 10 at 0:57 | history | edited | FNia | CC BY-SA 4.0 |
edited body
|
Feb 10 at 0:52 | history | answered | FNia | CC BY-SA 4.0 |