-41

The current policies of Stack Overflow around the responsible use of AI are confusing and unclear, both for moderators and users. There was the old announcement that as a temporary policy any use of GPT of ChatGPT was prohibited, which to me sounded like a blanket ban, even for responsible AI use, and there is the official SO statement on posting GPT generated answers, which by my reading referred more to posting unverified, inaccurate GPT generated answers and to plain copy & paste practices. In addition, there have been announcements to moderators mentioning that due to the high false positive rate, GPT use cannot be accurately detected & hence that the policy against the use of GPT would & should no longer be enforced. At the same time, I experienced myself that when I tried to post a well verified answer mentioning the use of ChatGPT 4 (where ChatGPT 4 was used produce a small part of the SDL+OpenGL code & not even any of the text of my answer or the benchmarking & output that I showed) it was instantly removed by moderators (this happened repeatedly) (my answer is available on GitHub here). Official guidelines are that any source, including a particular AI, should be cited, but if one does that then one gets the answer immediately deleted or downvoted (as happened for my ChatGPT 4 assisted, but verified answer here). Whilst poor, unverified answers for which GPT was used, but not disclosed, remain on the site, as are any other poor quality human-written answers.

There is also no official statement on whether code produced by GPT powered GitHub Copilot would be allowed (I would presume it is, but a blanket ban would suggest otherwise), or if other generative AI can be used to help formulate a verified answer (e.g. Anthropic's Claude+).

So what is the official position on the responsible use of AI on Stack Overflow?

To clarify my own position on this: I strongly disagree with a blanket ban on the use of AI-generated content and feel that responsible use should be allowed. A complete ban is not only impractical but also counterproductive. A more reasonable approach would be to implement measures that address the concerns associated with posting unverified or poor quality answers in quick succession, providing advice on how users should independently verify and refine AI-generated answers before posting them, and providing a good reward system for up- & downvoting of good & poor quality answers, so that the best, highest quality answers will always float to the top (currently that is not the case, e.g. for this answer the ChatGPT 4-based answer is by far the most correct & detailed one, but received no more votes than the other answers).

Transparency is also crucial. Users should have the option to disclose if an answer was partially or fully generated by AI, and in fact are required to do so under current policies. Hence, they definitely should not be punished for being transparent about it.

I have personally experienced the benefits of using GPT in solving complex problems and providing accurate answers. In some cases, where specialized knowledge was required or existing answers fell short, GPT was instrumental in delivering valuable insights. For instance, it assisted me in optimizing code performance, provided correct R to Rcpp translations, wrote correct, working code from scratch and even suggested solutions with complete mathematical proofs. Especially the performance of the paid version, ChatGPT 4 (potentially with plugins such as WolframAlpha for mathematical work or the ScholarAI plugin to provide citations) is impressive and in my view on a par with the quality of most of the answers I see on SO, at least for the ones involving programming, and of course after formal verification and fixing some small bugs.

The argument against GPT often stems from concerns about reliability. However, it is essential to note that responsible users employ AI as a tool, not as a substitute for critical thinking and verification. Users must still ask the right questions, provide adequate context, and thoroughly review AI-generated responses. GPT serves as an aid in reaching correct answers faster, but the responsibility for vetting and testing lies with the user. It would also lower the bar for domain experts to post good answers, given that they might not have the time to write out a full, detailed answer on SO themselves, but might do so if they can be partly aided by ChatGPT or Claude+ to phrase their answer (this applies for example to this answer where as a domain expert I knew the answer, but would not have been able to invest the time to write out such a detailed answer).

Moreover, it is worth considering the significant impact of GPT in the programming community. Many experienced programmers, including notable figures like John Carmack, rely on GPT daily for efficient problem-solving & 83% of all software developers state they now regularly use ChatGPT. The quality and relevance of GPT-generated answers often surpasses those found on Stack Overflow, which has led to a decline in traffic to this site as well as to a decline in the rate of asking questions or providing answer. GPT detectors, both automated and human-based, have been found to be ineffective with high error rates. This means that any policy against the use of GPT or other AI platforms like Claude+ would also be unenforceable.

Rather than seeing GPT and other AI as a threat, we should embrace its potential to enhance problem-solving and knowledge sharing. Stack Overflow could benefit from archiving exceptional GPT-generated answers, particularly for questions that have remained unanswered or lacked satisfactory solutions. By upvoting accurate answers and incentivizing quality control, the community can maintain the reliability and integrity of the platform. Embracing the potential of GPT would not only improve the quality of answers, but also foster innovation and attract a diverse community of problem-solvers, thereby making sure that the Stack Overflow community will remain vibrant and active, and that no user should feel threatened for posting an answer that was even just in part inspired or enabled by the use of ChatGPT or other AI tools, which going forward could just result in many users, including the most active ones, just leaving the site altogether, which would be a great shame.

83
  • 4
    There's (again) a lot of rambling and noise in your question here... You really need to be more specific in what you're suggesting or asking. As it is right now, this question is unclear.
    – Cerbrus
    Commented Jun 16, 2023 at 12:32
  • 13
    The community and moderators' current position is very clear; I've marked this question as a duplicate of that very position/policy. You can also read about it here.
    – Cody Gray Mod
    Commented Jun 16, 2023 at 12:33
  • 8
    @TomWenseleers: I guess your post would be more productive if you add a suggestion for a concrete policy on AI usage and how exactly it should be implemented. To this point, there wasn't any good suggestion made that prevents AI copy-pasting while not harming the ability of human users to provide answers. I'm sure if you can come up with something good, that will be helpful for the community.
    – BDL
    Commented Jun 16, 2023 at 12:34
  • 13
    The official policy is very clear in that no GPT-generated content is allowed whatsoever: "to issue immediate suspensions of up to 30 days to users who are copying and pasting GPT content onto the site"
    – Cerbrus
    Commented Jun 16, 2023 at 12:44
  • 10
    It's a blanket ban on any and all things GPT. It's not that difficult!
    – Cerbrus
    Commented Jun 16, 2023 at 13:04
  • 7
    That doesn't matter, @TomWenseleers . If I go to road where bicycles are banned, I can't say "but I'm fast on a bicycle, so it's ok". The same applies here; GPT is GPT and GPT is banned,
    – Thom A
    Commented Jun 16, 2023 at 13:05
  • 3
    Then suggest something that fixes that problem.
    – Cerbrus
    Commented Jun 16, 2023 at 13:14
  • 3
    @TomWenseleers: Stating "we need a better rewards system" is not a concrete suggestion. How would a better system look like, which changes to our current system does it require? Which impacts will it have to the current state of working?
    – BDL
    Commented Jun 16, 2023 at 13:20
  • 10
    Again you're the one that wants to make a suggestion, it's your responsibility to make the suggestion credible and understandable. You are in no place to complain about this getting closed when you continually disregard any and all advice given. You're repeatedly stated "SO will sort it out"... That's not good enough.
    – Cerbrus
    Commented Jun 16, 2023 at 14:26
  • 3
    "Sorry but the post you link doesn't answer any of my questions. It mentions GPT. Does that also include Github Copilot? Does it also include Anthropic Claude+?" - see also meta.stackoverflow.com/questions/422949, meta.stackoverflow.com/questions/412696, etc. Commented Jun 16, 2023 at 15:02
  • 9
    Come on, sir. You should well know that my single datapoint can beat up your single datapoint. But you've misread me. We're effectively arguing the same point. I'm just going further: If the new tool can out-perform Stackoverflow, let Stackoverflow die. Commented Jun 16, 2023 at 17:46
  • 7
    i mean, you can say that as many times as you want, until results exist outside of your miraculously positive results that noone else can verify it is meaningless. Instead, we can continue to act on the results we have seen, repeatedly, for the past 6-8 months.
    – Kevin B
    Commented Jun 16, 2023 at 19:12
  • 6
    @TomWenseleers None of those align with what we see here on stack sites. Until they do, they are irrelevant to how AI is to be managed here.
    – Kevin B
    Commented Jun 16, 2023 at 19:27
  • 6
    That's fine, however, people are still using the old crap if that's what they're still using. It doesn't change the stance or how it should be handled here.
    – Kevin B
    Commented Jun 16, 2023 at 19:32
  • 7
    If it's truely as good as you think it is, It has no purpose here and people who use it have no reason to share it here outside of earning imaginary internet points on skills they don't have.
    – Kevin B
    Commented Jun 16, 2023 at 19:34

1 Answer 1

31

responsible users employ AI as a tool, not as a substitute for critical thinking and verification.

Please come up with guidelines to get rid of the many irresponsible users then.

Users must still ask the right questions

As history has proven again and again, users don't know how to.

The average asker needs guidance from experienced people who have to ask several comments back-and-forth to obtain the actual criteria of a satisfying answer, all the while the GPT-users just paste the question and GPT's answer which may or may not cover a single use case and provide code that might fix the problem in the question but leave many others.

21
  • Maybe your view is based more on seeing ChatGPT3.5 produced code, not ChatGPT4? As for guidelines on getting rid of irresponsible use: a good reward system to upvote or downvote good & bad answers would already help a lot. And I would suggest to still ban users engaging in users that post large numbers of unverified answers... Just not the ones that use it responsibly. Commented Jun 16, 2023 at 12:35
  • 22
    GPT4 doesn't magically fix all the issues 3.5 has. It's really not that much better. It still suffers from many of the limitations any language model has.
    – Cerbrus
    Commented Jun 16, 2023 at 12:39
  • @Cerbrus Not my experience. GPT3 & ChatGPT3.5 could not come up with working code for that OpenGL+SDL+rdyncall example. ChatGPT4 gave working code in just 2 prompt... And that noncentered ridge regression answer was spot on. And these are no exceptions, that's my all round experience. Commented Jun 16, 2023 at 12:44
  • 20
    Tom, just because a novice axe thrower managed to hit the bullzai once, doesn't mean he'll hit hit every time. Sure, you got a good output. It still generates a lot of crap. One good example isn't enough! It needs to be consistent! It's not.
    – Cerbrus
    Commented Jun 16, 2023 at 12:46
  • @Cerbrus OK so I followed your advice and posted a new question on this and now it got closed. So I give up folks. If this is supposed to be democracy & reasonable debate I am out of here. I might take another look in 10 years or so, if and when SO has got its act together... Commented Jun 16, 2023 at 12:46
  • 13
    You didn't follow my advice. You wrote a long rambling post that's vague and full of irrelevant links and details. I told you to write "A specific suggestion, with a justification and explanation.". This is not that.
    – Cerbrus
    Commented Jun 16, 2023 at 12:47
  • 2
    @Cerbrus I've been using ChatGPT4 nonstop for my work for months - this is not my assessment based on a couple of lucky shots... I'm saying it solves my questions way faster than I otherwise could & not allowing users to make use of it would cause the userbase of this platform to shrink massively... Plus that now the users that use AI responsible get punished, whilst the ones that don't disclose its use get away with it & get reputation for it... Do you think that's sustainable? Commented Jun 16, 2023 at 12:49
  • 14
    My stance is that LLMs are hit and miss. They're often confidentially incorrect. New users won't know why it's incorrect. If it works for you, yay for you. It's just not good enough for SE.
    – Cerbrus
    Commented Jun 16, 2023 at 12:51
  • 19
    @TomWenseleers: The problem with your post is that it talks way to much about how cool ChatGPT is, but lacks concrete details about how the policy should be implemented. If you want to get a policy changed, that will only happen if you come up with a system that works, not with motivation why it should be changed alone.
    – BDL
    Commented Jun 16, 2023 at 12:57
  • 1
    Stating only verified answers are allowed will not work, because people will still post unverified answers on site. And then to ban those users, moderators would not only need to determine answer is AI generated, but also that it is wrong and they cannot do that because they may lack expertise in the area, and again there are not enough experts here willing to do that either. And once you open AI gates, we will be flooded with such answers even more than we are now. The sites will simply die under load of AI crap.
    – Dalija Prasnikar Mod
    Commented Jun 19, 2023 at 11:04
  • 2
    @user13267 Moderators cannot determine the validity of answers. They never did and it is not their job. It would require additional volunteer experts in each tech stack to do that. Again there aren't enough of those either. And yes, there are plenty poor posts on the sites. But the problem with AI posts is that they can look good on the surface, so it is harder to identify them as bad answers if you are not an expert and also no human can write that many answers without AI help. There were people posting AI answers every few minutes.
    – Dalija Prasnikar Mod
    Commented Jun 19, 2023 at 12:07
  • 1
    @user13267 And the fact that experts are not capable of cleaning poor posts that are written by people, is evidence that we could not deal with AI posts either if the only metrics would be validity and correctness.
    – Dalija Prasnikar Mod
    Commented Jun 19, 2023 at 12:09
  • 4
    @user13267 Even 30 minutes is too short. And that is only valid for users with rep < 125. If people want AI answers they can ask AI directly. If you want to use AI, you can use it freely as long as you don't post such answers here. If you figure out solution with the help of AI and you understand the problem well, they you will be able to write the answer yourself based on your knowledge regardless of how you acquired it and you are free to do that.
    – Dalija Prasnikar Mod
    Commented Jun 19, 2023 at 12:48
  • 3
    @user13267 you can use AI to do research and learn (if you are capable of distinguishing between correct and incorrect answers it can give you). You cannot use AI to write an answer for you.
    – Dalija Prasnikar Mod
    Commented Jun 19, 2023 at 14:10
  • 2
    @user13267 I am pretty sure that with my knowledge of around 50 Korean words, it would be pretty bad idea that I start posting answers at Korean Language site using ChatGPT. Even thought it would probably be better at that than it is for solving programming problems.
    – Dalija Prasnikar Mod
    Commented Jun 19, 2023 at 14:13

Not the answer you're looking for? Browse other questions tagged .