95

To be more specific, I flagged a question recently as it was of the type "ChatGPT generated this but I need some more help fixing this". But I was told by a mod that asking a question about code is fine, which led to my confusion here.

Here is the post I am referring to. And here is the response -

asking a question about code produced by CGPT is fine. Not sure why you’d want to, but it is not banned. ChatGPT is not a programmer or a mathematician, it doesn’t use logic to construct code but is based on statistics. That rarely produces code that is actually fit for purpose.

I was under the impression that my flag should have been correct based on reading what-should-i-do-if-i-suspect-that-a-question-or-answer-is-written-by-chatgpt and are-questions-about-chatgpt-code-okay-to-ask


Don't the same reasons for which answers are banned, apply to questions as well?

  • It can be used to generate a ton of 'fake' questions on the platform
  • It could attract upvotes, due to the well-formatted and "confident" looking content
  • Bad questions created by will have to be handled the same way as any other question, but high volumes of such questions will waste precious moderator and community time.

Would love to hear from mods on the policy around this.

3
  • @ZoestandswithUkraine "..while we curb the tidal wave.." Any estimation how high the tidal wave is? What order of magnitude is the number of posts allegedly by ChatGPT every day? Commented Jan 4, 2023 at 8:18
  • 1
    @Trilarion last I heard, between 500 and 1500 Commented Jan 4, 2023 at 10:54
  • I see that these question often fall in this category. Commented Apr 16, 2023 at 18:43

2 Answers 2

109

With respect to our policy banning the posting of AI-generated content, the point here is that the specific question was not written by ChatGPT.

There is a difference between having ChatGPT write the question for you, and asking a question (in your own words) about something that ChatGPT generated. The former is prohibited by our policy; the latter is allowed under the policy, provided you attribute the source of the code.

Asking a question about ChatGPT output is no different from asking questions about other code you found somewhere, be that documentation, a tutorial, or another Stack Overflow answer.

Note that there may be grounds to close such a question as off-topic, but not because ChatGPT was involved, but simply because of the way the question is worded. It could be too broad (asking us to explain the whole thing), a typo (ChatGPT didn't put in the required punctuation), etc. That's not a reason to flag for moderator attention; that's a reason to flag or vote to close.

In other words, please don't flag questions about GPT-generated content as violating our AI-generated content policy, because they probably don't. However, that doesn't mean they shouldn't be moderated in other ways—handle them just as you normally would questions that may be low-quality or off-topic.

10
  • 2
    Thanks for the answer @martijnpieters, could you also elaborate on how the latter (asking a question (in your own words) about something that ChatGPT generated) fits in with the blanket ban as well? Commented Jan 1, 2023 at 14:23
  • 29
    @AkshaySehgal: the ban is clear: don't generate questions or answers or comments with AI. This isn't such a case.
    – Martijn Pieters Mod
    Commented Jan 1, 2023 at 14:26
  • 1
    So hypothetically (mentioned this as a comment before), if someone generated 20 pieces of code, ran them, copied the error messages and wrapped the code + trace in a problem description and posted 20 questions, that is acceptable and not banned? just to clarify Commented Jan 1, 2023 at 14:27
  • 1
    @AkshaySehgal: If the question is about why the code produces error messages, yes, that's fine. I think that trusting ChatGPT to the point that you are surprised to see errors is unwise, but I'm not here to judge why others seem to expect ChatGPT to know about logic, maths and other programming skills.
    – Martijn Pieters Mod
    Commented Jan 1, 2023 at 14:30
  • 16
    Stack Overflow licensing policy is that user contributions [are] licensed under CC BY-SA, but if someone posts ChatGPT generated code, can they actually agree to such a license?
    – dbc
    Commented Jan 1, 2023 at 17:01
  • @dbc that’s an interesting issue, to which I have no answer. If there is a license violation then presumably there’ll be an injured party that can file a DMCA takedown.
    – Martijn Pieters Mod
    Commented Jan 1, 2023 at 23:23
  • 27
    I appreciate the logic here, but I think there are more subtleties in allowing questions about chatGPT-generated code that are worth considering. I fear we will become the clean-up service for reams of chatGPT generated code that is close but still contains at least some complete nonsense. I remember one piece of python code that looked 100% correct except for a single import statement at the beginning that was utter garbage but still looked convincing. Do we want to answer those questions? We don't have reams of these yet so perhaps my concerns are premature. Commented Jan 2, 2023 at 4:45
  • 9
    It is not OK to spam 20 questions at once (and probably runs into a ban anyway). It is not ok to copy code from anywhere as a cheap substitution for one's own attempt. It is not OK to post a chunk of code without having a clue and asking us to debug/fix it. All of these are reasons to downvote for lack of effort, and vote to close. But it doesn't matter whether the asker uses ChatGPT for this - it also happens without, and stating the source of the copied code is still better than not stating it at all. For now, current moderation tools suffice to cope with this, we don't need a complete ban.
    – Bergi
    Commented Jan 2, 2023 at 6:04
  • 6
    @PresidentJamesK.Polk there haven’t been many questions and even fewer that were on topic. The post that sparked this debate was closed as a duplicate, and the error made was not unlike something many newbies might have made. Had the term “ChatGPT” not been included in the post no-one would have noticed.
    – Martijn Pieters Mod
    Commented Jan 2, 2023 at 9:29
  • 7
    @PresidentJamesK.Polk Plus, the post quality system will land you in post ban hell a lot quicker for bad questions than it does for bad answers.
    – Martijn Pieters Mod
    Commented Jan 2, 2023 at 9:31
49

It seems highly unlikely to me that ChatGPT code could support a worthwhile question. A question using such code would presumably be either:

  • "Does this ChatGPT generated code do what it's intended to do?" We aren't a debugging service, and we certainly aren't a testing service.

  • "What does this ChatGPT generated code do?" - almost certainly needs more focus; and if properly focused, there would be no reason to leave behind enough code for it to still have any signature of AI generation.

  • "I tried using this ChatGPT generated code in my project, and it doesn't do what I want it to do; how do I fix it?" - almost certainly needs debugging details, even if the user has included example input, a stack trace, a description of expected output etc. The problem is that the code will not be a minimal reproducible example. Since we aren't a debugging service, the question needs to be about the specific part of the code that causes the problem; this entails that OP is responsible for determining which part that is.

  • "I have a problem with my code; to maintain NDA, I used ChatGPT to generate a MRE...." - really? And you verified by hand that the generated MRE is minimal, reproducible, and exemplifies the actual problem? Was that easier than actually just writing the code by hand, or copying and pasting the relevant lines and changing some variable names? Do you also use ChatGPT to create unit tests, and trust the result of those tests without human intervention?


That said, we care about the questions, not the code. The reason we care about banning ChatGPT content is because the ease of generating it means that relatively few users could easily overwhelm the capacity of moderators and curators (who are already overwhelmed by thousands of almost-all-worthless new questions per day). Having to write everything by hand except the actual code, certainly mitigates the problem.

7
  • 18
    The answer to "why doesn't this ChatGPT code do what I want?" is always the same: ChatGPT is a language model. It has no understanding of programming, computer science, or your goals. The code doesn't do what you want because ChatGPT is not an appropriate tool for generating code you couldn't have written yourself. Commented Jan 2, 2023 at 15:27
  • 5
    @JamesWestman it has as much understanding of programming as it does English, which is a surprisingly good ability to generate a plausible stream of convincing BS - and the most convincing BS is BS that happens to be correct - but not always. Commented Jan 2, 2023 at 20:22
  • 7
    @user253751 Right. If you ask a magic 8 ball a question and then come to Stack Overflow asking if that answer is correct, well, you should just ask us your original question. If it's on topic. Commented Jan 2, 2023 at 22:45
  • 9
    As true as all of this may be, it fundamentally does not answer the question that was asked here, which is whether questions that contain code generated by ChatGPT should be flagged as using code generated by ChatGPT, under our current, blanket ban of all ChatGPT-generated content.
    – Cody Gray Mod
    Commented Jan 3, 2023 at 8:28
  • I'm not convinced by the third and fourth point. The M in MRE very often does not get taken verbatim; it's very common to have bloated examples. Using ChatGPT to generate debugging questions would very well be doable with the current curation standards. It's convincing that moderators don't see this happening so it doesn't need special handling, but it's not convincing to me that that regular curation could handle such questions if people were to press our on-topic debugging capabilities. Commented Jan 17, 2023 at 9:19
  • 1
    My point is that "current curation standards" are a) abysmal and b) due to their history of being applied the same way, the reason why I constantly am unable to find canonical duplicates that should be obvious. Commented Jan 17, 2023 at 9:20
  • "it's not convincing to me that that regular curation could handle such questions if people were to press our on-topic debugging capabilities" - "our on-topic debugging capabilities" are approximately zero, and we know this; which is exactly why we should demand that questions not actually test those capabilities. As I've explained before: putting the appropriate work into a debugging question makes it effectively not a debugging question any more. Commented Jan 17, 2023 at 9:22

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .