74

Following the new temporary policy, content generated by ChatGPT must not be used as a question or answer on Stack Overflow. If I, as a non-moderator user, encounter a single post that I suspect is generated by an AI, what is the correct course of action?

Similarly, if I encounter a user who has multiple answers posted that seem to be generated by an AI, should I respond differently?

(This question was made in response to an answer, posted on the ChatGPT policy announcement. It was requested that a new question be made, to add visibility.)

3 Answers 3

85

Flag it as in need of moderator intervention. That's all you need to ever do.

Provide as much evidence as you possibly can to a moderator to explain why you think this is a ChatGPT response.

Don't respond/interact with the person directly if you can help it since we don't want to make this a witch hunt. People are going to react aggressively if you accuse them of being a witch using ChatGPT, so flag and let the mods sort that out.

Don't flag it as "Not an answer" or "Very low quality", because 1) that is not the problem with the answers, 2) these need to be reviewed by moderators, not the Low Quality Answers queue, and 3) if these flags are validated, they will result in extremely confusing audits.

Don't flag it as "Plagiarized content", because currently plagiarism flags get automatically cleared whenever a post is deleted, including by its owner, whereas moderators might need to investigate all of a user's posts as a follow up to these flags.

16
  • 30
    But what if the post actually weighs the same as a duck?
    – Drew Reese
    Dec 9, 2022 at 5:19
  • 1
    In my experience, having one AI answer means they have several. If you're feeling generous, see if you can flag any of the other answers on their network profile. Even if you're not completely certain, it would allow a moderator to investigate it further or make a note for the future.
    – Laurel
    Dec 9, 2022 at 14:15
  • I've a similar question: what if the answer is almost correct?
    – shingo
    Dec 10, 2022 at 9:07
  • 10
    @shingo: Did I stutter? On the Internet, no less?
    – Makoto
    Dec 10, 2022 at 9:29
  • 20
    @shingo it's a blanket ban. Its correctness is irrelevant. If it's generated by CGPT, it's not allowed and has to go Dec 10, 2022 at 10:05
  • 3
    It's hard to "provide as much evidence as you possibly can" due to the 500 character limit in custom flags. I just flagged an answer that I suspect was AI-generated, but I couldn't manage to fit all my reasons for suspecting it in only 500 characters. This is especially difficult since reasons for suspecting it often have to do with incoherences in the answer, which can sometimes be complicated to explain. Dec 10, 2022 at 17:32
  • 5
    @shingo Verifying an almost-correct answer is more of a waste of time than a clearly wrong (instantly dismissable) one. Also, we don't want to encourage rep farming with a bot that produces wrong answers, so even "completely correct" GPT answers should go. Dec 10, 2022 at 20:59
  • I was encountered some answers which are acceptable, but the tone, structure and small mistake made me suspect they were AI-generated. Just as @éclairevoyant said this is more of a waste of time so I asked if it is worth to flag.
    – shingo
    Dec 11, 2022 at 8:36
  • @DonaldDuck Guess you'll have to become a pro at shorthand :) I mean what else can you do to fit a lot into a small box? Compress it.
    – Gimby
    Dec 12, 2022 at 13:48
  • @Makoto Do you think we should downvote the answer in addition to flagging it?
    – MendelG
    Dec 20, 2022 at 23:43
  • 2
    @MendelG: I didn't misspeak here. If you think it's something generated by ChatGPT, flag it. Whether or not you think it's of quality enough to be voted on is a separate matter altogether.
    – Makoto
    Dec 21, 2022 at 0:28
  • 1
    @Makoto might be worth mentioning in your answer that it's one flag per user regardless of the number of ChatGPT answers they've posted but mention in the flag that other answers by that user need to be considered. Dec 23, 2022 at 15:14
  • 1
    @shingo More important than wasting time, IMHO, is that ChatGPT doesn't cite its sources, so you can effectively consider anything it writes to be plagiarized.
    – wjandrea
    Dec 24, 2022 at 23:49
  • 11
    @wjandrea anything copied from ChatGPT without proper citation is plagiarized in itself, and goes against ChatGPT’s own Sharing & Publication Policy
    – Didier L
    Dec 28, 2022 at 23:38
  • 2
    @Makoto your first paragraph here is correct. Your second paragraph is wrong, pointless, confusing and adds confusion. I would suggest you delete the second paragraph. (ChatGPT output, or output from any of the dozen similar bots that hasn't featured on GoodMorningAmerica, is instantly recognizable and anyone who takes the time to flag it need only tap flag and type "chat bot". Much like is you flag, say, swearing.)
    – Fattie
    Jan 1 at 4:27
-17

We didn't talk so far about ChatGPT-generated questions.
This is surely another facet of the problem. If we would be flooded with chatbot-questions, and initially would put energy in the considering and answering them, I don't know whether I would engage in any other question at all once I've got the suspicion that each of them could be a fun-project.

Btw, I'm not convinced of the "rep-point" assumption. I'm an old Usenet user, and meeting real disgusting trolling there over years, and escalating in the 1990s, I think it is a reduced(*1) perspective to put the bot-chatting in terms of acquiring reputation points - and suggesting that installing a button for "getting 340 reps immediately" would significantly reduce the problem: of simply making fun with the lustful (and cynical) experience of bullying and destruction.

Finally, I think a greenfield for training users with recognized Q&A of chatbots to sharpen our awareness and accumulate experiences would be a good thing (I know that this is not the policy of SE, so it might better be a service outside our small world here).


(*1) - I said "reduced", not "completely false"

9
  • 8
    "Use of ChatGPT generated text for content on Stack Overflow is temporarily banned." The announcement doesn't exclude questions.
    – Cerbrus
    Jan 21 at 10:58
  • 5
    I'm not really sure what point you are trying to make. It is prefaced by "We didn't talk so far about chatgpt-generated questions." but the very title of this Q&A is "What should I do if I suspect that a question or answer is written by ChatGPT?" Jan 21 at 11:14
  • 6
    This answer is quite hard to understand, so I can't decide if I agree or disagree with you.
    – PM 2Ring
    Jan 21 at 11:56
  • @MisterMiyagi - yes, that's ("questions") in the title. The arguments discussing "answers" have several aspects, but in my feeling a discussion of "questions" has some more, and different, aspects. I was missing that points - but I'd like to confess to have parallel to the Q&A here read in other threads about this general theme and might have been polarized a bit that the most arguments weighted the occurences, aspects, whereabout and perspective of mass-occurences of answers, for instance that users want accurate answers and not random-texts and answeres want reps. (...) Jan 21 at 12:23
  • (...) With questions there are further aspects (and interests of chatbot-applier). Hmmm. Hope I could make it more clear now? - - - - Ok, after rereading the thread here I must acknowledge that my answer has much be inspired by the parallel threads around - sorry for that low selfawareness... (I'll see whereelse my input would have better fit/were more to the point of discussion - p.s. I've just flagged one question where I suspect slightly a chatbot behind as asked by the SE team announcements.) Jan 21 at 12:24
  • What is the point regarding trolling at Usenet? That ChatGPT is likely to be used for (direct) trolling or posting troll questions at Stack Overflow? (That the motive would be trolling, not gaining cheap reputation points.) Or something else? Jan 21 at 15:41
  • 1
    @PeterMortensen - yes. Putting out "answers" generated by bots might have another motivation (as discussed in many comments in the related meta-threads) as well as the effect of that "answers" on the SE-network and on the users might be different from motivation and effect behind/of questions. That was one thought which came up when reading our discussions here. The other one was, how I/we could train ourselves to become more sensitive in the judging/guessing about the artificiality of the text on our screen and whether it is worth to consider it at all. Jan 21 at 15:50
  • 1
    ...(cntd msg to Peter): forgot to say this - the idea to undermine the wish to rep-farming (by spreading bot-answers) by implementation of some button which immediately provides 340 reps... has been thrown out in one of the mentioned comments-threads I've read today, and I found this remarkable but not reasonably reflecting a/the multitude of motivations. Jan 21 at 15:57
  • The answer earlier covers questions too. Flag for mod attention.
    – Makoto
    Jan 21 at 18:11
-20

Before flagging the post - I would talk to the poster about it. That is, ask explicitly, in a comment, whether they used ChatGPT to generate the post.

Now, it's possible, of course, that a poster would try to hide having done this. But - I believe that's not very likely. While some users view for reputation, I believe only a few users are so interested in illicit SO reputation gain that they would secretly use ChatGPT. And even those - after a couple of incidents of this happening, you'll be able to tell from looking at their other questions.

So, I expect that posters are most likely to:

  1. Say "Yes, why?" - in which case you can point them to the relevant policy and ask them to rewrite/delete.
  2. Say "No, I know the answer because XYZ", in which you would probably believe them.
  3. Say nothing for a while, in which case they don't care about their question/answer much anyway.

In all three cases you are in a better position to decide whether to flag, and the moderator is in a better position to act.

8
  • 5
    Or, just use AI detection software... They're pretty accurate. Accurate enough for reasonable doubt. An OP dishonest enough to use ChatGPT to answer, surely won't have issues lying about using it.
    – Cerbrus
    Feb 20 at 7:00
  • 2
    I've found commenting to ask for rule violations can lead to the specific evidence just being deleted. While enough rep means you can still access that content and flag it, it makes it much more cumbersome to do so. Feb 20 at 8:48
  • @Cerbrus: 1. Link please? 2. Many people use ChatGPT in good faith. Copy-pasting that as a SO answer is poor judgement, but may not necessarily be "dishonest".
    – einpoklum
    Feb 20 at 8:58
  • 3
    The whole reason we have this rule is because many users used ChatGPT in bad fait. Copy-pasting answers in bulk. These detectors are trivial to google... The HuggingFace one is pretty good.
    – Cerbrus
    Feb 20 at 9:23
  • @Cerbrus: Well, many users/editors would not DDG these detectors - because it hasn't occurred to them to try. Also, what is "many"?
    – einpoklum
    Feb 20 at 10:29
  • 2
    "DDG"? "Many" is plenty enough to get noticed, enough to flood the mod team with bad answers, and enough to warrant this whole ban in the first place.
    – Cerbrus
    Feb 20 at 10:51
  • 1
    1. "DDG?" <- duckduckgo.com , no need to live under Google's thumb. Not that they're perfect, but at least they don't seem to spy on you and use the data for all sorts of nefarious purposes. 2. That "many" is IMHO still so little, that when a user encounters a subjectively-suspicious answer, it is likely to be a false suspicion, or a non-malicious lapse of judgement by the poster.
    – einpoklum
    Feb 20 at 11:17
  • 2
    "Google" is a verb nowadays... "DDG", well, I've never seen it used like that before. Let's not go into politics. Your "IMHO" is completely irrelevant as it clearly was plenty to require such drastic measures. Your perception of the flood of ChatGPT content we got on this site is so far off-base... Maybe it wasn't as prevalent in the tags you frequent, but that doesn't mean the problem doesn't exist, nor does it mean the block is unjustified... Frankly, your suggestion to just "ask the OP" is naïve, and would be a waste of everyone's time.
    – Cerbrus
    Feb 20 at 15:05

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .