88

Following up from the bustling discussion as a consequence of the temporary ChatGPT ban, I guess the big gaping question is how can one determine if an answer used ChatGPT?

As an example, @AKX suggests that there are some tells: answers that start with "It looks like the issue...", or "To fix this...", or those that ends with "I hope this helps" are heuristics.

But we can't confirm that the answer is indeed AI generated, as many legit SO users can and do begin their answers like this.

Another suggestion by @drewcassidy is that we can use an output detector like https://huggingface.co/openai-detector/ - using the model against itself - to determine if the answer is real or fake.

39
  • 3
    In addition these phrases are pretty common in use, it's not like these are strong indicators. You might supposed to make an account and check it. No seriously, don't have a clue how this rule is supposed to be enforced. Dec 6, 2022 at 9:26
  • 1
    You should flag for moderator attention, providing your evidence. Dec 6, 2022 at 9:28
  • 10
    @snakecharmerb your skipping the point of the whole question. How do we gather evidence in the first place? Or should we just flag every answer that does not look human ? Dec 6, 2022 at 9:29
  • 3
    I don't really think you can do it based on rules, it'll involve human intuition. Judge the overall style of the post. No spelling mistakes will probably be a big tell :)
    – Gimby
    Dec 6, 2022 at 9:29
  • 9
    Do we actually need a 100% reliable discriminator? If a user manually posts content indistinguishable from a mindless bot without subject matter expertise, misidentifying them as doing it with less effort doesn't seem that harmful. Dec 6, 2022 at 9:31
  • 4
    You can usually tell from a user's history on the site whether they are likely to have produced an AI-like answer by themselves. Dec 6, 2022 at 9:42
  • 9
    I also use the users history as a indicator. A new user posting 5 answers with just a little more than 3 minutes inbetween is a good hint. If you then find an answer that contradicts itself (last example: your problem is that the object is not extendable, solution: use object.Freeze to make the object not extendable), then you have a very good idea of what is happening.
    – BDL
    Dec 6, 2022 at 9:55
  • 4
    @Barkermn01 lol i love that the user is called GPT-3 😭
    – hongsy
    Dec 6, 2022 at 10:37
  • 2
    @Sgdva If you can’t tell whether it was tested and actually solves the problem, do you care? Dec 6, 2022 at 15:46
  • 4
    @Sgdva, IMO if we allow these bot's at all they will start spamming the site, how long is it till some one makes a bot that starts asking questions it can't find and bots answering it, that's a recipe for destroying the site.
    – Barkermn01
    Dec 6, 2022 at 17:27
  • 4
    @Thingamabobs: Being a native speaker is not a guarantee. They still need to actively learn to write. 52% of Americans falls **** below **** literacy level 3. "Level 3 is considered a suitable minimum for coping with the demands of everyday life in a complex advanced society." Dec 6, 2022 at 23:56
  • 2
    @Sgdva YET!, it takes a Javascript Dev 10, 15 mins to make a bot that uses a headless browser to start auto-posting, and maybe another 30 mins to build a data store of URLs it's already scanned and answered, my point was not "we should never allow automation in society" it was that automation in this capacity when the bot is not actually testing the code they are giving if we permit it, it won't be long till we get 100% automated systems doing it, and the human answers and point stop working we then lose moderators and site is useless then.
    – Barkermn01
    Dec 7, 2022 at 15:44
  • 8
    @Sklivvz gnerally, ChatGPT answers do not look like junk, they look like great answers despite the fact that they are junk. not deleting them damages the site.
    – Kevin B
    Dec 7, 2022 at 21:55
  • 5
    In a fit of irony, I posted this question into ChatGPT and it returned an "internal server error" Dec 8, 2022 at 19:20
  • 3
    I hope the solution is not that we try to start writing really bad English and cross our fingers that AI's down come down to our level.
    – Trilarion
    Dec 11, 2022 at 17:51

9 Answers 9

82

The general question of how to detect these posts is something we've been avoiding publicly answering, because publicly describing how we detect ChatGPT generated content provides those people using ChatGPT with specific information which they could use to make it more difficult for us to detect ChatGPT generated content. So, while I/we understand your desire to know, this isn't something we're officially answering publicly at this time.

For moderators, there is a significant amount of information available about detection of these posts in the Moderator Team and other locations mentioned in there. Moderators can also get information through the Teachers' Lounge chat room.

8
  • So, the answer is flagged instantly, I mean will OP know in time not to use the answer?
    – Ed_Gravy
    Dec 6, 2022 at 16:00
  • 7
    At this time, there can be significant delay between flagging and a moderator taking a look at it. While we're trying to stay on top of these, there are literally thousands of such posts, and that's over and above all the other stuff we normally handle. We all are, of course, volunteers, so how long it will take to get to each flag is indeterminate. So, overall, the answer to your question is that it's likely the OP, who gets directly notified of any new answer (and who is often specifically watching for answers to their question), will see the answer prior to a mod looking at it.
    – Makyen Mod
    Dec 6, 2022 at 16:27
  • 2
    Well, modGPT turns out to be a dead end... (pasted from chatgpt) "It is not possible for me to determine whether a given programming solution was produced by me or not. This is because chatgpt is a large language model trained by....", etc.
    – danh
    Dec 10, 2022 at 16:16
  • "...there is a significant amount of information available about detection of these posts..." Is there? Without details it's difficult to judge how high the success rate of detection really is. Could be anything really.
    – Trilarion
    Dec 11, 2022 at 17:57
  • 4
    @Trilarion The "success rate" of detection is something that is really only possible to guess at in aggregate. In order to know the success rate, you'd have to identify everything that was posted that originated from ChatGPT, even the things which were not detected as such, which is, obviously, not really possible, if for no other reason than it's, at best, difficult to prove that you've found everything. But, yes, members of the public not being able to make such judgements about the efficacy of detection is one of the trade-offs of not making all information public, at this time.
    – Makyen Mod
    Dec 11, 2022 at 18:10
  • "yeah we can't really detect ChatGPT with any sort of accuracy but we don't want to admit it" Jan 10 at 23:38
  • 4
    @ScottishTapWater Your statement is completely unjustified based on the available public and private information. It's just slinging mud around. If you take the time to identify a notable quantity of A) posts which are ChatGPT generated that have not been identified, and/or B) posts which have been identified as generated by ChatGPT, but were not actually generated by ChatGPT, then the first part of your statement might have some basis. Currently, it's entirely baseless. As to "but we don't want to admit it", that's just presuming motivation based on your own, erroneous, assumptions.
    – Makyen Mod
    Jan 11 at 19:37
  • 2
    While there have been some of (B), it's a low number and those are typically reevaluated when the author indicates an objection, either by flagging their deleted post or responding to the moderator message. As to (A): of course detection methods are both imperfect and continuously improving. So, of course, there will be some ChatGPT generated posts which are not, yet, identified. So, if you can identify a significant quantity (proportional to the thousands of posts which have been identified as ChatGPT and deleted), then the first part of your statement might have some basis.
    – Makyen Mod
    Jan 11 at 19:37
31

I don't think there's going to be any value in having you, a mere mortal, try to determine if an answer or question was generated by ChatGPT.

The reason is super, super simple: we don't want this to turn into a witch hunt.

There are things you can do even today to help with curation of answers; if an answer is wrong or incomplete, you can downvote it. If you happen to notice a trend of similarly bad answers from an account, you can flag for moderator attention with the series of answers you've got as evidence.

This shouldn't be a "those bad answers are more moderatable than others" situation - just vote on answers as you always would, and let the moderators deal with the heavier lifting on this circumstance.

2
  • 11
    Makoto makes a valuable point here that I think hasn't surfaced quite enough in discussions like this: witch hunts on the internet are far too common and (especially with anything that requires a subjective opinion) the results are very rarely correct. I'm glad to see this come into the discussiion.
    – Philippe StaffMod
    Dec 11, 2022 at 17:19
  • I second that, and also, we should focus on what the real issue is exactly, is it that we don't like the Idea of people abusing the system and using chatGPT to effortlessly answer questions and get upvotes or is it about the value and correctness of answers. And what if chatGPT is able to give valuable and useful answers that respects stackoverflow's guidelines what do you do about that? or is someone was to copy/paste an answer from another forum to SO, would that also be a problem ?
    – Xsmael
    Jan 5 at 14:09
10

I have flagged several suspicious answers with in need of moderator intervention and a comment about answer contents and user behavior (usually there are a lot of low quality answers in succession in different topics) but probably it would be great to add a separate flag/closure reason/deletion reason specifically for this use case.

P.S.

Also it seems there are some AI-generated questions =)

4
  • 14
    AI generated questions? If it means no typos and proper markdown, I'm all for it
    – Phil
    Dec 8, 2022 at 0:58
  • 1
    "I have flagged several suspicious answers..." To be an answer to the question here you would probably have to say a few words about what raised your suspicion in these cases. Otherwise, how does it answer the question?
    – Trilarion
    Dec 11, 2022 at 17:52
  • @phil: Uh, no. Can't use AI for answers? Can't use it for questions either. Dec 12, 2022 at 12:50
  • 2
    @RobertHarvey was mostly tongue in cheek but perhaps it could be useful if the prompt was something like "reformat this question to be suitable for Stack Overflow"
    – Phil
    Dec 12, 2022 at 18:01
7

how can one determine if an answer used ChatGPT?

Answers by ChatGPT will likely have perfect grammar and punctuation (unless this bot learns to dumb itself down in that regard), a certain length maybe (3-4 paragraphs, typically no links nor code/emphasis formatting but a certain fondness for bullets/numbered lists) and most importantly be kind of useless, missing the point or stopping short of the solution. Unfortunately detecting that would require domain knowledge. Fortunately we have this knowledge but we have only limited time.

Therefore it seems apt to use AI in order to detect AI. Kind of what a GAN does. ChatGPT is the generator and what we would need to build would be a discriminator and then see where that leads us.

In the end, nobody knows if you are a dog on the Internet. I could be one (or an AI).

The really crucial thing is being an expert. That is much harder to fake. People will realize at some point if I just sound well or if there is real substance behind my words. At least for those topics with definite answers like programming.

An important thing would also be to assess the accuracy (false positives/negatives) of such a detection. I guess if one takes all posts before December 2022 as negatives and all self created answers by ChatGPT as positives, it would be possible to estimate these error rates and judge how well that detection system can work. That's really important to know. See for example Why was my answer deleted for using ChatGPT even when I didn't? for what can happen if you start your answer with "Here's an example of how you could use.." among other things.

Finally, we could also include a stricter trust model to recognize experts in their fields. In the past, we mostly emphasized that the content should stand on its own, but exploiting the link of every answer to a user account could result in additional information about whom to trust and whom not to trust.


P.S.: As Cerbrus and ConceptRat mention in another question, a bit of help from OpenAI could make the detection much easier, i.e. if they would have an API that lets you check if a certain part of content was generated by them lately. That might alleviate the problem greatly (unless people start transforming the output before posting here).

4
  • 4
    Many thanks to Peter Mortensen for providing context and improvements. (constantly and over many years)
    – Trilarion
    Dec 11, 2022 at 21:13
  • 1
    "if they would have an API that lets you check if a certain part of content was generated by them lately." The problem is that they don't store output. When the session closes, the data is gone.
    – Cerbrus
    Dec 12, 2022 at 10:26
  • /me starts working on script to add grammatical errors and mess up code a little so it looks human generated :)
    – Yepher
    Dec 12, 2022 at 17:42
  • 2
    In regards to "typically no links or formatting", the AI does seem fond of bullet/numbered lists, though.
    – Cerbrus
    Dec 14, 2022 at 9:02
3

There are a few tell-tale signs that can provide a general indicator that answers and accompanying example code were pasted from ChatGPT.

Once you've seen them, it's hard not to spot them when they pop up in the wild. And while not a guarantee that the answer is AI-written, they are strong indicators that are often worth further investigation.

As for code correctness, if perfect-looking example code has a glaring error typically only caught by intellisense, something's probably wrong. ChatGPT tends to prefer explicitly naming variable types over inference, so it's rare (in my experience) to see var foo = something() (C#) or auto bar = another() (C++).

If reviewing an answer to determine if it is human or not, it's probably worth your time to paste it into an IDE, if you don't already.

Presumptive Type Classification

Many property classes in C# provide a getter function, named the same as the class name, prefixed with Get. Likewise for methods returning a collection, GetAll. This is usually by design, but it is not always the case, especially when dealing with code introduced very early on before adopting this naming convention.

using System.Net.NetworkInformation;

IPGlobalProperties properties = IPGlobalProperties.GetIPGlobalProperties(); // truth
//...
NetworkInterface[] interfaces = NetworkInterface.GetAllNetworkInterfaces(); // truth
foreach (var ni in interfaces) {
  IPProperties ipProperties = ni.GetIPProperties(); // fiction
  //...
}

Just because the GetIPGlobalProperties() and GetAllNetworkInterfaces() methods use their class names verbatim, does not guarantee that a GetIPProperties() method is part of the IPProperties class. Indeed, such a class does not exist in the System.Net.NetworkInformation namespace. GetIPProperties() is actually part of the IPInterfaceProperties class.

Similarly, the existence of an enum specifically describing common interface types (NetworkInterfaceType), does not mean every possible connection type in existence is included.

using System.Net.NetworkInformation;

if (ni.NetworkInterfaceType == NetworkInterfaceType.Ethernet // truth
  || ni.NetworkInterfaceType == NetworkInterfaceType.Wireless80211 // truth
  || ni.NetworkInterfaceType == NetworkInterfaceType.Bridge) // fiction
{
  //...
}

Both of the above errors are easily apparent when pasted into an IDE, but ultimately would go unnoticed except to the most astute programmer with significant first-hand experience using these specific .NET classes, as the following unaltered snippet from a ChatGPT response shows:

AI-generated code excerpt with errors

Symmetric Sentences

Example code is often introduced and summarized by a single sentence, using a consistently recognizable sentence structure with very little - if any - deviation from the following:

Standalone introduction sentences (meaning a single-sentence paragraph) begin with:

  • "To get/display ..."
  • "For example, ..."

Multi-sentence introductory paragraphs typically use the modified form "To do this, ..." in the last sentence of the paragraph.

Summary sentences will begin with one of the following, with very few exceptions:

  • "This will display/return ..."
  • "In this example, ..."

These tend to be paired, meaning an example introduced with "For example..." will invariably be followed by a summary beginning with "In this example...". Introductions beginning with "To display..." are followed by summaries beginning with "This will display...".

2
  • 3
    It is mildly distressing that my normal way of writing answers tends to match what you've described here in the "Symmetric Sentences" section. (And my normal answers also often include typos in the code blocks, so maybe I am a bot after all!)
    – Cody Gray Mod
    Jan 7 at 8:59
  • 1
    Re "ultimately would go unnoticed except to the most astute programmer": I suspect this for many (most?) of the "try this" answers on Stack Overflow (code dumps without any explanation) by humans (copied from somewhere?), especially late answers. Though I could be completely wrong. Jan 7 at 13:04
2

As the state-of-the-art AI model evolves, it may eventually be indistinguishable from human-written text. So instead of judging by arbitrary "noticeable traits", I rely on my "sense of language" to identify answers that don't "feel natural" to me. Then I check the user to see if they have just posted multiple answers in quick succession, plus other heuristics, like being new users or low-rep users. If it's a single occurrence I'd just flag accordingly (usually NAA, sometimes VLQ), and if there are multiple low-quality answers, I double-check and then raise a mod flag explaining my concern.

2
  • The very AI that writes text can be used to determine if it's likely to have written a certain text. Detection isn't a technical problem.
    – Cerbrus
    Dec 16, 2022 at 7:56
  • AFAIK, NAA and VLQ are not the right tools for this. When I suspect an AI-generated answer, I do the same checks you do and then flag them for moderator attention with a message like “Possible ChatGPT-generated answer.”
    – Julia
    Jan 10 at 23:07
-10

Yours begs the question; What is the real problem for SO which chatGPT creates?

It seems to me the primary issue is rate of ingress of "seemingly good" answers, that is, answers which eat-up volunteer time recognizing that while well-written, the answers are not accurate; but humans write those too, just not 20 in an hour.

So then isn't some form of user rate-limiting the solution? (Indeed SO has done this for users < 125rep (GOOD MOVE!))

on the Temporary ban page: Temporary policy: ChatGPT is banned

I ran into some good discussion about both rate and length of posts. Short answers are much easier to discern:

  1. if they actually solve the problem
  2. That they probably did not come from chatGPT

Ultimately if a user is habitually pasting in text from chatGPT, they will also be getting habitually down-voted, so that part of the problem solves itself.

Note that if that wasn't true, we'd be getting solutions and SO would celebrate and not ban chatGPT.

It's good SO is learning ways to tell the difference, and a good idea not to publicly disclose those.

Part of the right answer though was suggested by @polkovnikov.ph on the link provided above:

Clipboard API supports adding a custom mimetype to data in clipboard. If OpenAI just added a text/x-chatgpt for copied text, at least other resources would have a protection against foolest of fools that copypaste directly from their website.

because this protects chatGPT, educators, scientists, and yes SO. Whether mods care to reach out to OpenAI or not, I'm going to, because this is the kind of this which merits a community response.

Then if a user pastes directly from chatGPT to an answer, the 'Answer/Submit' button can go grey with a banner 'Careful, plagarizing chatGPT could result in a ban'

Where users citing and refining chatGPT answers into actual solutions will have edited out meta-text and have more to the body than just copypaste

Stack Overflow is a place of earnest effort, where questions have a Required: 'What have you tried?' field, and frankly, I think that form should have an added checkbox:
[x] Yes, I tried chatGPT first

Which again helps the rate problem (by reducing question ingress)

9
  • The first part seems to be missing that ChatGPT answers look good. They need more effort to identify as bad and may even receive significant upvotes when wrong. A rate limit would have to be (much) more severe than for human content and ambient downvoting won’t single out such posters. Feb 15 at 6:24
  • "Yes I tried ChatGPT first" -> no: if ChatGPT cannot be relied upon to produce correct answers it should not be recommended as a source of information. Feb 15 at 6:35
  • @snakecharmerb the internet cannot be relied upon to produce correct answers, nor can SO, indeed they are sources of information, and while chatGPT answers are seldom exactly what you were looking for usually a couple of modifications to the query (running conversation) can get you a lot closer. The proposed check-box is a step to ensure you've tried what you can before bothering busy devolopers on SO. (Same reason we're expected to search google and SO before writing a question) Can google be relied upon to produce correct answers? Directly: No. But both services can help you get there. Feb 15 at 20:25
  • @MisterMiyagi in either case humans are the ones copy-pasting chatGPT answers. chatGPT does not have a SO API where its pushing spam answers to SO. The problem is lazy users were copying SO questions -> chatGPT, then the AI answers strait back to SO without; testing, reviewing, refining the answer at all. The rate limit is for human submissions, and indeed this has been one of SO's early adjustments to solve for this influx. Feb 15 at 20:29
  • "Yes, I tried chatGPT first" is a horrible idea, because ChatGPT is not a programmer, it doesn't understand code, it doesn't validate code...
    – Cerbrus
    Feb 20 at 9:39
  • @Cerbrus are you a programmer? can you copy-paste its output to validate? then you'll get a stack trace make 2 tweaks and 90% of the time have a solution in a fraction of the time it would have taken to google and formulate. Work smarter not harder. Feb 20 at 19:10
  • I'm indeed a programmer, and I use Codex / CoPilot instead of a language model that's not made to do code. @DeftconDelta. ChatGPT doesn't positively affect my productivity. CoPilot's impact is... meh.
    – Cerbrus
    Feb 20 at 22:23
  • @Cerbrus you can't paint everybody with your brush. Many of us make a decent living being much more generalist, and chatGPT is a good tool to get you a serious leap in a language you know almost nothing about. is it going to help with a language you code in everyday ABSOLUTELY NOT, chatGPT is only impressive (in any category) when you open your mind and widen the breadth of what you're trying to do, not get exact specifics. I hope some of this has inspired you think a little outside the box, and was hoping to benefit similarly. But you've put nil effort into your argument so, bye! Feb 23 at 2:55
  • Please don't presume to know how much time and effort I've put into ChatGPT. It's not of any value to SO, and your suggestion, aside from being yet another iteration of "Embed it", doesn't help. People lie on checkboxes they need to check to post.
    – Cerbrus
    Feb 23 at 8:58
-15

We can't, and as such we shouldn't waste our time trying.

ChatGPT is merely the latest and greatest iteration of GPT. As GPT continues to improve, so will the answers it generates, which in turn will make such answers more difficult to detect. The end result is an arms race between the curators of Stack Overflow and the developers of GPT - a race that we the former, with our limited personnel and resources, cannot ever hope to win.

But we curators are smarter than an algorithm that is nowhere near being artificially intelligent. And we can win, but to do so we have to think deeper than merely curating answers, and instead turn to prevention. Or in short, move the goalposts by ensuring that all users on Stack Overflow are real human beings, not bots.

This may sounds ridiculous and unworkable but it truly is the only way to have some sort of protection from more and more sophisticated bots based on more and more sophisticated language models. As more and more of these bots flood the Internet and begin to crowd out human-generated content with computer-generated noise, the only way for human communities where accuracy is paramount (such as Stack Overflow) to continue to function will be via identity verification.

For Stack Overflow, this sort of verification is unlikely to cause much turmoil, as many of the most trusted users already use their real names for posting the content they produce. Whether Stack Exchange Inc. is forward-thinking enough to care is the most important concern.

Of course, identity verification doesn't preclude verified users from using GPT to generate answers, but simple numbers dictate that the numbers of such users will be low, and as such ordinary curation efforts should be able to manage the detection and removal of such content and users.

11
  • 1
    "We can't" That's simply not true. The very tool used to generate text can be used to detect how likely it is the text is AI-generated. There are plenty of services out there that can. Even if all users are humans, that doesn't stop them from using some AI to generate content. The whole problem here is human users using AI-generated text.
    – Cerbrus
    Dec 14, 2022 at 8:29
  • 1
    "simple numbers dictate that the numbers of such users will be low, and as such ordinary curation efforts should be able to manage the detection and removal of such content and users." That's the entire problem here. The number of users isn't low. The content they post is creating significant work for moderators. You're completely missing the point/reason of this ChatGPT blanket ban.
    – Cerbrus
    Dec 14, 2022 at 8:30
  • @Cerbrus How many of those users are new?
    – Ian Kemp
    Dec 14, 2022 at 9:48
  • Why does that matter?
    – Cerbrus
    Dec 14, 2022 at 11:12
  • 1
    Because new users who intend to sign up only for the purpose of spamming, are unlikely to want (or be able) to go through the effort of proving their identity. So they won't sign up at all - leading to less spam, ChatGPT or other.
    – Ian Kemp
    Dec 14, 2022 at 12:14
  • 3
    And existing users will leave the platform en-masse, because plenty of users don't trust SO with their data. This has been an issue in the past with something as comparatively trivial as usernames.
    – Cerbrus
    Dec 14, 2022 at 12:16
  • So the worst case of trying to fight the low-quality answers is we end up with high-quality answers? xkcd.com/810 Dec 15, 2022 at 23:07
  • 2
    @JohnMontgomery If you believe that a machine learning model with zero comprehension of what abstract concepts like "programming" are or entail, can ever provide high-quality answers about such abstract concepts except by accident, then I have nothing to say to you.
    – Ian Kemp
    Dec 15, 2022 at 23:24
  • @IanKemp Your first paragraph seemed to imply that you think it could, or else why wouldn't we able to detect it? Dec 15, 2022 at 23:41
  • 3
    @JohnMontgomery GPT will generate more and more answers that appear correct, but won't actually be correct. As its sophistication increases the proportion of each answer that is incorrect will continue to shrink, but that doesn't matter: one syntax error is the same to a compiler as one thousand. However, as each answer becomes proportionally more correct, it also becomes proportionally more difficult for a human to detect the fundamental incorrectness that invalidates said answer in its entirety.
    – Ian Kemp
    Dec 15, 2022 at 23:47
  • 1
    This is uninformed. OpenAI themselves have released tools to detect if something was generated from ChatGPT or not. They have no interested in disguising the output from the bot as something else, quite the contrary. So detecting it is rather a race between OpenAI and OpenAI... and in that race I'm fairly certain that OpenAI can hope to win. SO just have to use their tool intended for this purpose.
    – Lundin
    Feb 2 at 11:51
-21

You can detect the explanations, but not the code because the code could come from anywhere or ChatGPT might just be reading content from a programming language's official site.

Why would you ban code generated by ChatGPT when other users will post the same exact code from either Python's official documentation site, Java, or C#? So just let it go; don't even try to detect as some other moderators advised. Detect the code explanations or code that does not compile posted from ChatGPT, otherwise just stand down.

4
  • 2
    ChatGPT doesn't answer with only code. This whole ban only really affect those that blindly copy-paste the output, any way, so your whole "don't detect the code" is completely irrelevant.
    – Cerbrus
    Jan 8 at 14:27
  • You guys will struggle and won't be able to completely quarantine SO from GPT code and content
    – Dong Li
    Jan 8 at 15:40
  • 4
    ChatGPT doesn't copy content, including code. It generates content using a large language model. While it's possible the generated code is the same as some code in the material used to train ChatGPT, it's unlikely that someone will be able to find exactly the same code from somewhere else. If ChatGPT copied code from somewhere, the code would probably be better, because the copied code would likely have been tested, rather than generated by a model that just puts "words" together in ways it thinks "fit", based on its model with no actual understanding nor functional checking.
    – Makyen Mod
    Jan 8 at 18:06
  • 4
    "You guys will struggle and won't be able to completely quarantine SO from GPT code and content" These blanket statements are just nonsense... Of course some posts will slip through. This whole rule exists so mods have somewhere to point users they're suspending for ChatGPT use. No arguments, no ifs or buts.
    – Cerbrus
    Jan 9 at 8:28

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .