-15

I've came back to Stack Overflow (after a while) to test out ChatGPT.

The OpenAI community has built something insane. I literally copy and pasted the SO input questions to the platform input and it gave me the result in less than 2 seconds with extremely proficient explanation (code + code explanation).

The craziest thing was that no moderator noticed anything suspicious when providing the answers, at least not yet. What is Stack Overflow's plan about this?

ChatGPT is for sure a disrupting technology. What are your thoughts? You can check my answers (oldest: 74649101, youngest: 74659987) on stackoverflow.com; all were given by OpenAI ChatGPT.

Is this even legal? Any thoughts are welcome. I suspect a lot of people will start doing the same if not already. Are there any mechanism by which SO can recognise such things?

Check my profile for ChatGPT answers https://stackoverflow.com/users/2951933/eugensunic?tab=answers

33
  • 14
    Does it check for duplicates? If so, I'm all over it. If not, I want it dead ;-). Commented Dec 2, 2022 at 2:51
  • 22
    At the scale of Stack Overflow ~2 hours is a very short amount of time for things to be "noticed". We did have a similar discussion a bit ago: Is it acceptable to post answers generated by an AI, such as GitHub Copilot? I'm not sure what (if any) salient differences there are between chatGPT and Copilot.
    – Henry Ecker Mod
    Commented Dec 2, 2022 at 3:04
  • 26
    You really need to verify that those answers actually do what they're supposed to do before posting them. Eg, stackoverflow.com/a/74649919/4014959 needs to use continue, not break.
    – PM 2Ring
    Commented Dec 2, 2022 at 5:20
  • 7
    "Is this legal?" - what license is the content created by the AI released to you under? Does it give you the right to re-license it to SO under CC BY-SA per the TOS? Given that you're not actually writing it there's also the issue of attribution; you're quoting, not creating.
    – jonrsharpe
    Commented Dec 2, 2022 at 9:04
  • 4
    You will just end up creating a load of code only answers that might indeed bring you direct reputation points but will only answer the OPs issue, leading to no reputation in a long run. On top of that, those answers not aligned with the goal of our Q&A. While good answers do explain the code and important principles, they can be reused in the future and in for other users. You'll soon realise that those good answers will bring you reputation in the long run "without breaking a sweat", as you said yourself. Commented Dec 2, 2022 at 10:13
  • 11
    The fact that AI can answer these questions so readily comes across to me as a sign that they are not very good questions. Commented Dec 2, 2022 at 12:52
  • 34
    “I'm amazed how you guys aren't worried a bit...” - I am more worried you are submitting low quality code only answers and nobody is calling you out on the lack of quality (yet). Commented Dec 2, 2022 at 13:50
  • 5
    @SecurityHound They aren't code-only answers, though. Some of them have quite a lot of non-code text.
    – PM 2Ring
    Commented Dec 3, 2022 at 6:47
  • 6
    "I'm also worried ..." ... is this a poor trolling attempt? It is obvious that you don't care. You wouldn't continue when were actually worried.
    – Tom
    Commented Dec 3, 2022 at 15:05
  • 31
    Posting answers you cannot verify as correct is antisocial and actively harmful, whether they were generated by AI, sent to you by a friend, or scrawled backwards on your bathroom mirror by an unseen presence. If your point is that this is a problem and we should worry about it, doing it yourself is not an acceptable way to make the point. If someone mugged you, you wouldn't thank them for pointing out how easy it is to mug someone, would you? Please stop doing this. Anyone else who is doing this: please stop.
    – jcalz
    Commented Dec 3, 2022 at 16:20
  • 6
    If you don't want to face "unnecessary ramifications" you could delete any of your answers which you cannot personally verify as being correct, or at least any of the answers with which people have explicitly pointed out problems.
    – jcalz
    Commented Dec 3, 2022 at 16:44
  • 7
    No, it's not a much more different technology. It's just the latest version of a technology that seems impressive to us because it's "human-like" (something which we, and I include myself, find very cool). However, the technology will continue to improve and there will be a new tool out in a couple of weeks/months/years that will be even cooler. I don't see that we need a new Meta post about each one because I don't see that community consensus on how to deal with content generated by such tools is going to change each time.
    – cigien
    Commented Dec 3, 2022 at 18:09
  • 6
    @cigien - I can totally see community consensus changing as the tech evolves. Likely any problems caused by this tech will also change. For example as the tech becomes more viable for more questions and more "human like" in its responses I can imagine a greater proportion of FGITW answers that are not just "code only" and that are at least superficially plausible and that the humans on the site will need to spend longer evaluating and moderating these. Commented Dec 3, 2022 at 19:24
  • 8
    "chatGPT is for sure a disrupting technology. What are your thoughts?" ever heard of "garbage in, garbage out"? (that was a rhetorical question). This is like the "oh no- computers are learning to code and now they're going to take our jobs- oh wait- for the computer to solve a client's problem, the client will have to accurately describe what they want". Maybe go try to build something to detect unanswerable questions and ask the asker to clarify on what needs clarifying. I mean- what is ChatGPT going to do for "can you help me?" Qs?
    – starball
    Commented Dec 4, 2022 at 7:33
  • 8
    "Temporary policy: ChatGPT is banned" (date: 2022-12-04).
    – starball
    Commented Dec 5, 2022 at 5:53

2 Answers 2

41

The trouble with having an AI provide answers is what happens if you get comments on those answers?

If the comment says simply "this answer is wrong" how are you going to check the answer or correct it?

If the comment asks you to "please further explain the answer", are you equipped to do that?

If your AI can respond to additional questions and update the answer for you then it's effectively able to pass the Turing test in this limited problem domain, if not then your answers run the risk of simply being noise.

We can actually see that happen with your answers...

How are you going to respond to these comments?

Or if the answer is downvoted...

If you want to know what we're going to do about it, see this question. I.e. using chatGPT to generate answers is currently banned.

5
  • 3
    I was able to make 51 points in a 2.5 hours frame, without breaking a sweat. I fed the AI with OPs additional comments and it did very well. I'll continue doing what I started, just to see how it performs. I still think this will be a big issue for SO
    – EugenSunic
    Commented Dec 2, 2022 at 8:18
  • 47
    Is the above comment AI generated? It doesn't address the answer's point here at all, @EugenSunic
    – Thom A
    Commented Dec 2, 2022 at 8:34
  • 3
    then the answers get downvoted, no problemo
    – Rainb
    Commented Dec 4, 2022 at 23:03
  • 11
    @Rainb: When the problems are subtle and the answer looks well-written, "no problemo" is far from accurate. Many readers will skim and upvote an answer that looks good, looks like it makes sense, because we're used to answers that look like that having been written by humans that also get the small details right. When it looks good but requires careful examination to see that it isn't, it's a lot more likely to attract undeserved upvotes and displace actually correct answers. Wasting time for curators, and for people who actually try to use code from such an answer. Commented Dec 5, 2022 at 17:16
  • 2
    You not only brag about violating the ban, you promise to continue? SMH
    – WGroleau
    Commented Jun 18, 2023 at 16:22
-38

I've been doing this exact thing today, got +120 points of reputation, and even helped a few people.

I believe this is inevitable. If a bot can answer a question no worse than a human, then there's nothing Stack Overflow or anyone can do (it's all just text, not even an image!). Even if there were some kind of detection system, people would just correct the bot's output and give that text instead. Maybe Stack Overflow would incorporate its own version of the near future bot, which would answer people automatically even before they get to post for the people to see.

It's just the new reality, whether we are ready for it or not. The Internet will adapt, and a new era shall be born. Maybe we'll get to realize that we do not need jobs anymore to function as a society; we simply need electricity and robots to do all the work for us. If there aren't any jobs, the consumer doesn't have any money, and if they don't have any money to consume then the monetary system is impossible.

We need to be ready to transition into a new world, to realize that we can build an actual paradise and we do not need to suffer anymore of the monetary problems we suffered for centuries. There will be no poverty, no war, no greed, because there will no longer be scarcity, and no longer will money have value that caused the idea that we have scarcity on this planet. A new world would be abundant! A true mechanical paradise the world has never seen before!

Ehem, anyway, I had fun answering questions I barely have read or understood today :)

12
  • 41
    Could you please stop doing this unless you can verify whether or not the generated answer is correct? Right now you're just making extra work for others who have to wade through answers which look okay at first glance but are quite often incorrect and sometimes complete nonsense. That's antisocial; you should stop.
    – jcalz
    Commented Dec 3, 2022 at 16:13
  • 21
    yeah ChatGPT themselves do state as a limitation "ChatGPT sometimes writes plausible-sounding but incorrect or nonsensical answers" and "plausible-sounding" may well be enough to garner some upvotes Commented Dec 3, 2022 at 16:16
  • 2
    First of all, my initial experiment was to see how easily I can submit an answer and get free reputation points. I was purposefully searching for dumb/simple question that can easily disprove any AI wrongness (which already happened a few times). Proven possible and not always accurate I've lost interest. Now what I do is tell the AI to write an answer based on what I actually intend to say. Secondly, I do check for obvious wrong answers now given by the prompt and I do check if the code works, it's not hard. You think telling me to stop it will stop EVERYONE from doing these silly stuff?
    – Jefferson
    Commented Dec 3, 2022 at 16:23
  • 2
    That's why we have multiple people checking for the answer and downvoting it. Telling me to not or what to do would do absolutely nothing. More AI programs coming, you cannot stop kids from doing exactly what I did can you? The best thing StackOverflow can do is to incorporate their own version of the AI so that it gives an AI answer the questions before they are submitted (the person will know that such thing exist and it can lower the number of duplicated/silly questions as well).
    – Jefferson
    Commented Dec 3, 2022 at 16:28
  • 8
    Re "robots to do all the work for us": That was also predicted in the 1980s (the so-called "leisure society"). It didn't happen. Commented Dec 3, 2022 at 17:35
  • 2
    "It didn't happen". A person been smoking for 20 years, says: "they said ill get cancer, yet I didn't!". Things take time y'know, your answer doesn't make any sense, because a lot of jobs are ALREADY being automated. Automation is a process, not an instant thing that happens on Tuesday morning.
    – Jefferson
    Commented Dec 3, 2022 at 17:38
  • 1
    @PeterMortensen considering the mathematics, programming, science you've done in your career you should leave the gates open for AI. Comparing 1980 to 2020+ is something I wouldn't expect from a guy like you. I agree with Jefferson, perhaps 100s of posters are deploying this technology to build a good SO cv.
    – EugenSunic
    Commented Dec 3, 2022 at 18:19
  • 8
    Regarding "plausible sounding" in this case the answer seems so close - except it seems to have just invented a possible return code of 3 that isn't correct - or would even be relevant as return codes 1 and 2 are all that are needed here stackoverflow.com/a/74668146/73226 Commented Dec 3, 2022 at 18:37
  • 11
    -1 for "answering questions I barely have read or understood today" That is truly terrible. Commented Dec 6, 2022 at 10:48
  • That was the whole point Vladimir
    – Jefferson
    Commented Dec 15, 2022 at 14:24
  • 8
    @Jefferson - The fact your low-quality plagiarized answer(s) were upvoted proves, more upvotes are as dangerous as downvotes and downvotes are as important as upvotes, all you have proven is you submitted numerous answers which you had no business submitting. Commented Dec 31, 2022 at 6:43
  • 1
    REALLY disappointed at people not only violating policy, but bragging about it.
    – WGroleau
    Commented Jun 18, 2023 at 16:25

Not the answer you're looking for? Browse other questions tagged .