I just left a comment beneath an answer by a new user. The answer was wrong in several aspects. I visited their profile and was amazed at seeing they gave a staggering number of answers in a short period: 21 answers in 95 minutes.
Is this record-breaking? Does the (answering) system not need some defense against this as I'm sure many of these answers will be low-quality? Is there an answer-ban like there is a question-ban?
-
4Maybe some bot? The answers are over several different areas, I see at least C++, C#, Java, R, Haskel, assembler. Though it is possible that the user has expertise in all these areas, I highly doubt it.– BDLDec 4, 2022 at 19:03
-
19Looks like chatgpt again. It's an incredibly cool system, but it's sad to see people use it this way– Zoe is on strike ModDec 4, 2022 at 19:05
-
10Yeah, definitely chatgpt. "It sounds like you're trying to <blank>" is basically its signature to show what it understands the question as prior to giving an answer. In this case, see meta.stackoverflow.com/q/412696/6296561, which this user is in violation of– Zoe is on strike ModDec 4, 2022 at 19:07
-
29@Dom we have our hands full dealing with regular crap that gets posted. If we now have to sift through the artificial crap as well this site is doomed. Yahoo! Answers here we come.– reneDec 4, 2022 at 19:25
-
27@Dom: You realize that by posting answers that you can't verify you are actually harming the community? I checked your answer to the WGSL question and your answer wasn't even in the right language...– BDLDec 4, 2022 at 19:26
-
19For the record, mods have been trying to stay on top of it for now, but it's also not much of a secret that we don't have a whole lot of effective tools to assist in detection of these answers. We mods are trying our best to stay on top of them, but as chatgpt gets more popular, we'll rely more and more on flags to detect users abusing it, and people not deciding to dump those answers to test the response (i.e. generating an artificial load when we could've spent time dealing with other users doing this, or other problems). We're doing our best as far as resources allow in the meanwhile– Zoe is on strike ModDec 4, 2022 at 19:33
-
3Similar? stackoverflow.com/users/19192614/boatti, stackoverflow.com/users/20684429/a-s, stackoverflow.com/users/20677565/kan-jang– takendarkkDec 4, 2022 at 21:37
-
14@DotNetRussell Many of the answers aren't correct even if they look reasonable at a glance to someone unfamiliar with the subject, which is the problem. We might not be far off from AI being able to correctly answer questions as good as subject matter experts, but we're not there yet - and until then, better to keep the site clean of answers that the one posting may not even understand, let alone validate the correctness of.– CertainPerformanceDec 4, 2022 at 21:51
-
15@DotNetRussell If the answers were correct and the user followed the referencing requirements, then that would be OK. The problem is that a high percentage of the answers are wrong/bad, but the bot is able to make the text look like it might be correct. The bot doesn't care about being correct. The bot has nothing in its design that even attempts to be correct. It just produces text that looks like it might be correct and sometimes it gets lucky and is correct.– Makyen ModDec 4, 2022 at 21:53
-
21@DotNetRussell It wastes everyone's time because the answers look plausible at first glance It takes a lot of effort to realise they need to be downvoted. On top of that someone can create lots of answers very quickly over lots of different subject areas that then need lots of clean up/downvoting.– Robert LongsonDec 4, 2022 at 22:01
-
8@DotNetRussell That would be the ideal. The real problem is that with many people posting these as fast as they can they can post them faster and in more volume than SO has available curation resources, if handled on a individual post basis. And by as fast as they can, there have been multiple people posing these at their maximum answer rate limit of 1 every 3 or 5 minutes. I've, personally, deleted about 500 of them, just today, so far and I expect that to be much higher later.– Makyen ModDec 4, 2022 at 22:04
-
18Complicating that is that the bot is sufficiently good at making the text look good and sound good, without being correct, such that it often takes a significant amount of subject matter expertise to be able to know the answer is incorrect (without putting out the work to try the answer's solution). We just don't have enough people (regular users) willing and able to downvote and delete-vote to handle the influx, if we're handling them on an individual post basis. That doesn't even consider that a lot of the bad ones get upvoted, because they look good.– Makyen ModDec 4, 2022 at 22:06
-
21@DotNetRussell You appear to have completely glossed over the posting rate issue and the comparative amount of time and effort necessary to identify a typical bad post from the AI (may take an expert in the tech some time) vs a typical bad post from a human (typically obvious to most people in seconds). Unaugmented humans can't create a thousand words of a good looking, good sounding answer at a rate of 1 every 3 minutes for hours.– Makyen ModDec 4, 2022 at 22:16
-
21The site has a fairly static amount of users performing curation activities. That level was already substantially below what would really be needed to keep the site clean. We can't reasonably increase the available curation resources. Thus, substantially increasing the need for those resources, is going to have a significant negative effect.– Makyen ModDec 4, 2022 at 22:16
-
5"Temporary policy: ChatGPT is banned".– starballDec 5, 2022 at 5:51
|
Show 13 more comments