99

I just got Late Answers Queue review item #33495800, which used a now-deleted ChatGPT-generated answer, a/11107541 as a review audit.

Since it was an audit, comments were hidden. There was a comment saying that the answer where someone had sniffed it out as being written by ChatGPT, but I couldn't see it until after I passed the audit. And I'm guessing that not all deleted-for-ChatGPT answers will have such comments on them.

I worry that this kind of thing can trip up reviewers (who aren't highly aware of the ChatGPT situation and haven't built up a sense for telltale ChatGPT signs) for some of the the very reasons that ChatGPT is banned (at the time of this writing): It writes in an authoritative style with proper spelling and grammar such that the many people/reviewers without enough subject-matter-knowledge/expertise to easily know whether it's wrong right off the bat will think it's probably right, and even people with subject-matter-expertise could take a while to verify the correctness.

If I wasn't so aware of the ChatGPT situation, having followed the meta posts and official announcements, and having gained some experience spotting such answers and learning the telltale signs from searching for ChatGPT posts when the flood started, I don't think I would have been able to know that I should have custom-flagged for ChatGPT or commented for suspicion of ChatGPT, linking to the ChatGPT policy page.

I don't think many people have even seen this MSO post on what to do if one suspects an answer is ChatGPT-generated. At the time of this writing, it has under 1k views.

Possible routes forward I thought of:

Thoughts?

1
  • 3
    I mean fully agreed, but it is not like the existing eligible posts are so great for audits. They're automatically picked so it'll automatically go wrong. This just feeds into the existing trouble, bad bookkeeping leads to bad audits.
    – Gimby
    Commented Dec 29, 2022 at 10:50

2 Answers 2

63

I agree that ChatGPT answers should not be used as audits. A large part of the issue with ChatGPT content is how much the generated content appears (on the surface) to be a genuine answer. That said, there really isn't much we can do to stop this from happening now that it has been chosen as an audit.

The system sees this specific answer as a valid audit candidate because it is (1) deleted and (2) has a Very Low Quality (VLQ) flag which was marked helpful. That's it; that's all that is necessary to make the post eligible to become a review audit for LA or LQA.

The good news is that the vast majority of these ChatGPT answers are deleted with either only a mod flag or removed as part of a moderator investigation. Any posts that do not have a helpful standard flag on the post (VLQ/NAA) will not be eligible audit candidates. For this reason, these types of audits should not be too widespread. There's perhaps a handful of posts among thousands that are eligible to become audits.

The bad news is that we (as moderators) don't really have any good options to stop this post from being used as an audit now that it has been chosen. Undeleting the post would stop that post from being used as an audit, but that would go against our current policy. We can't change the fact that there's a helpful flag on the post now that it has been marked helpful. We could lock the post (or flag it as R/A), but that seems excessive just to remove it from the audit pool.

So, for the moment, we'll have to continue to handle these audits on a case-by-case basis.


There are a few things we can do before the post is deleted. As moderators, we can decline the VLQ/NAA flags before handling the mod flag to prevent these from becoming audits, but it can be difficult to make sure that such flags are always declined before removing the answer (for any number of reasons).

When reviewing answers in LA or LQA, reviewers can flag for moderator attention instead of voting to delete posts that are generated by ChatGPT. If the post is deleted from review the NAA/VLQ flags will be marked helpful, which will in turn make it an audit candidate. Please flag it for moderator attention so that we can handle the post (and the user).

1
  • concerning the last paragraph, I've been seeing a noticeable amount of chatgpt in the LQA queue, and the unfortunate thing is that handling of chatgpt flags right now is bottlenecked by heuristic approval. even ones I've flagged a while ago. I just skip / flag if I haven't flagged already...
    – starball
    Commented Dec 18, 2023 at 23:26
-3

"many people/reviewers without enough subject-matter-knowledge/expertise to easily know whether it's wrong right off the bat will [fail the audit]" is a good thing.

Reviewers facing a topic outside their area of expertise should use the Skip button liberally, and never click Looks Ok.

Reviewers facing a topic within their area of expertise who don't have the time to actually assess whether the answer is correct should also use Skip, not Looks Ok.

It's not like the audit requires you to determine that the answer is ChatGPT-generated and click "Recommend Deletion". That's a good outcome if you do it, but skipping, editing, and commenting all will also pass the audit. The only thing that will fail is clicking Looks Ok, which indeed meant you weren't paying attention (to the answer and to your own limits).

6
  • 12
    Nowhere in stackoverflow.com/help/review-late-answers do I see indication that reviewers of first answers are expected to be able to judge factual correctness of answers. I do see clear indication that reviewers are expected to either judge whether a late answer post is an attempt to answer the question, or skip if unsure due to lack of familiarity with the topic: "However, in other cases it may require specific knowledge of the topic. If you’re unsure whether the answer actually attempts to answer the question, use the “Skip” option."
    – starball
    Commented Apr 6, 2023 at 19:08
  • 6
    Nowhere in stackoverflow.com/help/review-first-answers do I see indication that reviewers of first answers are expected to be able to judge factual correctness of answers. I do see clear indication that reviewers are expected to judge whether the form of the post is a good fit for the Stack Exchange model: grammar, spelling, formatting, being an attempt to answer the question, not a duplicate answer, not link-only, not spam, not rude or abusive.
    – starball
    Commented Apr 6, 2023 at 19:11
  • 10
    We don't expect mods to be able to take action on flags about the factual correctness of posts. I don't see why reviewers should be expected of that either.
    – starball
    Commented Apr 6, 2023 at 19:15
  • 1
  • 2
    There is no shame in using "Skip"
    – Ben Voigt
    Commented Apr 6, 2023 at 19:43
  • 2
    note to other skimmers: those are respectively for the triage and primarily the suggested edit queues. the specific problem in the traige post is something that can be solved by using the tag filters, and I see suggested edits as a different problem than reviewing supposedly original content.
    – starball
    Commented Apr 6, 2023 at 20:07

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .