21

I recently cast the last delete-vote required to delete a user's GPT-generated answer. The answer had a bounty of 500 reputation.

The user's reputation counters still show their rep as if they were awarded this bounty. I would expect the answer deletion to update the user's reputation in (close to) real-time, just like normal votes would.

I just came across that 4-day-old user (22237204) and noticed he had over 650 reputation.

Nothing shocking, at first sight, but seeing as how the user only has 5 (non-deleted) answers, none of which have a positive score, I was wondering where all that rep came from.

He's not been active suggesting edits. His reputation page shows a couple of upvotes and the association bonus:

enter image description here

Apparently, the deleted bounty, though gone from the reputation history, has not yet recalculated the user's reputation.

19
  • 1
    Most likely deleted answer, takes time for rep synch to run. (i.e. cache.) Commented Jul 19, 2023 at 7:33
  • 2
    Maybe a bounty not showing up?
    – machine_1
    Commented Jul 19, 2023 at 7:34
  • 1
    Ooh, I delete-voted one of the user's answers. That might've had a bounty.
    – Cerbrus
    Commented Jul 19, 2023 at 7:35
  • 13
    "I just came across a 4-day-old user (22237204) that has over 650 reputation" - could it just be that they're brilliant? Oh, no, ChatGPT, of course. And vehemently denying that they use that, of course. Hey Prashanth, is this the way you want the site to go?
    – CodeCaster
    Commented Jul 19, 2023 at 7:49
  • 7
    ^ Which was why I delete-voted that answer, it was an extremely obvious GPT post. I don't recall them actually denying it, just avoiding the subject by shifting blame to the users asking him whether or not he's used GPT.
    – Cerbrus
    Commented Jul 19, 2023 at 7:59
  • 7
    The fact the user has already made 27 upvotes suggests to me that they are could possibly be part of a voting ring as well.
    – Thom A
    Commented Jul 19, 2023 at 7:59
  • I could have sworn we had a duplicate for the core issue, but I can't find it now. (I mean, the site's issue with reputation accounting, not the ChatGPT usage.) Commented Jul 19, 2023 at 8:33
  • 2
    Another example can be found here, the OP in that question offered the bounty and it looks like it was not refunded. So I assume the user that received the bounty would also have 50 rep missing in their graph, because it doesn't include deleted posts. -> looks like its by design, still feels weird though
    – Lino
    Commented Jul 19, 2023 at 8:39
  • Additionally also found this How are bounties awarded to ChatGPT-sourced answerers handled?, the answer from DavidW also mentions that the bounty should be refunded on deletion.
    – Lino
    Commented Jul 19, 2023 at 8:50
  • 1
    @Lino this deletion wasn't from a mod action, though.
    – Cerbrus
    Commented Jul 19, 2023 at 8:51
  • 4
    @Lino afaik, bounties being refunded is an exceptional case that can only be done by moderators, yes.
    – Cerbrus
    Commented Jul 19, 2023 at 8:55
  • 4
    If there's ever any doubt about that user using ChatGPT That's literally how ChatGPT responds to being corrected.
    – Cerbrus
    Commented Jul 19, 2023 at 10:02
  • 2
    @Cerbrus: Yes, it reads like an ELIZA transcript. Commented Jul 19, 2023 at 12:50
  • 11
    Gotta love the periodic flips between "Hugo Award nominee" and "Can't write a 10 word sentence without a muck-up".
    – Dan Mašek
    Commented Jul 19, 2023 at 14:08
  • 1
    @Cerbrus What I like most about the chat is this reply: "Unfortunately, as an AI language model, I don't have information about specific website accessibility restrictions in different regions." here
    – piet.t
    Commented Jul 20, 2023 at 5:59

1 Answer 1

23

The usual explanation is bounties. I don't know if they show up in that view. I think they really ought to, if they don't.

However, I can't let this pass without addressing the elephant in the room.

The user in question vehemently denies (in comments) using ChatGPT to write answers, and has been getting rather heated about it, claiming to have reported comments, questioning whether people have "considered the implications if your statement turns out to be incorrect" and so forth.

Here is a sample of "the user's writing", from the most recent undeleted answer:

The DownloadAndRenameImages procedure is responsible for iterating through the rows and downloading the images. For each image, it also calls the RenameShape procedure to rename the picture using the value from cell "A". The RenameShape procedure creates a temporary shape using the AddPicture method, assigns the new name, and then deletes the shape.

Here is a sample of the user's writing, from the profile page:

I'm learning programming machine and eager know machine learning. I have started programming in student LOGO programming language in 1993. Now I'm in python.

Another answer shows a bizarre inconsistency in displayed level of English proficiency - consistent with copying and pasting ChatGPT content into an attempt at a hand-written answer:

Now, when call the toWeirdCase function with a string, it will alternate the case of characters while ignoring spaces.

console.log(toWeirdCase("asdfghjkl")); // Output: "AsDfGhJkL"
console.log(toWeirdCase("hello world")); // Output: "HeLlO WoRlD"

Note: The updated function assumes that you want to ignore spaces while alternating the case of alphabetic characters. If you also want to ignore other non-alphabetic characters, you can modify the condition in the if statement accordingly.

Hope this help you.

The shift from making basic errors in verb conjugation, to perfectly writing complex sentence structures straight out of a high school essay, and back again, is rather striking.

(Aside from that: the corresponding code offered is nonsensical, and spaces aren't actually ignored. This prose does accurately describe the behaviour of the code; but the desired output for toWeirdCase("hello world") is presumably "HeLlO wOrLd" instead. The code uselessly "skips" spaces by conditionally "not uppercasing" them; but of course this has no effect on the result, as JavaScript allows uppercasing a space just fine, and the result is just an ordinary space.)

For that matter, those comments themselves read like ChatGPT output in many cases:

Undermining efforts and devaluing answers to questions can occur when making incorrect statements. Disregarding the rules and regulations of commenting on When shouldn't I comment in Stackoverflow? diminishes the hard work of contributors. While considering the possibility of your viewpoint being correct, it's important to use the specialized chat for debates and speculations rather than publicly expressing such statements. Please raise your concerns in the appropriate chat for a response and resolution.

This is exactly the sort of thing I would expect ChatGPT to output when suitably instructed. It presents a lot of prose that superficially refers to policy, but it doesn't have a clue what the policy actually is (there is no "specialized chat" relevant to the topic), makes up page titles, and takes on a bizarrely academic tone that makes no sense in context.

For how much longer would the company like to pretend that it is not possible in principle to detect answers written by ChatGPT; or that moderators, while not on strike, had any significant error rate in doing so?

Especially when there seems to be evidence that such answers are written in an attempt to collect bounties?

24
  • 2
    "The user in question vehemently denies" Did he? I can only find him avoiding answering that. (And threatening with "implications " of those accusations)
    – Cerbrus
    Commented Jul 19, 2023 at 8:19
  • 1
    There was mention in the Meta chat room of such denial; I didn't investigate it too closely, but that seemed to be the underlying purpose of the comments you're talking about. "Avoiding answering that" while also aggressively threatening people, claiming to have reported comments, presenting as if offended by the mere suggestion etc.... comes across to me as a denial. Commented Jul 19, 2023 at 8:23
  • 4
    Another example read (with a ping): "Your message violates Stack Overflow rules. It is an unethical and disrespectful comment. Before disrespecting and devaluing someone's efforts, consider the harm it causes. If you can, provide helpful answers like I do, assisting programmers and those interested in this field. If you can't contribute, why show disrespect? I'll report your comment as per the site's rules, respecting all programming enthusiasts." The underlying premise is some supposition that comments are not allowed to raise suspicion of ChatGPT usage. Commented Jul 19, 2023 at 8:24
  • 3
    To me, that doesn't look like denial, it looks like a counter-attack to try to scare off users with made-up rules.
    – Cerbrus
    Commented Jul 19, 2023 at 8:25
  • 2
    "is actually the correct output for that function" - OP showed simpler code (i.e., without a pointless check) that gives the same result, and then complained "I tried this but it does not account for the spaces between the character. How can I set it to ignore spaces?". Since the given code gives the result "HeLlO WoRlD" but does not satisfy OP, I can only assume the desired output is "HeLlO wOrLd". Commented Jul 19, 2023 at 8:29
  • 1
    Ah, I see, so on top of it being GPT-generated, the answer is wrong :D
    – Cerbrus
    Commented Jul 19, 2023 at 8:29
  • 1
    That's what I meant with the "spaces aren't ignored" part, yeah. Commented Jul 19, 2023 at 8:30
  • 7
    The user can't show denial, because GPT (that generated probably all of that users comments) thinks that it's right. -> Also the overuse of links to help pages is hilarious.
    – Lino
    Commented Jul 19, 2023 at 8:34
  • 1
    Even their comments seem AI generated to me, they say: "It provided clear steps and sample code for implementing an AJAX request" to an answer that tells them not to use AJAX and to use a websocket instead and doesn't provide any sample code for implementing that either... Commented Jul 19, 2023 at 8:53
  • 2
    No, that's just him trying to shift blame onto the users asking him if he used an AI, @ThomA. He's claiming the accusations are baseless and "inhumane", he's asking people to "prove" he's using AI. He's playing the victim, ignorance and "you got nothing" cards. If he didn't use AI, why wouldn't he just say so?
    – Cerbrus
    Commented Jul 19, 2023 at 9:08
  • 2
    @ThomA Imo, those are the actions of someone that knows they're guilty. Trying to shift the subject. Trying to make others feel quilty for daring to question his integrity, even going as far as to threaten with repercussions.
    – Cerbrus
    Commented Jul 19, 2023 at 9:12
  • 5
    Found it. Commented Jul 19, 2023 at 9:18
  • 11
    Meanwhile, that user reposted his deleted answer...
    – Cerbrus
    Commented Jul 19, 2023 at 9:24
  • 5
    Note that it's often very hard to tell the truly clueless from the troll. I'm tempted to apply Hanlon's Razor here even though the alternative to malicious trolling is probably more insulting. Commented Jul 19, 2023 at 18:30
  • 1
    The denial thing is just modern human nature to be honest. Even in the face of irrefutable evidence people will still play dumb because they have nothing to lose in doing so, and having a sense of personal honour is kind of a thing of the past. Present company excluded, of course.
    – Gimby
    Commented Jul 21, 2023 at 9:39

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .