39

I was just evaluating some comments and it would seem that usernames are not always being redacted with "@________".

See this - enter image description here

So far I've seen two instances; both times the username was not at the start of the post. Also the username may be typo'd as a search for the username from the image doesn't bring anything up (unless I'm not doing the search correctly).

26
  • 9
    I've seen this multiple times, along with usernames that just don't have the @, or where there's a space between the name and the @
    – Kendra
    Commented Sep 26, 2018 at 14:09
  • 3
    How are the people that try the Comment Evaluator 500™ chosen? Commented Sep 26, 2018 at 14:37
  • 5
    @FélixGagnon-Grenier with a sorting hat.
    – user50049
    Commented Sep 26, 2018 at 14:39
  • 20
    (unrelated but) What's the button for "No longer needed"?
    – user202729
    Commented Sep 26, 2018 at 14:49
  • 18
    This is a terrible way to evaluate comments, holy crap. Evaluators should be required to write a text response describing their evaluation of each comment.
    – TylerH
    Commented Sep 26, 2018 at 15:21
  • 2
    @FélixGagnon-Grenier They had to have opted in to survey/contact requests from SO the company and get lucky, or be a moderator.
    – TylerH
    Commented Sep 26, 2018 at 15:22
  • 13
    @TylerH Trust me, there have been plenty of comments where I'm like, "Well, it's not rude or disrespectful or anything, but God is this comment useless." The options we're given are definitely not always the best way to categorize. A text box to give thoughts definitely would've been better, at least in addition to the buttons.
    – Kendra
    Commented Sep 26, 2018 at 16:18
  • 8
    @Kendra At the very least, all the same options as we currently have for flags should be available (e.g. "no longer needed" should be added ), the comments should be displayed in context of the post, with users attached (dummy users 1 and 2, etc., if they care about skewing results based on familiarity), and a summary text box a la the 'something else' flag should be required for each page so that the participants can provide context and reasoning for why they reviewed the comments the way they did. Also replacing meaningful information with emojis is atrocious and shame on SO for doing that.
    – TylerH
    Commented Sep 26, 2018 at 16:35
  • 12
    I'm wondering why they never used the actual flag reasons. It'd make more sense. This just seems like nonsense and not inline with the sort of thing SE / SO does. How do those emojis actually convey the correct opinions? It'd be a more accurate data set too.
    – Script47
    Commented Sep 26, 2018 at 16:35
  • 2
    @TylerH Afaik it's not meant to truly evaluate comments. It's meant as a dataset to train models and run interesting queries against
    – Erik A
    Commented Sep 26, 2018 at 16:36
  • 9
    @ErikvonAsmuth And there's the underlying problem. Before we can train computers to do anything useful we need humans to understand what is being put into the computers.
    – TylerH
    Commented Sep 26, 2018 at 16:37
  • 4
    @user202729: There isn't one. A comment's contextual relevance has no bearing on its (either intended or perceived) tone.
    – BoltClock Mod
    Commented Sep 26, 2018 at 17:13
  • 5
    @Script47: Notice how nowhere in your question you mention the tone of either of those comments. Again, whether a comment is contextually relevant doesn't matter. The tool is intended for evaluating a comment's perceived tone, not whether it's still needed (and you wouldn't be able to know anyway given that every comment is shown to you devoid of any context whatsoever). If that remaining comment is helpful or friendly, it's "Fine." If it's snarky, it's "Disrespectful or Unfriendly." And if it calls the other person names or their background into question, then it's "Abusive or Harassment."
    – BoltClock Mod
    Commented Sep 26, 2018 at 17:23
  • 8
    @BoltClock I disagree that "A comment's contextual relevance has no bearing on its... tone". It only took me a couple of clicks to hit a case where lack of context stopped me from knowing if I thought a comment was "disrespectful" - a comment instructing the asker to "Try to post your code which you have tried". If it was a debugging question where that information was needed, the comment is fine. If the information was plainly not needed, it's disrespectful - then the commenter is being petty and officious and trying to shoot down a valid question. I don't know which is true.
    – Mark Amery
    Commented Sep 26, 2018 at 17:58
  • 6
    @Mark Amery: You're right, I don't know what I was going on about with my second sentence. I think my reply to Script47 does a better job explaining what I meant to say (that the tool isn't meant for evaluating whether a comment is chatty or otherwise unnecessary for reasons other than its perceived level of friendliness).
    – BoltClock Mod
    Commented Sep 26, 2018 at 18:14

1 Answer 1

21

Yeah you pretty much nailed it. We couldn't reliably redact @names when they occurred in positions other than the start of the string. There were a lot of non @name usages of @ when it appeared later in the comment. We erred on the side of not wrecking the understandability of those comments by applying an ill-suited regex, so these @names still remain.

3
  • 42
    Status-workswellenoughsowontfix?
    – Erik A
    Commented Sep 26, 2018 at 16:30
  • 1
    I guess not posting any of the comments we get to see is part of the terms of using the comment evaluator that came with the email?
    – Magisch
    Commented Sep 26, 2018 at 17:16
  • 1
    @Magisch Correct: "We will emphasize the sensitive nature of this data and ask requesters to respect Stack Overflow users’ privacy by not publishing individual comment texts."
    – ash
    Commented Sep 27, 2018 at 16:28

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .