Timeline for The "Stack Overflow Comment Evaluator 5000" is (perhaps) failing to hide some usernames
Current License: CC BY-SA 4.0
30 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Sep 28, 2018 at 6:08 | comment | added | xdtTransform | And special char like ç break the annonmisation. | |
Sep 27, 2018 at 20:52 | comment | added | Andras Deak -- Слава Україні | @TylerH I've been saying that it looks exactly as if the company thought that new users are stupid. It's only fair for them to assume that everyone else involved in the welcoming initiative is stupid too, so better keep it simple. Smiley face, unwelcome face, angry censorship face. The more knee-jerk the reaction the better. | |
Sep 27, 2018 at 13:25 | comment | added | TylerH | @user202729 One must assume the people creating this project and asking this time of volunteers will actually follow through with it and read them. | |
Sep 27, 2018 at 4:41 | comment | added | user202729 | @tylerh (yes I agree but) Who will spend the time to read it? | |
Sep 26, 2018 at 18:14 | comment | added | BoltClock Mod | @Mark Amery: You're right, I don't know what I was going on about with my second sentence. I think my reply to Script47 does a better job explaining what I meant to say (that the tool isn't meant for evaluating whether a comment is chatty or otherwise unnecessary for reasons other than its perceived level of friendliness). | |
Sep 26, 2018 at 18:10 | comment | added | Mark Amery | @Kendra Eh, I've done a few dozen now and all of them have either been "Fine" or me deciding not to classify and refreshing because of the lack of context problem described above. I think non-fine comments are genuinely unusual in whatever sample these are being drawn from. | |
Sep 26, 2018 at 18:07 | comment | added | Kendra | @MarkAmery While working on these, we're supposed to be treating them as if we were a brand new user, arguing we might not know that community standard. =/ It's supposed to be entirely based on tone. (Of course, I've only had a handful that were "Disrespectful" and one "Abusive" so far, so... I'm probably still more positive than some new users.) | |
Sep 26, 2018 at 18:04 | comment | added | Mark Amery | @BoltClock Another example: "Thanks, do you also know how I could make those rounded corners?". Was making those rounded corners part of the original question? If so, pointing out that an answer missed it is fine. If not, latching on to somebody who answered the original question as posed and trying to make them answer further unrelated questions for you in the comments is classic Help Vampire behaviour, which we've communally agreed is disrespectful. Without context, I can't classify. | |
Sep 26, 2018 at 17:58 | comment | added | Mark Amery | @BoltClock I disagree that "A comment's contextual relevance has no bearing on its... tone". It only took me a couple of clicks to hit a case where lack of context stopped me from knowing if I thought a comment was "disrespectful" - a comment instructing the asker to "Try to post your code which you have tried". If it was a debugging question where that information was needed, the comment is fine. If the information was plainly not needed, it's disrespectful - then the commenter is being petty and officious and trying to shoot down a valid question. I don't know which is true. | |
Sep 26, 2018 at 17:36 | comment | added | Luca Kiebel | I also found some comments that had a working edit link in them | |
Sep 26, 2018 at 17:23 | comment | added | BoltClock Mod | @Script47: Notice how nowhere in your question you mention the tone of either of those comments. Again, whether a comment is contextually relevant doesn't matter. The tool is intended for evaluating a comment's perceived tone, not whether it's still needed (and you wouldn't be able to know anyway given that every comment is shown to you devoid of any context whatsoever). If that remaining comment is helpful or friendly, it's "Fine." If it's snarky, it's "Disrespectful or Unfriendly." And if it calls the other person names or their background into question, then it's "Abusive or Harassment." | |
Sep 26, 2018 at 17:18 | comment | added | Script47 | @BoltClock what about in the instance that user A asks OP a question to clarify then notices that this is already addressed in the post and then deletes it and in the mean time OP or someone else answers the question in the comment without noticing that it has been deleted. On the outset the answer may contain relevant information but in actual fact, it is no longer needed. | |
Sep 26, 2018 at 17:13 | comment | added | BoltClock Mod | @user202729: There isn't one. A comment's contextual relevance has no bearing on its (either intended or perceived) tone. | |
Sep 26, 2018 at 17:00 | history | edited | Restore The Data Dumps AgainMod |
edited tags
|
|
Sep 26, 2018 at 16:37 | comment | added | TylerH | @ErikvonAsmuth And there's the underlying problem. Before we can train computers to do anything useful we need humans to understand what is being put into the computers. | |
Sep 26, 2018 at 16:36 | comment | added | Erik A | @TylerH Afaik it's not meant to truly evaluate comments. It's meant as a dataset to train models and run interesting queries against | |
Sep 26, 2018 at 16:35 | comment | added | Script47 | I'm wondering why they never used the actual flag reasons. It'd make more sense. This just seems like nonsense and not inline with the sort of thing SE / SO does. How do those emojis actually convey the correct opinions? It'd be a more accurate data set too. | |
Sep 26, 2018 at 16:35 | comment | added | TylerH | @Kendra At the very least, all the same options as we currently have for flags should be available (e.g. "no longer needed" should be added ), the comments should be displayed in context of the post, with users attached (dummy users 1 and 2, etc., if they care about skewing results based on familiarity), and a summary text box a la the 'something else' flag should be required for each page so that the participants can provide context and reasoning for why they reviewed the comments the way they did. Also replacing meaningful information with emojis is atrocious and shame on SO for doing that. | |
Sep 26, 2018 at 16:18 | comment | added | Kendra | @TylerH Trust me, there have been plenty of comments where I'm like, "Well, it's not rude or disrespectful or anything, but God is this comment useless." The options we're given are definitely not always the best way to categorize. A text box to give thoughts definitely would've been better, at least in addition to the buttons. | |
Sep 26, 2018 at 15:50 | comment | added | Script47 | Cue the meta posts regarding the new evaluator | |
Sep 26, 2018 at 15:38 | answer | added | Restore The Data Dumps AgainMod | timeline score: 21 | |
Sep 26, 2018 at 15:22 | comment | added | TylerH | @FélixGagnon-Grenier They had to have opted in to survey/contact requests from SO the company and get lucky, or be a moderator. | |
Sep 26, 2018 at 15:21 | comment | added | TylerH | This is a terrible way to evaluate comments, holy crap. Evaluators should be required to write a text response describing their evaluation of each comment. | |
Sep 26, 2018 at 14:49 | comment | added | user202729 | (unrelated but) What's the button for "No longer needed"? | |
Sep 26, 2018 at 14:39 | comment | added | user50049 | @FélixGagnon-Grenier with a sorting hat. | |
Sep 26, 2018 at 14:38 | comment | added | Cœur | Any link to this mysterious Comment Evaluator 5000? [edit: false-mammal.glitch.me ] | |
Sep 26, 2018 at 14:37 | comment | added | Félix Adriyel Gagnon-Grenier | How are the people that try the Comment Evaluator 500™ chosen? | |
Sep 26, 2018 at 14:27 | history | edited | ryanyuyu |
edited tags
|
|
Sep 26, 2018 at 14:09 | comment | added | Kendra |
I've seen this multiple times, along with usernames that just don't have the @ , or where there's a space between the name and the @
|
|
Sep 26, 2018 at 14:01 | history | asked | John C | CC BY-SA 4.0 |