Timeline for Did Stack Exchange cut the number of negative comments nearly in half between the beginning of the fourth quarter of 2019 and January 21, 2020?
Current License: CC BY-SA 4.0
13 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Feb 7, 2020 at 18:36 | comment | added | Restore The Data Dumps Again Mod | Hey so I added some more graphs to Kevin's answer. The false negative question is a good one. I can't answer it without an oracle, but we can see how many false negatives there are for humans, given that the robot is running. | |
Feb 7, 2020 at 17:57 | comment | added | NoDataDumpNoContribution | @AlexeiLevenkov If this would be true it would be an indication that there is no control of the false negative rate and the true rate of cutting down negative comments as reported by the CEO could be anything. In the answer to the skeptics question it ends with "it's my professional opinion that the number really is cut in half" or something similar. Who would give a professional judgment without having at least an idea of the number of items you might miss out in the calculation. | |
Feb 7, 2020 at 17:35 | comment | added | Alexei Levenkov | @Trilarion I bet that threshold is roughly "moderators can comfortably handle X comment flags a day - set threshold to automatically flag ~X*0.5 comments a day". Probably with some adjusting depending on current needs - down if more training for robot would be needed (to get more comments reviewed by mods) or up to free up mods time if large number of auto-flagged comments not get deleted. 0.9 is likely just that round enough number that currently satisfy all needs. | |
Feb 7, 2020 at 9:39 | comment | added | NoDataDumpNoContribution | @AnsgarWiechers Yes, there are critical aspects of their automatic detection but they are more to do with the threshold less with the absolute values of the score. Why is the threshold 0.907, why not 0.99 or 0.8? | |
Feb 7, 2020 at 8:58 | comment | added | Ansgar Wiechers | If you say so. I for one am way past assuming good intentions. | |
Feb 6, 2020 at 22:38 | comment | added | NoDataDumpNoContribution | @AnsgarWiechers The score doesn't have to be scaled so that 0.5 is meaningful. It's just a number below or above the threshold and that is all that is important. I wonder how well more veiled attacks are detected, it seems to be more like a "watch your language son" thing you might hear in your parents home. I wish though they would employ it on other popular Internet places. I can hardly believe Google or Facebook or Twitter cannot do the same. | |
Feb 6, 2020 at 22:29 | comment | added | Restore The Data Dumps Again Mod | @Trilarion lol 😂 | |
Feb 6, 2020 at 22:08 | comment | added | Restore The Data Dumps Again Mod | @AnsgarWiechers The goal of the project isn't to have a specific score of a specific comment be palatable to a specific user. The goal is to bring comments that need attention to the attention of our moderators. We (correctly) would not raise this comment. | |
Feb 6, 2020 at 21:46 | comment | added | Ansgar Wiechers | @JasonPunyon "Did you try anything?" is arguably as neutral a comment as it gets, so it should have a rating around .5 (50%). That it sits at almost 75% basically shows how skewed and biased the detection is. | |
Feb 6, 2020 at 18:47 | comment | added | NoDataDumpNoContribution | @JasonPunyon Thanks for the values. So we could just replace version 2 and 3 with version 1 everywhere and call it mission accomplished, maybe. ;) | |
Feb 6, 2020 at 17:54 | comment | added | Restore The Data Dumps Again Mod | "Did you try anything?" gets a .73 from UnfriendlyRobotV2. "Did you even try anything?" gets a .941. "Did you even bother to try anything?" gets a .978. The maximum is 1 and the threshold for an automated flag is .907. | |
Feb 6, 2020 at 16:42 | history | edited | NoDataDumpNoContribution | CC BY-SA 4.0 |
added 4 characters in body
|
Feb 6, 2020 at 16:28 | history | answered | NoDataDumpNoContribution | CC BY-SA 4.0 |