Skip to main content
added 52 characters in body
Source Link
TylerH
  • 21.2k
  • 22
  • 229
  • 328

This isn't a bad idea, but there's one downside; Stack Exchange automatically deletes some comments, and does face the Scunthorpe problemScunthorpe problem. There might be edge cases where a user actually added some profanity which made sense in the context of the post.

This isn't a bad idea, but there's one downside; Stack Exchange automatically deletes some comments, and does face the Scunthorpe problem. There might be edge cases where a user actually added some profanity which made sense in the context of the post.

This isn't a bad idea, but there's one downside; Stack Exchange automatically deletes some comments, and does face the Scunthorpe problem. There might be edge cases where a user actually added some profanity which made sense in the context of the post.

added 254 characters in body
Source Link
Bugs
  • 4.5k
  • 1
  • 17
  • 29

Actually, Thisthis was an issue earlierin the past. A few years back, we (the Sobotics teamSOBotics team), requested a dump of rude comments from Stack Exchange, and Stack Exchange which Stack Exchange provided usprovided us with some. WeUsing this data, we then built the HeatDetector, an app to detect rude comments on Stack OverflowHeatDetector, a bot to detect rude comments on Stack Overflow (using NLPNatural Language Processing). Thanks to the bot reporting stuff, most of the rude and snarky comments posted on Stack Overflow used to be detected by HeatDetector and then manually flagged by users in chat and, causing the rude comment to be subsequently deleted. We used to raise a custom moderator flag to inform the moderators about users, if they added too many who left a substantial amount of rude comments in a very short period of time. Now, thanks to Brad's meta postBrad's feature request to have the Stack Exchange system raise an automatic flag when a user leaves a lot of rude comments, there is an automatic flag raised by the Stack Exchange system in these cases, and wethe SOBotics team no longer needhas to flagraise those custom flags.

Now speaking from the mod perspective, the auto flag became very noisy and went to the levels of 300. Most of them were filled with too chatty comments, which were flagged as Nonnon-constructive. This caused the CMs to look into the auto flag and make the comment flags less stupid. After the merger of the 3 comment flag types, the auto flag is now raised whenever there are 3 or more rude comments in the recent past.

Now With this change the signal/noise ratio in that auto flag is high, but on the downside, the number of false negatives are also high.

This isn't a bad idea, but there's one downside.downside; Stack Exchange automatically deletes some comments, and does face the Scunthorpe problem. There might be edge cases where a user actually added some profanity which made sense in the context of the post.

This growing perception is mostly because the users receive negative comments. Most of these snarky comments are flagged as no longer needed. This is because the users to which they are targeted are usually new and do not know how to flag. The other users, who check these out do not consider it rude, and flag it as no longer needed, instead. (I don't know why they do this, but I can clearly say that I see many snarky comments flagged as nlnNLN and not raR/A). This doesn't raise an auto flag, and wouldn't send the automated message.

Now, we can't just include nlnNLN into the rude comments bracket, as it would cause the problem discussed earlier. So, to conclude, the new system won't be very effective. If we decide to go with this new system, it would need a lot of development effort. Instead of that, we can just spend some more of the moderator time and make them handle it. And as always, a pair of human eyes is better than an automated system.

andAnd for your questions:

From a community user perspective, you are more than welcome to join us in Sobotics and get a live feed of the snarky comments. Rob is building a nice web-based GUI frontend, to create a new dashboard, where you can see the (possibly anonymized) data. ThisThis would be more useful to you.

Actually, This was an issue earlier. A few years back, we (the Sobotics team), requested a dump of rude comments from Stack Exchange, which Stack Exchange provided us. We then built the HeatDetector, an app to detect rude comments on Stack Overflow (using NLP). Thanks to the bot reporting stuff, most of rude and snarky comments used to be flagged by users in chat and subsequently deleted. We used to flag the users, if they added too many rude comments in a very short period of time. Now, thanks to Brad's meta post, there is an automatic flag raised in these cases, and we no longer need to flag those.

Now speaking from the mod perspective, the flag became very noisy and went to the levels of 300. Most of them were filled with too chatty comments, which were flagged as Non-constructive. This caused the CMs to look into the flag and make the comment flags less stupid. After the merger of the 3 comment flag types, the auto flag is now raised whenever there are 3 or more rude comments in the recent past.

Now the signal/noise ratio is high, but on the downside, the number of false negatives are also high.

This isn't a bad idea, but there's one downside. Stack Exchange automatically deletes some comments, and does face the Scunthorpe problem. There might be edge cases where a user actually added some profanity which made sense in the context of the post.

This growing perception is mostly because the users receive negative comments. Most of these snarky comments are flagged as no longer needed. This is because the users to which they are targeted are usually new and do not know how to flag. The other users, who check these out do not consider it rude, and flag it as no longer needed, instead. (I don't know why they do this, but I can clearly say that I see many snarky comments flagged as nln and not ra). This doesn't raise an auto flag, and wouldn't send the automated message.

Now, we can't just include nln into the rude comments bracket, as it would cause the problem discussed earlier. So, to conclude, the new system won't be very effective. If we decide to go with this new system, it would need a lot of development effort. Instead of that, we can just spend some more of the moderator time and make them handle it. And as always, a pair of human eyes is better than an automated system.

and for your questions:

From a community user perspective, you are more than welcome to join us in Sobotics and get a live feed of the snarky comments. Rob is building a nice web-based GUI frontend, to create a new dashboard, where you can see the (possibly anonymized) data. This would be more useful to you.

Actually, this was an issue in the past. A few years back, we (the SOBotics team) requested a dump of rude comments from Stack Exchange, and Stack Exchange provided us with some. Using this data, we then built HeatDetector, a bot to detect rude comments on Stack Overflow (using Natural Language Processing). Thanks to the bot reporting stuff, most of the rude and snarky comments posted on Stack Overflow used to be detected by HeatDetector and then manually flagged by users in chat, causing the rude comment to be subsequently deleted. We used to raise a custom moderator flag to inform the moderators about users who left a substantial amount of rude comments in a very short period of time. Now, thanks to Brad's feature request to have the Stack Exchange system raise an automatic flag when a user leaves a lot of rude comments, there is an automatic flag raised by the Stack Exchange system in these cases, and the SOBotics team no longer has to raise those custom flags.

Now speaking from the mod perspective, the auto flag became very noisy and went to the levels of 300. Most of them were filled with too chatty comments, which were flagged as non-constructive. This caused the CMs to look into the auto flag and make the comment flags less stupid. After the merger of the 3 comment flag types, the auto flag is now raised whenever there are 3 or more rude comments in the recent past. With this change the signal/noise ratio in that auto flag is high but on the downside, the number of false negatives are also high.

This isn't a bad idea, but there's one downside; Stack Exchange automatically deletes some comments, and does face the Scunthorpe problem. There might be edge cases where a user actually added some profanity which made sense in the context of the post.

This growing perception is mostly because the users receive negative comments. Most of these snarky comments are flagged as no longer needed. This is because the users to which they are targeted are usually new and do not know how to flag. The other users, who check these out do not consider it rude, and flag it as no longer needed, instead. (I don't know why they do this, but I can clearly say that I see many snarky comments flagged as NLN and not R/A). This doesn't raise an auto flag, and wouldn't send the automated message.

Now, we can't just include NLN into the rude comments bracket, as it would cause the problem discussed earlier. So, to conclude, the new system won't be very effective. If we decide to go with this new system, it would need a lot of development effort. Instead of that, we can just spend some more of the moderator time and make them handle it. And as always, a pair of human eyes is better than an automated system.

And for your questions:

From a community user perspective, you are more than welcome to join us in Sobotics and get a live feed of the snarky comments. Rob is building a nice web-based GUI frontend, to create a new dashboard, where you can see the (possibly anonymized) data. This would be more useful to you.

Added references to important meta posts that are implicitly referred to here.
Source Link
user6655984
user6655984

Now speaking from the mod perspective, the flag became very noisy and went to the levels of 300. Most of them were filled with too chatty comments, which were flagged as Non-constructive. This caused the CMs to look into the flag and make the comment flags less stupidmake the comment flags less stupid. After the merger of the 3 comment flag typesthe merger of the 3 comment flag types, the auto flag is now raised whenever there are 3 or more rude comments in the recent past.

Now speaking from the mod perspective, the flag became very noisy and went to the levels of 300. Most of them were filled with too chatty comments, which were flagged as Non-constructive. This caused the CMs to look into the flag and make the comment flags less stupid. After the merger of the 3 comment flag types, the auto flag is now raised whenever there are 3 or more rude comments in the recent past.

Now speaking from the mod perspective, the flag became very noisy and went to the levels of 300. Most of them were filled with too chatty comments, which were flagged as Non-constructive. This caused the CMs to look into the flag and make the comment flags less stupid. After the merger of the 3 comment flag types, the auto flag is now raised whenever there are 3 or more rude comments in the recent past.

Source Link
Bhargav Rao Mod
  • 52k
  • 22
  • 234
  • 271
Loading