Skip to main content
1 of 4
Bhargav Rao Mod
  • 52k
  • 22
  • 234
  • 271

but lately that feels like just sweeping the problem under the rug

Actually, This was an issue earlier. A few years back, we (the Sobotics team), requested a dump of rude comments from Stack Exchange, which Stack Exchange provided us. We then built the HeatDetector, an app to detect rude comments on Stack Overflow (using NLP). Thanks to the bot reporting stuff, most of rude and snarky comments used to be flagged by users in chat and subsequently deleted. We used to flag the users, if they added too many rude comments in a very short period of time. Now, thanks to Brad's meta post, there is an automatic flag raised in these cases, and we no longer need to flag those.

Now speaking from the mod perspective, the flag became very noisy and went to the levels of 300. Most of them were filled with too chatty comments, which were flagged as Non-constructive. This caused the CMs to look into the flag and make the comment flags less stupid. After the merger of the 3 comment flag types, the auto flag is now raised whenever there are 3 or more rude comments in the recent past.

Now the signal/noise ratio is high, but on the downside, the number of false negatives are also high.

Can users be sent an automatic warning with a reminder to Be Nice if a number of their comments are flagged as rude?

This isn't a bad idea, but there's one downside. Stack Exchange automatically deletes some comments, and does face the Scunthorpe problem. There might be edge cases where a user actually added some profanity which made sense in the context of the post.

Another potential problem which I see is that, it doesn't really help cater the main issue which you're focusing upon, which is:

Lately it feels like there's a growing perception that Stack Overflow is not a nice place.

This growing perception is mostly because the users receive negative comments. Most of these snarky comments are flagged as no longer needed. This is because the users to which they are targeted are usually new and do not know how to flag. The other users, who check these out do not consider it rude, and flag it as no longer needed, instead. (I don't know why they do this, but I can clearly say that I see many snarky comments flagged as nln and not ra). This doesn't raise an auto flag, and wouldn't send the automated message.

Now, we can't just include nln into the rude comments bracket, as it would cause the problem discussed earlier. So, to conclude, the new system won't be very effective. If we decide to go with this new system, it would need a lot of development effort. Instead of that, we can just spend some more of the moderator time and make them handle it. And as always, a pair of human eyes is better than an automated system.

and for your questions:

Is anything like this already in place?

As meagar mentioned, there isn't an automated system per se, but mods are trained similar to an automated system to contact the user on seeing these flags.

Is there (anonymized) data regular users can access to see how big a problem this is?

There is some limited data set provided by Stack Exchange, which would not help to see how big this problem is. As far as I know, this is not made public, to protect the guilty (even if anonymized, users can find out from the comment text).

From a community user perspective, you are more than welcome to join us in Sobotics and get a live feed of the snarky comments. Rob is building a nice web-based GUI frontend, to create a new dashboard, where you can see the (possibly anonymized) data. This would be more useful to you.

Should this be escalated to a moderator flag after a number of warnings to the same user?

I'd say, this should be escalated on the very first warning (in the new system which you propose). Moderators must have knowledge of rude and abusive users so that they can keep an eye on them and take care.

Bhargav Rao Mod
  • 52k
  • 22
  • 234
  • 271