I am increasingly likely to hand out short review bans for blatantly wrong reviews that I come across.
This is primarily motivated by my observation that if I see something bad and do nothing about it then the odds of the reviewer noticing or learning from it are so vanishingly slim that I might as well have not bothered to view the review to begin with.
There are two cases that I'm mostly motivated about right now:
- Approving/allowing spam to exist for longer than necessary.
- Mis-using "requires editing" on questions that are fundamentally unsalvageable.
It's very easy to find a bad editor or reviewer and then spend all my time for that morning chasing up one single issue.
The scale of the bad reviews problem is large enough that investigating every single incorrect reviewer individually and figuring out if it's a one-off blip or a long term trend really isn't viable. It's simplest and scalable to hand a short review ban to all the incorrect reviews regardless of history. The harm of a 3 day review ban for a misclick vs not banning roboreviewers is strongly skewed towards needing to act on the roboreviewers.
In terms of lengths of ban I typically use 3 days for "I think it was a good faith, but incorrect review" as a minimum to make sure the user has a good chance of seeing the message. (Quite a large percentage of users aren't active over weekends it seems). For the case where there's no possible way that outcome could be reasonable I tend to pick 7 days instead, but that's a crude rule of thumb.
(As a feature request I'd love a mechanism that let me tip bad reviews into the normal automatic audit banning mechanism, counting as just 1 failure but that's lots of dev work from where we are right now. That would be a scalable single click which did the right thing for the circumstances of each reviewer).