Skip to main content
replaced http://meta.stackoverflow.com/ with https://meta.stackoverflow.com/
Source Link

I am increasingly likely to hand out short review bans for blatantly wrong reviews that I come across.

This is primarily motivated by my observation that if I see something bad and do nothing about it then the odds of the reviewer noticing or learning from it are so vanishingly slim that I might as well have not bothered to view the review to begin with.

There are two cases that I'm mostly motivated about right now:

  1. Approving/allowing spam to exist for longer than necessary.
  2. Mis-using "requires editing" on questions that are fundamentally unsalvageableMis-using "requires editing" on questions that are fundamentally unsalvageable.

It's very easy to find a bad editor or reviewer and then spend all my time for that morning chasing up one single issue.

The scale of the bad reviews problem is large enough that investigating every single incorrect reviewer individually and figuring out if it's a one-off blip or a long term trend really isn't viable. It's simplest and scalable to hand a short review ban to all the incorrect reviews regardless of history. The harm of a 3 day review ban for a misclick vs not banning roboreviewers is strongly skewed towards needing to act on the roboreviewers.

In terms of lengths of ban I typically use 3 days for "I think it was a good faith, but incorrect review" as a minimum to make sure the user has a good chance of seeing the message. (Quite a large percentage of users aren't active over weekends it seems). For the case where there's no possible way that outcome could be reasonable I tend to pick 7 days instead, but that's a crude rule of thumb.

(As a feature request I'd love a mechanism that let me tip bad reviews into the normal automatic audit banning mechanism, counting as just 1 failure but that's lots of dev work from where we are right now. That would be a scalable single click which did the right thing for the circumstances of each reviewer).

I am increasingly likely to hand out short review bans for blatantly wrong reviews that I come across.

This is primarily motivated by my observation that if I see something bad and do nothing about it then the odds of the reviewer noticing or learning from it are so vanishingly slim that I might as well have not bothered to view the review to begin with.

There are two cases that I'm mostly motivated about right now:

  1. Approving/allowing spam to exist for longer than necessary.
  2. Mis-using "requires editing" on questions that are fundamentally unsalvageable.

It's very easy to find a bad editor or reviewer and then spend all my time for that morning chasing up one single issue.

The scale of the bad reviews problem is large enough that investigating every single incorrect reviewer individually and figuring out if it's a one-off blip or a long term trend really isn't viable. It's simplest and scalable to hand a short review ban to all the incorrect reviews regardless of history. The harm of a 3 day review ban for a misclick vs not banning roboreviewers is strongly skewed towards needing to act on the roboreviewers.

In terms of lengths of ban I typically use 3 days for "I think it was a good faith, but incorrect review" as a minimum to make sure the user has a good chance of seeing the message. (Quite a large percentage of users aren't active over weekends it seems). For the case where there's no possible way that outcome could be reasonable I tend to pick 7 days instead, but that's a crude rule of thumb.

(As a feature request I'd love a mechanism that let me tip bad reviews into the normal automatic audit banning mechanism, counting as just 1 failure but that's lots of dev work from where we are right now. That would be a scalable single click which did the right thing for the circumstances of each reviewer).

I am increasingly likely to hand out short review bans for blatantly wrong reviews that I come across.

This is primarily motivated by my observation that if I see something bad and do nothing about it then the odds of the reviewer noticing or learning from it are so vanishingly slim that I might as well have not bothered to view the review to begin with.

There are two cases that I'm mostly motivated about right now:

  1. Approving/allowing spam to exist for longer than necessary.
  2. Mis-using "requires editing" on questions that are fundamentally unsalvageable.

It's very easy to find a bad editor or reviewer and then spend all my time for that morning chasing up one single issue.

The scale of the bad reviews problem is large enough that investigating every single incorrect reviewer individually and figuring out if it's a one-off blip or a long term trend really isn't viable. It's simplest and scalable to hand a short review ban to all the incorrect reviews regardless of history. The harm of a 3 day review ban for a misclick vs not banning roboreviewers is strongly skewed towards needing to act on the roboreviewers.

In terms of lengths of ban I typically use 3 days for "I think it was a good faith, but incorrect review" as a minimum to make sure the user has a good chance of seeing the message. (Quite a large percentage of users aren't active over weekends it seems). For the case where there's no possible way that outcome could be reasonable I tend to pick 7 days instead, but that's a crude rule of thumb.

(As a feature request I'd love a mechanism that let me tip bad reviews into the normal automatic audit banning mechanism, counting as just 1 failure but that's lots of dev work from where we are right now. That would be a scalable single click which did the right thing for the circumstances of each reviewer).

added 400 characters in body
Source Link

I am increasingly likely to hand out short review bans for blatantly wrong reviews that I come across.

This is primarily motivated by my observation that if I see something bad and do nothing about it then the odds of the reviewer noticing or learning from it are so vanishingly slim that I might as well have not bothered to view the review to begin with.

There are two cases that I'm mostly motivated about right now:

  1. Approving/allowing spam to exist for longer than necessary.
  2. Mis-using "requires editing" on questions that are fundamentally unsalvageable.

It's very easy to find a bad editor or reviewer and then spend all my time for that morning chasing up one single issue.

The scale of the bad reviews problem is large enough that investigating every single incorrect reviewer individually and figuring out if it's a one-off blip or a long term trend really isn't viable. It's simplest and scalable to hand a short review ban to all the incorrect reviews regardless of history. The harm of a 3 day review ban for a misclick vs not banning roboreviewers is strongly skewed towards needing to act on the roboreviewers.

In terms of lengths of ban I typically use 3 days for "I think it was a good faith, but incorrect review" as a minimum to make sure the user has a good chance of seeing the message. (Quite a large percentage of users aren't active over weekends it seems). For the case where there's no possible way that outcome could be reasonable I tend to pick 7 days instead, but that's a crude rule of thumb.

(As a feature request I'd love a mechanism that let me tip bad reviews into the normal automatic audit banning mechanism, counting as just 1 failure but that's lots of dev work from where we are right now. That would be a scalable single click which did the right thing for the circumstances of each reviewer).

I am increasingly likely to hand out short review bans for blatantly wrong reviews that I come across.

This is primarily motivated by my observation that if I see something bad and do nothing about it then the odds of the reviewer noticing or learning from it are so vanishingly slim that I might as well have not bothered to view the review to begin with.

There are two cases that I'm mostly motivated about right now:

  1. Approving/allowing spam to exist for longer than necessary.
  2. Mis-using "requires editing" on questions that are fundamentally unsalvageable.

It's very easy to find a bad editor or reviewer and then spend all my time for that morning chasing up one single issue.

The scale of the bad reviews problem is large enough that investigating every single incorrect reviewer individually and figuring out if it's a one-off blip or a long term trend really isn't viable. It's simplest and scalable to hand a short review ban to all the incorrect reviews regardless of history. The harm of a 3 day review ban for a misclick vs not banning roboreviewers is strongly skewed towards needing to act on the roboreviewers.

(As a feature request I'd love a mechanism that let me tip bad reviews into the normal automatic audit banning mechanism, counting as just 1 failure but that's lots of dev work from where we are right now. That would be a scalable single click which did the right thing for the circumstances of each reviewer).

I am increasingly likely to hand out short review bans for blatantly wrong reviews that I come across.

This is primarily motivated by my observation that if I see something bad and do nothing about it then the odds of the reviewer noticing or learning from it are so vanishingly slim that I might as well have not bothered to view the review to begin with.

There are two cases that I'm mostly motivated about right now:

  1. Approving/allowing spam to exist for longer than necessary.
  2. Mis-using "requires editing" on questions that are fundamentally unsalvageable.

It's very easy to find a bad editor or reviewer and then spend all my time for that morning chasing up one single issue.

The scale of the bad reviews problem is large enough that investigating every single incorrect reviewer individually and figuring out if it's a one-off blip or a long term trend really isn't viable. It's simplest and scalable to hand a short review ban to all the incorrect reviews regardless of history. The harm of a 3 day review ban for a misclick vs not banning roboreviewers is strongly skewed towards needing to act on the roboreviewers.

In terms of lengths of ban I typically use 3 days for "I think it was a good faith, but incorrect review" as a minimum to make sure the user has a good chance of seeing the message. (Quite a large percentage of users aren't active over weekends it seems). For the case where there's no possible way that outcome could be reasonable I tend to pick 7 days instead, but that's a crude rule of thumb.

(As a feature request I'd love a mechanism that let me tip bad reviews into the normal automatic audit banning mechanism, counting as just 1 failure but that's lots of dev work from where we are right now. That would be a scalable single click which did the right thing for the circumstances of each reviewer).

Fix some typos
Source Link
Niall C.
  • 10.9k
  • 1
  • 18
  • 9

I am increasingly likely to hand out short review bans for blatentlyblatantly wrong reviews that I come across.

This is primarily motivated by my observation that if I see something bad and do nothing about it then the odds of the reviewer noticing or learning from it are so vanisinglyvanishingly slim that I might as well have not bothered to view the reivewreview to begin with.

There are two cases that I'm mostly motivated about right now:

  1. Approving/allowing spam to exist for longer than neccesarynecessary.
  2. Mis-using "requires editing" on questions that are fundamentally unsalvageable.

It's very easy to find a bad editor or reviewer and then spend all my time for that morning chasing up one single issue.

The scale of the bad reviews problem is large enough that investigating every single incorrect reviewer individually and figuring out if it's a one-off blip or a long term trend really isn't viable. It's simplest and scaleablescalable to hand a short review ban to all the incorrect reviews regardless of history. The harm of a 3 day review ban for a misclick vs not banning roboreviewers is strongly skewed towards needing to act on the robo reviewersroboreviewers.

(As a feature request I'd love a mechanism that let me tip bad reviews into the normal automatic audit banning mechanism, counting as just 1 failure but that's lots of dev work from where we are right now. That would be a scaleablescalable single click which did the right thing for the circumstances of each reviewer).

I am increasingly likely to hand out short review bans for blatently wrong reviews that I come across.

This is primarily motivated by my observation that if I see something bad and do nothing about it then the odds of the reviewer noticing or learning from it are so vanisingly slim that I might as well have not bothered to view the reivew to begin with.

There are two cases that I'm mostly motivated about right now:

  1. Approving/allowing spam to exist for longer than neccesary.
  2. Mis-using "requires editing" on questions that are fundamentally unsalvageable.

It's very easy to find a bad editor or reviewer and then spend all my time for that morning chasing up one single issue.

The scale of the bad reviews problem is large enough that investigating every single incorrect reviewer individually and figuring out if it's a one-off blip or a long term trend really isn't viable. It's simplest and scaleable to hand a short review ban to all the incorrect reviews regardless of history. The harm of a 3 day review ban for a misclick vs not banning roboreviewers is strongly skewed towards needing to act on the robo reviewers.

(As a feature request I'd love a mechanism that let me tip bad reviews into the normal automatic audit banning mechanism, counting as just 1 failure but that's lots of dev work from where we are right now. That would be a scaleable single click which did the right thing for the circumstances of each reviewer).

I am increasingly likely to hand out short review bans for blatantly wrong reviews that I come across.

This is primarily motivated by my observation that if I see something bad and do nothing about it then the odds of the reviewer noticing or learning from it are so vanishingly slim that I might as well have not bothered to view the review to begin with.

There are two cases that I'm mostly motivated about right now:

  1. Approving/allowing spam to exist for longer than necessary.
  2. Mis-using "requires editing" on questions that are fundamentally unsalvageable.

It's very easy to find a bad editor or reviewer and then spend all my time for that morning chasing up one single issue.

The scale of the bad reviews problem is large enough that investigating every single incorrect reviewer individually and figuring out if it's a one-off blip or a long term trend really isn't viable. It's simplest and scalable to hand a short review ban to all the incorrect reviews regardless of history. The harm of a 3 day review ban for a misclick vs not banning roboreviewers is strongly skewed towards needing to act on the roboreviewers.

(As a feature request I'd love a mechanism that let me tip bad reviews into the normal automatic audit banning mechanism, counting as just 1 failure but that's lots of dev work from where we are right now. That would be a scalable single click which did the right thing for the circumstances of each reviewer).

Source Link
Loading