36

When reviewing the outcomes of my decisions in the review queues, I sometimes see review results that, from my perspective, are clearly wrong. Especially in the Suggested Edits queue, sometimes very weird edits get accepted.

What is the right way to deal with that? Raising a moderator flag?

Wouldn't it be a nice feature to have some kind of I don't agree button when the review is finished?

Clicking this button could either send the particular item back to the queue for a second review, or let a moderator or higher reputation user to have a second look at it.


After receiving feedback I guess I can say that this proposition is controversial. forsvarir made a fair point in the comments:

[...] clearly everybody that votes the opposite way to the final decision disagreed with the outcome... That's why the system works based on the majority of votes.

My point here is: sometimes the majority of votes decision does not reflect the opinion of the community - that's an issue arising from the fact that we select a very small number of reviewers. My idea to solve this is to make it somehow possible to increase the number of people judging a review, without increasing the review work to a level that cannot be handled anymore.

Having thought about that a second time, the proposal of a meta-review queue could be more general and better suited to solve this problem. Any suggestions and criticism are of course warmly welcomed.

11
  • 19
    I don't really see how this is any different to your existing vote in the queue.... clearly everybody that votes the opposite way to the final decision disagreed with the outcome... That's why the system works based on the majority of votes.
    – forsvarir
    Commented Mar 29, 2015 at 19:26
  • 2
    @forsvarir I saw the OP's request as a desire to correct actions believed to be mistaken. (Which is reasonable since mistakes do happen, but I think they are less common outside of suggested edits.)
    – Radiodef
    Commented Mar 29, 2015 at 19:33
  • 1
    @forsvarir, that's true in some cases, but not all. Sometimes when I go through the previous edits I realize, that it was me who made a mistake.
    – cel
    Commented Mar 29, 2015 at 19:50
  • 1
    @Radiodef, Yes suggested edits, is probably the most common queue for mistakes, but sometimes also low quality and triage. But in the triage queue the outcome is often debatable.
    – cel
    Commented Mar 29, 2015 at 19:53
  • 1
    Just suggest an opposite edit? (The wikipedia way) Commented Mar 30, 2015 at 7:06
  • 3
    @Trilarion, I am over 2000 reputation, so I cannot really suggest anymore. If I make a change then it will automatically bypass the `review´ queues.
    – cel
    Commented Mar 30, 2015 at 7:19
  • 2
    This whole question is "I know best. My vote should override other peoples' votes because I know best. Make that happen please." Commented Mar 31, 2015 at 0:29
  • 3
    @LightnessRacesinOrbit, it may seem at first sight, but I can assure you that this is clearly not my intention here. I don't want to make my opinion decide, I want to make it possible to increase the number of people involved in a review, when I think it may have gone wrong.
    – cel
    Commented Mar 31, 2015 at 6:39
  • 2
    @cel Well that is also a possibility. Just edit the question and improve it. You may not be able to undo the small rep for the suggested edit but you improve SO. Isn't that the goal? Commented Mar 31, 2015 at 18:32
  • I don't think this goes far enough. Each review should have a dedicated parent review. That way, the whole system will fall over, and there will be actual issues to discuss on meta.
    – machine
    Commented Apr 1, 2015 at 9:02
  • @MichaelMroz, see my linked discussion about meta-review. Note however that judging from the votes, this idea does not seem to be supported by the community
    – cel
    Commented Apr 1, 2015 at 9:05

1 Answer 1

19

If you have sufficient reputation (2000) you can revert the edit yourself or click 'Improve Edit' or 'Reject and Edit', both of which presumably remove the suggestion from the queue.

If a review mistake is particularly egregious, you may flag the post to notify a moderator (possibly with a link to the review).

Creating more reviews seems like a noisy solution to me. Also if we are talking about erroneous edits, creating a review is a slow path to correction. Better to correct it immediately yourself IMO.

If you are confident an action is an error, and have the privilege to overrule it, you may do so.

For other queues, I would have to say it depends on the situation. For example with low quality, you can flag the post again, but if the original flag was controversial you should put some extra thought in to it.

Reviewers/moderators do make mistakes occasionally but most of the time when a flag is disputed, it is because there simply isn't a majority opinion on whether it should be deleted or not. (See, for example, the "doesn't answer the question/doesn't answer any question" NAA debate.)

Especially when it comes to closing/flagging, I've only rarely seen an action that I disagreed with where, after researching the topic, it didn't became clear to me that my disagreement was misplaced or simply my opinion.


Other relevant discussion:

Although unrelated to queues, you might peruse something like is:question title:"why" [disputed-flags] or [declined-flags] to see examples of flags that are controversial or ambiguous.

3
  • 5
    The problem with a rollback is that this is basically cheating the review system. It's like saying: Yes you all think this edit is okay, but I will reject and don't really care about what you were actually voting.
    – cel
    Commented Mar 29, 2015 at 19:57
  • 7
    It circumvents the queue but a rollback is a non-queue option (at this time). Rollback exists so incorrect edits can be rolled back so of course we may use it. See for example the discussion here: http://meta.stackoverflow.com/a/253370/2891664. (Clicking 'Reject and Edit', then adding zero-width whitespace would certainly be cheating but I don't recommend that.)
    – Radiodef
    Commented Mar 29, 2015 at 20:29
  • 4
    @cel if you've noticed this and taken the time to look over the post itself, you've probably spent a lot more time than the people who just clicked 'approve'. There's no need to feel bad about using your own judgement.
    – sapi
    Commented Mar 31, 2015 at 0:28

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .