926

I recently got the privilege to review questions in Triage, and I'm pretty sure I'm already doing it wrong.

I've read some of the Q&A about the Triage review queue here on Meta, but I was wondering if there is a guide explaining how it works and how I should be reviewing.

What do the four review options mean, what should I do if I'm unsure what action to take, and how many Triage reviews can I perform per day?

What should I do if I make mistakes? Is there any recourse?

Return to FAQ index

7
  • 11
  • 4
    How do posts get into Triage in the first place? Commented Sep 5, 2020 at 0:21
  • 4
    @DanielWiddis Through VLQ flags or through some unknown heuristic when the question is posted (questions which score below the heuristic threshold are put into the queue, questions scoring above are given full visibility on the homepage) Commented Sep 5, 2020 at 0:24
  • 1
    @10Rep, I disagree that featuring this is very helpful. Few hundereds of users may read this and even learn, but as soon as this is unfeatured you will still have a problem. The constant need to route new users here probably indicates some problem there. Perhaps triage UI needs a change. Imho featured is for something what needs discussion or a kind of announce (when there is no way to get new information). Necro-featuring wiki questions periodically is interesting idea, but there could be a better way.
    – Sinatr
    Commented Sep 7, 2020 at 7:03
  • 1
    @Sinatr I agree with you on this. There's another deeper problem with reviewing. Users do not understand which Questions are OK and which should be closed. Triage routes a lot of wrong reviews to the Help & Improvement queue, and that makes them very visible wrong reviews. But there are lots of posts going wrongly through review and never closed. Some come from Triage, but I believe more come from the First Posts queue, where only one reviewer makes the call. The deeper issue is the route cause, in my opinion.
    – Scratte
    Commented Sep 7, 2020 at 7:23
  • @Sinatr I agree the Triage UI needs a change, which is why I quit triage. But SE doesn't seem to want to do anything as of now. Instead, they are bombing new things on us that most people think is junk. So a moderator simply did the next best thing, which is to raise awareness. It's not going to fully solve the problem, but after looking at this post I understood what my mistake was when I was doing triage. There is definitely a better way, which is for the company to take action.
    – 10 Rep
    Commented Sep 7, 2020 at 17:45
  • @DanielWiddis Also, if a post receives a 'Looks OK' review in Triage, you can 'dispute' the review i.e. push it back into Triage by flagging the question as Very low quality.
    – CPlus
    Commented Dec 3, 2023 at 18:16

1 Answer 1

1221

The primary goal of Triage is to quickly sort potentially problematic posts into categories that can be routed elsewhere. Many people have expressed confusion over how to use Triage, as the queue has evolved considerably over time.

Here are some rules of thumb based on the review options available:

Skip

If you aren't sure what should happen to a question, Skip it and move on to the next one. This should be your default option: there's no penalty for skipping, and it immediately makes the question available for others to review, so if you don't think you can make a good decision quickly (within, say, a minute), Skip it!

Common reasons to Skip include:

  • an unfamiliar technology, and not blatantly unsuitable for the site (I dare you to try judging the validity of VHDL tagged questions if you've never worked with it).
  • the prose is hard to understand but not necessarily impossible (English written by folks who don't often write English can be extremely confusing for those not accustomed to it).
  • extremely long and detailed, combined with either of the above...
  • ...or you're just in a hurry and were hoping to find an obvious spam post to flag before heading out for lunch.

Remember: There is no shame in using "Skip"!

Flag (question is spam, rude/abusive, or should be closed)

Use Flag for incomplete and/or off-topic questions which should be closed.

Blatantly-inappropriate questions

Is it spam? A rant about nothing productive? The output of someone's cat dancing merrily across their keyboard? Not in English? Easy enough: choose Flag, and flag or vote to close appropriately. (At 3k some of the options become votes instead of flags, but the UI doesn't change much.)

Of course, if you think it's the work of a cat but suspect it might actually be a valid Perl regex that got mistagged somehow... Skip, so someone else can have a look.

When you know something about what you're reading

Even questions that aren't blatantly inappropriate for the site can still be Flagged if there's simply no way they can generate a useful answer. Usually, judging these questions will require at least some basic knowledge of the technologies involved though, and you'll want to read the question carefully — the good folk answering Ruby questions won't appreciate you flagging stuff simply because all the Gem names appear to have been produced from a set of rather twee Markov chains. Again, if you're not sure, hit Skip!

You should Flag a question for any reason you would flag a question. These include, but are not limited to:

  • It's a duplicate.
  • It is extremely broad, requesting answerers to implement an entire system ("I want to build a Facebook, but for dogs") or write a textbook ("Can someone explain functional programming, and concurrency, and asymptotic notation and also three other questions on my test before tomorrow?") or both ("I'm new to programming, and want to write my own operating system on x64 - where should I start?").
  • It is written in a language other than English (even if it is a clear and answerable question for those who understand it).
  • Anything that has no direct connection to programming or software design ("I want to share football scores with my team, but I'm locked out of my Slack account; halp?")
  • It is Primarily Opinion-based: This can sometimes be tricky, as questions which require some level of professional, experience-based opinion are OK. Questions are off-topic when answers will be based primarily on opinions (e.g. "are tabs or spaces better for indenting").
  • Any reason in the community-specific (off-topic) sub-pane of the close-vote or close-flag dialog, including:
    • About general computing hardware and software
    • About professional server- or networking-related infrastructure administration
    • Seeking recommendations for books, tools, software libraries, and more
    • Not reproducible or was caused by a typo
    • Belongs on another site in the Stack Exchange network (and is off-topic on Stack Overflow)
    • Blatantly off-topic (only listed on the close-flag dialog; for a close-vote use another valid reason, or a custom reason)
    • Other, custom reasons (only listed on the close-vote dialog)

That last one deserves a note: if a question is definitely off-topic but is quite well-written and on-topic for another Stack Exchange site, you can flag/vote for migration using Flag → off-topicbelongs on another site (or a custom moderator flag if the necessary site isn't in the list of sites). Alternately, just leave a comment noting the existence of the appropriate site and close as off-topic.

Needs Community Edit

Use Needs Community Edit only for complete and on-topic questions which simply require a cleanup.

Needs Community Edit = Needs an editor

Can you imagine yourself (not the post's author) editing the question to improve its current state? How about some other random editor with perhaps more knowledge of the specific area, or more patience for lousy writing, or both?

If you don't know whether the question can be fixed by editing alone — perhaps you've never worked with the technologies involved and simply can't tell if it's a reasonable question for topic-experts — then Skip; there are other questions that need your attention more.

If you're sure that this question can be fixed through editing alone (see also Addendum: Bad Triage Review below) then hit Needs Community Edit. This keeps the post visible on the site and may add it to the Help & Improvement First Questions review queue, allowing other editors to find and improve it.

Reasons for choosing Needs Community Edit

  • Overhaul its substantial spelling/grammar/formatting errors
  • Rewrite the title to represent the core of the problem
  • Remove useless and mistaken tags and add crucial, relevant tags
  • Incorporate key information from comments
  • Incorporate key information from mistaken self-answers (assuming you can see these, which is not usually the case)

(These reasons are borrowed from another post.)

Reasons for NOT choosing Needs Community Edit

Do not choose "Needs Community Edit" if you know the question can only be made answerable with clarifications or additions from its author. The correct option for that is "Needs Author Edit."

For example, if an question asks for an explanation of errors found in logcat, but omits specific errors and/or logcat listing, the question doesn't require editing — it requires more information, so choose Needs Author EditNeeds details or clarity.

A question is also Needs Author Edit if the code, error message, or other crucial information is only present as an image (or image link)! It's the author's and not the editor's job to include all relevant information as text. The same applies to questions which link to code repositories without including the critical code sections or a Minimal, Reproducible Example in their post. Images and links should only ever serve as references or enhancements of what's already being stated completely as text in the question's description.

Looks OK

First, there's a bit of a special case here: Duplicates. A clear, well-written question might still be a duplicate, and the last thing you want to do is to dispute Duplicate flags by choosing Looks OK if it is a duplicate. So always read the comments first: scroll to the end of the question, and if you see "Does this answer your question?" (formerly: "Possible duplicate") in the list, either mark it as a duplicate yourself (if you can confirm that the comment is accurate) or Needs Community Edit if the author has provided some clarification in the comments but hasn't yet edited the post; choose Looks OK only if you're certain the question is not a duplicate. As always, Skip is a fine option here if you simply don't want to take the time to look at duplicates.

The "Does this answer your question?" auto-comment indicates there is at least one close vote but also look for comments suggesting a question is very similar, a duplicate, or has the answer the asker needs.

If the question is clear, well-written and unique, hit Looks OK. If you're the 3rd person to choose this option, you'll get the chance to vote on the question following your review — go ahead and do so! (You can always vote by clicking through to the normal question page of course, but since exceptionally good questions are so rare Triage gives you a chance to do this without leaving the queue).

If it's a halfway decent question but not amazing, or if some editing would be nice to clean up some minor errors or rough spots, but it's just about as answerable without any, just hit Looks OK.

If it's kind of a boring or useless question but it doesn't really need to be closed or removed, hit Looks OK (and downvote if you're the 3rd reviewer).

Needs Author Edit

Use Needs Author Edit for questions that need more information or clarity from the author.

Reasons for choosing Needs Author Edit

This is a new option that duplicates some of the functionality of the Flag option, but makes it much clearer that a vote for this option is a vote for sending the question back to the author.

Choose Needs Author Edit if:

  • The question doesn't have enough information to be answered as-is
  • You understand the question topic and the question they're asking is unclear or ambiguous
  • Key information/code in the question is in screenshot form only
  • The question is too broad

Addendum

Queue limits

The limit of 20 reviews/day is common to all review queues on all sites and does not change with reputation, time spent on site, badges, helpful flags, review counts, audit pass rates, or much of anything except the queue overflowing: if there are more than 150 reviews backlogged, all reviewers will have 40 reviews/day in that queue. (♦ moderators do not have review limits.)

Recovery of a Bad Review

You had too much coffee, you finger twitched, and by mistake you wrongly clicked on the Needs Community Edit (or Looks OK) button when you actually wanted to click on the Flag button. What can you do?

  1. You cannot change or undo your review.
  2. Instead, go back to the question itself and flag it as you should have during the review.
  3. If flagging doesn't work for you, or if there's some other concern, then join the Bad Stack Overflow Review Chat and discuss your bad review there to find a resolution.
39
  • 34
    How would you categorize questions asking to solve their homework by only posting the entire problem description without any information on what they have tried or any specific problem? Is it too broad or rather off topic? If off topic then which of the options, because none of them seem to match. Commented Sep 8, 2019 at 8:28
  • 17
    @anddero: Too Broad is usually best; a problem statement for homework is not an actual question per se, but only background information for what should be a more narrowly focused and specific question that comes up in the process of solving homework. But to some extent it doesn't matter too much: a homework dump is just generally terrible quality, so any close reason that is more or less applicable can be slapped on there to just get out of the way. Commented Sep 8, 2019 at 22:27
  • 6
    How do you categorize people who don't post any try/code ? Too broad too ? Commented Sep 12, 2019 at 7:16
  • 14
    @MaximeGirou: If the question is asking too much, flag as too broad; if it doesn't make sense without the relevant code, unclear, or the MCVE custom reason. But not all questions even need any code at all. Commented Sep 12, 2019 at 16:55
  • 52
    Hitting "Looks OK" on any post with "rough spots" is liable to end up hitting an audit question that gets you banned from the review queue. The whole process feels like a minefield. Commented Nov 2, 2019 at 21:21
  • 8
    Might be a nice article, but it requires a much higher level of English than a non-native English speaker gets by programming and reading documentations. The little difference from "maybe" to "probably" is not easy to grasp, or idioms like "the work of a cat" either. Please try to stick to some more scientific language. I consider myself to speak fluent English - but I'm unable to understand Shakespeare in English - and this shouldn't be necessary for stackoverflow.
    – Holger
    Commented Dec 4, 2019 at 19:09
  • 15
    I'm still not sure on how to triage questions from someone who didn't try anything at all. Like "I want [this code] to do [this]. Please do it for me" or "I want to convert [this code] to [this language]. Please do it for me". For now I I just skip them but PLEASE handle this case in the guide.
    – Camusensei
    Commented Feb 4, 2020 at 22:07
  • 13
    most of the posts i get in my triage queue are about technologies i don't use and therefore i can't add value. can i apply filtering somehow? Commented Feb 5, 2020 at 19:08
  • 9
    @Camusensei These are "Unsalvagable" and could be flagged as "Needs more focus". On a general point, the Triage queue seems to be on a hair-trigger for temp-banning; twice in the last month I've had one-week total queue bans...
    – Ken Y-N
    Commented Mar 8, 2020 at 23:50
  • 7
    These tips, and especially the first rule about "Skipping" and the link to There is no shame in using "Skip" Should be on the Triage page for all potential triage-ers.
    – willman
    Commented Mar 14, 2020 at 19:44
  • 7
    @KenY-N: “On a general point, the Triage queue seems to be on a hair-trigger for temp-banning”—I avoid the Triage queue for that exact reason. I usually skip, but I do try to vote if I’m above 80% confident. And yet that’s still just 5-10 votes away from being on the wrong side of a judgment call. (With the mediocre quality of most posts, I’m rarely above 90% confident.) First Posts are much safer, and provide an opportunity to help welcome new contributors and coach them on how to best use the site. That said, with each test or suspension I develop a better heuristic for those judgment calls. Commented Mar 19, 2020 at 18:48
  • 11
    I see a loophole in Skipping questions that written in poor English that can be understood, but still is broken. If all of us stick to the rule, I feel that the post will never exit triage. Thus, Skipping is just procrastinate, until someone will finally say Looks Ok to broken English, or Requires Editing, again for broken English. Doesn't this loophole defy the purpose of community driven reviews, putting work on the shoulders of experienced reviewers, as newcomers are guided towards Skip 'em all? Shouldn't Broken English default to Requires Editing? Commented Apr 8, 2020 at 9:10
  • 22
    After I had received my reviewer privilege yesterday, I read this thread earlier today. Then, I did a couple of Triage reviews (about 20 or so, plenty of Skip in between when I was unsure). Apparently, I had misunderstood parts of the descriptions above. So I didn't get a warning or something, but a direct ban. Draconic? Yes, they are. For the first mistake (or, the first day making one or potentially multiple mistakes), I got banned for > 1 month. I cannot recommend anybody to take part in Triage reviews and put at risk the own account for "nothing". Commented Apr 18, 2020 at 16:43
  • 8
    I also think an important section or warning is missing in this document: Consequences of Misjudging a Question. 1) Know your judgment is final (you cannot undo hitting the wrong button by mistake) – except for Skip. 2) A wrong judgment (Requires Editing over Unsalvageable) results into tedious, manual work for the moderators to recover from it 3) You're definitley going to be banned from using the review system for X days for making a single judgement mistake. // Such section would also help to correct the (maybe too carefree) tone of this document IMO.
    – Ivo Mori
    Commented May 22, 2020 at 2:08
  • 9
    I've seen Triage for the first time. I had no idea what to do with it. After reading through this, I'm not actually much wiser, except that it is being made very, very clear that doing this is a mistake for 99% of the people out there. Literally stopped reading at the threat of being banned for making a mistake. Either the wording needs to be improved, or the rules. In any case can I only recommend not to participate in this, unless you're absolutely 100% certain that you know what you're doing in respect to the topic of the question.
    – z0rberg's
    Commented Jul 22, 2020 at 10:25

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .