Skip to main content
5 of 7
added 67 characters in body
dan1st
  • 16k
  • 36
  • 70

What you can do

For the posts themselves, treat them like other bad quality posts and close them if applicable. The main mechanisms to deal with/remove these questions are on the main site.

Note that you can't expect questions coming out of the Staging Ground to be high-quality. But the author should make it clear what's asked and it should be on-topic on Stack Overflow. If it needs a subject-matter expert to judge whether the question is ok or needs details, it's ok to be published.

For reviewers you have a few options:

  • If you have reason to believe the reviewer acted in good faith but doesn't understand or overlooked something, you could try to contact the reviewer directly via Chat and tell them that it isn't really a good question. You can find the chat profile of a user by taking the profile URL and prepending it with the chat. subdomain. Note that this may not work for all users (I think you can't create a chatroom with a user if they never used Chat).
  • If it's just a single post from the reviewer and their other reviews look good (or it's their only review), you can't really do much. Just go on.
  • If you can see a pattern of the reviewer approving bad questions (you can use the review history and search for reviews of the user - I wrote a user script for this), you can raise a custom flag in one of the Staging Ground posts they reviewed. Please explain why you think their reviews are bad in some form and maybe also link to some examples (you can use [Q](/q/<question ID>) which works with SG posts for links if you reach the character limit of the flag dialog).

A special case would be obvious spam (I haven't seen that being approved until now). These posts shouldn't be posted to the main site. In that case, I would flag the published post as spam and raise a custom flag on the SG post to inform mods that the reviewer let through the said obvious spam since they are probably not really taking attention while reviewing.

Your linked questions

Let's look at the specific cases you linked. I am not including specific post links to not have too much of a Meta effect. Note that these are my opinions:

  • In the first case, I can find 5 approvals from the reviewer and no other Staging Ground review actions. Out of these, one question doesn't really explain the problem, one has an image of data that doesn't even have image formatting (the one you linked), one is fine IMO but could be better written, one where I am not sure what exactly the OP wants and one is asking about errors without stating what the errors are. I think this reviewer may not understand the Staging Ground and/or the expected quality level on Stack Overflow. I guess you could try to contact people like that in Chat.
  • In the second case, I found two other reviews from that reviewer which are both "Requires Major Changes" and seem reasonable. I don't see any action needed regarding this reviewer.
  • The third user approved 4 posts in the Staging Ground. The one you linked mostly looks fine for non-SMEs. One was (IMO rightfully) marked as off-topic before and still approved for some reason (before being closed on the main site), one should be focused more on a single problem and one has formatting issues in a way the reviewer should have definitely seen. Similar to the first case, I think this reviewer probably doesn't know what we are expecting of reviewers and it might be good to inform them.
  • The fourth user approved the question you linked and voted 4 other SG posts as off-topic and the post you linked doesn't seem to be that bad to me so I don't think there's anything to do regarding that reviewer.
  • For the last user, I agree that this question shouldn't have been published but the reviewer didn't review any other questions. They might just found the question and clicked a button not really understanding it. I don't think it's worth doing anything here as they just (wrongly) approved a single question which can happen.

All in all, these reviewers don't seem enough of a problem that I think you'd need to flag it. There are some bad reviews but IMO there isn't much of a point in going after people who don't do many reviews anyway.

For the above, I scanned 50 pages of review history so there may be some older posts I overlooked.

The real problem

Unfortunately, there are many reviewers who don't understand the Staging Ground and the Staging Ground is not explaining how exactly posts should be reviewed. Reviewer onboarding has been improved but it is still lacking. It doesn't explain contain the information from the reviewer guidelines, the importance of "Requires Major Changes" (and that it should be preferred over the off-topic option in most cases) and there is nothing showing reviewers what is actually expected from them.

dan1st
  • 16k
  • 36
  • 70