Since SOCVR is a Stack Overflow group and this question sort of focuses on their work, this may be better served on Meta Stack Overflow (which is why I eventually moved it here)... but there are similar groups around the network designed to help get questions closed more quickly, so I think talking about this more broadly is beneficial.
In short - these groups are serving a valuable purpose and we should work to make their work easier and support what they're doing with changes that will help anyone whose question is closed. I don't see a specific need for additional transparency into the work of these groups; I see need for improvement in how the system helps users overcome question closure - and even more - improving how the UI introduces users to question asking so that fewer questions need closure.
Notifying users of closure and other system improvements
A week ago, we changed our system so that all users whose question is closed are notified of the closure and the reason for it - "Question closed" notifications experiment results and graduation - this is a huge departure from our past, where we were concerned about notifying users because we do know that having a question closed can feel like a failure and can hurt - particularly if you're desperately trying to get unstuck at work, only to have your question shut down, too. Closure can be frustrating but we want to help users overcome it, rather than having it feel like a dead end.
To do this, we want to make sure that any links in the post notice that a user sees after their question being closed lead to helpful information for the improvement of their question - there's probably some room for improvement here as this guidance is generally network-wide rather than site-specific. That said, any guide still has to be somewhat general as sometimes the way to fix a question is specific to it, so there's only so much help a guide can offer.
Think about it this way - if I have a guide about how to write a good question and it has five points - any one close-worthy question may be missing 1-5 of those points but it's difficult to make the guide specific to which points an individual question is missing, which can lead to overloading the asker with stuff they're already doing and making it difficult to identify the items that need to be added. So by narrowing the scope of any help guide to a specific subset of issue, the information can be more tailored to the question asked.
Many people who participate in reviewing questions for closure do leave comments linking to helpful resources, which will give askers a heads-up that their post needs some work, but these resources are available to all reviewers, not only specific subsets of them, so I don't see a need for special treatment for SOCVR participants only. While these may be more tailored than the main Help Center article, they may still be more general rather than specific to the question asked but, with individuals leaving these comments, they can often tailor them to the specific needs of the question - though this slows down the review process.
Currently, there are only two notifications the system sends when a question is nominated for closure and they are both due to comments being created -
- Questions that are possibly duplicates.
- Questions being closed with a custom reason.
- (Not a notification, but with sufficient rep, they can see on the question that it has collected close votes)
Otherwise, a user only knows their question is up for closure after it's closed or if someone leaves a comment pointing out issues with the post. I have seen discussions about notifying users about closure while its in process so that they can see why their question is seen as close-worthy and work to address that during the close process, hopefully preventing their question from being closed. I'm not really convinced that it'd be effective at getting a quick change to the post... but a lot of times, that's not even necessary since...
Many reviews age out completely
The issue that I regularly come across is that many sites have more work than they can manage in review. In a 90-day period, 69 sites had 70% or fewer of the questions nominated for closure actually finish review - this means that 30% or more aged out of review without being handled. This includes Stack Overflow, which naturally tends to be around 50/50 (which is an improvement from only 35-40% handled when five votes were required to close).
Many questions do get edited after being closed but most edits don't result in the question being reopened. For example, in a ninety day period on SO prior to the close notifications being turned on, nearly 30k questions were edited after being closed but only 6% were reopened - that said, only about half of the posts were reviewed, with 44% aging out of the reopen review queue - so, while it can be hard to close close-worthy questions, it's also hard to reopen a question that's been closed.
What I get from this is that there's a ton of stuff needing to be reviewed and not getting it and that's likely because there just aren't enough people willing to review at all. There's a core of reviewers on many sites - in some cases it's mostly the moderators - but many users with the ability to review, don't. This is why we're working to improve the review experience. If people are better trained in how to review and the review queues are easier to use, they may actually review more and more accurately, leading to a lighter load shared by more people and a higher percentage actually getting reviewed.
There's a lot of room for improvement but I don't think that transparency for the small group of users trying to manage the huge flow of close-worthy stuff on the network, particularly on Stack Overflow is the place that needs it.
Thanks to all of the SOCVR members who do work to identify and close questions that aren't a good fit for SO - and to the users who do similar work on other sites. You may not hear it often but you're appreciated.
reopen-pls
in SOCVR. (And some of those are still not eligible, but even then, I would say SOCVR is probably too eager rather than too reluctant to reopen.)