We currently have a review queue for first posts as well as for low quality posts.
We currently also have a problem with the signal-to-noise ratio of new questions, and the current system seems insufficient to alleviate this problem.
I propose to amend the current review system in a similar manner on how journal article are peer reviewed before they are published.
TLDR: I suggest that questions by new users, or users with a history of bad questions, are required to be reviewed before they can be answered
My proposal:
Questions by users with bad previous questions (and possibly by new users) do not appear on the frontpage or in search results by default.
The only place those questions show up is in a special review queue. Reviewers can vote to publish those questions, suggest how the question can be improved, or skip. Reviewers by default get questions tailored to their interests using a similar algorithm as currently used to select questions for the "interesting" tab on the frontpage.
Questions with positive reviews get unlocked and published. Question with requests for improvements get sent back to the author, who can then edit the question and resubmit it. To avoid questions in low traffic tags from hanging around in limbo for ever, questions with no negative reviews automatically get published after x minutes.
Once a user has a certain (very low) number of question that passed review with the first attempt, their questions get published automatically. If they post a number of closed or downvoted questions, this is reverted.
Gamification: To attract enough reviewers and to prevent review-bots, reviewers get reputation for questions they approved: If the question they approved is later upvoted, they gain reputation; if it is downvoted they loose reputation. In essence the reviewers share responsibility for the quality of the question with the asker. This avoids some of the downsides of the badge-reward / audit-punishment system in our current review queues.
For the initial test phase this review system would only apply to users with a history of bad questions, i.e. users close to a question ban. If it works well, it should probably be extended to all new users, otherwise it is too easy to circumvent.
Possible drawbacks
this would be a massive barrier of entry if extended to all new users.
But perhaps that is what we need?Instead of being judged by the broad masses of stackoverflow peers, each question in the review queue would depend on the whims of a small random sample of users.
Of course, a user could always try again if their question fails review, and thereby get some new reviewers, but the fundamental problem remains. There will probably a lot of outcries over rejected questions.We currently have no hope of ever emptying the close-review-queue, so a queue for all questions by new users may be too much to handle.
I hope that with the proposed gamification we would attract enough reviewers to keep the size of the queue short. And if we automatically publish questions that were in the queue for 30 minutes, then the worst that would happen is that some users would have to wait half an hour for their answers.It is not that different from the current system. We already review all questions and close the ones deemed bad; and we ban users with excessively many bad questions. The only difference is that currently everyone can participate in the review of every question, and the proposed system adds a lot of complications on top of that.
However the current system is not working as intended. Bad questions do not reliably get downvoted or closed, often they get answered instead. The number of views on bad questions is staggering. If we could concentrate all these views on better questions instead, we would improve the overall quality of the site.
Related proposals: I hope this theme has not been beaten to death before. I could find no direct duplicate, the closest I could find was the question "Why not peer-review all new questions". However that question proposes a very different review system based on social networks, that boils down to more specific filters for each user.
Please do not take this proposal as a final draft, more like an early concept; perhaps some ideas in here can be used; most likely not everything as it stands. After writing all this, I am suddenly having doubts whether this could have some big downsides I am not seeing yet.