Problem statement
A large segment of the triage "Requires Editing" votes are simply wrong. The people voting don't understand the essential difference between requires editing by OP and requires editing ... by some random other user to fix minor glitches. As a result: a large number of entries on "Help and Improvement" simply don't belong there.
Which is bad for everybody:
- instead of giving the OP immediate feedback (by closing/putting on hold), the questions sit around for hours, days; before somebody shows up and makes a pointless edit, that makes the question "nicer to read", but still leaves it "unanswerable".
- people taking "help and improvement" seriously ... spend a lot of time not editing, but downvoting questions, and doing the reasonable close vote.
A simple solution
Reorder and relabel the 4 buttons for the triage review:
- Requires Editing by Questioner (was "Unsalvageable")
- Requires formatting improvements (was "Requires Editing")
- Looks OK
- Skip
The new "labels" are just a proposal, better wording is possible. The new order of buttons does (somehow) (imho) reflect the likelihood that the buttons should be used, "Requires editing by questioner" to be the almost default to click.
Why will that work?
While working on my last steward badge on H&I, I did something bad: I occasionally directly contacted triage reviewers who voted "Requires Editing" for questions that were really obvious "too broad" or "no mcve" cases. After doing that like 30, 50 times, I noticed the following:
- most such triage reviewers are relatively unexperienced (new members, reputation between 500 and 2000, rarely more)
- most of them: really didn't know. "I voted edit because, obviously, the OP has to edit the question". "But that is not what edit should be used for!" "Ups. I didn't know that." ... over and over and over again
It doesn't matter that the help text is right there. It doesn't matter that there is a link to more help text explaining that thing. They see the buttons, and click the wrong one.
But please note: 99% of the folks I spoke to, they are eager to improve and do better. The majority of people doing the reviews wants to contribute in meaningful ways. Thus we don't need to look into complicated changes, just make it easier for the average reviewer to do the right thing!
Beyond that
Of course:
- In a reasonable world, the UI team would carefully draft different A/B experiments, and measure how different UIs affect the outcome. But hey, nobody is measuring the effectiveness of these queues in the first place. It even seems to be impossible to remove the pointless VLQ link on the H&I page. So hoping that a real, costly UI change happens here isn't realistic (at least to what I observe: there is tremendous activity around code of conduct, and "being welcoming", but the quality stuff doesn't matter, because that doesn't result in money coming in)
- As said, for me one problem with wrong triage vote is lack of experience. Honestly, I think that only people who have done 50 or more edits (ideally on H&I!) should be able to vote there. And looking a bit deeper, I would even claim that maybe we talk about a 10K reputation limitation on top of that.
Sincerely, GhostCat 8th Steward of H&I