I think that the current review system offers an awesome opportunity to learn about how people do in their reviews via crowd sourcing. For example, I'd like to be able to see how often my reviews disagree with those of others:
I was inspired by looking at this review task
In case it gets deleted, here is the question that someone reviewed as "Looks OK" (it's in nested quotes because the original was in a single quote)
i was developing
javaSE
application usingnetbeans
, and as we know when we design the frame using netbeans and, once wedouble click
the button, it will generateaction performed
for me bt i want to develop my application undermvc pattern
. i can setup thecontroller and model
in differentclasses
bt that istime
consuming.is there anyframework
which generate mySE application
undermvc
pattern? any help would be appreciate..
Why would someone review this question as "Looks OK"? But that's besides the point. The point is: It should not be that difficult to add a query to look back on our reviews and see "15% of your Looks OK reviews matched the crowd. Maybe you need to be less forgiving?" or "only 71% of your reviews as "close" actually got closed by the community. Maybe you need to leave open more?"
This is related to the honeypot idea but we could be using these stats as a feedback statistic, displayed right in the review queue itself, to try to train people to be better reviewers.
Obviously, this problem would not help with robo reviewers; this problem is for people who are genuinely trying to do the right thing but just need more training.
This is not a duplicate of Show cases when my review differs from the community consensus because this is more about showing statistics when actually in the review queue, not about showing individual reviews when looking at the review history.