This is not a rhetorical rant, this is an earnest scream for reform.
Sorry, I tried to make this as short as possible, but it is kind of a complex change that I am suggesting. I probably left out some vital pieces why trying to keep this small.
Why do questions marked as duplicates need to be closed if Jeff Atwood says:
One thing I want to be clear about, though, is that duplication is not necessarily bad. Quite the contrary — some duplication is desirable. There’s often benefit to having multiple subtle variants of a question around, as people tend to ask and search using completely different words, and the better our coverage, the better odds people can find the answer they’re looking for. And isn’t that, really, the whole point of this exercise?
Let's focus on "isn't that, really, the whole point of this exercise?". This incredulously points to a personal and overdue revelation that I've had about what Stack Overflow should be -- "a researcher's paradise".
Right now, Stack Overflow is NOT a researcher's paradise and it doesn't appear to be on a path to this utopia either.
Put yourself in the mindset of a careful researcher:
- Researchers do not care about housekeeping.
- Researchers do not care how old a page is that gives them the best possible advice.
- Researchers do not care who the user is that gives them the best possible advice.
- Researchers want to find the most appropriate page as quickly as possible.
- Researchers want the fewest number of comprehensive pages that most similarly pertain to their problem.
- Researchers want answers to be unique, correct, peer vetted, and ideally be as few as necessary without leaving out any relevant insights.
Let's be perfectly honest, there is a review/curation bottleneck because the number of motivated volunteers with the permission and ability to do these tasks is fewer than the number of users who creating new content.
From what I see, the regulars in SOCVRs are doing a crazily disproportionate amount of the curation work. The bright side of this is that many of the curators there are SMEs in their respective field, qualified to make decisions with very high accuracy, and there is an ever-present, self-scrutinizing culture in the room to keep people honest. Even still, we are trusting a very small cohort, they are woefully outnumbered, they are often negatively labeled as gatekeepers, buzz-killers, narcissistic sheriffs, etc., and occasionally the targets of malicious voting which can skew the perception of good content.
So I am here today to see if I can sow the seeds of a new direction so that:
- duplicate (clear, complete, on-topic) question askers:
- can still receive answers that are specifically tailored to their question AFTER being marked as a duplicate
- will be given no guarantee that their question will have a long life on SO
- answerers who are unaware or don't care about the importance of curation can:
- happily flit from question to question and fire answers as they please without being chastised
- potentially earn rep points in a Stack Overflow where virtually all new questions are duplicates
- answerers who ARE aware and DO care about curation:
- can still effectively mark duplicates without being cursed by the previously mentioned group
- can ethically answer a question THEN mark it as a duplicate in one fell swoop without closing the page
- don't have to spend 10 minutes looking for duplicates before allowing themselves to answer
- will trust that a Duplicate Questions review queue (I have been thinking of it as "The Gallows" while brainstorming, although it's not a very cheerful term) will see the most appropriate handling of the page.
Before I talk about The Gallows, let's talk about why SO isn't on the right path. Currently, SO has a tradition of honoring older content even when the older page isn't great for a number of reasons (vague requirements, no mcve, no proof of research/effort, outdated accepted answer, misinforming vote tally / accepted answer, and more). Some people hold the belief that great answers make a question great -- let's agree to disagree on this. New pages never get a chance to build up their own value because they are closed. I see a protectionist culture that is akin to religions. But science exists in stark contrast -- it perpetually puts itself under new tests and challenges so that it can only evolve into its most refined form. This is the whole point of this exercise. Why not let the new pages challenge the old pages for superiority?
Let's not worry about protecting the oldest pages that have such a gargantuan number of redundant answers that pagination is required. Let's instead, try to build a "researchers first" culture to content curation instead of "elders first".
So, what will be the purpose of The Gallows / Duplicate Questions review queue?
This will behave differently to other queues -- this will be for SMEs / gold badgers in the tags of the questions. It will rely solely on the volunteers who have proven themselves to be knowledgeable and trustworthy. I am SUPER flexible on the actual functions and algorithms to be implemented but the general goal is to give reviewers the opportunity to review, say, 6 questions at a time which are marked as duplicates then vote on which pages:
- are legitimately NOT duplicates and should be ousted from the aggregate
- add absolutely no new value to SO and should be outright deleted
- are most suitably merged into another page instead of being deleted
- should be found first by researchers because they are ideal questions with the leanest, most helpful, most comprehensive, and ultimately most researcher-pleasing (all other non-deleted pages in the aggregate would point to the highest "ranked" page)
Right now, this job of aggregating, comparing, closing, finding the "best" dupe target is being done in a non-democratic way and it can lead to other volunteers calling foul play. By forging a new review queue, the responsibility for curating the best possible pages will be cast to many. For SMEs, this might be just the new and exciting activity that they have been secretly yearning for -- something with real lasting purpose.
This is careful work and there is much to contemplate with this venture. I can think up at least one very predictable and concerning possibility:
What if someone finds a popular page with 40 answers, studies them all, boils down the insights, crafts their own beautiful/narrow/complete question, then posts ~5 answers which eloquently conveys all of the correct/available techniques, even offers technique comparisons, and then marks their own page as a duplicate of the 40-answer page?
- On one hand, the new poster might be hissed and booed by onlookers who see this as overt theft/plagiarism/poaching and wish to see it stomped out.
- On the other hand, the new poster is making life SUPER easy for researchers because the entire page has been crystalized and educationally laid out.
Would our community react to this with disgust? Should it? Might there be any protections/precautions regarding this scenario?
In the end, the new duplicate would be judged on its merit in The Gallows where it would likely be the clear "winner" in terms of total page quality.
Can you imagine a Stack Overflow like this? What concerns do you have?
Oh, and because I didn't explicitly state it, I am suggesting that a page is never "closed" for being a duplicate. Pretty controversial, eh?!?
And one page can be marked as a duplicate of 5 other pages (of which maybe none of them were marked as duplicates previously) and ALL of them would be included in the aggregate to be reviewed. (easier curation)
For the record, I have read associated pages such as: