There's something of an ongoing struggle here on SO but also on many sites - this struggle with duplicate questions and disagreements between high-reputation users about when a question should be answered and when it should be closed. This is, I think, often tied to this concept we have of questions needing to have value to more than one person, askers needing to put in a good amount of effort to self-solve prior to asking, and wanting to save the work of people by not needing to answer every question every time it's asked here.
These are important central concepts here but I think we should also consider "everything in moderation" to some degree. If an answer gets so bulky that it takes a long time to actually find the answer you need then it's not really very much more helpful than digging through 50 pages of documentation - we just happen to have it on SO so that you can dig through it here rather than there.
Friction points for duplicate questions
Before I talk too much about canonical questions I want to think about duplicates from the asker and curator viewpoints. I will admit that my experience here is largely anecdotal other than having my one and only SO question briefly closed as a duplicate of a canonical regex question and strongly disagreeing with that closure. So I will say that I've been following along to the discussions here for a bit about the issues related to this and thinking about it a lot.
For the askers, the experience of having a question closed at a duplicate can go a number of ways (assume that there's many I'm missing):
- Hey, that solved my problem, thanks!
- That doesn't answer my question. (it actually doesn't, it's just a wrong duplicate)
- I don't understand how that answers my question. (often due to the asker being new to the technology and not knowing how to understand what may be a very complicated explanation)
- How the heck am I supposed to find my answer in 16 pages of text?
While this question generally focuses on the last of those, I think that duplicates are part of a bigger issue. And, of course, this doesn't take into account cases where a duplicate attracts a ton of downvotes.
For answerers and curators, there's a different set of considerations (there may be more I'm not listing here but these were the ones that came to mind):
- This is an exact duplicate of a question and I can easily link to it.
- This question looks like a canonical question - but it isn't because there's something different about it.
- This question is different but the solution is the same as another question.
- It takes more time to find a duplicate than it does to just write the answer again.
- The canonical answer does address this but I'm not certain the asker would understand it, so I'd like to put it in simpler terms.
- The canonical answer does address this but the answer is so long writing a new answer would make it easier for the asker to find their solution and move forward.
Again, the last one is where the focus of this question lies but addressing it more holistically might be in order here. Here we're ignoring the more social aspects of askers arguing or complaining about closure.
(Aside, for either groups I'm happy to explain these in more detail or, if you have additional ones I'd be interested to know about them)
The first in both situations is the lowest friction for everyone - for the asker, they get linked to a duplicate question that immediately addresses their own and they walk away with the information they need.The rest of the situations all come with an element of friction that can make the situation difficult - often for both parties.
One of the things that I appreciate about the question here and the answers is how much it seems that y'all are aware of the strains on both.
Shortcomings of the duplicate closure system
So, why do those strains exist? I'd say that a lot are caused by our system not having a great way to handle duplicates that allows close voters to help the asker with their specific problem. And this occurs even when there isn't a canonical duplicate.
This is a primary concern when it comes to these encyclopedic canonical answers. If an answer is 20k characters and my specific question is answered in a 200 character snippet somewhere in the middle, it's kinda painful to be pointed at the canonical answer as a whole and tasked with digging through it - keeping in mind that if I understood my problem, I might have found the answer without having asked the question - so even if the canonical answer has great headings to help me find my section, I may not know what I'm even looking for there.
The solutions available to a close voter in these cases are:
- Close and leave a comment that either contains a quote of the specific solution or points to where on the page it can be found.
- Answer the question with the specific solution (and either vote to close as a duplicate or not)
- Just close the question as a duplicate and hope they can find the right section on their own.
I've seen the first option used from time to time and it's generally pretty helpful, though it can add to that meme of "the question was closed as a duplicate and answered in a comment". That's not necessarily a terrible thing but it can look to users unfamiliar with our platform like comments are a place for answers.
The second option can be wrought with pain for the answerer - some go out of their way to discourage answering close-worthy questions and it's not uncommon for people to experience cognitive dissonance when a question is answered and voted closed by the same person. That said, within how our platform currently functions, this may actually be the closest to best solution for these cases. It both helps the asker with their specific question without looking like we're abusing the system.
The third option is the lowest effort on the part of the close voter but leaves the asker's fate uncertain. While we do want them to put in some effort, we also recognize that the answer is big and they may struggle to find what their specific answer.
So, are canonical duplicates good?
Like most of the answers here, I think it depends. I've created canonical answers on sites before and benefitted from others, so I know that they can be of value but I think that value is generally found in a few cases, either in conjunction or alone:
- The answer is relatively short. It only takes a few minutes to scan the information. The site is saving a potentially large number of questions but the answers to each of those questions would be short and might even answer each other. The easiest example for me to grab is one I created on Arts & Crafts. The entire answer is very compact and easy to search - even more so now if I were to convert it to a table, now that we have them.
- The answer is easily searched based on terms the asker already knows. These answers may be long but they don't require specialized knowledge to find the answer needed. There's not necessarily a ton of text or explanation. One of my favorite canonical questions is like this - it's the question on Cooking about cooking terminology differences between different English variants. Even the most beginner cook trying to understand what "rocket" is in a UK recipe will be able to search "rocket" on that page and find that it means "arugula" in US English. The page is also sorted into sections by type of item.
- Instead of one answer, there's multiple curated answers with anchors in the question. This is most commonly used on meta in my experience for things like FAQs. This style can make it much easier to help a user get to their specific solution because a close voter could link to the specific short answer directly rather than the 20k character behemoth. Here's an example on MSE about moderating chat.
I understand that the concept of #3 is a bit of a departure from our existing format and, in fact, the guidance for the Wiki lock tool specifically recommends that all of the content exist in a single answer that is community editable but, while I agree that preventing new answers is beneficial in many cases for these sorts of questions, I don't think that trying to compress all of the content into a single answer - particularly when we don't have page anchors within posts - is great for these long answers.
What I will say is that I feel pretty strongly that helping askers find an answer is the right thing here, rather than just getting rid of canonicals because they're just dumping grounds for bad questions - the reasons people are asking these questions so frequently is because they are all struggling to understand something and, while an experienced dev may find this easy to diagnose and fix, people who are new to programming entirely or to a language in general are very likely to run into this issue. As a place that's supposed to serve as "a library of detailed answers to every question about programming", not having an answer about these very common issues seems to go against that purpose.
These canonical answers are often the most detailed and in-depth guides to this around and are, if someone took the time to read them, excellent resources - as you say yourself
On the other hand, the answer's thoroughness means that almost anybody with an NRE who does take the time to read through it, should find a solution to their problem.
As such, I think the issue isn't that canonical posts are useless, but that we don't do a good enough job of helping users make use of them.
How can we make canonical posts more useful within the current system?
I think getting them into alignment with the three points above would be a good place to start and they all work with the current system. Now, the type of information you're trying to capture may likely make 1 and 2 impossible but, through some effort, converting to type 3 may be possible and lead to easier usage.
In some cases, the canonical just got too broad, as BoltClock said and a good trim may help bring it back to usefulness. Get it back to the heart of the question and let caveats be handled in other places. Or, consider breaking it up into several questions that focus on specific things. These are still canonical but they're more refined and honed.
Do actually clean up and remove superfluous answers - while I have already said that I think compressing everything into one answer is a problem, leaving a bunch of partial or duplicate answers is a problem, too. That null pointer exception question has 28 undeleted answers - that seems like a lot for a canonical question - now, I can't judge if they're all still necessary but I'm sure y'all can.
When you vote to close something as a duplicate, do your best to help the asker find the part of the answer they need so they can more easily identify which of the myriad solutions in the answer is their solution. Remember that they may not be able to recognize that on their own. How you do that is, of course, still complicated as there are things to be aware of if you're answering or leaving a comment to get their situation solved.
What could potentially make them more useful but would require feature changes?
Y'all probably have a longer list of these than I do but here are some that I think would help - do note that me listing them here doesn't mean we're going to build them but they're ideas of things that might be worth discussing - I'd be interested to see if you also think they'd be of value
- Supporting page anchors in Markdown. My understanding is that MD doesn't natively support these but that adding support to some degree (using headers) may actually be possible already but there are complications regarding the same headers being used in multiple posts and that sort of thing - not insurmountable but would require some thought. This would allow someone to link to a specific solution really easily without having dozens of answers.
- Supporting some sort of way to highlight or quote text within a duplicate target that specifically addresses the question asked. This would allow close voters to indicate the part of a very long answer that the asker should pay close attention to - Tim Post had mentioned this idea a while back and called it "Answering as a duplicate".
- Making upkeep of canonical (wiki?) answers more rewarding by sharing reputation with the top contributors to that answer. While many curators don't need additional reputation, this might be a way to incentivise improvements to these answers.
- Finding ways to simplify the cleanup of existing Wiki-locked canonical posts so that curators can strip them down to their core answer and make the whole thing easier to follow.