Comparing things fairly is hard, and someone having the necessary subject-matter-expertise to do so is rare (and other problems)
*Obligatory link to https://isocpp.org/wiki/faq/big-picture#lang-comparisons, quoting Bjarne Stroustrup's response to being asked to compare C++ with other lanugages in his book "The Design and Evolution of C++":
Several reviewers asked me to compare C++ to other languages. This I have decided against doing. Thereby, I have reaffirmed a long-standing and strongly held view: Language comparisons are rarely meaningful and even less often fair. A good comparison of major programming languages requires more effort than most people are willing to spend, experience in a wide range of application areas, a rigid maintenance of a detached and impartial point of view, and a sense of fairness. I do not have the time, and as the designer of C++, my impartiality would never be fully credible.
I also worry about a phenomenon I have repeatedly observed in honest attempts at language comparisons. The authors try hard to be impartial, but are hopelessly biased by focusing on a single application, a single style of programming, or a single culture among programmers. Worse, when one language is significantly better known than others, a subtle shift in perspective occurs: Flaws in the well-known language are deemed minor and simple workarounds are presented, whereas similar flaws in other languages are deemed fundamental. Often, the workarounds commonly used in the less-well-known languages are simply unknown to the people doing the comparison or deemed unsatisfactory because they would be unworkable in the more familiar language.
Similarly, information about the well-known language tends to be completely up-to-date, whereas for the less-known language, the authors rely on several-year-old information. For languages that are worth comparing, a comparison of language X as defined three years ago vs. language Y as it appears in the latest experimental implementation is neither fair nor informative. Thus, I restrict my comments about languages other than C++ to generalities and to very specific comments.
Any such question would need to be focused to a single (or very small set of meaningfully related) objective evaluation criteria
That aside, if the concern is about having an unbounded scope of things to compare between two different things, then that should be addressable by insisting that questions focus on a single, extremely focused criteria that can be objectively evaluated between the two. In relation to this, see /help/dont-ask.
Note: Bjarne's concern about focusing on a single application isn't as much of concern on SO, I think, where more specific focus per-Q&A is generally desirable.
N choose k
(or worse) sounds like a recipe for a information fragmentation, duplication, and maintenance nightmare
My concern is with scaling and fragmentation/duplication of information.
If you have N
things that can be compared, and you allow up to k
things to be compared at a time in a question post, this scales as the sum of N choose k_i
over k_i in [1,k]
, which is just... really not great. Like- where do you draw the line? If something changes, how many Q&A pairs need to be updated? How many times will the same thing be said between those? It just sounds like a lot of maintenance burden.
... except if k = 1
What has worked so far and that I think does scale and doesn't (comparatively) face problems of fragmentation/duplication of information is to draw the line at k = 1
. That's right- just ask a question about how a single thing fares at doing a single thing. If we can focus on that and do a really good job at it, then at least on paper, a reader should just be able to search for and read k
Q&A posts.
Doing a single Q&A about evaluating one thing against one criteria is often hard enough (which is why we have the guidelines for constructive subjective Q&A in /help/dont-ask).
k = 1
being the norm, filling in specific gaps with k > 1
sounds fine to me
If there are specific gaps after good answers have had some time to roll in to those k = 1
questions that need dedicated attention and explanation to be filled in, then questions can be asked about the specific gaps. The nice thing about that approach (on paper) is that then the specific questions will be informed by existing Q&A, and there'll be less basic groundwork info to fill in readers on. The k = 1
questions would be the pre-readings.
On the value and potential problems with k = N
I also recognize that having a single Q&A for k = N
- basically a high-level overview thread could have its usefulness, but there are a couple problems I can see with that (and probably more I haven't thought of):
that it could be wading into the "you could write a whole book about it" territory
deferring to the isocpp link I put at the top of this answer post- particularly the point that the more things you want to compare, the rarer it is that someone actually knows enough to give a fair comparison- though that might be a non-issue if all the k = 1
Q&A are really really good: Someone could go and read all the k = 1
Q&A and maybe through that become informed enough to do that, but...
N
tends to grow. What do you do when a new solution rolls in? What if N
is just stupidly big, or that nobody even knows how big it really is? It's not that it's impossible to keep this constructive, objective, and up to date, but... it does sound like a lot of work. And who would own the answer(s)? The original authors? Then either it's left up to each author to keep their posts up to date and be aware of a potentially very broad landscape of technology... forever? or others edit new info into their post but the original author gets all the rep, or it's community wiki, but then I'd feel a little uncomfortable about who's vouching for the accuracy of the info. Maybe the answer to this is that trying to do this would just not work very well.