This is what the top of the list of Top openssl Answerers currently looks like:
For each user, the first column indicates the total score received for answers and the second column is the total number of answers posted for the tag in question. In this particular example, five out of the eight Top Answerers happened to answer a question that turned out to be very popular.
Although the phrase "Top Answerer" can be interpreted in different ways, I think people expect to see a list of experts for the associated tag. The current algorithm of simply counting the score does not provide that; at least not for tags with a low amount of questions being asked. Is it possible to use a somewhat more sophisticated algorithm that better reflects the expertise of answerers especially for low(er) traffic tags? And the list of askers could use a similar improvement.
One comment below suggests discussing what makes somebody a Top Answerer first, what does that mean and what does SO try to achieve with this list? Only after answering these fundamental questions it makes sense to select an associated algorithm.
That is a fair point, although I would like to argue that SO has not given a whole lot of thought to the Top Users list, otherwise its implementation would not be this flawed. A better question might be: what do SO users expect to see in such a list to provide them value, if any at all.
In my opinion, getting a feel for who are expert users for a subject does have value. As an example, I have spent quite a bit of time on the openssl
tag recently because I am learning about it, and answering other people's questions is an efficient way for me to do so. After several weeks of dwelling around, I start to recognize names of high quality contributors. Consequently, I start to pay more attention to what they have to say. This is just a natural filtering process but it takes quite a while before that filter is properly initialized. A well-designed list to Top Answerers would instantly help me with that.
Summarizing, I think a Top Answerer is somebody who has consistently displayed a deep knowledge about the subject. Being a Top Answerer should be a reliable indication of that user having a good reputation.
Since there appears to be a bit of interest, I have created a few queries that show alternative lists of Top Answerers, based on different algorithms proposed by commenters:
- Total number of votes, the current approach
- First order by tag badge, then by total number of votes (my preferred option and further detailed in this joint answer)
- Total number of votes, putting a cap of
x
on the vote score per answer - Total number of answers with a vote score of
x
or higher - Sum of votes per view ratio for all answers
- H-index based on answer scores
score = a * nof_accepted_answers + b * nof_upvotes
, wherea
andb
would have to be chosen properly. Probablya
would have to be significantly larger thanb
.