As a Stack Overflow user, I find that sometimes an interesting question may get an answer very fast (within one hour). But I also find many interesting questions that take a long time to get an answer (or may not even be answered).
I did some analysis on what factors impact the speed of getting answers. I analyzed around 60k questions which have at least 1 score and accepted answer from Stack Overflow and around 80k questions from other three sites (i.e., Mathematics, Ask Ubuntu, and Super User). Basically, I find that many of the interesting questions that took a long time to get an answer are answered by non-frequent answerers (i.e., the users that answered less than five questions).
Below I share some points I observed in detail:
- Because I find that many interesting and useful questions take a long time to get an answer, I did some data analysis to understand the potential reason. I calculate a couple of metrics, including the metrics related to the question (e.g., the length of question), the asker (e.g., the reputation, activeness), the answerer (the time to answer a question in the past, number of answers posted in the past), and the answer. Then I build a classification model where independent variables are the metrics and dependent variable is the speed of getting accepted answer for the question to understand which factors have most important contribution on the speed. Basically, I want to see which factors are more correlated with the question answering speed. Here is the link of the data[http://sail.cs.queensu.ca/replication/AnswerSpeedStackExchange/data.zip]. I analyze more than 40 factors that I can think of and did some statistical analysis to control for confounding factors.
The non-frequent answerers (i.e., the users answered less than five questions) help answer most of the slow-answered questions. The table below shows the mean and median time to answer questions.
I find that the questions that are answered by non-frequent answerers are as important as the ones that were answered by frequent answerers (i.e, the users answered at least five questions), and some questions even more complex (in terms of length). The table below shows comparison of the score of the questions that were answered by non-frequent answerers and frequent answerers.
So as a Stack Overflow user, I really want to see some interesting questions get answered faster (e.g., perhaps in days instead of weeks or months). These non-frequent answers may not be active enough to spend time on the Q&A websites in search of questions to answer. However, such non-frequent answerers are important for the community since they have their own expertise to answer some very specific questions. In additional, slow-answered questions are likely to remain unanswered if they were not answered by the non-frequent answerers (and old questions got buried very quickly by new questions). Anderson et al. observed that the answerers on Stack Overflow are organized like a latent “pyramid” with active answerers at the top. Once questions are created,frequent answerers, who are active on Q&A websites, would try to answer the questions according to their expertise. However, the remaining questions would need to wait for another set of answerers (i.e., non-frequent answerers) to answer. In other words, such slow-answered questions, which probably require unique expertise, could only be answered by such non-frequent answerers.
Based on the findings, I wonder if Stack Overflow should consider improving the way of delivering the questions to the right person, e.g., recommend questions to users since most of users search based on browsing tags how active users find questions?. Or do you have any thoughts about how to improve this?