We are software engineering researchers. We recently conducted a study on Stack Overflow question comments (Using the Dec. 2021 datadump with more than 40 million comments for questions). Below are some of our major findings. Please share your thoughts on our findings and share your own experience of using the comment section of questions on Stack Overflow.
We studied when and how much people comment on questions
- The proportion of questions with comments have increased by year; for example, ~30% of questions posted in 2008 have comments, and ~60% of questions posted in 2013 have comments. Of course, a question posted in 2008 may receive a comment many years later, but the data shows that comments are most commonly posted very soon after the original posting of the question.
- Comments can occur even after a question is solved! In commented and solved questions, 19.4% of questions received their first comment after the accepted answer was posted. We think these comments may highlight important information in the question such as false information, improper assumptions, or obsolescence.
Based on our findings, it seems like commenting on questions is actually pretty common and can happen at any time during the question and answering process. Currently, comments have several functions as suggested by their prevalence; people use them to discuss with each other and share additional information. We think there exists an opportunity for a better design of the system to separate the functionalities. For example, we can add buttons to report false and/or obsolete information. Then reported content can be reviewed by other members of the community. More interestingly, there could be automated summary tools to summarize the comment content so people won't miss what's in the comments if they are really crowded (hey, by default SO only shows 5 comments).
We looked at the users who comment on questions
- Lots of users comment on questions! The number of users who comment on questions is of similar size to the number of users who answer questions.
- Askers and answerers have a high appearance in the question's comment section. (When more than 5 comments are present in an answered question, 90.3% of them have askers in the question's comment section and 51.9% of them have one of the answerers in the question's comment section.) We think this suggests that people are leveraging the comments to communicate with each other when the question is hard to answer in the first place.
Given that many people are using comments essentially as an interactive way to answer questions, can another way of Q&A happen on Stack Overflow, where people ask and answer questions in places like chat rooms and later they can organize the Q&A section into dedicated questions?
We also discovered some relationships between question comments and other activities
- Questions with more comments are edited more
- Questions with more comments before answers are answered more slowly.
Please let us know what you think of our findings and share any experience whether positive or negative regarding your experience of posting comments on questions.