I just participated in a survey from Stack Overflow called the "comment-classification" and would like to share a couple of thoughts.
For those who were not invited:
- See https://stackoverflow.blog/2018/07/10/welcome-wagon-classifying-comments-on-stack-overflow/
I was presented with the comments on the questions of new users and was asked to rate the comments as if I was the new user and was reading the comments on my question.
Ratings to choose from:
- "The comment is fine",
- "The comment is disrespectful, sarcastic, or otherwise unfriendly." or
- "The comment is abusive or contains harassment."
The comments were batched per question and did not include the text of the question (Just bare, anonymised, comments).
Thoughts/findings:
- I did not mark any comments as "The comment is abusive or contains harassment."
- Of the comments that I marked as "The comment is disrespectful, sarcastic, or otherwise unfriendly." I would consider none as disrespectful nor sarcastic.
- Nearly half of the comment were from the OP; this makes the question "Imagine that..." a bit strange: I am commenting on my own comments.
- There are an awful lot of comments (over 50% easily) that should not be there (answers, discussion)
- The survey did not allow me to skip a comment when classification would require the context of the question.
These findings make me second guess whether or not the effort should be put into "making comment friendly again".
That call is not up to me but I would argue that the quality of the Questions and Answers would greatly benefit from turning comments that should be answers into answers, and moving discussion comments to chat. Perhaps we should focus on that.