The purpose of comments on a question it to gather further information from the user asking the question. @deceze writes in this meta post that the:
purpose of comments is to provide feedback to a question or answer with the goal of improving it. Once this improvement has happened, the value of the comment is nil and it can be removed.
I agree on the purpose of comments, but I don't agree that they should be removed or that their value is now nil.
Comments can serve as a paper-trail for other users having the same problem as the original question poster, as different users ask for further explanation into the original question, try to confirm certain aspects of the problem, etc. Removing comments may stop new users from fully understanding the complete solution.
I suggest that instead of completely deleting comments, that admins, mods, and users can only choose to hide the comments. This way other user who want to see what was previous said can do so.
However, I'm not sure what to do about comments that ignore community guidelines and rules. It's possible that simply hiding these type of comments might not be enough to stop spammers, etc.
Thoughts?