So, I noticed earlier on Stack Overflow while writing a comment in reply to an erroneous comment to my answer that was deleted while writing the reply, but the site had not notified me.
I posted a reply and in the meantime a comment from the same (probably replying about what I had just said to a now non-existent comment) user posted apologizing for the confusion, and I posted my comment. I quickly removed my reply to his now non-existent comment and was going to leave a different one, but then his comment was deleted in the meantime -- which I accidentally replied to as well and had to quickly delete!
It's a bit of a usability issue that caused a slight ping-pong of comment creation and deleting that was confusing to say the least. Granted, it is a bit of an edge case where both users need to be active and looking at the same issue at the same time, but I still think there should have been something to notify me that a comment that I may have been replying to was just deleted (or even edited?) while I was writing one.
Perhaps it did give me a notification, but I simply had not seen it. Sorry in that case!