To be honest, we figured someone was doing this, based on the similar kinds of comments being flagged. It's interesting work, but I wonder if it's being applied in the right direction.
It should be noted that the baseline for accepting "obsolete" comment flags on Stack Overflow is 95%, so those are going to be deleted with a high frequency anyway. I bet the same could be said for pure "not constructive" comments, but Jon lumped in "other" comment flags with those in his analysis. I know that we decline "other" comment flags at a much higher rate, because many people use them improperly to flag comments they think are technically incorrect.
I think a better direction for this would be to try to identify "rude or abusive" comments with a high rate of success. I don't really care if a few extra "thanks, that worked well" style comments hang around, but I do want to know if people are being insulted and move on that right away. According to Jon, we have only an 80% accept rate on those, so it would be much easier to see if machine learning could flag those better than the average community member.
While I do appreciate the intent and design of your flagging system, going after slightly noisy but complimentary comments isn't my highest priority as a moderator. There has to be a better way for the community to handle these, or to even hide them intelligentlyhide them intelligently, instead of requiring moderators to step in for each one.