I'm the one who marked the flag in question as Helpful. As I think has been covered above already, the invalidation was automatic. Moderators actually cannot invalidate (or even see) individual votes. When I reviewed your flag, there was one thing I could do; check the relevant information moderators can see, and take appropriate action as far as notifying/warning/whatever. I took that action, and noted that what you reported was correct, so I marked it as Helpful.
I always caution against assuming anything about who voted, including extrapolating from known information. Yes; five votes in tight series, combined with three of those votes being invalidated, strongly suggests the other two may have been from the same person. But it is absolutely possible that's not the case.
In fact, I've seen a couple cases where the information available to me (perhaps after auto-invalidations, coupled with account deletions, user admissions, etc) showed clearly that the "other votes" came from someone else. Those two cases give me pause with these things, even.
That said; I do still wonder if there is some hole in this sort of thing. The exact invalidation algorithms are (properly) kept private - even from moderators - so I really do want to be careful. It's entirely possible there's something else here that makes what happened a "correct" action.
But I think this may justify a mention to the CM team, so they can have the appropriate splines reticulated, if reticulated, they must be. I would not expect any specific response back about this, necessarily, but I am mentioning it to the team to consider, just in case there's something here.