There's not a lot you can do.
People down-vote for all sorts of reasons, and the reputation cost of a down-vote is more than outweighed by the reputation gained from an up-vote. So as long as your answer is still scoring zero or more you're still gaining rep.
If you're sure that your answers are OK then just move on look for something else to answer.
Moderators can't see individual votes so if someone has down-voted one or two of your posts we're not going to be able to spot it. There is an automatic script that will reverse serial down-votes (and serial up-votes too) which runs nightly. We can see if this has been triggered. If you spot something that looks like serial down-voting that hasn't been picked up then flag one of the posts for us to investigate further.