Look, two things:
RELAX. It doesn't matter. If receiving a few downvotes is affecting you this much then you may benefit from some quiet meditation in the shower (well, that's where I like to reflect, at least) on why votes on this site are such an important part of your self-image. This will help you not just here, but in many areas of your life. Chill out, get a good night's sleep, and move on. Receiving downvotes on an SE site doesn't make you a bad person. It really doesn't. Even if one or two people specifically have it out for you, it's their problem, not yours.
If you suspect suspicious activity, use the proper tools. Flags (a single flag with an explanation and polite request for an investigation is enough), contact support (once) if necessary, and be patient and reasonable. Posting an "answer""answer" to this question in all bold pleading for more help is not one of the proper tools (and really, think about where this anxiety is coming from...). If one user is serially downvoting you the system does have ways to detect that and if it is truly happening it will be dealt with eventually. It's not going to kill you if it takes a few days to resolve. And even if it isn't dealt with, just have a little self-confidence and move on.
Your user profile currently readscurrently reads "This day will never come again, do what make you feel proud tomorrow." So, handle this in a way that will make you feel proud tomorrow.