Let's look at two things here: Why this would be a bad idea, and why this would be hard to implement.
Bad Idea
Downvotes are, like upvotes, an integral part of the quality system here on Stack Overflow. Upvotes are a signal that a post is helpful, well researched, interesting, or otherwise high-quality. They are a signal to other users saying, "Hey, this post is worth looking at."
Downvotes, meanwhile, are also signals to other users. They signal a post is unclear, not useful, wrong, not well researched, or that it doesn't belong on the site. Downvotes on a post are saying, "Hey, there's something not quite right with this content." This lets other users know to avoid that particular post, if they are searching for answers to their own problems, or to stop in and verify what's going on with the question in the case of users trying to moderate content.
These signals aren't just for users reading the posts, however. They are also signals to the poster of the content being voted on. Upvotes tell the OP, "This is what we like to see on the site. Try to keep posting content of this quality." Downvotes are an even more important signal to the OP, however. They say, "Other users feel this isn't up to standards. You should review your post and fix it up if you can."
If we limit downvotes on posts in any way, we limit the signals that we send to users. Not only that, but this may cause an adverse reaction: Users will be less likely to upvote. If downvotes are limited, upvotes become far more important in determining the quality of a post. Users may decide to upvote only the absolutely perfect gems of posts, and not upvote posts that are just good or great.
Hard to Implement
I imagine two ways to try to implement this restriction, if it were decided to implement it: Automatically, and manually through moderators and potentially high reputation users.
If the automatic route were taken, we would have to attempt to find a way to objectively measure how "legitimate" a question is. What would factor into this? Would the question simply have to be well written, with proper grammar? Would the question just have to have been made out of a need for an answer, with the OP having a serious problem? What defines a "legitimate question" for the sake of limiting downvotes? These questions would need to be answered before we could even begin to implement an automatic restriction on downvotes.
Alright, so what about having moderators decide? Well, we have very few moderators, and the site receives thousands of questions a day. It would not be a viable solution to have moderators, or even 10k and 20k users, go through each and every question posted to the site in a day and decide if they are worthy of being downvoted or not. This would also be prone to the human element, as votes already are, and chances are would not end up changing much in the way of how votes are down now. People have varying opinions on what should be up/downvoted, and there's a good chance that their opinions, going through this process, will still lead you to be unhappy with how your questions are being voted.
Conclusion
Really, this is just not going to work out very well as proposed now. It would be hard to implement, and could negatively impact the quality signal of the site. If your questions are receiving downvotes, your first step to stop them should not be to complain or think that they are not legitimate votes, but instead to step back and take a good look at your questions. Are you sure they're following the site standards? Should you maybe double check the How To Ask page in the help center for ideas where you might have gone wrong? Are there any comments asking for more information, clarification, or code? If there are, can you address these in a timely manner?
Don't take downvotes personally. They aren't meant to vote on you, the user, but the content you have posted. Just because you feel your post is gold doesn't mean others see it that way. It can be hard, as humans, to admit that something we've created isn't as great as we originally thought, but sometimes, you just need to take a step back and consider it from another person's view. If you still feel that your questions are up to standards and don't know what you could have done to earn the downvotes, ask for help. Leaving a comment to the effect of "I've reviewed my question and don't understand the downvotes. Could someone give me some insight so that I can improve my question?" could very well get you the information you need to fix things and start receiving upvotes instead.