Typically, downvotes on Meta signify disagreement. From "What's Meta":
Unlike normal Stack Exchange sites, Meta invites the community to discuss, debate and propose changes to the way the community itself behaves, as well as how the software itself works. On posts tagged feature-request, voting indicates agreement or disagreement with the proposed change rather than just the quality or usefulness of the post itself.
(Emphasis mine.)
Note that voting on Meta is supposed to work that way for feature-requests, but it has become more or less the same voting culture for all types of posts here. I could speculate on the reason why, but it's not really worth it; it's likely some combination of there being no reputation effects and the subjectivity of nearly everything asked here.
Also, a lot of people have already done so, and there's no need to go into it any further than they already have.
What you should take away from this is that voting on Meta defies reason, and no one is forced to explain the way they vote. Posts being downvoted on Meta is nearly an inevitability due to the smaller size of the community and its collection of highly-opinionated people, so you don't have anything to worry about unless your total score drops below -5; however, if you truly want to take it into your own hands to improve your post with any feedback given to you, you definitely should.