No it isn't, but the only way to prevent that kind of thing is to respond to such comments very shortly.
When you ask a question, you can't just go grab a beer or something, you must follow it in the following minutes to be able to respond to comments. Nothing annoys commenters most than a non-responsive OP.
That also applies to "possible duplicate of...". If you do nothing, some gold badge user will probably hammer & close it.
You have to "defend" your question with a comment, pining the person who proposed the duplicate, and also edit your question as the banner suggests (other users often defend the question if it was clearly wrongly flagged)
If your arguments are convincing, the people reading your comments & the person which flagged/voted to close will retract the close vote (same applies when a question is hammered, you can still ping the user who hammered/closed)
Also note that the "this question has already an answer here" banner is visible only to you until it's closed. Others just see a "possible duplicate of ..." comment, so it's not visually as imposing.
For me, the issue is often the other way round: a lot of potential answerers quickly answer, ignoring the "Possible duplicate of" comment, just to get easy rep just before it's closed...
The downvote is sometimes a side-effect of the "roomba" system: if the question is downvoted & closed as a duplicate without answer, it will be deleted automatically, so some people vote to close/downvote and move on. If your question is good you'll even get "corrective" upvotes.
So if the proposed answer answers (which can happen, actually!), then just close it yourself (will be marked "closed by Community")
If it doesn't:
- stay connected to respond to comments
- edit your question & ping the people who voted to close as duplicate
- It's tempting but don't repost another similar question, as you're liable to another close, more downvotes & possibly a moderator flag.
If your question is closed, editing it puts it in the reopen queue, so it can be reopened if the edit is substantial.