To quote the help center's explanation on downvotes:
Use your downvotes whenever you encounter an egregiously sloppy, no-effort-expended post
So yes, by all means, such answers deserve to be downvoted. Having said that, if you continue reading that page, you'll also see the recommendation:
If something is wrong, please leave a comment or edit the post to correct it.
The way I get Stack Exchange is that the answers aren't only there to answer the OP's question, but to evolve into a usable, searchable, reference that can help others in the future. While downvoting is definitely appropriate here, it's just half a solution. Unless you comment and explain your downvote, the poster won't necessarily understand what he did wrong, and you're losing out on an opportunity to improve that post.