Is it useful to always flag such questions?
That depends. If the question should be closed, use one of the flags for "this question should be closed." But please do not use a custom flag or inappropriate flag. For example, please don't flag as spam something that isn't actually spam.
Or is it sufficient just to downvote them?
If the question shouldn't be closed but just isn't a good question (lacks research, for example), just a downvote is fine.
Does gratuitous flagging pollute the flag review queues?
Yes, if it's really gratuitous! If you mean, "Does lots of flagging pollute the queues?", then no. Flag whenever appropriate, but be sure you use the right type of flag. Don't use a custom flag, for example, if a standard flag will do.
Also is it harmful to answer such questions? (Which I did.)
If it is a bad question, but not one that should be closed, it's fine to answer. I have answered a lot of questions that I also downvoted. But if it should be closed, then answering is wasting your time, at best, and encouraging more bad questions to boot. In other words, flag or answer, but don't do both.