No, you do not need to be careful. If in your opinion a question satisfies the criteria for upvoting, "This question shows research effort; it is useful and clear", then you should upvote the question.
(As a sidenote, the criteria for downvoting a question is the negation of the criteria for upvoting, "This question does not show any research effort; it is unclear or not useful".)
There are three parts to the upvoting criteria:
"This question shows research effort" (emphasis added).
I interpret this criterion and the use of the word "shows" to mean that in some way the text of the question demonstrates (such as by citing or linking to an authoritative source, or mentioning an approach that has been tried) that the asker of the question has put some effort into answering the question for himself/herself.
This criterion should weed out the questions that can be answered with a few minutes of searching the Internet, Stack Overflow, or relevant documentation, because these questions typically provide nothing to show that the question asker has researched the problem.
"[the question] is useful"
This is the criterion that I think is the most difficult to apply because you can't definitively say whether the question is useful in general. The question is hopefully useful to the person who asked the question. However, unless the question is useful to you personally, you cannot say that the question is useful to someone else.
Perhaps the "it is useful" criterion is best evaluated by considering whether the question is on-topic (as in, useful to the site by virtue of being on-topic), and the question is not likely to be a duplicate.
"[the question is] clear"
I interpret this criterion to mean that the post appears to include enough detail for someone to be able to provide a good answer.
In addition, I partially agree with CodeCaster in that you should only upvote a question if you are familiar with the problem space.
I tend to be more liberal in upvoting questions. To justify my position, consider:
Upvoting a question provides only +5 reputation.
I know that some people adopt a strategy of asking many poor questions in order to gain reputation. However, you can usually determine whether someone is doing this by looking at their question-asking history. And, if someone's goal is to gain reputation as quickly as possible, it is far more lucrative to write answers, especially for unanswered questions with an active bounty.
The criteria for upvoting a question does not require you to "thoroughly check" the question.
Upvoting a question that in your opinion meets the criteria for upvoting, but which in actuality is a bad question, is not nearly as harmful as upvoting bad answers.
Per one of CodeCaster's comments, it should be noted that if you tend to upvote questions that have been downvoted by others, then you may need to reconsider how you decide whether to upvote questions.
In order for there to be good answers on Stack Overflow, there must be good questions.
From my experience, it is very difficult to ask a question. Many questions can be answered for oneself with a few minutes of searching. A significant portion of the remaining questions can be answered by searching and reading information on related topics, or perhaps by reading source code. The remaining questions are usually too broad or too narrow in scope to be useful on Stack Overflow. Thus, to someone who is trying to ask good questions on Stack Overflow, very few questions are candidates for questions on Stack Overflow.
When such a rare candidate question comes along, it is a fair amount of work to write the question on Stack Overflow. At least, it is for me. It is necessary to write the part of the question to "show" research effort. It may be necessary to provide context. It may be necessary to prepare a code sample, properly trimmed to remove irrelevant details. All of this work for not much benefit in terms of reputation gained. Of course, the real benefit is getting an answer to your question, but it seems to me that this is not as likely to occur if the question receives no upvotes.
You have written that it isn't uncommon to see other questions with better content that no one has upvoted. Isn't the solution to this problem, then, for everyone to be more liberal with upvoting questions?
It really is a bad feeling to put a lot of effort into writing what you think is a good question on Stack Overflow and no one, or hardly anyone, upvotes your question.
There is a Socratic badge that is awarded for "Ask[ing] a good question on 100 separate days, and maintain[ing] a positive question record". As of this writing, only 2,002 people have earned this badge. I have this badge set as my "badge to track" (currently at 88/100), so I know how difficult it is to earn. Compare this with the number of times the answer badges have been awarded (Nice Answer - 591,533 times, Good Answer - 168,409 times, Great Answer - 24,567 times). Perhaps more comparable are the gold tag badge (4.5k times) and silver tag badge (14.8k times).
By the way, for the purpose of the Socratic badge, a "good question" is a question that has received just one upvote.
In my (slightly biased) opinion, people should upvote questions a lot more frequently than they do currently.
I think that it is interesting to examine for oneself the list of unanswered questions with no upvotes: is:q closed:no duplicate:no score:0 answers:0
In the past hour or so of examining questions that appeared interesting to me from their title or tags, I have downvoted 3, taken no action on 13, upvoted 6, and answered 1. I would be interested to know what stats others have.