This is not a problem for Stack Exchange to solve by trying to come up with more rules and guidelines. This is a problem for the community to solve.
The tooltip for the downvote button on an answer explicitly says "This answer is not useful". So if it solves a problem in a way that is not useful to you, then it is by definition "not useful" and you should have zero problems downvoting it.
In addition to choosing to vote or not vote, you can simply leave a comment that says:
While this answer may solve the problem for x
calendar system, it is going to fail (or be incorrect) in other cultures because of y
.
Then leave an answer of your own (if you have an answer) on how to solve the problem in a more generic method or for another culture that is not covered in the existing answers.
However, one thing to keep in mind before you cast that vote, is keep in mind what the original question was asking. If the original question asked about a specific culture (or a general idea of the culture involved can be extrapolated from the content of the question), it is probably a bit unfair to expect someone to write an answer to cover every possibility. Doesn't stop you from commenting, if nothing more than to help future users see the limitations of the answer.