I don't think it would be right - I would prefer to keep my votes for when I have a reasonably good idea of what I'm voting on.
There are too many sheep around here to just trust that the highest voted answer is correct.
Check out this recent thread for some interesting discussions around the problem that is caused by this type of behaviour: