There's no way to stop a bounty from being automatically awarded if an answer meets the criteria for it to happen.

It sucks, but that's the way it is.

[As indicated by @animuson](http://meta.stackoverflow.com/questions/260141/how-to-willingly-not-award-a-bounty#comment40552_260141), there's a feature request to make this possible: http://meta.stackexchange.com/questions/166172/explicit-do-not-award-bounty-button