There's no rule that coerces when the OP can remove the acceptance mark. There's no flag to be raised when that happens and there is no appeal to be made to the mods. So the OP can revoke acceptance for whatever reason the OP has.
There are situation where I think most people would agree that the mark should be removed from an answer:
The OP later finds that the accepted answer was not helpful after all. Sometimes what appears to be a valid answer is revealed to be faulty only after trying to use it. And, no, the OP does not have to give a reason.
The answer was helpful, but someone posted an answer that was even more helpful. There's only one mark, and no rule that it should be awarded to the earliest helpful answer.
At the same time, irrespective of the fact that the OP is always allowed to remove the mark, there's a social aspect to this. So yeah, there are times when the OP's use of the mark can seem ungrateful, but there is no recourse and, for the sake of your own well-being, it is better to move on.