Currently, unless I'm missing something, you don't seem to get the close vote back when you retract it. You also don't appear to get the vote back when a question that you voted to close is deleted. However, you do get the downvote back when you retract it or the question you downvoted is deleted.
Is this a bug? It seems like they should behave in the same way.