Sometimes a question is clarified ( rarely ) after a duplicate closure, and the clarification is still a duplicate just of a different question.
A more common case is sometimes you copy paste the wrong URL or find better duplicate afterwards or someone that can't vote to close points out a better target when closing as a duplicate and need to change the target.
Right now, if you remove the duplicate closure you lose your ability to vote to close on the question again for the new ( or better ) duplicate target.
At some kind of least grace period like on editing comments would even be acceptable, because people are pretty quick to complain about duplicate closures.
We need a way change the duplicate target question without reopening the question to answers.