Let me talk about this specific case first, before addressing the more general question. The moderator's attention was drawn to this question by the fact that a flag was cast on the answer there. The reason for that flag was that four normal users voted to delete the accepted answer in review. Before the nice edit by Palimundo, that answer wasn't the best.
That caused the moderator to examine the question itself, and while the question is about a developer tool, it is asking about a potential bug in a beta version of that tool. It used to be standard procedure to close such time-specific questions about beta tools as "too localized", but that close reason was removed a little while ago. Many of these type of questions still get closed because there's some debate as to whether they fit here (although the consensus seems to now be that they can be appropriate). I think that was the reasoning here, not that the question about the tool itself was off-topic.
As pointed out, it was reviewed three times and in all three cases community members agreed with the close decision. Even if your proposed system for punishing moderators was in place, it would have made no impact here.
If you strongly disagree with a unilateral close vote by a moderator, you can use an "other" flag and explain why you believe a mistake was made in closure. We overturn close votes by each other all the time in response to such arguments, so one moderator's vote isn't the final say on anything. We all have different areas of expertise and different opinions on what is and is not appropriate for the site. We're not afraid to confront others about why they voted to close or delete something on the site.
You can also make an argument on Meta for something to be reopened. You put forth a good enough case that five members of the community did decide to overturn the moderator and reopen the question. I consider this the system working fairly well, and see no need for an additional layer of complexity to be added on top of that.