I like the idea. It would be a good tool for guiding new reviewers, and enable others to ask someone for their reasoning without starting a Meta topic about it.
Rather than comments, how about an embedded chat? It could be archived as flat HTML in line with the edit record after a certain time of no activity. This way, one could ping other users to join a discussion, if necessary. The chat instance could be lazy-created, if the tab said "Start Discussion" until the first person initiates it.
Here's a mockup of a close vote, with a new "Discussion" tab.