Related: Can a machine be taught to flag comments automatically?
I was thinking about automated flagging and it occurred to me that if an automated flagger can exist and survive, a literal Robo-Reviewer (a reviewer that is literally a robot) could be plausible.
From the perspective of SO/SE policy as interpreted by the moderators, would running a literal robo-reviewer be problematic?
More specifically, would the very fact of having a script perform review queue actions be seen as a violation of the rules of reviewing, or would such a robo-reviewer be held accountable by the quality of its reviews? E.g. if the robo-reviewer was reviewing at least to the standard expected of human reviewers, it would be left alone in peace to rack up badges for its owner, but if not, it (and its owner) would be subject to the same penalties (review bans) for bad reviewing as a flesh-and-blood reviewer would receive for those same bad reviews.
Would it be different if a human were actually looking at each review item, but using criteria other than their own intelligence, knowledge, and skills to perform the review? For example, if a reviewer were performing up to the level of quality expected here, but it became known that the user was rolling DC 10 Low Quality checks (or using a Ouija board, etc.) instead of actually reading the posts, would any action be warranted or would they be left alone to review in peace as long as their reviews did not fall below the quality benchmark?
I'm not asking about the programming feasibility of creating a robo-reviewer of sufficiently high quality to avoid getting automatically review banned due to failed audits or identified by moderators as one who ought to be banned due to blatantly bad reviews, only asking whether a reviewer made of a thousand lines of code would even be allowed within a hundred feet of the SO review queues.
Another way to ask this question is to ask whether the review queues are Outcome Based in the sense that what really matters is whether the correct review action is performed (regardless of how that action is determined by the reviewer - careful study, rolling a die, Ouija board, phone-a-friend, Magic 8-Ball, outsourcing to China, etc.) or whether the process itself matters (must be manually reviewed by a human, account owner must be the reviewer (no outsourcing reviews), etc.). For example, if my past reviews appear acceptable at first glance, but a moderator finds out that I have been using chicken entrails magick instead of my brain to make decisions, would they say "Good on you for finding something that works for you and that produces acceptably high-quality results" or would they be thinking about a review ban "for the principle of the thing"?
Note that I have not actually written a robo-reviewer and am not currently planning to do so - I'm more asking for the sake of knowledge about SO policies and for the sake of others who might be inclined to give a robo-reviewer a try.