I found a case of robo-reviewing in documentation.
A few examples:
- https://stackoverflow.com/documentation/proposed/changes/50840?draftId=43301 has discussion, someone rejected, he approved
- https://stackoverflow.com/documentation/proposed/changes/52525?draftId=44551 has discussion, someone rejected, he approved
- https://stackoverflow.com/documentation/proposed/changes/52920?draftId=45100 has discussion, he approved
- https://stackoverflow.com/documentation/proposed/changes/46959?draftId=39896 has discussion, someone rejected, he approved
- https://stackoverflow.com/documentation/proposed/changes/44096?draftId=38161 low quality, wall of text, he approved
- https://stackoverflow.com/documentation/proposed/changes/42237?draftId=36662 factually incorrect information (under
An exploit using the $_GET request
title), has discussion, he approved - https://stackoverflow.com/documentation/proposed/changes/39125?draftId=34301 duplicates all examples, has discussion, he approves
- https://stackoverflow.com/documentation/proposed/changes/38312?draftId=33760 irrelevant information, he approves
And that are only the first 2.5 of 7 pages of his documentation backlog
Most approvals are fine, because the content itself is fine, but there are disproportionally many bad approvals in here.
This is especially problematic with most proposals just needing a single approval and often being longer around (as there are discussions needing to be resolved first) and thus robo-reviewers being able to actually do harm.
I maybe do a lot check the backlog of proposals (to check nothing gets wrongly approved), but I also don't catch everything and miss a few bad reviews … a bad rejection is not that bad, but a bad approve is much worse for the documentations quality.
What can I do about them and what shall be improved in the system?
I currently have a feature-request: Documentation proposals: There are comments, please do not approve straight ahead! but this only will mitigate the issue a bit.