98

Related to Suggested edit queue is full I have noticed in the past few days that the suggested edit queue is almost always full which means that I, and presumably many others, can rarely suggest edits.

Assuming that it is undesirable to prevent users wanting to help improve post quality from being able to do so, what is the preferred way to avoid that happening?

Some thoughts that might be expandable into suitable answers (by others) to vote on are:

  • remove the suggested edit queue limit
  • raise the suggested edit queue limit from its current setting at 200
  • empower more users to approve suggested edits
10
  • 12
    It's a shame of the amount of posts that require editing. Another point to add would be to maybe attempt to educate the author so they do it themselves and do it right.
    – Bugs
    Commented Mar 28, 2017 at 6:24
  • 24
    Another suggestion would be to only edit posts that actually look like they add value to the site. There are a lot of posts that come onto SO which are off topic. If they are don't edit.
    – Bugs
    Commented Mar 28, 2017 at 6:26
  • 25
    Another one is to actually provide substantial edits. I've seen one person thinking it was OK to change I am to I'm on every post they saw which adds to the queue and is a pointless edit.
    – Bugs
    Commented Mar 28, 2017 at 6:27
  • @Bugs Feel free to add any one or more of those as an answer. I think discussion in Meta is better had via Q&A rather than in comments.
    – PolyGeo
    Commented Mar 28, 2017 at 6:30
  • @Bugs I think those second and third suggestions are something that reviewers can already address by simply rejecting such edits. Sure it would be better if they do not reach the queue but once there they should be rejected quickly. I think the suggested edits that take longer to review, and thus contribute more to the queue being full, are those that have had more thought put into them.
    – PolyGeo
    Commented Mar 28, 2017 at 7:08
  • 1
    Some thought: filtrable or multiple queues for edits: meta.stackoverflow.com/questions/345636/… and meta.stackexchange.com/questions/277031/…
    – Cœur
    Commented Mar 28, 2017 at 14:08
  • 7
    That's odd. If memory serves, this queue has been historically empty or very low: meta.stackoverflow.com/q/341675/19679 meta.stackoverflow.com/q/251395/19679 . The others might build up, but the suggested edits queue is usually pretty low because of how quickly these are reviewed. Stats seem to show a decrease in suggested edits over the last month, not a spike, so why the buildup?
    – Brad Larson Mod
    Commented Mar 28, 2017 at 14:37
  • 7
    @BradLarson it's because of the new top-bar which doesn't redirect to this queue automatically anymore: meta.stackoverflow.com/questions/343100/…
    – Cœur
    Commented Mar 28, 2017 at 15:24
  • 2
    Truthfully, I didn't even realise the queue was a problem. Usually if I have time I hit up close votes (currently 9.7k in queue) because I recently discovered it was a problem. Knowing that Suggested Edits also gets full (and that there's a 200 limit) I might look there instead / as well (although I guess more people have access to that queue)
    – Tas
    Commented Mar 28, 2017 at 21:25
  • 1
    There is nothing gamification can't solve (hopefully without too many undesirable side effects). Commented Jan 13, 2021 at 4:54

11 Answers 11

36

The restrictions on the Suggested Edits queue were put in place because there were many bad editors, whose edits were happily Approved by robo-reviewers. There was a feature request on MSE to rate limited edit suggestions, which was responded to.

These restrictions are:

  • At most 200 edits in the queue
  • At most 5 suggested edits per user, 20 on beta sites.

On to your proposed solutions:

Removing the suggested edit queue limit:

The queue could become very big, and it would take even longer for the edits to be handled. Edits need to be handled with a certain amount of speed because they block subsequent edits.

Raise the suggested edit queue limit from its current setting at 200:

I'd be willing to try this. On Stack Overflow, maybe 300 is a good value. We'd need some research, and some trial-and-error.

Empower more users to approve suggested edits:

No. Given the amount of robo-reviewers out there already, I don't want more people empowered to review edits. What we need isn't more reviewers, we need more good reviewers.

Another thing we could do is to make it harder to suggest edits. I've seen plenty of edit suggestions that were just lazy. Like fixing a spelling mistake in a post, but only fixing it once, even it if it occurs several times. This kind of edit is just lazy, and there is no need for this to fill up the queue.

Or, we could limit the amount of edit suggestions per user even further, like lowering it from 5 to 3. But I'm not convinced this will help.

25
  • 1
    Are there any measures in place to ban users for a suggesting edits for any given reason, such as too many rejected suggested edits? Similar to failing an audit.
    – Bugs
    Commented Mar 28, 2017 at 7:54
  • 10
    @Bugs IIRC there are two. Too many rejected edits will cause an automatic edit suspension. And moderators can give edit suspensions manually. Commented Mar 28, 2017 at 7:59
  • 5
    Or, if the problem is small but valid edits, like i->I, punctuation or tag changes, simply make those edits easier to accomplish. Leave the queue for actual, substantial changes.
    – code11
    Commented Mar 28, 2017 at 13:24
  • 6
    @code11 How would you differentiate between a small valid edit, and a small invalid edit? I've seen people try to change "I" into "i". Or slapping textbook meta-tags on as many questions as they could find. Commented Mar 28, 2017 at 13:32
  • 1
    @S.L.Barth another queue perhaps? /s Maybe you don't. Maybe you just allow those changes but don't give rep for them (as determined by characters changed). I have no idea why a tag change gives as much rep as an actual helpful edit, but thats probably the cause of the suggestion queue always being full.
    – code11
    Commented Mar 28, 2017 at 13:34
  • 4
    @code11 If we're going to allow minor edits freely, there should at least be a rep threshold. Or it'll open the floodgates to bad minor edits. As a side note, we used to have a "retag" privilege at 1500 rep, but it was rolled into edit. Commented Mar 28, 2017 at 13:45
  • 4
    @S.L.Barth, sure, but for entirely selfish reasons I think the minor edits privilege should be at 500 ;) In more seriousness, the ability to contribute to triage seems about on par, if not more consequential than this proposed privilege.
    – code11
    Commented Mar 28, 2017 at 13:49
  • 4
    On Stack Overflow maybe 1,000 would be good. 300 is still too low.
    – TylerH
    Commented Mar 28, 2017 at 14:28
  • 10
    @TylerH How is that at all helpful? If edits are being suggested faster than they're being reviewed then increasing the limit will just mean more suggested edits sitting around for longer. It's not actually helping anything, and it's causing harm by locking those posts for a much longer period of time.
    – Servy
    Commented Mar 28, 2017 at 16:02
  • 5
    @TylerH But increasing the limit doesn't actually do anything to change the actual number of edits applied, in the long term. It just means that the queue will fill up, and then once it fills up, you're back to square 1, with the only change being that edits take longer to be approved, and the actual number of edits suggested/resolved staying exactly the same.
    – Servy
    Commented Mar 28, 2017 at 16:46
  • 3
    @Servy I disagree, at least several data points here (various people complaining about it and asking questions on meta as to why they can't suggest more edits or why the queue is full) indicate that it would change the actual number of edits. Sure, a limit of 1000 might be a bit hyperbolic, but the problem is that a lot of edits are made because its convenient for the editor to make them. Rarely will someone return to a question and edit it later if they're stopped from doing so when they try the first time. We miss out on getting these edits at all because of the artificially low limit.
    – TylerH
    Commented Mar 28, 2017 at 19:12
  • 1
    @TylerH But the point is that if there are more people suggesting edits than there are people reviewing them then the queue will just fill up to the 1000 limit over the course of a few days, and then from that point on you have the same problem of people prevented from suggesting edits. It only buys you a few days of time. Once you hit the limit again you're back to only being able to suggesting as many edits as there are reviewers reviewing them, and that number won't have gone up.
    – Servy
    Commented Mar 28, 2017 at 20:26
  • 4
    Prioritize suggested edit reviews based on a percentage changed, under a certain percentage it goes into another pile that doesn't get seen unless all of the more important edits are reviewed. Then make that pile not block edits against their respective posts, and if someone overwrites the edit with a better one, the first edit is just abandoned.
    – user4639281
    Commented Mar 28, 2017 at 23:47
  • 4
    Have there been any considerations for adding a minimum reputation requirement for suggesting edits? Something small, like 10 or 20?
    – Stevoisiak
    Commented Apr 27, 2017 at 16:53
  • 3
    Why can't we add like a simple format button when a user is about to post his/her question? One click and SO will highlight the spelling mistakes and such and then the user can change them. This might stop a lot of unnecessary edits which just fix the spelling and the grammar
    – Caladan
    Commented May 24, 2022 at 4:40
15

It's a shame of the amount of posts that require editing. First point of call would be to educate the author so they do it themselves and do it right. Links to How to Ask, MCVE and to the Tour page are helpful to new users. The opinion I take is, if they can be bothered to read these links, make the recommended changes then they'll get the help. If they don't people should avoid the question. No effort from them equals no effort from us.

What I call pointless edits

As a reviewer you often see edits that are pointless. By pointless I mean changing I am to I'm. This should not be happening and it's those kinds of suggestions we don't want to see. For this, we need to educate people but I fear this is a losing battle. There are always new users wanting to make similar pointless edits.

Editing off-topic posts

This happens quite often. A post comes on looking something like this:

[enter image description here][x]

I have code that shows error. What happening? this is URGENT!!!!

Let's say hypothetically, this post is from a new user asking us to look at some code which they have yet to post. They have included the error as a screenshot.

There are edits that can be made. The question is, should they be made? I don't think they should be made. This post is off-topic under:

Questions seeking debugging help ("why isn't this code working?") must include the desired behavior, a specific problem or error and the shortest code necessary to reproduce it in the question itself. Questions without a clear problem statement are not useful to other readers. See: How to create a Minimal, Complete, and Verifiable example.

Again we need to educate. You could however restrict suggested edits being made on posts that have been closed leaving it to those with full edit privileges.

I've probably made edits to such posts when I was new. You start to become accustomed to how things work by watching others. Now I would leave a comment telling the OP to visit the Help Center (providing links) and I'd flag the post.

Retagging

There are small changes which also end up in the queue. Something as simple as retagging. This can be important to the question. A simple miss-tag can often lead to a question being heavily down voted. They end up in the same queue as suggested edits and can take a while to be processed. A quicker way would be to introduce a queue primarily for retagging which is open to 2k+ users. You could take it further to only allow people with experience in the tag (badges would show this) but I think that would be too restrictive. Is it worth the development time? I'm unsure but it's an idea.

4
  • 18
    Disagri ubout typos bein poinless edets. Typos produce friction.
    – agc
    Commented Apr 3, 2017 at 14:36
  • 3
    @agc that did humour me. Seeing that pop on my phone gave me quite a smile. I am however isn't a typo and doesn't need to be changed to I'm. That being said if you asked a question with that much typo, it would probably be closed as unclear.
    – Bugs
    Commented Apr 3, 2017 at 14:43
  • 4
    Eye all ways lode spell cheque be four eye post two you're cite. Dew knot four get how a May zing are maw dern daze our. Too maw row and bee yonder! Commented Apr 4, 2017 at 0:48
  • 1
    No edits required for you @RobertColumbia that made perfect sense haha
    – Bugs
    Commented Apr 4, 2017 at 5:39
10
  1. Use a separate edit queue for experienced editors. That is, if an editor has a large number of successful edits, combined with a small number of rejected edits, the ratio of both numbers being less than some arbitrarily strict maximum, dub them an Editor, (or some other distinctive name), and put their edits in an editor suggested edits queue that is in some way or other speedier than the ordinary edit queue.

    The theory would be that experienced editors have lower odds of producing dud edits, therefore it saves resources not to perform the redundant labor of checking those edits quite as often.

    OTOH, such a measure would likely make the regular edit queue more tedious to review...

  2. Improve the closing flag radio button menus. Currently there are additional options below some buttons, (and some below those), but the buttons do not make that difference visually clear before choosing a button. Such interface disclarity needlessly consumes user/editor time.

  3. Automate some obvious editing jobs.

    • If a user fails to use capitalization or punctuation, auto reject the message, or auto edit it, and let them check "OK".
    • Same for obvious blocks of unquoted code.
    • Mine editor data for most common unambiguous typos, (i.e. "dont", "im", etc.), and automate rejecting/editing.
  4. Improve editing queue review tools.

    • Automate trivial unambiguous edits, (i.e. s/ im / I'm/, etc.). Mining the queue data presumably would turn up some. Therefore if a user submits one of those, assume it's correct. If that's the only edit, it needn't be reviewed by a human. If there are other edits, process and approve the unambiguous tweaks before the reviewer sees it, to save them the brain cells.
2
  • 2
    IM is often used for Instant Message or other stuff: stackoverflow.com/search?tab=votes&q=title%3aim
    – Cœur
    Commented Apr 17, 2017 at 17:25
  • @Cœur, IM is upper case, and therefore could be left alone. "(Im)mutable" could be parsed by context. Note that an automated trivial unambiguous edit needn't be a universal fix for every possible typo -- all it needs to be is correct for some typos, some of the time, and never or seldom incorrect, or modifiable if incorrect so that it improves its hit/miss ratio.
    – agc
    Commented Apr 18, 2017 at 10:23
8

Agree with S.L. Barth's answer. We need more good reviewers, not more reviewers.

We must find a way to identify good reviewers. And possibly add more weightage to their "approve" or "reject" votes. How about that?

5
  • 5
    So how do you intend to distinguish such reviewers?
    – Servy
    Commented Mar 29, 2017 at 13:54
  • 1
    @Servy I have no answer to that currently. I wish I had one, though.
    – NVZ
    Commented Mar 29, 2017 at 13:57
  • 4
    But to be fair, you can't get more GOOD reviewers without getting more reviewers.
    – SandPiper
    Commented Jun 17, 2017 at 21:25
  • 1
    Maybe let edits from everyone with a Strunk and White or Copy Editor badge regardless of rep skip the queue, or review the edit queue. Commented Feb 7, 2022 at 14:48
  • 2
    How will you incite people to be good reviewers, i.e. how do you define what a good reviewer is and how do you reward them for being good.
    – XouDo
    Commented Feb 14, 2022 at 14:38
6

Has there been any thought into adding a minimum reputation requirement for suggested edits? If the queue is flooded with low quality edits, it may help to add a small reputation requirement of 10 or 20.

6
  • 2
    The whole purpose of having suggested edits is to exist for the sake of people that don't have the ability to edit posts without review. Additionally, while you can run the stats and see for yourself, in my personal experiences, there isn't a super large portion of edits from users with that little rep, and those edits don't' tend to be of any lower quality that edits by users with more rep. If you'd want this suggestion to hold weight you'd want to get stats on how many edits this would prevent, and what the accept rate is on those edits.
    – Servy
    Commented Apr 27, 2017 at 17:04
  • 1
    I don't understand how anybody can suggest edits, but commenting is reserved only to users with +50 rep. So I like your suggestion, and I believe it will prevent all those +2 extra rep unnecessary edits.
    – Alon Eitan
    Commented Apr 27, 2017 at 17:06
  • 1
    @AlonEitan Slight correction. Any user can suggest an edit, but only users with 2,000 rep can edit posts without review.
    – Stevoisiak
    Commented Apr 27, 2017 at 17:07
  • @StevenVascellaro Yep, I know, and just edited my comment about specifically that
    – Alon Eitan
    Commented Apr 27, 2017 at 17:08
  • 2
    @AlonEitan Anyone can suggest an edit because (at least in theory) any inappropriate edits would be filtered out by review. Comments aren't reviewed (and couldn't possibly be, in any practical sense) hence the need for a rep requirement.
    – Servy
    Commented Apr 27, 2017 at 17:21
  • @Servy Oh! Now I finally understand this, up until now, ridiculous limitation
    – Alon Eitan
    Commented Apr 27, 2017 at 17:23
5

Just to fill in on what was actually done, it seems that the review limits were temporarily relaxed so I got 40 per day. Now the queue is back to normal and my quota is 20 reviews per day in this queue.

(Reporting my personal experience; I guess this applied to everyone but it could be that some limits depend on your rep as well?)

2
  • 2
    It's 40 for everyone when the queue is over 150, 20 when it's not. This was changed to being the normal operation. I'd have to track down the meta post announcing the change.
    – Makyen Mod
    Commented Apr 7, 2017 at 4:43
  • 2
    source: meta.stackoverflow.com/questions/319131/… Commented Apr 7, 2017 at 15:20
-1

I think the queue limit should be removed, for several reasons:

  • Incentivizing people to review the queue would be better done in a way that doesn't prevent valid edits from being submitted. For example, a message that appears when the queue is high asking a person to review. You could also go about it in the opposite way - incentivize people to submit more impactful edits. Or editors could check a box signifying a minor edit, which can safely be put off for longer to have a faster turn-around time for significant edits. You could get bogged down on the details of each solution, but the point is that there probably exists a solution that is better than the current state of events.
  • The limit is a solution that is worse than the problem. I'd rather wait longer for my edit to be reviewed than not be able to submit the edit at all.
  • It is a unintuitive and somewhat frustrating experience. The warning message doesn't explain what the limit size is, or where to find the suggested queue. Once you find the queue, there is a good chance that you don't have enough karma to review it, which is doubly frustrating.
5
  • 4
    The things listed in your first bullet point already happen. Otherwise, I agree with you. I see no compelling reason for the system to block edits from being submitted based on some arbitrary criterion for "full". I do, however, think that a per-user limit should be in place, so that a single editor cannot flood the queue with low-quality suggestions before they can be reviewed and rejected.
    – Cody Gray Mod
    Commented Jan 12, 2021 at 6:27
  • @CodyGray Ah, thanks for the clarification. Is there is a badge for helping review a full queue? I didn't see any when I checked meta.stackoverflow.com/help/badges but maybe I'm looking in the wrong place?
    – Almenon
    Commented Jan 12, 2021 at 6:35
  • 3
    Well, there's a badge for reviewing. It's not specific to reviewing when the queue is full. That's not something we specifically want to incentivize. Any correct reviewing is helpful, no matter when it happens. If it happens before the queue gets full, then it still helps to reduce the chances of the queue getting full. :-)
    – Cody Gray Mod
    Commented Jan 12, 2021 at 6:43
  • 1
    How do you expect a "badge for helping review a full queue" to work if there is no limit, and the queue thus cannot be full? Commented Jan 12, 2021 at 10:12
  • @CodyGray, that makes sense, good point. I'll remove that.
    – Almenon
    Commented Jan 13, 2021 at 16:39
-2

For starters -- remove the Edit link when the queue is full.

Change it to Score Suggested Edits and give the power to reviewers to score edits.


Doing some more testing I've noticed that almost every Edit link on stackoverflow.com is full for me; it is only sometimes that I get: "The edit queue is full at the moment - try again in a few minutes!"

5
  • 2
    "give the power to reviewers to score edits" - Users already get to review edits (unlocked at 2000 reputation), just takes a bit of time. Commented May 17, 2022 at 23:08
  • 1
    @NickstandswithUkraine was thinking more in the line of giving the power to users with lower reputation to have the opportunity to up and down vote suggested edits so that the system can clean up the queue once enough voting are collected.
    – MeSo2
    Commented May 17, 2022 at 23:40
  • 2
    Sort of like giving half-votes to lower-rep users or something, you mean?
    – Ryan M Mod
    Commented May 18, 2022 at 1:10
  • There could be a separate score or standing for (suggested) edits (e.g., like the accept rate (though that may be a bad example)). The new score could be public and/or have limited visibility. For instance, I would like some kind of score that incentivises people to find and point out duplicates (that is, vote up or down on proposed or completed duplicates. E.g., some duplicates for already-closed questions are really good (vote up) or not any good (e.g., does not point to the canonical question)-vote down). Commented May 18, 2022 at 12:55
  • 1
    Just FYI: There's only one suggested edits queue per site, so trying different posts isn't going to give you any different results than trying on the same post at a later time.
    – Makyen Mod
    Commented May 23, 2022 at 20:08
-3

I'll sum up a few suggestions from comments:

educate editors

When doing an edit, some obvious notice could remind about core recommendations to follow for editing a post and filling an edit summary. This would allow easier reviewing and consequently less disputed reviews.

educate reviewers

When doing a review, some obvious notice could remind about core recommendations to follow for reviewing a suggested edit. This would allow less disputed reviews.

rollback top-bar review button redirect

A month ago, with the new top-bar, the review button stopped redirecting to suggested-edits and instead is now redirecting to the list of queues. Rolling back this change would make people focus on the suggested-edits queue like before.

split the queue

It has been suggested to separate this queue between post edits and tag wiki edits. Hence, an increased total number of queued edits.

It has also been suggested to allow filtering on this queue for easier and faster focus on some edits.

1
  • 2
    1. that information is already presented but no one reads it. 2, that information is already presented but no one reads it 3. I'd rather have it be a drop down menu as they have said they are planning to do 4. You can only review tag wiki edits once you hit 5k, and given that the majority of suggested edit reviewers are probably below the 5k mark, I don't think this would help anything.
    – user4639281
    Commented Mar 28, 2017 at 23:50
-4

I suppose I will weigh in with two major assumptions and a possible suggestion:

  • Many if not most of these suggested edits are "minor edits", ie code-block fixes, tag fixes, punctuation, and things like i->I.
  • Although these suggestions do clog up the queue in the current system, these actions can still be beneficial to the site as a whole. (No one wants ugly or hard to read questions)

Unfortunately, because of the ease of making these types of edits (as opposed to "real" edits like rephrasing, or heavy grammatical changes) low rep users (like me...) prefer these sorts of edits since the rep pay out is the same for less effort.

Therefore, I propose a new privilege:

At 500 rep, the same level you gain access to the triage queue, you gain the ability to make "minor edits" without going through the suggestion queue but you get no reputation for making these changes (disincentivizing spam).

What is a "minor edit"? I think it should be some low character count + retagging. If there were an automated way of detecting code-block only changes, that should be included as well.

3
  • 15
    Why would we want to encourage people to be making more of these edits? And just because an edit isn't touching a large number of characters doesn't mean it's minor, and doesn't mean it's correct. People could use this to introduce inappropriate content into posts, break code, vandalize content, remove essential tags, etc. and end up bypassing review in the process.
    – Servy
    Commented Mar 28, 2017 at 15:57
  • @Servy Valid points. I wanted to strike a balance between recognizing that some of these edits are actually helpful, if queue clogging and keeping reviewless edits behind a rep barrier while still allowing low rep users to contribute.
    – code11
    Commented Mar 28, 2017 at 16:06
  • (disincentivizing spam). - spammers aren't usually in it for the rep anyway Commented May 22, 2020 at 8:32
-9
  • Improving edits takes time, just add improving heap, where edits are improving.

  • And prioritize better edits by users with 50+ rep.
    After 12 hours edits from the queue will be deleted.

Improving heap is a simple set, where are edits, that are already improving for now.

3
  • 5
    "Improving edits takes time, just add improving heap, where edits are improving." I don't really understand this part. Can you specify what it means? Commented Aug 24, 2022 at 7:20
  • What do you mean by "improving heap"? Do you mean increasing the (maximum) size of the edit queue? Or add some new separate queue for posts that are in the process of being improved? Or something else? Can you elaborate, please? Commented Aug 24, 2022 at 10:59
  • (OK, the OP can't respond until about 2022-09-01.) Commented Aug 24, 2022 at 11:02

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .