41

Over the last few days, I've often been rate-limited:

Too many requests

This IP address (x.x.x.x) has performed an unusual high number of requests and has been temporarily rate limited...

Method: rate limit

Reason: Request rate.

True

  • I run bots which query the SE-API every minute and feed information to multiple chat rooms

  • I participate with my account in multiple chat rooms

  • I visit questions and answers at a fairly high rate (normally just to flag as NAA or some offensive comments).

But

I have been doing this for more then a year without any problems. I'm not aware of any recent change in what I'm doing which would cause me to be rate-limited more often.

That this is happening much more often over the last few days is why I'm asking if you've changed the rate-limit mechanism (more strict?, started including chat, SE-API?), or if it's only some temporary issue?

This information is important. If it's a permanent change, I will need to modify what I do in order to avoid being rate-limited this often (e.g. change my query strategy towards the SE-API, limit the number of chat rooms I interact with, limit the number of rooms in which the bots report, etc.) .

7
  • 2
    I've also been experiencing this rate-limit lockout more often recently. At least for me, the lockout has restricted normal access to SE pages (i.e. the lockout page is displayed instead of questions), but has not affected SE API access. I've been able to use the SE API in other tabs throughout the lockouts. Lockouts have been for relatively short periods of time. I'd estimate at 10 minutes, or so, but I keep forgetting to measure the actual lockout period. For me, the lockout has usually happened when rapidly moving from one question to another using AJAX rather than loading new pages.
    – Makyen Mod
    Commented Jul 27, 2017 at 11:51
  • You don't have the "who ignored me" chat userscript installed do you? or any other userscripts that could be impacting this? That userscript recently (as of a few weeks ago) started getting a lot of us ratelimited over in js chat recently, so i think they did change something.
    – Kevin B
    Commented Jul 27, 2017 at 15:30
  • 1
    @Kevin No, I don't, I have a few user scripts (that I have been checking and testing to remove) anyway they are old stuff (installed several month/year ago), it seems in some way related to chat (not api), I have removed the duplicate reporting bots from some rooms (with less users) and since I seem to have less problems. I hope we get an answer, so I can notify RO's of those rooms that I can not run the bot in them anymore if this is the case. Commented Jul 27, 2017 at 15:57
  • Maybe you should consider running the bot query once every 5 minutes. It is possible that the amount of time it causes the server to process queries is also a factor.
    – Travis J
    Commented Jul 27, 2017 at 20:51
  • 1
    @TravisJ I actually do not think the it has to do with api (hence how often I run query has no effect, it has it's own back-off time if to often). My guess is that it's a new chat request limit, the problem with the bot is that it's also in multiple chat rooms, listening to messages. However I'm only guessing, something however probably have changed not only me with bots is experience this Commented Jul 27, 2017 at 21:16
  • Perhaps it is related to the maximum amount of sockets the bot is connecting to? You only need one socket connection in order to send to any chat room.
    – Travis J
    Commented Jul 27, 2017 at 21:19
  • 1
    @TravisJ I think it's related to something that SO have changed (maybe after the readonly issue), our chat lib is fairly optimized. Lets see if they answer or we just need to figure out how to avoid it. Commented Jul 27, 2017 at 21:25

1 Answer 1

25

We moved chat to Fastly during the failover to our Colorado datacenter earlier this month as it makes things easier not having to wait for DNS changes to propagate. Things looked like they were working as expected, but in the past few days we found there were some complications with chat behind Fastly. One of the issues was it caused a number of users to be rate limited when they re-opened Chrome with multiple chat tabs.

Earlier today we reverted the change so that chat is no longer behind Fastly, which should help prevent the recent rate limiting issues. We plan on moving chat back to Fastly at some point in the future, but we need to do more testing first to make sure it doesn't cause any unintended issues.

2
  • 3
    Thanks for the speedy answer, when it returns back to Fastly, will it effect the rate limit in someway for people using chat?, hence also chat activity will be included and it was not before? Commented Jul 28, 2017 at 9:13
  • 1
    @PetterFriberg not sure yet. Chat previously was not included in the rate limiting system, but we would like it to be included in the future so it prevents a potential DoS vector. But we would want to make sure it doesn't interfere with normal use, which it most definitely was for these past few weeks.
    – Greg Bray Staff
    Commented Jul 28, 2017 at 17:46

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .