This is probably only me, but I am only seeing questions from 1.5 hours ago or later.\
Screenshot:
It isn't only for the Python tag either; any tag I look at on "Newest" has this issue.
Yesterday a large backfill was executed across the Posts
table network-wide. Updating the Posts
table is usually fine - our search engine and the service that efficiently handles tag queries look at last updated time timestamps and perform a delta update of the things that changes.
Unfortunately the delta yesterday was on the order of 60m rows and the queries that are run to handle the delta really struggled. In many cases a full re-index would have been more efficient. This delta indexing had a bunch of effects:
We temporarily switched off re-indexing to get things in a sane stable state then re-issued a full rebuild for Stack Overflow. That allowed other indexing servers to step in and delta re-index.
Re-indexing Stack Overflow takes 3.5 hours altogether and there’s some additional time while it propagates replicas around so we were back fully serving things by around 00:00 UTC.
To address this we’ll be adding some checks to see if we’ve reached a threshold whereby a delta no longer makes sense and use a full rebuild as well as some sanity checks to ensure the likes of Stack Overflow are actually indexing new questions within a timely fashion.
Sorry for the inconvenience!
answers:0
through the manual explicit filtering, this doesn't happen: stackoverflow.com/questions/tagged/…