19

This is probably only me, but I am only seeing questions from 1.5 hours ago or later.\

Screenshot:

Are all newest questions very old?

It isn't only for the Python tag either; any tag I look at on "Newest" has this issue.

16
  • 2
    Hmm, I'm seeing the same thing. That's strange.
    – cigien
    Feb 11, 2021 at 17:24
  • @cigien No way there's no activity either, at least for python there would be at least 1-2 per minute Feb 11, 2021 at 17:25
  • Yeah, definitely. I searched for [c++], and I'm looking at new questions at the same time :p
    – cigien
    Feb 11, 2021 at 17:26
  • seems like an issue with search. Accessing the tag works fine
    – Suraj Rao
    Feb 11, 2021 at 17:27
  • @cigien I feel bad for new users... imagine joining stack overflow and not getting a single answer, comment, upvote, downvote, edit, etc... Feb 11, 2021 at 17:27
  • 1
    I wouldn't be too worried. As SurajRao mentions, filtering by tag is working, which is what a lot of users do (I think).
    – cigien
    Feb 11, 2021 at 17:31
  • Interestingly, when putting the answers:0 through the manual explicit filtering, this doesn't happen: stackoverflow.com/questions/tagged/…
    – Tomerikoo
    Feb 11, 2021 at 17:43
  • 2
    This appears to be the same bug (or at least the same symptom) meta.stackoverflow.com/questions/261459/…
    – cigien
    Feb 11, 2021 at 17:45
  • I'm getting the same thing. No new results before 2 hours ago. Try viewing this question. For some reason it does not appear in search. It was made 14 minutes ago.
    – 0-1
    Feb 11, 2021 at 18:04
  • 7
    We're question complete. All that is left to do is curating existing content ....
    – rene
    Feb 11, 2021 at 18:30
  • There was a report about this a few days ago, but it’s been deleted. It may have been this one on MSE. Feb 11, 2021 at 18:51
  • Note that the latest question IDs are close to 2^26 ~ 67 million
    – 0-1
    Feb 11, 2021 at 19:02
  • 1
    @0-1 What's the matter with 2^26? If it was 2^32 I would understand, but this? I don't get it. Feb 11, 2021 at 19:13
  • @CATboardBETA I was curious to see if it was close to any power of 2. A recent question ID I just saw was 66161182. Whereas 2^26 is 67108864. The numbers differ by 1.4%. I think it may just be coincidence, though. Probably a similar issue this question mentioned above
    – 0-1
    Feb 11, 2021 at 21:19
  • 10
    This is in progress and should clear out shortly. Had some issues with re-indexing and started serving a stale cache. Apologies for any inconvenience and thanks so much for bringing it here so we could address it!
    – Catija StaffMod
    Feb 11, 2021 at 22:10

1 Answer 1

26

Yesterday a large backfill was executed across the Posts table network-wide. Updating the Posts table is usually fine - our search engine and the service that efficiently handles tag queries look at last updated time timestamps and perform a delta update of the things that changes.

Unfortunately the delta yesterday was on the order of 60m rows and the queries that are run to handle the delta really struggled. In many cases a full re-index would have been more efficient. This delta indexing had a bunch of effects:

  • our indexing servers kept timing out running the queries causing unnecessary load on our SQL infrastructure
  • Full text search and tag search got caught up trying to re-index the same thing constantly - at some points several servers were doing the same work

We temporarily switched off re-indexing to get things in a sane stable state then re-issued a full rebuild for Stack Overflow. That allowed other indexing servers to step in and delta re-index.

Re-indexing Stack Overflow takes 3.5 hours altogether and there’s some additional time while it propagates replicas around so we were back fully serving things by around 00:00 UTC.

To address this we’ll be adding some checks to see if we’ve reached a threshold whereby a delta no longer makes sense and use a full rebuild as well as some sanity checks to ensure the likes of Stack Overflow are actually indexing new questions within a timely fashion.

Sorry for the inconvenience!

2

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .