Timeline for Why does the number of monthly SO questions in the past differ by up to 19% in Data Explorer query, depending on when it runs?
Current License: CC BY-SA 4.0
11 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Feb 19 at 5:56 | comment | added | Peter Mortensen | I have an index for technology popularity. | |
Feb 15 at 21:39 | vote | accept | Karsten Silz | ||
Feb 14 at 15:07 | answer | added | Karsten Silz | timeline score: 4 | |
Feb 13 at 22:13 | comment | added | Ryan M Mod | It depends what you're looking for. If you want statistics on what's being asked, questions less than 1 year old are more reliable than older questions if you're relying on the Posts table (with additional cliffs at 30 and ~10 days). Though if that's what you want, you should use PostsWithDeleted if it's possible for your analysis (it has fewer columns present). | |
Feb 13 at 21:57 | comment | added | Karsten Silz | Thank you for the explanation! In short, questions that are less than one year old are not reliable because they still may be deleted? | |
Feb 13 at 20:44 | comment | added | Ryan M Mod | Further evidence that this is the cause is that the period between queries spans parts of November and February (it's not exactly proportional, but recall that SEDE is only updated once a week), which have medium differences, and all of December and January, which have large differences. | |
Feb 13 at 20:35 | comment | added | Ryan M Mod | Yes, that seems pretty likely, due to the fact that questions that have received little to no response are automatically deleted 365 days after posting (see the "If the question is more than 365 days old, and ..." section). This results in a large spike in the deletion rate of questions when they hit that age. You could probably verify that this is correct by checking the DeletionDate column in PostsWithDeleted. | |
Feb 13 at 20:12 | comment | added | Karsten Silz | Do I understand you correctly? You say that between Nov 28, 2023, and today, people deleted 19% of their questions from December 2022 and January 2023 but only 0.22% of all the October 2022 questions. Correct? | |
Feb 13 at 20:08 | history | edited | Karsten Silz | CC BY-SA 4.0 |
edited title
|
Feb 13 at 20:07 | comment | added | VLAZ | Isn't this just deleted questions? Have you checked the PostsWithDeleted table for more questions there? Most of the data is stripped from the deleted questions but metadata should be there - tags and creation dates, for example. | |
Feb 13 at 20:04 | history | asked | Karsten Silz | CC BY-SA 4.0 |