8

I have found similar questions in this meta site so I hope it is the appropriate place to ask it.

For my research, I need statistics on deletions between July 1, 2013 and March 4 2019 related to Stack Overflow questions. Since the repositories do not contain deleted questions, and this data is not available except for the moderators, I would like to request it from you.

The purpose of these statistics is to estimate the valid distribution of the quality of questions posted to Stack Overflow.

However, querying SEDE the number of deletion can be obtained but it does not contain important details, such as the reason for deletion (especially in case of previously closed questions), which is needed to estimate the valid distribution of the quality of posted questions.

I found a post where the statistics related to 2014 was provided, but I need the data for the whole period mentioned.

My research is related to the quality of the posted questions and the further goal is to build an evaluation tool based on NLP and deep learning methods, which can be used by askers to pre-evaluate their questions against the SO policy.

Dumps contain closed questions but do not contain deleted-questions which is about 25% of the posted questions. Due to the deleted posts, the dataset (dumps) are extremely unbalanced, the closed questions are only very tiny parts of the post available in the dumps. This is detrimental for the deep learning algorithms which need much more data to provide acceptable accuracy for practical usage.

Despite the lack of data we are struggling to build a good classifier, but we should demonstrate the reasons of the weaker results, evaluate the distribution of the quality and estimate a reasonable accuracy if the deleted data would be available for us.

I would be grateful if you can help us to get the statistics or maybe the deleted questions (their body, title, tags, and the reasons for the deletion). We do not need the users' data, we lean on only the textual information in our research.

A closely related question is here (What posts get deleted, and why?) , where the asker got some useful details, that is also usefull for me. If somebody could provide also the reasons of closing, I would be very thankful.

6
  • 1
    You need to have at least 25,000 rep to view site analytics.
    – 10 Rep
    Jun 3, 2020 at 16:45
  • 1
    Or you need to be a moderator to view site analytics.
    – 10 Rep
    Jun 3, 2020 at 16:46
  • Yes, I am familiar with the rules, but I this is only a try of a researcher who simply can not wait to achieve the designated reputation level :)
    – user10059606
    Jun 3, 2020 at 19:58
  • 2
    Google "site:meta.stackoverflow.com a year in moderation" to find the Shog9 posts back. Jun 3, 2020 at 20:29
  • 1
    Here's a spreadsheet based off Shog's posts docs.google.com/spreadsheets/u/0/d/….
    – Samuel Liew Mod
    Jun 4, 2020 at 0:46
  • Thank you Hans and Samuel, unfortunately I can not upvote your comment due to the low privileges...
    – user10059606
    Jun 4, 2020 at 5:43

0

You must log in to answer this question.