Questions tagged [data-dump]
This tag is about the quarterly creative commons data dumps of all public data in the Stack Exchange network Q&A sites.
29
questions
-10
votes
1
answer
275
views
How to extract all questions from Stack Overflow?
I want to extract all questions from Stack Overflow. I am trying to download from https://archive.org/download/stackexchange/stackoverflow.com-Posts.7z, but it's updated only until 2019.
I would like ...
26
votes
0
answers
972
views
Can DuckDuckGo be given the correct modified date?
This is something I've noticed just recently, but DuckDuckGo has put "7 days ago" next to a few Stack Overflow hits today. But when I click through they are e.g., "Asked 6 years, 3 ...
100
votes
2
answers
4k
views
Stack Overflow is no longer providing Creative Commons Data Dumps
The company has refused to honestly explain their plans to the community, but the data dump was late, and a former employee graciously did the community the favour of confirming that the company has ...
4
votes
1
answer
75
views
It appears that the DeletionDate column in the Stack Exchange data dumps available on archive.org is always empty
I downloaded Post.xml file from https://archive.org/download/stackexchange Here, you can find what is inside the different XML files https://ia800107.us.archive.org/27/items/stackexchange/readme.txt ...
26
votes
1
answer
548
views
How many new users start off asking good questions?
Asking a good question on Stack Overflow can be tough, especially for new members.
How many users' oldest recorded questions are currently not closed, have no downvotes, and have at least one upvote?
...
5
votes
3
answers
513
views
How can I get Stack Overflow datasets related to comment ending with .csv?
I am working on my thesis and I need to get Stack Overflow datasets related to the "comments" ending with ".csv".
2
votes
0
answers
129
views
Get the list of all flagged comments
I am trying to retrieve a list of all flagged comments on Stack Overflow. I looked up some tables on Stack Exchange Data Explorer. I found FlagTypes and PendingFlags tables. However, they seem to ...
12
votes
0
answers
218
views
How can I take out all data from Stack Exchange (a la Google Takeout)?
I hoped this would be a duplicate, but I found none: I would like to have an off-site backup for my Stack Exchange data, much like I have for GitHub and Google for example.
How, if at all, can I get a ...
-11
votes
1
answer
114
views
Searching by vote type (not by score)
I understand some people read this question as if I'm discussing the merits of down-voting.
This isn't the case.
My question is - how could I collect empirical data regarding the use of downvotes, so ...
8
votes
0
answers
102
views
Where can I find statistics about deleted questions related to Stack Overflow?
I have found similar questions in this meta site so I hope it is the appropriate place to ask it.
For my research, I need statistics on deletions between July 1, 2013 and March 4 2019 related to Stack ...
5
votes
0
answers
122
views
Creation date of posts incorrect?
I was doing some querying on the Stack Overflow database and I noticed that the creation date of a post is sometimes later than the first or subsequent comments. The query below is the most extreme ...
5
votes
1
answer
145
views
How can I get the categorized reputation of a user into different tags?
I am trying to get the score of different users into different tags. I am using the platform https://data.stackexchange.com/ to get that information. For example, writing the query:
Select Id, ...
-1
votes
1
answer
167
views
Are deleted comments included in the data dump?
Are deleted comments all included in file Comments.xml in the data dump (archive.org), although they have been deleted on the site?
If not, is there a way to see those (e.g., SEDE, etc.)?
9
votes
2
answers
154
views
How to collect question text before and after an edit - for recommending a suggestion when a user posts a question
We would like to model the complete process of a user posting a new question and editing their question.
We found the data in archive.org, PostHistory.xml, which only contains the comments about the ...
4
votes
0
answers
2k
views
Where do I find the history Stack Exchange data dump on archive?
I am now following a Hadoop course on "MapReduce Design Patterns", which needs to import Stack Overflow's data.
I find the latest dump is here, https://archive.org/details/stackexchange.
And as ...
1
vote
1
answer
74
views
Get activity over time for a specific question
Is there already any way to find out when page views & question votes have occurred over time for a specific question? Clearly this info is publicly available for comments & answers, but what ...
5
votes
1
answer
119
views
Developer Jobs Data Archive Availability?
I am aware of the set of Stack Exchange archives (https://archive.org/details/stackexchange), but am searching for a similar archive of all job openings posted to the "Developer Jobs" section of Stack ...
3
votes
1
answer
140
views
How to download the answers to my questions on Stack Overflow
I understand the use of data Explorer to get my questions. However I can't get the accepted answers to the questions.
My query is as follows in the data explorer:
DECLARE @UserId int = ##MyAccountID#...
6
votes
1
answer
256
views
What is the meaning of Views attribute in the file Users.xml in the Stack Overflow data dump?
I am doing a project on the Stack Overflow data dump. I am unable to understand the significance of the Views attribute in the Users.xml file.
Can somebody explain it?
22
votes
2
answers
1k
views
User ID and Account ID: What do they refer to?
I am doing data analysis on a data dump from Stack Overflow. The Users.xml file from this data shows two bits of information: Id= and AccountID=. However, it looks they refer to two different things. ...
9
votes
1
answer
932
views
Retrieve list of top user tags on data.stackexchange.com
I am currently trying to replicate the query behind the top users page for a certain tag, specifically the "All time" list, in this query on data.stackexchange.
The query is as below
DECLARE @...
22
votes
1
answer
581
views
Stack Exchange DataDump - Some 7z files don't conform to 7z specification [closed]
I've been working on a C# wrapper for extracting and playing with the Stack Exchange Data Dump, with mixed results. Specifically, here are the results:
Successful: 135
Index out of Range Exception: ...
16
votes
1
answer
439
views
Can we add an auxiliary 'numbers' table to the SEDE?
For those who are not familiar with an auxiliary 'numbers' or 'tally' table in a database, it's essentially just a single-column table that stores a sequence integers - usually from 0 to whatever ...
6
votes
1
answer
181
views
Obtaining related questions for the data dump
I am doing some analysis of Stack Overflow posts using the Stack Exchange dump. I'd like to do analyze the downstream effects of posts on the community, and I was wondering if there is a source that ...
3
votes
1
answer
1k
views
Stack Overflow data dump for only a few tags
I want to have an offline copy of Stack Overflow questions and answers. I would prefer if I can download only questions with specific tags (for example, all questions tagged php, javascript and jquery)...
43
votes
3
answers
52k
views
Download Stack Overflow database
I recently attended a conference where the speaker referenced the Stack Overflow database and actually did queries against it.
Some of the queries that he has provided to us also use the Stack ...
9
votes
2
answers
495
views
Having troubles downloading the data dump
I'm having troubles downloading the Stack Overflow data dump.
I've tried both the torrent and .zip download here.
The torrent goes up to 7%, the incoming data does not verify correctly, and it keeps ...
7
votes
1
answer
139
views
Is it possible for users to generate a dump of their questions/answers?
I'm wondering if it is possible - like for instance Twitter provides - to generate a dump of the content a user has produced on the website?
There are - if I recall correctly - regular dumps of the ...
5
votes
1
answer
1k
views
What is the meaning of Posts.Id and how I look the corresponding post from https://www.stackoverflow.com?
I have downloaded the datadump of Stack Overflow. And I want to retrieve the question from stackoverflow.com by posts.id like if the data dump said its id is 305223, then I look for URL https://...