11

Our country's Internet is going to be national! So accessing websites like Stack Overflow, Google, YouTube, etc. is going to be blocked.
I am a programmer and my life depends on these websites (especially Stack Exchange websites).

I searched a lot and I found some datasets for Stack Overflow, but after the global Internet get blocked, we don't have any access to SQL Server and I don't know how to use those datasets!

Alternatively I wanted to download the entire Stack Overflow website for offline access using wget on Windows. But after minutes, the website blocked my IP address because of too many requests so the progress terminated.

Is there another way to download Stack Overflow question and answers without the need for SQL Server and just reading an index.html file?

32
  • 14
    download the data-dump: meta.stackexchange.com/questions/2677/…
    – rene
    Commented Aug 14, 2021 at 10:12
  • 5
    "Our country's internet is going to be national!" Wait what? Is this a hypothetical scenario, or is this actually based on real events? That said, the data dump by itself isn't very practical... Half of the usability of SO comes from it being indexed by search engines.
    – Cerbrus
    Commented Aug 14, 2021 at 11:20
  • 1
    @Cerbrus Yes unfortunately thats real...I need a more detailed answer.How can I download full website offline and search through it?Is that possible?
    – Nameless
    Commented Aug 14, 2021 at 11:33
  • 1
    Besides the data dump, there is no (easy) way to do what you want. As you already noticed, you will be blocked when you issue too many requests. Even if you would be able to download the whole site, I highly doubt that it will be of much use since you don't have a search functionality then.
    – BDL
    Commented Aug 14, 2021 at 11:36
  • 7
    I would be really curious which country you are talking about, blocking the whole internet sounds like a very strange idea. You don't have to answer that if it might get you into troubles.
    – BDL
    Commented Aug 14, 2021 at 11:37
  • @BDL stackoverflow.com/questions/20188064/offline-web-search
    – Nameless
    Commented Aug 14, 2021 at 11:41
  • @BDL Does this apps(in the link) work for stack data dumps?
    – Nameless
    Commented Aug 14, 2021 at 11:42
  • 1
    @BDL Iran probably, they are working on an internet censorship bill Commented Aug 14, 2021 at 12:22
  • 4
    You can use the data dump and make your own local database. It doesn't have to be a SQL Server.
    – Scratte
    Commented Aug 14, 2021 at 12:33
  • 1
    @Zoe Getting answers to questions which you're not otherwise retrieving does add the SE API quota cost of getting that answer's question (or that answer, but the quota cost is the same for getting a single answer vs. the question the answer is on and all of that question's answers, so it's commonly better to get the entire question and its answers). Also, 10k requests (quota) * 100 questions/request = 1M questions and all the answers on those questions. So, while using the SE API to get the data isn't the right way to go, it is possible to do so over many days, but less than a month.
    – Makyen Mod
    Commented Aug 14, 2021 at 15:27
  • 2
    I believe the Brave browser has Tor built in. Perhaps you can make us of it.
    – Scratte
    Commented Aug 14, 2021 at 23:11
  • 2
    Or just use Tor. Commented Aug 14, 2021 at 23:35
  • 1
    @Scratte Access Youtube in our country is denied and we are using that with only VPN . After our internet become national , accessing to VPN is denied too, and related ports will be closed...I'm an 2-year student at university and I want to migrate after my license ends and want to continue learning in another country. But for this 2 years remaining,I need a free internet or at least offline version of key websites for temporary to make my learning successful.
    – Nameless
    Commented Aug 15, 2021 at 8:04
  • 2
    @41686d6564 In this country everything is possible :) So instead of seating and watching what problem I will face , I'm trying to save everything for bad days incoming. National Internet is an impossible thing to whole countries but as you see ,we will face this problem 3 months later...Thats possible because they dont want people to communicate in a foreign app or website. They want to control people!
    – Nameless
    Commented Aug 15, 2021 at 8:29
  • 4
    If your primary goal is learning, I suggest that you focus on obtaining books around topics you are interested in. Books are far better source for learning and gaining experience, they will also give you skills needed to help yourself.
    – Dalija Prasnikar Mod
    Commented Aug 15, 2021 at 9:48

0

You must log in to answer this question.

Browse other questions tagged .