Timeline for Programmatically reading reproducible markdown data tables now results in Forbidden HTTPError
Current License: CC BY-SA 4.0
31 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Nov 21, 2023 at 13:56 | history | edited | Peter Mortensen | CC BY-SA 4.0 |
Second iteration [<https://en.wikipedia.org/wiki/Markdown>].
|
Nov 20, 2023 at 20:32 | history | edited | Peter Mortensen | CC BY-SA 4.0 |
Fixed the weird syntax highlighting (as a result, the diff looks more extensive than it really is - use view "Side-by-side Markdown" to compare).
|
Nov 16, 2023 at 23:32 | comment | added | Peter Mortensen |
I think Perl's LWP has the same problem. A workaround is to call out to the system's Wget (or similar). Something like my $qxString = "wget -O - \"$URL\" "; my $content = qx/$qxString/; (the URL must be quoted, at least if it contains "?" (GET parameters)). And capture standard output (or through a temporary file).
|
|
Oct 2, 2023 at 3:04 | review | Close votes | |||
Oct 2, 2023 at 4:44 | |||||
Sep 27, 2023 at 10:53 | comment | added | Abdul Aziz Barkat | Query to get links of posts broken due to this: data.stackexchange.com/stackoverflow/query/1787848/… (Note: This only finds posts that have the pandas tag on them, tried with the Python tag as well but that gives a timeout) | |
Sep 27, 2023 at 4:46 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
added 18 characters in body
|
Sep 27, 2023 at 4:41 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
clarifying details
|
Sep 27, 2023 at 4:32 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
deleted 12 characters in body
|
Sep 27, 2023 at 4:01 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
sentence clarification
|
Sep 26, 2023 at 19:13 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
added 2 characters in body
|
Sep 26, 2023 at 18:57 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
added 135 characters in body
|
Sep 26, 2023 at 18:50 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
jonrsharpe quit changing my formatting, the bold was there because it seems that commenters are not actually seeing it
|
Sep 26, 2023 at 18:48 | history | rollback | jonrsharpe |
Rollback to Revision 10
|
|
Sep 26, 2023 at 18:48 | review | Close votes | |||
Sep 26, 2023 at 22:58 | |||||
Sep 26, 2023 at 18:47 | history | rollback | Trenton McKinney |
Rollback to Revision 9
|
|
Sep 26, 2023 at 18:47 | history | edited | jonrsharpe | CC BY-SA 4.0 |
deleted 22 characters in body
|
Sep 26, 2023 at 18:45 | history | edited | Trenton McKinney |
edited tags
|
|
Sep 26, 2023 at 18:44 | comment | added | Karl Knechtel | Businesses switch to Cloudflare because they want its services and features. Anti-scraping is probably one of the most famous of those - surely you've seen one of those "Please enable Javascript and cookies to continue; we need to make sure your connection isn't malicious" sorts of screens before? It is extremely unlikely that this would be considered undesired. | |
Sep 26, 2023 at 18:36 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
added 127 characters in body
|
Sep 26, 2023 at 18:36 | answer | added | Karl Knechtel | timeline score: 15 | |
Sep 26, 2023 at 18:34 | comment | added | Laurel | They recently changed to Cloudflare, which caused some other issues. I'm not sure if the error here is intentional or not. | |
Sep 26, 2023 at 18:28 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
added 302 characters in body
|
Sep 26, 2023 at 18:27 | comment | added | Karl Knechtel |
If the error were something to do with actually interpreting the data, then you might have an interesting point to make about what the page is actually outputting - although it would probably not be accepted as a bug as long as it renders properly in most browsers. But HTTPError: HTTP Error 403: Forbidden is extremely explicit. This is Stack Overflow saying that it does not want to provide the requested information to your program. That is not a bug unless you can find something in the site documentation that supports a claim that it's supposed to be provided in this specific way.
|
|
Sep 26, 2023 at 18:26 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
deleted 159 characters in body
|
Sep 26, 2023 at 18:12 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
added 51 characters in body
|
Sep 26, 2023 at 18:11 | comment | added | Abdul Aziz Barkat | Stack Overflow never supported this, what you were depending on was basically web scraping. If a site decides to actively prevent such scraping, reporting that as a bug doesn't seem sensible to me. See: Every site requesting verification that I'm human | |
Sep 26, 2023 at 18:10 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
added 51 characters in body
|
Sep 26, 2023 at 18:08 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
added 328 characters in body
|
Sep 26, 2023 at 18:03 | comment | added | Erik A | Honestly, just scraping a page breaking doesn't seem like a bug. Instead, use the API to get the body of a question. | |
Sep 26, 2023 at 17:57 | history | edited | Trenton McKinney | CC BY-SA 4.0 |
edited title
|
Sep 26, 2023 at 17:46 | history | asked | Trenton McKinney | CC BY-SA 4.0 |