Timeline for Is it inappropriate to give advice about avoiding bot detection? [duplicate]
Current License: CC BY-SA 4.0
18 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Jun 16, 2021 at 17:42 | comment | added | PM 2Ring | @CodyGray That answer is ok, but it's not strictly true. A sufficiently advanced scraper may be able to operate for a long time. OTOH, once the scraped site figures out how to block the scraper it will be very hard to write a new scraper that avoids detection and retrieves data fast enough to be useful. We often get questions about that: "I've been using this script to scrape this site for a few month, but it suddenly stopped working. How do I fix it?" | |
Jun 16, 2021 at 16:06 | comment | added | Cody Gray Mod | @PM2Ring You, like me, might be a big fan of this answer by Ben Voigt. That is, "You should not do this because it violates the Terms of Service" is an answer to these types of questions. | |
Jun 16, 2021 at 14:13 | comment | added | C. Peck | @Gimby this is likely selection bias. I answer a lot on the selenium tag so that's where I found the examples. | |
Jun 16, 2021 at 14:10 | comment | added | Gimby | I find it interesting that there are questions about Selenium. Selenium is above else a testing framework, even though of course you can also use it for different more nefarious reasons since it is pretty good at what it does, why would you re-invent the wheel. I don't find the linked questions all that objectionable. Bot detection can actually make it hard to created automated tests using Selenium. | |
Jun 16, 2021 at 13:05 | comment | added | PM 2Ring | @Braiam Sure, it's not SO's job to police ToS violations. But I would be happy if we did have an official policy that discouraged helping ToS violators. OTOH, I don't downvote such questions or their answers purely on ToS grounds. Bad security practices is a different issue, and I have no problem downvoting answers as not useful if they (for example) contain code that's vulnerable to SQL injection. | |
Jun 16, 2021 at 12:53 | comment | added | Braiam | @PM2Ring that would be shot down immediately, because SO doesn't police the ToS violators. What it should police is bad security practices. | |
Jun 16, 2021 at 3:50 | comment | added | PM 2Ring | We get a lot of questions from people trying to "scrap" a website. But many of them are close-worthy because they are unclear, don't have an adequate MCVE, lack focus, etc. But sometimes I do wish that we had a close reason that addressed the ethical issue of code that defies the ToS of a site, and which unfairly strains the site's resources. Many of these scrapers just don't get the concept that what they're doing is unethical, and they only throttle their code in order to reduce the odds of being detected, not because it's the polite thing to do. | |
Jun 16, 2021 at 2:08 | review | Reopen votes | |||
Jun 16, 2021 at 5:42 | |||||
Jun 16, 2021 at 1:56 | history | edited | 10 Rep | CC BY-SA 4.0 |
added 32 characters in body
|
Jun 16, 2021 at 1:40 | history | edited | Sabito | CC BY-SA 4.0 |
added 1 character in body; edited tags
|
Jun 15, 2021 at 23:31 | comment | added | Baum mit Augen Mod | The assumption behind this kind of question always seems to be that discussions about how to circumvent some security system being public on the "normal" internet (like SO) helps the attacker more than it helps the defender. I am honestly not sure that's the case; while SE relies on some obscurity itself for some things like the Q ban algo, there are plenty of examples of attackers getting the info anyway from some darker corner of the internet while the defenders blissfully think they are running a secure service.. | |
Jun 15, 2021 at 23:30 | comment | added | Cody Gray Mod | But, to answer your specific question, we don't police the intent of questions asked on Stack Overflow. There are legitimate reasons for doing most things, and then there are illegitimate reasons. Even when the asker may have nefarious intentions, getting the information out there may be to the broader benefit of the community. If the question meets our criteria for a good question, then it's fine. Otherwise, it's not, and you'll easily find one of the standard close reasons/flags that fits. As always, you can express your opinion about the question, subjective or not, by voting. | |
Jun 15, 2021 at 23:27 | history | duplicates list edited | Cody GrayMod | duplicates list edited from How do we handle questions that are potentially or blatantly illegal or malicious? to What is the policy on questions that ask how to crack passwords? [duplicate], How do we handle questions that are potentially or blatantly illegal or malicious?, How to handle questions with seemingly malicious (albeit legal) intent [duplicate], Unethical, possibly illegal assistance | |
Jun 15, 2021 at 23:26 | comment | added | Gino Mempin | No specific example if a question or a bot violates any TOS, but related: Should questions that violate API Terms of Service be flagged? | |
Jun 15, 2021 at 23:26 | comment | added | Cody Gray Mod | The real policy is here: "...you have to treat each post on its own merits." | |
Jun 15, 2021 at 23:26 | history | closed | Cody GrayMod discussion Users with the discussion badge or a synonym can single-handedly close discussion questions as duplicates and reopen them as needed. | Duplicate of How do we handle questions that are potentially or blatantly illegal or malicious? | |
Jun 15, 2021 at 23:24 | comment | added | Nick is tired | If you're uncomfortable providing an answer or advice don't, but we're not here to provide lessons on ethics, we're here to answer coding questions. Of course, there are always ethical reasons for asking such questions as well (wanting to know how to defeat some security, in order to improve the security of something, for example) | |
Jun 15, 2021 at 23:21 | history | asked | C. Peck | CC BY-SA 4.0 |