66

I do not know if Stack Overflow allows the ChatGPT Web Crawler to scrape information from this site so that it can use it to train its large language model, but OpenAI are reportedly encouraging sites to disallow the GPT web crawler if they are concerned about their information being used to train the bot.

Since the crawler could be scraping information available on Stack Overflow to train the bot, will Stack Overflow disallow the crawler or is it already disallowed?

14
  • 31
    Isn't it Open AI themselves who should be concerned about getting their bot trained on content potentially generated by itself? If you don't want your dog to get ill because the neighbors feed it chocolate, then maybe not let it roam freely on the neighbors lawn?
    – Lundin
    Commented Aug 9, 2023 at 9:52
  • 6
    Anyway, the content on SO is licensed in such a way that it cannot be reused without attribution given. If Open AI is doing that, then I believe they are violating the licensing terms.
    – Lundin
    Commented Aug 9, 2023 at 9:54
  • @Lundin, which would justify a ban on the web cralwer if there is evidence that it scrapes as it's responses do not attribute the source.
    – user16612111
    Commented Aug 9, 2023 at 10:12
  • 11
    @Lundin Does the license block that though? Because if we see learning as a form of adaptation, then I have yet to see a software project that lists all the SO posts they ever used for knowledge. And that is basically what OpenAI does. It does not copy. It learns.
    – J. Vergeer
    Commented Aug 9, 2023 at 13:49
  • 7
    "block the GPT web crawler's IP address" - really? Haven't they heard about robots.txt?
    – Bergi
    Commented Aug 9, 2023 at 13:52
  • 1
    Ban is a strong word. I think what you mean is "politely ask it not to crawl" by disallowing in robots.txt... Commented Aug 9, 2023 at 15:37
  • 3
    @CorneliusRoemer same difference
    – Kevin B
    Commented Aug 9, 2023 at 15:39
  • @Lundin I don't think Qing is suggesting this because they're concerned about the quality of training data. Commented Aug 9, 2023 at 15:55
  • @Bergi Did you not read the second paragraph of the information you linked to? Not all robots comply with the standard; [...] may even start with the portions of the website where they have been told to stay out. Commented Aug 9, 2023 at 17:56
  • 2
    @AndrewMorton More important quote from the WP article: "This relies on voluntary compliance". My comment was in response to OpenAI themselves "reportedly encouraging sites to block […]". I'm not sure where Quing Guo got these reports from, but the answer below shows that OpenAI actually know how to achieve this properly in accordance with the relevant web standards.
    – Bergi
    Commented Aug 9, 2023 at 20:17
  • @J.Vergeer "It does not copy. It learns." Very good question about the difference of copying and learning. Although with the CC license an adaptation must still be under the same license. Learning itself must be something completely different. Maybe one could even invent a version of the CC license that only allows learning from it for humans? Some kind of discrimination. Anyway, these legal problems should be sorted out one way or another. Commented Aug 11, 2023 at 7:06
  • 5
    Disallowing in robots.txt and potentially blocking the IP ranges hardly matters if OpenAI gets its hands on the data dumps. Commented Aug 11, 2023 at 16:40
  • Open AI have a 150000$ lawsuit to answer to for violating the copyright act of the content it uses to train it's not. Stack Overflow should also follow suit.
    – user16612111
    Commented Aug 20, 2023 at 17:24
  • 2
    This didn't age well.
    – user492203
    Commented May 6 at 23:43

1 Answer 1

74

Yes, it was, but not anymore.

Stack Overflow had been blocking OpenAI's web crawler, GPTBot from crawling the sites by utilizing the robots.txt, which is the suggested way from the official documentation about GPTBot.

Based on the capture on 07 Aug 2023 19:23:49 GMT, the file contained the following lines:

User-agent: GPTBot
Disallow: /

But since 27 Mar 2024 03:29:48 GMT, the lines have been removed.

However, as The Verge stated,

It does not retroactively remove content previously scraped from a site from ChatGPT’s training data.

14
  • 5
    Not sure if that is enough. This link speaks of ChatGPT-User instead of GPTBot: platform.openai.com/docs/plugins/bot
    – Gimby
    Commented Aug 9, 2023 at 10:16
  • 31
    With the number of scraper sites out there, this probably won't be terribly effective.
    – Laurel
    Commented Aug 9, 2023 at 10:26
  • 7
    ChatGPT-User is specifically for plugins. I assume both have to be blocked Commented Aug 9, 2023 at 10:36
  • 5
    @Laurel Wouldn't matter anyway; there's a large amount of scrapers that do not respect robots.txt. They'd need server-sided user-agent blocks, and that assumes the scraper sets a special user agent. Blocking the AI scrapers efficiently is a nightmare Commented Aug 9, 2023 at 10:36
  • 29
    True but ChatGPT should respect it. But let's face it, the bot has already scraped a good amount of data from the site because that's why it can guestimate smartly worded nonsense to programming questions. I can't imagine adding a block to a robots.txt file is going to make it forget all that prior training. The only reason to block anything at this point is to help reduce server costs, not to prevent data from going out there.
    – Gimby
    Commented Aug 9, 2023 at 11:24
  • 4
    Well that's a shame. I wonder why do this, besides "we insist on credit all of a sudden". It's handicapping the most useful programming assistant to ever exist. Commented Aug 9, 2023 at 13:31
  • 1
    I learn things when browsing the web or SO, and when I'm asked to solve a problem, I don't have to append it with "I learned this from Khan Academy" - I just have the knowledge and that's it. A non-trivial case is copy-pasting significant work - which I've never seen ChatGPT do - then, well, you put your stuff out on a public forum, good luck enforcing even if you wanted to (exceptions apply). Commented Aug 9, 2023 at 13:39
  • 55
    ChatGPT is not at all "the most useful programming assistant to ever exist". I have worked with people who have leaned on it heavily, and it just produces absolute garbage. Semi-functional garbage, but garbage all the same. Especially as, unlike a human who will adapt an answer from SO to fit into the larger picture, ChatGPT provides an answer based on the prompt. Projects which use ChatGPT often end up being unmaintainable Franken-code. Commented Aug 9, 2023 at 13:52
  • 30
    @OverLordGoldDragon The most useful programming assistants are docs, along with human-written knowledge repository sites like Stack Overflow. ChatGPT just regurgitates completions based on scrapes of pre-existing data, with a good deal of hallucinations on top. Most answers GPT gives you can be acquired more reliably by going to the source, and it fails terribly on anything non-trivial in my experience.
    – ggorlen
    Commented Aug 9, 2023 at 14:59
  • 4
    Shouldn't "has blocked OpenAI's web crawler, GPTBot from crawling the sites" be "has attempted to indicate to OpenAI's web crawler, GPTBot, that it would prefer that it didn't crawl the sites"? Commented Aug 9, 2023 at 17:58
  • 1
    If Stack Overflow disappears because of ChatGPT, where will ChatGPT collect its training data? Someone says ChatGPT is better than Stack Overflow, that's not a important thing. Eeven that better ChatGPT is trained from data created by humans.
    – ladofa
    Commented Mar 15 at 1:38
  • If you read the robots.txt now, you will see that GPTbot is not included there. Why has this change been made? Commented May 4 at 5:15
  • @desertpureolive I didn't get the memo, though it might be related to this discussion on MSE: Is Stack Exchange explicitly blocking web crawlers that have a potential to be used for training AI models?
    – Andrew T.
    Commented May 4 at 6:05
  • 4
    The new partnership with OpenAI explains the unblocking. Commented May 6 at 13:09

You must log in to answer this question.