55

I do not know if Stack Overflow allows the ChatGPT Web Crawler to scrape information from this site so that it can use it to train its large language model, but OpenAI are reportedly encouraging sites to disallow the GPT web crawler if they are concerned about their information being used to train the bot.

Since the crawler could be scraping information available on Stack Overflow to train the bot, will Stack Overflow disallow the crawler or is it already disallowed?

13
  • 31
    Isn't it Open AI themselves who should be concerned about getting their bot trained on content potentially generated by itself? If you don't want your dog to get ill because the neighbors feed it chocolate, then maybe not let it roam freely on the neighbors lawn?
    – Lundin
    Aug 9 at 9:52
  • 6
    Anyway, the content on SO is licensed in such a way that it cannot be reused without attribution given. If Open AI is doing that, then I believe they are violating the licensing terms.
    – Lundin
    Aug 9 at 9:54
  • @Lundin, which would justify a ban on the web cralwer if there is evidence that it scrapes as it's responses do not attribute the source.
    – user16612111
    Aug 9 at 10:12
  • 11
    @Lundin Does the license block that though? Because if we see learning as a form of adaptation, then I have yet to see a software project that lists all the SO posts they ever used for knowledge. And that is basically what OpenAI does. It does not copy. It learns.
    – J. Vergeer
    Aug 9 at 13:49
  • 7
    "block the GPT web crawler's IP address" - really? Haven't they heard about robots.txt?
    – Bergi
    Aug 9 at 13:52
  • 1
    Ban is a strong word. I think what you mean is "politely ask it not to crawl" by disallowing in robots.txt... Aug 9 at 15:37
  • 3
    @CorneliusRoemer same difference
    – Kevin B
    Aug 9 at 15:39
  • @Lundin I don't think Qing is suggesting this because they're concerned about the quality of training data. Aug 9 at 15:55
  • @Bergi Did you not read the second paragraph of the information you linked to? Not all robots comply with the standard; [...] may even start with the portions of the website where they have been told to stay out. Aug 9 at 17:56
  • 2
    @AndrewMorton More important quote from the WP article: "This relies on voluntary compliance". My comment was in response to OpenAI themselves "reportedly encouraging sites to block […]". I'm not sure where Quing Guo got these reports from, but the answer below shows that OpenAI actually know how to achieve this properly in accordance with the relevant web standards.
    – Bergi
    Aug 9 at 20:17
  • @J.Vergeer "It does not copy. It learns." Very good question about the difference of copying and learning. Although with the CC license an adaptation must still be under the same license. Learning itself must be something completely different. Maybe one could even invent a version of the CC license that only allows learning from it for humans? Some kind of discrimination. Anyway, these legal problems should be sorted out one way or another. Aug 11 at 7:06
  • 5
    Disallowing in robots.txt and potentially blocking the IP ranges hardly matters if OpenAI gets its hands on the data dumps. Aug 11 at 16:40
  • Open AI have a 150000$ lawsuit to answer to for violating the copyright act of the content it uses to train it's not. Stack Overflow should also follow suit.
    – user16612111
    Aug 20 at 17:24

1 Answer 1

63

Yes, Stack Overflow has blocked OpenAI's web crawler, GPTBot from crawling the sites.

The robots.txt file contains the following lines:

User-agent: GPTBot
Disallow: /

which is the suggested way from the official documentation about GPTBot.

However, as The Verge stated,

It does not retroactively remove content previously scraped from a site from ChatGPT’s training data.

22
  • 4
    Not sure if that is enough. This link speaks of ChatGPT-User instead of GPTBot: platform.openai.com/docs/plugins/bot
    – Gimby
    Aug 9 at 10:16
  • 28
    With the number of scraper sites out there, this probably won't be terribly effective.
    – Laurel
    Aug 9 at 10:26
  • 7
    ChatGPT-User is specifically for plugins. I assume both have to be blocked
    – Zoe is on strike Mod
    Aug 9 at 10:36
  • 4
    @Laurel Wouldn't matter anyway; there's a large amount of scrapers that do not respect robots.txt. They'd need server-sided user-agent blocks, and that assumes the scraper sets a special user agent. Blocking the AI scrapers efficiently is a nightmare
    – Zoe is on strike Mod
    Aug 9 at 10:36
  • 28
    True but ChatGPT should respect it. But let's face it, the bot has already scraped a good amount of data from the site because that's why it can guestimate smartly worded nonsense to programming questions. I can't imagine adding a block to a robots.txt file is going to make it forget all that prior training. The only reason to block anything at this point is to help reduce server costs, not to prevent data from going out there.
    – Gimby
    Aug 9 at 11:24
  • 4
    Well that's a shame. I wonder why do this, besides "we insist on credit all of a sudden". It's handicapping the most useful programming assistant to ever exist. Aug 9 at 13:31
  • 49
    ChatGPT is not at all "the most useful programming assistant to ever exist". I have worked with people who have leaned on it heavily, and it just produces absolute garbage. Semi-functional garbage, but garbage all the same. Especially as, unlike a human who will adapt an answer from SO to fit into the larger picture, ChatGPT provides an answer based on the prompt. Projects which use ChatGPT often end up being unmaintainable Franken-code. Aug 9 at 13:52
  • 28
    @OverLordGoldDragon The most useful programming assistants are docs, along with human-written knowledge repository sites like Stack Overflow. ChatGPT just regurgitates completions based on scrapes of pre-existing data, with a good deal of hallucinations on top. Most answers GPT gives you can be acquired more reliably by going to the source, and it fails terribly on anything non-trivial in my experience.
    – ggorlen
    Aug 9 at 14:59
  • 2
    @LukeStevenson, it stands to reason if ChatGPT is producing semi-functional garbage then better data would make it at least produce slightly better garbage. Why cut it off from the best source of programming related answers on the internet? Is the goal to punish people who (over) use it by making them produce even worse code? I just can't see the reasoning behind "someone is using the wrong tool, so I hate that tool, so let's try to make that tool worse".
    – yeerk
    Aug 9 at 17:48
  • 3
    Shouldn't "has blocked OpenAI's web crawler, GPTBot from crawling the sites" be "has attempted to indicate to OpenAI's web crawler, GPTBot, that it would prefer that it didn't crawl the sites"? Aug 9 at 17:58
  • 15
    No, that does not stand to reason, @yeerk. The reason ChatGPT produces poor code is that it has no understanding of the semantics of the code it produces or of the context it is to be used in, or of the nuances that sometimes guide which approaches are best in a given situation. More data is not going to help ChatGPT in those areas. Aug 9 at 18:02
  • 11
    @yeerk Most people here know how a Transformer works and what the Attention mechanism is. It's really nothing esoteric. But you are basing your argument on a word, the fact that it's called "attention" because it weights specific inputs more than others doesn't mean the network is "attentive" like humans are. You should not attribute anthropomorphic traits to a statistical model. ChatGPT has no practical experience. Having said so, SO is not meant to teach programming so it's unlikely that any intelligence could use it to learn programming regardless of the number of parameters they have. Aug 10 at 9:52
  • 6
    I just asked GPT 4 a Typescript question and it returned Python. I haven't felt like this since road rage in traffic. I need to go walk it off now.
    – suchislife
    Aug 10 at 19:02
  • 2
    Something has happened to it lately... It reminds of when I took the 2nd COVID shot and couldn't form meaningful thoughts for about a week. It appears to be... less logically intelligent and more concerned with how I feel, waaay more English and sometimes no code on a coding question.
    – suchislife
    Aug 10 at 19:08
  • 2
    @yeerk Copilots are similar but different enough, specifically trained to produce code. You cannot just say that ChatGPT is a great coding tool when you actually meant one of the copilots. Aug 11 at 8:14

You must log in to answer this question.