Agree with most all of Makyen's answer. Specifically regarding whether the results are "derivative works", though (the question at hand):
How things ultimately turn out is up to the courts and/or new legislation which directly address these issues.
Agreed as well, and I can see this going one of two ways in the courts (and probably both ways, since different laws and precedents will exist in different locales).
First, yes, there's the "obvious" conclusion that if one information-system uses data from another information-system, then it is a derivative work.
(Standard "I am not a lawyer" disclaimer here, but from my discussions with attorneys on IP negotiations) Then there's also the concept of "residual knowledge" that might be applied here. As humans, we learn things over time that ultimately enter our residual knowledge.
Compare two situations:
First, take a common Stack Overflow example of knowing how to set an environment variable in Linux via ~/.bashrc
. If I was answering a question about this, I'd be doing so from my residual knowledge, not from looking it up in Google (and certainly not ChatGPT! ;-). I probably wouldn't remember where I initially learned it (although I think I do remember).
In my Stack Overflow answer, there would be no expectation that I would need to attribute that knowledge to a source.
There are, as a result, literally millions of answers here on Stack Overflow that do not have any attribution to a source. That's expected and normal.
However, when I was answering a question about why VSCode can only operate as the default Windows Subsystem for Linux user, I Googled, searched GitHub, and found some existing issues that had information relevant to the problem. After confirming those by testing on my own system (and looking for a workaround), I posted an answer with attribution to the GitHub issue.
In that case, an attribution would be expected and required.
The question that has not yet been determined is whether the result of training an LLM is equivalent to residual knowledge or not. When OpenAI claims "fair use" on training on web-based content, this is likely the core principle they are using. The input is so extensive, and the results of an LLM's output are such an amalgamation of that input, that it is far more like residual knowledge.
- Note: Given the existing definition of residual knowledge, anything stored in a computer system would not be residual knowledge, because it must be in the human-brain. However, if this was being decided in court, OpenAI (et. al.) would be likely to argue that LLMs are different enough from traditional information-systems that the prior definition should not apply.
And perhaps as with human knowledge, the result will be "it depends". If the LLM determines that most of its output for a given prompt came from a particular source, it would attribute it, and otherwise it would synthesize a result.
Who knows? It might be argued that the "hallucinations" we hate so much are signs that the LLM synthesized the result based on residual knowledge. If an LLM result were more like a "search result", it would be closer to the original.