If, for example, I ask an LLM to produce a short story with a completely unique and random prompt that doesn’t resemble any known existing story in its training data (or in the entire world, if you like), is the generated output of the LLM also stolen?
I think what you’re proposing isn’t something they can do. Are you saying “What if I asked it to create a short story who’s pieces don’t resemble any pieces of known stories?” or are you saying “What if I asked it to create a short story who’s whole doesn’t resemble any known stories?”
The first one can’t happen. The second? Yes, it’s stealing.
Where is it getting this story? LLMs don’t have creativity. They don’t understand story structure. It pulls sentences and paragraphs from work in it’s training data. If the generated output contains work that others have made, that’s called plagiarism. If it doesn’t, then your hypothetical isn’t realistic. LLMs can’t create original works. That’s the whole point. It pulls pieces of the training data and rearranges them. It would be like if I was writing a college paper and instead of writing anything myself I just pulled 100 different sources and copied a sentence or two from each source and structured them as my paper. That’s 100% plagiarism.
The process of generating a story involves recombining and rephrasing the LLM’s training data in unique ways, it’s not a copypaste job. They generate content by predicting and generating text based on patterns, an this implicates a degree of transformation and synthesis.
Where do you draw the line between plagiarism vs inspiration, whether it’s a person or an LLM? How long and similar to something existing does a fragment of text have to be to cross the plagiarism line?
If, for example, I ask an LLM to produce a short story with a completely unique and random prompt that doesn’t resemble any known existing story in its training data (or in the entire world, if you like), is the generated output of the LLM also stolen?
I think what you’re proposing isn’t something they can do. Are you saying “What if I asked it to create a short story who’s pieces don’t resemble any pieces of known stories?” or are you saying “What if I asked it to create a short story who’s whole doesn’t resemble any known stories?”
The first one can’t happen. The second? Yes, it’s stealing.
Where is it getting this story? LLMs don’t have creativity. They don’t understand story structure. It pulls sentences and paragraphs from work in it’s training data. If the generated output contains work that others have made, that’s called plagiarism. If it doesn’t, then your hypothetical isn’t realistic. LLMs can’t create original works. That’s the whole point. It pulls pieces of the training data and rearranges them. It would be like if I was writing a college paper and instead of writing anything myself I just pulled 100 different sources and copied a sentence or two from each source and structured them as my paper. That’s 100% plagiarism.
I was referring to producing a unique plot.
The process of generating a story involves recombining and rephrasing the LLM’s training data in unique ways, it’s not a copypaste job. They generate content by predicting and generating text based on patterns, an this implicates a degree of transformation and synthesis.
Where do you draw the line between plagiarism vs inspiration, whether it’s a person or an LLM? How long and similar to something existing does a fragment of text have to be to cross the plagiarism line?