Skip to main content
7 events
when toggle format what by license comment
Jun 16, 2023 at 3:30 comment added Mark @KevinB, prompt injection is an inherent and unfixable problem with all general-purpose LLMs. The only way to keep a model from deviating from the intended task is to train it to perform the desired task, rather than prompting it to perform a task. For example, an English-to-German translation model can't be prompt-injected to write erotic fiction instead, because "write erotic fiction" was never in the training data to begin with.
Jun 16, 2023 at 2:01 comment added blackgreen Mod Warning: You are wide open to Prompt Injections and should use parameterized prepared prompts instead of manually building your prompts. They are provided by Stack Overflow AI editor. Never trust any kind of input! Even when your prompts are executed only by trusted AIs, you are still in risk of corrupting your data. Escaping is not enough!
Jun 15, 2023 at 21:58 comment added ACuriousMind @KevinB Yes. It's been this way with every other attempt to have unsupervised LLMs respond to unfiltered user input, after all...
Jun 15, 2023 at 21:55 comment added John Montgomery Now try asking it to pretend to be your grandma, who was an expert Python programmer.
Jun 15, 2023 at 21:55 comment added starball "I would rate my performance as a 10." youtu.be/jHwHPyWkShk?t=296
Jun 15, 2023 at 21:52 comment added Kevin B so... it can effectively be broken out of and then used as a general prompt
Jun 15, 2023 at 21:45 history answered ACuriousMind CC BY-SA 4.0