Timeline for We are seeking functional feedback for the formatting assistant
Current License: CC BY-SA 4.0
7 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Jun 16, 2023 at 3:30 | comment | added | Mark | @KevinB, prompt injection is an inherent and unfixable problem with all general-purpose LLMs. The only way to keep a model from deviating from the intended task is to train it to perform the desired task, rather than prompting it to perform a task. For example, an English-to-German translation model can't be prompt-injected to write erotic fiction instead, because "write erotic fiction" was never in the training data to begin with. | |
Jun 16, 2023 at 2:01 | comment | added | blackgreen Mod | Warning: You are wide open to Prompt Injections and should use parameterized prepared prompts instead of manually building your prompts. They are provided by Stack Overflow AI editor. Never trust any kind of input! Even when your prompts are executed only by trusted AIs, you are still in risk of corrupting your data. Escaping is not enough! | |
Jun 15, 2023 at 21:58 | comment | added | ACuriousMind | @KevinB Yes. It's been this way with every other attempt to have unsupervised LLMs respond to unfiltered user input, after all... | |
Jun 15, 2023 at 21:55 | comment | added | John Montgomery | Now try asking it to pretend to be your grandma, who was an expert Python programmer. | |
Jun 15, 2023 at 21:55 | comment | added | starball | "I would rate my performance as a 10." youtu.be/jHwHPyWkShk?t=296 | |
Jun 15, 2023 at 21:52 | comment | added | Kevin B | so... it can effectively be broken out of and then used as a general prompt | |
Jun 15, 2023 at 21:45 | history | answered | ACuriousMind | CC BY-SA 4.0 |