Timeline for Stack Overflow will be testing a title-drafting assistant, and we’d like your involvement
Current License: CC BY-SA 4.0
11 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
May 18, 2023 at 19:17 | comment | added | Ben Voigt | @Soltius: Both are going to be very concerned with conditional probability of a certain "next word" given previous text and topic (prompt). But the generative task to output the next word which maximizes the conditional probability and the analysis task of returning the conditional probability given an arbitrary "next word" input are very different, and don't even require the model to encode the same information. | |
May 18, 2023 at 17:43 | comment | added | Soltius | @BenVoigt Good point, but even non-generative language models are pre-trained on generative tasks (basically predicting the next work in a sentence), giving them the "detailed model of the input language" you mention. They can then be adapted to other tasks, which can be non-generative (such as your example). So I'd say that LLMs are a subset of generative AI. But it's just fussing over nomenclature anyway. | |
May 16, 2023 at 19:12 | comment | added | Ben Voigt | @Soltius: I am not any type of AI expert, but according to the plan meaning of the terms, there's a lot of overlap between generative AI and LLM, but no superset-subset relationship. For example, calculating a distance metric between two inputs has to benefit from a detailed model of the input language, and I would say the term LLM applies. But it isn't generative. ("Calculating a distance metric" has real applications on StackExchange such as finding duplicate questions, and in the larger world such as plagiarism detection and patent searches) | |
May 14, 2023 at 3:16 | history | edited | Jonathan Leffler | CC BY-SA 4.0 |
Theses --> these — and sundry other changes
|
May 11, 2023 at 15:25 | comment | added | Slate StaffMod | As for the issue with prompt-created titles -- I think we'll have to wait and see where the pain points are here. We hope it's an edge case, but no way to know until we test. As for your quick analysis request -- it's a good thought, and one I've heard a bit of discussion about internally. Not so quick, though, and probably of more relevance to future projects. I'll see if we can find time to consider it, but probably no full writeup. Thanks for the suggestions. | |
May 11, 2023 at 14:40 | comment | added | Soltius | LLMs are a type of Generative AI : a class of methods trained in a certain way with some characteristics, destined to generate text. Generative AI just means AI which generates stuff (eg pictures such as midjourney) | |
May 11, 2023 at 6:02 | comment | added | starball | oh sorry. for some reason I didn't pick up on the LLM part. Are LLM and "Generative AI" synonymous? (I don't know much of anything technical about this field) | |
May 11, 2023 at 5:49 | comment | added | Travis J | @user - Yes, they are using an LLM. There was an MSE post on this already | |
May 11, 2023 at 3:18 | comment | added | starball | "I am curious what the prompt will be" - do we know that they're using an LLM behind the scenes? And if they are... I wonder how much this'll cost to maintain. | |
May 10, 2023 at 19:49 | history | edited | Laurel | CC BY-SA 4.0 |
added 1 character in body
|
May 10, 2023 at 19:39 | history | answered | Travis J | CC BY-SA 4.0 |