Skip to main content
11 events
when toggle format what by license comment
May 18, 2023 at 19:17 comment added Ben Voigt @Soltius: Both are going to be very concerned with conditional probability of a certain "next word" given previous text and topic (prompt). But the generative task to output the next word which maximizes the conditional probability and the analysis task of returning the conditional probability given an arbitrary "next word" input are very different, and don't even require the model to encode the same information.
May 18, 2023 at 17:43 comment added Soltius @BenVoigt Good point, but even non-generative language models are pre-trained on generative tasks (basically predicting the next work in a sentence), giving them the "detailed model of the input language" you mention. They can then be adapted to other tasks, which can be non-generative (such as your example). So I'd say that LLMs are a subset of generative AI. But it's just fussing over nomenclature anyway.
May 16, 2023 at 19:12 comment added Ben Voigt @Soltius: I am not any type of AI expert, but according to the plan meaning of the terms, there's a lot of overlap between generative AI and LLM, but no superset-subset relationship. For example, calculating a distance metric between two inputs has to benefit from a detailed model of the input language, and I would say the term LLM applies. But it isn't generative. ("Calculating a distance metric" has real applications on StackExchange such as finding duplicate questions, and in the larger world such as plagiarism detection and patent searches)
May 14, 2023 at 3:16 history edited Jonathan Leffler CC BY-SA 4.0
Theses --> these — and sundry other changes
May 11, 2023 at 15:25 comment added Slate StaffMod As for the issue with prompt-created titles -- I think we'll have to wait and see where the pain points are here. We hope it's an edge case, but no way to know until we test. As for your quick analysis request -- it's a good thought, and one I've heard a bit of discussion about internally. Not so quick, though, and probably of more relevance to future projects. I'll see if we can find time to consider it, but probably no full writeup. Thanks for the suggestions.
May 11, 2023 at 14:40 comment added Soltius LLMs are a type of Generative AI : a class of methods trained in a certain way with some characteristics, destined to generate text. Generative AI just means AI which generates stuff (eg pictures such as midjourney)
May 11, 2023 at 6:02 comment added starball oh sorry. for some reason I didn't pick up on the LLM part. Are LLM and "Generative AI" synonymous? (I don't know much of anything technical about this field)
May 11, 2023 at 5:49 comment added Travis J @user - Yes, they are using an LLM. There was an MSE post on this already
May 11, 2023 at 3:18 comment added starball "I am curious what the prompt will be" - do we know that they're using an LLM behind the scenes? And if they are... I wonder how much this'll cost to maintain.
May 10, 2023 at 19:49 history edited Laurel CC BY-SA 4.0
added 1 character in body
May 10, 2023 at 19:39 history answered Travis J CC BY-SA 4.0