Skip to main content
Rephrase unnecessarily harsh language while maintaining meaning (LLMs cannot effectively fix search); emphasize that the criticism is about messaging; remove mention of a specific person where there's no indication that that specific person was the primary driving force behind this specific decision
Source Link
Ryan M Mod
  • 20k
  • 12
  • 190
  • 217

I have to say that the language you're using in the popup, "New search experience powered by AI" and "leveraging AI to summarize", is offputting and undercuts confidence that stackoverflow knows what it's doing. (Independently of whether using LLM chatbots or what have you will improve search experience, or whether bot summaries cite code properly, etc.) This comes from being keyed in to the current LLM hype cycle, how it's being promoted as "AI", and what that implies vs. what the actual capabilities are.

You're a technical knowledge site whose answers are written by your users, many of whom are sophisticated enough to know that "powered by AI" can mean "we've integrated a LLM somewhere in our site", or "we've integrated what superficially seems like machine intelligence somewhere in our site, but isn't quite there yet so uses human assistance behind the scenes", or even "we want our new feature to catch the eye of gullible investors, so we'll call it ‘AI’". If your users think less of you for the way you're promoting this new search feature, it's going to undercut what gets your users to answer questions here or trust answers as authoritative.

You should be very careful & specific with how you describe these features if you want to maintain trust. As of right now, with the "OverflowAI" messaging, you are not. This comes off as trying to sell snake oil to investors by jamming LLMs into your product. Like other users have mentioned, SO’s search function is not great right now; itthis messaging seems like you're waving AI at it in the hopes that'll fix it. It's a frankly ridiculous and self-defeatingnot an effective way to approach the problem. At this point, I don't trust Prashanth'sthe company's judgement at all, and I doubt I'm the only one.

I have to say that the language you're using in the popup, "New search experience powered by AI" and "leveraging AI to summarize", is offputting and undercuts confidence that stackoverflow knows what it's doing. (Independently of whether using LLM chatbots or what have you will improve search experience, or whether bot summaries cite code properly, etc.) This comes from being keyed in to the current LLM hype cycle, how it's being promoted as "AI", and what that implies vs. what the actual capabilities are.

You're a technical knowledge site whose answers are written by your users, many of whom are sophisticated enough to know that "powered by AI" can mean "we've integrated a LLM somewhere in our site", or "we've integrated what superficially seems like machine intelligence somewhere in our site, but isn't quite there yet so uses human assistance behind the scenes", or even "we want our new feature to catch the eye of gullible investors, so we'll call it ‘AI’". If your users think less of you for the way you're promoting this new search feature, it's going to undercut what gets your users to answer questions here or trust answers as authoritative.

You should be very careful & specific with how you describe these features if you want to maintain trust. As of right now, with the "OverflowAI" messaging, you are not. This comes off as trying to sell snake oil to investors by jamming LLMs into your product. Like other users have mentioned, SO’s search function is not great right now; it seems like you're waving AI at it in the hopes that'll fix it. It's a frankly ridiculous and self-defeating way to approach the problem. At this point, I don't trust Prashanth's judgement at all, and I doubt I'm the only one.

I have to say that the language you're using in the popup, "New search experience powered by AI" and "leveraging AI to summarize", is offputting and undercuts confidence that stackoverflow knows what it's doing. (Independently of whether using LLM chatbots or what have you will improve search experience, or whether bot summaries cite code properly, etc.) This comes from being keyed in to the current LLM hype cycle, how it's being promoted as "AI", and what that implies vs. what the actual capabilities are.

You're a technical knowledge site whose answers are written by your users, many of whom are sophisticated enough to know that "powered by AI" can mean "we've integrated a LLM somewhere in our site", or "we've integrated what superficially seems like machine intelligence somewhere in our site, but isn't quite there yet so uses human assistance behind the scenes", or even "we want our new feature to catch the eye of gullible investors, so we'll call it ‘AI’". If your users think less of you for the way you're promoting this new search feature, it's going to undercut what gets your users to answer questions here or trust answers as authoritative.

You should be very careful & specific with how you describe these features if you want to maintain trust. As of right now, with the "OverflowAI" messaging, you are not. This comes off as trying to sell snake oil to investors by jamming LLMs into your product. Like other users have mentioned, SO’s search function is not great right now; this messaging seems like waving AI at it in the hopes that'll fix it. It's not an effective way to approach the problem. At this point, I don't trust the company's judgement at all, and I doubt I'm the only one.

Source Link

I have to say that the language you're using in the popup, "New search experience powered by AI" and "leveraging AI to summarize", is offputting and undercuts confidence that stackoverflow knows what it's doing. (Independently of whether using LLM chatbots or what have you will improve search experience, or whether bot summaries cite code properly, etc.) This comes from being keyed in to the current LLM hype cycle, how it's being promoted as "AI", and what that implies vs. what the actual capabilities are.

You're a technical knowledge site whose answers are written by your users, many of whom are sophisticated enough to know that "powered by AI" can mean "we've integrated a LLM somewhere in our site", or "we've integrated what superficially seems like machine intelligence somewhere in our site, but isn't quite there yet so uses human assistance behind the scenes", or even "we want our new feature to catch the eye of gullible investors, so we'll call it ‘AI’". If your users think less of you for the way you're promoting this new search feature, it's going to undercut what gets your users to answer questions here or trust answers as authoritative.

You should be very careful & specific with how you describe these features if you want to maintain trust. As of right now, with the "OverflowAI" messaging, you are not. This comes off as trying to sell snake oil to investors by jamming LLMs into your product. Like other users have mentioned, SO’s search function is not great right now; it seems like you're waving AI at it in the hopes that'll fix it. It's a frankly ridiculous and self-defeating way to approach the problem. At this point, I don't trust Prashanth's judgement at all, and I doubt I'm the only one.