22

The initial description of the OverflowAI Visual Studio Code extension says:

Meeting users in Slack is helpful, but we wanted to do more. Developers spend a lot of their time in an IDE and Stack Overflow wants to help coders find solutions without breaking their flow. To do that, we’re working on an IDE extension for Visual Studio Code powered by OverflowAI. This extension pulls in validated content from both the public platform and your private Stack Overflow for Teams instance to provide your developers with a personalized summary of how to solve their problems efficiently and effectively, allow them to dig deeper where needed, and then document new learnings and solutions.

Exactly what does the last line mean? Is it just some sort of marketing empty buzzword or does it imply something else? More specifically, does this betray the intention to train the model on the users code in some way? Or it is simply hinting at some way to post an answer directly from inside Visual Studio Code (again, using the user code as an input)?


Thanks to Peter Mortensen’s comment, another line caught my eye:

Highlight code to explain the code.

In order to be able to explain the code, the client extension component has to send the code to some server, probably owned by Prosus. I doubt any company would allow their developers to use an extension that has the ability to "upload" part of the company developed application code to some other company, regardless of the nature of said company. This plug-in already looks like something that will be strictly forbidden in any workplace.

... There is a reason many company tell their employees to NOT use those "Power Point like" online tools to make presentations.

8
  • Related (blog post): Announcing OverflowAI. And Stack Overflow for Visual Studio Code meets you where you work (Stack Overflow Labs) - "The Stack Overflow for Visual Studio Code is a paired programmer that pulls in validated content from Public and Private Stack Overflow to provide developers with a personalized summary of how to efficiently solve problems as well as insights to expand their knowledge." Commented Jul 27, 2023 at 15:59
  • 8
    I'm guessing they are using GPTs to summarize code, a common use case. Pass the code in with a prompt that says "summarize what this code does at a high level" or similar. It's sort of harmless-ish, but also fairly useless in my experience. Having worked on a large codebase that has been completely GPT summarized to create per-file docs, everything it's generated is obvious and non-insightful, so I basically ignore the output at this point.
    – ggorlen
    Commented Jul 27, 2023 at 16:17
  • 1
    @ggorlen still meaning that the code has to be sent to a server, something most IT companies would probably not allow. Commented Jul 27, 2023 at 16:21
  • 1
    @SPArcheon Correct, unless they run the GPT locally or on a company-dedicated private server or something, which is probably prohibitive at present. Also, this sort of feature is already available via CoPilot, I'm pretty sure, although I don't really use CoPilot either.
    – ggorlen
    Commented Jul 27, 2023 at 16:31
  • 7
    @ggorlen when I said "harmless-ish", that's only if it's not dumped on SO as this answer indicates... Also this. So I'd better just call it it harmful given the track record of how people actually use GPTs.
    – ggorlen
    Commented Jul 27, 2023 at 19:15
  • 1
    @ggorlen Does it even correctly summarize it? I’d imagine that, especially for such a large amount of text, it mostly just generates something «random» that somewhat fits with parts of the project? Commented Jul 28, 2023 at 17:37
  • 1
    @AndreasdetestsAIhype I haven't looked at the summaries closely because they're so trivial, but yeah, they probably have the usual hallucinations.
    – ggorlen
    Commented Jul 28, 2023 at 17:57
  • 3
    "This extension pulls in validated content from both the public platform" The word 'validated' by itself here raises so many questions.
    – Mast
    Commented Jul 29, 2023 at 6:58

1 Answer 1

8

I wager it's speaking about the planned feature of the OverflowAI VS Code extension to enable posting AI-generated code explanations to a SOfT or SO.

From WWC23 - Stack Overflow: Community and AI (Mainstage) at t=25:55, at the section where Prashanth is speaking about the explain code feature of the planned VS Code plugin:

Let's say that you had a piece of code you wanted to really get an explanation for the code and you're able to then do that through this mechanism now. You'll get back sort of a short summary of what you're trying to find out or get an explanation for and you're also going to get references from again our data set on where this explanation really was rooted in, right. So this is a really really powerful way for you again to trust and attribute answers from the public community and within stack overflow for teams, and if you think by the way that this was helpful you can create a Q&A, or you can create an article in this case, it's going to suggest tags automatically and you can post it into stack overflow for teams or public stack overflow.

This is also hinted at in The SO Labs "Code Editor" page, but in less detail (does not mention the feature to post to SO, which Prashanth mentioned in his talk):

  • Highlight code to explain the code.
  • Ability to create new questions or articles by creating a draft with tag and title suggestions.

Right now, this will only be available on the Business and Enterprise tier of Stack Overflow for Teams. We’ll explore offering this IDE extension to other tiers in the future.


See also: Will OverflowAI really feature dumping AI code explanations onto Stack Overflow?

1
  • 1
    accepting this answer for now. I'll reconsider in the remove chance that the staff actually post an official statement. I guess you should be pretty safe for the next 6-8 something. Commented Jul 31, 2023 at 7:51

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .