-24

I'm aware that the creation of question's and answers using ChatGPT is banned for now.

Accepting ChatGPT's shortfalls when producing code solutions and snippets, it does a remarkable job for a model that has not been trained for programming. ChatGPT has been trained to chat and respond like a human. Indeed, the ChatGPT/Stack Overflow problem is that its answers are linguistically convincing and the narratives appear superficially correct (and sometimes are).

Are there any plans or projects to use the data held within Stack Overflow to train a GPT for answering programming questions? Tautologically, it would be the ideal data for training that model.

I am concurrently intrigued and terrified by what might be created.

18
  • 11
    I'm pretty sure that Stack Overflow, among many other website, was used to train it.
    – Thom A
    Commented Jan 10, 2023 at 16:27
  • 19
    Training it on Stack Overflow doesn't solve the core problem, which is that the bot has no way of knowing whether what it cobbles together is correct or nonsense. The most terrifying thing is that people truly have no idea what this technology is, what it does, or how it works. It's little more than a fancy Markov chain generator. It cannot program. Superficial correctness is not sufficient for a compiler.
    – Cody Gray Mod
    Commented Jan 10, 2023 at 16:30
  • 2
    If it were capable of citing sources when producing new answers and revealing possible duplicates when a similar question has been answered, that'd be quite useful indeed.
    – Kevin B
    Commented Jan 10, 2023 at 16:30
  • 4
    That's also very likely part of the problem, @KevinB . Some of the answers on Stack Overflow are truly awful (and written by human beings) and I suspect that ChatGPT had no idea how well (or poorly) those answers were received by the community. I have no doubts that it could easily regurgitate an answer that has some severe security issues, because an answer it was fed contained it.
    – Thom A
    Commented Jan 10, 2023 at 16:35
  • 4
    See Was ChatGPT trained on Stack Overflow data? on AI Stack Exchange. TLDR: Yes it can. Commented Jan 10, 2023 at 16:38
  • 1
    @CodyGray After reading GEB I am convinced that our current computers are not about to become sentient.
    – Jodrell
    Commented Jan 10, 2023 at 16:38
  • Now I'm wondering if this soon to be deleted question is really this bad, or if there is extensive support for a Butlarian Jihad. Yes I know ChatGPT does not think.
    – Jodrell
    Commented Jan 10, 2023 at 16:42
  • 1
    Sarah Connor? No, it's next door.
    – TGrif
    Commented Jan 10, 2023 at 18:20
  • 1
    Context and intent are everything. When we get AI that can grasp that, I hope we get Gort and not Skynet. Commented Jan 10, 2023 at 20:08
  • "Are there any plans or projects" - By whom? and why ask us about it? Commented Jan 11, 2023 at 9:09
  • @KarlKnechtel, because I'm interested in both, if you know of any plans or projects and, what you think about the idea of plans or projects. Specifically, whether you think attempts are futile or, whether you have some philosophical or moral objection.
    – Jodrell
    Commented Jan 11, 2023 at 9:49
  • I mean, why would we have any more idea of the existence of those projects than anywhere else on the internet - for example, some appropriately on-topic subreddit? Perhaps start with a search engine? I would think that most people who attempted a project like that, would have some interest in advertising it, if it weren't purely for personal use or simple curiousity. Commented Jan 11, 2023 at 23:29
  • @user4581301 I'll take Optimus Prime myself.
    – Gimby
    Commented Jan 12, 2023 at 8:59
  • 1
    @Gimby Always wondered about him. Anyone ever run him through the Sieve of Eratosthenes to make sure he lives up to expectations? So many people padding their resumes these days... Commented Jan 12, 2023 at 16:36
  • 1
    "I am concurrently intrigued and terrified by what might be created." - I am terrified that technology such as this will turn the movie Idiocracy into a documentary. Apparently, students are already starting to... "apply" it.
    – Gimby
    Commented Jan 16, 2023 at 10:31

1 Answer 1

12
  1. I believe this bot already was trained on Stack Overflow data.
  2. Having the bot answer questions would indicate that somehow the bot was able to prove that the answer was right, and thus far I have been less than impressed with what the bot has been able to showcase as "correct". So, I don't believe it would be of any value whatsoever to leverage the bot to try to "answer" a question. Answering a question without any basis in fact is not an answer at all.

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .