Adding to the answers already here, Stack Overflow is the most popular Stack Exchange site by several metrics. It really has the most "brand recognition" if you will, and thus attracts a lot of beginners and outsiders.
When Average Joe who doesn't frequent SE sites and isn't that involved has a technical question that would probably be better suited for one of the other sites, he just thinks "Oh, I'll ask it on SO" because it always gets high marks on Google searches, because it's kind of the grandfather of SE sites. Joe would not even think about the other sites, or know they exist.
On top of that, how would he know if his question is better suited for Stack Overflow, Programmers, Code Review, Server Fault, Linux & Unix, Ask Ubuntu, or Super User? He would have to do research, and that's too much work! (admittedly, I am guilty of this sometimes too) And the people who do do their research are probably going to answer that duplicate or off-topic question themselves anyways, so they're weeded out.
Plus sometimes, programming and server administration kind of bleed together, so there's kind of a gray area in the middle somewhere.
That's my take anyways, and is a pretty common theme among these off-topic or duplicate questions I see on SO.
hardware
.perl
, someshell
,awk
,sed
etc. Some of that's Stack Overflow, some is Unix and Linux, some is ServerFault. And I think we've got a DevOps SE in the pipe line too now, and Programmers etc. Stack Overflow does suffer from having a bit too much 'siloing' of completely separate tech stacks - more so that U&L does. Which would almost suggest a language-family based site would be appropriate.