Overall, I honestly do not think so.
As others have mentioned, the issue is usually due to poor questions being asked and then getting downvoted. However, in my view that's not where the accusations come. It's when the question gets downvoted but no explanation is given as to why.
When I first joined StackoverflowStack Overflow, I get exasperated at this a lot. Sure there's a guidlineguideline, but guidelines don't really explain the problem for your particular question, especially when starting off as a new user; guidelines don't explain how your question is bad,bad; reading thousands of other questions do.
The high rep users complain about accusations of elitism, but they never bothered to give a simple, 5 second explanation on why they downvoted the question and help the new user. If you look at other stack exchangeStack Exchange sites, for example this question on history.stackexchange, a simple 1one-liner was typed up by a veteran user on why the post is downvoted. TookIt took him no more than 5five seconds (although curiously even that exchangeStack Exchange site has something similar to this question).
However, when I got into the flow of how to ask a good question on SOStack Overflow, I've rarely gotten a downvote since even though I'm a relatively new programmer and my questions are quite basic. A super basic C++ question I've asked was graced by not one, but two 100k+ rep users. This to me shows that the community largely isn't elitist, but it is just suffering from lack of communication from the old and the new.
That being said however, I can think of a few users on this site who can be branded as 'elitist' through and through - just read their profiles. One guy is even elitist about his favourite language...