What a great question! I'm not sure I have an answer other than: yes, yes we can and yes we absolutely should. It is my supposition that it is also not just a "growing perception" but rather an indisputable fact. If it makes us feel better to call it a "perception" that's fine, but the mere fact that there exists such a "perception" is a problem. I posit that it is not just one-off rude comments or snarky remarks that need addressing but a rather unfortunate large part of the SO ecosystem that needs attention.
I am just a lowly former active asker and (later) answerer of questions on SO. I am a cisgender white male and even I stopped participating in the SO community a number of years ago because I felt excluded. I can't imagine what it must be like to not possess the magic privilege triangle that I do and participate on SO without feeling disheartened by the toxicity that I feel has found a comfortable home on SO.
I openly admit it is easy to sit on the sidelines and shout things like "The community is toxic! It is mean-spirited! It is elitist! It is discriminatory!" but if enough voices exclaim such things, or even (I think) if one voice whispers such things, then perhaps we ought to take a hard look at the community as a whole and see what we can change, then take whatever measures to enact said change. I am using "we" here and not "you" even though I haven't been active on SO for a number of years now, because I believe this duty falls on each of us as SO community members.
I owe a great deal to SO and the knowledge I gained here, and that's one of the main reasons I wanted to contribute back by answering any and all questions I could. I don't post this to simply finger-point or make dissenting remarks, but rather because I still, after all these years, care about SO and its mission as originally laid out all those years ago, and because I do believe SO still has a chance of becoming an inclusive, nice place to ask questions and contribute to a vast database of knowledge if we all pitch in. But only if we admit that perhaps these problems exist, and take measures to make things right, instead of saying things like "well it never happened to me" or "well the bar for nicety has been raised in society" as ways of making ourselves feel better.
I've seen in the past, and see currently even in the remarks on this question, people asking for "hard data" about the exclusionary, elitist, and generally condescending atmosphere that exists on SO. I think that's a valiant pursuit, but quantifying such things with numbers and statistics is insanely difficult and, I believe, misses the point. The mere fact that people are feeling this way and voicing the fact that they are feeling this way should be enough for all of us to realize things need to change.
I'm not even sure I believe the idea that "the bar for being nice" has been moved up over the years as has been suggested in this question's answers. Perhaps though there is some truth to that, and even if there is, what's wrong then with raising the "bar" for the SO community as a whole? Did it ever hurt anyone to take a few moments to re-format your comment or your answer to be a bit more empathetic and compassionate?
For example, put yourself in the shoes of a new SO member who wants to ask a question. Said member has a very good chance her question will get obliterated (read: closed/deleted/) by the community (often with remarks like: "Read about how to ask a question before posting" or "this question has been asked a thousand times already!" or worse) simply because she didn't read every page of SO's stringent guidelines for asking questions.
I understand the goals of such community guidelines and principles are to keep content quality as high as possible, but I firmly believe that compassion, empathy, and inclusiveness do not share mutually exclusive relationships with quality, as has also been suggested in this questions answers/comments. Quite the opposite, in fact. And, even if (gasp) quality were to sometimes take a smaller backseat to compassion and kindness, wouldn't we all benefit? At the end of the day, SO is a community of humans and not computers right? But I guess I come from a mindset that "content quality" (what does that really even mean?) would do well sometimes to take a huge backseat to making people feel welcome and included. That's the only "quality" that matters at the end of the day for me.
My plea to the SO community at large is that we finally take a good hard look at ourselves in the mirror and admit there are things that need to change, and then make those changes.
Finally, in German it is sometimes said: Man kann nicht alle in eine Schublade stecken which roughly translates to: "One can't throw everyone in the same drawer." In other words, I don't want to make the claim that everyone on SO has made the community a toxic place, or that there aren't even people fighting actively in the trenches to help the community become a more inclusive place, I'm simply imploring all of us to realize that SO has a problem, and we all need to do our part to fix it. Jeff & Joel had a brilliant idea with StackOverflow, but they are not infallible, and neither is the community they started. Let's start to make things right.
Update: First, I am somewhat taken aback that the top-rated comment on this answer effectively seems to be saying (at least to me) that it's fine to be a jerk in the name of content quality. Really? Even if in the official SO guidelines to be nice? As the #1 source of QA developer information, is this the best we can do? Is this really how we all feel? Are we really happy with excluding people like this?
Secondly, I don't think we should be conflating the concepts of "being nice" or "being rude" with having compassion. Some of the comments on this answer mentioned that this "answer" is more of a statement of the problem than a solution. I admit that openly. Want concrete things we can do now? Let's rework the "Be Nice" page and get rid of the wishy washy "be nice" or "be rude" vocabulary and replace them with "compassion" and "empathy." Nice and rude are very subjective at the end of the day. One person's nice is another persons nasty. What isn't so subjective is having compassion and empathy, remembering that the person on the other end of the keyboard is a living breathing human being with feelings.
How about an update to moderator / user-mod guidelines as well? Add a suggestion that if you are getting upset about all the "bad questions" you are seeing than maybe it's time for you to step away from the keyboard yourself for a while. A community moderator, whether elected or user-mod, should never let their emotions affect their decisions or comments.
How about a blog post, or a serious of blog posts admitting that there IS indeed a less-than-ideal culture existent on SO and that we want to take, and are taking, measures to rectify it.
How about the staff reaching out to the developer community at large, on channels other than SO, and asking for honest non-SO community feedback. Ask THEM why they feel excluded instead of speculating in the (sometimes) echo-chamber that is SO meta.
Jeff himself mentioned that if we want to become better programmers, we should take ownership and figure out how things might be our fault. I think this is great advice and applies to the SO community as well. Even if we at first think we are doing nothing wrong, how about we take a few steps back and evaluate how we might IN FACT be doing some things wrong?
Will we ever satisfy everyone? No. But that's not what I'm after / the intent of my post. But can we create a welcoming, inclusive, compassionate community? Yes. I really believe we can.
Those are just a few concrete suggestions/ideas I have that may slowly help change the culture and make SO a truly welcoming and inclusive place.