There are many proposals for changing the rep incentives associated with closing vs answering duplicates. But they either (1) can be gamed, or (2) penalize users who put work into answers on interesting niche questions, for which the duplicate was hard to find.
I have two suggestions, which I'll post separately to allow separate voting. The other is:
First, when asking a question, there is a list of supposedly-similar questions shown after you type a title. After posting a question, links to related questions are provided in the right-hand bar. The quality and relevance of the latter is far better than the former list, probably because it considers both the title and the actual question content. Let's kill the former list completely.
Now I see a similar questions list as I write this suggestion, and it does seem to be updating as I add explanation. That's good. But it's not part of the main workflow like the first list, instead it's shuffled to the side, with colors that make it easy to ignore. In fact, as an experienced member of the site, I assumed1 it was the help-with-Markdown-syntax until I took a closer look. Users who may be new here but familiar with wikis and other Q&A sites are probably thinking the same thing. And there's reverse incentive to go through that list carefully, since it interrupts describing the problem, and also increases the chances of losing my work. And it's still easily ignorable.
So here's what I propose:
Kill the list found from the title only. If the user hasn't bothered putting their title into either google or the stackoverflow.com search field, I don't care about saving them a little time on their writeup.
Take only the first few items from the content-driven similar questions search, give them the space vacated by the other list and the UI that shows whether they've already been answered/accepted. For the 2 which score the highest for relevance, actually show an excerpt. As well as the name, rep, and matching tag badges of the author of the accepted answer.
Make dealing with the similar questions list a mandatory part of the question asking process. The current button changes from "Post Question" to "Submit". At this time the question is saved and becomes accessible from the user's profile. But it is not yet visible to the community via front page, RSS feeds, tags, searches, etc. The asker is then taken through each of the top relevant questions and can either type an short explanation of how their problem is different, or accept a duplicate. When accepting a duplicate, they are given the opportunity to add some search terms to the existing question. Also, the question they've laboriously typed in starts to influence the search system to help find the existing question, even though it's not shown as a redirect to the general public.
Viewers of the question then can see the one-line "why doesn't this apply" explanation for the linked questions when they appear in the auto-generated list, or in the close-as-duplicate interface.
TL;DR version: Make looking at suggested duplicates/related question a mandatory part of asking a question.
1 Actually, I went back and started typing a satire of the usual "why are my question-asking privileges revoked"-type blather that's so common, in order to re-observe the actual user experience. Lo and behold, it WAS the Markdown syntax help before it was the related questions list. In fact, it went through "Types of Questions to Ask" (when adding a title), "How to Tag" (when putting support
in the Tags list), and "How to Format Markdown" (typing the first few lines of the question). All in the same color scheme. I noticed this because I was really looking for the related questions list that I promised shows up. Well, it did eventually show up, after typing about four paragraphs of pseudo-question. Still in the same color scheme. It's no wonder people are tuned out.
There needs to be ONE LIST. It needs to use whichever of (TITLE, TAGS, QUESTION BODY) have been entered so far.