40

I've come across this paper from about a month ago titled Detecting Duplicate Posts in Programming QA Communities via Latent Semantics and Association Rules. It features Stack Overflow as one of its test subjects and claims to have improved the way to find duplicate Q&A.

From its abstract:

Programming community-based question-answering (PCQA) websites such as Stack Overflow enable programmers to find working solutions to their questions. Despite detailed posting guidelines, duplicate questions that have been answered are frequently created. To tackle this problem, Stack Overflow provides a mechanism for reputable users to manually mark duplicate questions. This is a laborious effort, and leads to many duplicate questions remain undetected. Existing duplicate detection methodologies from traditional community based question-answering (CQA) websites are difficult to be adopted directly to PCQA, as PCQA posts often contain source code which is linguistically very different from natural languages. In this paper, we propose a methodology designed for the PCQA domain to detect duplicate questions.

...

Experiments on a range of real-world datasets demonstrate that our method works very well; in some cases over 30% improvement compared to state-of-the-art benchmarks. As a product of one of the proposed features, the association score feature, we have mined a set of associated phrases from duplicate questions on Stack Overflow and open the dataset to the public.

I didn't read most of it yet, but considering the queue we have on Close Votes, the direct application of their method on Stack Exchange site and their claim for results, would it be worthwhile to look into and attempt to implement their method?

Addressing comments:

Are you going to be able to override the robot, or are we going to be slaves to a robot?

From the paper:

A high quality duplication detection system will considerably improve user experience: for inexperienced users creating a new question, it can suggest a related post before posting; for experienced users it can suggest potential duplicate posts for manual verification.

The robot just gives suggestions, there's nothing to override, just to decide.

19
  • 7
    possibly related: Project Reduplication of Deduplication Has Begun! (at MSE)
    – gnat
    Commented May 15, 2017 at 7:08
  • 4
    Interesting note: the paper from this question cites a paper from one of the co-authors of the paper mentioned in the discussion gnat linked to. So, there is definitely some overlap here. Commented May 15, 2017 at 9:32
  • 31
    @Chloe The robot will bring you better duplicate proposals and the human decides if they are really duplicates or not. Commented May 15, 2017 at 11:11
  • 6
    Better duplicate proposals are acceptable.
    – Chloe
    Commented May 15, 2017 at 12:02
  • 5
    SO community would certainly benefit from having mechanisms to detect dupes! meta.stackoverflow.com/questions/343382/…
    – Bhargav Rao Mod
    Commented May 15, 2017 at 16:28
  • @BhargavRao Can you nudge this to the people in charge? Commented May 15, 2017 at 20:10
  • 1
    Welp, we the users of SO, are in charge of the community. :|
    – Bhargav Rao Mod
    Commented May 15, 2017 at 20:11
  • @BhargavRao I was under the impression that this needs to be implemented on the server level. Commented May 15, 2017 at 20:13
  • 1
    You've added a meta post, so the SO devs will have already taken a look at that and might implement it in 6-8 weeks. As community users, we can try to implement this on our side. There's a project in SObotics which was to predict dupes, I've pinged the dev of that community project.
    – Bhargav Rao Mod
    Commented May 15, 2017 at 20:16
  • 2
    The thing that you're missing here is that they are looking into it. This isn't something that can just happen over night. This will take a lot of training, research, and development to implement.
    – user4639281
    Commented May 15, 2017 at 21:19
  • 2
    @TinyGiant Don't think I'm missing that, there was no evidence that they are aware of the paper. If you're talking about gnat's link then it's based on a paper from well over 6 months ago. Looking at the post is something that can happen overnight, though I never expected anything to happen at such a short duration. At best I expected maybe a response like "we'll look at it" or "we know about it" or "we don't want this". Commented May 15, 2017 at 21:48
  • 4
    "for inexperienced users creating a new question, it can suggest a related post before posting" The problem here is a lot of users either don't care or don't understand that their questions are duplicates.
    – TylerH
    Commented May 15, 2017 at 22:58
  • "I not-so-briefly alluded to a collaboration we're kicking off with the University Of Melbourne." (quoted from the first line of the post gnat linked). They are looking into this and have been since well before they posted that. It is going to take a loooong time before there is something viable that can be put into production. They are likely to be fiddling with knobs and flipping switches for 6-8 somethings.
    – user4639281
    Commented May 15, 2017 at 22:59
  • 1
    I think it's a great idea! In fact,there's a data science competition created by Quora and hosted on Kaggle to build such a tool. kaggle.com/c/quora-question-pairs Commented May 16, 2017 at 2:28
  • 2
    Don't hold your breath. We were promised that they were "working" on a redesign of the "Ask Question" page, but there's been absolutely no public activity on that front in months. That would be a bigger-impact, shorter-term change, not to mention would require a lot less research and speculation. Frankly, though I don't have time to read the whole paper, I wonder how much difference there really is between this and the list of "related" questions that gets auto-generated when you type in a title. Even if so, no evidence users pay attention to those; why would a new algorithm change anything?
    – Cody Gray Mod
    Commented May 17, 2017 at 9:07

0

You must log in to answer this question.

Browse other questions tagged .