Sometimes, organizations don't communicate very well internally. Over the years, we've found this to be particularly true when it comes to large software companies working on the same project, or university students working on (at least) similar long-term assignments.
What happens is we end up with quite a few questions that should generally be closed as duplicates, but volume is often a big problem with the efficacy of any system. To start chipping away at this problem, we're going to be testing a new system over the next few weeks.
What does this system do?
It keeps track of what happens to questions that are asked from what appear to be people strongly related to one another in endeavor. Network 'neighborhoodness' is a big signal here, but there are other signals that we might be able to eventually put to some use.
When we detect that folks might be throwing themselves at a wall organizationally, we have the option of:
- Being more targeted about what goes right past triage and straight into another queue
- What probably isn't a good candidate question to show someone that's poking through a tag feed looking for things to answer
- Sending a "We're pretty sure people working with you just asked this whole stack of relevant questions, go look?" message to users we detect repeating questions (possibly)
- We have to see.
What does testing entail?
We go off of signals like posts being closed for various reasons. Similar to our anti-abuse system, certain events carry more certainty, some less, some won't really show how useful they are until we look at aggregate data.
We're going to be messing with lots of knobs while we bring the system up beyond the passive looking that it has been doing.
What could go wrong?
Well, if there's a duck, plenty. But we're pretty sure the worst case possibility is you occasionally see something in review that obviously doesn't belong there. We won't be using the data this system collects to alter how questions are shown on the site in the near or immediate future as far as we know.
I have a question or saw something funky happen
Leave an answer, and we'll get right on it.
When does this start?
Monday, June 26. Ending date to be determined for now. Most people should not notice anything different while we take some time to make sure everything works. Once that happens, we'll share what we found, and our plans on going forward.
Planned for the network, or just Stack Overflow?
If it tests and works well and there's merit, we're not opposed to giving it to sites where it might help. However, this is a question we're probably not ready to answer for a while as there's still a bunch of work to be done.