I work closely with the developers and designer of the Documentation project. Meta isn't our only method of tracking bugs, but it is our primary method. I can't speak for other teams, but I believe much of what I say is applicable to them as well.
For history, Jeff Atwood began collecting bug reports on UserVoice. It prioritized issues based on a restricted voting system that didn't seem particularly useful. But it did collect a bunch of feedback for the developers to use in planning future work. In 2009, Jeff created the first meta which replaced UserVoice. Over time a system of tagging was built up around the core Q&A features. This allowed developers to track bugs using Stack Exchange question filters to see meta posts across the network.1
As a community manager, I often hear from people who have bug reports. Unless I can fix the problem myself, I always point people to meta. That has two immediate benefits:
- Often the bug has already been reported, so going to meta helps detect duplicates.
- Other users can give immediate feedback.
It also has an obvious drawback for the reporting user: bug reports are may get buried among many others on meta. However, it's important to note that the same problem would occur with we had some other bug tracking system because Stack Overflow is a relatively lean organization when measured by developers per user.
After a bug2 is posted on meta, it's trajectory varies widely. Some bugs are fixed even before they are posted. Other bugs languish forever. I know this is a frustrating situation. Jeff used to slap status-declined with a terse answer whenever something came along that wouldn't get an immediate fix. I find that equally frustrating, so I tend to not reply to meta posts when I'm not ready to give them my full attention.
In order to avoid overlooking bugs, the dev team assigns one person to "bug duty" each week. That person monitors meta for any new problems and goes back to fix old problems that weren't addressed. I don't know what criteria people use to find bugs (my guess is it varies) but the likely suspects are votes, age and activity. As far as I know, nobody pays much attention to bounties.
On the Documentation project, each week I suggest meta posts for the team to tackle. I look for questions on this meta tagged [documentation] [bug] -[status-*]
. Then I scan through the newest posts that I might have missed and check the top scoring posts to find the most important bugs to fix. Then I do the same thing for feature-requests. I take a few of those posts and drop them on an internal Trello board so that we can talk about them in our weekly call.
Sometimes the result of our internal discussion is that we aren't going to fix the problem. In those cases, one of us will write up an answer and decline the request on meta. More often, the developer who fixes the bug will mark the request completed and write up an answer explaining the fix. Not only does that drop the question out of our filters, it also helps us be transparent about things that have changed. Finally, we do occasional updates give an overview of recent progress and let the community know about changes that weren't requested on meta.
Of course, the above doesn't answer the question of whether this system is optimal. It seems to me that the answer to that question depends entirely on your goals. For a large, community-run, programmer-focused network, I'd say the first goal is to make it easy for users to report and triage bugs. Generally votes are a good indication of which requests are bothering people, which is why I often sort by score. And since we are all familiar with the Q&A format, it's just about as easy to start a bug report as I can imagine.
However there are other possible goals for a bug system:
- transparency
- accountability
- progress tracking
- change history
Meta has a mixed record when it comes to these goals. Most often you'll see the input (in the form of meta questions) and the output (in the form of meta answers), but none of the in-between steps. We don't often let you know we are working on a problem until it's been fixed. As a result, the community doesn't know what we are up to most of the time.
Again, notice the problem isn't with the tool. Rather it's with the discipline required to make those things happen. I worked for years on a project that used a fully-featured issue tracker that integrated with our version control system. The tool promised to make problems of transparency and accountability go away. But our team, including managers, testers, programmers and system administrators alike, failed to use it as intended. As a result, our issue tracking system didn't live up to its promise. A tool is only as good as the use that it's put to.
That said, here's a blurb we put in a job ad for a VP of Product:
We like to work in public. Not only does that mean being open within the company about what the product team is building, we also try and bring the developer community in as soon as we’re able.
So keeping the community involved continues to be a priority for us. We hope to do a better job in the future.
Footnotes:
We have a more flexible internal tool to filter meta posts now, but the basic functionality is the same.
Or feature request. Most of what I say about one applies to the other. These are often less binary categories than we might hope.