Meta already had a discussion on this here, with a wide range of solutions. Unfortunately, it was a discussion, so 8 years later we still have a horribly wrong outdated answer and not-an-answer as two top answers here, and almost two pages of wrong answers here. Upvotes there are still ticking. Mentioned questions were picked because SO is doing particularly bad at displaying a go-to answer, and I also cared enough to try at least writing a semi-decent answer there.
The proposed solution, partially based on previous discussion:
- Extend "not an answer" flag to mean what it actually sounds like: the answer not attempting to answer the question;
- Put "not an answer" flags into a review queue instead of asking for a moderator attention;
- Add a flag for "wrong/outdated answer" that works in the same way as "close" vote. Upvotes from novices for an answer being "helpful" shouldn't balance on the scales with downvotes for the fact it being completely wrong;
- Show a message "this answer is wrong/outdated" on top if it was flagged several times as such.