Either way it's an estimation, which by the very definition of an estimation, is never accurate.
We could consider the number of upvotes and downvotes as the general opinion and extrapolate that to estimate the opinion of voters. If an item had 4 upvotes and 6 downvotes, we can estimate that 40% of voters thought the item was helpful, and extrapolate that to a positive impact on 40% of viewers.
This doesn't account for people who considered voting for the question and deliberately decided it didn't merit a up nor downvote, which is indistinguishable from members who viewed the post and realized it didn't apply to their problem. We could try to resolve this by considering views for members who did not vote, but that would also includes a large number of members who typically don't vote at all, so this count would be overly large.
You could try to compare the question to other questions on SO using some sort of statistical analysis based on number of views and up/down votes. The goal would be to try and determine if question is being viewed in cases where it doesn't apply to the viewer's problem, and thus a disproportionate number of people view it without voting. For example, if a question only got 10 votes and 100,000 views, while most other questions with 10 votes only have ~1,000, then one might estimate that the question with more views is probably turning up in searches where the question doesn't apply.
The other similar approach would be to look across questions with similar number of views, and establish a distribution of voter participation to see if your question is an outlier.
Either way, basically trying to normalize the view counts based on voter participation. It gets more complicated as you consider the impact of non-top answers. Do you calculate voter participation based on the top answer, the question, or the non-top answer you are calculating impact for? Do you also only attribute a percentage of views to the non-top answer based on it's relative net score compared to all the other answers?
So it indeed can certainly be improved, would likely need a statistical approach to do so, but will never be perfect because you can only assume so much from a view count.
I imagine SO devs considered some of these things, and that's probably why they chose a neutral word such as "impact" that doesn't imply positive nor negative connotation. Someone's impact might be a big smoldering black crater on the face of the internet.