29

When I last checked my profile probably yesterday, the impact was around ~44k. Below screenshot is my current profile statistics.

1.1 million impact

How is it possible to impact so many users in a single day? I assume this is a bug between main and meta site since meta shows that I have reached 0 people (now increased due to this question) although I have answered two questions which have some up votes too. Are the answers not included in the impact score for the meta?


Going through the answers, it indeed seems like a false metric and the score is exaggerated. Probably this meta question could be turned to a feature request for finding difference between answer views from the date it was posted.

Edit: Tunaki deleted his answer but it was worth to answer my question as it contains the reasoning. I will just leave the reasoning here.

Tunaki's answer

7
  • Yes, but this only leaves way to implement addition of average views/day system.
    – m4n0
    Dec 10, 2015 at 5:07
  • 1
    Huh, I didn't know the giant asteroid from Armageddon was on SO. Dec 10, 2015 at 8:39
  • 4
    Same Happened to me also Dec 10, 2015 at 8:48
  • 2
    We need to demote our pride. (I also impacted 1M, which seems too much for me.) Lets cut down those numbers! Dec 10, 2015 at 9:05
  • 1
    @canon Nah, it is a great stat. Just count all those fine hours all users have spend on this. This is what keeps us occupied. We need more stats like this. (I might be bored, or weekend, or both)
    – rene
    Dec 12, 2015 at 16:47
  • @canon what would you expect from data that is not there? If people would see it as a gadget instead of something useful (like that it is a stat) would be the best option.
    – rene
    Dec 12, 2015 at 16:58
  • 1
    @canon I think we have to wait for the documents to be de-classified to fully understand what happened here...that takes 60 to 80 years...
    – rene
    Dec 12, 2015 at 17:39

3 Answers 3

29

This smells fishy. Really fishy.

Let's list the things that we know.

  • The question was asked back in 2009, so it's over 6 and a half years old, or ~2378 days.
  • The question is very popular, with over 1M views.

  • The answer didn't exist until 17 August, which is only 114 days, or 4% of the entire lifespan of the question.

Let's list some likelihoods.

  • The question most likely had the majority of those views early on in its life. A lazy estimate would put the total of views per day at around 446 views/day. I don't believe it's possible to get snapshots of each individual day's views, but if anyone can I'd love to see that too.

The issue here is that you've managed to surge ahead with the supposition that you've helped over a million people with that one answer, when the likelihood is that you've helped closer to 40-50K.

This is why I feel like it's a bug. The amount of time the answer has survived is no indicator of how many people have seen that specific answer. Unfortunately, SEDE doesn't track views on a specific answer, but perhaps they should to come up with a more accurate answer on this.

This opens up this number (which is already flimsy) to be gamed; simply post a good answer on an old question and you count as "reaching" everyone that's viewed that question, even if they haven't viewed your answer.


In case my proposed solution wasn't quite clear, here's what I'm thinking.

The "reached" count you get should only increase based on the estimate of how long the answer was around with respect to the question's views.

Algebraically, it's "simply":

(total question views / total question life in days) * (total answer life in days)

For this case, it would be:

(1062111 views / 2378 days) * (114 days) ~ 50.9K people reached

This would make it more balanced towards answers who've existed more towards the length of the question and those that just showed up. It's still a guess since that doesn't even come close into taking into account votes, but I doubt that would factor heavily into it, considering that the answer has to exist before it can be voted on.

19
  • 4
    I wouldn't call it a bug simply because it's working exactly as intended. However it is definitely a faulty metric, deciding to calculate it that way. It's definitely possible to calculate how many views a question has received since your answer and sum all of those up to get a more accurate "People Reached" number.
    – TylerH
    Dec 9, 2015 at 17:22
  • 20
    I'm more calling out the fact that the metric is faulty. The code itself is doing what it's told, but the metric is woefully skewed.
    – Makoto
    Dec 9, 2015 at 17:23
  • Yes, the impact score is exaggerated, false and should not be counted as it is. There should be some difference between the views for various answer dates.
    – m4n0
    Dec 9, 2015 at 17:27
  • @pnuts: This is a logical bug. Even though it's being told this information, the information doesn't seem right. It's kind of like...integer division, if you want to put a finer point on it...
    – Makoto
    Dec 9, 2015 at 17:54
  • When I posted this answer on a 88k times viewed question, the "helped" count went from 13k to 180k. Given that the question has 1m views, the calculation may be correct. (I am not sure tho) :/ Dec 9, 2015 at 17:55
  • @BhargavRao: The calculation may be more conservative, but we've not seen a case which involved such a popular question before. At least, none spring to mind.
    – Makoto
    Dec 9, 2015 at 17:56
  • 4
    Yep true. On a lighter note, People with more "helped" count usually have more Necromancer badges :) Dec 9, 2015 at 17:58
  • What's the point of that metric anyway? What is its intended purpose? Is it just swag? edit: guess I'll have to read this: meta.stackexchange.com/questions/244534/…
    – Gimby
    Dec 10, 2015 at 8:37
  • 2
    You'll be surprise to see that 50% of the views occurred after march 2014 Dec 10, 2015 at 8:43
  • No method of measuring impact is going to be perfect. There are always going to be outliers like these.
    – Martijn Pieters Mod
    Dec 10, 2015 at 14:31
  • @TylerH et al, SE "views" is just an integer that grows, unlike votes, so, not even SE knows how many views a question had at any point of time.
    – Braiam
    Dec 10, 2015 at 17:09
  • @Braiam It might not "know" now, but it would be trivial to measure.
    – TylerH
    Dec 10, 2015 at 18:34
  • 1
    By tracking the view count when the answer is posted, that number can be subtracted from the total view count with minimal difficulty. Dec 12, 2015 at 2:35
  • 1
    @user1122069: Yes, but the question is how does one begin to track the view count of an answer. If you count it when someone hits the page it's on, that's flimsy and inaccurate. What if the answer is buried on page 6? How much credit does one get for that view? These and other wonderful edge cases have to be teased out before tracking answers can be viable.
    – Makoto
    Dec 12, 2015 at 2:36
  • 1
    @Makoto Count it by subtracting from the total view counts is a good beginning. Of course it is an over-estimation. More accurate counting is not possible due to the enormous amount of data to track/process/store, but it would be easy to reduce the threshold of "helpful answer" on questions with many up-votes. 5 upvotes out of 1 million views isn't that helpful. Various fair heuristics for that can be made, as that calculation is run not very often (once marked helpful, likely stored as a 1 value in DB) Dec 12, 2015 at 2:47
10

In addition to the late-answer effect, I think that a great deal of surprise comes from the sudden transition when an answer gets its 5th upvote, possibly long after being posted. An answer doesn't necessarily have to be posted late for it to take some time getting 5 votes. I've seen at least one other Meta post asking the same question, with the same conclusion of "oh, your answer just hit +5". If the "helpfulness factor" of an answer increased in a more gradual way instead of going from 0% at +4 to 100% at +5, the surprise factor would be reduced by quite a bit.

I don't have a concrete suggestion, just opening this avenue for discussion.

3

Since this was turned into a feature request, no need for this answer anymore!


This is not a bug. This answer of yours was upvoted today and the question was currently seen 1062039 times, i.e. a little more than 1 million times. Now sitting with 5 upvotes, it passed the threshold for being a helpful post. The rules for what is considered a helpful post are here, quoted for convenience:

  • Questions
    • Non-deleted only
  • Answers - Views of the parent question for answers that are:
    • Non-deleted AND
    • Score > 0 AND
    • Also meets one or more of the following criteria:
      • In the top 3 answers OR
      • Is the Accepted Answer OR
      • Score at least 5 OR
      • Has at least 20% of the total vote count

This accounts for the huge gain of impact you noticed.

10
  • Nice, a trick for the impact count maybe! :) I thought that the view count for that answer made little sense since I had answered a lot later. But what about the 0 reach in meta site earlier(Now 7 due to this question)? Are the answers not counted towards the reach count?
    – m4n0
    Dec 9, 2015 at 17:02
  • @ManojKumar Probably because they were not "helpful post" as per the definition above.
    – Tunaki
    Dec 9, 2015 at 17:06
  • 3
    Yes, the post is infinitely helpful, but I still see this as a bug. Those million views didn't appear between 17 August and now.
    – Makoto
    Dec 9, 2015 at 17:09
  • @Makoto Why 17 August? The post just crossed the impact thresold. It wasn't counted before.
    – Tunaki
    Dec 9, 2015 at 17:12
  • 1
    Yes, but the answer in question didn't exist until that point. I'm going to expound on this in an answer in a moment.
    – Makoto
    Dec 9, 2015 at 17:12
  • @Makoto Are you saying that the impact should count the number of views between the date the answer was posted and now?
    – Tunaki
    Dec 9, 2015 at 17:13
  • That would make more sense. Again, I'll be explaining this in a moment.
    – Makoto
    Dec 9, 2015 at 17:14
  • @Makoto OK, waiting for your answer, but the way I read the meta post, this is not how it was designed so I'm not sure we can tell it's a bug. It counts "Views of the parent question for answers" regardless of the date of the answer.
    – Tunaki
    Dec 9, 2015 at 17:17
  • 1
    It's ready for your perusal. If the code does that, then the code is legitimately doing what it's told, but what it's being told feels wrong.
    – Makoto
    Dec 9, 2015 at 17:24
  • @Makoto I agree that the metric is faulty. Perhaps a feature-request would be in order.
    – Tunaki
    Dec 9, 2015 at 17:28

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .