Skip to main content
added 1166 characters in body
Source Link
Sobrique
  • 53.4k
  • 3
  • 31
  • 52

Rep is more a measure of activity than skill. It pays to remember this. Usually there is a correlation between 'active' and 'knows how it works here (and is a bit more invested in the community)' which usually means better questions/answers.

But that really all rep means. Even tag score - might well be more a measure of activity than skill.

So for all that - higher rep means I will look twice at an answer that I think is "rubbish" at first glance, just to ensure I'm not missing something profound. But if it genuinely doesn't look 'right' (and assuming I have at least enough supporting knowledge to tell) I'll do what I do with any user - comment requesting clarification/expansion, downvote or vote to close as appropriate.

Now, higher rep might mean I look twice, but it also means I think you should "know better" what makes a good answer/question.

To answer your broader question though - the only way you can avoid bias is to hide the source of it. E.g. obfuscate our magic unicorn points either partially or fully.

Now personally, I don't like 'badge count' anyway - some of the badges are considerably less meaningful than others. But to an extent, the same is true of rep score - you will look at it because it's there, and any conclusion you draw will generate bias.

So perhaps that's a case to say - hide both. Drop the rep score and badge count from the question/answer page. (Still allow it to be viewed if someone looks at a profile though).

The one thing I would still find useful for answering questions is metadata about their behaviour once they get an answer. I'm thinking primarily in terms of distinguishing the low rep users for whom this is their first question, and the low rep users who have a lot of negative scoring questions/answers and can't be bothered to accept.

So maybe something like:

  • Illuminator - more answers than questions.
  • Well received - Questions score / number of questions asks > 1
  • Acceptor - >50% of asked questions have accepted answers.

Rep is more a measure of activity than skill. It pays to remember this. Usually there is a correlation between 'active' and 'knows how it works here (and is a bit more invested in the community)' which usually means better questions/answers.

But that really all rep means. Even tag score - might well be more a measure of activity than skill.

So for all that - higher rep means I will look twice at an answer that I think is "rubbish" at first glance, just to ensure I'm not missing something profound. But if it genuinely doesn't look 'right' (and assuming I have at least enough supporting knowledge to tell) I'll do what I do with any user - comment requesting clarification/expansion, downvote or vote to close as appropriate.

Now, higher rep might mean I look twice, but it also means I think you should "know better" what makes a good answer/question.

Rep is more a measure of activity than skill. It pays to remember this. Usually there is a correlation between 'active' and 'knows how it works here (and is a bit more invested in the community)' which usually means better questions/answers.

But that really all rep means. Even tag score - might well be more a measure of activity than skill.

So for all that - higher rep means I will look twice at an answer that I think is "rubbish" at first glance, just to ensure I'm not missing something profound. But if it genuinely doesn't look 'right' (and assuming I have at least enough supporting knowledge to tell) I'll do what I do with any user - comment requesting clarification/expansion, downvote or vote to close as appropriate.

Now, higher rep might mean I look twice, but it also means I think you should "know better" what makes a good answer/question.

To answer your broader question though - the only way you can avoid bias is to hide the source of it. E.g. obfuscate our magic unicorn points either partially or fully.

Now personally, I don't like 'badge count' anyway - some of the badges are considerably less meaningful than others. But to an extent, the same is true of rep score - you will look at it because it's there, and any conclusion you draw will generate bias.

So perhaps that's a case to say - hide both. Drop the rep score and badge count from the question/answer page. (Still allow it to be viewed if someone looks at a profile though).

The one thing I would still find useful for answering questions is metadata about their behaviour once they get an answer. I'm thinking primarily in terms of distinguishing the low rep users for whom this is their first question, and the low rep users who have a lot of negative scoring questions/answers and can't be bothered to accept.

So maybe something like:

  • Illuminator - more answers than questions.
  • Well received - Questions score / number of questions asks > 1
  • Acceptor - >50% of asked questions have accepted answers.
Source Link
Sobrique
  • 53.4k
  • 3
  • 31
  • 52

Rep is more a measure of activity than skill. It pays to remember this. Usually there is a correlation between 'active' and 'knows how it works here (and is a bit more invested in the community)' which usually means better questions/answers.

But that really all rep means. Even tag score - might well be more a measure of activity than skill.

So for all that - higher rep means I will look twice at an answer that I think is "rubbish" at first glance, just to ensure I'm not missing something profound. But if it genuinely doesn't look 'right' (and assuming I have at least enough supporting knowledge to tell) I'll do what I do with any user - comment requesting clarification/expansion, downvote or vote to close as appropriate.

Now, higher rep might mean I look twice, but it also means I think you should "know better" what makes a good answer/question.