Timeline for Downvotes Survey results
Current License: CC BY-SA 4.0
58 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Jun 25, 2022 at 11:12 | comment | added | Peter Mortensen | Four significant digits, for example, "55.61%", does not make sense (suggesting a level of precision that isn't there). Counting statistics alone give a best-case relative uncertainty of about 3%, thus a maximum number of significant digits of about 2. | |
Apr 27, 2021 at 12:08 | history | edited | MachavityMod |
edited tags
|
|
Apr 26, 2021 at 13:41 | comment | added | zcoop98 | A note for @Keith and others, in case they haven't thought of it this way– your personal experience on the site matters and is meaningful, full stop. As an active member of the community, your contributions and opinions are valuable! However, everyone needs to stop and consider the fact that their personal experience is only ever a small slice of the whole picture, and is almost guaranteed not to properly represent the whole. If we're going to truly make our site systems better, we can't afford act on anecdotes and hearsay alone, we have to act on real data that helps us see the whole. | |
Apr 25, 2021 at 19:04 | comment | added | Keith | same thing one last response. I am OLD I didn't say I've been here x years and I am not an abstract me. I am sharing MY experience with the site and not somebody else's. I can ONLY talk about my own experience and I AM trying to help. Being abstract works for art not when talking about real issues. HTH!! | |
Apr 25, 2021 at 18:57 | comment | added | 0Valt | @Keith - one comment and wrapping up to avoid chit-chat: but you, as others, are pretty happy to share the conclusions, right? Without any hint of analyzing the bigger picture. My/your experience is not going to work on a network visited by millions of users that uses free work of a much smaller number of volunteers. We just can't afford talking experience. Note that I am not a proponent of the current system, btw. P.s. please, can we not bring "I am here for X years" and "I am too old for discussion" into this? When you post something, you (an abstract "you") should be ready to defend it. | |
Apr 25, 2021 at 18:51 | comment | added | Keith | Well this space is 2 small :( and spending the next few hours digging up multiple occurrences isn't going to be productive since I'll find a few and then you'll say well it's only a few. I can only share MY experience with you. I can't help, if you choose NOT to accept what I say. I'm to OLD to get into long debates over important things that are dismissed. | |
Apr 25, 2021 at 18:42 | comment | added | 0Valt | @Keith, so, can you present these sitings then? I am not trying to dismiss concerns, I know there are problems. But what I really dislike is "my word - your word" style of debate. Believe it or not, what you talk about is not my experience. But we cannot figure out what's right or wrong because you assert something you don't provide data for Re: agenda - this wasn't part of the response to you per se, rather to people trying to turn this into a collection of anecdotes "I've been downvoted before, the system is broken". | |
Apr 25, 2021 at 18:35 | comment | added | Keith | @OlegValter - This isn't rhetoric, it is based on real sitings of issues. Of course you can respond but the users down vote you for that as well. IOW: You can't really respond. This isn't about an agenda either. I'm suggesting the current implementation of downvoting is dysfunctional and isn't productive for a well run web site. Lastly, if you're not interested in taking feed back while you are providing results then what can I say. Being open is part of a survey process. BTW: I spent almost 10 years in marketing research... I know the process. I am not mad and I am trying to help. | |
Apr 25, 2021 at 12:00 | comment | added | 0Valt | oh, and one more thing: please, stop highjacking the post about the results of the downvotes survey to further one's own agenda | |
Apr 25, 2021 at 11:37 | comment | added | 0Valt | @Keith - the question I ask everyone: care to give a couple of examples? I am willing to go through each and every one of them and assess whether they represent the problem at hand or not. Anecdotal evidence is, in my opinion, the worst kind of rhetoric there is when talking about a problematic practice. P.s. "without rep can't respond" - not true in the slightest. A user can always respond on their posts and they always can edit their posts regardless of the rep. | |
Apr 25, 2021 at 7:16 | answer | added | lys | timeline score: -6 | |
Apr 24, 2021 at 8:07 | comment | added | Keith | I don't believe these results represent what I see. I see people down voting because they don't like the formatting of the article, the paragraph sizes, because the writer is new to the system, because they don't use code blocks etc etc. Also the comments left behind are not on topic and often relate to their pet peeve on the system. All of which does not help resolve the main question/issue. The system is not balanced in that way. People without rep can't respond and get the these behaviors fixed. Instead people with rep rip on those that don't have rep. | |
Apr 22, 2021 at 12:00 | answer | added | musicamante | timeline score: 8 | |
Apr 21, 2021 at 16:08 | answer | added | Jeff Schaller | timeline score: 8 | |
Apr 21, 2021 at 14:51 | answer | added | SpoonMeiser | timeline score: 23 | |
Apr 18, 2021 at 16:01 | answer | added | einpoklum | timeline score: 6 | |
Apr 17, 2021 at 6:19 | comment | added | GuidoG | I also have the feeling that quesionts that have a few downvotes already, are easily downvoted more by people visiting the question without even reading it or making up their own mind. It's like, oh so many downvotes, this must be a bad question, let's downvote also.... and then they continue to another question | |
Apr 17, 2021 at 2:15 | comment | added | 0Valt | @AnitaTaylor - eh, thanks for engaging anyway (despite the high chance when the numbers confirm what you already know that they fell prey to confirmation bias, it is nice to see that people at least follow the rules or think this is expected of them to follow when downvoting)! To second mike here, please do consider the request (or escalate to those who make the decision) of making an anonymized and/or redacted data available - regardless of the outcome, it is an invaluable data source for anyone curious enough to spend some time doing data "munching". | |
Apr 16, 2021 at 13:33 | comment | added | Michael Heil | @AnitaTaylor Would it make sense to publish the data you have gathered after removing all person related information? That way everyone can analyse and tell a story based on their own background. Usually when this kind of data gets analysed and reported from one party it does not tell the whole story as statistics are dependent on who is telling the story. | |
Apr 15, 2021 at 17:04 | comment | added | Anita Taylor StaffMod | @OlegValter On the raw responses, people mostly elaborated on the quality theme -- e.g., they were downvoting because an answer was incorrect or a question was homework, which I've summarized above. Nothing else was a major factor. | |
Apr 15, 2021 at 6:13 | comment | added | 0Valt | @AmirhosseinTarmast - so, you are basing a statement about the most common case on the experience of one person on one (or a small set) of questions, am I correct? | |
Apr 15, 2021 at 4:57 | comment | added | 0Valt | @AnitaTaylor "We won't be sharing the raw open-ended responses" - that's a pity, I think we here on MSO can take some profanity :) It would also be useful in determining whether the claims of DVs being a hostile act have a substance behind them. "included the main takeaways" - so, nothing especially interesting in those responses then (unexpected reasons, prevalence of emotional response, etc)? | |
Apr 15, 2021 at 4:54 | comment | added | 0Valt | @AnitaTaylor "we did track anonymous vs. registered" - just for clarification purposes: did the research track the first dismissal only, or the percentage can include those who were presented the survey multiple times and chose to dismiss the survey? | |
Apr 14, 2021 at 23:06 | comment | added | Anita Taylor StaffMod | @zcoop98 The 56.5% includes both anonymous and registered users. The table that shows reputation bands only includes registered users, as they are the only ones with reputation. | |
Apr 14, 2021 at 22:53 | comment | added | zcoop98 | @AnitaTaylor Thanks! One more question– The intro mentions that "56.5% [of respondents] actually had the downvote privilege," but the table right below it shows that 63.1% of respondents had 125+ reputation. Am I misunderstanding that first statement, or is there a mistype here somewhere? | |
Apr 14, 2021 at 22:38 | comment | added | Anita Taylor StaffMod | @zcoop98 We didn't track dismissal rate by rep level, but we did track anonymous vs. registered. 53% of anonymous users dismissed the survey vs. 50.2% of registered users. Registered users were much more likely to complete the survey (16.3%) vs. anonymous users (0.4%). | |
Apr 14, 2021 at 22:23 | comment | added | zcoop98 | @AnitaTaylor Were other stats on the dismissal rate recorded? In other words, do we know whether a certain rep. group was more likely to take/ dismiss the survey over another? | |
Apr 14, 2021 at 19:32 | answer | added | Braiam | timeline score: 12 | |
Apr 14, 2021 at 16:40 | comment | added | Anita Taylor StaffMod | @KevinB The monthly Site Satisfacton Survey is advertised at the top of the page. (I am confirming internally whether it also appears in the left nav, where Teams advertising appears.) It is probably luck of the draw in your case -- we heavily sample traffic to ensure we only get 1K responses from anonymous users and 1K from registered users. | |
Apr 14, 2021 at 16:26 | comment | added | Anita Taylor StaffMod | @LawrenceCherone 3% of people who saw the modal took the survey and 52.7% dismissed it | |
Apr 14, 2021 at 16:22 | comment | added | Anita Taylor StaffMod | @OlegValter We won't be sharing the raw open-ended responses. (Our researcher didn't feel comfortable because there's some bad language.) I've already included the main takeaways from the open ends in the writeup. | |
Apr 14, 2021 at 14:19 | comment | added | TylerH | @PM2Ring I regularly click them on sites where I don't have 125 reputation but content is bad/wrong, so that at the very least it is recorded in the site data published each year. | |
Apr 14, 2021 at 10:33 | answer | added | nvoigt | timeline score: -3 | |
Apr 14, 2021 at 10:28 | comment | added | NoDataDumpNoContribution | This survey seems to show that people should demonstrate more research, put in more effort and formulate more clearly when posting question and answers if they want to avoid downvotes. If the goal of further studies is to make people more aware of that, I'm all for it. I hope you can come up with good ideas. Some larger singposts maybe ("If you do not show research, you'll get downvoted!"). Maybe a brainstorming on meta would also help. For a moment I thought that the company simply wants to abolish downvotes, when the downvote survey was announced. Luckily this does not seem to be the case. | |
Apr 14, 2021 at 9:27 | answer | added | Dalija PrasnikarMod | timeline score: 82 | |
Apr 14, 2021 at 9:18 | comment | added | Dalija Prasnikar Mod | @PM2Ring That is because Tour does not tell you about any limitations. You learn about them when you try to upvote or downvote without having sufficient reputation. While not being able to vote will not get you in any trouble, other uninformed actions may - and this is the core issues here. Users are not presented with rules, they don't even know there are rules, let alone punishments. | |
Apr 14, 2021 at 8:23 | comment | added | PM 2Ring | @charlietfl I'm not surprised that some people without sufficient rep click the up or down vote buttons (I sometimes do it accidentally myself on HNQ questions on sites that I'm not a member of). But I am surprised that the number is so high: I expected it to be more like 2 or 3%, max. I guess that indicates that there are a lot of people casually using SO who don't have a clue how it works. FWIW, I was reading SO answers for a couple of years before I decided to join, and I didn't bother reading any of the Help info before I joined (but I did read the Tour before making my first post). | |
Apr 13, 2021 at 23:11 | comment | added | 0Valt | @AnitaTaylor - eh, too bad, it would be a valuable data point, but it is understandable. Btw, as mentioned above, is there a way to get an analysis of custom voting reasons (or as a raw data dump)? I am sure there are some very useful insights in the real reasons why people downvote posts. | |
Apr 13, 2021 at 22:52 | comment | added | Anita Taylor StaffMod | @OlegValter We didn't break 2K+ category down further. To protect anonymity, we passed rep as the bands in the first table vs. raw rep numbers. | |
Apr 13, 2021 at 22:47 | comment | added | Anita Taylor StaffMod | @KevinB We sampled downvote clicks at 10% and excluded users who received an invitation to take the Site Satisfaction Survey within the last 90 days, those who previously dismissed the Downvote Survey invitation, and those who previously clicked through to the survey. It was per vote, not first vote. | |
Apr 13, 2021 at 22:38 | comment | added | Braiam | @charlietfl these are taken for anonymous feedback. We are trying to capture the intention behind the click, not whenever the user is capable. | |
Apr 13, 2021 at 22:38 | comment | added | 0Valt | oh, and another thing - it would also be nice to break 2K+ category into 2K, 5K, and 10K (maybe even 20K) as my gut feeling tells me the numbers should go higher the more rep the responder has, but cannot confirm that from the current breakdown. | |
Apr 13, 2021 at 22:28 | comment | added | charlietfl | I'm trying to digest how about 40% of responses are from people who don't even have capability to down vote due to rep < 125. Or am I missing something? | |
Apr 13, 2021 at 22:24 | comment | added | 0Valt | It is slightly disappointing (the data, not the research itself) that the results are as expected, but it is really nice to have a breakdown of the usual reasons for downvoting - this is tangible and a basis for something more constructive than anecdotal evidence. It would be great if we could also have a breakdown of the "Other" option (at least a high-level overview or a selection of more peculiar reasons). 30% means quite a few people had something else to say about why they voted this way. | |
Apr 13, 2021 at 22:05 | answer | added | Mad Scientist | timeline score: 111 | |
Apr 13, 2021 at 21:44 | history | became hot meta post | |||
Apr 13, 2021 at 21:28 | answer | added | akuzminykh | timeline score: 76 | |
Apr 13, 2021 at 21:21 | history | edited | MachavityMod |
edited tags
|
|
Apr 13, 2021 at 21:13 | comment | added | Jonas Wilms | Does downvoting more often increase the probability of being in the survey? Or did 10% of users get the popup? | |
Apr 13, 2021 at 21:08 | comment | added | Braiam | @Dharman This is water is wet. And as always: it's good to have data to confirm our believes. | |
Apr 13, 2021 at 20:58 | comment | added | Jonas Wilms | How do you know which users use the downvote privilege? | |
Apr 13, 2021 at 20:51 | comment | added | Kevin B | For overall users, yes, but for users who use the downvote privilege? | |
Apr 13, 2021 at 20:51 | comment | added | Jonas Wilms | @kevin b If I'm not mistaken, >2k+ is even overrepresented in the survey, compared to the user stats stackexchange.com/leagues/1/year/stackoverflow/2021-01-01 | |
Apr 13, 2021 at 20:44 | comment | added | Kevin B | Clever way of hiding how few results came from users over 2k, a rather common trend in most recent SO surveys | |
Apr 13, 2021 at 20:44 | comment | added | zcoop98 | Thank you for releasing and bringing hard data about downvotes to future discussions, whether about onboarding or beyond. I suspect (fear?) that the reaction on Meta will likely be one of "told you so," but there is still incredible value here, because we now have real numbers to reference; downvote data is now no longer purely anecdotal. I like these research initiatives a lot. | |
Apr 13, 2021 at 20:43 | comment | added | Thom A | "Most users downvote because the author didn’t demonstrate enough research or because the post was unclear/unhelpful." That is what the tooltip says the downvote reason is for. I find that there are very few that vote for other reasons; and then it's normally for the user not the content and I doubt someone would admit that they did that (even in a survey). | |
Apr 13, 2021 at 20:41 | comment | added | Dharman Mod | I don't see anything new from these results. We already knew as much. Both downvotes and upvotes have a description when you hover over them. It is a way to rank the content. I wonder how this helps you in making further improvements. | |
Apr 13, 2021 at 20:27 | history | asked | Anita TaylorStaffMod | CC BY-SA 4.0 |