22

After completing the survey, I discovered through meta posts and chat that I had missed at least two questions. I did not skip these questions, I never saw them at all.

  • Alice/Caroline wants to switch careers.
  • Something involving a "Documentation on Stack Overflow" choice.

While answering the survey, I encountered the navigation bug described here where Next would occasionally go back to the first page. I just clicked through until I got back to the question I was answering. Additionally, I had the problem with the percent complete being off.

I linked my profile during the survey, if that can help find and diagnose the issue.

I understand that some questions are context sensitive or randomized, but given the other navigation issues I want to confirm that it was intentional and not a bug.

6
  • 7
    Can't remember those two questions either, but I think some questions are conditional and only shown based on what you answered in a previous question. For example, I answered that I taught myself a programming language and after that got asked about how I did it, or I answered that I'm a student and got a question related to that later. Commented Jan 12, 2017 at 19:19
  • I considered that some questions might deliberately not appear, but given the other bugs I wanted to be sure. Neither of these seemed particularly context-sensitive.
    – davidism
    Commented Jan 12, 2017 at 19:24
  • 12
    From Would you like to test the 2017 Developer Survey?: "This year some questions are only asked of a subset of survey takers based on previous responses or randomly assigned groups." So... Potentially the case? I have no idea how the Alice/Caroline question (which I also didn't see) could be context based at all, same as you.
    – Kendra
    Commented Jan 12, 2017 at 19:28
  • I got questions about Robert and another male name, but not Alice/Caroline. Maybe there's an algorithm that's assigning each survey taker a gender and presenting Robert or Alice or Pat based on that? These questions appeared before the actual "how do you identify" demographic question.
    – shoover
    Commented Jan 12, 2017 at 20:06
  • Those issues (next button / percent bar) seems more a SurveyMonkey bug than SO's fault. Regarding the missing questions, you may have answered something that triggered a different sub-set of questions.
    – Zanon
    Commented Jan 12, 2017 at 23:38
  • 1
    Perhaps, depending on one's background, it wouldn't be relevant to give advice to Bob/Alice/Caroline/Robert. Suppose you don't have much work experience, then how would it be relevant for you give career advice to Bob-Alice?
    – Lundin
    Commented Jan 13, 2017 at 13:41

1 Answer 1

7

I'm not quite sure how Stack Overflow structured the survey, but in Survey Monkey you can use questions using Skipping Logic, therefore skipping some questions or even triggering different kinds of questions.

Here is Survey Monkey Docs on Question Skip Logic

Regards to finish at 57% or at 44%, it really seems like a Survey Monkey bug, and as stated in other Question's comment by a mod, the progress bar will be removed.

7
  • Thanks, I understand that you can set up skip questions in surveys, and I know that the percent thing was a bug, but this doesn't really answer my question, it just restates information.
    – davidism
    Commented Jan 13, 2017 at 14:59
  • Well I confirmed the bug from progress bar.
    – dippas
    Commented Jan 13, 2017 at 15:01
  • OK, but that wasn't my question. I linked the percentage issue in my question, it had already been confirmed.
    – davidism
    Commented Jan 13, 2017 at 15:02
  • @davidism I see what you're getting at, but the way your question is worded, dippas's answer appears to answer it. I think the question you are trying to ask is more along the lines of "Assuming the following questions are conditional, what are the trigger conditions for them?" or something like that. If the answer is "No, those aren't conditional.", then you have a bug. Otherwise, you can check your answers with the triggers.
    – tehDorf
    Commented Jan 13, 2017 at 22:22
  • @tehDorf The answer I'm looking for is an employee to say "you didn't miss anything due to the navigation bugs" or "you did miss something".
    – davidism
    Commented Jan 13, 2017 at 22:23
  • @davidism Unless those questions are not conditional, I don't think you are going to get an answer because your question is too narrow - it only applies to you. I wouldn't imagine an employee taking the time to go look up your individual questionnaire and review it for errors. It seems likely those questions were conditional, and a lot of people are probably curious about the conditional questions, so you'll probably get more interest (and an answer) if you rephrase your question.
    – tehDorf
    Commented Jan 13, 2017 at 22:32
  • @tehDorf thanks, but I'm explicitly not interested in the conditional questions except as they pertain to "there was no error, that was normal conditional question behavior". Given that the other navigation errors affected everyone during the first hour, I don't think it just applies to me, even if it doesn't apply to everyone.
    – davidism
    Commented Jan 13, 2017 at 22:37

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .