Participation in the election Q&A is completely voluntary - this is asserted in the first stage of the processfirst stage of the process, which I'd quote except it's not only in the first couple lines but also I already said it above just before that hyphen.
It's not necessarily true that people who haven't answered yet don't plan to answer - sometimes for example the candidates are busy through the particular workweek that we host them, so it's not until the weekend that they can dedicate proper time.
But again, ultimate point - completely voluntary. We do it as a side thing for people to get-to-know the candidates on a more direct aspect with regards to questions that the community wants to have answers to. Whether you let their decision to or not to answer on the thread affect your vote, that's pretty fair. Since that in itself is a way to know something about your candidate, perhaps.