I think, in case of asking, or even polite application, it's ok. You can just answer yes or no.
You started commenting, so he understands that you can help him. Every other reader of the question thinks the same. So discussion in comments can be treated as as your readyness to help and other people can start skipping this question as there is already someone who wants to answer.
Explicit question about timing and explicit answer "no" resets skipping of the question by other users, so it is useful and has nothing bad.
You don't need special politeness or long descriptions, it's just a piece of information, helping other people to deside if they care to unswer the question or they should wait for your answer first.
I could just easily answer yes or no but that doesn't stop him from doing it again. I don't think people skip questions when I just ask for clarification, or am I wrong?
It depends.
If I treat some comments as preparation for the answer and I understand that answering or understanding of the question requires some amount of time, it's very possible that I wouldn't be doing it at least for some period of time. Maybe I'll add question to favourites to see the answer latter, or just leave the browser tab open, or even close it. But if I don't see something especially interesting in this question, I won't start answering it immediately even if I would've start in case of no comments.
So clarifiing comments are reducing likelihood of other users response and explicit question about time with answer "no" just resets this effect.