No, you can't remove it. Badges are awarded automatically, and they're cool because:
you receive badges for being especially helpful
I can imagine you're not happy with your questionquestion earning a TumbleweedTumbleweed badge, but trust me, it is pretty hard to do so intentionally. Actually, Tumbleweed is more of a 'consolation' badge. Just note that by no means it means that it is a bad question.