No, this is not a good idea.
Bans from the review queue are meant to say:
You are not doing this well. Go away, and come back when you have the time to think.
They are meant to stop you making mistakes, not just limit your mistakes to other queues.
All three review queues are logically separate from each other in each aspect:
That's not really true. The primary thing you're meant to be bringing to each review is the same: attention to what you're being asked to review. If you are consistently not paying attention to First Posts or Triage why should the system assume you're going to be paying attention to Late Answers or Suggested Edits?
The reason behind same is that each kind of review needs different skill sets.
Not really. The only "different" queue currently is Help & Improvement -- but I don't think that has audits, so it's not really relevant. The only "skill" required in most cases is reading. Remember, if you don't know what to do, press skip. Skip should be your default option.
Right now, I am banned from reviews because I reviewed one latest answers wrongly. So I should be banned from reviewing late answers.
Well... you don't get banned for a single failed audit. And I'm fairly sure this isn't your first ban. Furthermore, in a comment you say:
but i opened question in other tab and i mostly messed up by reading other answer this time
If you opened the question in another tab, it should have been blindingly obvious that this was a review -- the answer you were being asked to evaluate would either be highly-upvoted or deleted. That even then you didn't make the right decision demonstrates you are not paying attention.
The reason that the review queues share a ban is because if you do badly on audits, it's a good indicator that you probably do badly in other reviews.
Please can anyone explain why it's different in the case of review as compared to badges.
Because the two are only tangentially related. You get badges for completing 1, 250 and 1000 reviews in each queue because they want to incentivize people to do reviews across all of the queues. You get bans for failing review audits (or at the discretion of ♦ Moderators if they notice you've done something particularly ridiculous).