I thought if I press Skip my changings or votes getting removed again.
As you have found out, this is not the case.
In the First Posts queue, you can take multiple actions before you are done. This is why there is a separate I'm done button, which only becomes enabled after you have taken at least one action. You don't want to move to the next review until you've done all that you believe to be necessary.
If you take actions and then Skip, your actions will remain; but they will not be added to your review count. You'd effectively be doing more reviews, but they don't count towards your daily reviews or your badges.
As Ilmari Karonen points out in their comment, when you choose Skip the item will remain in the queue, for others to review. You may have taken actions, but they simply don't count as a review. If you choose I'm Done, it counts as having been handled by a reviewer. (Note that most queues require that each item is judged by multiple reviewers; so if it required to be reviewed by 3 people and you were the first, it would still need 2 more people to review it).
Note that there is not actually a limit of 20/40 edits; there is a limit of 20/40 reviews, per queue. These limits were imposed because some people mindlessly clicked their way through the queues to get that badge, causing harm to the site. Review is quality control and must be done with care.
You have found out that you could effectively do more reviewing by using Skip instead of I'm Done, but these will not be counted towards the badge.
Also, in practice, there are other limits. You have a limited number of votes and flags per day. You can also have at most 5 pending edits at the same time. So, even if you Skip everything, you would still be limited in how many actions you took every day.