The billing dashboard appears to indicate that you only pay for "active" users:
Who counts as an "active" user?
Active users are defined as any Stack Overflow for Teams users that have not been deactivated.
In the admin dashboard, under "members" you click "manage", you can see all active/inactive users and deactivate any user that you would like.