dmckeedmckee and Tim StoneTim Stone pretty much nailed it:
It takes time and effort - from the SE staff, the existing moderators, and the community at large - to bring a new moderator up to speed. There are certainly some candidates who could probably hit the ground running, but there's no guarantee they'll be the ones elected... And the more brought on at once, the less time and attention we can devote to each.
The voting system itself works less well with more than three elected moderators. We don't actually let folks cast 10 votes, even though there are 10 candidates in the final round, so as we draw from the pool, fewer people will have voted for them. Increasing the number of votes that can be cast would put more strain on voters.