Don't worry about having a lot of pending flags, they'll get handled eventually. Depending on the kind of flag, it may get handled by other users (e.g. when a NAA flagged post is deleted via review). Other flags (e.g. "Needs moderator intervention") will need to be handled by a moderator, and that can take some time. Some flags also age away after some time, but there's not much you can do about that.
Of course, you should make sure that you are only raising flags appropriately. For example, don't raise flags for the purpose of boosting your flagging stats. If you're only raising flags for content that needs to be flagged, then you're doing the right thing, and you needn't worry about having a lot of flags that haven't been reviewed yet.