I recently got 500 reputation pts. Now I can review questions. I decided to look at one. It was a "late answers" review and the answer was bad. I downvoted and left a comment explaining why I downvoted and voilà, I have 499 points and now I'm below the threshold and can't review any other questions.
My concern (and I am biased because I only had the chance to use the feature one time) is that the system does not incentivize me to continue reviewing posts and I'm not sure if that was the point of giving me access in the first place.