There is no rigid requirement; moderators are free to use their own discretion, to a certain extent, in determining what action is merited in such a situation.
The comments would be deleted no matter what. In most situations, that's likely to be the end of it. If the content is particularly problematic, if there's a pattern over time, etc. then other actions may be taken, such as a written warning to the user that will remain visible to other moderators on the user's profile going forward, up to potentially even an account suspension (the time period would vary radically based on the specifics of the situation).
As to being provoked, a moderator is of course able to take such factors into consideration when determining the appropriate action, but do note that, "they insulted me first" does not excuse you also acting inappropriately. A single provoked outburst in a stressful situation is rather unlikely to result in something like an account suspension, but if you make a habit of posting inappropriate comments you're likely to find yourself facing some serious consequences, even if other people are also posting inappropriate comments.