Should capture-group and regex-group be synonyms?
No. Capture groups are not the only regex groups out there. While capture groups are commonly used, there are also non-capture groups and atomic groups. (You can find an outline of regex groups in Reference - What does this regex mean?) Regex groups are more general (as suggested in the tag wiki of regex-group) while capture groups are more specific (as suggested in the tag wiki of capturing-group). The situation could also be illustrated with sets.

We can translate this to "all capture groups are regex groups but not all regex groups are capture groups". This suggests a non-synonym. If the terms were synonyms, the sets A and B would be equal (to an extent?). But this is not the case here.
Should they actually exist at all?
Sure, why not? From the tag help page:
Tags are a means of connecting experts with questions they will be able to answer by sorting questions into specific, well-defined categories.
Tags can also be used to help you identify questions that are interesting or relevant to you.
(emphasis added)
Regex groups and capture groups are both specific, well-defined categories. (so)
is a regex group (assume the parentheses are escaped properly). \bso\b
isn't a regex group. Well-defined. (so)
is a capture group. (?:so)
isn't. Well-defined.
People wanting to know more about regex groups and capture groups can also look up the tags individually. The search becomes more difficult without tags to categorise questions into.