I agree: why have different types of separators?
They should be consistent with a site's design: MSE's design doesn't use separators, so why does the new comment layout have them?
MSE design:

MSE comment layout:

Fixed:

This should definitely be fixed.
In the meantime, however, I've created a userscript that implements your suggested change on each SE site to follow the design of its toolbars.
The only snag I ran into with your suggestion was that the separator is still present when the comments don't overflow. It is merely hidden with the addendum dno
to the class name, so you have to check to make sure that that is not present before changing the span
's class (which would make it unnecessarily visible).
Trying to get around the way that Stack Exchange's dev team has implemented the show/hide behavior has created quite a few versions that try to replicate the proper workings of the comment system (see the revision history), but I've rewritten it in a way that should comply with SE's design and be future-proof (version 2.0). Until/if this is (not) fixed, the userscript should, for all intents and purposes, work the way that toolbars (share/edit/close/delete/flag) do on all sites in the network.
It makes the separator look like this (for SO):

That's much more in line with the separators for the toolbar:
