You can have any team admin email us at teams-support@stackoverflow.com requesting the Slack integration be manually removed from the team. This effectively erases everything about your prior Slack integration and returns the settings page to a state as if it had never been installed. We do not currently offer any way to completely erase Slack traces within the admin settings UI.
Note, though, that this doesn't get rid of the Integrations box. It will change the "View notifications" link to be "Connect" instead and also start displaying the Microsoft Teams option, since neither one is installed.