Deleting your key and taking down your service would prevent further compromise of your system, but if your private key was already stolen, it wouldn't stop an attacker from continuing to announce your key and running an imposter service.