The case and power supply are already touching.
May be not the ground wire from inside PS ... Or check your front panel's grounding ... I've seen a few of these myself and I usually replace the switch at the front panel and all is good.