If the noise is coming from the power supply itself, you may have something shorting to ground. Usually it's the motherboard making contact on an unused case blister.
Check your wiring, check your motherboard mounts...
If it's coming from the speaker... the others have already give you good suggestions.
--->It ain't better if it don't work<---