Sounds like something is arcing within the PSU. My theory is that a capacitor is discharging onto something else in the PSU that shouldn't be.
Moral of the story: DEFINITELY not normal. In fact, it could be very dangerous. Unplug the system and leave it alone until the new PSU arrives. You can fry components and cause fires with arcing PSUs.
You have been warned.