Yeah, this is a sound common to older power supplies.
You're hearing frequency variations from varying input power (residual energy left in the capacitors) coming from the switching circuitry.
I believe what makes this whole thing audible is vibrations in the transformer/ferrite core that is responsible for converting MAINS voltage to high frequency AC.
But, err... that's just me. Should be fine...