try isolating the noise. Run the computer with the PSU outside the case to see if that's the noisemaker. It sounds lke a case fan vibrating on its mounts.
Its not a fan because I've stopped them all while the noise is going on. And I don't know if you considered $60 cases cheap, but its pretty strong and has strong steel.