Welcome to Tom's Hardware Forums,
I'm assuming we are talking about a desktop or tower here.
Can you isolate the source of the high pitch sound? The most likely source is the power supply - usually a coil within. If the power supply is the source, you'll most likely need to replace it.
If the source is other than the power supply, you'll need to explain but that's where I would look first.