Weird noise coming from computer

Sounds like coil whine. It could be the power supply, graphics card or even the motherboard. The easiest way to isolate the problem is to use something like a paper towel tube to listen to each device in turn and you should be able tell what is making the noise.

I did some research for you:
I found this on eHow



Identification

The first step to dealing with a noisy video card is to identify which component is the source of the noise. The fan is an obvious candidate, but other components may also be the source of the whine. One easy way to track down the source of the noise is to use an empty paper towel tube or rolled piece of paper as a sort of stethoscope, allowing you to listen directly to different areas of the card and determine where the noise is loudest.
Fan Speed

A whining noise from your card’s fan may simply be a consequence of its design. GPUs become extremely hot under load, requiring powerful fans to dissipate that heat. Some cheaper units use fans that prioritize cooling over quiet, leading to high noise levels under load. If your brand-new card is producing a loud whining noise, you may be able to limit your fan speed to reduce the decibel level, although you should carefully monitor your card’s temperatures any time you alter its cooling characteristics. If you are unable to find a happy medium between temperature and noise, you may be able to replace your fan’s card with a quieter model.
Fan Failure

A sudden increase in noise from an older card fan may indicate a damaged bearing and impending hardware failure. Replacing a dying fan is always better than waiting for complete failure, as if the fan seizes during a gaming session, GPU temperatures can spike substantially. Most modern cards have emergency shutoff features that will terminate processing if temperatures exceed recommended levels, but you always risk damaging your hardware when cooling systems shut down unexpectedly.
Coil Whine

The induction coils on your graphics card may also be causing your noise problem. These units, consisting of coils of tightly wrapped wire, may vibrate slightly under heavy load and produce a whining noise. Normally, the sound they make is too quiet to hear over other noise in the case, but loose wiring or components may enhance the vibration and make the noise loud enough to be annoying. Coil whine is not necessarily a symptom of an impending hardware failure, but if a new card is producing unexplained noises, take the opportunity to return it for replacement or repair, just to be safe.

https://www.ehow.com/info_12194125_loud-whining-noise-graphics-card.html

it can be the HDD
http://www.datacent.com/hard_drive_sounds.php listen to these sounds, are any of them familiar?
other parts of the PC are not capable of making a sound as far as I know except the fans, HDD and internl speaker. it can be a faulty GPU fan too as you mentioned it is coming from the GPU.

Alright. Thank you guys for you time and effort! I really appreciate it! I'm just going to RMA it. This computer is only for home use as I am going back to college in a couple days and won't be able to use it until next weekend anyways!