Video card issue?

[iscprz]

So today I was gamin and my computer turned off randomly....i couldnt restart it so then I proceeded to check my hardware to see if anything noticeable was wrong. I felt my video card (nvidia 9800 GT) and it was too hot to touch so i assumed it overheated and let it cool down for a bit. After a while I plugged it back in and the computer lights blinked for a quick second and almost started but it didnt....I unplugged the 6 pin power cable from the video card and the computer started (and the video card had a red light which meant it was missing the power). So why is my computer starting when the video card is removed but not starting when I plug it in with the power supply plugged?

 

[mi1ez]

My thoughts are PSU too. Sounds like it can't provide enough power for GPU and everything else simultaneously.