Your OK with removing the GPU from the system, just do not remove the sticker from the GPU. This is all that the sticker means. It is to prevent people from opening the GPU and causing damage to it.
It sounds like there BIOS is not getting through its POST (Power On Self Test). Certian manufactures of motherboards make them do different things when the POST fails. Some will try to boot three times, then revert the BIOS settings back to default and try again, IF it is unsuccessful it will then turn off. Others will try to boot and if it does not it will bring up a screen saying the overclock attempt failed, even if no overclock was tried, making you enter the BIOS and fix the issue.
In your case it sounds like there is a hardware issue causing the BIOS not to pass POST. Because you were in the system just before the problem happened try the basic things first like: Remove the Ram modules and reseat them making sure they are installed all the way, Insure all the power cords are properly plugged in all the way including the GPU, make sure the GPU is seated all the way in the slot, make sure all SATA cable ends are plugged in to the devices and motherboard properly.
after this is done, Testing after each thing is checked, then you move on to hardware testing. At this point it would be best to get a case speaker that give the trouble code in beeps or if your board has one look at the digital readout code. the trouble code will tell you what component is causing the issue. Try the GPU in a different machine to be sure the GPU is in working order.
Be sure to ground your self before you put your hands in the PC, touch the case or the PSU to discharge the static your body may hold.