Try replacing the CMOS battery on the motherboard also check for loose capacitors not just leaky/swollen ones on the motherboard, double check all of your connections. The orange ring indicates there is a power issue somewhere
also note; A 'new' PSU does not mean a 'good' PSU - always a chance (small) of the new PSU being faulty
Also, while you are checking your motherboard, if you see a solid amber light beside the plug for the floppy drive turned on...THIS IS A DIFFERENT ONE THAT IS TELLING YOU THAT YOUR DESKTOP IS STILL PLUGGED IN! THIS amber light is not to be confused with the amber error light on the power button of the desktop...it is simply saying, "I am still plugged into the wall and receiving power from the power supply."