When I press the power buttons, PC boots for two seconds, shuts down itself, and turns back on again and loads Windows fine

Solution
First make sure all cables/wires are connected properly.

Check that the memory, video card, and CPU are seated properly also.

If still having problems, try the PSU in another computer, and/or try another known working PSU.