Ah I figured it out. I eventually gave up, and believed it was a faulty PSU. I decided to give it 1 more try. And what I had discovered was the RAM was not in all the way. (silly me).
This is the first time seeing that type of RAM slots where you put in 1 corner, and slide the other corner in.