Already tried that.
I solved it! lol...so weird
I overclocked the cpu using the asus suit II to fast then i overclocked to extreme. Then I installed the other 16GB's of RAM. I then discovered that it was running at a lower clock speed around 1300MHz rather than the stock 1600MHz. Its now running smoothly with all 32gb of RAM. So now i put it back to stock cpu clock and RAM clock and all seems to be fine now
I guess its one of those random things were you just need to play around with stuff.