First thing to test your RAM with memtest86. http://www.memtest.org/
if you have two sticks test each one separately.
Second thing, take out the GPU and plug the monitor on MB's VGA/DVI port, see what happens.
Third thing, check your Task Manager for any abnormal behavior, like abnormal CPU usage, or abnormal uses of RAM.