Yes indeed it looks like a GPU problem:
could be GPU working at unstable voltages, check if the PSU can really handle it;
could be driver version bug, try another driver (older ones).
could be overheat, check the gpu temps if they are too high see if the case is well ventilated and check if the gpu coolers are clean.
could be other problems but i bet on one of the above.