Well that is a 7-8 year old CPU right there. Did you install Windows 10 as an upgrade or a clean install? A clean install may do what you need so long as it is a software issue, which I think it is for now.
Are you also running on the original hard drive that came with this rig, or have you replaced it or upgraded to an SSD? 7+ years on the original hard drive is respectable, but if what we are seeing is signs of that hardware starting to go, you may need to replace and you still have to do that clean install.
Make sure you have all your important files and stuff backed up.
First thing though, I would boot into safe mode and do disk cleanup and maybe even defrag. Use that link that maxalge provided, and use that to get rid of the old drivers for your old graphics card. You may have to reboot a few times during this process. If you can get the new drivers installed after that, then great. Also make sure you have the latest drivers for your motherboard, but there is a good chance the manufacturer stopped making them a while ago and are not officially supported in Windows 10.