Driver sweeper is not a proper solution. All it does is delete stuff, it does not fix problems. If you switch from AMD to NVidia or vice versa it is always recommended to perform a complete reinstall
By complete reinstall, do you mean I should wipe all my drivers on safemode and install my NVIDIA drives again?
Do you have the latest driver?
I have the latest driver from the NVIDIA site.