Windows 10 installs a driver for your GPU initially. So you might still have to do a fresh install.
Or, don't install your graphics driver, just do Windows 10 updates and reboot until you have no more updates. Then when you're done with them, you can try to install the GPU driver from their website. And make sure you download the exact driver for your GPU, Nvidia doesn't let you install drivers unless it can detect compatible GPU, not sure about AMD.