To uninstall a video driver, you first have to be booted into the Safe mode (F8).
The operating system can't uninstall a driver when it is in use and when you boot up in normal mode the video driver is in use.
Granted, some driver upgrades are programed to make the change during a reboot. However, not all upgrade programmers are that thoughtful.