If you uninstall all of your drivers, you will also uninstall GeForce Experience. That is if you actually wipe all of nVidia programs and not just delete the video card from device manager.
Once you re-load the drivers the audio for HDMI will get re-installed, same as they were installed the first time the drivers were installed.
You may be asking the wrong question though, why are you doing this in the first place?