I find that hard to believe, since it's such an old game, they're likely done fiddling around with bug fixes and optimized code for Skyrim. You likely have an obscure setting enabled that is affecting your performance, like Multisample Transparency Antialiasing, which doesn't work in Skyrim.
Here's a Skyrim tweak guide:
http://www.geforce.com/whats-new/guides/the-elder-scrolls-v-skyrim-tweak-guide?sf2686171=1#1
If you still want to mod your drivers, the Guru3d.com forums have more technical expertise than Tom's Hardware. If you go to any one of the discussions of Nvidia beta drivers, inevitably there will be instructions on how to modify your .inf file, or actual modified .inf files to copy and paste.