Im with Emil
Skyrim is a VERY CPU bound game.
You can tell if you have a CPU bottleneck if your CPU in Task Manager is at a constant %99-%100 while your GPU is around say %50 or so while playing. Have to take Skyrim's Built in V-Sync into account though in this case
DO NOT turn off V-Sync in skyrim. Things become very bad with the games Physics Engine as well as quests becoming broken. Your best bet is to force triple buffering in your GPU Control panel for Skyrim to remove a bit of the input lag
Whats the version of your Video Driver out of curiosity?