I'd say its a CPU bottleneck, Skyrim doesnt use 4+ cores well and per core performance of the 8320 is lacking.
Really wow i thought this processor would do a lot better than it is. I'm getting about the same performance as i was getting on my Phenom 965 @ 4.0ghz