Alright, so I posted this here because I assumed this issue would be associated with my GPU(Radeon 7950)
I was getting 40FPS in whiterun and riverwood and it was pretty aggravating so I decided to mess around with the settings to see what was giving me the most performance hit.
I lowered absolutely EVERYTHING and found that increasing my Object Fade past 3-4 give me a huge hit. I can literally lower every single settings but put Object Fade up and will be getting a bad frame-rate. I am not sure if anyone else is having this issue; I just assume maybe it was something common in AMD cards.
I have tried 12.7/12.8 and am currently using 12.9 beta of catalyst and all of them give the same results.