That's a very valid point. I mainly use my rig for games, and don't do any video editing. I play different types of games, though I noticed that I'm particularly having problems running Skyrim, Metro 2033, and BF3 at certain settings at 1920x1200.
Yeah your going to get hammered on Skyrim and BF3 both games are pretty CPU intensive so having a dual core going to cause issues.
You might wanna shop around for a upgrade to your processor if you want to max out those games.