perhaps it's not your comp but your ISP/ router ?
I had issues as well until I turned my settings way low, then again my comp is not as good as yours.
Router or ISP speed should have no effect on the game's performance, besides lag in online gaming of course.
Quite honestly, I'm stumped. Are you sure that both your CPU and CPU spin up to maximum clock speeds when you launch the game?