Sign in with
Sign up | Sign in

Test Methodology

StarCraft II Revisited: How Much Gaming PC Do You Need?
By

The StarCraft II Map Editor allows us to create a large map with a lot of melee units and structures ready to fight. For this purpose, we use the majority of a large 256x256 map space, filling it with different terrain details, including water and fog, and placing 380 melee units, 42 static structures, 96 mineral piles, and six vespine geysers.

All of the units are placed in a position where they will attack enemy units and structures from the get-go, and we’re careful to balance the forces so that the AI remains busy for the better part of a minute, which is perfect for our 60-second benchmark. Testing shows the results are very consistent, so we’re ready to generate some performance numbers.

[EDIT]

Due to a ton of requests, I have posted the Tom's Hardware Benchmark to BATTLE.NET!


TOM'S HARDWARE GUIDE STARCRAFT II BENCHMARK INSTRUCTIONS

The first step is to download and install the FRAPS framerate measuring utility to record the frame rate.
Set FRAPS to record the min/max/avg frame rate for 60 seconds. Do not press the key to begin the FRAPS run just yet.

- Start StarCraft 2, and log in to your battle.net account.
- Select 'MULTI PLAYER' button at the top left side of the screen
- Click the 'CREATE A GAME' button at the bottom right of the screen
- In the 'SEARCH BY NAME' search field, type 'toms'
- Select the 4 player 'Toms Hardware Guide Benchmark' map authored by Cleeve
- Set Game Speed to Normal
- Start Game
- When the game begins, you will immediately see the 'Victory!' message suggesting that the game is over. Click the 'Return to Game' button to begin the benchmark

When I recorded benchmark results, I would center the camera on the Protoss mothership at the center of the map in order to be consistent. To do this, select the mothership, press the CTRL and number 1 key to apply the mothership to group 1, and then press the 1 number key to center the camera on the mothership.

Do this as quickly as possible. As soon as this is done, start the FRAPS utility to begin the 60-second frame rate data collection.

When I take this benchmark, I burn the first results because the initial loading creates a lot of inconsistency. In fact, the first time you can just start the game and wait 60 seconds without using FRAPS. After this, exit the map and immediately re-start it. Repeat this three more times and record those three runs to get an average.

If you alt-tab out of StarCraft 2, you will need to burn another run before recording any results as the game will force everything to re-load into memory to cause lags.

Now, I used this benchmark as a single-player map so there might be some variance there, but as far as I can tell you can't search for a single player map. You might have access to the single player map once you've downloaded the multiplayer custom version, I don't know. The single player is preferable because the game seems to pause until you click the 'return to game' button, where the multiplayer version seems to continue whether or not you press the button.

Have fun! Let me know your results.

[/EDIT]

Ask a Category Expert

Create a new thread in the Reviews comments forum about this subject

Example: Notebook, Android, SSD hard drive

Display all 169 comments.
This thread is closed for comments
Top Comments
  • 20 Hide
    avatar_raq , September 17, 2010 1:28 PM
    A very enjoyable article. Few points:
    1. While the benchmark the author kindly put a lot of effort to make is nice, I believe it's much worse than the worst case scenario for most ppl, most people play online against human opponents or play against the AI in the single player campaign or to get some training before diving into multiplayer. IMHO it should have tuned down a little or the GPU/CPU recommendation should be stated with less certainty. Readers should put that well in mind.

    2. ATI released CCC10.9 after the article was written and it is said to improve the performance while AA is on, but I really have to test this to confirm. If anyone tested the new driver please share the results!

    3. For those whiners about not including their hardware in the piece: STOP! It is near impossible to include all the hardware out there, besides I always noticed that Don is somehow limited on the hardware side, so he only used what cards Gigabyte offered, and that was clearly stated in the article. As for the CPUs he did a comparison of 1, 2, 3 and 4 phenom 2 cores, so this should give you a good idea how the game scales with CPU cores and it is obviously not threaded well enough to make use of Phenom II x6 6 cores.

    Feel free to thumb me down! :) 
  • 16 Hide
    letsgetsteve , September 17, 2010 6:43 AM
    i wish the test was re-run with a bigger overclock so we could see how cpu limited the game really is and what card will really let it stretch its legs.
  • 14 Hide
    letsgetsteve , September 17, 2010 9:31 AM
    gpharmanI run it fine on my X58 Extreme3, core i7 920 @ 3.60ghz. 12GB DDR3 1600, 2 evga GTX470SC in SLI, Win 7 64 @ 1920x1080 with aa maxed on ultra.


    show off :p  care you maybe share some frame rates with your bragging?
Other Comments
  • 2 Hide
    duk3 , September 17, 2010 6:18 AM
    Nice article.
    I wish the i5 750 was included as a comparison.
  • 8 Hide
    Doom3klr , September 17, 2010 6:19 AM
    5770 should run it with a 3 core amd
  • 1 Hide
    ScoobyJooby-Jew , September 17, 2010 6:40 AM
    a 5750+phenom II 945 runs smoothly with a mix of ultra and high settings. no aa.
  • -4 Hide
    L0tus , September 17, 2010 6:40 AM
    Quote:
    The Radeon cards are clearly bested by their similarly-priced GeForce counterparts here.


    Hence why I regret my ATI purchase.

    It's good hardware but the constant driver issues & benchmarks such as these make you think twice.
  • 16 Hide
    letsgetsteve , September 17, 2010 6:43 AM
    i wish the test was re-run with a bigger overclock so we could see how cpu limited the game really is and what card will really let it stretch its legs.
  • -9 Hide
    nativeson8803 , September 17, 2010 6:55 AM
    I wish they would have included my cpu: q9550 OC'd to 3.5Ghz

    Still relevant!
  • 6 Hide
    madass , September 17, 2010 6:58 AM
    Are you guys sure the NV cards didnt beat the radeons due to bigger frame buffer?
  • -6 Hide
    kingnoobe , September 17, 2010 7:17 AM
    I don't reget my ati purchase at all. I'd rather deal with driver issues *which I never seemed to have with ati only nvidia.. for some odd reason*. Then deal with crap hardware with nvidia..

    Of course this is just personal exp.

    Some games will run better with nv, and some better with ati.. Don't really care as long as I can play it smoothly. And usually 1-5 fps don't determine that.
  • 5 Hide
    dingo_d , September 17, 2010 8:03 AM
    Doom3klr5770 should run it with a 3 core amd

    Yep it worked flawlessly on my 5770 1GB + Athlon II X3 435...
  • 8 Hide
    adonn78 , September 17, 2010 8:16 AM
    Why is there not a 5770 in the round up?
  • 2 Hide
    nilfisktun , September 17, 2010 8:43 AM
    Well my E8400 @ 3.6Ghz, and a gtx260 seems more then capeable of playing sc2. I got everything on ultra, and it have allways been running smooth for me. Even in me vs 7 FFA insane AI opponents.
  • -2 Hide
    urlsen , September 17, 2010 8:46 AM
    I run it just fine on my P5b deluxe 1080P,E8400,4 gb ddr2,8800 gts 320mb, win7 64.
  • 1 Hide
    Anonymous , September 17, 2010 8:50 AM
    "Our 6 or their 4" I'll take their 4 any day of the week.
  • 14 Hide
    letsgetsteve , September 17, 2010 9:31 AM
    gpharmanI run it fine on my X58 Extreme3, core i7 920 @ 3.60ghz. 12GB DDR3 1600, 2 evga GTX470SC in SLI, Win 7 64 @ 1920x1080 with aa maxed on ultra.


    show off :p  care you maybe share some frame rates with your bragging?
  • -4 Hide
    krolo , September 17, 2010 9:33 AM
    Yeah i wish my 9550 was in the benchmarks to see how the core2 duo stacks up.
  • 1 Hide
    Anonymous , September 17, 2010 9:45 AM
    I wish the hexa cores from amd were included esp the 1090t
  • 0 Hide
    rockstone1 , September 17, 2010 10:10 AM
    My GTX 260 and Phenom II 940 (overclocked to 3.5 GHz) plays nice with Starcraft 2... Ultra setting at 1920x1080 is beautiful, and I've never seen a slow down.
  • 1 Hide
    scrumworks , September 17, 2010 11:22 AM
    L0tusHence why I regret my ATI purchase.It's good hardware but the constant driver issues & benchmarks such as these make you think twice.


    What driver issues you are talking about? I had none. If you don't care about power consumption, temps and noise then perhaps you should consider Germi.
Display more comments