Meet The 2012 Graphics Charts: How We're Testing This Year

DirectX 9 Game Benchmarks

The King Is Dead, Long Live the King?

Even though DirectX 9 ceased to be state-of-the-art on the PC a long time ago, it still has a commanding presence in the market due to games that were primarily written for consoles. In addition to those titles, there are DirectX 9 classics that are still widely played. Therefore, we've picked three games to represent the old DirectX 9 API.

Crysis 2: DirectX 9

Crysis 2 is a fairly recent game that we run both in DirectX 9 and DirectX 11 mode (with HD textures). This also gives us a good frame of reference for evaluating scaling from DX 9 to 11, and that's a fairly unique capability of this title.

We test both Crysis 2 modes with the Adrenaline benchmark tool at preset levels appropriate for each graphics card category.

Preset Level
Resolution
Settings
Entry
1280x720
DirectX 9, Quality: High, Anti-aliasing: Off, High-Res Textures: Off
Performance
1920x1080
DirectX 9, Quality: Extreme, Anti-aliasing: Edge Blur, High-Res Textures: Off
Extreme
2560x1440
DirectX 9, Quality: Ultra, Anti-aliasing: Edge AA, High-Res Textures: On


Grand Theft Auto IV EFLC

GTA IV is an open-world classic that's still being played today. However, we want to point out that the game is not programmed optimally, and even an overclocked Core i7 processor starts to limit the game’s performance when a high-performance graphics card is run at low-quality settings. Anything that performs better than a GeForce GTX 570 is slowed down by our CPU. This is another reason why you should only assess a graphics processor's performance with well-balanced settings. It isn't useful to compare high-end cards at entry-level quality settings.

Preset Level
ResolutionSettings
Entry
1280x720
DirectX 9, Texture quality: Low, Reflections: Low, Water: Low, Shadows: Low, Anisotropy: x4, Distance (1+2): 25, Traffic: 25
Performance
1920x1080
DirectX 9, Texture quality: High, Reflections: High, Water: Middle, Shadows: Middle, Anisotropy: x8, Distance (1+2): 35, Traffic: 35
Extreme
2560x1440
DirectX 9, Texture quality: Highest, Reflections: Highest, Water: Highest, Shadows: Highest, Anisotropy: x16, Distance (1+2): 50, Traffic: 50


Mafia 2

Mafia 2 is a valuable addition to our benchmark suite, as it is still demanding of even current high-end graphics cards, so long as the quality settings are high enough (and even though the game is just a console port). Downloadable content keeps luring players back to this title.

Preset Level
Resolution
Settings
Entry
1280x720
Anti-aliasing: Off, Anisotropy: x4, Shadows: Low, Ambient occlusion: Off, Geometry: Low
Performance
1920x1080
Anti-aliasing: On, Anisotropy: x8, Shadows: Normal, Ambient occlusion: On, Geometry: Normal
Extreme
2560x1440
Anti-aliasing: On, Anisotropy: x6, Shadows: High, Ambient occlusion: On, Geometry: High


Next, we look at our DirectX 11 benchmarks.

Create a new thread in the US Reviews comments forum about this subject
This thread is closed for comments
85 comments
Comment from the forums
    Your comment
    Top Comments
  • quixoticism
    I would have preferred to see all the benchmarks at 1920x1080 done with maxed out graphics settings.
    I want to see how the base performance is in games with full detail, and save the heavy AA and resolutions for extreme.
  • johnny_utah
    While I love the new techniques, using BITCOIN to bench GPUGPU performance instead of Folding @ Home? Um, okay.
  • randomkid
    Where's the 5760x1080? In the area where I come from, 3x 1920x1080p 22" monitor cost around the same or even less than a single 2560x1440/1600 27" monitor so this is a more likely configuration among gamers.

    The 5760x1080 resolution will also push the GPU's harder than a 2560x1440/1600 could so why limit the resolution there?
  • Other Comments
  • johnny_utah
    While I love the new techniques, using BITCOIN to bench GPUGPU performance instead of Folding @ Home? Um, okay.
  • Anonymous
    Still with the bar charts? Would *love* to see scatter plots with price/score on the axes... So much more useful in picking out a card.
  • AznCracker
    Man the charts are dying to be updated. Too bad it isn't done more often since it takes a lot of work.
  • Anonymous
    You havent added how many cheese wheels it can run in skyrim as a benchmark... wth?
  • DjEaZy
    ... i like the pile of card's @ the end of the article.... a beautiful pile...
  • pharoahhalfdead
    johnny_utahWhile I love the new techniques, using BITCOIN to bench GPUGPU performance instead of Folding @ Home? Um, okay.


    I agree. I know Tom's spends a lot of time benchmarking, but Folding@home is something that is a bit more common. I would love to see F@H in some articles.

    BTW, I appreciate all the work you guys do.
  • randomkid
    Where's the 5760x1080? In the area where I come from, 3x 1920x1080p 22" monitor cost around the same or even less than a single 2560x1440/1600 27" monitor so this is a more likely configuration among gamers.

    The 5760x1080 resolution will also push the GPU's harder than a 2560x1440/1600 could so why limit the resolution there?
  • Anonymous
    Quote:
    We'll add up to 20 new boards each month until the lower end of the performance range is filled out, too.

    How far back in GPU generations are you going to test, if at all? I saw the power consumption charts and could only see GTX 500, 600 and Radeon 6000, 7000 series. I have an EVGA GTX 480 SC for two years and do like to know how it compares to the newer series of GPUs. Much appreciated.
  • Yargnit
    MMO FanYup no surprise here typical Nvidia benchmark suite fuck sakes.


    So what would YOU like to see used then? If they were trying to push Nvidia wouldn't Hawx 2 be in the suite?
  • shinym
    For Starcraft II you say "This game doesn't stress the CPU, and is thus well-suited for GPU benchmarking." Looks like you got CPU and GPU mixed up there.
  • cangelini
    shinymFor Starcraft II you say "This game doesn't stress the CPU, and is thus well-suited for GPU benchmarking." Looks like you got CPU and GPU mixed up there.

    More than likely, it's the sequence the German team picked that is less CPU-bound than other StarCraft II tests we've used.
  • CaedenV
    CommieIBankerStill with the bar charts? Would *love* to see scatter plots with price/score on the axes... So much more useful in picking out a card.

    I would love something like this as well, but as Tom's has a world wide market and the prices vary so greatly from place to place such charts become impractical.

    What I miss about the old charts is that you could easily compare old GPUs to new ones. When upgrading I think people like to have a reference of what they currently have compared to what they are looking at getting. To throw in a few old cards like the 8600GT, 8/9800GT in the mix may help people feel more secure in their purchases, and have a better feel for what they are getting because they can relate the new card to their old one. Not saying Tom's needs to put in every single card from every generation, but a card or 2 from each generation from the last 6 years or so would be nice.

    Another thing I would like is something like Anandtech's bench where when you select your cards you get bar graphs instead of raw numbers in a chart. It is just easier to visually see a 1/3rd difference in performance on a line graph rather than in raw numbers.
  • quixoticism
    I would have preferred to see all the benchmarks at 1920x1080 done with maxed out graphics settings.
    I want to see how the base performance is in games with full detail, and save the heavy AA and resolutions for extreme.
  • CaedenV
    while speaking of comparison chart complaints:
    -Some cards (though not all) show up as their name, others have a picture of the card with a sales link, and others give very little information at all. It would be nice to make this consistent so that at the top of each column we could see the pic (if available), the name of the card, and then a sales link (hey, you have to pay of the site somehow)

    -organize the comparison charts a little. On the comparison page it just throws all the charts together with no apparent rhyme or reason. It would be nice to have groupings such as physical considerations (temps, noise, and power usage), gpgpu benchmarks, and game benchmarks sorted either by game.

    -Could we add physical dimensions? It would be helpful to some to know how long a card is, and now many slots it takes.

    -lastly, under "02 - Unigine Heaven DirectX 11 Performance 1920x1080, 4xAA, AFx16 Shaders medium Tessellation normal" the "score in" has a blank spot to enter in text (pretty sure it should say 'FPS' here) followed by a broken "Go" link.

    None of these changes should be all that hard to make, and would make the charts much simpler to use when comparing specific cards.
  • Anonymous
    Glad to see Bitcoin Mining being included now.
  • kyuuketsuki
    quixoticismI would have preferred to see all the benchmarks at 1920x1080 done with maxed out graphics settings.I want to see how the base performance is in games with full detail, and save the heavy AA and resolutions for extreme.

    This. I, along with probably a large chunk of your readers, are probably more interested in performance at maxed out settings at 1080p than skipping from mid-range settings at 1080p to maxed out settings at higher resolutions.
  • MMO Fan
    yargnitSo what would YOU like to see used then? If they were trying to push Nvidia wouldn't Hawx 2 be in the suite?

    Now that would just be to obvious.
  • Anonymous
    Thanks for your work Guys,reading trough since long time and each rig has been built based upon your tests!
    Gabriel
  • devBunny
    "What would you rather listen to, a low hum or a high-pitched whine at the same loudness?"

    Lol. Good question. My tinnitus gives me a couple of the lows and several highs (but, just for fun and to keep me noticing them, the pitch and loudness vary). To be honest, I'd rather not hear any of them! ;O)
  • devBunny
    Dear Tom's

    Regarding charts, I think it's way past time that you provided dynamic, configurable graphs generated from the data rather than static images. Images are fine if that's all that the web savvy that a site has. Surely Tom's is better than that?! [tease, tease] ;o)

    I'd like graphs that have options, including choice of colours (I sometimes can't easily see the difference between the colours that you use) and scale (so that I don't have to opening images in another tab and manually enlarging them to read the finer details).

    Someone above mentioned scatter diagrams. And why not, if that would suit him? A page that downloads the data rather than an image has scope for creating whatever kind of graph can help represent the data meaningfully.

    Tom's, I invite you to kill me with kindness. ;-)

    ps. By "dynamic", I don't mean animated. That's pointless, even annoying, eye candy. It's only necessary to show the data more clearly, in a form that people prefer.