The GPU benchmarks hierarchy 2024: Ten years of graphics card hardware tested and ranked

Our GPU benchmarks hierarchy ranks all the current and previous generation graphics cards by performance, and Tom's Hardware exhaustively benchmarks current and previous generation GPUs, including all of the best graphics cards. Whether it's playing games, running artificial intelligence workloads like Stable Diffusion, or doing professional video editing, your graphics card typically plays the biggest role in determining performance — even the best CPUs for Gaming take a secondary role.

Earlier this year, we had what was likely the final 'refresh' of the current generation GPUs: Nvidia launched the RTX 4070 Super, RTX 4070 Ti Super, and RTX 4080 Super; and AMD released the RX 7600 XT, plus the RX 7900 GRE arrived in the U.S. We don't expect any further shakeups in the GPU hierarchy until the fall, when the Nvidia Blackwell RTX 50-series, Intel Battlemage, and AMD RDNA 4 GPUs may start to arrive — though an early 2025 might be more likely for Nvidia and AMD cards.

We're also looking to revamp our GPU testing, with new games and possibly a switch in platform. After the Core i9-13900K issues we experienced — we eventually RMA'ed our chip — we're now looking toward AMD Zen 5 and Arrow Lake (we'll probably wait for the X3D Zen 5 chips). Until then, our recent reviews use testing from the 13900K testbed with additional games, and we've included those results in the charts at the bottom of the page.

Our full GPU hierarchy using traditional rendering (aka, rasterization) comes first, and below that we have our ray tracing GPU benchmarks hierarchy. Those of course require a ray tracing capable GPU so only AMD's RX 7000/6000-series, Intel's Arc, and Nvidia's RTX cards are present. The results are all without enabling DLSS, FSR, or XeSS on the various cards, mind you.

Nvidia's Ada Lovelace architecture powers its current generation RTX 40-series, with new features like DLSS 3 Frame Generation — and for all RTX cards, Nvidia DLSS 3.5 Ray Reconstruction (which is only used in a few games so far). AMD's RDNA 3 architecture powers the RX 7000-series, with seven desktop cards filling out the product stack. Intel's Arc Alchemist architecture brings a third player into the dedicated GPU party, even if it's more of a competitor to the previous generation midrange offerings.

On page two, you'll find our 2020–2021 benchmark suite, which has all of the previous generation GPUs running our older test suite running on a Core i9-9900K testbed. It's no longer being actively updated. We also have the legacy GPU hierarchy (without benchmarks, sorted by theoretical performance) for reference purposes.

The following tables sort everything solely by our performance-based GPU gaming benchmarks, at 1080p "ultra" for the main suite and at 1080p "medium" for the DXR suite. Factors including price, graphics card power consumption, overall efficiency, and features aren't factored into the rankings here. The current 2024 results use an Alder Lake Core i9-12900K testbed. Now let's hit the benchmarks and tables.

GPU Benchmarks Ranking 2024

Image 1 of 4

For our latest GPU benchmarks, we've tested nearly every GPU released in the past seven years, plus some extras, at 1080p medium and 1080p ultra, and sorted the table by the 1080p ultra results. Where it makes sense, we also test at 1440p ultra and 4K ultra. All of the scores are scaled relative to the top-ranking 1080p ultra card, which in our new suite is the RTX 4090 — especially at 4K and 1440p.

You can also see the above summary chart showing the relative performance of the cards we've tested across the past several generations of hardware at 1080p ultra — swipe through the above gallery if you want to see the 1080p medium, 1440p, and 4K ultra images. There are a few missing options (e.g., the GT 1030, RX 550, and several Titan cards), but otherwise, it's basically complete. Note that we also have data in the table below for some of the other older GPUs.

The eight games we're using for our standard GPU benchmarks hierarchy are Borderlands 3 (DX12), Far Cry 6 (DX12), Flight Simulator (DX11 Nvidia, DX12 AMD/Intel), Forza Horizon 5 (DX12), Horizon Zero Dawn (DX12), Red Dead Redemption 2 (Vulkan), Total War Warhammer 3 (DX11), and Watch Dogs Legion (DX12). The fps score is the geometric mean (equal weighting) of the eight games. Note that the specifications column links directly to our original review for the various GPUs.

GPU Rasterization Hierarchy, Key Takeaways

• Nvidia RTX 4090 takes the top spot but costs almost twice as much as the second place RTX 4080 Super.
• RTX 4090 can encounter CPU bottlenecks at 1440p and especially 1080p.
• New cards typically match previous gen GPUs that are one or two model tiers "higher" (e.g. RTX 4070 Ti vs. RTX 3090 Ti, or RX 6600 XT vs. RX 5700 XT). This is not universally true, however (e.g. RX 7800 XT is only slightly faster than the prior 6800 XT).
• Looking at 1440p, RTX 4080 Super ranks as the most efficient GPU, with other 40-series GPUs rounding out the top ten. AMD's most efficient GPU is the RX 7900 XTX. Intel's Arc GPUs rank near the bottom of the chart in terms of efficiency.
• The best GPU value in FPS per dollar at 1440p is the Arc A580, followed by the RX 6600, Arc A750, RX 6800, and RTX 4060.

*: GPU couldn't run all tests, so the overall score is slightly skewed at 1080p ultra.

While the RTX 4090 does technically take first place at 1080p ultra, it's the 1440p and especially 4K numbers that impress. It's less than 2% faster than the RTX 4080 Super at 1080p ultra, but that increases to 9% at 1440p and then 25% at 4K. Also note that the fps numbers in our table incorporate both the average and minimum fps into a single score — with the average given more weight than the 1% low fps.

Again, keep in mind that we're not including any ray tracing or DLSS results in the above table, as we use the same test suite with the same settings on all current and previous generation graphics cards. Since only RTX cards support DLSS (and RTX 40-series if you want DLSS 3), that would drastically limit which cards we could directly compare. You can see DLSS 2/3 and FSR 2 upscaling results in our RTX 4070 review if you want to check out how the various upscaling modes might help.

Of course the RTX 4090 comes at a steep price, though it's not that much worse than the previous generation RTX 3090. In fact, we'd say it's a lot better in some respects, as the 3090 was only a minor improvement in performance compared to the 3080 at the time of launch, but with more than double the VRAM. Nvidia pulled out all the stops with the 4090, increasing the core counts, clock speeds, and power limits to push it beyond all contenders. There are two problems with the 4090, however: It's not available at MSRP any longer, due to demand from the AI sector — it often costs $2,000 or more — and there are still concerns with pulling 450W of power over the 16-pin connector.

Stepping down from the RTX 4090, the RTX 4080 Super and RX 7900 XTX trade blows at higher resolutions, while CPU bottlenecks come into play at 1080p. We'll be switching to an i9-13900K in the near future, and you can see those results in our latest graphics card reviews as well as in the charts at the bottom of the page.

Outside of the latest releases from AMD and Nvidia, the RX 6000- and RTX 30-series chips still perform reasonably well and if you're using such a card, there may not be any need to upgrade at present. Intel's Arc GPUs also fall into this category and are something of a wild card.

We've been testing and retesting GPUs periodically, and the Arc chips running the latest drivers now complete all of our benchmarks without any major anomalies. (Minecraft was previously a problem, though Intel has finally sorted that out.) They're not great on efficiency, but overall performance and pricing for the A750 is quite good.

Turning to the previous generation GPUs, the RTX 20-series and GTX 16-series chips end up scattered throughout the results, along with the RX 5000-series. The general rule of thumb is that you get one or two "model upgrades" with the newer architectures, so for example the RTX 2080 Super comes in just below the RTX 3060 Ti, while the RX 5700 XT basically matches the newer and less expensive RX 6600 XT.

Go back far enough and you can see how modern games at ultra settings severely punish cards that don't have more than 4GB VRAM. We've been saying for a few years now that 4GB was just scraping by, and these days we'd avoid buying anything with less than 8GB of VRAM — 12GB or more is the minimum we'd want with a mainstream GPU, and 16GB or more for high-end and above. Old cards like the GTX 1060 3GB and GTX 1050 actually failed to run some of our tests, which skews their results a bit, even though they do better at 1080p medium.

Now let's switch over to the ray tracing hierarchy.

Ray Tracing GPU Benchmarks Ranking 2024

Enabling ray tracing, particularly with demanding games like many of those we're using in our DXR test suite, can cause framerates to drop off a cliff. We're testing with "medium" and "ultra" ray tracing settings. Medium generally means using the medium graphics preset but turning on ray tracing effects (set to "medium" if that's an option; otherwise, "on"), while ultra turns on all of the RT options at more or less maximum quality.

Because ray tracing is so much more demanding, we're sorting these results by the 1080p medium scores. That's also because the RX 6500 XT, RX 6400, and Arc A380 basically can't handle ray tracing even at these settings, and testing at anything more than 1080p medium would be fruitless (though we've done 1080p ultra just for fun if you check the charts at the end).

The five ray tracing games we're using are Bright Memory Infinite, Control Ultimate Edition, Cyberpunk 2077, Metro Exodus Enhanced, and Minecraft — all of these use the DirectX 12 / DX12 Ultimate API. The fps score is the geometric mean (equal weighting) of the five games, and the percentage is scaled relative to the fastest GPU in the list, which again is the GeForce RTX 4090.

If you want to see what the future may hold with ray tracing, check out our Alan Wake 2 benchmarks where the full path tracing barely manages playable performance even with upscaling on non-Nvidia GPUs.

Image 1 of 4

GPU Ray Tracing Hierarchy, Key Takeaways

• Nvidia absolutely dominates in ray tracing performance, with the RTX 4070 Super and above taking down AMD's best AMD RX 7900 XTX, which sits at position 11. Intel's Arc A770 lands at number 31.
• DLSS 2 upscaling with quality mode is supported in most ray tracing games and can boost performance an additional 30~50 percent (depending on the game, resolution, and settings used). FSR 2 and XeSS support can provide a similar uplift, but FSR 2 is only in about a third as many games right now, and XeSS support is even less common.
• You'll need an RTX 4070 or RTX 3080 or faster GPU to handle 1080p with maxed out settings at 60 fps or more, which also means Performance mode upscaling can make 4K viable.
• RTX 4080 again ranks as the most efficient GPU, followed by the rest of the 40-series cards. Even the RTX 3060, 3060 Ti, and 3070 rank ahead of AMD's best, which is the RX 7900 XT. Intel's Arc GPUs are still pretty far down the efficiency list, though in DXR they're often better than AMD's RX 6000-series parts.
• The best overall ray tracing "value" in FPS per dollar (at 1080p ultra) goes to the Arc A580 again, followed by the RTX 4060, RTX 4070, Arc A750, and RTX 4060 Ti.

If you felt the RTX 4090 performance was impressive at 4K in our standard test suite, just take a look at the results with ray tracing. Nvidia put even more ray tracing enhancements into the Ada Lovelace architecture, and those start to show up here. There are still further potential performance improvements for ray tracing with SER, OMM, and DMM — not to mention DLSS 3, though that ends up being a bit of a mixed bag, since the generated frames don't include new user input and add latency.

If you want a real kick in the pants, we also ran many of the faster ray tracing GPUs through Cyberpunk 2077's RT Overdrive mode, which implements full "path tracing" (full ray tracing, without any rasterization) — as well as Alan Wake 2, which also uses path tracing at higher settings. That provides a glimpse of how future games could behave, and why upscaling and AI techniques like frame generation are here to stay.

Even at 1080p medium, a relatively tame setting for DXR (DirectX Raytracing), the RTX 4090 roars past all contenders and leads the previous generation RTX 3090 Ti by 41%. At 1080p ultra, the lead grows to 53%, and it's nearly 64% at 1440p. Nvidia made claims before the RTX 4090 launch that it was "2x to 4x faster than the RTX 3090 Ti" — factoring in DLSS 3's Frame Generation technology — but even without DLSS 3, the 4090 is 72% faster than the 3090 Ti at 4K.

AMD continues to relegate DXR and ray tracing to secondary status, focusing more on improving rasterization performance — and on reducing manufacturing costs through the use of chiplets on the new RDNA 3 GPUs. As such, the ray tracing performance from AMD isn't particularly impressive. The top RX 7900 XTX basically matches Nvidia's previous generation RTX 3080 12GB, which puts it barely ahead of the RTX 4070 — and that's not even in all DXR games. There are some minor improvements for RT performance in RDNA 3, though, as the 7800 XT for example ends up basically tied with the RX 6800 XT in rasterization performance but is 10% faster in DXR performance.

Intel's Arc A7-series parts show a decent blend of performance in general, with the A750 coming in ahead of the RTX 3060 overall. With the latest drivers (and with vsync forced off in the options.txt file), Minecraft performance also looks much more in line with the other Arc DXR results.

You can also see what DLSS Quality mode did for performance in DXR games on the RTX 4090 in our review, but the short summary is that it boosted performance by 78% at 4K ultra. DLSS 3 frame generation improved framerates another 30% to 100% in our preview testing, though we recommend exercising (extreme) caution when looking at FPS with the feature enabled. It can dramatically boost framerates in benchmarks, but when actually playing games it often doesn't feel much faster than without the feature.

Overall, with DLSS 2, the 4090 in our ray tracing test suite is nearly four times as fast as AMD's RX 7900 XTX. Ouch. AMD's FSR 2 and FSR 3 can help as well, and AMD continues to work on increasing the rate of adoption, but it still trails DLSS both in the number of games supported and in the overall image quality. Only two of the games in our DXR suite have FSR2 support. By comparison, all of the DXR games we're testing support DLSS2 — and one also supports DLSS3.

Without FSR2, AMD's fastest GPUs can only clear 60 fps at 1080p ultra, while remaining decently playable at 1440p with 40–50 fps on average. But native 4K DXR remains out of reach for just about every GPU, with only the 3090 Ti and above breaking the 30 fps mark on the composite score — and a couple of games still come up short on the 3090 Ti.

AMD also has FSR 3 frame generation. Like DLSS3, it adds latency, and AMD requires the integration of Anti-Lag+ support in games that use FSR 3. But Anti-Lag+ only works with AMD GPUs, which means non-AMD cards will likely incur a larger latency penalty. We've tested it in Avatar: Frontiers of Pandora and found it worked pretty well, but that was not the case in Forspoken and Immortals of Aveum.

The midrange GPUs like the RTX 3070 and RX 6700 XT basically manage 1080p ultra and not much more, while the bottom tier of DXR-capable GPUs barely manage 1080p medium — and the RX 6500 XT can't even do that, with single digit framerates in most of our test suite, and one game that wouldn't even work at our chosen "medium" settings. (Control requires at least 6GB VRAM to let you enable ray tracing.)

Intel's Arc A380 ends up just ahead of the RX 6500 XT in ray tracing performance, which is interesting considering it only has 8 RTUs going up against AMD's 16 Ray Accelerators. Intel posted a deep dive into its ray tracing hardware, and Arc seems reasonably impressive, except for the fact that the number of RTUs severely limits performance. The top-end A770 still only has 32 RTUs, which proves sufficient for it to pull ahead (barely) of the RTX 3060 in DXR testing, but it can't go much further than that. Arc A750 and above also ends up ahead of AMD's RX 6750 XT in DXR performance, showing just how poor AMD's RDNA 2 hardware is when it comes to ray tracing.

It's also interesting to look at the generational performance of Nvidia's RTX cards. The slowest 20-series GPU, the RTX 2060, still outperforms the newer RTX 3050 by a bit, but the fastest RTX 2080 Ti comes in a bit behind the RTX 3070. Where the 2080 Ti basically doubled the performance of the 2060, the 3090 delivers about triple the performance of the 3050.

Test System and How We Test for GPU Benchmarks

We've used two different PCs for our testing. The latest 2022–2024 configuration uses an Alder Lake CPU and platform, while our previous testbed uses Coffee Lake and Z390. Here are the details of the two PCs.

Tom's Hardware 2022–2024 GPU Testbed

Intel Core i9-12900K
MSI Pro Z690-A WiFi DDR4
Corsair 2x16GB DDR4-3600 CL16
Crucial P5 Plus 2TB
Cooler Master MWE 1250 V2 Gold
Cooler Master PL360 Flux
Cooler Master HAF500
Windows 11 Pro 64-bit

Tom's Hardware 2020–2021 GPU Testbed

Intel Core i9-9900K
Corsair H150i Pro RGB
MSI MEG Z390 Ace
Corsair 2x16GB DDR4-3200
XPG SX8200 Pro 2TB
Windows 10 Pro (21H1)

For each graphics card, we follow the same testing procedure. We run one pass of each benchmark to "warm up" the GPU after launching the game, then run at least two passes at each setting/resolution combination. If the two runs are basically identical (within 0.5% or less difference), we use the faster of the two runs. If there's more than a small difference, we run the test at least twice more to determine what "normal" performance is supposed to be.

We also look at all the data and check for anomalies, so for example RTX 3070 Ti, RTX 3070, and RTX 3060 Ti all generally going to perform within a narrow range — 3070 Ti is about 5% faster than 3070, which is about 5% faster than 3060 Ti. If we see games where there are clear outliers (i.e. performance is more than 10% higher for the cards just mentioned), we'll go back and retest whatever cards are showing the anomaly and figure out what the "correct" result would be.

Due to the length of time required for testing each GPU, updated drivers and game patches inevitably will come out that can impact performance. We periodically retest a few sample cards to verify our results are still valid, and if not, we go through and retest the affected game(s) and GPU(s). We may also add games to our test suite over the coming year, if one comes out that is popular and conducive to testing — see our what makes a good game benchmark for our selection criteria.

GPU Benchmarks: Individual Game Charts

The above tables provide a summary of performance, but for those that want to see the individual game charts, for both the standard and ray tracing test suites, we've got those as well. We're only including more recent GPUs in these charts, as otherwise things get very messy. These are also using our new test PC, which changes the performance slightly from the above table, simply because our newest tests are more relevant (but haven't been run on a lot of the older GPUs shown in the tables).

These charts are up to date as of August 13, 2024.

GPU Benchmarks — 1080p Medium

Image 1 of 22

GPU Benchmarks — 1080p Ultra

Image 1 of 22

GPU Benchmarks — 1440p Ultra

Image 1 of 22

GPU Benchmarks — 4K Ultra

Image 1 of 22

GPU Benchmarks — Power, Clocks, and Temperatures

Most of our discussion has focused on performance, but for those interested in power and other aspects of the GPUs, here are the appropriate charts.

Image 1 of 4

Image 1 of 4

Image 1 of 4

If you're looking for the legacy GPU hierarchy, head over to page two! We moved it to a separate page to help improve load times in our CMS as well as for the main website. And if you're looking to comment on the GPU benchmarks hierarchy, head over to our forums and join the discussion!

Choosing a Graphics Card

Which graphics card do you need? To help you decide, we created this GPU benchmarks hierarchy consisting of dozens of GPUs from the past four generations of hardware. Not surprisingly, the fastest cards are from the latest Nvidia Ada Lovelace and AMD RDNA 3 architectures. AMD's graphics cards perform well without ray tracing, but tend to fall behind once RT gets enabled — even more so if you enable DLSS, which you probably should, though FSR2 is a reasonable alternative. GPU prices are finally hitting reasonable levels, however, making it a better time to upgrade.

Of course it's not just about playing games. Many applications use the GPU for other work, and we cover professional GPU benchmarks in our full GPU reviews. But a good graphics card for gaming will typically do equally well in complex GPU computational workloads. Buy one of the top cards and you can run games at high resolutions and frame rates with the effects turned all the way up, and you'll be able to do content creation work as needed. Drop down to the middle and lower portions of the list and you'll need to start dialing down the settings to get acceptable performance in regular game play and GPU benchmarks.

If your main goal is gaming, you can't forget about the CPU. Getting the best possible gaming GPU won't help you much if your CPU is underpowered and/or out of date. So be sure to check out the Best CPUs for gaming page, as well as our CPU Benchmarks Hierarchy to make sure you have the right CPU for the level of gaming you're looking to achieve.