Improving Nvidia RTX 4090 Efficiency Through Power Limiting

RTX 4090 Efficiency Through Power Limiting
(Image credit: Tom's Hardware)

The Nvidia GeForce RTX 4090 delivers new levels of performance, lands at the top of our GPU benchmarks hierarchy, and is the fastest of the best graphics cards. For all that, it's not the most efficient of GPUs, but that's mostly due to design decisions. We can improve efficiency — and potentially reduce the risk of melting 4090 power adapters — through power limiting. This is basically a quick and easy alternative to underclocking and undervolting, and the opposite of overclocking.

For our testing, we've taken Nvidia's RTX 4090 Founders Edition and run it through eight of our most demanding tests to see what happens to performance, clock speeds, temperatures, and power requirements at the various settings. We tested in 10% increments, starting at 120% and dropping down to just 50% to provide the full range of options.

Before we get to the results of our testing, note that without increasing the GPU clock speed, the higher power limits don't really do much for performance. We've tested RTX 4090 overclocking elsewhere and found that in our standard gaming test suite, even at 4K ultra settings, overclocking only increased performance on the RTX 4090 by about 4%. In our more demanding DXR (DirectX Raytracing) test suite, however, overclocking proved a bit more helpful and increased performance by about 9% overall.

In short, the more demanding a game happens to be at whatever settings we test with, the more impact we'll see from changing the power limit. Conversely, there are a lot of games that don't tax a GPU like the RTX 4090 much at all, even at 4K and maxed-out settings — Microsoft Flight Simulator is a perfect example of this, given its CPU-limited nature. Such games may run just as fast at lower power limits, but that's because the GPU wasn't hitting its 450W TBP (Total Board Power) limit to begin with.

RTX 4090 Power Limiting Test Setup

Jarred Walton
Senior Editor

Jarred Walton is a senior editor at Tom's Hardware focusing on everything GPU. He has been working as a tech journalist since 2004, writing for AnandTech, Maximum PC, and PC Gamer. From the first S3 Virge '3D decelerators' to today's GPUs, Jarred keeps up with all the latest graphics trends and is the one to ask about game performance.

  • Neilbob
    That looks pretty much conclusive to me. Except for those people who insist they can actually tell the difference between 100FPS and 102FPS, there's no reason not to run this monstrosity in a more power efficient manner.

    I really wish the manufacturers would default to 75-80% (or less) power and let users decide via software/drivers if the extra less-than-5% performance is worth the bother, rather than chasing the performance-at-all- costs-because-benchmarks-are-all-important thing that seems to be going on lately.
    Reply
  • bit_user
    Thanks for testing this, @JarredWaltonGPU ! If I ever got such a beast of a card, I had already planned to put it on a leash. Articles like this one are key for showing us the consequent tradeoffs.
    Reply
  • bit_user
    Neilbob said:
    I really wish the manufacturers would default to 75-80% (or less) power and let users decide via software/drivers if the extra less-than-5% performance is worth the bother, rather than chasing the performance-at-all- costs-because-benchmarks-are-all-important thing that seems to be going on lately.
    In the era of cut-throat benchmark competition, it's unrealistic to expect manufacturers to do this of their own accord.

    I think a good first move would be some kind of energy labeling regulation that requires the energy usage of the default config to be accurately characterized. Similar to how we insist automobiles advertise their fuel-efficiency, according to a prescribed measurement methodology.
    Reply
  • AgentBirdnest
    Wow! Those are really interesting results. I'm not gonna get a 4090, but it's still fascinating to know that I could lower the power by 30% or even 40% in the summer so I don't get cooked in my gaming room, and would only miss out on ~10% performance that I probably wouldn't notice.

    Awesome work, Jarred. I've really wanted to see some tests exactly like this.
    Reply
  • JarredWaltonGPU
    AgentBirdnest said:
    Wow! Those are really interesting results. I'm not gonna get a 4090, but it's still fascinating to know that I could lower the power by 30% or even 40% in the summer so I don't get cooked in my gaming room, and would only miss out on ~10% performance that I probably wouldn't notice.

    Awesome work, Jarred. I've really wanted to see some tests exactly like this.
    There are going to be cases where the losses are larger (ie, Metro Exodus Enhanced), but yeah, Nvidia really stomped on the performance pedal — screw efficiency! Which is interesting as other Ada Lovelace parts (like the RTX 6000 48GB) aren't pushing nearly as hard.
    Reply
  • escksu
    80% looks like a sweet spot
    Reply
  • Very informative and helpful article, @JarredWaltonGPU. Thanks.
    Reply
  • -Fran-
    Yes, let's keep reducing the power of the most expensive hardware we buy going forward to get less performance so we can manage the heat and power outputs. Makes perfect buying sense!

    Why are we allowing Companies to pass that burden to us, again?

    Regards.
    Reply
  • bit_user
    -Fran- said:
    Why are we allowing Companies to pass that burden to us, again?
    Benchmarks, benchmarks, benchmarks! Being the top-performer translates into premium prices and greater sales volume. The temptation to turn up clock speeds just a little more has proven too great form companies to resist.

    For efficiency to be prioritized, the market needs to value it. As I've been saying, a step towards that would be some standardization of metrics that can be used to compare products on that basis.
    Reply
  • _dawn_chorus_
    Great article. I'd love to see a similar one for Raptor lakes13900k/700k/600k.
    The power draw and heat are the two main factors making me hesitant to buy.
    Reply