AMD confirms it is working on an AI upscaler for gaming – CTO Papermaster says it's part of 'AI enabling our entire portfolio'

AMD
(Image credit: AMD)

AMD's CTO Mark Papermaster announced in an interview that AMD will be enabling AI-based upscaling on its gaming devices in the future. Papermaster's statement confirms that AMD is potentially reworking its FidelityFX Super Resolution (FSR)-based upscaler to incorporate an AI-based upscaling solution to compete with Nvidia and Intel's DLSS and XeSS technologies. 

The interviewer asked what Papermaster wants people to know about the company's focus in 2024, to which he replied:

"Well, this for us is a huge year because we have spent so many years developing our hardware and software capabilities for AI. We've just completed AI enabling our entire portfolio. So, cloud, edge, PCs, our gaming devices, we're enabling our gaming devices to upscale with AI...."

According to Papermaster, it appears AMD is implementing AI-upscaling as a company-wide initiative to get all of its applications "AI-ified" rather than implementing it for the sole purpose of being more competitive in the upscaling space — particularly against Nvidia's DLSS tech. Nonetheless, with the introduction of AMD's XDNA NPUs in its latest Ryzen desktop and mobile APUs, it makes sense that AMD would go this route. Adding AI to all of its software portfolio will help increase the adoption rate of its new NPU-equipped APUs.

That said, AI-based upscaling will still be a huge shift for FSR, representing the next major update for the upscaling technology since FSR 2 came out with temporal upscaling. AI-assisted upscaling should in theory boost FSR's image quality compared to its outgoing FSR 2 implementation right now, potentially enabling FSR to add detail into scenes that was previously not possible. We've learned from Nvidia's DLSS technology that AI-based upscalers can do more than simply upscale resolution. They can also add detail that does not exist, even at native resolution. (This is why some people in the industry say that DLSS looks better than native resolution.)

Currently, AMD's existing FSR upscaling technology relies on a temporal upscaler that utilizes AMD's Edge-Adaptive Spatial Upsampling and Robust Contrast-Adaptive Sharpening. On top of this, FSR also uses a bunch of other functions, such as color space conversions, dithering, and tone mapping to make the upscaled image look as good as possible. Upscaling without any of these techniques will result in a very blurry image.

We don't know how AMD will integrate AI into FSR yet. But there is a possibility it might duplicate what Nvidia has done with its DLSS tech. If this is true, AMD will use a neural network to extrapolate data from in-game frames rendered at substantially higher resolutions than 4K. This data would then be integrated into AMD's Radeon drivers for its FSR AI upscaler to use as a reference point to generate high-quality images in-game.

The big question regarding FSR AI-upscaling is hardware support. If AMD is building its AI-flavored version of FSR for its XDNA NPUs, it might only support Ryzen 8000 series mobile CPUs, Ryzen 8000 series desktop APUs, and its existing Radeon RX 7000 series GPUs (which incorporate AI accelerators.) This would leave much of the existing AMD gaming community left out, particularly the vast majority of desktop users running Ryzen 7000 or older CPUs paired with high-performance Radeon RX 6000 series GPUs or older.

We'll have to wait and see how AMD implements its AI upscaling technology. For all we know, it could just be an alternative upscaler dedicated solely to systems featuring its XDNA NPUs. But on the flip side, it could be a full update to FSR 2 upscaling that works on all system hardware. Hopefully, it is some version of the latter.

Aaron Klotz
Contributing Writer

Aaron Klotz is a contributing writer for Tom’s Hardware, covering news related to computer hardware such as CPUs, and graphics cards.

  • Currently, AMD's existing FSR upscaling technology relies on a spatial upscaler that utilizes AMD's Edge-Adaptive Spatial Upsampling and Robust Contrast-Adaptive Sharpening.

    Nope. Only FSR 1 relied on spatial upscaling, without relying on other data such as frame history or motion vectors. FSR 2 supports temporal data.

    Current-gen FSR 3 technology also uses a combination of super resolution temporal upscaling technology and frame generation/FG.

    Nonetheless, with the introduction of AMD's XDNA NPUs in its latest Ryzen desktop and mobile APUs, it makes sense that AMD would go this route. Adding AI to all of its software portfolio will help increase the adoption rate of its new NPU-equipped APUs.

    If AMD is building its AI-flavored version of FSR for its XDNA NPUs, it might only support Ryzen 8000 series mobile CPUs and Ryzen 8000 series desktop APUs.

    You do realize that apart from NPUs (for accelerated AI enablement), we also have Radeon RX 7000 series RDNA 3 GPUs with AI accelerators ?

    Current-gen RDNA 3 sports dedicated AI acceleration with Wave MMA (matrix multiply-accumulate) instructions, which can help improve AI-based performance and also benefits ray tracing instructions, similar to Nvidia's Tensor cores.

    So will future next-gen iterations of the RDNA arch GPUs, where AI-based upscaling might help.
    Reply
  • TechyInAZ
    Thanks for highlighting the issues. We'll update the article as soon as possible.
    Reply
  • usertests
    For all we know, it could just be an alternative upscaler dedicated solely to systems featuring its XDNA NPUs. But on the flip side, it could be a full update to FSR 2 upscaling that works on all system hardware. Hopefully, it is some version of the latter.
    NPUs already addressed above. I think they should make a clean break from everything older than RDNA3 if that's what it takes to keep up with Nvidia. The older versions will always be available.
    Reply
  • JTWrenn
    Very interested to see quality comparisons on the upscalars. I have a feeling we are going to go back to the AMD Nvidia weird quality fights back when matrox would randomly show up as well. Those FPS numbers look great, but does it hurt quality more? I think we are gonna see a whole lot of numbers and quality tricks with a ton of spikey FPS issues as this fight heats up.
    Reply
  • Sleepy_Hollowed
    I mean… this may help handhelds, but having fake frames and oddities pop around are just not something I’m interested in.
    Reply
  • vijosef
    AMD's FSR is broken. It doesn't sends to the monitor the frames it supposedly generates. It feels slower with FSR than with it.
    People feels it bad and believes that is a lag problem, but it's lost frames.
    Reply
  • shalako33
    As long as it makes full use of the AI accelerators on my 7900xt like it should have the first time i'll be happy. And if they are really focusing on their AI acceleration hardware everything before that is out so they might as well forget about it and move on.
    Reply