AMD Posts Ryzen AI Software Platform Preview for Developers

AMD Radeon 780M iGPU
(Image credit: AMD)

Although AMD says its Ryzen 7040-series accelerated processing units with the company's Ryzen AI hardware engine have been shipping for well over half of a year now, there were no publicly available tools to make use of it. That changed this week, as AMD posted version 0.8 of its Ryzen AI Software Platform.

AMD's Ryzen AI for Windows is a hardware unit built into the company's Ryzen 7040-series APUs based on the Zen 4 microarchitecture. AMD's Vitis AI offers a robust toolset for AI inference, seamlessly integrating with popular frameworks like TensorFlow, PyTorch, and ONNX.

To optimize models for hardware deployment, AMD provides specialized quantization tools. The ONNX Runtime ensures efficient execution of ONNX models on AMD devices. For a streamlined development experience, AMD offers pre-configured Docker containers tailored to specific frameworks. Moreover, the platform supports integration with popular development environments such as Visual Studio and Python, making AI development easier.

AMD’s posting of Ryzen AI supporting software is timely: The company’s arch-rival Intel is set to introduce its 14th-Gen Core processors codenamed Meteor Lake this month, and one of the defining features of this CPU is indeed AI acceleration. It remains to be seen whether the blue company’s AI engine will work out of the box with programs, but at least some software developers will be able to use AMD’s Ryzen AI engine with their products in the near future. 

AMD’s Ryzen XDNA AI engine is an on-die accelerator designed for lower-intensity AI inference workloads, such as audio, photo, and video processing. It aims to deliver faster response times than online services and is more power-efficient than CPU or GPU-based solutions. The engine can handle up to 4 concurrent AI streams and processes INT8 and bfloat16 instructions. AMD claims this engine is faster than Apple's M2 processor’s neural engine.

Anton Shilov
Contributing Writer

Anton Shilov is a contributing writer at Tom’s Hardware. Over the past couple of decades, he has covered everything from CPUs and GPUs to supercomputers and from modern process technologies and latest fab tools to high-tech industry trends.

  • Brian D Smith
    7040...does that include the laptop versions like the 7945HX? I don't think so...just we weaker versions.
    Reply
  • bit_user
    Brian D Smith said:
    7040...does that include the laptop versions like the 7945HX? I don't think so...just we weaker versions.
    The 7x45-series are basically the same as the desktop Ryzen 7000 chiplet-based processors. Neither of them have Ryzen AI.

    The 7x40-series is monolithic (not chiplet-based) and codenamed Phoenix. It's made on a slightly improved process node, has a bigger iGPU, and includes Ryzen AI.
    Reply