A project to bring CUDA to non-Nvidia GPUs is making major progress — ZLUDA update now has two full-time developers, working on 32-bit PhysX support and LLMs, amongst other things

AMD
(Image credit: AMD)

ZLUDA, a CUDA translation layer that almost closed down last year, but got saved by an unknown party, this week shared an update about its steady technical progress and team expansion over the last quarter, reports Phoronix. The project continues to build out its capabilities to run CUDA workloads on non-Nvidia GPUs; for now, it is more focused on AI rather than on other things. Yet, work has also begun on enabling 32-bit PhysX support, which is required for compatibility with older CUDA-based games.

Perhaps, the most important thing for the ZLUDA project is that its development team has grown from one to two full-time developers working on the project. The second developer, Violet, joined less than a month ago and has already delivered important improvements, particularly in advancing support for large language model (LLM) workloads through the llm.c project, according to the update.

Latest Videos FromTom's Hardware
Anton Shilov
Contributing Writer

Anton Shilov is a contributing writer at Tom’s Hardware. Over the past couple of decades, he has covered everything from CPUs and GPUs to supercomputers and from modern process technologies and latest fab tools to high-tech industry trends.

  • hotaru251
    ngl...i hope this goes well but I fully expect if it does NVIDIA will try their best to shut it down somehow.
    Reply
  • -Fran-
    hotaru251 said:
    ngl...i hope this goes well but I fully expect if it does NVIDIA will try their best to shut it down somehow.
    They already have, kind of, forcing any "pro" user to abide by the TOS, so they can't use ZLUDA for anything and must use nVidia hardware. Because we somehow allow Companies to do that with the hardware we purchase from them.

    Still, that wouldn't be a problem for the regular user at home with non-nVidia hardware.

    Regards.
    Reply
  • Mr Majestyk
    -Fran- said:
    They already have, kind of, forcing any "pro" user to abide by the TOS, so they can't use ZLUDA for anything and must use nVidia hardware. Because we somehow allow Companies to do that with the hardware we purchase from them.

    Still, that wouldn't be a problem for the regular user at home with non-nVidia hardware.

    Regards.
    Why would the user of a Radeon card for example care one bit about Nvidia's TOS?
    Reply
  • -Fran-
    Mr Majestyk said:
    Why would the user of a Radeon card for example care one bit about Nvidia's TOS?
    If they want to use CUDA libraries, they have to care. Specially if they want to re-distribute. It's not a hardware thing, but a software thing. Licencing is the biggest pain for software distribution and usage for Corps. As an end user, you may not care, because it's super hard to enforce, but if nVidia wanted to make your life miserable, they'd sue you, as a consumer, for breaching their TOS under some petty clause (which already exists). In short, you'd get DMCA'd.

    Regards.
    Reply