Pat Gelsinger Says Silicon Without Software Support Is a Bug

(Image credit: Intel)

People who are really serious about software should make their own hardware, said Alan Kay, a renowned computer scientist. But according to Intel's chief executive Pat Gelsinger, it works the other way around too: If you want your hardware to succeed, you have to put software first.

Broad software compatibility is a fundamental advantage that Intel's processors have traditionally had over other CPUs both because of the x86 architecture and because Intel has always worked closely with software developers. But as the world is changing, Intel's CEO Pat Gelsinger has to look at software in different ways than his predecessors. On the one hand, Intel must work with a broader ecosystem of independent software vendors (ISVs) than before, and work more closely than before. But on the other hand, Intel's own software could bring new revenue streams to the company.

"One of the things that I've learned in my 11-year 'vacation' [at VMware and EMC] is delivering silicon that isn't supported by software is a bug," said Pat Gelsinger in an interview with CRN. "We have to deliver the software capabilities, and then we have to empower it, accelerate it, make it more secure with hardware underneath it. And to me, this is the big bit flip that I need to drive at Intel."

Making the Intel Software Ecosystem Broader

Intel has always tried to ensure that software would take advantage of its latest hardware by properly supporting all the latest instruction set extensions and other technologies designed to speed up certain workloads. To a large degree, Intel assisted its partners in creating an ecosystem of software optimized for its processors.

That approach was instrumental in empowering Intel's software ecosystem for many years, until accelerated computing emerged in the mid-2000s. Nvidia began to aggressively promote its CUDA platform, whereas other companies relied on various open or proprietary standards like OpenCL, Vulkan, Metal, and OpenAI to speed up performance-hungry workloads with proprietary hardware. Companies like Apple and Nvidia created their own software ecosystems that were not as broad as Intel's but were competitive enough to attract software developers.

Today, loads of artificial intelligence (AI) and high-performance computing (HPC) applications are developed for Nvidia's CUDA platform and therefor require the company's hardware and software stacks. This naturally represents a challenge for Intel and its datacenter CPUs and compute GPUs designed for AI and supercomputers, as now they're on the other side of the equation: They have to compete against an already established ecosystem.

When Raja Koduri joined Intel in late 2017, one of his first initiatives at the chip giant was to build an open-standard, cross-platform application programming interface (API) that would let developers program CPUs, GPUs, FPGAs and other accelerators to eliminate the need for separate code bases and tools for each architecture. Intel calls this oneAPI.

To take advantage of oneAPI and ensure ISVs will optimize their programs for Intel's instruction set extensions like AMX (Advanced Matrix eXtensions), XMX (Xe Matrix eXtensions), or Deep Learning Boost (AVX-512 VNNI, 4VNNIW, AVX-512 BF16, etc.), Intel will have to engage with more developers than ever before and work with them better than ever before, says Gelsinger. 

AI and HPC are of course megatrends that make headlines for technology companies like Intel, and evidently the blue company is playing catch up with Nvidia here. But programs for AI and HPC are not the only types of software that Intel needs optimized for its hardware. There are emerging applications for edge computing, datacenters, and even client PCs that will have to rely on new types of Intel hardware not available just several years ago, and these will have to be part of Intel's software ecosystem.

For example, Intel's upcoming Alder Lake CPUs for client PCs will integrate high-performance and energy-efficient cores as well as a special Intel Thread Director hardware unit that will ensure the proper load balancing and correct assigning of cores for different workloads. To maximize the efficiency of the Thread Director, Intel will need to work closely with developers of operating systems and third-party programs.

Another example is Intel's Atom system-on-chips based on energy-efficient cores and aimed at 5G and edge computing applications. Programs that run on these SoCs have to be optimized for them (and eventually for Xe-HP GPUs for machines on the edge) rather than for Intel's Xeon or AMD's Epyc processors featuring full-fat cores. That means that Intel will have to engage with many developers of appropriate software since the number of potential edge computing applications is hard to overestimate. Nvidia is also there with its EGX platform that includes easy-to-deploy machines powered by software accelerated using Nvidia's CUDA hardware.

Intel Mulls Paid Software Services

Some of Intel's partners believe that the chip giant could consider Nvidia's approach to datacenters and edge computing, which includes DGX systems for AI and/or HPC as well as EGX machines for edge applications, according to CRN. Value added resellers can take those machines that are shipped with a general software stack and equip them with additional programs tailored for a particular client.

Since Intel is the world's number one supplier of PC and server CPUs, the company is unlikely to be interested in competing against its own customers and offer its own machines. This could undermine its semi-custom/custom x86 business that Pat Gelsinger pits hopes on, but it could still capitalize not only on its hardware, but also on its software. For example, Intel already offers its Intel Unite and Intel Data Center Manager software for additional fees and could expand its software offerings, says Greg Lavender, Intel’s new chief technology officer.

"I do expect that you'll see more in that area: How do we leverage our software assets? How do we have unique monetized software assets and services that we'll be delivering to the industry, that can stand in and of their own right? And yeah, that's a piece of the business model that I do expect to do more of in the future," Lavender told CRN.

Intel is not ready to talk about the exact kinds of paid software that it might offer to its clients with its CPUs, but it says that instead of developing its own programs it could sell things like advanced platform telemetry to software makers and then share revenue. Such data could make it significantly easier for security companies to detect malware or viruses both on client and server systems.

Traditionally, Intel has used its software as a value adder for its hardware. For example, Intel's Quick Sync Video software for desktop PCs comes free with Intel's drivers and takes advantage of the video encoding/decoding capabilities built into Intel CPUs. It remains to be seen how Intel manages to make money selling both hardware and software in a world where many companies now consider their own homegrown SoCs tailored for particular applications, but this is an option that management is now mulling. 

Anton Shilov
Freelance News Writer

Anton Shilov is a Freelance News Writer at Tom’s Hardware US. Over the past couple of decades, he has covered everything from CPUs and GPUs to supercomputers and from modern process technologies and latest fab tools to high-tech industry trends.

  • Giroro
    "One of the things that I've learned in my 11-year 'vacation' ..."

    I think one of the other things Gelsinger learned at VMware, is that companies can get so deeply hooked into a subscription model, that they have no choice but to keep paying price hikes or risk losing the whole business.

    I'm calling it now: I think Intel is going to try charging their customers subscription fees to use hardware, even after its purchased.
    They're going to try and get in on that "infinite money forever" business model.
  • watzupken
    So Pat is giving Apple a pat on the back by saying this. It is true that software and hardware need to work hand in hand, since what good is the hardware when the software is inefficient and cannot utilise the full potential of the hardware. The problem for Intel however is that they have limited control over the OS or software developed. They can work closely with the developers, but because they don't own the software companies, getting the software to marry nicely with their hardware all the time is not possible.
  • ezst036
    watzupken said:
    The problem for Intel however is that they have limited control over the OS or software developed.

    Intel has its own publicly available operating system, that you or anybody can download and use.
  • Conahl
    ezst036 said:
    Intel has its own publicly available operating system, that you or anybody can download and use.

    Too bad its based on linux. that limits its reach quite a bit, if it was able to run windows based programs it could be interesting, only i think 3 people i know use linux, and even then, most of their times in spent in windows :)
  • It's kind of obvious these days. Without software to back up the hardware you won't sell your products. He's stating well known facts.