A startup has just emerged from stealth mode, heralding its development and fabrication of a prototype superconducting processor for AI. The company, Extropic, recently closed a $14.1 million seed funding round, and claims it will achieve a goal of creating AI accelerators "that are many orders of magnitude faster and more energy efficient than digital processors (CPUs/GPUs/TPUs/FPGAs)." The firm, led by ex-Alphabet X quantum researcher Guillaume Verdon, has also published its "Litepaper" brief offering a tantalizing glimpse of the full-stack thermodynamic hardware platform it is building.
Extropic argues that currently available digital processors are not a good match for AI acceleration. The paper introduces a novel probabilistic paradigm of computing that is said to be distanced from increasingly complex pristine digital computers in favor of something more 'biological' and 'noisy'. Extropic's prototype passive thermodynamic chips run the type of probabilistic algorithms used in AI physically, as a rapid and energy-efficient physics-based process. This makes them much more suitable for current AI algorithms than traditional computing processors, which rather unnaturally try to embrace probability and uncertainty - introducing inefficiency.
There are many more discussions about the science behind Extropic's "revolutionary approach to AI acceleration through thermodynamic computing" in the paper. However, we were most interested to see the firm's demo chip, to hear how it works, and what it can do. In the image above you can see a microscope image of one of the first Extropic chip neuron designs. These chips are said to be nano-fabricated from aluminum and run at low temperatures so they are superconducting.
You can see two Josephson Junctions highlighted in the photo, and these should be adept transistor-style components for the types of complex non-linear problems faced by AI. What we see is just a small processor building block that will be used alongside many other linear and non-linear neurons in larger supercomputing systems.
That all might sound highly ambitious, but Extropic is also readying semiconductor devices that operate at room temperature to extend its reach to a larger and more immediate market opportunity. These devices will use transistors in the place of the Josephson Junctions, sacrificing energy efficiency but enabling the possibility of a GPU-like expansion card. Besides the hardware, Extropic is busy with software that interprets the abstract specifications of Energy-Based Models (EBMs) to its processors.
Helping founder Verdon achieve the above-outlined goals is a team of experts with prior experience at companies like Alphabet, AWS, Meta, IBM, and Nvidia. Let's hope we will hear more from Extropic in the near future.
