HBM's future isn't just bright: it's also lightspeed, ultra-bandwidth, and super low-power. At this year's Open Compute Project (OCP) Global Summit, Samsung's Advanced Packaging Team Yan Li presented us with a glance at a more integrated future than we might expect: one where thermal and transistor density issues with further High Bandwidth Memory (HBM) development could be solved through photonics.
Photonics is based on a technology that can encode information on single photons (particles/waves of light), which means that it improves (almost) everything we care about in our current computing environment. There's both incredibly reduced power consumption (you're beaming particles of light instead of a flow of electrons) and improved processing speeds (with latencies achieving femtoseconds and propagation speed, well, approaching the lightspeed limit). Getting there is just a matter of engineering, quantum physics, and human ingenuity.
As it stands, the industry has made recognizable inroads in integrating photonics and HBM via two methods. One sees a photonics interposer being sandwiched between the base packaging layer and a top layer holding both logic (a GPU, for instance) and HBM itself, serving as the communications layer between them. This future seems expensive – there's the need for that interposer, as well as the need for both local logic and HBM to be configured with photonics I/O as well.
Another approach is to decouple the HBM memory banks from the chip package entirely. Instead of dealing with the chip packaging complexities (including logistics) of dealing with an interposer, you shift the HBM banks away from the chiplet itself and connect them (via photonics) to the logic. This simplifies chip manufacturing and packaging costs for both HBM and logic and does away with complex, in-circuitry, local conversion from digital to optical.
From this vantage point, that approach sounds most sensible. But then, it also means a deeper rethinking of server specifications and would also likely result in "HBM memory cubes" being a thing - HBM memory banks pre-loaded onto a specified photonics interface. Because you've decoupled HBM from the chip itself, and assuming you keep a standard optical communications interface, you can then look at an "upgradeable" product - one that's handled as if it were a stick of the best RAM kits.
Takes from Samsung presentation at OCP Global Summit 2023.
The presentation also goes into additional details on Samsung's HBM packaging, which is already offered in 2.5D and 3D solutions, and presents a brief overview of the racing horses that are Moore's Law and the increasing costs of semiconductor miniaturization in order to explain why photonics is indeed a part of our future. How far away into the future is hard to tell, but the road disappears far into it.
Stay on the Cutting Edge
Join the experts who read Tom's Hardware for the inside track on enthusiast PC tech news — and have for over 25 years. We'll send breaking news and in-depth reviews of CPUs, GPUs, AI, maker hardware and more straight to your inbox.
Francisco Pires is a freelance news writer for Tom's Hardware with a soft side for quantum computing.
I still don't have great understanding of photonics application in semiconductors or the challenges therein, but I have started to hear a lot more about it this year that in previous years. I watched an asianometry video on photonics and semiconductors a few months back which helped illuminate (pun intended) some of the design challenges and best next steps with respect to research and applications.Reply
Yes, the technology is definitely accelerating and simply showing up in a number of fields (quantum, semiconductors, etc). Maybe share that video's link, if you can? Tom's still has a long road to cover photonics for our audience, and I'm sure some in our community would be appreciative.Reply
Moore's law would mean reduced profits unless accompanied by the increase in price per mm^2.Reply
The second is as important to the sector as the first.
Francisco Alexandre Pires said:Yes, the technology is definitely accelerating and simply showing up in a number of fields (quantum, semiconductors, etc). Maybe share that video's link, if you can? Tom's still has a long road to cover photonics for our audience, and I'm sure some in our community would be appreciative.
This is the video I was referencing. There are, i'm sure, other more rigorous and detailed videos available out there, but this one is within a nice time window for the casual observer.
There are the first real products with the transmission of information through light. But what is described in the article requires a miniaturization of not one, but several orders of magnitude of the optical elements. I don't know when this would be ready for mass production and in a product that is affordable even at the level of defense spending.Reply
My only fear is now AI is going to get freaky about RGB lighting and try to take over the world by making all the lights in our houses change colors at the same time! :eek:Reply
To a large extent, photonics has so far been used for interconnects between different electronic subsystems (e.g., a memory circuit to logic circuit). It will have even larger impact if it can be integrated into the subsystems.Francisco Alexandre Pires said:Yes, the technology is definitely accelerating and simply showing up in a number of fields (quantum, semiconductors, etc). Maybe share that video's link, if you can? Tom's still has a long road to cover photonics for our audience, and I'm sure some in our community would be appreciative.