Kopin has a few bones to pick with most VR displays. The company believes that LCD displays are inferior to OLED, that the resolutions of VR displays are too low, that the refresh rates are mostly too slow, that the power requirements of displays are too high, and that their physical sizes are too large.
None of the above is really in dispute--by which we mean that VR HMD makers are already working on it or are ahead of the curve. For example, the Rift and Vive both offer AMOLED displays, not LCD; even on upcoming mainstream HMDs, only lower-end models will have LCD displays. And it’s generally agreed that you need at least sustained 90Hz for acceptable VR.
Further, although the Rift and Vive are tethered at this time, there’s a huge industry push towards untethered VR HMDs that either pack in all the computing components on board or rely on a PC with a wireless transmission protocol to pump the data to an untethered headset. In both cases, lower power requirements are a must.
To those ends, Kopin believes its new Lightning microdisplay is the answer. In a press release earlier this year, it stated in part:
Kopin’s Lightning OLED microdisplay addresses the most challenging technical hurdles with VR, including screen door effect due to insufficient display resolution, bulky goggles, and nausea or dizziness due to motion-to-photon latency, as well as heat-build-up caused by high power consumption.
The Lightning Microdisplay And Accompanying Optics
A Kopin representative laid it out for us at a CES meeting: In VR, hardware is a huge problem. (He suggested that it’s the “biggest,” although one could argue that content is currently a larger issue.) VR HMDs need to get small, and to do that, they need a microdisplay; and that microdisplay needs to handle both VR and AR applications.
The Lightning microdisplay is just one inch square, and it’s directly on silicon, not glass--so, “OLED-on-Silicon.” Kopin told us that the glass other display makers use is powered by “cheap” silicon, which is fine for larger screens but has issues on these tinier ones. Further, the company stated, its solution uses single-crystal polysilicon that has better transistors. A representative told us that its strategy here includes having the headroom to improve the product down the line.
Kopin also asserted that it’s unconcerned with brightness; instead, a representative suggested, it’s more important for the display to have better colors and deeper blacks--which OLED enables.
This first generation of the Lightning microdisplay can offer 2,048 x 2,048 resolution at 120Hz, with “no” latency; the next generation should be able to boast 3,000 x 3,000 resolution, or even 4,000 x 4,000. Within five years, a Kopin representative told me, the company expects to help push HMDs down to the size of eyeglasses. (Even so, there's the key issue of what sort of graphics hardware can push that many pixels.)
Regarding the claim of “no latency,” Kopin said the Lightning microdisplay offers just 10 microseconds of latency--this is not to be confused with milliseconds, which you see abbreviated as “ms.” Ten microseconds is equal to 0.01 milliseconds.
Aiding and abetting the Lightning microdisplay is Kopin’s optics. Kopin is working on two versions of its proprietary optics: One version uses layers of Fresnel lenses that results in a pattern that looks like the terra cotta tiles you see on some roofs--hence the term “Pantile” that Kopin has applied to this technology. The other type uses “polarization optics,” so although it still uses stacked lenses, the appearance is smooth--according to Kopin, like a pancake shape.
The Pantile optics are less than 30mm thick, which Kopin said enables those smaller and thinner eyeglasses-type mobile VR designs.
Kopin told us that the optics are still in development.
We were supposed to see a demo of the Lightning microdisplay on a pair of spectacles during our CES meeting, but the device was not working. We did, however, see the display functioning with a colorful test pattern:
"Mobile" VR--And AR And MR
After CES, we had lingering questions about the microdisplay and what it might enable in the XR market, so we reached out to Kopin post-CES for answers. Dr. Hong Choi, CTO of Kopin, responded.
Assuming that all of Kopin’s claims about performance, size, and power are true, we wondered what sort of cost they might add to an HMD. Dr. Choi stated that Kopin has not nailed down pricing for the Lightning microdisplay yet, but he said that “it may be competitive or somewhat higher than the direct view OLED on glass panels used in VR headsets such as Oculus or HTC Vive.” In other words, the cost increase should be nil or negligible, and he believes that the improved user experience would be worth it, regardless.
Dr. Choi also clarified what the company meant when it described the Lightning microdisplay as ideal for "mobile VR." "'Mobile' VR in this case means not tethered to a 'stationary' PC, allowing freedom of movement, and potentially can be connected to a smartphone," he said. "The Lightning OLED display can certainly be used for PC-tethered HMD systems as well, though the power and to some extent smaller form factor are not as critical in this use case."
What he’s saying is that the Lightning microdisplay could work in high-end HMDs like the Rift and Vive, but it’s really aimed at the rapidly developing world of untethered HMDs where weight, power, size, and efficiency are at a premium. This would include devices like Intel’s upcoming Project Alloy and some of the promised mainstream HMDs from PC makers, as well as the experimental wireless HMDs from Intel and Oculus (Project Santa Cruz).
One intriguing tidbit from Dr. Choi's statement above stood out to us: "...potentially can be connected to a smartphone." The smartphone-based HMDs on the market today, such as Google's Daydream and Samsung's Gear VR, use the smartphone and its display, paired with optics in the HMD, to produce the immersive images. Therefore, although Kopin’s Pantile optics could potentially enhance the viewing experience on such products, the Lightning microdisplay has no place. So what gives?
It is possible that Dr. Choi is referring to a different type of device--an HMD that is tethered to a smartphone via a cable, but relies on a display inside of the HMD to produce images. (LG attempted this very thing with its LG 360 VR HMD a year ago at Mobile World Congress, although we found that the execution left much to be desired.) The paradigm, then, would be the same as PC-connected HMDs like the Rift and Vive, which are technically PC peripherals. This new type of device would be essentially a smartphone peripheral. Just as you connect a Rift or Vive to a PC with a cable, you would connect this type of HMD to a smartphone via a cable.
However, because a smartphone is by nature untethered, the HMD would effectively be “untethered.” (Being tethered to an untethered thing is essentially the same as being untethered.) In this case, light and power-efficient microdisplays would be a prerequisite for the HMD to offer any sort of usability.
Just look at the mockups of Kopin optics-enabled glasses: There's essentially no room for computing components on them, but they could be fitted with microdisplays and connected to a computing device--such as a smartphone--with a cable. (Suddenly, the immense capabilities of USB Type-C ports on smartphones look pretty tasty, no?)
Note well that all of the above refers only to occluded VR devices, not AR or MR HMDs. Kopin claims that the Lightning microdisplay could be used for AR or MR, as well. On the surface, this makes no sense, because the microdisplay is on silicon and is therefore opaque. While acknowledging that indeed, the Lightning microdisplay is ideally suited for occluded VR (in particular because of the lower brightness requirements), Dr. Choi elaborated on what Kopin means: "Conceptually, the Lightning OLED display can work for VR, AR or MR if combined with appropriate optics (i.e., see-through optics are possible)," he said. In fact, he noted, opaque displays are fairly standard on AR/MR devices.
"Typically the see-through AR or MR is achieved by see-through optics and non-transparent displays," he explained. "See-through optics [have] a form of a thin waveguide with holographic structures (Hololens using Nokia technology), multiple mirrors imbedded [sic] in a waveguide (Lumus), a partial reflecting/transmitting lens (Seiko Epson), etc. These are all optical AR which is not easy to implement in practice since it requires the alignment of the real image with the computer generated image. On the other hand, most of real world AR is done by video AR with the digital information overlaid on a camera-captured video image. This is much easier to implement with much less computation requirements."
He said that in an AR/MR HMD, you can therefore use an opaque microdisplay that uses "compact, see-around optics." Even so, he allowed that "For AR / MR use, high-brightness transmissive LCoS or reflective LCoS (with appropriate optics) are better suited today [than OLED displays]," but he noted that if OLED displays gain more brightness, they could find a happy home in AR and MR HMDs and glasses.
Theoretically, you could also rely on Lightning microdisplays within an occluded HMD that provides mixed reality via camera passthrough. Intel’s Project Alloy uses the camera passthrough method to an extent, and the Vrvana Totem relies on it heavily.
The validity of Kopin’s claims and its success in the XR market remain to be seen, of course, but it’s important to note that the company is not some scrappy startup. According to the company website, Kopin has been around for almost thirty years, during which time it has provided "
"wearable computing assets" for the military, consumers, and industry in products from companies such as Vuzix, Motorola, and Recon Instruments. "Kopin’s technology portfolio of ultra-small displays, innovative optics, speech enhancement technology, head-gesture command, low-power ASICs, packaging, and system reference designs enable customers to accelerate the development of products for consumers, industry, and the military," reads the site. The company said it has "more than 200 global patents and patents pending in these areas."
Kopin also just formed a joint venture with the Lenovo Capital and Incubator Group (LCIG) called "Lenovo New Vision" that will focus on AR headsets for enterprises. In other words, it has the resources for significant R&D, not to mention a big IP portfolio and longstanding relationships with manufacturers.
