Starbreeze, Tobii Tech Bring Eye-Tracking To StarVR

Tobii Tech has been pushing its eye-tracking technology as one of the next big things to come to gaming. At Computex this year, MSI was showcasing a gaming laptop that featured Tobii's eye-tracking hardware, and today the company announced a partnership with Starbreeze Studios that will put Tobii Tech's eye-tracking technology directly into the StarVR HMD, which is currently in development.

"VR is all about experience. When that experience is inhibited by the ability to render realistic and immersive environments, it's a roadblock to creating world-class content and experiences our customers love and consistently expect us to deliver," said Emmanuel Marquez, CTO of Starbreeze AB. “Partnering with Tobii, the clear leader in eye tracking, allows us to solve this limitation, benefitting [SIC] the VR industry as a whole, while also allowing us to deliver the highest-quality and most immersive film and gaming content ever experienced."

By integrating eye-tracking hardware into the headset, Starbreeze will be able to provide unique experiences such as eye contact with game characters, making the interaction feel more lifelike and authentic. Another example that was given is the idea of a "choose your own adventure"-type video that changes based on what the viewer focuses on. Imagine watching the same video back to back, but seeing an entirely different story simply because you were focusing on a different area of the scene.

Tobii Tech said that the integration of eye-tracking into StarVR will not only allow for different unique experiences; it will also help with performance in virtual reality, as well. By tracking where the player's eyes are trained, the scene can be rendered in much higher detail at the focus points, and the graphics seen only in peripheral vision are rendered with less fidelity.

If you're thinking this sounds familiar, it probably is. The process is called "Foveated rendering" and was first introduced during Fove's Kickstarter campaign a few months ago. Foveated rendering will come in very handy when driving the 5K resolution that StarVR's HMD will come equipped with.

Another less obvious benefit of tracking a user's eyes is that there is no need for manual calibration. The tracking technology determines the structure of each individual's eyes, and compensates accordingly. Tobii Tech also noted that eye tracking improves gaming immersion in a number of ways. Using a gaze to target something on screen is much more natural compared to using a gesture or head movement. Eye contact with in-game avatars or NPCs makes the experience feel even more realistic. Tobii Tech said characters are able to interact, or ignore users, based on eye contact.

Follow Kevin Carbotte @pumcypuhoy. Follow us @tomshardware, on Facebook and on Google+.

 Kevin Carbotte is a contributing writer for Tom's Hardware who primarily covers VR and AR hardware. He has been writing for us for more than four years. 

  • cats_Paw
    I can just picture in game female characters saying "my eyes are up here".
    Reply
  • hdmark
    would this type of tech allow weaker graphics cards to push VR then?

    I read the part where you can give higher detail to the focal point and in my mind that means maybe rending "ultra" quality at the focal and drop it "low" on the outskirts.
    I know that it will probably just be used to push extreme quality at the focal point and high quality every where else, but maybe the first thing I said? so my 970 has a chance to push VR smoothly? :D
    Reply
  • jaber2
    would this type of tech allow weaker graphics cards to push VR then?

    I read the part where you can give higher detail to the focal point and in my mind that means maybe rending "ultra" quality at the focal and drop it "low" on the outskirts.
    I know that it will probably just be used to push extreme quality at the focal point and high quality every where else, but maybe the first thing I said? so my 970 has a chance to push VR smoothly? :D
    Earlier this year I purchased 960, I then read a week later that the minimum for was 970, so I returned my 960 for a new 970, its been a few months and I don't think I can return my 970 for 980 or 980 ti, but when these do come out I don't think I will have the minimum requirement at that time
    Reply
  • DonGateley
    Can foveated rendering be applied without integration with the VR platform makers like Unity?
    Reply