By leveraging the human vision process, eye-tracking can lighten the load on headset graphical processing and reduce the bandwidth needed to send data across the network to other headsets and devices, while maintaining the user experience.
Foveated rendering makes use of the fact that our eyes focus on a limited region of interest in high-resolution, surrounded by a medium-resolution blend area, outside of which we only require low-resolution rendering for objects in our periphery.
Enabled by Tobii Spotlight Technology™, dynamic foveated rendering leverages user-focus data to dramatically decrease processing load on the headset — freeing up resources to, for example, support higher resolution headsets, enhance graphics, and increase frame rates (which can help to lessen nausea).
Compelling user content
From the user’s point of view, building an ecosystem with millions of frequent users requires compelling content, which in turn requires incentives and a low entry point for development teams. Predicting a user’s intent to pick up an object, for example, is simplified when eye-tracking data is available. An application can use the gaze point of a user to select an object, removing the need to look and then select with a hand gesture or head movement. Gaze-based object selection mimics the way people naturally interact with the world around them, heightening the sense of immersion for the user. By removing the need for head movements, eye-tracking can help reduce fatigue and nausea — additional factors helping to accelerate adoption.
Avatars without stares
With eye-tracking, avatar-based applications become realistic with natural eye movement, by leveraging features such as social eye contact. Together with head-and-hand gestures, applications leveraging eye-tracking become more intuitive, learning is simple, and the user experience is memorable — factors that contribute to adoption.
Headsets adapted for users
In addition to enriched user experiences, new business opportunities for developers, and reduced GPU and transport loads, eye-tracking plays a role in ease-of-use of the headset — a key enabler for XR. The weight and comfort of the headset being two of the most significant design factors affecting adoption.
By continually measuring the distance to a person’s eyes, slippage, for example, can be detected. Calibration with eye-tracking is accurate because it enables additional parameters, such as the distance between a person’s eyes, the position of the fovea, and the reflection properties of different parts of the eyes to be included in the calculation.
Tobii partnerships
Together, Qualcomm and Tobii have built a platform facilitating the creation of a sustainable XR ecosystem for millions of frequent users. Tobii is keen to partner with other stakeholders, both at a systems integration level and application development. Our SDK, for example, provides many essential tools to lower the entry barrier for application development in areas such as training, remote collaboration, immersive design and diagnostics. Interested in partnering with Tobii?