UX and insights

Interaction in immersive 3D environments brings some new HCI challenges. The aim is for virtual, mixed, and augmented experiences to feel as intuitive as real ones, and for transitions to be seamless. Eye tracking raises the intuitiveness of experiences because it, for example, reduces the need for hand controllers (and the odd gestures they entail). But it also equips users with supernatural powers — you can control objects by looking at them, aim and teleport with gaze — making experiences intuitive, enjoyable, and less straining.

Social presence and nonverbal communication lie at the heart of human connection. Avatars, virtual non-player characters (NPCs), and even non-character elements like objects, trees, and rocks feel real or magical in XR when they respond to eye-movement-based nonverbal cues. Eye tracking enables avatars with authentic eye contact and eye-movement control, character and environment awareness, as well as shared gaze — enhancing social presence and ensuring that user experiences in the metaverse are realistic and immersive.

Eye tracking delivers a deep understanding of user behavior, what users find interesting, and what captures their attention. The technology also provides pupillometry — the measurement of pupil size and reactivity — information essential for evaluating cognitive load and critical to a wide range of industries and applications for training and gaming.