Beyond the blink: Using eye tracking + biometrics

Eye tracking 101 series - #7

Understanding human behavior requires more than observing actions alone. By combining eye tracking with biometric measures such as EEG, heart rate, galvanic skin response, and facial expression analysis, researchers gain a more complete view of attention, emotion, and cognitive workload.  

This multimodal integration provides deeper insight into how people process information and respond to their environment. As adoption grows, it is shaping research and decision-making across neuroscience, UX, healthcare, and consumer research. 

Why combine eye tracking with biometrics? 

Eye tracking shows where people look and how they visually engage with their environment. But to understand why they look and what they feel or think while doing so, biometric data adds the missing layer.

By integrating physiological signals, such as brain activity (EEG), heart rate (ECG/PPG), skin conductance (GSR), and pupil dilation, researchers can measure: 

Cognitive workload: How mentally demanding a task is. 

Emotional response: Joy, stress, frustration, or excitement. 

Attention levels: Whether someone is truly focused or distracted. 

This multimodal approach provides real-time, non-invasive insights into human experience, which is crucial for designing improved products, training systems, and environments. 

Emerging trends in multimodal research 

Recent research indicates that integrating eye tracking with biometrics enhances the accuracy and sensitivity of assessing mental workload and emotional states. For instance, a 2024 study from Drexel University employed six biomedical modalities, such as EEG, eye tracking, and heart rate, to measure cognitive performance in six areas, including working memory, vigilance, and situational awareness. 

Meanwhile, experimental software such as Tobii Pro Lab provides seamless synchronization of eye tracking data with biometric inputs from partners such as
Brain Products, Bitbrain, and MindWare Technologies. Researchers can co-register gaze data with EEG, ECG, EMG, and GSR to analyze how visual attention correlates with physiological responses in both lab and real-world settings. 

How Tobii supports multimodal integration 

Tobii provides a robust ecosystem for multimodal research: 

Tobii Pro Spectrum: A high‑precision eye tracking system designed for advanced human behavior studies. It captures detailed eye‑movement data and easily synchronizes with other modalities, such as EEG, motion capture, or biometrics, making it a powerful tool for multimodal research. 

Tobii Pro Lab: A comprehensive platform designed for studying human behavior. It serves as a central hub for recording, synchronizing, and analyzing eye tracking data together with biometric streams. 

Tobii Pro Glasses 3: Wearable eye trackers for studies in dynamic environments. 

Partner integrations: Compatible with EEG systems (BrainAmp, LiveAmp), physiological sensors (GSR, ECG, EMG), and software platforms for advanced analysis. 

These tools allow researchers to: 

• Segment data by gaze behavior (e.g., AOI visits, pupil size). 

• Run fixation-related EEG analyses. 

• Discard irrelevant trials based on gaze patterns. 

• Merge and export synchronized datasets for deeper analysis. 

Applications across industries 

UX and HCI: Measure frustration or engagement during digital interactions. 

Healthcare: Assess cognitive load in surgeons or detect early signs of neurological disorders. 

Education: Monitor student attention and anxiety during classes and exams. 

Marketing: Understand the emotional impact of ads and product placement. 

Automotive: Detect driver fatigue and distraction in real time. 
 

The future of multimodal insight 

As sensor fusion and AI-powered analytics evolve, multimodal integration will become more accessible and scalable.  

As the field evolves, this approach could support outcomes such as: 

• Real-time emotion detection in consumer environments. 

• Adaptive training systems based on cognitive workload. 

• Neuroadaptive interfaces that respond to user states. 

• Expanded use in safety-critical fields like aviation and robotics. 

Advance behavioral insight with multimodal data 

Multimodal integration is opening new paths for understanding human behavior. The combination of eye tracking and biometric data offers a richer context around attention, emotion, and cognition than any single measure alone. With Tobii’s tools and research partnerships, behavioral insight continues to move toward greater clarity, reliability, and real-world relevance.