home

Eye tracking en los Factores Humanos Q2 2025

La tecnología Eye tracking ha hecho avanzar considerablemente la investigación sobre factores Humanos, como demuestran las publicaciones del segundo trimestre de 2025. Ha sido fundamental para comprender las distracciones de los conductores, mejorar la formación en gestión de contratos de construcción y mejorar las consultas sobre patrimonio cultural. El eye tracking también ha enriquecido los estudios sobre evacuación de peatones y seguridad de los e-scooters al proporcionar información detallada sobre comportamientos visuales y patrones de atención. Estos resultados subrayan el papel de la tecnología en la mejora de la seguridad y la eficiencia en diversos ámbitos.

An interpretable stacking ensemble learning model for visual-manual distraction level classification for in-vehicle interactions

Yahui Wang, Zhoushuo Liang, Pengfei Tian & Yue He

Recognizing the level of driver distraction during the execution of secondary tasks within the intelligent cockpit is crucial for ensuring a seamless interaction between human drivers and intelligent vehicle systems. To address this issue, this paper proposes a framework for recognizing driver distraction levels that integrates clustering, classification, and interpretability. First, Feature Selection with Optimal Graph(SF2SOG) is employed to identify discriminative features from the data facilitating dimensionality reduction. Following this, Agglomerati...

How Project-Based Learning Improves Construction Contract Management Training: Evidence from Eye-Tracking Searching Strategies for Contract Risk Recognition Performance

Jiaming Wang, Yiran Xu, Dongping Fang & Pin-Chao Liao

Construction contract management is crucial for the smooth implementation of projects, and contract risk recognition is key to construction contract management. However, complex legal terminology often makes project managers find contract management training quite challenging. Recently, learner-centered project-based learning (PBL) has flourished, but few related studies concentrate on construction contract management training. This study aims to explore the impact of PBL on improving construction contract management training and the specific mechanisms ...

How does mindfulness training affect attention and penalty kick performance in university football player

Jiaqi Wu & Lixin AiSoftware and Systems Modeling

Athletes often struggle to maintain attentional focus and performance consistency under pressure, particularly during high-stakes tasks like penalty kicks. This study examined the effects of brief mindfulness training on visual attention behaviors and penalty kick performance among university football players under non-pressure and pressure conditions. The study comprises two experiments: Experiment 1 was conducted in non-pressure conditions, whereas Experiment 2 involved pressure condition. Each experiment involved 40 participants, who were randomly ass...

Leveraging Motion Platform Simulator for Detecting Driver Distraction: A CNN-LSTM Approach Integrating Physiological Signal and Head Motion Analysis

Arian Shajari, Houshyar Asadi, Shehab Alsanwy, Saeid Nahavandi & Chee Peng Lim

Phone use can distract drivers from driving safely. This research presents an approach to detecting driver distraction caused by handheld mobile phones, employing a deep learning model that combines Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM). The study collected physiological signals and head motion data in a simulated driving environment using a motion platform, capturing data such as heart rate, breathing rate, galvanic skin response, and skin temperature, alongside accelerometer and gyroscope metrics for head movements. This ...

Eyes on City Heritage Enhancing Consultations with Accessible Eye-Tracking Data Visualization

Marta Rusnak & Joanna Majczyk

One of the important tasks outlined in the Davos Declaration is the inclusive transformation of city centres. Striving for balance requires experts to encourage societies to become actively involved in heritage management. Transparency in the design process is paramount, ensuring that each activity undertaken is efficient and accountable. Diagnosis methods need to be improved, project development and implementation processes need to be streamlined. One idea that combines: new technologies, care for monuments and cooperation; is the use of eye-trackers (E...

Study on the Influence of Video Buffering Prompt Strategy on Users’ Emotional Response in Vehicle Environment

Shan Zhong & Hao Tan

With the rapid development of in-car information systems, entertainment has become a critical component of the user experience, particularly with advancements in autonomous driving technology. However, unstable in-car network environments often lead to initial loading and stuttering buffering issues, negatively affecting viewing experiences. Existing studies focus primarily on typical environments, leaving a gap in understanding video buffering impacts in in-car scenarios. This study investigates how informational prompts can mitigate negative emotions a...

Process Model Complexity Metrics, Cognitive Load and\xa0Visual Behavior: A Multi-granular Eye-Tracking Analysis

Thierry Sorg, Amine Abbad-Andaloussi, Ekkart Kindler & Barbara Weber

Complexity metrics are widely used to estimate the difficulty of understanding process models. However, the relationship between these metrics and the concept of cognitive load, which captures the difficulty experienced by users, is not fully understood in the process modeling literature. In neighboring fields like Software Engineering, researchers could only to a limited degree establish a relationship between complexity metrics and users’ cognitive load. To investigate the extent to which such a relationship exists in the process modeling field, we con...

BIRD: A Museum Open Dataset Combining Behavior Patterns and Identity Types to Better Model Visitors Experience

Worm Alexanne, Florian Marchal, Sylvain Castagnos & Alexanne Worm

Lack of data is a recurring problem in Artificial Intelligence, as it is essential for training and validating models. This is particularly true in the field of cultural heritage, where the number of open datasets is relatively limited and where the data collected does not always allow for holistic modeling of visitors’ experience due to the fact that data are ad hoc (i.e. restricted to the sole characteristics required for the evaluation of a specific model). To overcome this lack, we conducted a study between February and March 2019 aimed at obtaining ...

Non-contact map interaction configuration optimization

Nai Yang, Junpeng Lv, Yi Chao, Hao Fang & Peng Liu

Current map interaction operations primarily rely on the use of a mouse, keyboard, or touchscreen, which are not convenient for special scenarios such as driving or cycling, or for specific populations such as individuals with hand disabilities or ALS patients. Therefore, this paper explores non-contact map interaction methods that do not require hand involvement. We conducted a comparative analysis of user preferences for several common non-contact methods (eye tracking control, voice control, head movement control, and facial expression control) in bas...

Evolution and arousal of high-speed train drivers’ vigilance based on physiological information

Huimin Li, Wenjuan Zhang, Mengxuan Liang, Ke Niu, Yafei Zhang, Chengyi Zhang & Yihang Du

Vigilance decrement has become one of the main risk factors for train accidents. It is of great significance to evaluate high-speed train drivers’ vigilance in real time during long-duration driving. In this study, a driving simulation experiment was conducted to collect multimodal physiological information, and the vigilance index was defined by principal component analysis (PCA) to identify its evolution. Furthermore, the effects of sound and vibration stimuli on arousing vigilance were analyzed, and visual characteristics during vigilance decrements w...

Development of a motion capture and feedback system for Qigong

Melanie Baldinger, Kevin Lippmann, Gheorghe Lisca & Veit Senner

Qigong is a meditative exercise form that originates in traditional Chinese practice. Shibashi, one form of Qigong, consists of 18 exercises, the so-called 18 Forms of Harmony. To facilitate self-guided learning and practicing, feedback on the quality of the execution is essential. This research aims to evaluate the technological feasibility of capturing Qigong exercises and provide appropriate feedback to the trainee. This work comprises four studies (S1–S4) that explore methods to capture Qigong motions, detail the development of a system for quantifyi...

EyeUnderstand: Dashboard for Gaze and Deep-Learning Driven Comprehension Estimation in Online Lectures

Ko Watanabe, Gitesh Gund, Jayasankar Santhosh, Haruka Sakagami, Yuki Matsuda, Andreas Dengel & Shoya IshimaruLecture Notes in Information Systems and Organisation Technology Driven Transformation

Online videos are a potent tool for educators to disseminate knowledge widely to diverse student audiences. However, collecting student feedback remains a significant challenge for lecturers, particularly in the absence of feedback. Understanding students’ subjective comprehension levels during online video lectures with sensor technology is yet to be thoroughly researched. This study uses eye-tracking technology to predict self-reported comprehension levels during video lectures. We recruited 20 participants from Germany and Japan who were invited to wa...

    Optimising Pilot-Aircraft Interaction: A Low-Cost Projection-Enhanced Head-Up Display (PE-HUD) with Neuro-Ergonomic Validation

    Xin Yuan, Kam K. H. Ng, Cho Yin Yiu & Qinbiao Li

    Modern aviation operations demand pilots to process multi-source cockpit instrumentation, creating cognitive fragmentation that degrades situational awareness (SA) and increases mental workload. While conventional head-up displays (HUDs) partially address these challenges, their static symbology and high retrofitting costs limit effectiveness. Augmented Reality (AR) solutions face adoption barriers due to visual conflicts in head-mounted displays and prohibitive waveguide HUD costs. This study proposes a low-cost Projection-Enhanced HUD (PE-HUD) using re...

    Comparing User Behavior in Real vs. Virtual Supermarket Shelves: An Eye-Tracking Study Using Tobii 3 Pro and Meta Quest Pro

    Francesco Vona, Julia Schorlemmer, Paulina Kaulard, Sebastian Fischer, Jessica Stemann & Jan-Niklas Voigt-Antons

    This study compares user behaviors between real and virtual supermarket shelves, using eye-tracking technology to assess behavior in both environments. A sample of 29 participants was randomly assigned to undergo two conditions: a real-world supermarket shelf with Tobii eye-tracking and a virtual shelf using Meta Quest Pro’s eye-tracker. In both scenarios, participants were asked to select three packs of cereals belonging to specific categories (healthy/tasty). The aim was to explore whether virtual environments could realistically replicate real-world e...

    Translation Design Strategy of Mobile Phone Patterns from the Perspective of Intangible Cultural Heritage Digitization

    Yi Ding, Yi Zhang, Tairan Yu & Wenjing He

    This study focuses on the design strategy for intangible cultural heritage-themed smartphone applications. The primary objective is to develop a de-sign strategy that incorporates aesthetic qualities, cultural significance, and functional capabilities. Through the comprehensive application of both qualitative and quantitative research methodologies, this study investigates and categorizes common challenges encountered in the translation design of pat-terns related to intangible cultural heritage. The identified issues are ad-dressed through an analysis o...

    • Tobii Pro Studio

    How Display Types of Non-Driving Related Tasks Affect Driver Performance and Situation Awareness in Conditionally Automated Driving?

    Ina Jeong, Seulgi Kim, Hanbo Zou, Sejung Lee & Sangeun Jin

    This study explored how display types for non-driving-related tasks (NDRTs) influence driving performance, gaze behavior, and situation awareness (SA) after takeover requests (TOR) during conditionally automated driving (CAD). Current legal regulations, such as those from JAMA and NHTSA, restrict the display of non-driving-related information while driving. As advancements in autonomous driving occur, there is an increasing need to research optimal display types for NDRTs to ensure safety. In this pilot study, three participants completed eight trials un...

    Assessment of Eye-Tracking Data for User Experience in Smart Home Appliances

    Sreeram Kongeseri, Liliana Vale Costa, Samuel Silva, Bernardo Marques & Nelson Zagalo

    Over the past years, there has been an increasing interest in the design and evaluation of home appliances that have been increasingly interconnected and personalised, integrating visual, auditory, haptic and multimodal interfaces catering to diverse user preferences and contexts. One of the greatest challenges in these human-machine interaction environments is to assess ecological validity in the studies, i.e., approximate the testing environment to real-life situations. Although the alignment between the user’s mental models and response to the environ...

    Eye Movement Training for Taking Care of Potential Risks of Irregular Events in Driving Vehicles

    Koki Shimomura, Kenji Matsuura, Hironori Takeuchi, Akihiro Kashihara & Ryo Murakami

    This paper describes a proposal for drivers’ effective detection for precise scanning to unexpected events during train operations. The study highlights the importance of gaze behavior and visual exploring strategies in improving reaction times and ensuring passenger safety. The paper also discusses the effectiveness of visual feedback at real time in a simulator of virtual reality. The system navigates the driver’s eye movement to scan the whole screen efficiently, balancing focus between central and peripheral vision. The feedback mechanism includes a ...

    Optimizing Human-Computer Collaboration in Nuclear Control Rooms: An Experimentally Validated Automation Design Framework for Steam Generator Operations

    Yage Yang, Beiyuan Guo, Zhihui Xu & Jiajie Xie

    With the improvements in information technology, the nuclear power instrumentation and control system has shifted from traditional instrumentation to digitalization and now faces the challenge of advancing toward intelligence. Greater emphasis is placed on human-computer collaborations in advanced nuclear power plants, and automation design significantly impacts the safety and efficiency of control room diagnosis and actions. In this study, we constructed a decision ladder for operators in the main control room that is divided into different levels of a...

    Research on the Impact of Outpatient Medical Appointment Interface Design Features on Cognitive Load and Emotional Response

    Qi Wang, Zhenhua Zheng, Bo Yan & Chunyu An

    With the ongoing digital transformation of global healthcare services, medical guidance apps have become essential tools for patients, particularly for facilitating online medical appointments. However, inadequate interface designs often lead to increased cognitive load and heightened user anxiety. This study examines the impact of interface interpretability and layout on users’ cognitive load and emotional response during online medical appointment. A 3 × 2 mixed-factorial experiment was conducted with 24 participants, employing Tobii eye-tracking techn...

    • Tobii Pro X60 / X120 / T60 / T120
    • Tobii Pro Studio

    Exploring the Role of Leadership in Pedestrian Evacuations Using a Virtual Reality (VR) Environment: An Eye-Tracking Study

    Sajjad Mazloum, Navid Khademi, Ali Ahmadi, Kimia Afand, Amirmohammad Zabihpour, Amir Rafe & Patrick A. Singleton

    Effective crowd management during evacuations depends on timely information and leadership that guides evacuees to safety. This study investigates factors influencing pedestrian behavior in outdoor evacuations using immersive virtual reality (VR). Data from 27 participants, collected through eye-tracking and physiological sensors, examined leader credibility, leadership style (visual versus visual-verbal), stress levels, leader gender, familiarity, and crowd behavior. Mann-Whitney U tests analyzed attention and physiological responses, while a mixed bina...

    • Tobii VR

    Impact of Road Infrastructure and Traffic Scenarios on E-Scooterists’ Riding and Gaze Behavior

    Dong Chen, Arman Hosseini, Arik Smith, Zeyang Zheng, David Xiang, Arsalan Heydarian, Omidreza Shoghli & Brad Campbell

    The growing adoption of e-scooters has raised significant safety concerns, particularly due to a surge in injuries and fatalities. This study explores the relationship between road infrastructure, traffic scenarios, and e-scooterists’ riding and gaze behaviors to improve road safety and user experience. A naturalistic study was conducted using instrumented e-scooters, capturing gaze patterns, fixation metrics, and head movement data across various road layouts and traffic scenarios. Key findings reveal that bike lanes offer a stable environment with redu...

    Investigating Truck Driver Behavior under Distracted Conditions to Enhance Road Safety

    A. Alireza, S. Nasim & J. Mansoureh

    Traffic safety for truck drivers is vital to overall road safety, especially in complex traffic conditions. This study examined the driving behavior of truck drivers under distracted conditions, focusing on phone use, rubbernecking, and using a high-fidelity driving simulator and eye-tracking technology. Simulating a segment of the I-695 highway in Baltimore City, the study involved 40 participants navigating mild and heavy traffic scenarios. The study assessed reaction times, speed, braking, and lateral lane positioning during phone calls, as well as ch...

    Effects of Dynamic Visual Coding of Point Symbols in Map-Based Information Visualization Design: An Eye-Tracking Study

    Weijia Ge, Jing Zhang, Shangsong Jiang, Xingjian Shi & Yanxu Zhou

    Dynamic point symbols are increasingly utilized in geographic information visualization interfaces, as they are believed to enhance users’ ability to identify information more efficiently. However, practical applications often lack well-defined design strategies and guidance for implementing dynamic point symbols in map-based visualizations, and there is no consensus on the optimal forms of dynamic coding for these symbols. While some previous studies have explored perceptual differences in dynamic visual coding, none have experimentally investigated t...

    From Skeuomorphic Design to Flat Design. Applying Eye-Tracking to Explore Cross-Cultural Differences in Visual Perception and Arousal Potential on Smart Home Control Panel User Interface Design

    Chih-Yen Lin & Tseng-Ping Chiu

    The rapid development of modern technology and the Internet of Things (IoT) has transformed traditional household appliances into interconnected smart home ecosystems. In user interface design, skeuomorphic design mimics real-world objects to create intuitive and accessible experiences, particularly for first-time users, while flat design emphasizes simplicity, functionality, and consistency, which makes it widely adopted in modern smart home devices. However, while both approaches enhance functional usability, their emotional impacts, such as effects on...

    Beyond looks: the effect of voice personality traits and gestures in virtual agent interactions

    Mingxuan Wang, Nasi Wang, Hang Zhao, Hao Chen, Ting Han & Zhanxun Dong

    With the expansion of extended reality (XR), virtual agents engage more with humans across fields. While the influence of anthropomorphic traits on user perceptions is studied, the combined effects of voice traits and gestures need further investigation. We explored the impact of a virtual agent's voice personality and gestures on subjective perception and visual behaviors in a hospital guidance setting. Using a 2 × 2 within-subjects design, we assessed the influence of voice traits (calm vs. lively) and gestures (with vs. without) through subjective rep...

    gazeMapper: A tool for automated world-based analysis of gaze data from one or multiple wearable eye trackers

    The problem: wearable eye trackers deliver eye-tracking data on a scene video that is acquired by a camera affixed to the participant’s head. Analyzing and interpreting such head-centered data is difficult and laborious manual work. Automated methods to map eye-tracking data to a world-centered reference frame (e.g., screens and tabletops) are available. These methods usually make use of fiducial markers. However, such mapping methods may be difficult to implement, expensive, and eye tracker-specific. The solution: here we present gazeMapper, an open-sou...

    Comparing Gaze-Based Interaction Methods in a Game Environment

    Eleni Navrozidou, Lampros Karavidas, Christos Katsanos & Thrasyvoulos Tsiatsos

    Eye tracking is a valuable tool in human-computer interaction providing insights into user behavior via gaze data or opportunities for novel gaze-based interaction methods. These new interaction methods can result in greater immersion and accessibility, which are particularly important in gaming. Several gaze-based interaction methods, such as dwell time and blinking, have been proposed in an attempt to balance interaction efficiency and accuracy with player fatigue. This study compares two such gaze-based interaction methods, the point-and-click and the...

    Exploring the Immersive Gaming Journey: A Virtual Reality and Eye-Tracking Rehabilitation System for Pediatric Amblyopia

    Ziqi Guo & Yixuan Zhou

    Amblyopia is a common visual disorder in children. Traditional treatment methods, lacking interactivity and engagement, often result in low compliance among patients, which limits the effectiveness of the treatment. With the continuous advancement of digital technology, its potential applications in the medical field offer new opportunities for amblyopia rehabilitation. This study employs a user-centered design approach and conducts a Delphi interview with 15 experts to complete the needs analysis. An immersive amblyopia rehabilitation system integrating...

    • Tobii VR

    Recognising and explaining mental workload using low-interference method by fusing speech, ECG and eye tracking signals during simulated flight

    Haixin Xu, Lijing Wang, Jiaying Zou, Jun Zhang, Runhao Li, Xianchao Ma, Yanlong Wang & Yanzeng Zhao

    The mental workload of pilots is a critical factor influencing performance. This study aims to propose a low-interference mental workload recognition method based on aviation ecological validity. A simulated flight tracking experiment was conducted with twenty-six pilot cadets. Speech, ECG and eye-tracking data were collected at different workload states corresponding to various training stages. The recognition performance of different feature combinations was evaluated using various machine learning model. Furthermore, the SHapley Additive exPlanations ...

    How Do We Team Up? Human-Machine Co-driving Style Assessment Through Visual Dynamic Analysis and Vision-Language Model

    Zhuorui Zhang, Donglin Li, Yiteng Sun, Ching-hung Lee, Shanshan Feng & Fan Li

    As autonomous driving technology advances, understanding human-machine co-driving styles becomes increasingly crucial. The integration of autonomous systems influences traditional human driving styles, resulting in diverse co-driving dynamics. This paper focuses on generating comprehensive driver behavior reports using Vision-Language Model (VLM) to assess human-machine co-driving styles. The assessment is challenged by complex driving scenarios, individual differences, and unclear style indicators. To address these challenges, we introduce the Adaptive ...

    Interpretability Analysis and Combined Prediction of the Coupled Relationship Between Pilot Fatigue and Situational Awareness

    Xinggang Hou, Yuan Feng, Bingchen Gou, Dengkai Chen, Jianjie Chu & Lin Ma

    Fatigue and situational awareness are key risk factors for pilot effectiveness in automatic cruise. In order to explore the nonlinear coupling relationship between pilot fatigue and situational awareness in automatic cruise and to reduce the multiple covariance between the predictive features, a comprehensive analysis based on machine learning interpretable techniques is performed in the spatial and temporal dimensions to improve the prediction accuracy. First, multidimensional time series were constructed from multimodal physiological data, and high-pre...

    Impact of color hues on arousal, concentration, and visual attention in digital platforms

    Wagner Junior Ladeira, Tareq Rasul, Syed Hasan Jafar, M. S. Balaji, Fernando de Oliveira Santini & Mustafeed Zaman

    The research objective posed for this study is to investigate the effect of warm and cool color hues on arousal, concentration, and visual attention in digital platforms. As evidenced by the research on color perception in the hospitality industry, the focus on color psychology is relatively modest concerning user behavior in digital platforms. This research addresses this gap by conducting two experiments: an online survey focusing on orientation attention and a laboratory experiment with an eye-tracker device employed to examine discovery attention. Th...

    Echoes of Empathy: A Symbiotic IoT-Based Emotion Feedback Framework for Psychological Interventions via Large Language Model

    Minqiang Yang, Zhichao Yang, Zhaolong Ning, Hao Shen, Chengsheng Mao, Changsheng Ma & Bin Hu

    Large AI models, connected to terminal devices via high-speed mobile communication networks, enable task collaboration and resource sharing, forming an intelligent framework for the Symbiotic Internet of Things (SIoT) paradigm in industry applications. Despite large language models hold significant potential for psychological intervention, their emotional interaction capabilities remain limited. This paper introduces a SIoT framework for psychological intervention and proposes an emotion-enhanced human-machine interaction architecture incorporating behav...

    On Target: Constant Activity Constrained Semi-supervised Feature Selection for Marksmanship Activity Classification

    Louis J. Dankovich IV, Andrew Tweedell, Chloe Callahan-Flintoft & Richard Diego

    In assistive technology, misclassification can degrade performance by aiding the wrong activity. In human activity recognition classes are often significantly imbalanced and have few labels. For example, while the final stage of shooting is a continuous activity, often the only labeled samples are trigger pulls which can account for < 1% of the dataset. Label spreading can mitigate this but requires optimized features and balanced class distributions. Conventional metrics assume constant ground truth and work poorly with label spreading. This results in ...

    • Tobii VR
    • LSL
    • EYE-EEG

    Impact of the Use of a Virtual Assistant on Driver Stress

    Julie Lang, Massyl Touat, Johana Bodard, François Jouen & Gérard Uzan

    The growing integration of virtual assistants in vehicles raises concerns about their effect on driver stress and distraction. This study examines whether such an assistant can reduce stress or introduce risks. Using a driving simulator, we created scenarios with stress-inducing events such as pedestrian crossings, speed cameras, low fuel warnings, and accidents. The assistant intervened by providing reassurance, adjusting routes, and delivering non-driving-related information. The qualitative results show both benefits and drawbacks. Reassurance functio...

    Visual Cues in Survey Design- A Strategic Use of Emojis in Research

    Aishwarya Balan & Rabail Tahir

    Emojis are increasingly designed into surveys to intuitively capture users’ emotions and opinions on products and services. Survey design and layout also significantly shape the user experience (UX) of survey takers. However, significant concerns exist regarding emoji misinterpretation, influenced by factors such as age, gender, culture, and operating systems. Despite the growing use of emojis, limited research addresses their effectiveness within bipolar differential rating scales, a common tool in survey design. This paper addresses these concerns by...

    TikTok Usage Effects on Attention to News Reading: An Eye-Tracking Study

    Bridget Cole, Arthur D. Santana, Xiaohan Hu & Toby Hopp

    This research examines how the use of the social media TikTok correlates with users’ attention to news reading. In a quasi-experimental laboratory setting, 242 U.S. college-age participants read 10 news and opinion pieces on a computer. Before reading, half of the sample browsed TikTok. Using eye tracking metrics, we found that those who browsed TikTok before reading were less likely to sustain their attention on the articles. Those who reported low news consumption frequency were more likely to pay less attention to news reading after browsing TikTok. I...

    Impact of Reviewing Procedure With Visual Gaze Patterns on Improving Endoscopic Submucosal Dissection Skills

    Huy Thanh Dang, Fumiaki Ishibashi, Kosuke Okusa, Kentaro Mochida, Takao Tonishi & Sho Suzuki

    No previous studies have reported on whether tracking and reviewing physicians' gaze patterns affect the endoscopic submucosal dissection (ESD) training process. This study investigated differences in physicians' gaze patterns during ESD and assessed how reviewing their procedure afterward impacted ESD skills.

    Comparison and Optimization of Target-Assisted Gaze Input Technique for Enhanced Selection in Virtual Eye-Controlled Systems

    Xiaoteng Tang, Xiaojiao Chen, Hanxi Leng, Zhengyu Wang, Bolin Chen, Yonghao Chen, Wenru Qi & Xiaosong Wang

    Eye-controlled interaction in VR offers intuitive, hands-free control, but reducing false triggers such as the “Midas touch” remains challenging. This study evaluates target-assisted fixation (TA-Fixation) under varying fields of view (FOVs) and target densities. Experiment 1 compares TA-Fixation with standard fixation and gaze gesture techniques, showing that TA-Fixation balances accuracy and efficiency. However, in smaller FOVs and higher target densities, both fixation and TA-Fixation exhibit reduced accuracy, highlighting the relative advantage than ...

    • Tobii VR

    Physiological and Behavioral Analysis Based Multimodal Evaluation of Older Adults’ Experience with Kitchen Appliances

    Cheng Xue, Minghui Liu, Yuxiang Zhai, Jiachen Du & Xinyi Fu

    As global population aging accelerates, enhancing the quality of life for older adults at home has become critical. This study evaluates kitchen appliance user experiences, focusing on elderly users’ needs in intergenerational contexts. The research uses a multimodal data collection approach, combining eye-tracking, electromyography, pressure sensing, and behavioral analysis to examine older adults’ interactions with kitchen appliances. The methodology employed Tobii Glasses 2 for visual attention tracking, ErgoLab EMG for muscle fatigue measurement, pre...

    The Effect of Static and Dynamic AI-Generated Visual Content on Emotional Recall in the Elderly

    Quanjingzi Yuan, Mingjiu Yu, Dengkai Chen, Ying Cao, Qian Wen, Muyao Shen & Huangjie Lin

    This study explores the use of Generative Artificial Intelligence (Generative AI) in enhancing emotional reminiscence among older adults, comparing the effects of static images and dynamic videos on emotional arousal and psychological well-being. Twenty-five participants aged 65 and above were assessed using the PAD scale, eye-tracking analysis, and interviews. Results show that both static and dynamic AI-generated content significantly enhance pleasure and dominance, with dynamic videos having a stronger impact on arousal and emotional resonance. Eye-tr...

    Cycling with hemianopia to explore road user detection and scanning behaviour in virtual reality

    E. M. J. L. Postuma, G. A. de Haan, F. W. Cornelissen & J. HeutinkPLOS One

    Cyclists with homonymous hemianopia (HH) may face challenges in detecting road users, especially in unpredictable situations or with distractors. This study examined how HH affects detection, scanning behaviour, and the relation between detection and scanning in a virtual cycling environment. Participants with real HH, simulated HH, and unimpaired vision (N = 12 per group) cycled in a virtual environment, braking upon detecting road users during predictable and unpredictable events, with and without distractors. Scanning behaviour and detection performa...

    • Tobii VR

    The Application of Eye Movement Analysis in the Study of Remote Tower Controller Workload

    Haiming Shen, Tingting Lu, Zhixuan An, Ning Li, Wen-Chin Li & Yanqing Wang

    In order to ensure the safe and efficient operation of the remote tower system, this paper further analyzes the workload of the controllers under different control modes. The selected experimental subjects were front-line controllers. The field tracking method was used to obtain the eye movement characteristic data and NASA-TLX scale data commanded by controllers under two control modes of traditional physical and remote tower. The results show that there are significant differences in the mean number of blinks, number of fixations, average blink duratio...

    Using Eye-Tracking Analysis to Detect Pilot Focus in Drone Interfaces During Signal Loss

    Dimosthenis Minas, Angelos Fotopoulos, Michalis Xenos & Christos Zotos

    Signal interruptions remain a critical challenge in drone operations, as losing connection to the operator can result in sudden, high-stress scenarios with potential safety implications. This paper presents an investigation using mobile eye-tracking technology to examine how both novice and experienced drone pilots allocate their visual attention when confronted with total signal loss. Fifty-six participants (11 experienced, 45 novice) completed a standardized flight task during which the drone’s connection was deliberately disrupted. Quantitative data, ...

    A digital twin-driven enhanced visualization method for high-steep slope scene

    Research on enhanced visualization of high-steep slope twin scenes is crucial for accurately depicting relationships between entities and improving the efficiency and accuracy of scene cognition. However, existing studies focus on static slope model displays, facing challenges such as slow model reconstruction, lack of integration with 3D scenes, and low cognitive efficiency. To address these issues, this paper proposes a digital twin-driven enhanced visualization method for high-steep slope scenes. Firstly, the slope model is rapidly reconstructed using...

    Analysis of visual fixations of novice vs. expert basketball players in triple threat situations based on defensive context

    Keb Tonantzin Hernández-Peña, Ruperto Menayo & Gemma M Gea-García

    The objective of this research was to analyze the duration of visual fixations of novice and expert basketball players before executing a motor action in a triple-threat situation while facing four defensive formations: man-to-man defense, 2-3 zone, 1-2-2 zone, and 1-3-1 zone. The results showed that man-to-man defense required more fixation time for expert offensive players when facing the 2-3 zone. Additionally, expert players exhibited significantly shorter fixation times compared to novices when facing the 2-3 and 1-2-2 defenses. The complexity of de...

    Leveraging Temporal Gaze Patterns for Intelligent Segmentation in Mobile Eye-Tracking

    Shupeng Wang, Yizi Chen, Sidi Wu, Peter Kiefer & Martin Raubal

    Recent advancements in deep learning models for object segmentation have significantly enhanced the analysis of mobile eye-tracking data, enabling automatic dataset annotation. However, many of these models rely solely on raw gaze and fixation points to indicate annotation targets on individual video frames, thereby neglecting the valuable temporal contexts provided by gaze features. In this paper, we introduce a pipeline that integrates temporal gaze features into the SAM 2 model to improve the segmentation accuracy of automatic annotations for mobile e...

    XTar: entropy-based target expansion for high density gaze-based interfaces

    Candy T Gonzales & Carlos H Morimoto

    Due to the low accuracy and noisy data of common eye trackers, virtual gaze-activated targets used for gaze interaction tend to be large, so they can be easily fixated and selected. Therefore, a full-size virtual keyboard with 30 to 40 keys may take a large portion of the screen space. If one simply reduces the keyboard size into a higher density interface, selections would become unreliable. In this paper we present XTar, an expandable target interface that uses an entropy-based algorithm to expand and improve the robustness of target selection in high ...

      How Do Experts Make Sense ofvIntegrated Process Models?

      Tianwa Chen, Barbara Weber, Graeme Shanks, Gianluca Demartini, Marta Indulska & Shazia Sadiq

      A range of integrated modeling approaches have been developed to enable a holistic representation of business process logic together with all relevant business rules. These approaches address inherent problems with separate documentation of business process models and business rules. In this study, we explore how expert process workers make sense of the information provided through such integrated modeling approaches. To do so, we complement verbal protocol analysis with eye-tracking metrics to reveal nuanced user behaviours involved in the main phases o...

      CLBoundaryManager: A System Facilitating Boundary Management and Border Crossing Between Life Domains

      Moritz Maleck & Tom Gross

      Interruptions from non-work domains, such as family, can disrupt work tasks, particularly during periods of high cognitive load, leading to reduced efficiency and increased stress. We introduce the CLBoundaryManager concept for optimising the timing of interruptions based on relevance indications of communication requests and user workload. The implemented system uses cognitive load data from eye tracking to manage communication between work and family domains. This allows users to stay connected with family during work.

      SENSE: Sensemaking Effectiveness Using Neurocognitive Signatures of Efficiency

      Evelyn Kim, Srikanth Nadella, Mary Frame, Mitchell Sayer, Mia Levy, Anna Maresca, Gina Notaro, Alex Waagen & Cara Widmer

      Advances in AI/ML automation technologies have been accelerating innovations in human-computer interaction (HCI) to improve overall efficiency and productivity while reducing human effort, especially for complex analytics tasks. Analysts have been assessing these technologies’ impact using subjective and qualitative surveys, but there has not been a systemic tool that automatically measures efficacy as analysts accomplish their tasks. This paper introduces SENSE, which attempts to measure human performance, behavior, and cognitive states in an automated ...

      Signals of Strain: Using Biosignals to Assess Fatigue in Video Conferencing

      Lucy V. Pagel, Tanja Kojic, Vera Schmitt, Wafaa Wardah, Philipp L. Harnisch, Sebastian Möller & Robert P. Spang

      The advent of remote work and video conferencing has introduced unique challenges, with “Video Conferencing Fatigue” (VCF) emerging as a prevalent issue. Rooted in increased mental workload, VCF stems from factors like constrained movement, limited non-verbal cues, prolonged gaze fixation, and degraded audiovisual quality. While self-reported measures shed light on user experiences, they often lack real-time applicability. This study investigates the potential of biosignals as objective markers for quantifying mental workload and fatigue during video con...

      CNN-based estimation of gaze distance in virtual reality using eye tracking and depth data

      Anna-Lena von Behren, Yannick Sauer, Björn Severitt & Siegfried Wahl

      Eye tracking in virtual reality (VR) can improve realism and immersion, for example, with gaze-contingent depth-of-field simulations. For this application, knowing the distance of the fixated object, not just the gaze direction, is crucial. One common approach estimates gaze distance from vergence, the relative angle between the eyes, but the accuracy of this method is limited, particularly for larger distances. Alternatively, the gaze distance in VR can be retrieved directly from the depth map at the point of estimated gaze. However, eye tracking inaccu...

      • Tobii VR

      How Developers Make Decisions When Choosing Issues and Reviewing Code: An Eye Tracking GitHub Study

      Igor Scaliante Wiese, Jasmine Boyer, Ethan Rasgorshek, Gustavo Pinto, Marco Gerosa, Igor Steinmacher & Bonita Sharif

      The paper presents a pilot eye-tracking study on how developers choose what issues to work on and how they perform code-reviewing tasks within the GitHub ecosystem. In this study, we recorded the eye movements of thirteen developers to understand what they look at on the GitHub interface to make decisions. They completed four tasks namely, ranking a list of open issues to work on, prioritizing pull requests, the likelihood of pull requests being accepted, and finally evaluating 25 diverse user profiles for pull request acceptance likelihood. Results sugg...

      Expert-Novice Eye tracking in Gross Anatomy

      Nancy Adams, Do Hyong Koh, Kyle E. Rarey & Pavlo Antonenko

      This pioneering study explored the eye movement classifications among expert and novice anatomists in a gross anatomy cadaver lab. Participants wore eye-tracking glasses while identifying tagged anatomical structures in a prosected donor body. As expected, our initial findings indicated that participants with greater expertise had shorter completion times. Also, the normalized fixation features of participants showed that as expertise levels increased, there were fewer fixations with shorter durations. This suggests that participants with greater experti...

      Streamlining Eye-Tracking and Observational Data for Field Study Visual Analysis

      Yidan Zhang, Nethara Athukorala, Ziying Liang, Yidan Qiao, Simran -, Yu Xuan Yio, Lee Lawrence, Benjamin Tag, Mor Vered, Michael Wybrow & Sarah Goodwin

      Wearable eye-tracking in field studies presents challenges in synchronising gaze data with dynamic stimuli and integrating observational notes from multiple observers. Existing tools often struggle to visualise eye-tracking patterns in complex, real-world environments with frequently changing areas of interest (AOIs). To address this, we propose a streamlined workflow that simplifies analysis preparation by integrating real-time observer notes with eye-tracking data with enhanced timestamp-based synchronisation, improving data mapping, and automating AOI...

      Energy-Aware Benchmarking of Wearable Eye Trackers

      Marco Carminati, Filippo Melloni, Giulio Marano, Alberto Pettenella, Daniele Bani, Daniele Maria Crafa, Andrea Aspesi, Andrew Duchowski, Tommaso Ongarello & Luca Merigo

      The number of devices embedding eye tracking (ET) capabilities, such as portable webcam-based consumer devices and wearable ones, such as headsets and smart eyeglasses, is rapidly increasing, making this technology truly pervasive. Despite the large number of papers and reviews discussing data quality and benchmarking of trackers, none of them is addressing the trade-off between power consumption, speed and accuracy. Power dissipation is typically dominated by signal processing to extract gaze information from sensors embedded in the glasses. This compro...

      Exploring Young Peoples Visual Attention while Assessing Climate Change Content on Social Media

      Christine Wusylko, Do Hyong Koh, Pavlo Antonenko, Kara Dawson & Angela Kohnen

      In this study, we utilize a concurrent mixed methods design to explore the attention patterns and processing strategies of young people as they evaluate socioscientific information on social media. We utilized the screen-based Tobii eye tracker to capture ten 8th and twenty 9th grade student's fixations while they evaluated if climate change information was believable or not. The students then completed a retrospective think aloud to explain their process. We find that it is possible to categorize young people's gaze patterns into heuristic and systemati...

      Transferable eye gaze control method for maritime vehicles as demonstrated on an unmanned surface vessel (USV)

      Vanessa Barth, Van S Jones & Leigh McCue

      Unmanned surface vessels (USVs) and other maritime vehicles are often operated using a keyboard and mouse combination or joystick-style controller, and are commonly used by those within the ocean, environmental, and biological sciences. These controllers keep the user’s hands occupied and require development of specific motor skills for vehicle control. Furthermore, these approaches are unusable for those with upper-limb mobility challenges, which presents a barrier to participation in these fields. Eye tracking has enabled users to control a device, app...

      Visualizing Novice Programmers’ Attention Distribution using DBSCAN Clustering and Sankey Diagrams

      Understanding how novice programmers allocate their visual attention during programming tasks can improve education. Although eye-tracking provides rich quantitative data, visualizing gaze behavior effectively remains challenging. This study introduces a methodology that integrates DBSCAN clustering and Sankey diagrams to visualize attentional distribution among novice programmers based on their expertise and accuracy. We collected eye-tracking data from undergraduate students as they solved multiple-choice programming questions. We clustered fixation da...

      Digital Art Gallery in Metaverse: Eye Tracking Digital Visitors’ Visual Attention, Engagement and User Journey when Interacting with Digital Artworks on Smartphones

      Zofija Tupikovskaja-Omovie

      With the exponential adoption of smartphones among young people, the rapid adoption of digital environments, namely Metaverse, for cultural engagement is increasing in creative industries. There is a limited understanding of how digital artwork, exhibited in digital art galleries, influences visitors’ visual attention and engagement with artworks in Metaverse’s Art Gallery. This study used a multi-method approach, triangulation of eye tracking experiments on smartphones, mapping AOIs, and developing user journeys based on visual attention patterns. The u...

      Mapping Democracy: An Eye-Tracking Analysis of Election Maps

      Stanislav Popelka, Julie Dorusakova, Tomas Vanicek & Michaela Vojtechovska

      In the digital era, election maps play a vital role in visualizing complex electoral data and shaping the public’s understanding of democratic outcomes. However, interpreting these maps can be challenging, particularly for non-experts, as comprehension is influenced by both cognitive styles and educational background. This study utilized eye-tracking technology to examine how users engage with interactive election maps. We conducted experiments with 20 high school students, categorizing them as either analytical or holistic thinkers based on post-session...

      Recognition of errors in gaze-based interaction with anomaly detection

      Björn Rene Severitt, Yannick Sauer, Nora Jane Castner, Wolfgang Fuhl & Siegfried Wahl

      Gaze-based interaction provides an intuitive way to control robotic systems, but unintended selections remains a challenge. Conventional approaches mitigate this problem by requiring additional confirmation actions, yet incorrect decisions still occur. In this study, we propose an anomaly detection approach to improve selection accuracy. We conducted a virtual reality experiment with a visual search task and tested different methods to find anomalies in the gaze pattern. These methods are trained with correct selections to learn their features. By exploi...

      • Tobii VR

      Evaluating the Effects on Comprehension in Python Code from Idiomatic Development

      Joshua A.C. Behler

      This work outlines an eye-tracking study designed to assess the readability of idiomatic versus non-idiomatic Python code among both novice and expert developers. Idioms are an important part of Python’s design and developer community. However, no prior research has rigorously evaluated whether these idiomatic constructs enhance comprehension compared to their non-idiomatic counterparts. This study will address this by measuring the comprehension of idiomatic and non-idiomatic Python code to determine if there is a significant difference.

      • itrace

      Research on Flight Training Optimization with Instrument Failure Based on Eye Movement Data

      Jiwen Tai, Yu Qian, Zhili Song, Xiuyi Li, Ziang Qu & Chengzhi Yang

      To improve the quality of flight training in instrument failure scenarios, eye movement data were collected from flight instructors during climbing, descending, and turning flights when the primary attitude direction indicator failed. The performance data of the excellent instructors was selected to produce eye movement tutorials. These tutorials were used to conduct eye movement training for the experimental group of flight trainees. In contrast, the control group received traditional training. The performance and eye movement data of the two groups of ...

      Once Upon a Time… Acquisition of Second Language Vocabulary Through Robotic Storytelling in Classroom Settings

      Anne-Lise Jouen, Reiko Matsunaka & Kazuo Hiraki

      Given their embodied social nature, robots have the potential to facilitate educational processes. As childhood is an opportune age to introduce a new language, robots could be particularly useful in the area of second language (L2) learning for children. This study assessed whether a social robot could provide efficient teaching to young children and how social cues of joint attention (pointing and gazing) can influence L2 learning. 82 children participated in an experiment with the Nao robot telling a story in French, adding -or not- joint attention ge...

      Procedures for personally optimizing text-to-speech output for people with aphasia and neurotypical adults: a proof-of-concept study

      Kelly Knollman-Porter, Karen Hux, Sarah E. Wallace & Elise Bossenbroek

      Background Text-to-speech (TTS) technology supports reading confidence and speed for people with aphasia (PWA) but does not universally improve comprehension. This may reflect selection of a less-than-optimal TTS output rate. To evaluate this, researchers need procedures to identify a rate best matching reading capability. This study’s purpose was evaluating whether online eye-tracking procedures are effective for determining a personally optimized TTS rate and examining reading speed, comprehension, and efficiency as variables for the selection process....

      An automotive human–machine interface design method integrating Fuzzy Kano-QFD and physiological data

      Xinhao Sun, Xiurong Guo, Yanling Zhang & Danfeng Du

      Against the backdrop of escalating intelligent driving technology, the challenge for human–machine interface (HMI) design is to accurately define diverse and individualised customer requirements (CRs), as well as to ensure the stability, usability and competitive advantage of the design solution. HMI design methods that address these issues have not been thoroughly studied. To address this challenge, this study proposes a HMI design methodology that integrates fuzzy Kano features, quality function deployment (QFD) and physiological experiments (eye-track...

      Google inject: increasing engagement with fact-checks through nudging*

      Loukas Konstantinou & Evangelos KarapanosThe Journal of Medical Investigation

      Fact-checking has emerged as a principal part of news reporting with over 400 fact-checking organisations worldwide. However, fewer than one in ten individuals report having used a fact-checking service. In this paper, we introduce Google Inject: a technology-mediated nudge that integrates, relevant to one's query, fact-checks, into the Google search results page. We report on a laboratory study that inquired into how four design variables, in particular, the number of fact-checking articles injected, their positioning, concealment and seamlessness affec...

      Examining Interface Preferences in a Decision Support System Using Eye-Tracking

      Evanielle Barbosa Ferreira, Lucia Reis Peixoto Roselli & Adiel Teixeira de Almeida

      To support the decision-making process and enhance user interaction, Decision Support Systems (DSSs) are being developed and continuously improved. The aim of this study has been to investigate the interface of the FITradeoff DSS in order to investigate decision makers’ preferences in holistic evaluation and decomposition process. This study analyzed the differences between four interfaces in a DSS, as well as eye movement data from 37 participants. In the experiment (total average duration of approximately 5 min), fixation and pupil data were captured u...

      • Tobii Pro X60 / X120 / T60 / T120
      • Tobii Pro Studio

      Eye Movement Modeling Examples in Robotic Surgery Training—A Randomized Controlled Study

      Andrea Storck, Eva Schönefeld, Michelle Bellstedt, Martin Janssen, Konstantin E. Seifert & Dogus Darici

      OBJECTIVE In robotic-assisted laparoscopic surgery, the perception and interpretation of the visual scene poses a huge challenge for medical trainees. However, their ability to assist effectively in surgical procedures depends heavily on mastering these visual skills. Research on multimedia learning suggests that seeing an expert's eye movements during task completion as a “worked-example” (i.e., eye movement modeling examples [EMME]) may guide learners’ attention to critical areas and improve learning outcomes. The effectiveness of EMMEs in robotic surg...

      Exploring unconscious user responses to affective computing in interactive prototypes: a consumer neuroscience study

      Alvaro Saavedra, Raquel Chocarro, Monica Cortinas & Natalia RubioThe Journal of Medical Investigation

      Affective Computing (AC) has gained increasing attention for its potential to enrich Human–Computer Interaction by enabling technologies to recognise and respond to human emotions. However, there is limited research on how users unconsciously react to AC-based interactive prototypes at a physiological level during interaction. This study examines user cognitive and affective responses to two interactive AC-based Prototypes using consumer neuroscience techniques – Electroencephalogram (EEG), Galvanic Skin Response (GSR), and Eye-tracking – to capture unco...

      Game-Based Learning for Improved Hazard Identification: Evaluating the Effectiveness of OSHA Hazard Identification Tool

      Sameeran G. Kanade, Sogand Hasanzadeh, Brandon J. Pitts, Behzad Esmaeili & Vincent G. Duffy

      This study examines the effectiveness of game-based learning in enhancing hazard identification skills. The research employed a mixed-methods approach, combining quantitative analysis of participants’ hazard identification performance and eye-tracking data with qualitative insights from participant feedback. In a simulated study, participants were asked to identify hazards following the game-based training intervention. The Hazard Identification Index (HII) scores increased significantly (p < 0.0001) in the post-training trials, indicating enhanced hazar...

      Railway safety under increasing speed: effect of cognitive ability on train drivers’ hazard perception

      Wenli Dong, Weining Fang, Xiaoxuan Jiang, Haifeng Bao & Hanzhao Qiu

      Increasing speeds in high-speed rail heighten safety concerns, particularly as foreign object detection technologies remain limited under adverse conditions. Train drivers, as the final safeguard, must accurately perceive and respond to hazards with reduced reaction margins. This study examines how four speed classes and three cognitive abilities—attention, reaction, and learning—affect hazard perception (HP) using a high-fidelity hazard perception test (HPT) developed in Unity 3D. Thirty participants completed the HPT, with performance assessed via resp...

      The Power of Context: An LLM-based Programming Tutor with Focused and Proactive Feedback

      Moritz Mueller, Corinna List & Michael Kipp

      Current research aims to utilize Large Language Models (LLMs) for tutoring beginning programming students efficiently and at scale. Students often struggle to interact effectively with LLMs to obtain meaningful feedback. We introduce an LLM-based Intelligent Tutoring System (ITS) with a structured interface and prompts aligned with Hattie’s feedback model. To provide more focused feedback, we utilize the user interaction history for context. Additionally, we explore the question of proactivity. A user study with 9 participants compared history-based and ...

      Right-brain utilization in pharmacists' dispensing processes: an eye-tracking analysis of efficiency and safety using error-induction models

      Toshikazu Tsuji, Kenichiro Nagata, Masayuki Tanaka, Shiori Iwane, Shigeru Hasebe, Yuto Nishiyama, Nana Yoshikawa, Hiroyuki Watanabe, Shigeru Ishida, Takeshi Hirota, Ichiro Ieiri & Mayako Uchida

      Background Dispensing errors associated with “same-name drugs” and “similar-name drugs” are common, negatively affecting patients. Using two pairs of error-induction models, this study analyzed pharmacists' gaze movements while dispensing by an eye-tracking method to interpret their thought processes. Thus, we aimed to assess the efficiency and safety of dispensing processes by examining right-brain function using error-induction models. Methods We created verification slides for display on a prescription monitor and three drug rack monitors. The prescr...

      TESY: A Usability Test-Driven Prototyping Assistant Connecting Designers with Crowd-Testers

      Felix Kretzer & Alexander Maedche

      In recent years, the availability of easy-to-use prototyping tools has empowered designers to create GUI designs. In parallel, a broad spectrum of usability testing tools have been proposed to support the collection of quantitative test data from crowd-testers. However, test specification and results are typically disconnected from created GUI designs and, therefore, difficult to translate into improvements. In this paper, we present TESY, a prototyping assistant integrating usability test specification and resulting test data. We implement TESY as a plu...

      Designing the HMI for a DC Motor Toolkit for Control Engineering Education

      Vivek Kant, Pramod Mhaske & P. S. V. Nataraj

      The aim of this article is to design a Human Machine Interface (HMI) for a direct current (DC) motor toolkit. This toolkit is designed to teach the concepts of control engineering to undergraduate engineering students. The kit itself has been developed over the course of a decade by several refinements from in‐class engagement and feedback from several batches of undergraduate learners. The kit can be connected to a computer through a USB port and can be provided inputs through it. The key challenge is to design a suitable HMI to support the operation of...

      Enhancing Transesophageal Echocardiography Training in Cardiac Anesthesia Fellows Using Wearable Eye-Tracking Technology

      Benjamin Gorbaty, Enrique Vergara Escuardo, Alexander Gherciuc, Serjey Gherciuc & Tjorvi E. Perry

      The training of Adult Cardiothoracic Anesthesiology (ACTA) fellows in transesophageal echocardiography (TEE) is essential for their development, but assessing technical proficiency remains challenging. While hands-on experience is the cornerstone of learning, traditional evaluation methods primarily focus on image interpretation, neglecting the assessment of image acquisition techniques and visual attention. We describe our experience using wearable eye-tracking technology to objectively assess the TEE skills of ACTA fellows. Since 2023, our ACTA fellows...

      Deep Learning–Based Prediction of Human–Robot Trust Dynamics in Future Construction Using Worker Neuropsychophysiological Responses

      Woei-Chyi Chang, Nestor F. Gonzalez Garcia & Sogand Hasanzadeh

      Because current construction activities are safety-critical and physically demanding, the incorporation of such autonomous technologies as robots and drones via worker–robot teaming has drawn interest from researchers and practitioners alike. However, this teaming relationship may impose additional safety concerns for future jobsites due to workers’ inappropriate trust—overtrust and/or distrust—in robots. The literature has highlighted that trust is a complicated and dynamic concept that fluctuates over time, highlighting the need to continuously underst...

      • Tobii VR

      Statistical Software Usability for Novice Research Students in the Social Sciences: An Eye-Tracking Study

      Sedigheh Abbasnasab Sardareh, Gavin T. L. Brown & Paul Denny

      Many social science research students struggle to master statistical data analysis and exhibit low ability in using statistical software tools. The current study tackles the possibility that the design of statistical software systems explains the difficulty that students encounter when conducting statistical data analysis. An eye-tracking experiment randomly assigned 24 students to either SPSS or jamovi software to complete a linear regression task so as to evaluate the usability of the two systems. Upon task completion, each participant “thought aloud” ...

      A Topical‐Clustered Layout Method for Intrinsic Tag Maps

      Nai Yang, Yuhang Chen, Yi Chao & Alan M. MacEachren

      Tag maps, a geographic extension of word clouds, represent information by mapping tags and their relationships onto corresponding regions. These maps provide valuable insights into the topics associated with specific geographic areas. Semantic relationships between tags are frequently neglected in current tag map layouts. Inspired by the benefits of semantic clustering in word clouds in guiding user comprehension, we introduce semantic clustering into tag map layouts. We propose an adaptive regional segmentation method combined with a scan line‐based tag...

      Tracking Success: Exploring the application of eye tracking for simulator validation in the clinical and simulated environments

      Haroula M. Tzamaras, Joseph Mast, Elizabeth Sinz, Jason Moore & Scarlett Miller

      Introduction Simulation-based training (SBT) is used to train medical residents before they perform procedures on patients, yet most simulators do not have reporting on their validation readily available. In SBT, there is no obvious standard for how validity tests of simulators should be conducted, or which type of validity should be used. Eye-tracking can be used to determine validity by comparing gaze patterns of physicians between the clinical and simulator environments, and between novices and experts. This exploratory study utilizes eye tracking to ...

      Usability evaluation study of the interface of a guided diagnosis robot based on eye movement experiments

      Shilin Dou, Hemin Du, Fei Xu & Ruiye Hong

      This study aims to enhance the usability and operational efficiency of the diagnosis-guiding robot interface at Union Hospital, Huazhong University of Science and Technology, Shenzhen, China, through an analysis of interaction design using eye movement experiment results. A subjective-objective usability evaluation method was employed to assess the XiaoYi interface. The Tobii Pro Glasses2 eye-tracking test was conducted on 31 subjects, focusing on the “pre-examination and triage” and “departmental specialist view” functions. The study concludes that eye...

      Incorporating visual attention measures to reveal homeowners’ preferences for environmentally friendly urban landscapes

      Xumin Zhang & Hayk Khachatryan

      Sustainable urban planning practices can help reduce the urban heat island effect, promote green roofs and walls, and encourage the preservation of natural habitats within urban areas. Cities can enhance their resilience to climate change and create healthier, more attractive living spaces for their inhabitants. Resource-efficient or environmentally friendly urban landscapes can support local ecosystems and biodiversity and require fewer external inputs, such as irrigation water and nutrients. To mitigate the increase in population and water demand in ur...

      Sequential Visual Cues from Gaze Patterns: Reasoning Assistance for Bar Charts

      Antonia Schlieder, Jan Rummel, Peter Albers & Filip Sadlo

      Even for well-studied visual reasoning tasks such as those performed on bar charts, little is known about the cognitive strategies users adopt to solve them. Guidance systems that support users in learning visual reasoning require information on successful strategies to help unsuccessful users improve or change their strategies. We introduce the guidance paradigm of sequential visual cues (SVCs), accompanied by a differential pattern mining approach that determines relevant visual attention patterns from gaze data, and exemplified for bar charts. The nov...

      Sensing Noticeability in Ambient Information Environments

      Yi Fei Cheng & David Lindlbauer

      Designing notifications in Augmented Reality (AR) that are noticeable yet unobtrusive is challenging since achieving this balance heavily depends on the user’s context. However, current AR systems tend to be context-agnostic and require explicit feedback to determine whether a user has noticed a notification. This limitation restricts AR systems from providing timely notifications that are integrated with users’ activities. To address this challenge, we studied how sensors can infer users’ detection of notifications while they work in an office setting. ...

      Physical and Semantic-Driven Transformation of Everyday Objects into Smart Interfaces in MR

      Xiaozhan Liang, Hu Yong, Xukun Shen, Tianyu Yang, Yu Wang, Chenyue Zheng & Dongxu Piao

      MR merges virtual and physical worlds, with MLLM enhancing contextual understanding and multisensory perception for smarter interactions. This study explores user behaviors and task needs through contextual inquiry and retrospective interviews (N=12), identifying key daily tasks and information requirements. A participatory design workshop (N=18) further refines interface displays and interactions based on the physical and semantic attributes of objects, resulting in a dynamic design space. By leveraging MLLM, this design space adapts to user needs, pavi...

      Investigating the Effects of Simulated Eye Contact in Video Call Interviews

      Andrew Jelson, Md Tahsin Tausif, Sol Ie Lim, Soumya Khanna & Sang Won Lee

      Some people suggest that deliberately watching the camera during video calls can simulate eye contact and help build trust. In this study, we investigated the effects of simulated eye contact in video calls and job interviews through an experimental study and a survey. Study 1 involved participants in a mock interview as an interviewer, where a confederate interviewee simulated eye contact half the time. The gaze patterns of the participants were tracked to understand the effects. In Study 2, we conducted an online survey to confirm the findings of Study...

      A prediction model of the mental workload of pilots based on improved multiple resource theory

      Huining Pei, Hao Gong, Yujie Ma, Man Ding, Xinyu Liu & Chuyi Zhang

      Purpose With the development of modern military technology, new combat equipment increased function-ality, and at the same time increased the workload of the operator. The goal of this study is to accurately and objectively predict the mental workload of the pilots of receiver aircraft (RA) during aerial refueling. Design/methodology/approach The prediction model is based on the multiple resource theory (MRT). Level-based weight as-sessment (LBWA) and the decision-making trial and evaluation laboratory–interpretative structural modeling (DEMATEL-ISM) me...

      Characteristics of Driver Peripheral Vision: How Drivers Respond to Ubiquitous Information on Wide-Area In-Vehicle Displays

      Hongwei Huang, Jiateng Li, Xuejing Feng, Jun Ma & Bruce Mehler

      Despite advancements in In-Vehicle Information Systems (IVIS) and extensive research on screen layouts, the influence of drivers’ peripheral vision on interactions with evolving multi-screen and large display technologies remains poorly understood. This study examines drivers’ responses to in-vehicle interactive information through peripheral vision, aiming to optimize visual interaction efficiency and enhance driving safety. Analyzing data from 216 participants in a driving simulator, we explored how horizontal eccentricity, screen type, cognitive load,...

      Sonora: Human-AI Co-Creation of 3D Audio Worlds and its Impact on Anxiety and Cognitive Load

      Fernanda M De La Torre, Javier Hernandez, Andrew D Wilson & Judith Amores

      Soundscapes are widely used for relaxation, but their potential for personalized, navigable experiences remains under-explored. To address this, we developed Sonora, an AI tool that enables real-time generation of synthetic, spatialized soundscapes, allowing users to navigate immersive auditory environments and customize soundscapes using voice commands. Sonora’s architecture integrates audio diffusion models and LLMs within Unity3D. A between-subjects study with 32 participants investigated its effects on anxiety and user experience, compared to a contr...

      • Tobii VR

      Enhancing Smartphone Eye Tracking with Cursor-Based Interactive Implicit Calibration

      Chang Liu, Xiangyang Wang, Chun Yu, Yingtian Shi, Chongyang Wang, Ziqi Liu, Chen Liang & Yuanchun Shi

      The limited accuracy of eye-tracking on smartphones restricts its use. Existing RGB-camera-based eye-tracking relies on extensive datasets, which could be enhanced by continuous fine-tuning using calibration data implicitly collected from the interaction. In this context, we propose COMETIC (Cursor Operation Mediated Eye-Tracking Implicit Calibration), which introduces a cursor-based interaction and utilizes the inherent correlation between cursor and eye movement. By filtering valid cursor coordinates as proxies for the ground truth of gaze and fine-tun...

        Cognitive load state analysis of drivers using multimodal physiological data and machine learning in a VR simulator

        xinyu tao, Dezhong Ma & Xiaotong Xiong

        Driver inattention is the primary cause of highway accidents. Various distractions can impair driving performance, posing a significant threat to road safety. This study uses a VR driving simulator to examine distracted driving, creating a simulated driving environment. It involves designing main and sub-driving tasks to replicate the cognitive load and distractions experienced by drivers. Data are collected using NASA-TLX scales, eye-tracking technology, and physiological signal acquisition. The impact of different distraction workloads on driver perfo...

        Employing Eye Trackers to Reduce Nuisance Alarms

        Katherine Herdt, Michael Hildebrandt, Katya LeBlanc & Nathan LauAdvances in Autism

        When process operators anticipate an alarm prior to its annunciation, that alarm loses information value and becomes a nuisance. This study investigated using eye trackers to measure and adjust the salience of alarms with three methods of gaze-based acknowledgement (GBA) of alarms that estimate operator anticipation. When these methods detected possible alarm anticipation, the alarm’s audio and visual salience was reduced. A total of 24 engineering students (male = 14, female = 10) aged between 18 and 45 were recruited to predict alarms and control a pro...

        s-DResNet: an adversarial domain residual adaptation network for mental workload detection in robotic assisted surgeries

        Jason West, Charanjit Singh, Jackie Cha & Dan Li

        In a high-risk, high-stakes task like robotic assisted surgery, identifying the mental workload (MWL) of the surgeon is essential for training and improving patient health outcomes. Recent studies on learning-based frameworks in the literature use physiological sensor data to develop a universal model that is applied to all subjects based on standardized data. Other methods based on transfer learning require a calibration dataset of the target domain before the MWL classification algorithm can be applied, which shows promising performance and more accura...

        A multi-task engineering design intention recognition approach based on Vision Transformer and EEG data

        Mingrui Li, Zuoxu Wang, Fan Li & Jihong Liu

        Engineering product design involves a variety of tasks and scenarios, including design modeling, design calculation, process planning, etc. When performing these design tasks, designers generate constantly shifting design intentions. Accurately recognizing these design intentions allows for a more thorough exploration of design processes from the perspective of cognition, facilitating the advancement of intelligent engineering design. Electroencephalogram (EEG) technology has emerged as an effective tool in recent years, which can provide direct insight ...

        Beyond the trained eye: An objective method to predict game sense in team sports

        Daniel Fortin-Guichard, Kathryn Johnston, Thomas Romeas, Magdalena Wojtowicz, Jean Lemoyne, David L. Mann, Simon Grondin & Joseph Baker

        Talent identification in sports requires a prediction of how athletes will perform in the future based on a sample of their behaviors. Perceptual cognitive-skills or ‘game sense’ in sports jargon is important for performance, yet sport organizations lack objective and validated measures to predict it. This study aimed to establish the degree to which subjective evaluations of athletes’ in-match perceptual-cognitive skills could be predicted by their performance on objective perceptual-cognitive tests. The perceptual-cognitive skills of 40 highly-trained ...

        Vigilance decrement in automated vs. manual driving: Insights from multimodal data

        Chuanggao Lin, Fangda Zhang, Yong Zhang & Tingru Zhang

        Driver vigilance is a crucial factor in road safety. Vigilance decrement can pose a significant challenge under Level 2 driving automation, where drivers are relieved of active vehicle control but must still continuously monitor the system. This study aims to evaluate the dynamic changes in vigilance during prolonged automated driving using multimodal data. A simulated driving experiment was conducted in which participants drove in either manual or automated mode while responding to randomly presented traffic sign targets. Subjective vigilance ratings, t...

        Quantify difference between physicians and medical students in clinical reasoning: evidence from eye-tracking

        Lijun Sun, Yao Zhang & Bin Zheng

        Background The assessment of clinical reasoning in health trainees is vital yet poses challenges. We tracked the eye movements of participants while they were reviewing a neurological case with the goal of finding behavioral evidence to improve health education. Methods Eleven medical students and seventeen expert physicians were required to read a neurological case within a 150-second timeframe. The case included descriptive text, a brain CT scan, and an electrocardiogram (ECG). Participants completed a multiple-choice questions (MCQs) test after readi...

        A Comparative Study on the Effects of Viewing Real and Virtual Reality Classical Chinese Gardens

        Yanning Cai, Minkai Sun, Yudie Lu, Yuqin Wang, Jian Zhang & Seiko Goto

        Purpose: This study evaluates the relaxation effects of viewing a Chinese classical garden and a Chinese-style public park in reality and virtual reality (VR) environments by focusing on their psychological and physiological impacts. Background: The experiment examined two landscapes: the culturally rich and elaborately designed Humble Administrator's Garden and the Hefeng Pavilion. Methods: Twenty-eight participants participated in four sessions, each consisting of a 5-minute viewing session of the Humble Administrator's Garden ...

        Gaze Behavior of Experts and Novices in Aikido’s Choku Tsuki

        Estefan Gemas Neto, Thiago Augusto Costa de Oliveria, Sérgio Tosi Rodrigues, Alexandre Moreira & Umberto Cesar Corrêa

        We investigated where and how expert and novice aikido practitioners fixate their gaze to achieve success in choku tsuki performance. Participants were 20 right-handed aikido male practitioners (black belts = 10; white belts = 8; yellow belts = 2), with an average age of 33.5 years ( SD = 7.4). Participants performed a choku tsuki, aiming to hit with a stick (jo) the center of a target on the chest of a virtual opponent attacking them with a wooden sword (bokken). Dependent variables included performance success (absolute fr...

        Leading with a Light Touch: Improving Train Driver Attention by Monitoring Requests with Directional Information and Positive Emotion

        Tiecheng Ding, Jinyi Zhi, Rui Zou, Xiao Zhao, Zhenyu Wang, Ruizhen Li, Dongyu Yu & Sijun He

        Train drivers must balance sustained attention and attention shifts for safe monitoring, but environmental complexity and limited attention make this challenging. This study designed three auditory Monitoring Requests (MR) to aid attention shifts: abstract MR (a beeping sound), warning MR (containing directional information with traditional alertness-related emotions), and consultation MR (directional information with positive emotions). Thirty-two drivers completed a simulated driving experiment comparing baseline and MR conditions in attention performa...

        Evaluation of cognitive load and user experience in alternative interaction modes under different noise degrees

        Xiaojiao Xie, Yao Wang, Yan Cui, Suihuai Yu, Dengkai Chen & Jianjie Chu

        In the context of multimodal interaction, user-centered research on alternative interaction modes is crucial for their application in real-world scenarios. In intelligent cockpits of specialized vehicles and aircraft, broadband continuous noise is a common challenge. This study aims to investigate the cognitive load and user experience associated with alternative interaction modes when performing tasks under varying levels of broadband continuous noise. 24 participants completed a point-and-select task with four interaction modes: Touch-Based Interaction...

        The Effect of Acute Physical Fatigue on Gaze Behavior During Tennis Players’ Service Return

        Jie Deng, Hong Wang, Lei Zhang, Tingting Fu, Demin Liu, Chong Xu & Yu Zhu

        Acute physical fatigue is an inevitable factor for athletes during tennis competitions. While previous studies have explored the relationship between gaze behavior and tennis performance, the impact of fatigue on gaze behavior during service return has not been thoroughly investigated. This study recruited 24 male tennis players with an average training history of 11 years. We recorded their gaze behavior in real-world settings using a eye-tracking device. All participants completed a service return task prior to the fatigue protocol, followed by the imp...

        Effects of pedestrians’ visual search effectiveness and behavioral characteristics on the wayfinding performance at underground rail interchange stations: A field test study

        Jinshuan Peng, Chaoyu Ren, Liuting Lan, Xiongbo Cui, Linjun Zhang & Mengqing Wu

        This study explored the impact of wayfinding signs and individual differences on wayfinding performance in interchange spaces, particularly within underground rail interchange stations. Previous research has primarily focused on either the visual effects of signs or wayfinding outcomes, with limited consideration of their interactions. Therefore, this study used Ranjiaba station, Chongqing Rail Transit, as a case study, classifying wayfinding tasks into four categories. On-site wayfinding eye-tracking experiments analyzed and discussed sign perception ch...

        Recognizing situation awareness of drillers based on eyetracking and EEG features

        Su Hao, Zeng Yuxi, Qing Xin, Fan Siping, Wang Jian & Xu Lifei

        Situational awareness (SA) is crucial for the safety of oil and gas drilling operations. The lack of it can result in increased human error rates. To address this issue, this study designed a drilling monitoring simulation experiment and proposed a situational awareness recognition model based on eye-tracking and electroencephalogram (EEG) features. The results showed that the fixation type, visit type, and pupil type eye-tracking metrics in specific Areas of Interest differed significantly among levels of situation awareness; the electroencephalogram me...

        Adaptive Geographic Scene Expression Driven by User Needs: A Case Study of the Twin Highway Tunnel Scene

        Jun Zhu, Na Li, Jinbin Zhang, Yuting Rao, Chao Pang, Ranran Tang & Hongyue Zhao

        Virtual geographic scenes, as a key component of virtual geographic environments (VGEs), play an essential role in conveying complex geographic information. However, the existing geographic visualization methods have problems such as separation from user needs and poor multi‐terminal adaptation, resulting in low user cognitive efficiency. To address these limitations, an adaptive geographic scene representation framework grounded in user requirements is proposed. A systematic mapping relationship between user requirements and scene representations was fi...

        Airway Management in the Offshore Rescue Helicopter: Evaluation of Tracheal Intubation in Alternative Positions

        Tobias Warnecke, Nina Schnackenberg, Jochen Hinkelbein, Andreas Klausen & Lydia Johnson Kolaparambil Varghese

        Objective This study focuses on airway management in offshore rescue helicopters, where patients often require initial and prolonged medical care during long flights. Here, the patient's atypical, sideway position in the helicopter cabin prevents intubation in the standard way. The aim of this study is therefore to investigate optimal strategies for airway management from the side. The results can also be transferred to other emergency situations with atypical patient position and confined spaces. Methods In a randomized trial, 440 intubations were perfo...

        How can appropriate hue ranges be selected for sequential color schemes on choropleth maps? A quantitative evaluation using map-reading experiments

        Taisheng Chen, Xi Lv, Kun Hu, Menglin Chen, Lu Cheng & Weixing Jiang

        We propose map-reading experiments to quantitatively evaluate the selection of hue ranges for sequential color schemes on choropleth maps. In these experiments, 42 sequential color schemes with six base hues and seven hue ranges were employed as experimental color schemes, and a total of 414 college students were invited to complete identification, comparison, and ranking tasks. Experiments using both maps with synthetic data and real data were performed, each involving a web-based survey and an eye-tracking experiment. In the experiments using maps with...

        Descubra publicaciones innovadoras en Factores humanos
        Ver todas las publicaciones

        Mejore su investigación sobre Factores Humanos

        Aproveche los conocimientos del eye tracking para mejorar la seguridad y la eficacia en diversos campos, desde la conducción hasta la gestión del patrimonio cultural.