home

Eye tracking Insights en Factores Humanos: Resumen de la investigación del cuarto trimestre de 2025

La tecnología Eye tracking sigue aportando información valiosísima en el campo de los Factores Humanos. En el cuarto trimestre de 2025, fue decisiva en estudios que van desde la mejora de la detección del punto de mira del cirujano en intervenciones quirúrgicas hasta la mejora de la percepción de los riesgos potenciales por parte de los conductores. La tecnología también facilitó la comprensión de la carga cognitiva en tareas de construcción y el diseño de señales de advertencia eficaces en laboratorios.

Visual ERP-based brain–computer interface use with severe physical, speech and eye movement impairments: case studies

Arne Van Den Kerchove, Juliette Meunier, Marie de Moura, Alixe Willemssens, Dorien Geeurickx, Edward Schiettecatte, Philip Van Damme, Hakim Si-Mohammed, François Cabestaing, Etienne Allart & Marc M. Van HulleJournal of NeuroEngineering and Rehabilitation

BackgroundIndividuals who experience severe speech and physical impairment face significant challenges in communication and daily interaction. Visual brain–computer interfaces (BCIs) offer a potential assistive solution, but their usability is limited when facing restrictions in eye motor control, gaze redirection and fixation. This study investigates the feasibility of a gaze-independent visual oddball BCI for use as an augmentative and alternative communication (AAC) device in the presence of limited eye motor control.MethodsSeven participants with var...

  • Tobii Pro 1750 / 2150
  • Open Source Presentation

Automatic and Real‐Time Surgeon's Gazing Point Detection From Surgical Videos Using Machine Learning and Mathematical Algorithm

Shu Sasaki, Kenji Karako, Kyoji Ito, Yuichiro Mihara, Maho Takayama, Ryo Oikawa, Takeshi Takamoto, Nobuhisa Akamatsu, Yoshikuni Kawaguchi & Kiyoshi HasegawaJournal of Hepato Biliary Pancreatic Sciences

BACKGROUND: Application of artificial intelligence (Artificial Intelligence) in intraoperative imaging has been expanding rapidly. The surgeon's gazing point indicates the exact site of surgical procedures and concentrates critical information for Artificial Intelligence applications. This study aimed to develop a machine learning-based system to automatically detect the surgeon's gazing point from surgical video data. METHODS: Surgical instruments were detected using a deep-learning model applied to images extracted from pancreaticoduodenectomy videos. ...

More Warmth and Less Competence? Navigating the Positive Outcomes of Kindchenschema Cuteness in Artificial Intelligence Agents’ Service Failure

International Journal of Human–Computer Interaction

With Artificial Intelligence agents increasingly deployed, their failures demand strategies to sustain user forgiveness. While post-failure remedies are well-studied, there is still limited literature on how kindchenschema cuteness facilitate user forgiveness to ensure an opportunity for system improvement and user maintenance. Grounded in evolutionary psychology, this study examines how kindchenschema cuteness affects forgiveness toward failing Artificial Intelligence agents. Using multi-method approach (behavioral experiments, eye-tracking, ECG), we re...

Decoding Time Perception in Virtual Reality: How Extreme Brightness and Eye Movements Shape Temporal Experience

Jiseob Park & Cheul RheeInternational Journal of Human–Computer Interaction

Extreme brightness in virtual reality (VR) can stretch or compress time perception, yet its physiological driver remains unclear. Twenty-six adults watched a one-minute video in three luminance modes (night, dark, fullbright) via a head-mounted display (HMD) or PC monitor. A mixed-effects model revealed that Pupil Research dilation significantly lengthened perceived duration (+1.71 s/mm, p

Automaticity Diagnosis in Construction: A Longitudinal Study Using Attentional Measures

Oluwaseun Olabode, Ikechukwu Sylvester Onuchukwu, Behzad Esmaeili & Sébastien HélieComputing in Civil Engineering 2024

Automaticity is an essential skill that develops as a task is repeatedly executed. While prior studies have shown that automaticity and attention are closely related, they are limited since most have used cross-sectional experiments and compared different individuals (novice versus expert). To address this gap, the specific objective of this study is to compare changes in attention allocation between workers’ non-automatic and automatic states while conducting a repetitive construction task. To achieve this objective, a simulated roof shingle installatio...

Statistical Modeling of Psychophysiological and Personality Factors to Predict Construction Workers’ Near-Miss Recognition Performance

Shashank Muley, Sueed Willoughby & Chao WangComputing in Civil Engineering 2024

Due to the industry’s high-risk nature, construction workers often encounter hazardous conditions. Past studies have shown that recognizing near-miss incidents is crucial for minimizing injuries, yet predicting workers’ near-miss recognition performance remains a research gap. Therefore, this study aims to develop models using psychological factors (Big 5 personality traits), physiological measures (heart rate and electrodermal activity), and eye-tracking metrics (time to first fixation and fixation duration) to predict near-miss recognition. A total of ...

The maximum text length threshold in in-vehicle information system

Jingli Qu, Tianxing Wang, Yilin Zhong, Fengjie Ai, Chunfen Wu, Jie Liu, Jingjing Gao, Zifei Li & Lanming LiuTheoretical Issues in Ergonomics Science

Visual distraction caused by in-vehicle information system (IVIS) poses a serious threat to driving safety. This study aims to determine the maximum safe text length thresholds for short and long Chinese texts displayed on central control display, based on the Visual-Manual NHTSA Driver Distraction Guidelines. A high-fidelity driving Simulator setup system and eye tracker were used to record participants’ glance behaviour while completing short- and long-text reading tasks under driving conditions. For short texts, statistical analysis indicated that a m...

Multi-user Gaze Tracking via Dynamic Image Mapping in 360 Immersive 3D Visualization Systems

Lingyan Ruan, Bin Chen, Chi-Hang Chow, Hiu-Lok Chung, Pok-Yin Victor Leung & Miu-Ling LamProceedings of the SIGGRAPH Asia 2025 Technical Communications

Immersive panoramic 3D visualization systems enhance presence, enabling rich educational, cultural, and collaborative experiences. While gaze offers significant potential as a natural, hands-free interaction modality in such environments, existing solutions often depend on fixed camera setups, fiducial markers, or controller-based navigation, which limit user mobility, reduce gaze estimation accuracy, and introduce visual or physical distractions. We present a real-time, multi-user gaze-driven interaction system for panoramic 3D visualization. The system...

Objective Assessment of Visibility of Colorectal Lesions Using Eye Tracking for New Image‐Enhanced Endoscopy Observation

Aiji Hattori, Hiroaki Ikematsu, Hiroki Yamashita, Takuma Oguro, Mitsuhiro Goto, Takeaki Yamazaki, Maasa Sasabe, Nobuhisa Minakata, Takashi Watanabe, Tomohiro Mitsui, Atsushi Inaba, Hironori Sunakawa, Keiichiro Nakajo, Tatsuro Murano, Tomohiro Kadota, Kensuke Shinmura, Hayato Nakagawa & Tomonori YanoJournal of Gastroenterology and Hepatology

BACKGROUND AND Artificial IntelligenceM: This study aimed to objectively evaluate colorectal lesion visibility using white-light imaging (WLI), narrow-band imaging (NBI), and texture and color enhancement imaging (TXI) with an eye tracking system. METHODS: Twelve endoscopists assessed 120 images of 30 colorectal lesions (29 adenomas, one sessile serrated lesion) captured using WLI, NBI, TXI mode-1, and TXI mode-2. Eye movements were recorded to analyze the lesion detection ability and time taken. The miss rate (calculated as the ratio of missed lesions f...

LLaMAC: low-cost biosignal sensor based large multimodal dataset for affective computing

Chang-Gyu Lee & Joo Young KimScientific Data

The LLaMAC dataset was developed to predict the success of audio-visual media via emotion prediction. It was created using low-cost biosignal sensors, with emotional questionnaires in both continuous (valence, arousal, dominance) and discrete domains (emotion type and intensity: neutral, fun, sadness, anger, fear), and included over 100 participants. Questionnaires on liking and familiarity were also collected. The dataset contains five biosignals—EEG, GSR, PPG, SKT, and RESP—and seven questionnaire measures. Biosignals were validated using statistical m...

Effect of eye-tracking-based depth perception visualization interface on virtual reality user experience

Haram Choi & Sanghun NamVirtual Reality

In virtual reality (VR), users underestimate distances between themselves and objects relative to reality. Such issues can negatively impact users’ spatial perception and interactions in VR environments by affecting elements of the VR user experience, such as presence. Therefore, enhancement of depth perception should be studied to improve the VR user experience. In this study, an eye-tracking-based depth perception visualization interface system is proposed to enhance depth perception and improve presence in VR. The visualization interface system consis...

  • Tobii VR

Performance Evaluation of Real-Time Object Detection for Electric Scooters

Dong Chen, Arman Hosseini, Arik Smith, Amir Farzin Nikkhah, Arsalan Heydarian, Omid Shoghli & Bradford CampbellComputing in Civil Engineering 2024

Electric scooters (e-scooters) have rapidly emerged as a popular mode of transportation in urban areas, yet they pose significant safety challenges. In the United States, the rise of e-scooters has been marked by a concerning increase in related injuries and fatalities. Recently, while deep-learning object detection holds paramount significance in autonomous vehicles to avoid potential collisions, its application in the context of e-scooters remains relatively unexplored. This paper addresses this gap by assessing the effectiveness and efficiency of cutt...

Study of impacts of the large-screen and multi-screen trends of HMI in intelligent cabins on drivers' cognitive load

Wang Yuxiao & Zhang YanxiangComputers & Graphics

Human-machine Interface (HMI) serves as the core medium within the vehicle. Its trend towards large-screen and multi-screen design is a significant manifestation of today’s intelligent cabins. However, this trend also brings risks of distracting drivers' attention and affecting driving safety. Therefore, this study used virtual reality (VR) technology to provide a simulated driving environment for participants, and explored the impact of HMI-related attributes in the intelligent cabin, namely "central control screen size," "central control screen orienta...

Relationships between gaze behaviour and fencing performance of high-skilled fencing athletes: Perspectives from defensive and offensive phases

Andrada Vincze, Andra Felicia Gabriela Iacob, Ioana Radu, Dragoş Iliescu & Răzvan JurchişCortex

This study explores the relationship between visual processing and fencing performance, focusing on various gaze behaviour indices in a dynamic and interactive sport. Visual processing, particularly the ability to gather and use visual information quickly and accurately, is critical for performance in high-speed sports. We hypothesised that visual behaviour, including the duration of the final fixation (Quiet Eye; QE), the number of fixations and the number of scanned locations, significantly impacts fencing performance during offensive and defensive act...

From unrecognized to incapacitating: Neuro-ergonomic differentiation of spatial disorientation typologies induced by visual illusions for pilot cognitive training and cockpit design

YUAN Xin, K.H. NG Kam, LI Qinbiao, Cho Yin YIU, ZHOU Qinyu & BU YuanyuanChinese Journal of Aeronautics

Spatial Disorientation (SD) causes 15-22% of general aviation fatalities, rising to 72% with conflicting visual references. Current detection methods fail to distinguish the three SD types: Type 1 (unrecognized), Type 2 (recognized), and Type 3 (incapacitating), nor the effects of visual illusions. This study presents a neuro-ergonomic framework combining 32-channel Electroencephalogram (EEG) and eye-tracking to identify subtype-specific signatures during visual illusions. Sixteen cadet pilots completed simulated flights under adverse weather and inconsi...

A smart community interactive art therapy platform based on multimodal computer graphics and resilient artificial intelligence for home-based elderly care

DianDian Sang, Ling Miao & Qitao WuScientific Reports

This research presents an innovative smart community interactive art therapy platform that integrates multimodal computer graphics with resilient artificial intelligence adaptation mechanisms to address the growing challenges of home-based elderly care. The platform employs a four-layered hierarchical architecture encompassing perception, network, platform, and application layers to deliver personalized therapeutic interventions. The system utilizes multimodal data fusion algorithms to process visual, auditory, and haptic inputs while implementing adapti...

  • SDK

Mimicking human attention in driving scenarios for enhanced Visual Question Answering: Insights from eye-tracking and the human attention filter

Kaavya Rekanar, Martin J. Hayes & Ciarán EisingIntelligent Systems with Applications

Visual Question Answering (VQA) models serve a critical role in interpreting visual data and responding to textual queries, particularly within the domain of autonomous driving. These models enhance situational awareness and enable naturalistic interaction between passengers and vehicle systems. However, existing VQA architectures often underperform in driving contexts due to their generic design and lack of alignment with domain-specific perceptual cues. This study introduces a targeted enhancement strategy based on the integration of human visual atten...

Measurement of pilots’ fatigue, attention and using EEG, ECG and EYE tracking in the simulated environment

Victoria RUSU & Gavrila CALEFARIUINCAS Bulletin

The concept of the Human Performance Envelope (HPE) brought the idea of interdependence between multiple ergonomic factors together with their influence on pilots’ performance. After the analysis of the aviation incidents, Eurocontrol experts had selected nine ergonomic factors (stress, fatigue, mental workload, situation awareness – (SA), attention, , communication, teamwork and trust) which affect the pilots’ performance. In the previous article [1], was proposed a hybrid model (mathematical - heuristic), which is suitable for the study of HPE, because...

Visionary Co-Driver: Enhancing Driver Perception of Potential Risks With LLM and HUD

Wei Xiang, Ziyue Lei, Jie Wang, Yingying Huang, Qi Zheng, Tianyi Zhang, An Zhao & Lingyun SunIEEE Transactions on Intelligent Transportation Systems

Drivers’ perception of risky situations has always been a challenge in driving. Existing risk-detection methods excel at identifying collisions but face challenges in assessing the behavior of road users in non-collision situations. This paper introduces Visionary Co-Driver, a system that leverages large language models (LLMs) to identify non-collision roadside risks and alert drivers based on their eye movements. Specifically, the system combines video processing algorithms and LLMs to identify potentially risky road users. These risks are dynamically i...

Pika: Designing a social-support agent to improve drivers’ experience in gig work

Wei Xiang, Xinli Chen, Tianhui Guo, Min Zhou & Shi ChenInternational Journal of Human-Computer Studies

Drivers in gig work face a steady stream of demanding tasks, with the interaction between agents and workers playing a significant role in drivers’ performance. However, there has been limited exploration into challenges and opportunities in these interactions. This paper imports social support in conversational agents to improve human-agent interaction within driving gigs. We began by conducting semi-structured interviews with 20 driving workers to uncover interaction challenges and strategies they employ. Building upon these insights, we designed Pika,...

Adaptive Token Boundaries: Towards Integrating Human Chunking Mechanisms into Multimodal LLMs

Dongxing YuInformation

Recent advancements in multimodal large language models (MLLMs) have demonstrated remarkable capabilities in processing diverse data types, yet significant disparities persist between human cognitive processes and computational approaches to multimodal information integration. This research presents a systematic investigation into the parallels between human cross-modal chunking mechanisms and token representation methodologies in MLLMs. Through empirical studies comparing human performance patterns with model behaviors across visual–linguistic tasks, we...

Privacy Preservation and Identity Tracing Prevention in Artificial Intelligence-Driven Eye Tracking for Interactive Learning Environments

Abdul Rehman, Are Daehlen, Ilona Heldal & Jerry Chun-Wei LinIEEE Access

Eye-tracking technology provides an estimate of where a person is looking and is essential for understanding individual attention and the psychological functions within the cognitive system. It can aid in understanding neurodevelopmental disorders and tracing a person’s identity. However, this technology poses a significant privacy risk, as it captures sensitive information about individuals and increases the likelihood that their data can be traced back to them. This paper proposes a human-centered two-phased framework to prevent identity backtracking w...

Beyond Words: The Impact of Eye-Gaze Sharing on Collaboration and Cognitive Load

Suvodip Chakraborty, Peter Kiefer & Martin RaubalInternational Journal of Human-Computer Interaction

Distributed cognition systems rely on collaboration among decision-makers to address complex problems that are challenging for a single individual. The success of collaborative decision-making hinges on effective communication, enabling stakeholders to develop a shared understanding of both the scenario and the decision-making process. However, traditional decision support systems still predominantly rely on verbal communication, which tends to lose efficacy as cognitive load increases. This study aims to leverage gaze-sharing to enhance collaboration un...

Eye-tracking metrics for estimating workload and characterizing errors in conflict detection and resolution during simulated en route air-traffic control

José A. Navia, Jorge Ibáñez-Gijón, David Travieso, Aitor Montes & Patricia López de FrutosFrontiers in Psychology

Growing traffic density and airspace complexity demand adaptive decision-support tools that anticipate when controllers are approaching overload or conflicts are mishandled. Ocular behavior offers a single, unobtrusive stream that simultaneously reflects global mental workload (MWL) and moment-to-moment attentional allocation. The present study examined whether eye-tracking metrics can estimate MWL and expose the mechanisms underlying errors in conflict detection and resolution during simulated en route control. Twenty-four novice participants worked six...

Visual communication design in laboratory safety effectiveness and optimization of warning signs

Yueyue Weng & Qiugang RenScientific Reports

This study proposes a comprehensive framework for evaluating and optimizing laboratory warning sign systems, grounded in the principles of visual communication design, cognitive psychology, and safety management. A mixed-methods experimental design involving 120 participants was employed, integrating eye-tracking analysis, comprehension and memory assessments, and behavioral response evaluations. The results identified key factors contributing to the effectiveness of warning signs, including color contrast ratio, symbol standardization, and information h...

Architectural Visual Design – Eye Tracking Analysis of Church Interiors Created Using Artificial Intelligence

Faculty of Civil Engineering and Architecture Department of Contemporary Architecture, Wojciech KOCKI, Mariusz DZIEŃKOWSKI & Faculty of Electrical Engineering and Computer Science Department of Computer ScienceInternational Journal of Conservation Science

The integration of artificial intelligence in scientific research offers novel opportunities and directions for exploration. In this context, an experiment was conducted to examine the application of eye-tracking technology and the indirect insights obtained through OpenArtificial Intelligence. This study extends previous research on the design of altars in Catholic churches and their interior architecture. The interior of a church plays a crucial role in fostering the concentration and prayerful engagement of the faithful. Findings from the initial phas...

Aviation fatigue detection based on cardiorespiratory coupling: A study under normoxic and mild hypoxic conditions

Jingda Feng, Congchong Li, Donghui Piao, Yan Zhang, Lihua Yu, Weiru Shi, Mengya Fang, Wenjing Gong & Xiaopeng LiuResults in Engineering

With rising long-duration flights, pilot fatigue increasingly threatens flight safety and efficiency. While the electrocardiogram (ECG) provides a stable and portable solution for aviation fatigue monitoring, reliable biomarkers beyond heart rate variability (HRV) remain scarce. This study investigates the dynamic changes of cardiorespiratory coupling (CRC) during fatigue progression and evaluates its potential for fatigue detection, including its performance under mild hypoxic conditions. We recruited eight healthy male participants (age: 20.6 ± 1.8 yea...

Machine learning models to predict desktop activity recognition based on low-point gaze features

Hazem Al-Najjar, Nadia Al-Rousan, Hamzeh F. Assous & Dania AL-NajjarArray

Eye-tracking desktop activity prediction analyzes how users behave and think through their eye movements for the purpose of behavior prediction during computer use. The study examines how low-point gaze features functioning alongside machine learning (ML) models enable predictions of eight frequent desktop activities which are Debug, Browse, Play, Read, Interpret, Search, Watch and Write. The research uses simple gaze metrics obtained from 24 users through the Tobii X2-30 eye tracker for fixation count analysis along with Saccade Research direction and g...

Visual perception and user experience Optimization: Exploring interaction design through static-triggered smooth pursuit systems

Ya-Feng Niu, Yun Feng, Xin Li, Wei-Chi Huang, Yi-Yan Wang & Lin-Han FanDisplays

This study investigates optimization strategies for smooth pursuit eye movements in eye-controlled interactive systems, aiming to enhance task efficiency and user experience. To address challenges such as visual clutter and cognitive load, a novel static-triggered smooth pursuit design is proposed. In this approach, interactive elements remain static until gaze contact initiates movement, after which they accelerate uniformly to a predefined maximum speed. The study employs an experimental methodology to evaluate the effects of three key parameters—accel...

  • SDK

Training Surgeons’ Visual Scanning Pattern in Laparoscopic Surgery to Enhance Patient Safety

Bin Zheng, Yixiong Zheng, Yao Zhang & Yuan Yuan YaoJournal of Surgical Education

OBJECTIVE: This study aimed to develop a novel approach for teaching visual scanning in surgery by integrating eye-tracking technology into a laparoscopic simulation environment.DESIGN: A prospective controlled study was conducted in a surgical simulation setting.PARTICIPANTS: Fifteen novice participants with no prior laparoscopic experience were recruited.SETTING: Participants performed simulated laparoscopic cholecystectomy across six training sessions. The control group received conventional technical training, while the experimental group also viewed...

Linking UI Design to Training Effectiveness, Efficiency, and Satisfaction in Central Venous Catheterization Simulation

Ava Knaf, Sanaz Motamedi, Jason Z. Moore, Sanjib Adhikary & Scarlett R. MillerHuman Factors in Healthcare

Objective The purpose of this study is to understand what updates to the user interface (UI) of our medical training Simulator setup, the DHRT+, led to an increase in usability as defined by its three pillars—effectiveness, efficiency, and satisfaction. Background Medical error is a leading cause of death in the United States. Central venous catheterization (CVC) is a large contributor to this issue with its 15% complication rate, which is primarily linked to the experience of the physician. Current training methods for CVC are limited by inadequate prac...

Beyond distraction: unraveling touchscreen effects on driver takeover performance and visual attention dynamics in Level 3 automated driving

Jiateng Li & Jun MaAccident Analysis & Prevention

Rapid advances in automated driving technology and the widespread adoption of in-vehicle information systems (IVIS) have led to an increasing prevalence of drivers engaging in non-driving-related tasks (NDRTs) during autonomous operation, thereby introducing potential safety hazards. In this study, we conducted a driving Simulator setup experiment with 30 participants to examine the effects of IVIS NDRTs (i.e., navigation, video, audio, and reading tasks) and takeover time budgets on takeover timing, takeover quality, and visual behavior. Results from li...

Fatigue estimation of OOWs based on eye-tracking technology: A hybrid experimental study

Wenjun Zhang, Yunkai Luo, Xue Yang, Yaqing Shu, Changyi Du & Jingzeng ZhangOcean Engineering

Seafarer fatigue caused by prolonged and monotonous work is a key contributing factor in maritime accidents. This study designs an experiment using eye-tracking technology aimed at developing an objective fatigue estimation method for Officer on Watch (OOW). Sixteen nautical students from different majors participated in Simulator setup experiments, during which data from subjective fatigue assessments, eye movement indicators, reaction time, and stress levels were recorded. The results indicate that participants experienced increasing fatigue over time,...

Vision Control of a Vehicle Intended for Tourist Routes Designed for People with Special Needs

Marcin Staniek & Ireneusz CelińskiApplied Sciences

Off-road vehicles, including those intended for mountain tourism, are also designed for people with special needs. These designs primarily concern the design of the drive of the vehicle, which can be manual, foot-powered, electric or a combination of these. Unusual forms of controlling these vehicles are also used, which use various parts of the body for this purpose, including the torso. In addition to using specific parts of the body to control the vehicle, an alternative is to use vision for this purpose, such as through eye tracking and similar techn...

Visual motion perception and driving hazard visibility at night-time

Catherine Kennon, Joanne M. Wood, Philippe F. Lacherez, Alex A. Black, Damian Cuda, Emily Henry & Allison M. McKendrickScientific Reports

Motion perception is an important visual process involved in driving, and has been associated with daytime driving performance, however, few studies have investigated the association of motion perception with night driving. This study examined the relationship between motion perception and performance on a computer-based off-road Night-time Hazard Visibility Test (NHVT) in 70 licensed drivers (M = 53.4 ± 23.9 years; 18–84 years), with and without eye disease. Motion perception was tested binocularly on four motion tasks: minimum displacement thresholds (...

  • Tobii Pro Studio

How AR-Enhanced Cultural Heritage Landscapes Influence Perception in Rural Tourism Spaces: Evidence from Eye Tracking and HRV

Wenzhuo Fan, Chen Li, Songhua Gao, Nisha Ai & Nan LiSustainability

Against the backdrop of globalization, environmental pressures, and rapid tourism development, digital technologies are emerging as vital supplementary tools for cultural heritage preservation. This study investigates the impact of augmented reality (AR)-enhanced cultural heritage landscapes on rural tourists’ perceptions, validating their effects through two physiological dimensions: visual attention and autonomic nervous system regulation. Employing a mixed experimental design (n = 81), the research integrates heart rate variability, eye tracking, and ...

Do We Need Opaque Walls?: Exploring Collaboration Space Design Using Transparency Attributes on the Room Walls in Virtual Reality

Tianze Xie, Yuxin Ma, Joongi Shin, Pengcheng An & Seungwoo JeInternational Journal of Human–Computer Interaction

Effective collaboration depends on the design of collaborative spaces. In particular, prior work has shown that the design of physical room walls impacts people’s attention and stress during collaboration. However, despite the growing adoption of VR for collaboration, room walls have been rarely studied as an important design factor. As the first step, this paper investigates how wall transparency affects the collaborative experience in VR. We compared three levels of transparency (nontransparent, semi-transparent, and no-wall) in terms of their impact o...

  • Tobii VR

Visibility and Usability of Protective Motorcycle Clothing from the Perspective of Car Drivers

Gihyun Lee, Taehoon Kim, Jungmin Yun, Dae Young Lim, Seungju Lim, Woosung Lee, Seongjin Jang, Jongseok Lee & Hongbum KimApplied Sciences

Aiming to improve nighttime safety for motorcycle riders, this study evaluates the visibility and usability of LED and retroreflective-equipped protective motorcycle clothing versus conventional retroreflective gear. Ten male participants with driving experience were selected based on specific criteria, including normal or corrected visual acuity. Utilizing a simulated driving environment with a 75-inch screen and electric bicycles, the study employed an eye tracker to define recognition distances. It was found that LED and retroreflective-equipped cloth...

A Novel Overlapping Coefficient-Based Framework for Integrating Multimodal Physiological Signals to Infer Cognitive Strategies and Operator Performance in Human–System Interfaces

Asher Ahmed Malik, Azizul Buang, Chidera Winifred Amazu, Salman Nazir, Risza Rusli, Ammar N. Abbas, Maria Chiara Leva, Umer Asgher & Micaela DimichelaInternational Journal of Human–Computer Interaction

In digitalized plants, control room operators experience cognitive overload, and literature emphasizes that multimodal physiological integration can better capture operators’ cognitive states. In chemical process operations, current methods often overlook cross-modal interactions. This study used a formaldehyde production simulation with 42 participants exposed to failure scenarios, assessing performance by recovery time and plant status. A novel framework for multimodal physiological integration is proposed, modeling high/low levels of eye-based, skin-r...

PipID: Light-Pupil Researchlary Response Based User Authentication for Virtual Reality

Muchen Pan, Yan Meng, Yuxia Zhan, Guoxing Chen & Haojin ZhuProceedings of the 2025 ACM SIGSAC Conference on Computer and Communications Security

During the use of Virtual Reality (VR) applications such as gaming, education, and military training, sensitive information may be generated or collected by VR sensors, raising user concerns about potential data leakage. This highlights the critical need for effective user authentication to prevent unauthorized access. Existing authentication methods for VR are often either cumbersome (e.g., entering passwords via handheld controllers), reliant on specialized hardware (e.g., iris recognition), or vulnerable to credential replay attacks. In this study, we...

  • Tobii VR
  • SDK

A Study of the Effect of Different Amplitudes and Colors on Recognition Efficiency in HUDs

Kaipeng Xue, Junqing Guo, Yan Liu & Fanghao SongInternational Journal of Human–Computer Interaction

Vibration affects the efficiency of information recognition during driving, yet the impact of varying amplitudes and colors in Head-Up Displays (HUDs) on recognition efficiency remains unknown. Based on this, this study uses helmet-mounted HUDs as an example to explore the impact of different amplitudes and colors on recognition efficiency. Three distinct cycling environments with varying amplitudes were created. Six colors were selected for displaying key information on the HUD. Participants' reaction times and Pupil Research diameters during the experi...

  • Tobii VR
  • ErgoLab

Inspector gaze‐guided multitask learning for explainable structural damage assessment

Chenyu Zhang, Charlotte Liu, Ke Li, Zhaozheng Yin & Ruwen QinComputer Aided Civil and Infrastructure Engineering

Abstract Accurately classifying damage levels from structural inspection images is critical for automated infrastructure assessment. Although deep neural networks achieve impressive performance, their black‐box nature limits explainability, and prior studies using Grad‐CAM often yield coarse or inaccurate saliency maps. To overcome these limitations, this paper introduces XIDLE‐Net, a multitask model that simultaneously performs damage classification and saliency map prediction to enhance explainability in structural damage assessment. Combining a Swin T...

Design mechanisms of airport visual guidance systems on passenger wayfinding performance: evidence from causal machine learning and a moderated mediation approach

Liyun Wang & Xiaochan WangJournal of Asian Architecture and Building Engineering

In airports, effective visual guidance systems are essential for supporting passenger wayfinding under cognitive load and time constraints. However, mexisting signage designs lack user-centered optimization, leading to inefficient navigation and decision errors. This study investigates how signage information density and coding format influence passenger cognitive load and decision confidence, with time pressure as a moderator. A two-phase approach was adopted: (1) causal machine learning identified key design factors from real-world airport signage; (2)...

GazeMatch: Drawing on the Benefits of Motion Matching Gaze Interfaces without Extensive Refactoring of Existing Public Display UIs

Diogo Lopes & Augusto EstevesProceedings of the ACM on Human Computer Interaction

Touch controls on public displays, while ubiquitous, introduce public health and accessibility concerns. Alternative controls based on gaze or mid-air interaction techniques usually require a calibration process that hinders spontaneous interaction. Calibration-free gaze alternatives tend to rely on user interfaces (UIs) with moving elements, which require substantial changes to existing UIs, can hinder touch input, and contribute to an overwhelming and confusing user experience -- ultimately limiting adoption. This paper introduces GazeMatch, a novel in...

    Composition and Contrast: The Painterly Nature of Architectural Exterior Illumination

    Rafał Krupiński, Marta Rusnak, Wojciech Żagan, Bartosz Kuczyński, Zofia Koszewicz, Marta Szmigiel & Malwina GeniuszArts

    CIE recommendations for architectural exterior illumination provide general guidelines for highlighting building forms, with emphasis on edges, curvature, and spatial layering. However, they do not explicitly address luminance contrast disposition—specifically, whether elements further from the viewer should appear brighter or if those closer should be more intensely lit. Inspiration for addressing this problem can be drawn from the principles of Renaissance and Baroque paintings, where techniques of working with light evolved from dramatic contrasts to ...

    Spatiotemporal characteristics of eye-hand coordination among different skill levels in laparoscopic surgery

    Farzad Aghazadeh, Bin Zheng, Mahdi Tavakoli & Hossein RouhaniSurgical Endoscopy

    IntroductionEfficient eye-hand coordination is fundamental to surgical proficiency, particularly in minimally invasive surgeries. A comprehensive analysis of eye-hand coordination across varying surgical skill levels is essential for evaluating surgical task proficiency and establishing a basis for objective surgical skill assessment and training.MethodsEighteen participants, including five experts (attending general surgeons), five intermediates (surgical residents), and eight novices without prior surgical experience, were recruited in this study. Metr...

    VReflect: Evaluating the Impact of Perspectives, Mirrors and Avatars in Virtual Reality Movement Training

    Dennis Dietz, Fabian Berger, Changkun Ou, Francesco Chiossi, Giancarlo Graeber, Andreas Martin Butz & Matthias HoppeProceedings of the 2025 31st ACM Symposium on Virtual Reality Software and Technology

    Virtual reality training systems require the careful design of content presentation, user embodiment, and overall user experience. We explore the impact of different perspectives (first-person and third-person) and virtual self-visualization techniques (VSVTs: mirrors and external avatars) on user embodiment, performance and experience. In a study with 28 participants learning karate movements, we tested four combinations of these factors. Results indicate that perspective influences visual focus and embodiment, while VSVTs affect movement execution, par...

    • Tobii VR
    • SDK

    Enhancing Immersive Virtual Reality Experiences with Multiple Tasks Prediction Using Pre-Trained Large Foundation Models

    Ripan Kumar Kundu, Istiak Ahmed & Khaza Anuarul HoqueProceedings of the 2025 31st ACM Symposium on Virtual Reality Software and Technology

    Immersive virtual reality (VR) environments pose significant cognitive and physical challenges as users engage in multitasking scenarios involving attention management and working memory, often leading to increased cognitive load, sensory conflicts, and cybersickness, diminishing users’ performance and immersion. While traditional machine learning (ML) and deep learning (DL) methods have been employed to predict individual factors such as cybersickness or attention, they often fail to capture the interconnected and dynamic nature of these cognitive and p...

    • Tobii VR

    Research on the Visual Search Time of Metro Driving Human-Machine Interface Based on Cognitive Load Equilibrium in GoA 2 Mode

    Yuming Ma & Hao YaoInternational Journal of Human–Computer Interaction

    The autonomous driving mode in metros has been widely adopted to reduce drivers’ workload. However, the dense and dynamic display of operational information on the human-machine interface poses significant challenges for drivers under multitasking conditions, particularly in quickly perceiving abnormal information within a limited time. This study focuses on a specific type of metro human-machine interface under Grade of Automation 2 (GoA2). First, drivers’ real human-machine interaction experiences were collected through interviews. Then, information en...

    Effects of Multimodal AR-HUD Navigation Prompt Mode and Timing on Driving Behavior

    Qi Zhu, Ziqi Liu, Youlan Li & Jung EuitayJournal of Eye Movement Research

    Current research on multimodal AR-HUD navigation systems primarily focuses on the presentation forms of auditory and visual information, yet the effects of synchrony between auditory and visual prompts as well as prompt timing on driving behavior and attention mechanisms remain insufficiently explored. This study employed a 2 (prompt mode: synchronous vs. asynchronous) × 3 (prompt timing: -2000 m, -1000 m, -500 m) within-subject experimental design to assess the impact of multimodal prompt synchrony and prompt distance on drivers' reaction time, sustaine...

    The impact of daylight on cognitive performance: A study using HRV and pupillometry

    Shuja Rehman, Prabhjot Singh Chani, Rajasekar Elangovan & Saptarshi KolayJournal of Physics Conference Series

    In contemporary workspaces, artificial lighting often prevails, despite strong evidence supporting daylight’s cognitive and physiological benefits. This study examines how different daylight–artificial light combinations affect physiological responses, subjective comfort, and cognitive performance. Twenty-two healthy adults (11 female, 11 male) participated in a controlled experiment under four lighting conditions, ranging from full daylight to full artificial light, while maintaining constant horizontal illuminance (450 lux). Sessions included cognitive...

    Explainable by Design: Enhancing Trustworthiness in Artificial Intelligence-Driven Control Systems

    Wassim Jaziri & Najla SassiMathematics

    Deep Reinforcement Learning (DRL) has achieved remarkable success in optimizing complex control tasks; however, its opaque decision-making process limits accountability and erodes user trust in safety-critical domains such as autonomous driving and clinical decision support. To address this transparency gap, this study proposes a hybrid DRL framework that embeds explainability directly into the learning process rather than relying on post hoc interpretation. The model integrates symbolic reasoning, multi-head self-attention, and Layer-wise Relevance Prop...

    Rearward Seating Orientation Decreases Trust and Increases Motion Sickness in Autonomous Vehicles

    Leonhard Rottmann, Alina Waldmann, Aniella Johannsen & Mark VollrathApplied Sciences

    As the development of autonomous vehicles (AVs) progresses, new seating arrangements are emerging. Face-to-face seating is common in SAE L4 AV concepts and is intended to facilitate social interaction during autonomous driving, enabling previously unfeasible non-driving related tasks (NDRTs). However, this is countered by the unpopularity of rearward seating orientations, which is particularly pronounced in cars. In order to develop countermeasures to address this unpopularity, a deeper understanding of the underlying mechanisms is required. This study v...

    Evaluating the impact of mental workload on drillers’ risk perception using wearable eye-tracking technology

    Su Hao, Jiang Jiaxin, Fan Siping, Wang Jian, Xie Ruiying, Xu Lifei, Wang Xiaoqin, Qing Xin & Song YuqiBehaviour and Information Technology

    Drilling accidents can lead to substantial financial losses, reputational damage, and even pose serious threats to human life. Existing research indicates that most drilling incidents are related to human factors, but the influence of mental workload on drillers’ risk perception in well control remains underexplored. To address this gap, the present study employed a Sustained Attention to Response Task (SART) paradigm and eye-tracking technology to investigate the effects of cognitive load. A total of 48 drilling workers participated in simulated monitor...

    MARTHA - Combining gaze into deep learning for fully quantitative human testicular histology analysis

    Jacqueline Kockwelp, Sabine Kliesch, Jörg Gromoll, Joachim Wistuba & Benjamin RisseComputers in Biology and Medicine

    Despite advances in computational pathology, manual tissue examinations remain the gold standard in diagnostics, resulting in thousands of whole slide image inspections in daily practice. Unfortunately, examination strategies and identified regions are often lost after inspection, preventing the use of manual efforts to train deep learning algorithms. To address this, we introduce MARTHA, a tool that combines passive eye tracking - which captures pathologists' gaze during tissue examinations - with deep learning-based image analysis. This approach simpli...

    Design and Evaluation of a Multimodal Elevator System with Gaze and Multilingual Voice Controls

    Ramanand & Yogesh Kumar MeenaProceedings of the 16th International Conference of Human-Computer Interaction (HCI) Design & Research

    Inclusivity and accessibility for everyone are essential steps toward smart urban infrastructure. Traditional elevator controls that depend on touch have limitations, including hygiene risks and accessibility issues. To address the limitations posed by traditional touch control systems and to enhance inclusivity and accessibility, we introduced a multimodal approach in this work by combining touch, multilingual voice (Hindi, Gujarati, English), and eye tracking modality. To demonstrate the working and the advantages of the proposed multimodal approach fo...

    Analysis of Driver Takeover Performance in Autonomous Vehicles Based on Generalized Estimating Equations

    Min Duan, Lian Xie, Jianrong Cai, Junru Yang & Haoran LiMachines

    Current autonomous vehicles require human drivers to take over control during emergencies or in environments the system cannot handle. During other periods, drivers are permitted to engage in non-driving-related tasks. It is essential to investigate how the immersion in non-driving-related tasks affects drivers’ takeover performance under different scenarios. To address this, a mixed-design simulated driving experiment was conducted with 40 participants, incorporating three non-driving-related tasks (no task, watch video, play game), three takeover reque...

    Lighting effects on visual and cognitive adaptation in multimedia classrooms: a multimodal neurophysiological study

    Mengrui Wang, Ning Guo, Yutao Liu, Yitao Fu & Xiang ZhouBuilding and Environment

    Classroom lighting influences both visual comfort and cognitive performance, yet its neurophysiological mechanisms remain underexplored in real-world educational environments. This study systematically compared typical daylight and artificial lighting to examine their effects on visual load, attentional regulation, and cortical activation during screen-based learning tasks. Experiments were conducted with forty-one university students in LED-equipped multimedia classrooms. Participants completed two cognitive tasks—2-back (numerical working memory) and S...

    Optimizing in-vehicle warning sounds: core feature insights with machine learning models

    Jiawen Chen, Xuesong Wang, Mengjiao Wu, Xin Yi, Xiaowei Tang & Andrew MorrisTransportation Research Part F Traffic Psychology and Behaviour

    Optimizing user-centered alerting systems is essential as automotive technology continues to evolve. However, previous studies have not fully clarified how individual driver characteristics affect the perception and response to warning signals. Consequently, this study employed Random Forest Regression and SHAP analysis to identify significant features and their contribution to predictions. Results showed that lane position, fixation times, and subjective urgency score were strong predictors of brake reaction time. In contrast, subjective pleasantness, d...

    Emotion-Aware Driving Warning for Safety and Experience Optimization: Adaptive Risk Field Thresholds and Evaluation of a Three-Level Strategy

    Zhifeng Yang, Bin Zhou, Bangjie Wu, Wei Peng & Yuanfa DongInternational Journal of Human-Computer Interaction

    Existing collision warning strategies primarily rely on vehicle kinematic indicators, often overlooking the critical influence of driver emotional heterogeneity on risk-handling capabilities. This study addresses this gap by investigating decision-making differences among drivers in various emotional states when responding to hazardous events. Building upon these findings, we propose an emotionally adaptive (EA) hierarchical audio-visual warning strategy. A driving Simulator setup experiment compared three conditions: no warning intervention, a conventio...

    Do drivers understand cyclists’ communication cues?

    Christine M Petersen & Patricia R DeLuciaAccident Analysis & Prevention

    In the last decade, cyclist fatalities in traffic collisions have increased. Therefore, the current study aimed to identify which cues drivers use to make quick and accurate judgments of cyclists' intent and whether cell phone use affects prediction accuracy. Sixty drivers viewed video clips of a cyclist performing combinations of different cues (position on the road, head movement, arm signals) and reported the cyclist's intended action (turn left, turn right, stop, or go straight) as indicated by arm signals defined by U.S. transportation laws. Half of...

    SET-DGCN: An end-to-end electroencephalography-based fatigue detection method for young drivers

    Yang Cao, Tiantian Chen, Ke Han, Hyungchul Chung, Zhaoguo Huang & Hongliang DingAccident Analysis & Prevention

    Driver fatigue poses a critical threat to global road safety, particularly among young drivers. Nevertheless, policy-level interventions remain fragmented due to the lack of reliable and deployable detection technologies. Bridging this gap requires accurate, interpretable, and real-time fatigue monitoring systems capable of informing practical decision-making in transportation safety management. To address this challenge, we propose an end-to-end EEG-based fatigue detection model, Scale-Enhanced Transformer and Dynamic Graph Convolutional Network (SET-DG...

    Differences in drivers’ dependence on AR warning information in urban driving environments: the role of driving experience

    Faren Huo & Rubanka AllaFrontiers in Virtual Reality

    Augmented Reality Head-Up Displays (AR HUDs) have been shown to enhance drivers’ performance and road safety. However, with the growing attention to trust in automated driving systems, excessive reliance on automation may lead to complacency and dependency. This study therefore aimed to examine how drivers with different levels of experience depend on AR warning messages under varying environmental conditions (daytime vs. nighttime urban driving) and to propose strategies for optimizing AR warning interaction design. A before-and-after comparative experi...

    The impact of usage experience and input modality on trust experience and cognitive load in older adults

    Hui Huang & Guanhua HouFrontiers in Computer Science

    Trust experience plays a pivotal role in human–computer interaction, particularly for older adults, where it serves as a critical psychological threshold for technology adoption and sustained usage. Against the backdrop of increasingly diverse intelligent interaction modalities, trust directly influences older adults’ initial acceptance and long-term reliance on technological systems. This study focuses on the interactive effects of users’ experience and input modality on trust experience and cognitive load in the elderly. Employing a 2 (prior experience...

    From Black Box to Transparency: The Impact of Multi-Level Visualization on User Trust in Autonomous Driving

    Mengniu Li, Ming Zhou, Yajun Li, Wentao Wei, Tianlu Zhu, Xun Xu, Linyan Ren, Nuowen Zhang, Renhan Xu & Jinye LiSensors

    Autonomous systems' "black-box" nature impedes user trust and adoption. To investigate explainable visualizations' impact on trust and cognitive states, we conducted a within-subjects study with 29 participants performing high-fidelity driving tasks across three transparency conditions: black-box, standard, and enhanced visualization. Multimodal data analysis revealed that enhanced visualization significantly increased perceived usefulness by 28.5% (p

    Multimodal Intention Recognition for Dynamic Tool Sharing in Anthropocentric Human-Robot Collaborative Applications

    Davide Ciaghi, Matteo Manzardo, Gilbert Soto, Renato Vidoni & Luca GualtieriLecture Notes in Mechanical EngineeringFlexible Automation and Intelligent Manufacturing: The Future of Automation and Manufacturing: Intelligence, Agility, and Sustainability

    In the context of Industry 5.0, designing anthropocentric human-robot collaborative applications is essential. Moreover, the ability to share production resources, such as tools, in a safe, ergonomic, and efficient manner is a prerequisite for implementing seamless human-robot collaboration. This work aims to develop a tracking system capable of combining the motion and gaze of an operator to infer his/her intentions during a collaborative task involving a shared tool within a manufacturing context. Wearable inertial sensors, combined with a kinematic mo...

    Influence of Surgical Expertise on Visual Gaze Patterns While Viewing a Robotic Adrenalectomy

    Taylor Quinn, Joseph C. L’Huillier, John M. Woodward, Cara Jones, Steven D. Schwaitzberg & Lora CavuotoJournal of Surgical Education

    OBJECTIVE: This study aimed to quantify and further understand differences in visual perception between surgical expertise and specific procedural events while watching a robotic adrenalectomy.DESIGN: For this cross-sectional observational study, participants viewed a video of a robotic right adrenalectomy and were asked to identify the case afterward. Participants viewed the video under identical conditions without contextual information to minimize perceptual bias. Surgeons were categorized into early career and senior groups based on years of experien...

    Effects of automation stage on alerted-monitor performance and operator perception with and without concurrent task demands

    Jianhua Sun, Suihuai Yu, Jianjie Chu, Xiaojiao Xie, Wenzhe Cun & Hao FanInternational Journal of Industrial Ergonomics

    Alerted-monitor systems may not be perfectly reliable and are apt to generate false alarms, risking automation misuse. The possibility and severity of automation misuse can be affected by the automation stage of the alerted-monitor task and the presence of concurrent task demands, especially when there is more than one unpredictable false alarm throughout the entire task. Therefore, this study investigated the effects of the automation stage on alerted-monitor performance and operator perception with/without concurrent task demands, aiming to select the ...

    Prediction of driver alertness levels on mountain roads using machine learning models: A naturalistic driving study in China

    Tong Liu, Deji Xie, Tangzhi Liu, Jue Shan & Caiqing TangTraffic Injury Prevention

    OBJECTIVE: A method for evaluating driver alertness on mountain roads was developed to enhance dynamic safety monitoring in high-risk sections. An indicator system integrating human and environmental factors was established, with 13 variables used for alertness classification and 17 initial variables applied for quantification.METHODS: Field tests were conducted in Guizhou, China, where data on drivers' heart rates, eye movements, and demographics were collected. Kernel principal component analysis (KPCA) was employed to extract four representative facto...

    What affects pedestrian street crossing decisions in day and night scenarios? A case study in Charlottesville, Virginia

    Afrida Raida, Arman Hosseini, Carreen de Cárdenas, Andrew Mondschein, Arsalan Heydarian & T. Donna ChenTransportation Research Part F Traffic Psychology and Behaviour

    Pedestrian crashes and fatalities are increasing, particularly in urban areas and at nighttime. Although previous studies have examined pedestrian crossing behavior, most have not considered pedestrians’ safety perceptions and behavioral variables that may affect crossing decisions at different times of the day. This paper uses a combination of perceived safety, gaze variability, and sociodemographic data to analyze how crossing decisions differ in day and night scenarios. 63 participants walked along an urban street in Charlottesville, Virginia in the U...

    Impact of Artificial Intelligence recommendation styles on carbon management technicians' trust: Dual process of cognitive effort and emotion

    Tao Zhang, Ming Jia & Pengdong XueInternational Journal of Industrial Ergonomics

    Artificial intelligence (Artificial Intelligence), as an advanced technological innovation, possesses considerable promise for improving energy efficiency and reducing emissions in industrial environments. Although Artificial Intelligence plays a crucial role in industrial decarbonization, research reveals that mArtificial Intelligence-dependent carbon reduction prospects remain untapped. This study examines the innovative correlation between the presentation styles of industrial Artificial Intelligence recommendations and the trust that carbon managemen...

    Enhancement of ADAS with Driver-Specific Gaze Profiling Algorithm—Pilot Case Study

    Marián Gogola & Ján OndrušVehicles

    This study investigates drivers’ visual attention strategies during naturalistic urban driving using mobile eye-tracking (Pupil Research Labs Neon). A sample of experienced drivers participated in a realistic traffic scenario to examine fixation behaviour under varying traffic conditions. Non-parametric analyses revealed substantial variability in fixation behaviour attributable to driver identity (H(9) = 286.06, p = 2.35 × 10−56), stimulus relevance (H(7) = 182.64, p = 5.40 × 10−36), and traffic density (H(4) = 76.49, p = 9.64 × 10−16). Vehicles and ped...

    Detection of cognitive and attention dimensions in block programming interface for learning sensor data analytics in construction education

    Mohammad Khalid, Abiola Akanmu, Ibukun Awolusi & Homero MurziInternational Journal of Human-Computer Studies

    The increasing adoption of sensing technologies in the construction industry generates vast amounts of raw data, requiring analytics skills for effective extraction, analysis, and communication of actionable insights. To address this, ActionSens, a block-based programming interface, was developed to equip undergraduate construction engineering students with domain-specific sensor data analytics skills. However, efficient user interaction with such tools requires integrating intelligent systems capable of detecting users’ attention and cognitive states to...

    Do you need help? Identifying and responding to pilots’ troubleshooting through eye-tracking and Large Language Model

    Mengtao Lyu & Fan LiInternational Journal of Human-Computer Studies

    In-time automation support is crucial for enhancing pilots’ performance and flight safety. While extensive research has been conducted on providing automation support to mitigate risks associated with the Out-of-the-Loop (OOTL) phenomenon, limited attention has been given to supporting pilots who are actively engaged, known as In-the-Loop (ITL) status. Despite their active engagement, ITL pilots face challenges in managing multiple tasks simultaneously without additional support. For instance, providing critical information through in-time automation sup...

    A multimodal dataset for human robot collaborative systems: Experimental data

    Shakra Mehak, Aayush Jain, John D. Kelleher, Michael Guilfoyle, Philip Long & Maria Chiara LevaData in Brief

    Human-Robot Interaction (HRI) systems are becoming increasingly integral to collaborative industrial and service environments. However, understanding human performance within such settings, particularly in Programming by Demonstration (PbD) frameworks, remains a challenge due to limited availability of comprehensive datasets. This study presents a multimodal dataset designed to assess human performance in HRI applications. The dataset includes both objective and subjective measures collected using various tools within a PbD framework. The data is collect...

    Usability evaluation of connected thermostat modalities

    Simin Kianpour Rad, Philip Agee, Abiola Akanmu, Josh Iorio & Lu ZhangEnergy and Buildings

    Connected Thermostats have gained significant attention in both design and research, with the aim of enhancing User Experience in the interconnected ecosystem of smart homes. Despite the abundance of research on CTs and the increasing integration of new control options, a substantial gap remains in the literature, particularly in the context of a multi-modal approach to CT interfaces. This study leverages usability study methodsconducted in a lab setting to compare the walk-up usability of traditional and novel modalities of the ecobee3 Lite Smart Thermo...

    The Effects of Task Factors on the Multi-Directional Tapping Task

    Yuhwa Hong, Haejun Kim, Jihae Yu, Heedo Shin, Xiaoqun Yu, Shuping Xiong & Woojoo KimInternational Journal of Human–Computer Interaction

    In Fitts’ law research for pointing and selecting tasks, the multi-directional tapping task from ISO/TS 9241-411 has been widely used as a standard task. However, the ISO standard does not describe several task factors in sufficient detail, leading researchers to interpret and apply them independently in various ways. This study aims to investigate the effects of four task factors for multi-directional tapping task: error highlight, hover highlight, target shape, and number of targets. The experimental results indicated that all investigated task factors...

    An Eye-Tracking Analysis of Rider Behavior and Handling Strategy in Motorcycle Racing

    Michael Bohm & Jan FojtasekSMTS 2025

    This study focuses on the use of eye-tracking technology to analyse the rider’s visual attention during racing on a Ducati Panigale V2 motorcycle. Using the TOBII Pro Glasses 2 system, the rider’s gaze dynamics were recorded, including fixations, eye movements (saccades) and gaze distribution on key sections of the track. The results revealed a link between gaze stability and cornering efficiency, particularly in optimising braking points and selecting the ideal trajectory. Identifying unstable visual behavior—such as frequent gaze deviations or constant...

    Eye-Tracking Indicators of Novice Programmers’ Proficiency: A Machine Learning Approach

    Zubair Ahsan & Unaizah ObaidellahACM Transactions on Computing Education

    This study investigates the efficacy of machine learning algorithms in classifying different levels of programming expertise among 60 first-year undergraduate computer science students from Asian demographic backgrounds using eye-tracking data. Existing studies offer limited detail on the construction and selection of feature sets for machine learning modeling. The study identifies Total Fixation Duration (TFD) and Total Visit Duration (TVD) as robust indicators for machine learning models when distinguishing between high and low performers (two levels) ...

    A Comprehensive Model for Visual Fatigue Assessment in 3D Light Field Displays Based on Eye Movement Data Analysis

    Yu Chen, Binbin Yan, Shuo Chen & Xinzhu SangProceedings of the 33rd ACM International Conference on Multimedia

    Three-dimensional (3D) light field displays (LFDs) provide immersive visual experiences and have attracted increasing attention. However, visual fatigue remains an important concern when users watch 3D LFDs which limits their development and application. In this paper, we propose a comprehensive methodology that integrates subjective and objective data to establish a robust dataset and employs eye movement data for systematically investigating visual fatigue in 3D LFDs. Firstly, a multimodal dataset is constructed by integrating subjective fatigue scores...

    Enhancing driver performance under cognitive load: the role of tactile and combined auditory-tactile warnings in simulated underground mining transport vehicle environments

    Xueyi Li, Yangcheng Wang & Yonghong LiuErgonomics

    In coal mining environments, underground transport vehicles are essential for transportation operations, yet high accident rates persist due to environmental and human factors. This study investigated the effects of auditory, tactile, and combined auditory-tactile warnings on driver driving and cognitive performance in a simulated underground transport vehicle cabin. 24 participants (12 novice, 12 experienced) completed baseline driving, stimulus-response tasks and interference tasks while their driving behaviour, physiological indicators and subjective ...

    Visual marker-based augmented reality for intraoperative ultrasound in minimally invasive surgery

    Takeshi Takamoto, Yusuke Kazami, Yujiro Nishioka, Akihiko Ichida, Nobuhisa Akamatsu, Yoshikuni Kawaguchi & Kiyoshi HasegawaSurgical Endoscopy

    BackgroundIntraoperative ultrasonography (IOUS) is essential in minimally invasive hepatobiliary–pancreatic surgery but requires surgeons to alternate attention between laparoscopic and ultrasound monitors, disrupting workflow. We developed Flag AR, an augmented reality system that superimposes real-time ultrasound images onto laparoscopic displays using visual marker tracking.MethodsThis prospective observational study included 14 patients undergoing minimally invasive hepatobiliary–pancreatic procedures between March and April 2025. Three experienced s...

    Validating a Wearable VR Headset for Postural Sway: Comparison with Force Plate COP Across Standardized Sensorimotor Tests

    David Saucier, Kaitlyn McDonald, Michael Mydlo, Rachel Barber, Emily Wall, Hunter Derby, Jennifer C. Reneker, Harish Chander, Reuben F. Burch & James L. WeinsteinAlzheimer's & Dementia

    This study seeks to determine the efficacy of a novel, virtual reality (VR)-based sensorimotor assessment tool, VIST Neuro-ID, in comparison to the gold standard. This was achieved through computing common postural sway metrics, as well as comparing these metrics across population groups including sex and age (50–60 vs. 61–75). Sensorimotor assessments were conducted within the VIST Neuro-ID VR software while participants stood on a force plate. A proxy for center-of-pressure measurement was developed using the six-degree-of-freedom data collected from t...

    • Tobii VR
    • SDK

    Research on the Significance of the Fatigue Identification Index for Passenger Seafarers Based on Subjective and Objective Data

    Qing Liu, Jun-Song Liao, Yue Ma & Lu-Yao LiCICTP 2025

    The hard living conditions and the requirement of long-time on-duty systems on board make sailors more prone to fatigue than other occupational groups. To seek reliable and efficient fatigue indicators for monitoring fatigue among seafarers, subjective and objective data of 24 seafarers were collected under authentic working conditions, which included physiological, psychological, and environmental factors. Through correlation analysis and factor analysis, a fatigue state indicator identification system for ship drivers has been established, including 3 ...

    The Visual Experience Research on Industrial Heritage Activation Using SBE-SD and Eye-Tracking Technology

    Na Lu & Zhuohang WuLecture Notes in Electrical Engineering Man Machine Environment System Engineering

    This study aims to explore the relationship between design elements in industrial heritage revitalization and their visual appeal by analyzing users' visual attention and subjective evaluation of contemporary design techniques in the context of heritage. A mixed analysis framework combining quantitative and qualitative methods SBE-SD approach and eye-tracking was employed to investigate modern design languages in the industrial heritage context. Based on the results from questionnaires, rating scales, and eye-tracking experiments, this study identifies t...

    Investigating Design Effects on Cognitive Load and Gaze Behavior in a VR Lab Course Environment

    Raphael Cera, Nina Peltzer, Chiara Boolzen, Salome Flegr, Christoph Hoyer, Stefan Küchemann, Constanze Richters, Matthias Stadler, Martin Fischer & Jochen Kuhn

    Gaze data is a well-established indicator of cognitive load levels during Human-Machine Interaction. The design characteristics of virtual learning environments can be a source of extraneous cognitive load, which can, in turn, strongly impact the gaze behavior of learners. The cognitive load experienced by learners can be classified into three components: intrinsic, extraneous and germane. This study aims to systematically investigate the relations between the design of virtual reality environments, gaze data, and cognitive load. Therefore, a randomized ...

    • Tobii VR

    Saying is Believing: Exploring the Importance of Artificial Intelligence ‐Generated Content Disclosure and User Trust

    Rui Wang, Boyuan Jia & Pu YanProceedings of the Association for Information Science and Technology

    As Artificial Intelligence‐generated content (Artificial IntelligenceGC) becomes increasingly prevalent across digital platforms, understanding its impact on users' trust and attitudes toward this new technology is crucial. Using an experimental design, we examined how the presence or absence of disclosing the use of Artificial Intelligence in content generation influences user engagement with Artificial Intelligence‐generated images and videos on social media platforms. Our experiment recruited 64 individuals (N control group =31, N experiment group =33...

    Research on Graded Lane Changing in Undersea Tunnel Exit Diversion Zones: Application of Set Pair Analysis and TOPSIS Method for Evaluation

    Xuanming Guo, Fuquan Pan, Xiaojun Fan, Shuai Shao, Lixia Zhang & Siliang LuanJournal of Advanced Transportation

    Owing to undersea‐tunnel constraints concentrating off‐ramp maneuvers in confined zones, this study optimizes graded lane‐changing strategies to mitigate collision risks. Using the Jiaozhou‐Bay Undersea Tunnel case, we propose an innovative exit diversion area graded lane‐changing strategy comprising Transition Section I, Transition Section II, gradient section, and auxiliary lane. Six schemes were simulated via UC‐WinRoad, with driver physiological stress quantified through Tobii eye‐tracking as a novel application of Pupil Research dynamics. Four indic...

    Use of Eye Tracking as a Method for Health Information Seeking Behavior Research

    Sue Yeon Syn & Laura Lannan

    This paper analyzes 25 health information behavior studies published in the period of 15 years (2009‐2023) using eye‐tracking as the research methodology. Eye‐tracking technology has become a valuable tool to study information behavior. This study examines the ways of adopting eye trackers in health information behavior research and how the research is designed with an extended method the technology provides. This paper contributes to understanding methodological trends for health information behavior research.

    ET2GIS & ET2QGIS tools: integrating ET2Spatial outputs into GIS for eye movement analysis of web maps

    Tomáš Vaníček, Jan Šenkeřík & Stanislav PopelkaEarth Science Informatics

    We present ET2GIS and ET2QGIS, two toolkits that integrate georeferenced eye-tracking (ET) data into mainstream GIS (ArcGIS Pro and QGIS). Built on ET2Spatial, which converts screen-space gaze into geographic coordinates, the toolkits enable GIS-native analysis and visualisation of FIX/RAW layers. ET2GIS (ArcGIS Pro toolbox) provides 3D visualisation, clustering, heat-map and kernel-density surfaces, scanpaths, and space–time cube exploration, supporting spatio-temporal analyses of gaze behaviour. ET2QGIS (open-source QGIS plugin) offers a streamlined wo...

    Error detection in reading in English: A\xa0validation study of a reading task administered\xa0with the help of an eye-tracker

    Tikhon Gostiukhin

    This paper presents a validation study of using eye tracking during a reading task with the aim to investigate reading processes in L2 and to detect errors in reading. I attempted to measure features of reading in L2 in terms of reading time, duration of fixations, and the total number of fixations with the help of the eye tracker. The paper starts with a theoretical overview of eye tracking and error detection in reading, indicating its growing popularity within linguistic circles. The participants of the study were 20 international university students ...

    Visualizing Spatial Cognition for Wayfinding Design: Examining Gaze Behaviors Using Mobile Eye Tracking in Counseling Service Settings

    Jain Kwon, Alea Schmidt, Chenyi Luo, Eunwoo Jun & Karina MartinezInteracting with Computers

    Wayfinding with minimal effort is essential for reducing cognitive load and emotional stress in unfamiliar environments. This exploratory quasi-experimental study investigated wayfinding challenges in a university building housing three spatially dispersed counseling centers and three academic departments that share the building entrances, lobby, and hallways. Using mobile eye tracking with concurrent think-aloud protocols and schematic mapping, we examined visual attention patterns during predefined navigation tasks performed by 24 first-time visitors. ...

    A Workflow for Urban Heritage Digitization: From UAV Photogrammetry to Immersive VR Interaction with Multi-Layer Evaluation

    Chengyun Zhang, Guiye Lin, Yuyang Peng & Yingwen Yu

    Urban heritage documentation often separates 3D data acquisition from immersive interaction, limiting both accuracy and user impact. This study develops and validates an end-to-end workflow that integrates UAV photogrammetry with terrestrial LiDAR and deploys the fused model in a VR environment. Applied to Piazza Vittorio Emanuele II in Rovigo, Italy, the approach achieves centimetre-level registration, completes roofs and upper façades that ground scanning alone cannot capture, and produces stable, high-fidelity assets suitable for real-time interaction...

    Bicycle performance monitoring on a two-way protected cycle lane related to different separation elements

    Leonardo Cameli, Riccardo Ceriani, Valeria Vignali, Margherita Pazzini & Claudio LantieriDiscover Applied Sciences

    Although the use of bicycles is increasingly promoted and widespread across Europe, cyclist fatalities have remained stable since 2010, likely due to insufficient safe of the infrastructure. The study investigates bicycle performances and cyclist’s safety in urban context to assess which factors influence the perception of the users. Employing an instrumented bike with advanced sensors and eye-tracking device, the effects of environmental and infrastructural factors were assessed. Conducted in Florence, Italy, the research collected data from 20 particip...

    Measuring Team Adaptation Through an Analysis of Physiological Synchrony

    Jayci T. Landfair, Matthew A. Peel, Craig J. Johnson, Polemnia G. Amazeen & Nancy J. Cooke

    Dynamic, high-stakes environments demand continual adaptation from teams operating within them. A key expression of adaptability is the regulation of cognitive demands, known as team mental workload (TMWL). Effective adaptation involves managing individual workload and redistribution across members to sustain coordinated performance. Traditional approaches often aggregate individual metrics, overlooking teamwork’s emergent nature. Physiological synchrony (PS), the alignment of responses like Pupil Research dilation between teammates, offers a dynamic alt...

    Naturalistic Prosocial Behavior in Mobility Contexts: Behavioral and Physiological Insights

    Elise Dennis, Zhaobo Zheng, Meng Wang, Kumar Akash & Teruhisa Misu

    Advances in transportation safety and efficiency enables road users to eventually care about travel experiences and satisfactions. Prosocial behavior is an important factor affecting wellbeing in mobility. To better understand what leads to prosocial behaviors, and how people experience such actions, we conduct a detailed analysis of behaviors across various levels of prosociality. This paper utilizes a naturalistic dataset for prosocial behaviors, with multimodal signals. We analyze road user behaviors and physiological responses in relation to the effo...

    Enhancing multimodal interaction in resource-constrained environments: a case study on smart TV control

    Fadia Nouna Bousba, Nadia Elouali & Sidi Mohammed BenslimaneJournal on Multimodal User Interfaces

    Multimodal interaction improves user experience by allowing users to select the most suitable way to interact with devices based on their needs and preferences. Its adoption has grown in IoT environments, particularly in resource-rich settings equipped with connected devices and intermediate tools for interaction detection. However, in resource-constrained environments, such as those in developing countries, interactions often rely on conventional methods because of the absence of intermediate devices, which are typically expensive, requiring a lengthy l...

      MERD-360VR: A Multimodal Emotional Response Dataset from 360° VR Videos Across Different Age Groups

      Qiang Chen, Shikun Zhou, Yuming Fang, Dan Luo & Tingsong LuProceedings of the 27th International Conference on Multimodal Interaction

      Virtual Reality (VR) technologies provide interactive experiences capable of evoking a wide spectrum of emotional responses from users. However, there is a notable scarcity of VR-based multimodal emotional response datasets designed to enhance the accuracy of emotionally immersive film and television productions. To address this gap, we conducted a study to develop a comprehensive, multimodal, annotated dataset capturing users’ affective, physiological, and behavioral responses to 360° panoramic videos in immersive VR environment. Our dataset specificall...

      • Tobii VR

      Using biometric data to improve our understanding and support of business process model comprehension

      John Krogstie & Kshitij SharmaSoftware and Systems Modeling

      Much research has been done on the comprehension and development of visual business process models. In related areas such as linguistics and software engineering, researchers have used techniques from neuroscience to study the physiological and neurological processes when working with text in tasks such as program code debugging and natural language understanding. Such techniques have only to a limited degree been used to improve our understanding of visual conceptual models. In this paper, we will present ongoing research on using techniques for collect...

      Simulated Insight, Real-World Impact: Enhancing Driving Safety with CARLA-Simulated Personalized Lessons and Eye-Tracking Risk Coaching

      Wenbin Gan, Minh-son Dao & Koji ZettsuProceedings of the 27th International Conference on Multimodal Interaction

      We present DriveWise, a personalized driver coaching system that integrates naturalistic performance assessment, CARLA-simulated lesson generation, and eye-tracking-based risk perception feedback. Driving skills are evaluated through unscripted simulation, where collisions and near-misses are detected to quantify risk. Based on these incidents, tailored interactive lessons are generated to address individual weaknesses. Eye-tracking data further identifies gaps in visual attention, enabling cognitive-level coaching. DriveWise offers a scalable approach t...

      On the effect of using an augmented reality laser projection operator guidance system on cognitive workload and assembly task performance

      Praneet Sahoo & Francesco N. BiondiInternational Journal of Human–Computer Interaction

      Augmented Reality offers clear benefits in the workplace: overlaying digital information directly over the real-world has the potential to make tasks easier and increase performance. While augmented reality has found wider adoption in fields like aviation and transportation, its benefits in manufacturing remain all but unexplored. To fill this gap, this study compares the use of an augmented reality laser projection system during a virtual reality-based manufacturing assembly task against more traditional means of operator guidance: video and pictorial. ...

      • Tobii VR

      Understanding Freehand Cursorless Pointing Variability and Its Impact on Selection Performance

      James Whiffing, Tobias Langlotz, Christof Lutteroth, Adwait Sharma & Christopher ClarkeACM Transactions on Computer Human Interaction

      Freehand pointing is a fundamental gesture commonly used for cursorless interactions. Prior work in HMI often elicits the same pointing behaviour – facing the target with an outstretched dominant arm and index finger. However, freehand pointing outside of HMI shows more variability across hand pose, usage, and coordination with gaze. To understand what variability exists and how it affects pointing performance, we collected data (N=23) using a hybrid motion capture system. To elicit a wide variety of pointing behaviours we included different levels of us...

      The Effect of Visual Attention Dispersion on Cognitive Response Time

      Yejin Lee & Kwangtae JungLecture Notes in Computer Science Social Robotics AI

      In safety-critical systems like nuclear power plants, the rapid and accurate perception of visual interface information is vital. This study investigates the relationship between visual attention dispersion measured via heatmap entropy (as a specific measure of gaze entropy) and response time during information search tasks. Sixteen participants viewed a prototype of an accident response support system and answered questions at three difficulty levels while their eye movements were tracked using Tobii Pro Glasses 2. Results showed a significant positive ...

      Examining cognitive load in human-machine collaborative translation: insights from eye-tracking experiments of Chinese-English translation

      Lei ChenFrontiers in Psychology

      Introduction: With the development of artificial intelligence and computer science, human-computer collaborative translation (HMCT) mode has gradually become a research hotspot in the field of English translation. The purpose of this study was to explore the cognitive load characteristics of translators in the process of human-computer collaborative translation through eye tracking experiments of Chinese-English translation. Based on a 2 × 2 hybrid design, the participants' eye movements were analyzed under the conditions of simple, medium and complex te...

      Studying human modality preferences in a human-drone framework for secondary task selection

      Suprakas Saren, Rubini Mariyappan, Prithwish Dey, Debasish Ghose & Pradipta BiswasJournal on Multimodal User Interfaces

      Existing research works on Unmanned Aerial Vehicles (UAVs) equipped with aerial manipulators usually rely on controllers, which often necessitate the use of both hands, unless the drone operates autonomously. In challenging scenarios such as inspecting high-voltage power lines or repairing wind turbine blades, operators must control the drone with precise manual input while simultaneously managing aerial manipulation tasks at the site. However, achieving precise control near the task site is quite demanding, and adding aerial tasks further complicates ex...

      Watch Out! No Sustain, No Gain: The Link Between Action Videogame Expertise and in an Emotional Context

      Joana Dias, Fábio Silva, Samuel Silva, Swann Pichon & Sandra C. SoaresCare in Crisis Attitudes and Practices of Care in Central and Eastern Europe in the 21st Century

      Several studies have suggested that action videogame experience improves attentional tasks, but its effects on emotional perception remain uncertain. The present preregistered study aimed to explore whether individuals classified as action videogame players (AVGPs) exhibit heightened in the presence of emotional stimuli compared to non-videogame players (NVGPs). Seventy-eight participants were assigned to each group based on self-reported gaming experience. Participants engaged in a dual-task paradigm comprising a central emotion discrimination task and ...

      Caught in the Net: An Explorative HMI Study on HumanBehavioral Vulnerabilities Against Phishing

      Lorenzo Morocutti, Dario Pasquali, Stefano Bencetti, Nicoletta Noceti, Francesco Rea & Alessandra SciuttiProceedings of the 16th Biannual Conference of the Italian SIGCHI Chapter

      This work presents an exploratory study focused on the design of a serious game aimed at investigating the factors that lead individuals to fall victim to phishing attacks—a particularly dangerous form of social engineering used by cybercriminals. Data were collected from 15 participants who played the game autonomously, while unknowingly being exposed to simulated phishing attempts within a safe and controlled environment. The results indicate that the game design was effective in both engaging participants and delivering realistic, custom-crafted phish...

      Gaze and stress-based evaluation of pilots attention during flight: a preliminary study

      Sofia Marilina Glorioso, Salvatore Sorce & Antonio Esposito

      Pilots attention to cockpit instruments is essential for safe and effective task execution. This preliminary study explores if and how the task complexity affects the pilot’s attention to the instrument panel. To this end, we used eye-tracking to monitor visual attention, and the heart rate combined with the self-estimation of cognitive workload to assess stress levels. Our preliminary results show no direct relationship between the stress level descending from task complexity and attention to the instruments.

      An explainable eye-tracking-based framework for enhanced level-specific situational awareness recognition in air traffic control

      Xing Yao, Chun-Hsien Chen, Bufan Liu, Guorui Ma & Xiaoqing YuInnovation and Entrepreneurship Education

      Situational awareness (SA) recognition is essential for air traffic controllers (ATCOs) to ensure operational safety in human-Artificial Intelligence collaborative environments. The existing studies have primarily focused on overall SA assessment, neglecting its three distinct levels: perception (SA1), comprehension (SA2), and projection (SA3). This study presents an explainable eye-tracking-based three-phase framework for SA recognition. In Phase 1, an unsupervised learning approach was employed to annotate SA levels from behavioral data. Phase 2 involv...

      Attentive Saliency and Photorealism in Immersive Virtual Environments

      Deborah Pintani, Giulia Benvegnù, Federico Maria Lorusso, Cristiano Chiamulera, Andrea Giachetti & Ariel CaputoProceedings of the 16th Biannual Conference of the Italian SIGCHI Chapter

      Virtual Reality is widely used in behavioral studies, as it allows to simulate realistic experiences in environments completely controlled by the study designers. In particular, studies on visual saliency and attention can leverage immersive graphics rendered on head-mounted displays to create custom environments and head, body, and gaze tracking systems to evaluate the participant’s behavior. However, some aspects of the design of VR applications for attentive saliency study, especially in relation to rendering style, are poorly investigated in the lite...

      • Tobii VR

      Evaluating Biometric and Behavioral Markers of Intoxication in Drivers: A Pilot Study

      Bahram Salamat Ravandi, Max Fransson, Victor Fabricius, Norra Vandeleene, Clémentine Francois & Robert LoweProceedings of the 16th Biannual Conference of the Italian SIGCHI Chapter

      Intoxication and cognitive impairment are among the major contributors to traffic accidents and decreased traffic safety. The current pilot study focused on identifying and exploring behavioral and physiological markers of intoxication using a simulated driving environment. Eight participants were tested under two conditions: control (sober) and moderately intoxicated (0.05-0.10% BAC (blood alcohol concentration)). Participants engaged in a driving simulation while data was collected via EEG, eye-tracking, and driver behavior sensors (e.g., steering inpu...

      A gender-aware saliency prediction system for web interfaces using deep learning and eye-tracking data

      Pablo Villanueva González, Cristobal Subiabre Cuevas, Lino Jeldez, Benjamin Torrealba Troncoso, María Flavia Guiñazú & Juan D. Velásquez

      Understanding how demographic factors influence visual attention is crucial for the development of adaptive and user-centered web interfaces. This paper presents a gender-aware saliency prediction system based on fine-tuned deep learning models and demographic-specific gaze behavior. We introduce the WIC640 dataset, which includes 640 web page screenshots categorized by content type and country of origin, along with eye-tracking data from 85 participants across four age groups and both genders. To investigate gender-related differences in visual saliency...

      Measuring situational awareness onboard and ashore under increasing trackpilot information load

      Jantsje M. Mol, Andreea S. Pop, Monique Van Der Drift, Niklas van Duinen & Thierry M. Verduijn

      Trackpilots can help inland skippers sail an optimal route with minimal human input, which has the potential to save fuel costs and lower crew workload. In theory, widespread adoption of trackpilots is not only beneficial for crew on board, but also for traffic operators ashore. Data from trackpilots or intentions could be shared with fellow skippers and traffic operators. This could minimize verbal communication and allow operators to focus on the most important safety concerns. However, a larger information load in the form of trackpilot data may not n...

      Descubra publicaciones innovadoras en Factores humanos
      Ver todas las publicaciones

      Profundice en la investigación sobre Eye tracking

      Descubra el potencial transformador del eye tracking en la investigación de Factores Humanos. Obtenga información, mejore los resultados e impulse la innovación.