home

Eye tracking insights in human factors Q4 2024

In Q4 2024, eye tracking technology played a pivotal role in advancing human factors research. It enabled detailed analysis of visual attention and cognitive processes across diverse scenarios, from pedestrian safety to sports environments. Eye tracking provided empirical insights into wayfinding, workload assessment, and perception of automated vehicles, enhancing the understanding of human interaction with technology and environments. These findings underscore the value of eye tracking in optimizing design and safety measures.

Optimisation of floor evacuation map based on drive design

Huimin Liao, Kexin Zheng & Jiazheng Yi

To investigate the optimisation scheme for a floor evacuation map, library, and mall scenarios were considered as examples, and drive designs, including non-drive design, salient stimulus-drive design, and working memory-drive design, were introduced in the experiment. Participants’ wayfinding behaviour and responses were studied by analysing the average duration of fixation (ADF), average fixation counts (AFC), accuracy rate (AR), response time (RT), and other relevant indices. The experimental data revealed that both the salient stimulus-drive and work...

Do boxes affect exploration behavior and performance in group-in-a-box layouts?

Yuki Ueno, Hiroaki Natsukawa & Koji Koyamada

The group-in-a-box (GIB) layout is an efficient graph-drawing method designed to visualize the group structure of graphs. The layout communicates group sizes and both within-group and between-group network structures simultaneously. The layout is characterized by its composition of multiple elements, including nodes, edges, and boxes. However, there is limited empirical guidance on how these elements should be combined. In this paper, we measured participants’ task performance and eye movements while identifying the group with the largest number of inter...

Railway safety under increasing speed: Train drivers’ hazard perception of foreign object intrusion on railway tracks

Wenli Dong, Weining Fang, Xiaoxuan Jiang, Haifeng Bao, Hanzhao Qiu & Yanjie Li

Foreign object intrusion on railway tracks poses a significant safety threat to train operations. In this study, we investigate the impact of train operating speed on drivers’ hazard perception (HP). For this purpose, we developed a hazard perception test (HPT) system, simulating scenarios of foreign object intrusion on railway tracks using high-fidelity computer animation techniques. Thirty certified participants, who had passed the train driver psychological qualification test, participated in the HPT across four speed classes: 120 km/h, 160 km/h, 250 ...

Workload Assessment of Operators: Correlation Between NASA-TLX and Pupillary Responses

Yun Wu, Yao Zhang & Bin Zheng

Operators in high-stress environments often face significant cognitive demands that can impair their performance, underscoring the need for comprehensive workload assessment. This study aims to study the relationship between subjective self-reported measures, the NASA task load index (NASA-TLX), objective bio-signal measures, and pupillary responses. The participants engaged in either a visual tracking task or a laparoscopic visuomotor task while their eye movements were recorded using a Tobii Pro Nano eye tracker (Tobii Technology Inc., Stockholm, Swede...

User Experience Study of the Patient Monitoring Systems Based on Usability Testing and Eye Tracking

Hyeonkyeong Choi & Wonseuk Jang

Background/Objectives: The patient monitoring system is a critical tool commonly used in hospitals, making it essential to assess caregivers’ user requirements and satisfaction with its usability. In intensive care units (ICUs), the usability of these systems is closely linked to the work efficiency of key users, such as nurses, and directly impacts patient safety and treatment outcomes. This study evaluates the usability of patient monitoring systems in intensive care units (ICUs), focusing on user requirements and satisfaction among nurses, the primary...

Eye-Tracking Experiment on Perception and Acceptance of Agrivoltaics: Pilot Study on the Impact of Grassland Use Visualisations

Iris Schröter, Niels Püttschneider & Marcus Mergenthaler

Agrivoltaics (AV) are expanding worldwide, but knowledge about the perception and acceptance of this approach is far from complete. The aim of the present study was to investigate the visual perception and acceptance of AV systems, focussing on the central research question of whether the type of grassland use influences the visual perception and acceptance of vertical interspace AV. For this purpose, three photo-based pictures of a vertical interspace AV plant were used in a laboratory experiment with 29 participants: the original photo showing the AV p...

Attention distribution of pedestrians during street crossings: impacts of facility and environment

Chengyuan Mao, Xintong Zhang & Yiwen Huang

The incidence of pedestrian fatalities and injuries in traffic accidents remained unacceptably high. In order to understand the preferences and needs of pedestrians when crossing from a human perspective and to provide layout recommendations for intersection safety signs and facilities, this study collected pedestrian eye movement data at signalized intersections using Tobii Pro Glasses2. This study analyzed the characteristics of their attention allocation during street crossings and examined the impact of environmental factors on their attention distri...

Enhancing Visual Perception in Sports Environments: A Virtual Reality and Machine Learning Approach

Taiyang Wang, Peng Luo & Sihan Xia

The sports environment plays a crucial role in shaping the physical and mental well-being of individuals engaged in sports activities. Understanding how environmental factors and emotional experiences influence sports perceptions is essential for advancing public health research and guiding optimal design interventions. However, existing studies in this field often rely on subjective evaluations, lack objective validation, and fail to provide practical insights for design applications. To address these gaps, this study adopts a data-driven approach. Quan...

The Effect of Adding Japanese Honorifics When Naming a Driving-Review Robot

Kota Tanaka, Maho Shigematsu, Masayoshi Kanoh, Felix Jimenez, Mitsuhiro Hayase, Naoto Mukai, Tomohiro Yoshikawa & Takahiro Tanaka

In Japan, the percentage of traffic fatalities involving individuals aged 65 years and older is higher than that of other age groups. This issue can be addressed by having elderly individuals reflect upon their driving habits. Currently, this involves repeatedly attending training sessions at driving schools, which can be challenging due to time and location constraints. Hence, we develop a driving-review robot that allows elderly people to self-assess their driving skills in their homes. In developing this robot, we identified two crucial factors: “supp...

Cognition and agency-based methods to improve children’s road-hazard perception ability during visually occluded road crossing

Zhongxiang Feng, Xiuwei Zhang, Canhui Chu, Jing Liu, Zhipeng Huang, Tao Gu & Rui Xue

Children often neglect potential dangers in complex traffic environments, especially when their line of sight is occluded. This study aimed to explore the effects of cognitive and agency-based intervention methods on improving children’s perceptions of road hazards when their line of sight is occluded. Forty-eight children aged 8–12 years were recruited and randomly assigned to an intervention group or a control group. The intervention methods were based on problem-solving therapy, implicit modeling, and Socratic questioning. Eye-tracking data were colle...

Unmasking Dominant Features in a Transformed Cultural Landscape

Marta Rusnak, Andrew Tadeusz Duchowski, Agnieszka Tomaszewicz, Izabela Garaszczuk, Anna Brdulak, Małgorzata Biegańska, Zofia Koszewicz & Daria Dobrasiak

Contemporary architectural theorists seek sustainable methods to address gaps in high-value cultural areas, particularly in urban compositions, where the primary challenge is defining the relationship between monuments and their evolving surroundings. Contextualism promotes harmony with existing structures, while conservation guidelines often demand reconstruction or strong references to historical features, which can lead to resistance. Given the current climate of social change, it is essential to reconsider whether new buildings must always mimic hist...

Restoration Evaluation of National Forest Park in Greater Khingan Mountains Region, China

Yao Sun, Yunhe Ding, Miaoyi Lei & Liang Mao

As an important part of ecological civilization construction and harmonious coexistence between man and nature, the importance of restorative environment construction in national forest parks is self-evident. In this paper, the national forest park in the Greater Khingan Mountains region covering a large area of primary forest is taken as the research object. Based on visual perception, PRS, skin conductance level, and eye tracking technology are used as evaluation indexes to conduct restoration experiments on individuals. Among 60 participants, the PRS ...

Study on the Effect of Retro-reflective Properties of Marking Lines on Night-time Driving Safety

Luhua Zhao, Guangna Wu, Huiyao Xing, Yuepeng Liu & Weifan Gao

Pavement marking is a necessary part of road infrastructure, and its nighttime retroreflective characteristics affect the visibility of the marking and the safety of drivers driving at high speed at night. We selected three highways with different retroreflective coefficients for field driving experiments, extracted the data with Tobii Pro spectacle software and performed analysis of variance; constructed the driving behavior matrix, calculated the weights and eigenvalues with CRITIC assignment method, and quantitatively analyzed the impact of road marki...

The effects of layout types, visual features and text labels on icon visual search performance

Li Deng & Ruiying Liu

In operational tasks involving cognitive processes and visual guided pointing activities, this paper investigated the effects of icon layout types, visual features and text labels on the performance of visual search through eye tracking technology, taking the layout types of the icon (single row, double row, matrix and circular), visual features (round icon, round inverse colour icon, chamfered square icon, chamfered square inverse colour icon and borderless icon) and text labels (with or without text labels) as experimental variables. The task completio...

Eye-Tracking Characteristics: Unveiling Trust Calibration States in Automated Supervisory Control Tasks

Keran Wang, Wenjun Hou, Huiwen Ma & Leyi HongAdvances in Autism

Trust is a crucial human factor in automated supervisory control tasks. To attain appropriate reliance, the operator’s trust should be calibrated to reflect the system’s capabilities. This study utilized eye-tracking technology to explore novel approaches, given the intrusive, subjective, and sporadic characteristics of existing trust measurement methods. A real-world scenario of alarm state discrimination was simulated and used to collect eye-tracking data, real-time interaction data, system log data, and subjective trust scale values. In the data proce...

The Impact of In-Vehicle Guidance Technology on the Driving Behavior of Connected Vehicles in Work Zone Scenarios

Cheng Shi, Ruoxiang Qiu, Ling Wang, Zijian Wang & Long Zhang

Connected work zones equipped with communication and guidance devices support real-time traffic guidance, representing the application of vehicular-infrastructure cooperation technology in work zones. Driver compliance is crucial for guidance effectiveness in connected work zones. However, research on in-vehicle guidance effects on driver behavior is lacking. This study aims to investigate the impact of factors related to in-vehicle guidance technology on the driving behavior of connected vehicles. This study reveals the impact of multi-channel format, r...

Human-computer interaction research and optimization of intelligent cycling navigation devices based on eye tracking technology

Yu Xiao

The huge traffic flow in morning and evening peaks and the popularity of shared bicycles have led to the development of green traveling. As a kind of navigation device designed for cycling, intelligent cycling navigation devices can meet the basic navigation needs of cyclists. Due to the incomplete development, there are still problems such as low interaction efficiency and low security. This paper relies on the advantages of eye-tracking technology which is convenient and fast, and proposes a program to combine eye tracking technology with intelligent c...

Analysis of the Effect of Non-Driving-Related Tasks on Drivers’ Visual Load

Yuwei Pang, Guangluo Li & Lian Xie

A study in a simulator investigated the impact of non-driving-related tasks on drivers’ visual load during car-following to explore the impact of different types of non-driving-related tasks on drivers’ visual load during car-following. Forty-two participants were subjected to a 3 × 3 mixed design. They engaged in two tasks (mobile game and 1-back) and a control (normal driving) across three distinct car-following scenes. Tobii eye-tracker captured eye movements, and NASA-TLX gauged workload. The analysis revealed that during the mobile game, drivers exh...

Can Facial Expressions Predict Performance?: A Machine Learning Approach

Sameeran G. Kanade, Jun He, Sogand Hasanzadeh, Brandon Pitts, Behzad Esmaeili & Vincent G. Duffy

Emotional responses play a crucial role in decision-making processes and human interactions. This study used the FaceReader technology to investigate the correlation between emotional expressions (fear, anger, happiness, sadness, disgust, surprise and arousal) and hazard recognition performance. The facial expressions of the participants during the hazard identification test were recorded and then analyzed using machine learning methodologies. The results highlighted the significant relationship between emotional response and hazard identification perfor...

Exploring human-swarm interaction dynamics in cyber-physical systems: A physiological approach

Joseph P. Distefano, Souma Chowdhury & Ehsan Esfahani

Complex Cyber-Physical-Human System (CPHS) integrate the human operator as an essential element to assist with different aspects of information monitoring and decision making across the system to achieve the desired goal. A crucial aspect of enhancing CPHS efficiency lies in understanding the interaction dynamics of human cognitive factors and Cyber-Physical Systems (CPS). This entails designing feedback mechanisms, reasoning processes, and compliance protocols with consideration of their psychological impacts on human operators, fostering shared awarene...

Pedestrians’ perceptions, fixations, and decisions towards automated vehicles with varied appearances

Wei Lyu, Yaqin Cao, Yi Ding, Jingyu Li, Kai Tian & Hui Zhang

Future automated vehicles (AVs) are anticipated to feature innovative exteriors, such as textual identity indications, external radars, and external human–machine interfaces (eHMIs), as evidenced by current and forthcoming on-road testing prototypes. However, given the vulnerability of pedestrians in road traffic, it remains unclear how these novel AV appearances will impact pedestrians’ crossing behaviour, especially in relation to their multimodal performance, including subjective perceptions, gaze patterns, and road-crossing decisions. To address this...

Looking Beyond Self-Reported Cognitive Load: Comparing Pupil Diameter against Self-Reported Cognitive Load in Design Tasks

Madison Cass & Rohan Prabhu

As designers experience greater mental demands from the complexity of design tools and methods, we must understand their cognitive load when performing design tasks. Researchers have identified task- and designer-related factors that affect cognitive load, such as time or expected outcome. However, most of these design studies used self-report measures of cognitive load, which have been observed to be inaccurate and, to some extent, incomplete. In contrast, physiological measures (e.g., eye tracking) provide an objective assessment of mental workload. Ho...

Development of web- and mobile-based shared decision-making tools in the neurological intensive care unit

Winnie L. Liu, Lidan Zhang, Soussan Djamasbi, Bengisu Tulu & Susanne Muehlschlegel

In the neurological intensive care unit (neuroICU), patients with severe acute brain injury (SABI) are rendered unable to make their own healthcare decisions. The responsibility of making life-or-death decisions, such as goals of care, is carried by surrogate decision-makers, usually families. In addition to the burden of decision-making, the emotional burden on families is further compounded by prognostication uncertainty, time-pressure for decision-making, and difficulties in understanding and interpreting the patient's values and preferences, ultimate...

The Influence of Interpretational Background Music on Visitor Experience: An\xa0Eye-Tracking Study on a Virtual Art Exhibition

Xia Zheng, Zhujun Wang & Mengting Shen

With the advancement of digital technology, virtual museum exhibitions are rapidly growing, in which background music (BGM) is increasingly being used. However, it is not clear whether and how such BGM affects the visitor experience. This study designed a between-subjects factor experiment with three levels (stimulative music [ST], sedative music [SE], and no music [NO]) in a virtual art exhibition. A combination of eye-tracking, questionnaires, and interviews were used to measure the viewing experience of 96 participants. The results showed that the BGM...

Cognitive Response of Underground Car Driver Observed by Brain EEG Signals

Yizhe Zhang, Lunfeng Guo, Xiusong You, Bing Miao & Yunwang LiAdvances in Autism

In auxiliary transportation within mines, accurately assessing the cognitive and response states of drivers is vital for ensuring safety and operational efficiency. This study investigates the effects of various vehicle interaction stimuli on the electroencephalography (EEG) signals of mine transport vehicle drivers, analyzing the cognitive and response states of drivers under different conditions to evaluate their impact on safety performance. Through experimental design, we simulate multiple scenarios encountered in real operations, including interacti...

Effect of daytime and nighttime on helicopter pilot’s gaze behavior: a preliminary study in real flight conditions

Chenyang Zhang, Jin He, Chuang Liu, Wenbing Zhu, Shihan Luo & Chaozhe Jiang

Nighttime affects pilot visual scan patterns and increase the risks of helicopter operations, contributing to many helicopter accidents and incidents. Several past studies have attempted to examine the effect of nighttime on helicopter pilot gaze behavior, but researchers had limited success due to the difficulty of collecting representative data under real flight conditions. The present study attempted to address this challenge by conducting a real flight study involving daytime and nighttime traffic pattern tasks and using a Tobii Glasses 3 eye-trackin...

Situational Awareness Errors in Forklift Logistics Operations: A Multiphase Eye-Tracking and Think-Aloud Approach

Claudia Yohana Arias-Portela, Jaime Mora-Vargas, Martha Caro & David Ernesto Salinas-Navarro

Background: This study explores forklift operators’ situational awareness (SA) and human errors in logistic operations using a multiphase approach as an innovative methodology. Methods: Ethnography, eye tracking, error taxonomy, and retrospective think-aloud (RTA) were used to study the diverse cognitive, behavioral, and operational aspects affecting SA. After analyzing 566 events across 18 tasks, this research highlighted eye tracking’s potential by offering real-time insights into operator behavior and RTA’s potential as a method for cross-checking the...

Comprehensive VR Dataset for Machine Learning: Head- and Eye-Centred Video and Positional Data

Alexander Kreß, Markus Lappe & Frank BremmerFrontiers in Public Health

We present a comprehensive dataset comprising head- and eye-centred video recordings from human participants performing a search task in a variety of Virtual Reality (VR) environments. Using a VR motion platform, participants navigated these environments freely while their eye movements and positional data were captured and stored in CSV format. The dataset spans six distinct environments, including one specifically for calibrating the motion platform, and provides a cumulative playtime of over 10 hours for both head- and eye-centred perspectives. The da...

  • Tobii VR

Pilots Gaze Behavior During Simulated Helicopter Air-to-Air Refueling

Sven Schmidt, Daniel Greiwe & Tim Jusko

Refueling mid air is considered as important force multiplier for e.g. conducting search and rescue operations. Due to close proximity to the tanker, the refueling hose and drogue as well as the receiver can be strongly affected by the tanker’s wake. Thus, the refueling drogue extended from the tanker by a hose is often oscillating from turbulence. Contact with the tanker has to be established by positioning the receiver’s refueling probe within the tanker’s drogue. During qualification training pilots are instructed to not focus on the drogue, due to it...

Image-based evaluation of product designs using eye-tracking, questionnaire, and interview methods

Linna Hu & Mardelle McCuskey Shepley

With a focus on the evaluation of conceptual product designs presented in the form of renderings, this paper describes an eye-tracking study in which gaze metrics, design ratings, and overall rankings of designs were measured. To explore the rationales behind fixational eye movements and numeric evaluation outcomes, additional qualitative data were collected through interviews. To investigate the predictive effect of gaze behavior on perceived design quality, we examined how fixation count and total fixation time could predict ratings of five different a...

Selection of optimal display color for China’s emergency management system using eye tracking

Ming Shao & Qinjuan Zhang

In recent years, eye-tracking analysis has been widely applied in both basic and applied research fields, yielding notable results. However, studies on specific scenarios, such as the display styles of emergency rescue platforms, are still lacking. China’s vast territory encompasses diverse climates and natural environments. To address the various environmental challenges, an emergency management digital twin system platform has been developed to enable real-time safety monitoring of key industries and high-risk areas for frequent accidents. However, the...

Fatigue Detection of Air Traffic Controllers Through Their Eye Movements

Yi Hu, Haoran Shen, Hui Pan & Wenbin Wei

Eye movement patterns have become an essential element in modern approaches for identifying air traffic controller fatigue. By observing eye movements among various individuals and environments, researchers have discovered correlations with multiple physiological metrics and cognitive processing abilities. This study involved human-in-the-loop simulations to collect eye movement and fatigue data from air traffic controllers and students. The eye movements were classified into three main types: fixation, saccade, and blink. Statistical analyses were perfo...

Interactive Design of Serious Game Based on Gesture for Transmission of Traditional Handicraft

Wa Gao, Shiyu Li, Yuan Tian, Shiyi Shen & Wenjing Wei

Traditional handicraft making and display usually require fixed steps of hand operating. Gesture-based design is a considerable way when designing serious interactive games for traditional handicraft transmission . This paper developed a design framework for interactive game using gesture with five modules including investigation, gesture-determination, scheme, rapid prototyping, and evaluation. Gestures are obtained by behavior observation of traditional handicraft and user study, and drawn as corresponding icons used in UI scheme, captured by Leap moti...

Study on the Influence of the Total Front HMI Size in Intelligent Cabins on the Drivers’ Eye Movement Behavior

Wang Yuxiao & Zhang Yanxiang

The large-screen and multi-screen design of the HMI (Human-machine interface) is one of the essential manifestations of today’s intelligent cabins. However, this trend poses a risk of distracting drivers and affecting safe driving. We used VR (Virtual Reality) technology to provide participants with a simulated driving environment and used eye movement analysis to explore the impact of the total size of the front HMI in intelligent cabins on the drivers’ eye movement behavior. At the same time, we investigated the effects of driving age, driving time, an...

Identifying Behavioral Correlates to Visual Discomfort

David Tovar, James Wilmott, Xiuyun Wu, Daniel Martin, Michael Proulx, Dave Lindberg, Yang Zhao, Olivier Mercier & Phillip Guan

Outside of self-report surveys, there are no proven, reliable methods to quantify visual discomfort or visually induced motion sickness symptoms when using head-mounted displays. While valuable tools, self-report surveys suffer from potential biases and low sensitivity due to variability in how respondents may assess and report their experience. Consequently, extreme visual-vestibular conflicts are generally used to induce discomfort symptoms large enough to measure reliably with surveys (e.g., stationary participants riding virtual roller coasters). An ...

  • Tobii VR

Impact of visual distraction on neonatal mask ventilation: a simulation-based eye-tracking study

Katharina Bibl, Michael Wagner, Robyn Dvorsky, Moritz Haderer, Vito Giordano, Peter Groepel, Angelika Berger, Travis Whitfill, Bashar Kadhim, Marc A Auerbach & Isabel T Gross

This study aimed to investigate whether distractions during simulated neonatal resuscitation impact mask leakage and visual gaze patterns during positive pressure ventilation (PPV) of a newborn manikin.

Modeling Attentive Interaction Behavior for Web Content Identification in Exploratory Information Seeking

Extracting and collecting information during web exploration is an arduous process, demanding substantial cognitive and physical effort from users. Users must not only determine which content is worth capturing but also manually extract and save it, often disrupting the flow of their learning and exploration. To mitigate it, we propose AIbM (Attentive Interaction Behavior Modeling), which encodes and integrates multiple implicit interaction data to identify fine-grained helpful web content, providing an algorithmic foundation to facilitate automatic info...

Human-Automation Trust Development as a Function of Automation Exposure, Familiarity, and Perceived Risk: A High-Fidelity Remotely Operated Aircraft Simulation

Eric T. Chancey, Michael S. Politowicz, Kathryn M. Ballard, James Unverricht, Bill K. Buck & Steven Geuther

Trust development will play a critical role in remote vehicle operations transitioning from automated (e.g., requiring human oversight) to autonomous systems. Factors that affect trust development were collected during a high-fidelity remote uncrewed aerial system (UAS) simulation. Six UAS operators participated in this study, which consisted of 17 trials across two days per participant. Trust in two highly automated systems were measured pre- and post-study. Perceived risk and familiarity with the systems were measured before the study. Main effects sho...

Identification of Distinct Visual Scan Paths for Pathologists in Rare-Element Search Tasks

Alana Lopes, Sean Rasmussen, Ryan Au, Vignesh Chakravarthy, Tricia Chinnery, Jaryd Christie, Bojana Djordjevic, Jose A. Gomez, Natalie Grindrod, Robert Policelli, Anurag Sharma, Christopher Tran, Joanna C. Walsh, Bret Wehrli, Aaron D. Ward & Matthew J. Cecchini

The search for rare elements, like mitotic figures, is crucial in pathology. Combining digital pathology with eye-tracking technology allows for the detailed study of how pathologists complete these important tasks.

Impact of Situation Awareness Variations on Multimodal Physiological Responses in High-Speed Train Driving

Wenli Dong, Weining Fang, Hanzhao Qiu & Haifeng BaoErgonomics

Background: In safety-critical environments, human error is a leading cause of accidents, with the loss of situation awareness (SA) being a key contributing factor. Accurate SA assessment is essential for minimizing such risks and ensuring operational safety. Traditional SA measurement methods have limitations in dynamic real-world settings, while physiological signals, particularly EEG, offer a non-invasive, real-time alternative for continuous SA monitoring. However, the reliability of SA measurement based on physiological signals depends on the accura...

Task allocation considering shipping safety: Workload resilient interval for inland passenger ship seafarers’ optimal safety performance in real navigation

Qing Liu, Yue Ma & Liu Yang

Maritime operations present unique challenges where excessive seafarer workload can directly impact ship navigation safety. While much of the existing research on seafarers’ workload in dynamic human-machine systems relies on simulation experiments, there is a lack of studies conducted in real maritime environments. Furthermore, research on optimal task allocation with practical applications remains limited. To address these issues, this study investigates the workload values and resilience intervals necessary for optimal safety performance among inland ...

Research on an Eye Control Method Based on the Fusion of Facial Expression and Gaze Intention Recognition

Xiangyang Sun & Zihan Cai

With the deep integration of psychology and artificial intelligence technology and other related technologies, eye control technology has achieved certain results at the practical application level. However, it is found that the accuracy of the current single-modal eye control technology is still not high, which is mainly caused by the inaccurate eye movement detection caused by the high randomness of eye movements in the process of human–computer interaction. Therefore, this study will propose an intent recognition method that fuses facial expressions a...

A subjective and objective fusion visual fatigue assessment system for different hardware and software parameters in SSVEP-based BCI applications

Peiyuan Tian, Guanghua Xu, Chengcheng Han, Chenghang Du, Hui Li, Ruiquan Chen, Jieren Xie, Jiahuan Wang, Hanli Jiang, Xiaobing Guo, Sicong Zhang & Qingqiang WuPLOS One

With the development of brain-computer interface industry, large amounts of related applications have entered people’s vision. BCI applications based on steady-state visual evoked potentials (SSVEP) are widely used because they do not require pre-training and have high information transmission rates. However, in the actual use of SSVEP stimulus paradigm, the subjects will produce visual fatigue with the use, and fatigue will affect the transmission efficiency. In this experiment, an experimental environment consisting of two paradigm stimulus frequencies...

    Driving Fatigue Onset and Visual Attention: An Electroencephalography-Driven Analysis of Ocular Behavior in a Driving Simulation Task

    Andrea Giorgi, Gianluca Borghini, Francesca Colaiuda, Stefano Menicocci, Vincenzo Ronca, Alessia Vozzi, Dario Rossi, Pietro Aricò, Rossella Capotorto, Simone Sportiello, Marco Petrelli, Carlo Polidori, Rodrigo Varga, Marteyn Van Gasteren, Fabio Babiloni & Gianluca Di Flumeri

    Attentional deficits have tragic consequences on road safety. These deficits are not solely caused by distraction, since they can also arise from other mental impairments such as, most frequently, mental fatigue. Fatigue is among the most prevalent impairing conditions while driving, degrading drivers’ cognitive and physical abilities. This issue is particularly relevant for professional drivers, who spend most of their time behind the wheel. While scientific literature already documented the behavioral effects of driving fatigue, most studies have focus...

    Different Evaluation Strategies of Oncological CT Examinations with Regard to Professional Experience: A Clinical Study Using Eye-tracking

    Sara Kluge, Christoph Schülke, Hannah Christin Ites, Tarek Zoubi, Cornelia L.A. Dewald, Walter Heindel, Boris Buerke & Anna Janina Höink

    Contrast-enhanced CT is the standard imaging technique in oncological objectives. Rates of missed pathologies depend on work experience of the respective radiologists. Thus the aim of this study is to analyze the eye movements of professionals while reading CT images in order to evaluate whether the eye-fixation patterns and search strategies of experienced radiologists could explain higher detection rates of pathologies and whether such patterns can be learned.

    Collision of tradition and visual perception: aesthetic evaluation and conservation intent in adapting traditional Chinese gates within architectural heritage

    Zihao Cao, Muhizam Mustafa, Mohd Hafizal Mohd Isa & Yongchun Mao

    The sustainable conservation of architectural heritage has attracted significant attention, especially with the rapid development of heritage tourism. Adaptation is a compromise to allow heritage to meet modern development demands; however, unregulated adaptations pose significant risks to sustainable conservation. This study involved 60 participants in a quasi-experimental investigation, using eye-tracking technology combined with evaluation questionnaires. The aim was to explore how material, ornament, and generational age differences impact aesthetic ...

    Cartographic generalization of settlement representations: human vs. machine

    Izabela Karsznia, Arzu Çöltekin & Veronica Sundstedt

    Cartographic generalization aims at decreasing map or database detail. On one hand, its goal is taking into account map purpose, user constraints and needs, on the other hand maintaining and highlighting characteristic spatial patterns. One of the main challenges in the research concerning cartographic generalization is the evaluation of its results. While previous studies have exclusively concentrated on quantitative evaluation of cartographic generalization results, we complement these studies by considering both quantitative and qualitative evaluation...

    Simulation-based Driver Scoring and Profiling System

    Jelena Medarević, Sašo Tomažič & Jaka Sodnik

    This paper describes a rule-based Driver Scoring System model, derived from behavioral data collected using a driving simulator. It introduces a novel approach to establish driver profiles through feature engineering of acquired dataset, with features evaluating various aspects of driver behavior. The research aims to provide employers and drivers with profile-specific feedback and recommendations to design training protocols. Principal Component Analysis is applied on preprocessed dataset from 412 drivers for dimensionality reduction and feature selecti...

    Quantifying the Remote Driver’s Interaction with 5G-Enabled Level 4 Automated Vehicles: A Real-World Study

    Shuo Li, Yanghanzi Zhang, Simon Edwards & Phil Blythe

    This real-world investigation aimed to quantify the human–machine interaction between remote drivers of teleoperation systems and the Level 4 automated vehicle in a real-world setting. The primary goal was to investigate the effects of disengagement and distraction on remote driver performance and behaviour. Key findings revealed that mental disengagement, achieved through distraction via a reading task, significantly slowed the remote driver’s reaction time by an average of 5.309 s when the Level 4 automated system required intervention. Similarly, dise...

    Survey on the Impact of Historical Museum Exhibition Forms on Visitors’ Perceptions Based on Eye-Tracking

    Linhui Hu, Qian Shan, Lidan Chen, Siyin Liao, Jinxiao Li & Guangpei Ren

    Exhibition design in museum space is of great significance in enhancing cultural attraction, visitor experience, and heritage conservation. With the growth of spiritual and cultural needs, the construction of museums has increased, but the quality of exhibitions has been improved to a limited extent. In order to explore visitors’ perceptual experience in terms of display forms, this paper combines eye-tracking technology and subjective evaluation to select three display forms, namely, stand-alone display form, combined picture and object form, and combin...

    Situation Awareness Discrimination Based on Physiological Features for High-Stress Flight Tasks

    Chunying Qian, Shuang Liu, Xiaoru Wanyan, Chuanyan Feng, Zhen Li, Wenye Sun & Yihang Wang

    Situation awareness (SA) discrimination is significant, allowing for the pilot to maintain task performance and ensure flight safety, especially during high-stress flight tasks. Although previous research has attempted to identify and classify SA, existing SA discrimination models are predominantly binary and rely on traditional machine learning methods with limited physiological modalities. The current study aimed to construct a triple-class SA discrimination model for pilots facing high-stress tasks. To achieve this, a flight simulation experiment unde...

    Detecting when Users Disagree with Generated Captions

    Omair Shahzad Bhatti, Harshinee Sriram, Abdulrahman Mohamed Selim, Cristina Conati, Michael Barz & Daniel Sonntag

    The pervasive integration of artificial intelligence (AI) into daily life has led to a growing interest in AI agents that can learn continuously. Interactive Machine Learning (IML) has emerged as a promising approach to meet this need, essentially involving human experts in the model training process, often through iterative user feedback. However, repeated feedback requests can lead to frustration and reduced trust in the system. Hence, there is increasing interest in refining how these systems interact with users to ensure efficiency without compromisi...

    Immersive remote telerobotics: foveated unicasting and remote visualization for intuitive interaction

    Yonas T. Tefera, Yaesol Kim, Sara Anastasi, Paolo Fiorini, Darwin G. Caldwell & Nikhil Deshpande

    Precise and efficient performance in remote robotic teleoperation relies on intuitive interaction. This requires both accurate control actions and complete perception (vision, haptic, and other sensory feedback) of the remote environment. Especially in immersive remote teleoperation, the complete perception of remote environments in 3D allows operators to gain improved situational awareness. Color and Depth (RGB-D) cameras capture remote environments as dense 3D point clouds for real-time visualization. However, providing enough situational awareness nee...

    • Tobii VR

    Experimental study on effect of pavement background on obstacle visibility in LED lighting environment of road tunnel

    Shouzhong Feng, Deyuan Kan, Long Zhou, Xianling Liu, Cunyu Du & Weixing Mao

    The tunnel pavement is generally made of asphalt or concrete. Due to the relatively fixed material of pavement, the effect of tunnel pavement setting on the lighting environment and visual performance of drivers has not received sufficient attention, especially the impact on the visual performance of drivers during driving has not been revealed. Therefore, experimental research on the visual recognition performance of an obstacle on asphalt and concrete pavements inside tunnels during dynamic driving was conducted in this study. The results indicate that...

    An exploratory user study towards developing a unified, comprehensive assessment apparatus for deaf signers, specifically tailored for signing avatars evaluation: challenges, findings, and recommendations

    Alfarabi Imashev, Nurziya Oralbayeva & Anara Sandygulovaeneuro

    Sign Languages (SL) are natural languages used by those who are deaf or have hearing impairments, as well as by hearing persons, including interpreters, family members, and friends of deaf individuals. Spoken languages rely primarily on verbal and written communication, whereas sign language focuses mainly on visual-gestural communication. In their daily lives, unimodal users (deaf people who only use sign language) cannot always rely solely on textual communication. Research on SL recognition and generation has shown enormous promise in addressing conce...

    Integration patterns in the use of metadata for data sense‐making during relevance evaluation: An interpretable deep learning‐based prediction

    Qiao Li, Ping Wang, Chunfeng Liu, Xueyi Li & Jingrui Hou

    Integrating diverse cues from metadata to make sense of retrieved data during relevance evaluation is a crucial yet challenging task for data searchers. However, this integrative task remains underexplored, impeding the development of effective strategies to address metadatas shortcomings in supporting this task. To address this issue, this study proposes the “Integrative Use of Metadata for Data Sense-Making” (IUM-DSM) model. This model provides an initial framework for understanding the integrative tasks performed by data searchers, focusing on their i...

    Research on the daylighting metrics of college classrooms based on visual comfort in China

    Han Li, Jia Jia, Hongxia Yu & Xingtian Wang

    Vision is one of the most important senses of human beings. Reasonable daylighting is a prerequisite for ensuring the visual health of college students, and it is even more necessary for the speed and accuracy of processing visual information. This study addresses the critical issue of identifying daylighting metrics threshold values for college classrooms to enhance students' visual comfort during desktop paper reading, visual health and efficiency in information processing. An overall methodology was explored, which integrated task performance indexes ...

    Multi-stage gaze-controlled virtual keyboard using eye tracking

    Verdzekov Emile Tatinyuy, Auguste Vigny Noumsi Woguia, Joseph mvogo ngono & Louis Aimé FONOSoftware and Systems Modeling

    This study presents a novel multi-stage hierarchical approach to optimize key selection on virtual keyboards using eye gaze. Existing single-stage selection algorithms have difficulty with distant keys on large interfaces. The proposed technique divides the standard QWERTY keyboard into progressively smaller regions guided by eye movements, with boundary fixations first selecting halves and quarters to sequentially narrow the search area. Within each region, keys are highlighted one by one for selection. An experiment compared the multi-stage approach to...

    Analysing Virtual Labs Through Integrated Multi-Channel Eye-Tracking Technology: A Proposal for an Explanatory Fit Model

    María Consuelo Sáiz-Manzanares, Raúl Marticorena-Sánchez, Javier Sáez-García & Irene González-Díez

    This study deals with an analysis of the cognitive load indicators produced in virtual simulation tasks through supervised and unsupervised machine learning techniques. The objectives were (1) to identify the most important cognitive load indicators through the use of supervised and unsupervised machine learning techniques; (2) to study which type of task presentation was most effective at reducing the task’s intrinsic load and increasing its germane load; and (3) to propose an explanatory model and find its fit indicators. We worked with a sample of 48 ...

    Analysis of spatial and design factors for users acceptance of rescue rooms in road tunnels: An exploratory study using Virtual Reality

    Claudia Moscoso, Jo Skjermo, Hampus Karlsson, Petter Arnesen, Carl-Johan Södersten, Åsa S. Hoem & Gunnar D. Jenssen

    In emergency fire situations in road tunnels in which vehicles cannot exit the tunnel, evacuation on foot might be the only alternative. In such scenarios, self-rescue using rescue rooms might provide provisional safe shelter to people trapped in tunnel emergencies. Yet, a stay in a rescue room with unsatisfactory design might contribute to higher levels of distress to the users. The present study examines five different designs of rescue rooms via virtual reality, to study how the different design and spatial factors might affect users' acceptance of su...

    • Tobii VR

    Detecting event-related driving anger with facial features captured by smartphones

    Yi Wang, Xin Zhou, Yang Yang & Wei Zhang

    Driving anger is a serious global issue that poses risks to road safety, thus necessitating the development of effective detection and intervention methods. This study investigated the feasibility of using smartphones to capture facial expressions to detect event-related driving anger. Sixty drivers completed the driving tasks in scenarios with and without multi-stage road events and were induced to angry and neutral states, respectively. Their physiological signals, facial expressions, and subjective data were collected. Four feature combinations and si...

    On the\xa0Task-Specific Effects of\xa0Fragmentation in\xa0Modular Process Models

    Amine Abbad-Andaloussi, Clemens Schreiber & Barbara Weber

    Modularization has been extensively investigated for its role in enhancing the comprehension of process models by dividing them into smaller, self-contained and manageable modules. However, existing studies have reported inconclusive results, prompting further exploration into when modularization supports or impedes process comprehension. Among the key factors suggested to influence the effect of modularization is the type of the task at hand. Indeed, the fragmentation of information across several modules caused by modularization can challenge readers’ ...

    Augmented reality HMI for distracted drivers in a level 3 automation: Effects on takeover performance and safety

    Gaëtan Merlhiot & Elsa Yousfi

    With an increased level of automation, drivers can divert attention from the road environment and engage in non-driving-related tasks, thus reducing situation awareness, which could impact safety in cases of manual takeover requests. In this research, an augmented reality situation-adaptive human–machine interface (HMI) was simulated in a virtual environment. The HMI aimed to improve the quality of takeovers by boosting the reconstruction of situation awareness in distracted drivers following a takeover request in a Level 3 automated driving situation. T...

    Effects of Head-Up Display Information Layout Design on Driver Performance: Driving Simulator Studies

    Jingyu Li, Weihua Zhang, Zhongxiang Feng, Liyang Wei, Tang Tang & Tao Gu

    Head-up displays (HUDs) enable drivers to receive additional information while maintaining a forward view of the road. However, due to human cognitive resource limitations, improper HUD interface design can pose safety risks, especially when multiple pieces of information are presented simultaneously. This study involved 45 participants and conducted two driving simulation experiments. Study 1 explored the impact of different HUD interface positions on driver cognitive performance in single cognitive task conditions. Study 2 validated the findings of Stu...

    Investigating mental workload across task modalities: a multimodal analysis using pupillometry

    Snehal Dhengre & Ling Rothrock

    Understanding mental workload is challenging due to its multidimensional nature and varying sensitivities of its primary measures: task performance, perceived workload, and physiological responses. This study investigates the effects of task load on performance, perceived workload, and pupil measures across different information modalities. A within-subjects experiment involving three tasks (digit span, matrix span, and dual n-back) was conducted with three task load levels. Workload measures included accuracy/sensitivity, reaction time, NASA-TLX, peak p...

    AR-based Merging Assistance at Expressway and Its Verification

    Sho Takahashi, Ryohei Maruyama & Toru Hagiwara

    This paper tries to support merging behavior by providing information about the behavior of the mainline vehicle as a next-generation human-machine interface based on augmented reality (AR). Specifically, our system indicates the timing in which the merging vehicle cannot merge by using AR to the driver. This information is generated based on the position and speed of the mainline vehicle. In this study, a virtual reality (VR) driving simulator that can measure the gaze was developed for experiments. By utilizing the VR driving simulator, driving experim...

    • Tobii VR

    Lock Operations Through the Operator’s Eyes: A Qualitative Exploration of Gaze Strategies

    Rutger Stuut, Christian P. Janssen, Stefan Van der Stigchel & Ellemieke Van Doorn

    This paper reports a qualitative exploration of gaze strategies during closed-circuit television (CCTV) tasks in remote nautical object control of a lock. Previous research has not examined gaze strategies in scenarios where systems, such as nautical objects, are operated remotely using CCTV. As contextual factors matter in nautical object control, a qualitative approach was necessary to uncover domain-specific terminology and insights into gaze strategies. We recorded eye gaze from professional lock operators and then conducted semi-structured interview...

    Pilot Study on Gaze Characteristics of Older Drivers While Watching Driving Movies

    Kaori Kawabata, Yuya Nakajima, Kazuki Fujita, Mamiko Sato, Koji Hayashi & Yasutaka Kobayashi

    Objective: This study aims to clarify the gazing characteristics of older drivers while driving cars using a gaze analysis device. Methods: The participants included 16 older and 12 middle-aged drivers who drove cars daily. After conducting cognitive and attentional function tests, eye gaze while watching driving videos was measured using an eye tracker. Ten driving videos were prepared. In addition, a total of 34 hazard areas were analyzed. Results: The results of the gaze measurement parameters were statistically compared between the two groups. In the...

    Age-adapted painting descriptions change the viewing behavior of young visitors to the Rijksmuseum

    Francesco Walker, Berno Bucker, Joshua Snell, Nicola Anderson, Zsofia Pilz, Kim Houwaart, Reinout Van den Brink, Pauline Kintz, Irma de Vries & Jan TheeuwesPLOS One

    Children learn about art by actively engaging with their surroundings. This makes museums potentially rich environments for learning and development. Yet, the descriptions of paintings on show are usually written for adults rather than younger visitors. This study uses mobile eye tracking to examine how painting descriptions tailored for children influence their eye movements when viewing paintings at the Rijksmuseum - the national museum of The Netherlands. Our findings underscore the importance of adapting information specifically for children, rather ...

    Towards Automatic Object Detection and Activity Recognition in Indoor Climbing

    Hana Vrzáková, Jani Koskinen, Sami Andberg, Ahreum Lee & Mary Jean AmonAdvances in Autism

    Rock climbing has propelled from niche sport to mainstream free-time activity and Olympic sport. Moreover, climbing can be studied as an example of a high-stakes perception-action task. However, understanding what constitutes an expert climber is not simple or straightforward. As a dynamic and high-risk activity, climbing requires a precise interplay between cognition, perception, and precise action execution. While prior research has predominantly focused on the movement aspect of climbing (i.e., skeletal posture and individual limb movements), recent s...

    Can eye-tracking help to create a new method for X-ray analysis of rheumatoid arthritis patients, including joint segmentation and scoring methods?

    Baptiste Quéré, Léonie Méneur, Nathan Foulquier, Hugo Pensec, Valérie Devauchelle-Pensec, Florent Garrigues & Alain Saraux

    Reading hand and foot X-rays in rheumatoid arthritis patients is difficult and time-consuming. In research, physicians use the modified Sharp van der Heijde Sharp (mvdH) score by reading of hand and foot radiographs. The aim of this study was to create a new method of determining the mvdH via eye tracking and to study its concordance with the mvdH score. We created a new method of quantifying the mvdH score based on reading time of a reader monitored via eye tracking (Tobii Pro Lab software) after training with the aid of a metronome. Radiographs were re...

    Discover cutting-edge publications in Human factors
    See all publications

    Enhance your human factors insights

    Leverage eye tracking to deepen understanding of human interaction with technology and environments for improved safety and design.