home

인간공학 연구에서의 시선추적의 발전 - 2025년 3분기

2025년 3분기 시선추적 기술은 다양한 영역에서 인간공학 연구를 발전시키는 데 중요한 역할을 했습니다. 시선추적은 자율 주행 시 운전자 상태, 조명 조건이 업무 성과에 미치는 영향, 게임 플레이 중 다양한 게임 컨트롤러가 시각적 주의에 미치는 영향에 대한 귀중한 인사이트를 제공했습니다. 또한 시선추적을 통해 신생아 중환자실의 체크리스트 준수 여부를 평가하고 고속철도 운전자의 시각적 특성을 평가할 수 있었습니다.

Proprioception and vision relationship in aimed movement with restricted and reversed vision

Yuqian Wang, Ravindra S. Goonetilleke, Ray F. Lin, Ameersing Luximon & Yan LuximonInternational Journal of Human–Computer Interaction

Human movement relies on visual and proprioceptive inputs, and the movement can be hampered when either input provides limited or distorted information, as in robotic surgery, virtual reality, or spaceflight. This study examines how proprioception influences performance in aimed movement tasks under restricted and inverted visual conditions. An experiment with 24 participants showed slower movements and increased information processing demands with incompatible visual feedback. The difference was diminished when the proprioceptive variability was control...

Flow or Distraction? Exploring Multimodal Patterns of Driver States in Automated Driving

Pei-Ru Chen, I-Jui Lee, Wei-Chun Tai & Jo-Yu Kuo

Understanding driver states is critical for adaptive systems, yet research has focused on fatigue and distraction, overlooking positive engagement (e.g., flow state) during Non-Driving-Related Tasks. This study explores whether drivers under various automation levels remain in flow or become distracted, and how physiological signals vary across Society of Automotive Engineers Levels 0, 3, and 5. Participants completed all levels in a Simulator setup while listening to a conversational podcast. Eye movement, heart-rate variability (HRV), vehicle control a...

Non-Emergency Notification Timing for Drivers Doing Non-Driving-Related Tasks in Autonomous Vehicles: An Interruptibility Study

Hongyu Howie Wang, Jiya Gupta & Nikolas Martelaro

Future high-level autonomous vehicles (AVs) will enable drivers to engage in non-driving-related tasks (NDRTs) during autopilot. Occasionally, an in-vehicle agent may need to notify drivers of important, yet not urgent, information. Through a four-session interruptibility study on a desktop autonomous driving Simulator setup, we investigated how drivers assess their availability to receive notifications by rating moments as good or bad for interruption. Our results suggest drivers fall into four notification availability groups: always available, priorit...

Query-Level Alignment for End-to-End Lesion Detection with Human Gaze

Yan Kong, Zhixiang Peng, Yuan Yin, Yonghao Li, Jiangdong Cai, Sheng Wang, Qian Wang, Yuqi Fang & Caifeng Shan

Lesion detection for medical image is crucial in computer-aided diagnostic systems, enabling early disease identification and enhancing clinical decision-making. Existing lesion detection models primarily rely on bounding boxes for supervision, which overemphasize lesion boundaries while neglecting critical internal features, potentially resulting in misdetections. In contrast, clinicians’ gaze, which reflects the visual focus during diagnosis, captures internal semantic patterns of lesions, providing a more informative supervisory signal than convention...

    Investigating Shifts in Driver Attention and Trust Across Manual and Autonomous Driving: Insights from Eye-Tracking Metrics

    Yuan Cai, Mustafa Demir, Farzan Sasangohar & Mohsen Zare

    As autonomous vehicles (AVs) advance, understanding driver visual attention and trust in various driving modes is crucial for ensuring safety and effective design. This study examined the relationship between trust and visual attention in a simulated Level 3 driving environment, utilizing eye-tracking metrics: fixation duration (FD), fixation count (FC), and time to first fixation (TFF). Thirty-four participants navigated scenarios involving automation, handover, manual, and takeover modes while interacting with a human-machine interface. Results from ge...

    The effect of command cabin light environment on work performance based on psychophysiological characteristics

    Command cabins often cause operator fatigue and errors due to confined layouts, complex tasks, and monotonous environments. This study recruited 25 healthy male operators. Under a fixed illuminance of 340 lx and three correlated color temperature (CCT) conditions (3000 K, 4500 K, 6000 K), participants performed dynamic tasks. Psychological comfort was assessed with Likert scales, task performance with accuracy and completion rates, and synchronized physiological indicators were recorded. Results showed that 4500 K lighting produced smaller Pupil Research...

    • ErgoLab

    Voice-Based Interactions in Immersive Interactive Digital Narratives

    Olga Chatzifoti

    This PhD research investigates the cognitive and affective influences of voice and speech as input modalities in immersive interactive experiences. While prior research on voice interfaces has primarily focused on usability and efficiency, the highly social and affective dimension of voice is increasingly gaining recognition in academia. This work aims to contribute to this growing area by investigating voice as an input modality specifically for text-based interactions, such as narration and dialogue, in immersive environments. The central hypothesis is...

    • Tobii VR
    • SDK

    Path-Aware Routing System for Multimodal Estimation: A Structured Fusion Perspective

    Yu Sun, Shiwu Li, Yiming Bie, Linhong Wang, Tongtong Jin, Mengzhu Guo & Zhifa Yang

    Driver is a critical cognitive factor in ensuring the safety of intelligent driving systems. With advances in physiological and behavioral sensing technologies, multimodal data have become an essential source for modeling drivers’ cognitive states. However, , as an implicit cognitive state, is difficult to model accurately using a single modality. Efficient fusion of multiple modalities and structured information interaction remains a core challenge in this task. Existing approaches often rely on strategies such as feature concatenation and attention mec...

    The Effects of of Working Memory Capacity on Situation Awareness During Takeover in Human-Machine Co-Driving Systems

    Song He & Naiwen Li

    This study investigates the influence of working memory capacity on drivers’ situation awareness during takeover in a human-machine co-driving environment. Using Prescan, a simulated autonomous highway driving scenario was created, where 26 participants engaged in 25 min of autonomous driving and performed takeover in response to sudden incidents. WMC was assessed via the Automated Operation Span Task, while SA was evaluated using the Situation Awareness Global Assessment Technique (SAGAT) combined with eye-tracking technology. Results indicated that par...

    Enhancing Path Testing with Eye-Tracking: A Human-Centric Approach to Functional Software Testing

    Angelos Fotopoulos, Fezo Metsi & Michalis Xenos

    Software testing is essential for reliable, high-quality software, and path testing plays a key role in ensuring every function works as intended. However, connecting complex code to control-flow graphs can overwhelm testers, slowing down the process and increasing the risk of errors. We’ve developed a novel eye-tracking system to make path testing easier and more effective. By tracking testers’ gaze, the system highlights matching code when they view a graph node, or the corresponding node when they focus on a line of code, keeping them focused and redu...

    Driving style modulates earthquake alert responses: EEG and eye-tracking evidence from simulated emergencies

    Jie Wang, Jiangtong Li & Yi Xiao

    OBJECTIVE: Sudden earthquakes can severely disrupt urban transportation networks, leading to traffic interruptions and secondary accidents. Earthquake early warning (EEW) systems offer drivers a short window to respond. However, reactions vary by driving style, which influences attention and decision-making under stress. This study aims to examine how individual driving styles influence cognitive and behavioral responses to EEW alerts, with the goal of informing behavior-aware safety strategies during seismic emergencies.METHODS: A total of 92 licensed d...

    Comparative analysis of the effects of sight-inducing facilities on drivers visual behavior at the entrance road of tunnel clusters

    Xiaowei Xue, Shunying Zhu, Zhiming Li, Qing Fu & Siyuan Li

    This paper focuses on driving safety in the successive entrance segments of tunnel clusters, collecting eye movement data of drivers in different entrance sections of a tunnel cluster through real vehicle tests, and analyzing the visual behavior characteristics of drivers and the improvement effect of visual guidance facilities to reveal the differences in the visual characteristics in the first tunnel and the second tunnel entrance sections. It is found that the IPACR shows a steep inverted V-shape structure in the range of 0-100m at the tunnel entrance...

    Evaluation of the effect of edge rate marking within tunnel clusters based on the VIKOR method

    Zhiming Li, Shunying Zhu, Qing Fu, Xiaowei Xue & Siyuan Li

    To investigate whether edge rate marking is less effective due to driver adaptation and improvement in the tunnel cluster, this study selected the second intermediate section of the Sun-Liu Tunnel Cluster on the Three Gorges Over Dam Expressway in Hubei Province. A real vehicle test was carried out, and vehicle trajectory data was collected using radar. The driver's Pupil Research diameter was measured using ocular kinesiology. The speed, acceleration, lateral offset and Pupil Research diameters were compared before and after the marking. The experimenta...

    The association between gaze behavior and parabadminton serves accuracy

    Igor Carvalho, Eduardo Carpinelli, Saulo Melo, Marcelo Haiachi, Simone Santos & Carla Guimarães

    This study aims to determine the relationship between gaze behavior and serve accuracy in parabadminton athletes under training conditions. Fifteen parabadminton athletes ranked among the top ten in the world participated in the study, including 9 females (33 ± 11,96 years); and 6 males (27,16 ± 9,51 years). The athletes performed 20 consecutive serves on each side of the court, for a total of 40 executions. Gaze behavior data was collected using the Tobii Glasses 2 eye tracking system. A linear mixed-effects model was used to assess the correlation betw...

    Video‐Based Evaluation of Checklist Adherence on a Neonatal Intensive Care Unit: A Prospective Observational Study

    Lisa Kessler, Hannah Schwarz, Katharina Bibl, Robyn Dvorsky, Andrea Lietz, Lena Strasser, Vanessa Roth, Moritz Haderer, Katrin Klebermass‐Schrehof, Tobias Werther, Angelika Berger & Michael Wagner

    AimSuccessful procedural performance in a Neonatal Intensive Care Unit (NICU) depends on skill performance and preparation. Checklists are beneficial, and video reviewing enhances adherence to guidelines. This study assessed whether video recordings can be used to assess checklist deviations, the extent to which proceduralists (doctors from 1 to ≥ 6 years of experience) deviate from checklists, and whether video recordings can help to improve existing and create new checklists.MethodsIn this single‐center study at the tertiary NICU of the Medical Univers...

    Evaluation of the comprehensive effectiveness of specific new combination of sight-guiding facilities at tunnel exit sections

    Si-yuan Li, Hong Wang, Shun-ying Zhu, Qing Fu & Zhi-ming Li

    To investigate the comprehensive impact of a specific new combined line-of-sight induction facility on drivers' visual characteristics and driving behavior at the tunnel exit, the Yunling Tunnel on the Shiyan–Mianyang Expressway was selected as the test object. Sixteen licensed drivers were recruited, and real-vehicle tests were conducted to collect data on visual characteristics and vehicle operating characteristics. Five key indicators—Pupil Research diameter variation rate, fixation time, speed standard deviation, acceleration, and lateral lane offset...

    Effects of edge-rate markings on driving behavior in the middle section of a freeway tunnel

    Qing Fu, Shun-ying Zhu, Si-yuan Li, Zhi-ming Li, Jing-an Wu & Xiao-wei Xue

    In order to investigate the influence of edge rate marking on driving behavior in the middle section of the tunnel, this study takes the middle section of Sunjiawan Tunnel and Liujiawan Tunnel of the Three Gorges Over Dam Expressway in Hubei Province as the target, recruits 30 drivers to carry out a real vehicle test, and collects eye movement data and traffic flow data. By constructing an evaluation system containing five indicators: gaze point distribution, Pupil Research diameter, speed, acceleration and horizontal offset, and using the comprehensive ...

    Nuisance is Better Than Nothing?: Exploring How Pedestrians and Cyclists Perceive Automated E-Scooter Alerts in Shared Spaces MHMI023

    Hiruni Nuwanthika Kegalle, Danula Hettiachchi, Jeffrey Chan, Flora D. Salim & Mark Sanderson

    Electric scooters (e-scooters) offer flexible urban mobility but raise safety concerns in shared spaces. This study investigates how e-scooters can better communicate their presence to pedestrians and cyclists in shared active mobility environments. A focus group with e-scooter riders identified notifying others of arrival as a key challenge. To address this, we co-designed audio and visual alerts in a participatory workshop and evaluated them in a real-world Wizard of Oz (WoZ) study involving live encounters. WoZ self-report data showed that voice and b...

    The Role of Game Controllers in Visual Attention and Performance During Gameplay: An Eye-Tracking Study

    Sofie Bronfield, Synnøve Løtveit Lone, Mussie Estifanos Ghebremichael, Frode Volden & Yavuz Inal

    We examined how visual attention and performance in gaming are influenced by different input methods in a Tetris game, focusing on comparing the two most common interaction modalities: keyboard and mouse. We collected data using an eye tracker and a questionnaire. The study results showed that familiarity with the Tetris game universe had a significant impact on participants’ in-game performance. When using the keyboard, participants achieved higher scores and spent the most time in the area where they decided to put the blocks correctly. In contrast, th...

    Enhancing Efficiency in Medical Simulations: The Impact of Objective Feedback on User Interface Design

    Ava Knaf, Sanaz Motamedi, Jason Z. Moore & Scarlett R. Miller

    Despite central venous catheterization being a very prominent procedure, a significant portion of patients still experience complications. These complications are directly linked to the physician’s experience. To combat this problem, more advanced training is needed for residents. However, due to the mandated limited work hours of residents, the training needs to be efficient. The goal of this paper is to identify how the addition of real-time and post-performance feedback to a training Simulator setup increases the efficiency of learning. Results show t...

    Computer-Aided Process Planning Based on Acquired Skills Related to Workpiece Materials

    Ryo Hamanaka, Eisuke Sogabe & Keiichi Nakamoto

    The quality and time of the machining process are highly affected by process planning, which determines process parameters such as the operation sequence and machining method. However, process planning remains largely dependent on the skills of operators. Thus, currently, skill transfer is an urgent challenge because the number of skilled operators capable of process planning is decreasing rapidly. In our previous study, skills were identified from interviews by obtaining gaze data of skilled operators when examining mechanical drawings of two different ...

    The Investigation of Visual Characteristics of High‐Speed Railway Drivers: Perspectives of Light Environment

    Qain Li, Ming Guo, Long Ye, PengFei Li, Jing Luan & Boyu Liu

    High‐speed railway (HSR) operations heavily rely on visual inputs, yet there is a notable gap in examining how HSR drivers adjust their eye movements in response to different lighting conditions, despite the pivotal role visual cues play in such environments. This investigation employed a Tobii Nano eye‐tracker to capture the visual behaviors of HSR drivers during simulated driving exercises. It centered on 4 areas of interest (AOIs): the front window, prompt area, dashboard, and speed dial. By using Train Sim World 3, we created 3 scenes (open section, ...

    Attention Allocation and Gaze Behavior While Driving: A Comparison Among Young, Middle-Aged and Elderly Drivers

    Anamarija Poll, Tomaž Tollazzi & Chiara Gruden

    In 2023, 95.5 million Europeans were aged over 65, falling within the definition of the “elderly population”. According to statistics, this number will rise to 129.8 million by 2050, making Europe the oldest continent in the world. One of the consequences of such growth is a sharp increase in the number of elderly drivers. Although they have more experience, which can positively impact road safety, their performance and health generally decline, limiting some of the physical and mental abilities required for safe vehicle control. The main objective of th...

    A Bayesian Network Approach for Modeling Resident Physician

    David Prendez, Veronika Kettel, Elizabeth Higgins, Jiaxin Li, Younghoon Kwon, Victoria Roach & Ji-Eun Kim

    , the ability to sustain attention, is critical in healthcare, yet resident physicians face significant sleep deprivation, increasing their risk of decrement and medical errors. This study aimed to develop a predictive model of in this population using contextual factors, physiological measures, and eye-tracking data. Fifteen resident physicians participated in psychomotor tests (PVT) under sleep-deprived and non-sleep-deprived conditions, and completed questionnaires assessing sleep, anxiety, and workload. Bayesian Networks (BN) were employed to model ,...

    How We Type with Word Suggestions: Understanding Visual Attention and Checking Behavior during Mobile Text Input

    Yang Li & Anna Maria Feit

    Word suggestions are commonly used when people type on mobile devices. However, how users adjust their typing behavior and visual attention to integrate the use of word suggestions and whether they are effective in doing so remains unclear, mainly due to the lack of gaze data in realistic settings. In this paper, we conduct an eye-tracking study of word suggestion users transcribing and composing text on their own phones and keyboards. Our analysis reveals that users frequently checked the suggestion list without picking a suggestion, yielding a 68% fail...

    Visual Cue Processing and Scanning Efficiency in Decision-Making of Expert and Novice Nurses During Rapid Patient Deterioration

    Haozhi Chen, Nicholas E. Anton, Bowen Zheng, Tera Hornbeck, Matthew Scanlon & Denny Yu

    This study investigates how clinical experience shapes nurses’ visual cue-gathering during acute patient deterioration. Using wearable eye-trackers, expert and student nurses’ visual behaviors were analyzed across pre- and post-deterioration phases in a simulated patient care scenario. Expert nurses fixated more on clinically relevant areas and exhibited more focused, sequential gaze patterns. In contrast, student nurses displayed greater fixation variability and higher gaze transition entropy, indicating less efficient scanning and increased cognitive l...

    Gaze Attention Predicts Emotional Convergence in Group Video Calls

    Erik van Haeringen & Charlotte Gerritsen

    Emotions are contagious, yet empirical knowledge on how they spread in groups is limited. A better understanding could help optimize social environments and benefit models predicting group affect. This study investigates how gaze attention affects emotional convergence in group video calls. Building on previous research that identified emotion contagion in competitive teams, we incorporated eye-tracking to analyse gaze direction and its relation to emotional responses. Results indicate the expressions of participants converged towards (1) the average emo...

    Does Feedback Based on Gaze and Stress Indicators Help Novice Programmers?

    Anahita Golrang & Kshitij Sharma

    Multimodal learning analytics have significantly improved our understanding of learning processes. One of the most discussed advantages of multimodality is the holistic view of the learning processes. In this contribution, we explore whether giving feedback based on multimodal analytics benefits learners. We designed and developed a novel system that collects learners’ eye-tracking and heart rate variability data while they debug a given code. The system computes the cognitive load from the eye-tracking data and physiological stress from the heart rate v...

    Brain–computer interface control with artificial intelligence copilots

    Johannes Y. Lee, Sangjoon Lee, Abhishek Mishra, Xu Yan, Brandon McMahan, Brent Gaisford, Charles Kobashigawa, Mike Qu, Chang Xie & Jonathan C. Kao

    Motor brain–computer interfaces (BCIs) decode neural signals to help people with paralysis move and communicate. Even with important advances in the past two decades, BCIs face a key obstacle to clinical viability: BCI performance should strongly outweigh costs and risks. To significantly increase the BCI performance, we use shared autonomy, where artificial intelligence (Artificial Intelligence) copilots collaborate with BCI users to achieve task goals. We demonstrate this Artificial Intelligence-BCI in a non-invasive BCI system decoding electroencephal...

    RTFnet: A multi-modal physiological data fusion approach for fatigue detection in remote tower controllers

    Zirui Yin, Zirui Yin, Zirui Yin, Weijun Pan, Shaoquan Ni, Shaoquan Ni, Shaoquan Ni, Yuanjing Huang, Xin Wang, Xin Wang, Xin Wang, Xia Zhao, Xia Zhao, Xia Zhao, Kun Liu, Kun Liu & Kun LiuAdvanced Engineering Informatics

    Remote towers, as a groundbreaking air traffic control technology, significantly alter the workflows and task loads of controllers, which may exacerbate mental fatigue. Unlike traditional towers, remote tower controllers (RTCos) operate with less direct interaction with aircraft and more reliance on remote monitoring systems, creating unique challenges in detecting and managing their fatigue. Existing methods are insufficient for accurately monitoring RTCos’ status, making it difficult to prevent human errors that could compromise aviation safety. To add...

    Achieving Cultural Heritage Sustainability Through Digital Technology: Public Aesthetic Perception of Digital Dunhuang Murals

    Yuxin Chen, Yuxin Chen, 2022021721@m.scnu.edu.cn,, 2022021727@m.scnu.edu.cn,, Yuxian Peng, Yuxian Peng, 2022021721@m.scnu.edu.cn,, 2022021727@m.scnu.edu.cn,, Yuanjun Tan, Yuanjun Tan, 2022021721@m.scnu.edu.cn,, 2022021727@m.scnu.edu.cn,, Guang Luo, Guang Luo, 2022021721@m.scnu.edu.cn,, 2022021727@m.scnu.edu.cn, & Min WangSustainability

    Against the backdrop of rapid digitization of cultural heritage, assessing the public’s genuine perception of digital heritage has become a critical issue in the study of cultural sustainability and communication. This study takes the “Digital Dunhuang Museum” exhibition in Guangzhou as a case, focusing on the differences and underlying mechanisms in public aesthetic perception of digital Dunhuang murals. Integrating eye-tracking experiments, subjective image evaluations, and semi-structured interviews, the research innovatively introduces multimodal vis...

    Dual-phase effects of emotional music on driving fatigue: delay and awakening revealed by Pupil Researchlometry

    Zhigang Hu, Kejin Li, Yi Cui & XiArchitecture and Navigationu ShangFrontiers in Psychology

    This study investigated the effects of different emotional background music on driving fatigue through a 60-min simulated driving experiment. The research employed a dual-phase design (0-40 min fatigue-delaying phase and post-40 min fatigue-awakening phase) with three auditory conditions: positive music, negative music, and no background music (driving noise only). Pupil Research diameter variation coefficient and average blink rate were used as objective fatigue evaluation metrics. The results demonstrated that when different emotional background music ...

    Visual and Pupil Researchlary Behavior in Neonatal Pain Assessment using Eye-Tracking

    Roberto Goncalves de Magalhaes, Rafael Nobre Orsi, TatiMarcondes Heiderich, Marina Carvalho de Moraes Barros, Ruth Guinsburg & Carlos Eduardo ThomazIEEE Latin America Transactions

    This paper introduces the application of novel eyetracking metrics to assess visual attention and cognitive load in neonatal pain assessment. Our goal is to evaluate pediatrician experts, non-experts, and parents using the relative Explore- Exploit Ratio, along with the Task-Evoked Pupil Researchlary Response, while analyzing the frontal faces of distinct newborns before and after painful procedures. All the experiments were based on a benchmark image dataset considering clinically relevant areas of interest. The Tobii TX300 system was used to record the...

    SenseSeek Dataset: Multimodal Sensing to Study Information Seeking Behaviors

    Kaixin Ji, Danula Hettiachchi, Falk Scholer, Flora D. Salim & Damiano SpinaProceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies

    Information processing tasks involve complex cognitive mechanisms that are shaped by various factors, including individual goals, prior experience, and system environments. Understanding such behaviors requires a sophisticated and personalized data capture of how one interacts with modern information systems (e.g., web search engines). Passive sensors, such as wearables, capturing physiological and behavioral data, have the potential to provide solutions in this context. This paper presents a novel dataset, SenseSeek, designed to evaluate the effectivene...

    ReplEye: An Open-Source Pipeline for Gathering, Analyzing, and Replaying Eye-Tracking Data with MRTK

    Deyrel Diaz, Samaneh Zamanifard, Matias Volonte & Andrew T. DuchowskiLecture Notes in Computer ScienceExtended Reality

    We present an open-source pipeline for eXtended Reality (XR) that helps researchers and developers integrate eye-tracking metrics into their studies. Built with the Microsoft Mixed Reality Toolkit 3 (MRTK3) and Unity, this pipeline enables recording, replaying, and analyzing gaze data on virtual humans, static objects, and dynamic targets. The pipeline includes demo environments with pre-defined Areas of Interest (AOIs), scripts for extracting head-mounted display (HMD) and eye-tracking data to CSV files, and an R-based analysis script for analyzing firs...

    Does brain connectivity hold the key to safer roads? EEG-based fatigue detection in young drivers using interpretable deep learning

    Yongjiang Zhou, Yang Cao, Hyungchul Chung, Hanying Guo, N.N. Sze & Tiantian ChenAccident Analysis & Prevention

    Mental fatigue is a significant risk factor for fatal road accidents among young drivers, but its underlying neural mechanisms are still poorly understood. To fill this gap, we explored the neurophysiological basis of driver fatigue using electroencephalography (EEG)-based brain connectivity analysis and designed an accurate, interpretable detection model specifically for young drivers. We collected EEG data from 32 young drivers on real roads and compared them with data obtained in a simulated laboratory environment to verify their reliability. The EEG ...

    Kaiwu: A Multimodal Manipulation Dataset and Framework for Robot Learning and Human-Robot Interaction

    Shuo Jiang, Shuo Jiang, Shuo Jiang, Haonan Li, Haonan Li, Haonan Li, Ruochen Ren, Ruochen Ren, Ruochen Ren, Yanmin Zhou, Yanmin Zhou, Yanmin Zhou, Zhipeng Wang, Zhipeng Wang, Zhipeng Wang, Bin He, Bin He & Bin HeIEEE Robotics and Automation Letters

    Cutting-edge robot learning techniques including foundation models and imitation learning from humans all pose huge demands on large-scale and high-quality datasets which constitute one of the bottleneck in the general intelligent robot fields. This paper presents the Kaiwu multimodal dataset to address the missing real-world synchronized multimodal data problems in the sophisticated assembling scenario, especially with dynamics information and its fine-grained labelling. The dataset first provides an integration of human, environment and robot data coll...

    Image-analysis-based method for exploring factors influencing the visual saliency of signage in metro stations

    Mengya Yin, Mengya Yin, Mengya Yin, Xilin Zhou, Qunfeng Ji, Huairen Peng, Shize Yang & Chuancheng LiCognitive Systems Research

    Mstudies have been conducted on the effects of color, light, and signage location on the visual saliency of underground signage. However, few studies have investigated the influence of indoor visual environments on the saliency of pedestrian signage. To explore the factors that influence the visual saliency of signage in metro stations, we developed a novel analysis method using a combination of saliency and focus maps. Then, questionnaires were utilized to unify the various formats of results from the saliency and focus maps. The factors that influence ...

    Integrating emotional intelligence, memory architecture, and gestures to achieve empathetic humanoid robot interaction in an educational setting

    Fuze Sun, Fuze Sun, Lingyu Li, Shixiangyue Meng, Xiaoming Teng, Terry R. Payne & Paul CraigFrontiers in Robotics and Artificial Intelligence

    This study investigates the integration of individual human traits into an empathetically adaptive educational robot tutor system designed to improve student engagement and learning outcomes with corresponding Engagement Vector measurements. While prior research in the field of Human-Robot Interaction (HRI) has examined the integration of the traits, such as emotional intelligence, memory-driven personalization, and non-verbal communication, by themselves, they have thus-far neglected to consider their synchronized integration into a cohesive, operationa...

    • SDK

    Bio-inspired optofluidic focus-tunable imaging system with large two-dimensional field-of-view tuning capability

    Jianming Lv, Huajie Hong, Meng Zhang, Zihao Gan, Zhaoyang Liu, Zhuoqun Hu & Minghao YangMeasurement

    Technological advances in smart materials and various new drive methods have contributed to the development of two-dimensional (2D) scanning focusable systems. An all-optical fluidic component forms the basis of a bionic optical focusable imaging system was proposed. The system exhibits a wide range of 2D field-of-view (FOV) tuning capability, and its design draws inspiration from the structure of the human eye, with the objective of achieving wide-range 2D scanning focusable imaging. The static optical tuning range is up to 35 . 6 ° and the wedge-angle ...

      Set-up of an experimental protocol to analyse physiological signals during autonomous driving in a dynamic driving Simulator setup

      Giulia Mengucci, Giulia Mengucci, Antonio Cioffi, Manuela Galli, Stefano Melzi & Gisella TomasiniTransportation Research Interdisciplinary Perspectives

      Advancements in autonomous vehicle technology continue to progress rapidly, but concerns regarding public acceptance persist. Traditional studies have used questionnaires to assess social acceptance, but these have limitations. To gather more reliable data, tracking physiological signals offers a promising alternative. This study aims to develop and test an experimental protocol to assess human acceptance of autonomous driving by using both objective measures - i.e.: Electroencephalogram (EEG), Electrocardiogram (ECG), Skin Potential Response (SPR), and ...

      Influence of ADAS on Driver Distraction

      Gaetano Bosurgi, Stellario Marra, Orazio Pellegrino, Giuseppe Sollazzo & Alessia RuggeriVehicles

      In recent years, research into smart roads has moved from the purely theoretical phase of initial experiments to an increasing number of applications on new or existing roads. However, a high level of digitization in terms of available equipment may lead to a decrease in driving performance and, consequently, have a negative impact on safety. The aim of this study is to define a procedure to determine the impact of these technologies by analyzing the visual behavior of the driver, in order to refine the on-board devices in case of negative feedback. The ...

        Using Interactive Maps to Reveal the Content of Second-Order Climate Change Beliefs

        Eliza Merritt, David Retchless, Bhuwan Thapa & Johnathan SuggCartographic Perspectives

        Although there is extensive research on first order climate change beliefs, second-order beliefs (perceptions about what others believe) are an understudied and potentially highly influential factor tied to a lack of climate policy action. This map reading study employs a pre- and post-map observational design to investigate how interactive maps can reveal and update second-order climate change beliefs. Participants first completed a pre-map survey detailing their climate change beliefs and estimating public support for climate policies. Participants the...

        Objective data-driven insights into pedestrian decisions, comprehensibility, and perceived safety of autonomous vehicles with varied eHMIs: Evidence from a real-world experiment

        Tianpei Tang, Tianpei Tang, Bang Luo, Wei Wang, Xiaofan Xue, Shengnan Zhao & Yuntao GuoAccident Analysis & Prevention

        In future traffic environments dominated by highly autonomous vehicles (AVs), pedestrians may face challenges in accurately interpreting AV behavior, thereby potentially increasing the risk of pedestrian-AV interactions. External human-machine interfaces (eHMIs) have been proposed to facilitate communication between AVs and pedestrians; however, comprehensive evaluations using objective data from real-world interactions are limited. This study developed a systematic evaluation framework grounded in the ISO 9241-11 standard, integrating four key indicator...

        Research on understandability & cognitive load equilibrium of human-machine interface under time pressure

        Yuming Ma & Hao YaoDisplays

        Static gaze entropy (SGE) and gaze transition entropy (GTE) are quantitative methods for analyzing cognitive load on human–machine interfaces. However, for the grade of automation 2(GoA2) mode of subway train driving human–machine interfaces, drivers need to quickly search and perceive the operation status of all devices displayed on the human–machine interface within a limited time. This visual search behavior is contradictory to the gaze point concentration required by SGE. At the same time, the time pressure generated by the limited time further incre...

        Video entertainment to mitigate safety risks during prolonged automated driving: Impacts on cognitive load, fatigue, and takeover performance

        Jun Ma, Jun Ma, Lizhuo Zang, Jiateng Li, Zaiyan Gong, Yue Fei & Jin LuApplied Ergonomics

        As vehicles are expected to shift from manual to automated driving, the role of human drivers changes from active control to passive supervision. However, prolonged disengagement from the driving task may induce passive task-related (PTR) fatigue, which may negatively impact takeover performance. The present study sought to investigate whether video entertainment during prolonged automated driving can mitigate these risks. A driving simulation experiment was conducted with 32 participants who experienced varying durations of automated driving time (ADT) ...

        Social anxiety and eye avoidance during virtual communication: Evidence from an eye-tracking study

        Nurerina Hanizam, Hafidah Umar, Asma Perveen, Mohd Zulkifli Mustafa & Faiz MustafarJournal of Cognitive Sciences and Human Development

        Despite evidence linking social anxiety to atypical gaze behaviours, its manifestation during virtual communication remains unclear. Using a quasi-experimental between-group design, this study examined the effect of social anxiety levels on gaze behaviour among 55 participants with high or low social anxiety symptoms. The participants' eye movements were recorded during the virtual communication task using the Tobii Pro Fusion eye-tracking system. The analysis focused on six eye-movement measures across four predefined areas of interest. The findings rev...

        Psychophysiological impacts of working with powered exoskeletons on construction sites

        Amit Ojha, Shayan Shayesteh, Yizhi Liu, Houtan Jebelli & Abiola AkanmuAutomation in Construction

        Powered exoskeletons are aimed at enhancing user strength and minimizing physical strain to prevent work-related musculoskeletal injuries. However, their widespread adoption within the construction sector remains limited, primarily due to uncertainties about their psychophysiological impacts, such as potential cognitive overload, trust issues, and changes in attention levels. To tackle these concerns, this paper sets out to empirically assess the psychophysiological risks associated with using powered exoskeletons during construction tasks. An immersive ...

        • Tobii VR

        Enhancing Human-Artificial Intelligence perceptual alignment through visual-haptic feedback system for autonomous drones

        Jiahao Wu, Bowen Sun, Hengxu You & Jing DuInternational Journal of Industrial Ergonomics

        Artificial Intelligence (Artificial Intelligence) has emerged as an effective agent for controlling autonomous drones in navigation and target search tasks across various applications with minimal human intervention. Despite their advantages, significant challenges exist in aligning human operators' perceptual understanding with autonomous drone Artificial Intelligence's assessment of environmental changes, particularly in dynamic and complex urban settings. This study addresses this issue by proposing a human-machine sensory sharing system that integrat...

        • Tobii VR
        • SDK

        Baywatch in the Laboratory—Differences in Visual Surveillance Between Lifeguards and Non‐Lifeguards

        Pieter Vansteenkiste, Jan G. Bourgois & Matthieu LenoirJournal of Experimental Psychology Applied

        Quickly recognizing distress and drowning is an essential skill for lifeguards. Unfortunately, it is unclear to what extent visual behavior contributes to the ability of a lifeguard to detect hazardous aquatic situations. Twenty‐four non‐lifeguards and twenty‐four beach lifeguards watched two 15‐min clips filmed from the perspective of a beach lifeguard. Participants were instructed to press the spacebar if they would undertake an action, and call out why they reacted. No difference in the number of reactions or average fixation duration was found betwee...

        Steering in the dark: The impact of environmental luminance on driver behavior through optical flow analysis

        Jiangtong Li, Jie Wang, Kang Song & Yi Xiao

        The visual perception and steering behavior of drivers are known to be influenced by environmental lighting, but the underlying perception mechanisms, particularly the role of optical flow under low-luminance conditions, remain insufficiently understood. In a simulated driving experiment, 32 participants were exposed to five controlled luminance levels while their eye movements and driving performance were recorded. The results indicate that lower environmental luminance leads to prolonged gaze duration, a wider distribution of gaze points, and an increa...

        Objective and Subjective Evaluation of Non-Technical Skills and Technical Leadership Skills During Simulated Critical Care Scenarios

        Matthew Ball, Patrick Fuller, Corbin Goodwin, Nicholas Anton, Dimitrios I. Athanasiadis, Edward Hernandez, Dimitrios Stefanidis, Denny Yu & Jackie S. Cha

        Occupational ApplicationsThe analysis of communication, attention, and cognitive engagement relative to leadership and non-technical skills (NTS) is important for understanding the team dynamic within clinical settings. We found negative correlations between passive communication (receiving information instead of dictating information) and leadership scores, suggesting that passive leadership traits lead to weaker technical leadership performance. Additionally, continuously sharing goals and providing affirmations to patients had positive relationships w...

        Exploring the impact of display types of information about autonomous driving in semi-autonomous vehicles on drivers’ situation awareness and take-over performance under different driving scenarios

        Chengmin Zhou, Jake Kaner & Yuxuan LuoSoftware and Systems Modeling

        With the advent of the era of autonomous driving, designing an effective and appropriate autonomous driving information display is crucial for ensuring driving safety. Head-up Display (HUD) is regarded as a promising way for presenting in-vehicle information in the future. This study conducted a simulation experiment to explore the impacts of three types of autonomous driving information displays on HUD on Situation Awareness (SA) and take-over performance, while considering the complexity of different driving scenarios. The experiment used in this study...

        Changes in Visual Attention Allocation During Psychomotor Skill Training in Laparoscopic Surgery: A Longitudinal Eye Tracking Study

        Jinwoo Oh, Nathan Lau, Sarah Henrickson Parker & Shiyu Deng

        This study examines how visual attention evolves with performance and differs by learning rate in a simulated laparoscopic task. Eye-gaze data were collected from twenty-nine novices recruited to practice the peg transfer task in the Fundamentals of Laparoscopic Surgery program until reaching proficiency or completing six training sessions. Results suggested that participants increasingly directed their gaze toward future target locations as their completion time decreased. Participants who became proficient sooner exhibited earlier and more frequent use...

        Eye-tracking metrics to compare visual attention in prosthodontic preclinical evaluations

        Abhishek Kumar, Anastasios Grigoriadis, Frédéric Silvestri & Maria Christidis

        AimThe study aimed to evaluate gaze behavior during tooth preparation assessments by analyzing and comparing eye-tracking metrics between novice and expert groups.MethodsThirty-five participants, divided into novices (n = 18, mean age = 22.9 ± 1.5 years) and experts (n = 17, mean age = 44.3 ± 13.1 years), were recruited for this observational study. The novice group consisted of third-year dental students, while the expert group comprised licensed dentists with an average of 18.9 ± 12.7 years of clinical experience. Eye-tracking metrics, including total ...

        Driving Behavior of Older and Younger Drivers in Simplified Emergency Scenarios

        Mingming Dai, Shouqiang Xue & Yun XiaoAdvances in Autism

        This study focuses on exploring the differences in driving abilities in emergency traffic situations between older drivers (aged 60–70) and young drivers (aged 20–35) in a simple traffic environment. Two typical emergency scenarios were designed in the experiment: Scenario A (intrusion of electric bicycles) and Scenario B (pedestrians crossing the road). The experiment employed a driving simulation system to synchronously collect data on eye movement characteristics, driving behavior, and physiological metrics from 30 drivers. Two-factor covariance analy...

        Single-Blind Examination of Rural Healthcare Provider Situation Awareness to a Novel Wearable Device for Patient Safety and Care Management

        Bernadette McCrory, Elizabeth A. Johnson, Jiahui Ma, Kaitlyn Benner & Lea Lisa Molnar

        Background: Effective communication between research and clinical care teams is essential for ensuring clinical trial participant safety. Current methods, such as paper documents and electronic health records are inconsistently used and poorly standardized. This study evaluated a prototype wearable device, TrialWear, designed to passively convey trial-related safety information during patient assessments. Methods: In a simulated emergency setting, 14 nurses conducted patient assessments while wearing eye-tracking glasses. Results: The majority ...

        Assessing driver reactions to emergency navigation prompts in head-up displays

        Maximilian David, Dirk Kemper, Martin Baumann & Alvaro Garcia-HernandezIEEE Transactions on Visualization and Computer Graphics

        This study examines the effectiveness of warning messages via Head-up displays (HUDs) that provided navigation-based evasion instructions in enhancing driver performance and safety during critical traffic events. A dual-method approach was employed, combining an online survey with a driving Simulator setup study. The online survey evaluated drivers' initial reactions to different visual HUD designs, such as directional arrows, lane markings, and textual cues, within a simulated emergency scenario. The insights gained from the survey were used to identify...

        Gender Differences in Visual Perception of Park Landscapes Based on Eye-Tracking Technology: A Case Study of Beihai Park in Beijing

        Guaini Jiang, Shangwu Cao, Si Chen, Xin Tian & Min Cao

        Previous landscape design mostly relies on general standards, failing to fully consider gender differences in landscape visual perception, with relevant research still needing further exploration. This study takes Beijing’s Beihai Park as the research object, using five types of on-site-collected photos (water landscape, plant landscape, architectural landscape, path landscape, and square landscape) as stimuli. Twenty males and twenty females participated in an eye-tracking experiment and a questionnaire survey to analyze gender differences in the visual...

        Attitude-driven visual cognition under conflict: an eye-tracking study in an architectural restoration context

        Zihao Cao, Linqi Huang, Muhizam Mustafa, Mohd Hafizal Mohd Isa & Yongchun Mao

        Heritage restoration often provokes polarized debates, yet limited research has examined how individual attitudes towards conservation influence visual behaviour and cognitive processing when confronted with conflicting restoration narratives. This study integrates eye-tracking technology with Lag Sequential Analysis (LSA) to compare participants with high versus low conservation attitudes. Eye-tracking metrics revealed distinct patterns of attention distribution and sequential transitions between defined Areas of Interest (AOIs). Participants with stron...

        Effects of patient-facing visualisations on the comprehension of personal health records among young and middle-older aged adults: an eye-tracking study

        Da Tao, Wenjie Zhang & Mingfu Qin

        Digital personal health records (PHRs) are increasingly accessed by users, but how they should be presented to facilitate user comprehension is yet to be determined. We examined the effects of patient-facing visualisations on user comprehension of PHRs with eye-tracking techniques. A three-factor mixed design was used, with age as a between-subjects factor, and visualisation type and visualisation status as within-subjects factors. Both young and middle-older aged adults performed a series of comprehension tasks with PHRs presented by four visualisation ...

        Asymmetrical Commuting in Automated Vehicles: Effects of the Perceived Value of Nondriving-Related Tasks and Commuting Direction Expectations on Takeover Performance and Driving Experience

        Jingyu Pang, Lubing He & Xingchen Zhou

        Conditional automated driving allows drivers to perform various nondriving-related tasks (NDRTs) during commutes. This study explores how commuting direction expectations and perceived values of NDRTs impact takeover performance. We conducted a 2 × 2 mixed-design driving simulation experiment involving 64 participants, with the perceived values of NDRTs (hedonic vs. utilitarian) as a within-subject variable and commuting direction expectations (outbound vs. inbound) as a between-subject variable. The key findings include: (1) Hedonic NDRTs caused more co...

        Addressing disorientation in endoscopy: A study on mental rotation difficulty and its impact on cognitive load measured by Pupil Researchlary response

        Yuzhang Li, Khadija Hasan, Wenmin Yu, Xingyu Lai & Bin Zheng

        Objectives One of the most notable challenges in endoscopic procedures is maintaining correct orientation. Mental rotation exercise (MRE) has been suggested as a potential aid for improving orientation. However, there is a lack of research on designing MREs with varying difficulty levels for training purposes. Furthermore, few studies provide solid evidence linking MRE difficulty with cognitive load measurements. This study aims to address this gap by investigating the correlation between the difficulty of MRE and participants’ cognitive load, as measure...

        Waste not, want not: enhancing household participation in pharmaceutical waste recycling from the prospective of information adoption model and message framing

        Bin-Xiu Xu, Yi Ding & Ying Li

        Household pharmaceutical waste (HPW) poses a significant environmental and health threat due to the presence of active pharmaceutical ingredients, such as antibiotics and hormones, as well as heavy metals like lead and mercury. While centralized recycling and chemical processing systems offer safe and effective solutions for HPW management, public participation in these initiatives remains low. This lack of engagement can be attributed to insufficient information about the HPW recycling process, leading to confusion and uncertainty regarding appropriate ...

        Investigating the Feasibility of Using Eye-Tracking Metrics as\xa0Indicators of Situation Awareness in Flight Training

        Ruiheng Lan, Xu Sun, Qingfeng Wang & Bingjian Liu

        Assessing pilot trainees’ Situation Awareness (SA) is critical for aviation safety and efficiency. This study aimed to evaluate the effectiveness of three distinct eye-tracking metrics, gaze-based metrics, gaze patterns, and gaze entropy, in measuring the SA levels of pilot trainees. A between-subject experiment compared two trainee groups: one received standard training, and the other received training enhanced with vibrotactile feedback. Participants’ eye movements were recorded using wearable eye-tracking glasses before and after training. The experim...

        Material Perception in Virtual Environments: Impacts on Thermal Perception, Emotions, and Functionality in Industrial Renovation

        Long He, Minjia Wu, Yue Ma, Di Cui, Yongjiang Wu & Yang Wei

        Industrial building renovation is a sustainable strategy to preserve urban heritage while meeting modern needs. However, how interior material scenes affect users’ emotions, thermal perception, and functional preferences remains underexplored in adaptive reuse contexts. This study used virtual reality (VR) to examine four common material scenes—wood, concrete, red brick, and white-painted surfaces—within industrial renovation settings. A total of 159 participants experienced four Lumion-rendered VR environments and rated them on thermal perception (visua...

        • Tobii VR

        Leveraging Eye Movement for Instructing Robust Video-based Facial Expression and Emotion Recognition

        Yuanyuan Liu, Lin Wei, Kejun Liu, Zijing Chen, Zhe Chen, Chang Tang, Jingying Chen & Shiguang ShanIEEE Transactions on Affective Computing

        Video-based Facial Expression and Emotion recognition (VFER) is challenging due to variations caused by cultural background and expression camouflage. To tackle these problems, researchers introduced eye movement signals to complement visual information. However, existing methods either require expensive devices to capture high-quality eye movements or can only extract low-quality eye movements visually, making them ineffective in the real world. To address this, we propose an eye movement-instructed VFER (EM-VFER) that leverages high-quality eye movemen...

        Effects of different visual styles on elderly users’ interaction behavior in smart sofa interfaces

        Jiayu Tang, Xinghao Liu, Chengmin Zhou & Jake KanerBioResources

        The usability of wood-based smart furniture interfaces for elderly users remains a critical challenge in aging-in-place solutions. This study aims to explore the most effective visual presentation styles of sofa illustrations in the smart sofa mobile app interface, with the goal of reducing cognitive load and enhancing the interaction experience for elderly users. To achieve this, we evaluated the cognitive responses of elderly users to different visual presentation styles through eye-tracking experiments and correctness analysis. As the results show, th...

        Predicting Cartographic Symbol Location with Eye-Tracking Data and Machine Learning Approach

        Paweł CybulskiJournal of Eye Movement Research

        Visual search is a core component of map reading, influenced by both cartographic design and human perceptual processes. This study investigates whether the location of a target cartographic symbol-central or peripheral-can be predicted using eye-tracking data and machine learning techniques. Two datasets were analyzed, each derived from separate studies involving visual search tasks with varying map characteristics. A comprehensive set of eye movement features, including fixation duration, Saccade Research amplitude, and gaze dispersion, were extracted ...

        A Design Study on Contextual and Interactive Serious Games for Children’s Learning of Chinese Character Culture

        Lanqi Xu, Yifan Zhang, Xu Lang, Jianing Liu, Xianxuan Lin, Jing Zhang, Zheng Wang, Baiheng Liu & Tianming WuLecture Notes in Computer ScienceComputer Animation and Social Agents

        The complexity of Chinese characters and their cultural connotations pose challenges to children’s cognitive development. Traditional teaching methods, often based on repetitive practice, fail to integrate cultural context and cognitive depth, limiting their effectiveness. This study introduces the “Situational Interactive Serious Game” paradigm, which incorporates a three-dimensional cognitive framework: the “Primitive, Constructive, and Cultural Layers.” The developed system, WGIF, combines progressive tasks with the mental flow theory to enhance learn...

          Technical Test of a Dry Electrode Headset for EEG Measurement Under Microgravity

          Judith Bütefür, Mathias Trampler, Elsa Andrea Kirchner & Elsa Andrea KirchnerCommunications in Computer and Information ScienceBiomedical Engineering Systems and Technologies

          In this paper we aim to test a prototype dry electrode headset during a parabolic flight in microgravity phases. We want to investigate, whether the EEG data measured with the same system during microgravity phases of a parabolic flight have the same quality as on Earth. Therefore, we conducted a study (3 operators) with an N-back task, which can be solved under both conditions. Each operator performed the experiment with the same dry electrode headset under microgravity as well as under Earth gravity to make the data comparable. The results show that it...

          Design and Evaluation of Touchless Interaction in MRI-Guided Interventions Based on Eye-Tracking

          Junwei Liu, Yuyong Tian, Zhengxiu Wu, Hanyu Zhang, Xiaowen Jiang & Rongsheng Lu2025 17th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC)

          Magnetic Resonance Imaging (MRI)-guided interventions offer significant advantages, yet the MRI scanner environment presents multiple human-machine interaction constraints due to magnetic field conditions and sterile requirements. This study investigates the main challenges and requirements faced by physicians during MRI-guided interventions. Building on these insights, we applied eye-tracking technology to the MRI control software and designed an interaction paradigm that allows contactless interaction within the operating environment. This system allow...

            Immunization effect of inoculation messages: interventions against consensus and misinformation to improve public acceptance of recycled water

            Hanliang Fu, Yuexin Li, Zhifang Wu, Yubing Tan, Weijie He & Jian ZuoHumanities and Social Sciences Communications

            The global freshwater crisis is accelerating, posing an urgent need for sustainable water solutions. Despite its potential as a viable alternative, recycled water has yet to gain widespread public acceptance. A key barrier is the public’ low intention to use it. Grounded in inoculation theory, this study explores the mechanism through which different types of information influence public acceptance of recycled water. Using eye-tracking technology, it examines the mediating role of information reception effects. The cognitive processing involved in the in...

            Spherical Vision Transformers for Audio-Visual Saliency Prediction in 360∘ Videos

            Mert Cokelek, Mert Cokelek, Mert Cokelek, Halit Ozsoy, Halit Ozsoy, Halit Ozsoy, Halit Ozsoy, Nevrez Imamoglu, Cagri Ozcinar, Inci Ayhan, Inci Ayhan, Inci Ayhan, Inci Ayhan, Erkut Erdem, Erkut Erdem, Aykut Erdem, Aykut Erdem & Aykut ErdemIEEE Transactions on Pattern Analysis and Machine Intelligence

            Omnidirectional videos (ODVs) are redefining viewer experiences in virtual reality (VR) by offering an unprecedented full field-of-view (FOV). This study extends the domain of saliency prediction to 360$^{\circ }$ environments, addressing the complexities of spherical distortion and the integration of spatial audio. Contextually, ODVs have transformed user experience by adding a spatial audio dimension that aligns sound direction with the viewer's perspective in spherical scenes. Motivated by the lack of comprehensive datasets for 360$^{\circ }$ audio-vi...

            • Tobii VR

            A foundation model-based framework for unsupervised gaze anomaly detection

            Kritika Johari, Jung-Jae Kim, Wei Quin Yow & U-Xuan TanKnowledge-Based Systems

            Traditional gaze analysis methods for online lecture largely depend on predefined average gaze features and self-reported ground-truths, limiting their ability to obtain real-time status in unsupervised settings. To address this, we propose Gaze-READ (Gaze Representative Embedding and Anomaly Detection), a framework that integrates gaze behavior analysis with unsupervised anomaly detection to systematically identify attention shifts caused by external stimuli. Our approach leverages GazeMTM (Masked Time-Series Modeling of Gaze), which employs MOMENT, a t...

            Effects of adopting voice assistants countermeasures on alerting drowsy drivers across age

            Wei Zhang, Oliver Carsten, Courtney M Goodridge & Wei ZhangApplied Ergonomics

            Drowsy driving is one of the leading contributing factors to traffic accidents. As drivers continue driving despite being aware of their drowsy states, it is necessary to adopt active countermeasures to avoid them falling asleep behind the wheel. Based on the multiple resources model, this study proposed five countermeasure types using voice assistants (no-countermeasure vs. meaninglessly listening vs. meaningfully listening vs. repeating vs. answering) and investigated their effects on countering drowsiness for young and middle-aged drivers. A five-week...

            Are directional or non-directional hazard warnings more helpful for drivers with homonymous visual field loss?

            Yustina Kang, Yustina Kang, Alex R Bowers, Alex R Bowers, Jing Xu, Jing Xu & Jing XuApplied Ergonomics

            People with homonymous visual field loss (HVFL), the loss of vision in the same half of the visual field in both eyes, are permitted to drive in some jurisdictions. However, the HVFL may cause delayed responses to hazards from the side of their vision loss (blind side). Warnings that indicate hazard direction may be beneficial. This study compared the effects of directional and nondirectional vibrotactile warnings on gaze behaviors and driving responses to pedestrian hazards in a driving Simulator setup. Directional warnings consisted of vibrations on ei...

            • SDK

            Analysis of Employees’ Visual Perception During Training in the Field of Occupational Safety in Construction

            Wojciech Drozd, Wojciech Drozd & Marcin KowalikApplied Sciences

            The article presents the results of research on improving construction safety using the eye tracking method. The analysis was carried out during training in the field of construction safety. Eye tracker allows for analysis of the way in which training participants process visual information and elements that attract their attention and the effectiveness of learning the principles of work safety. Eye tracking studies, in the aspect of construction safety, determine the effectiveness of training in this area. Moreover, the main advantage of such studies li...

            A defensive model and implementation baseline for the metaverse and extended reality systems

            Sara Qamar, Hasan Tahir, Zahid Anwar, Naveed Ahmed, Shahzaib Tahir & Muhammad AleemPeerJ Computer Science

            The metaverse and extended reality (XR) systems are vulnerable to emerging security threats, as developers have prioritized competitive business gains over security. The virtual entities, immersive experiences, and lack of centralized governance pose significant challenges in establishing standardized guidelines for XR systems and its stakeholders. In this research, a panoramic view is presented to identify mitigation strategies and defensive capabilities, including authenticity, privacy, integrity, interoperability, virtual forensics, and incident repor...

              Effect of Dynamic Point Symbol Visual Coding on User Search Performance in Map-Based Visualizations

              Weijia Ge, Jing Zhang, Xingjian Shi, Wenzhe Tang & Longlong QianISPRS International Journal of Geo-Information

              As geographic information visualization continues to gain prominence, dynamic symbols are increasingly employed in map-based applications. However, the optimal visual coding for dynamic point symbols—particularly concerning encoding type, animation rate, and modulation area—remains underexplored. This study examines how these factors influence user performance in visual search tasks through two eye-tracking experiments. Experiment 1 investigated the effects of two visual coding factors: encoding types (flashing, pulsation, and lightness modulation) and a...

              Multidimensional on-site perception study of stairway spaces in mountain city parks among young and older adult people: a case study of Pipa Mountain Park, Chongqing, China

              Cong Gong, Cong Gong, Xinyu Yang, Changjuan Hu, Changjuan Hu & Zhenkun MaoFrontiers in Psychology

              Stairway spaces in mountain city parks are crucial for vertical traffic. The multidimensional perceptions of stairway spaces are influenced by visual and auditory environments and behavioural traits. The intrinsic associations between environmental factors and age have been universally confirmed using multimodal data; however, localised studies on the perceptions of different age groups in mountainous environments are lacking. Thus, a pilot study was conducted in a mountain city park stairway space in Yuzhong District, Chongqing, China. Controlled enviro...

              Recent Progress on Eye-Tracking and Gaze Estimation for AR/VR Applications: A Review

              Liwan Lin, Zongyu Wu, Yijun Lu, Zhong Chen & Weijie GuoElectronics

              Visual information is crucial in human life, not only providing critical support for communication, learning, and decision-making, but also playing a key role in psychology, medicine, and science. Eye-tracking and gaze estimation have promoted the development of foveated rendering in wearable virtual reality and augmented reality glasses. This review summarizes the recent development on gaze estimation and discusses the impacts of head posture, illumination, occlusion, blur, and individual bias on the accuracy of eye-tracking. The prospective development...

              Study on the Influence of Different Museum Navigation Modes on School-aged Children’s Attention Based on Eye-tracking

              Yuxi Li, Jun Huang & Chang Lin

              This study explores the impact of different museum navigation modes on the attention of school-aged children. Through eye-tracking experiments and observations of 7-12-year-old children during independent and parent-child visits, it was found that the parent-child visit group demonstrated better attention concentration and search efficiency than the independent visit group. Based on these findings, the study proposes strategies to improve children’s museum experiences, such as designing engaging tour formats, enhancing interactivity, and strengthening pa...

              Expertise modulates visual sampling strategies in authorised firearms police officers

              Jennifer Sudkamp, Neil Roach, Shaun Beebe, Jessica Metcalf & Paul McGraw

              High-risk incidents require responders to rapidly detect, sample, and interpret critical visual information. To understand how experience shapes these abilities, we used mobile eye-tracking to examine expertise-related differences in gaze behaviour of Authorised Firearms Officers during simulated tactical scenarios. Receiver operating characteristic analysis revealed that the number, duration, and horizontal spread of fixations moderately discriminated between expert and novice officers, with experts tending to perform more, but shorter fixations that we...

              Parallel Brain-Computer Interface: Collaborative Control and Perception Based on Multi-Brain Division of Labor

              Zeqi Ye, Yang Yu, Yiyun Zhang, Zongtan Zhou, Dewen Hu & Ling-Li ZengIEEE Transactions on Cognitive and Developmental Systems

              To date, brain-computer interfaces (BCIs) have adopted a serial working mechanism, causing performance bottlenecks due to time multiplication. In this study, we propose a parallel BCI (pBCI), which transforms the traditional sequential processing paradigm into multiple sub-paradigms based on division-labor mechanism, and then these sub-paradigms can be processed by multiple brains in a parallel and collaborative way. According to the proposed pBCI, we designed: 1) a Collaborative Speller paradigm where targets are encoded in a multi-dimensional space, wi...

              A Human-in-the-Loop Study of Eye-Movement-Based Control for Workload Reduction in Delayed Teleoperation of Ground Vehicles

              Qiang Zhang, Qiang Zhang, Aiping Zhao, Aiping Zhao, Feng Zhao, Wangyu Wu & Wangyu WuMachines

              Teleoperated ground vehicles (TGVs) are widely applied in hazardous and dynamic environments, where communication delay and low transparency increase operator workload and reduce control performance. This study explores the cognitive and physiological workload associated with such conditions and evaluates the effectiveness of an eye-movement-based predicted trajectory guidance control (ePTGC) framework in alleviating operator burden. A human-in-the-loop teleoperation experiment was conducted using a 2 × 2 within-subject design, incorporating subjective r...

              Effects of Chinese Text Size on the In-Vehicle Text Legibility and Driver Distraction: A Simulator setup Study

              Qi Zhong, Rong Han, Jiaye Chen & Chunfa ShaApplied Sciences

              The rising popularity of in-vehicle information systems (IVIS) in China highlights the significance of Chinese character displays. A key design factor for text-rich in-vehicle human–machine interfaces (HMI) is Chinese text size (CTS). However, the impact of CTS on text legibility and driver distraction has not been extensively explored. The present study launches a Simulator setup experiment and adopts several one-way repeated-measure analyses of variance to identify the optimal CTS that maximizes text legibility while minimizing driver distraction. The ...

              Elevating Mesh Saliency in VR: Introducing a Novel Prediction Network and Dataset

              Kaiwei Zhang, Mohan He, Dandan Zhu, Kun Zhu, Xiongkuo Min & Guangtao ZhaiACM Transactions on Multimedia Computing Communications and Applications

              In computer graphics, polygon meshes stand out as a popular representation providing effective delineation of delicate textures and complex geometries. When dealing with geometric processing tasks for critical regions of the mesh, it is necessary to consider the human visual perception related to saliency. Therefore, we establish a novel mesh saliency dataset, facilitated by a more comprehensive gathering pipeline of eye-tracking from subjects observing mesh models at arbitrary viewpoints in a virtual reality space with six degrees of freedom. Additional...

              • Tobii VR

              Gaze-informed signatures of trust and collaboration in human-autonomy teams

              Anthony J. Ries, Stéphane Aroca-Ouellette, Alessandro Roncone & Ewart J. de VisserComputers in Human Behavior Artificial Humans

              In the evolving landscape of human-autonomy teaming (HAT), fostering effective collaboration and trust between human and autonomous agents is increasingly important. To explore this, we used the game Overcooked Artificial Intelligence to create dynamic teaming scenarios featuring varying agent behaviors (clumsy, rigid, adaptive) and environmental complexities (low, medium, high). Our objectives were to assess the performance of adaptive Artificial Intelligence agents designed with hierarchical reinforcement learning for better teamwork and measure eye tr...

              You really don’t recognise him? The eye-tracker as a forensic tool for concealed knowledge detection

              Weronika Celniak, Dominika Słapczyńska, Gowthami Krishnan & Piotr Augustyniak

              The Concealed Information Test (CIT), a well-established tool in forensic investigations, has thus far been utilised to measure autonomic nervous system (ANS) changes associated with concealed information. While previous studies have explored the integration of eye-tracking technology in face recognition, the specific application of CIT within a mock crime scenario remains relatively uncharted territory. In this study, we aim to broaden the scope of eye-tracking applications using a mock crime scenario, as well as a machine learning classification method...

              Exploring the Use of Eye Tracking to Evaluate Usability Affordances: A Case Study on Assistive Device Design

              Vicente Bayarri-Porcar, Alba Roda-Sales, Joaquín L. Sancho-Bru & Margarita VergaraJournal of Environmental Psychology

              This study explores the application of Eye-Tracking technology for the ergonomic evaluation of assistive device usability. Sixty-four participants evaluated six jar-opening devices in a two-phase study. First, the participants’ gaze was recorded while they viewed six rendered pictures of assistive devices, each shown in two different versions: with and without rubber in the grip area. Second, the participants physically interacted with the devices in a hands-on usability task. In both phases, participants rated the devices according to six usability affo...

              Tri-manual interaction in hybrid BCI-VR systems: integrating gaze, EEG control for enhanced 3D object manipulation

              Jian Teng, Sukyoung Cho & Shaw-mung LeeProceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility

              Brain-computer interface (BCI) integration with virtual reality (VR) has progressed from single-limb control to multi-limb coordination, yet achieving intuitive tri-manual operation remains challenging. This study presents a consumer-grade hybrid BCI-VR framework enabling simultaneous control of two biological hands and a virtual third limb through integration of Tobii eye-tracking, NeuroSky single-channel EEG, and non-haptic controllers. The system employs e-Sense attention thresholds (>80% for 300 ms) to trigger virtual hand activation combined ...

              Emotional Intensity Through the Eyes: Gaze Behavior Toward Expressive Virtual Avatars

              Bharat Vyas, Pisut Wisessing & Rachel McDonnell

              Virtual humans are increasingly used in games, films, and interactive media. Yet, understanding the role of emotional intensity remains critical for expressive character design. This work investigates the gaze behavior in expressive virtual avatars with varying levels of Facial Expression and Emotion intensity and light colours. Using eye-tracking, we analysed visual attention patterns as Facial Expression and Emotions and lighting varied, revealing how intensity influences attention and gaze trajectories. The findings inform design of expressive avatars...

              Eye Tracking Analysis to Determine the Endoscopist’s Recognition Rate for Artificial Intelligence-Detected Sites in Colonoscopy

              Fumiaki Ishibashi, Sho Suzuki, Kentaro Mochida, Mizuki Nagai, Eri Ozaki & Kosuke Okusa

              PurposeComputer-aided detection systems (CADe) are used in screening colonoscopy; however, no study has quantitatively analyzed how endoscopists recognize candidate sites identified by CADe. The aim of this study was to determine the extent to which endoscopists could recognize CADe-detected sites.MethodsThis prospective study used a dedicated eye tracking technology-based system to record the endoscopist’s eye position and CADe detection sites in a single video during colonoscope withdrawal. All videos were reviewed to calculate the endoscopist’s recogn...

              Combining biometrics and self-reports to better understand perceptions of source trustworthiness, expertise, and believability in HPV blog messaging

              Laura Crosswell

              The recent surge in user-generated, online activity shifts the dynamics driving public trust in healthcare information. As more voices gain social capital, consumers struggle to identify reliable sources of information. Our new media environment and redefined concepts of expert credentials have consequently complicated the nature of “credibility” and trust in public health messaging. This study aims to address gaps in both the literature and data collection techniques that inform the current body of HPV-related health communication scholarship. Specifica...

              Spatial Narrative Optimization in Digitally Gamified Architectural Scenarios

              Deshao Wang, Jieqing Xu & Luwang Chen

              Currently, exploring digital immersive experiences is a new trend in the innovation and development of cultural tourism. This study addresses the growing demand for digital immersion in cultural tourism by examining the integration of spatial narrative and digitally gamified architectural scenarios. This study synthesizes an optimized framework for narrative design in digitally gamified architectural scenarios, integrating spatial narrative theory and feedback-informed design. The proposed model comprises four key components: (1) developing spatial narra...

              Evaluating Automated Gaze Mapping Across Laboratory and Field Study Settings

              Celina Vetter, Rebecca Nauli, Ruth Häusler Hermann & Maarten Uijt De Haag

              Eye Tracking (ET) is used in different industries to understand human visual attention, cognitive load, and decision-making processes by capturing where, and for how long a person focuses their attention. A major challenge in processing ET data is mapping gaze points to dynamic Areas of Interest (AOIs) while accounting for data variability and head movements. The purpose of this research is to compare and evaluate methods for automatic gaze-to-AOI mapping to improve efficiency and accuracy in gaze analysis. An ArUco-marker based analytical software was d...

              Aging-in-Place Attachment Among Older Adults in Macau’s High-Density Community Spaces: A Multi-Dimensional Empirical Study

              Hongzhan Lai, Stephen Siu Yu Lau, Yuan Su & Chen-Yi Sun

              This study explores key factors influencing Aging-in-Place Attachment (AiPA) among older adults in Macau’s high-density community spaces, emphasizing interactions between the built environment, behavior, and psychology. A multidimensional framework evaluates environmental, behavioral, human-factor, and psychological contributions. A mixed-methods, multisource approach was employed. This study measured spatial characteristics of nine public spaces, conducted systematic behavioral observations, and collected questionnaire data on place attachment and aging...

              Enhancing Pilot Engagement and Situational Awareness with Augmented Reality: A Neuro-Ergonomic Evaluation of anb Innovative AR-HUD

              Xin Yuan, Kam K.H. Ng, Qinbiao Li, Ka Hei Fung, Chun Kit Lau & Lok Hei Ng

              Introducing augmented reality (AR) technology into aviation cockpit design, especially headup display (HUD) design, will help innovate a new generation of human-machine interaction (HMI) paradigm. However, former research on AR-assisted HMI design provides a less objective assessment of human factors such as pilot situational awareness (SA) and workload. This research innovatively developed a low-cost, easy-to-assemble AR-HUD based on projection reflection technology. The projection-based AR-HUD can provide key nformation and necessary warnings and remin...

              Eyes on the Bridge: The Effect of a Systematic Viewing Protocol in Remote Nautical Object Control

              Rutger Stuut, Ellemieke Van Doorn, Stefan Van der Stigchel & Christian P. Janssen

              This study investigates the effect of using a systematic viewing protocol for scanning closed-circuit television (CCTV) during a simulation of remote nautical object (bridge/lock) control. For nautical object control, systematic viewing is assumed to mitigate the risk of observer errors, such as missing a road user in CCTV streams. However, previous research has reported mixed results on the benefits of systematic viewing for performance. A total of 42 professional operators were asked to operate a bridge control Simulator setup where, unknown to the ope...

              Experimental and simulation research on evacuation with signage in mind: application of eye-tracking in virtual reality

              Rui Zhang, Weidong Yan, Jiaxi Liu & Qingyan Zhao

              Signage systems play a vital role in facilitating safe and efficient evacuation during emergencies in complex buildings. However, existing studies often rely on idealized assumptions and fail to capture individuals’ actual cognitive and perceptual responses to signage, resulting in discrepancies between simulation predictions and real-world evacuation behavior. To address this gap, this study constructs an experimental platform integrating virtual reality (VR) and eye-tracking technologies to objectively record participants’ visual attention distribution...

              Research on the coordinated setting and evaluation model of variable speed limit signs and visual deceleration markings at the entrance section of undersea tunnels

              Fuquan Pan, Haowei Liu, Xiaojun Fan, Shuai Shao, Lixia Zhang & Chang Liu

              OBJECTIVES: To improve traffic safety at the entrance section of undersea tunnels, this research analyzes the effectiveness of the coordinated setting of variable speed limit signs(VSLs) and visual deceleration markings(VDMs) at the entrance section of the undersea tunnels.METHODS: This research sets various parameters of VSLs and VDMs under the condition of a speed limit of 80 km/h. Twelve types of coordinated schemes of VSLs and VDMs are set. Qingdao Jiaozhou Bay Undersea Tunnel entrance section was simulated using modeling tools such as UC-win/Road an...

              Designing Search Engine Result Pages for Immersive Virtual Reality: Insights from Eye-Tracking and User Perception Data

              Austin R. Ward, Bogeum Choi & Robert Capra

              Extensive research exists on user interactions with search engine result pages (SERPs) in desktop and mobile environments. However, relatively little work has focused on understanding how virtual reality (VR) users interact with SERPs in 3D immersive virtual environments (IVEs). Unlike 2D displays with established paradigms (e.g., ranked lists), 3D IVEs lack standardized methods for presenting search results. This work explores how different information arrangements in 3D virtual space impact users' search behaviors and preferences. This paper presents t...

              • Tobii VR

              Visual attention and cognitive workload using different laparoscopic box trainers and mixed-reality feedback

              Aseel F. Khanfar, Sanaz Motamedi, Shawn D. Safford, Jason Moore, Jessica Menold & Scarlett Miller

              BackgroundLaparoscopic techniques have revolutionized minimally invasive surgery (MIS) but remain visually and mentally demanding, especially in smaller operative sites (e.g., pediatric patients). Though traditional box trainers serve as the golden standard for laparoscopic simulation-based training (SBT), they are limited due to their lack of real-time feedback and objective assessments. Advancements in SBT using Visual Reality (VR) and Augmented/Mixed-Reality (AR/MR) can provide objective real-time evaluations. This study assessed the effects of mixed-...

              Development and Evaluation of a Head-Controlled Wheelchair System for Users with Severe Motor Impairments

              Abdelhakim Haddoun, Dâlel Djabri, Mallak Saidani & Mohamed Benbouzid

              This paper presents an innovative and accessible hands-free wheelchair control system designed for individuals with severe motor impairments, particularly tetraplegic users. Unlike traditional joystick-based systems, which are often unsuitable for users with quadriplegia, our system relies on intuitive head-motion detection to enhance autonomy and ease of use. The system consists of a wearable motion-sensing cap equipped with an MPU-6050 sensor which is a 6-axis Inertial Measurement Unit (IMU) to capture head gestures, processed by an ATmega328 microcont...

              • Tobii Pro X60 / X120 / T60 / T120

              Eye movement predictors of hazard response performance in train drivers under different speed conditions

              Lu Yang, Maosheng Xia, Yusong Wang, Ding Fang, Xiaowei Jing & Jinfei MaPLOS One

              Foreign objects on railroads contribute to railway accidents. Train driving heavily relies on visual prowess. Drivers must quickly identify and react to these hazards, capabilities that directly impact the safety and efficiency of train operations. As train speeds increase, it becomes increasingly challenging to spot track anomalies. This underscores the importance of studying drivers’ visual attention, especially under different speed conditions. This study delved into the nuances of train drivers’ hazard detection by analyzing eye movement and response...

              • Tobii Pro X60 / X120 / T60 / T120
              • Tobii Pro Studio

              Effects of Driving Background Complexity and Interface Opacity on Visual Cognition in AR‐HUD Systems

              Jing Li, Chuchu Wang & Mo ChenIEEE Transactions on Mobile Computing

              The cognitive effectiveness of AR‐HUD interfaces is influenced by driving background complexity (DBC) and information opacity. This study explores how they impact visual cognition and reaction efficiency using a dual‐phase experimental approach. In Experiment I, a subjective evaluation classified DBC into low, medium, and high levels based on static driving scene images. This was followed by an objective assessment of the complexity of color variety, edge density, and texture features for the selected L‐DBC, M‐DBC, and H‐DBC images. Experiment II then em...

              Contrast Computation for\xa0Improved Visibility and\xa0User Experience in\xa0Educational Interfaces

              Agnieszka Olejnik-Krugly, Anna Lewandowska, Maja Dzisko & Jarosław Jankowski

              The effectiveness of digital learning environments depends largely on the usability and accessibility of their visual components. Contrast levels in graphical interfaces play a key role in ensuring visibility, engagement, and a positive learning experience. However, not all educational details are equally noticeable to all users. A lower contrast, if strategically applied and visually striking, can still draw attention and enhance the perception of critical information. This technique is often used in video games, where selective emphasis on certain elem...

              Deep learning quantifies pathologists’ visual patterns for whole slide image diagnosis

              Tianhang Nan, Song Zheng, Siyuan Qiao, Hao Quan, Xin Gao, Jun Niu, Bin Zheng, Chunfang Guo, Yue Zhang, Xiaoqin Wang, Liping Zhao, Ze Wu, Yaoxing Guo, Xingyu Li, Mingchen Zou, Shuangdi Ning, Yue Zhao, Wei Qian, Hongduo Chen, Ruiqun Qi, Xinghua Gao & Xiaoyu CuiIEEE Robotics and Automation Letters

              Based on the expertise of pathologists, the pixelwise manual annotation has provided substantial support for training deep learning models of whole slide images (WSI)-assisted diagnostic. However, the collection of pixelwise annotation demands massive annotation time from pathologists, leading to a high burden of medical manpower resources, hindering to construct larger datasets and more precise diagnostic models. To obtain pathologists’ expertise with minimal pathologist workloads then achieve precise diagnostics, we collect the image review patterns of...

              Does gaze direction influence cycling effort?

              Sem Otten, Ruud J. R. Den Hartigh, Frank T. J. M. Zaal, Benoît G. Bardy & Christophe GernigonSoftware and Systems Modeling

              Cycling effort can be influenced by the speed of the optic flow to which individuals are exposed. The present study tested whether gazing toward proximal (e.g., the road in front) versus distal areas (e.g., the horizon ahead) would influence cycling effort. We expected that gazing toward proximal areas would generate a feeling of “momentum” and thereby increase efforts. Twenty-eight cyclists completed two 20-minute trials on their bicycle in a VR environment, aiming to outperform the power output they exerted during a baseline trial. Their gaze direction...

              • Tobii VR
              • SDK

              How Background Colour Shapes Digital Text-Information Processing: A fNIRS-Eye Tracking Study

              Xingkai Wang, Lina Xu, Jiawei Li, Chen Cheng & Luwen Yu

              As digitalization advances, colour in Human-Machine Interaction now fundamentally shapes digital text processing beyond aesthetics. However, the background colour's impact on text information processing under controlled luminance conditions remains underexplored. This study employed a multimodal approach combining functional near-infrared spectroscopy (fNIRS), eye tracking, behavioural performance and subjective reports to systematically examine colour’s effects on text comprehension. Key findings demonstrated that green elicited higher activation in the...

              Hilbert–Huang transform based Pupil Research changes analysis for concentration assessment in skilled mowing

              Bo Wu, Yuan Wu, Ran Dong, Kiminori Sato, Soichiro Ikuno, Shoji Nishimura & Qun JinPLOS One

              In the hilly and mountainous areas of Japan, mowing operations can only be carried out by human labor because of the steep slopes. However, the environment faced by workers when mowing is complex, requiring them to deal with different visual stimuli at the same time. These factors will also be reflected in the data of specific Pupil Research changes, further impacting their concentration while mowing. Therefore, in this study, based on a set of experiments on various terrain (flat land and slope) in Hiroshima, Japan, an analysis method of human Pupil Res...

              Impact of Visual Attention Prompt Methods on Changes in Gaze Using a Driving Simulator setup

              Jinwei Liang & Makio Ishihara

              This study examines the effectiveness of different visual attention prompt methods in directing drivers’ gaze toward critical traffic targets after short-term training. Using a Unity-based driving Simulator setup and eye-tracking technology, five methods—Point, Arrow, Blur, Dusk, and a Modified Attention Funnel—were tested. Eye-tracking data showed that visual prompts improved detection efficiency, with effectiveness varying by driver proficiency. The results indicated that Point, Arrow and Dusk positively influenced drivers’ efficiency in detecting crit...

              From eye-tracking to games: exploring low-tech solutions for sustainable cultural landscape management

              Marta Rusnak, Barbara Kilijańska, Izabela Garaszczuk, Andrew Duchowski, Małgorzata Biegańska, Daria Dobrasiak & Zofia Koszewicz

              The development of cities to address social, cultural, and environmental challenges increasingly relies on new technologies. Eye tracking (ET) is one such method used to assess how urban developments impact the perception of architectural and cultural heritage. However, ET has limitations, including high costs and difficulties with certain populations. This paper proposes the use of games, specifically puzzles, as an accessible alternative for wider community engagement in urban planning. Although games are often viewed as less serious research tools, ou...

              인간공학 분야의 최신 논문 탐색
              모든 발행물 보기

              인간공학 연구 강화하기

              시선추적 기술을 활용하여 인간 행동에 대한 심층적인 인사이트를 확보하고 연구의 효율성을 높일 수 있습니다.