home

Eye Tracking in Psychology and Neuroscience Research: Q3 2025

The Q3 2025 publications in psychology and neuroscience underscore the value of eye tracking technology in revealing nuanced insights into human cognition, behavior, and decision-making. Eye tracking has facilitated research into language proficiency, attentional bias, gender associations, news selection, and more. This technology has proven instrumental in understanding complex cognitive processes, offering a window into how individuals engage with stimuli and make decisions.

Language proficiency over nonverbal sound effects in childrens eBook incidental word learning

He Sun, Adam Roberts, Jessica Tan, Jieying Leh & Yvonne Cui Yun Moh

While multimodal glossing is supported by theories like Mayer’s Cognitive Theory of Multimedia Learning, its effectiveness remains debated due to potential cognitive demands. This study examined how repeated exposures, working memory (WM), and gloss lookup behaviors influence vocabulary retention. Ninety-six Chinese high school students were randomly assigned to four conditions (L2 textual gloss, pictorial gloss, pictorial plus L2 textual gloss, and no gloss). Results showed that (a) repeated exposures to target words enhanced vocabulary lear...

Threat-related attentional bias in subjects with different looming cognitive styles: Evidence based on eye-tracking study

Xuan Wang, Shuai Chen, Bin Tian & Wen-Peng Cai

BACKGROUND: Although extensive research has investigated attentional biases based on the looming vulnerability model of anxiety, the characteristics of attentional biases in individuals with looming cognitive styles (LCS) remain incompletely elucidated. No prior eye-tracking studies have examined the spatiotemporal dynamics of their threat-related attentional preferences.Artificial IntelligenceM: To investigate the nature and temporal pattern of attentional biases toward threat stimuli in individuals exhibiting different levels of LCS using eye-tracking ...

Girls are disciplined and boys rebellious. The influence of implicit gender associations on noticing of disruptive student behavior: an eye-tracking study

Antje Biermann, Eva Mayer & Ann-Sophie Grub

Professional vision is an important situation-specific competence for teachers. Particularly for classroom management, a good learning environment requires early recognition of potential disruptions, the correct interpretation of such situations, and fair, appropriate consequences. Group associations can influence perceptual processes and, especially in complex, dynamic situations, (pre-service) teachers risk misinterpreting behavior by following implicit associations rather than actual behaviors. The connection between associations and perceptual proces...

Cognitive Barriers to Select News from Distrusted Sources

Robin Blom

News consumers prefer to access information from trusted sources but may also access news from a distrusted source in exceptional circumstances when the content of that news report is highly unexpected. That demonstrates that expectancy violations are highly important in media bias perceptions. Additionally, the decision to access news from distrusted sources may not be an easy decision. Therefore, this chapter investigates whether it took more cognitive effort to select a news headline from a distrusted source over a trusted one with the use of eye trac...

A Comprehensive Framework for Eye Tracking: Methods, Tools, Applications, and Cross-Platform Evaluation

Govind Ram Chhimpa, Ajay Kumar, Sunita Garhwal, Dhiraj Kumar, Niyaz Ahmad Wani, Mudasir Ahmad Wani & Kashish Ara ShakilLecture Notes in Computer Science Social Robotics AI

Eye tracking, a fundamental process in gaze analysis, involves measuring the point of gaze or eye motion. It is crucial in numerous applications, including human–computer interaction (HMI), education, health care, and virtual reality. This study delves into eye-tracking concepts, terminology, performance parameters, applications, and techniques, focusing on modern and efficient approaches such as video-oculography (VOG)-based systems, deep learning models for gaze estimation, wearable and cost-effective devices, and integration with virtual/augmented rea...

Wave after wave: The suggestibility of noise in the experience of multisensory hallucinations under multimodal Ganzfeld stimulation

Eleftheria Pistolas, Liv Smets & Johan WagemansComputer Aided Civil and Infrastructure Engineering

A multimodal Ganzfeld (MMGF) consists of homogeneous stimulation in both the visual and auditory modalities. Exposure to this unique perceptual environment can elicit the awareness of hallucinatory percepts. The nature of these hallucinatory percepts, and specifically the frequency of visual, auditory and multisensorial hallucinations, remains unclear. In this study, an MMGF refers to the stimulation paradigm itself. The perceptual experiences elicited, however, can be unimodal (occurring in one modality), multisensory (simultaneous but thematically unre...

Impact of viewing time on aesthetic experience of Christian medieval Nubian wall paintings: an eye-tracking study with Sudanese and Western viewers

Tomasz Michalik & Tobiasz Trawiński

Aesthetic experience may foster positive connections between visitors and heritage sites. However, the way people engage with and esthetically experience archaeological heritage is not yet well understood. To address this gap, in the present on-site study, we explored how viewers’ cultural backgrounds might influence their aesthetic experience of Christian medieval Nubian wall paintings. Specifically, Sudanese and Western subjects were asked to view 17 paintings from the Monastery on Kom H in Old Dongola (Sudan) while their eye movements and fixations we...

Analyzing the Relationship Between Chronic and Occasional Alcohol Consumption Patterns and Their Association with Attentional Bias: An Eye-tracking Methodology

Newfight Seth, Omar Afroz, Raja Babu Ramawat, Apinderjit Kaur, Stuti Karna, Shalini Singh, Roshan Bhad, Rohit Verma & Ravindra Rao

BackgroundAlcohol use disorder (AUD) is accompanied by cognitive impairments, including attentional bias towards cues linked to alcohol. Most studies on attentional biases have focused on participants in intoxicated states, with limited research on differences between chronic and occasional users. This study aimed to examine attentional biases in chronic alcohol users compared to occasional users using eye-tracking.MethodsIn this cross-sectional study, 71 male participants (36 chronic users and 35 occasional users) were recruited from a tertiary care cen...

Bilinguals’ visual attention in/of the Linguistic Landscape

Julia Tusk

While early Linguistic Landscape research concerns the semantic analysis of signs, contemporary studies investigate also the human visual attention of the LL. Three prior studies (Seifi, 2015; Vingron et al., 2017; Wei & Qin, 2023) investigate how language users look at the LL in a laboratory setting. However, research on bilinguals’ visual attention towards naturally occurring street signs remains limited. This study addresses this gap using a mobile eye-tracker to examine how bilinguals look at public signs, comparing Polish na...

Localization of a single tactile stimulus during saccadic eye movements

Kazumichi Matsumiya & Nanami NakashimaComputer Aided Civil and Infrastructure Engineering

To localize tactile events in external space, our perceptual system must transform skin-based locations into an external frame of reference. Such a transformation has been reported to involve reference frames that are unrelated to tactile sensations, such as eye position, which supports the idea that a visual reference frame is a single unified frame of reference for transforming spatial information from all sensory modalities. However, it remains unclear how tactile events are perceptually localized during saccadic eye movements. In this study, we prese...

  • Tobii VR
  • SDK

Audio description as a tool for supporting emotion processing in autistic children: Results of an eye-tracking study on randomised Polish participants aged 5–12

Monika Zabrocka, Grzegorz Kata, Anna Bereś & Marta Materska-Samek

Audio description (AD) is a pre-recorded verbal commentary that describes visual – and occasionally ambiguous auditory – elements of audiovisual (AV) cultural products. While AD is primarily designed for audiences with visual impairments, its potential benefits for other populations have recently attracted scholarly attention. This study examines the use of AD for children with autism spectrum disorder (ASD), exploring how it may enhance their information processing by delivering content through both visual and auditory channels. The study involved 33 Po...

Evaluating the Effects of Consequences of Error on Trust in Artificial Intelligence-Aided Task: An Eye Tracking Study

Jin Yong Kim, Catherine Kautz & Xi Jessie Yang

Artificial intelligence (Artificial Intelligence) is increasingly integrating into high-risk domains where error consequences vary. Understanding how consequences affect trust in Artificial Intelligence is important for safe collaboration. In an Artificial Intelligence-assisted experiment, 35 participants completed trials under low- and high-consequence conditions. Eye tracking, trust ratings, and performance data were collected. Under high-consequence conditions, participants spent less time fixating on Artificial Intelligence’s correct suggestions. Par...

Modeling rater cognition in translation assessment

Chao Han, Shirong Chen & Jia Feng

In this exploratory study, we investigated rater cognition in English–Chinese translation assessment, drawing on think-aloud, eye-tracking, and interview data. We designed a 3 × 2 × 2 experiment in which experienced raters assessed eighteen renditions of three levels of quality for each translation direction, using a Likert-type scale or analytic rubric scale. We found that: (a) the raters heeded meaning transfer more frequently than other contents; (b) they utilized a variety of processing actions, but a core subset involving eight actio...

Exploring Attentional Behavior in Young People with ASD Through a Wearable Eye Tracker

Andrea Antonio Cantone, Mafalda Ingenito, Serena Matarazzo Orilia, Orlando Ricciardi & Giuliana Vitiello

In this poster, we investigate attentional behavior in youths with Autism Spectrum Disorder (ASD) using the wearable eye-tracker Tobii Pro Glasses 3. The experiment involved 38 participants, 19 with ASD and 19 with typical development, who described both social and non-social images while their eye movements were recorded. Results revealed that participants with ASD accepted the device, demonstrating its feasibility for future use. Compared to the control group, individuals with ASD showed reduced focus on social images. These findings highlight potentia...

Eye-tracking-based identification of reading difficulty areas

yuchen xia, Zhonghua Wan, Mingxuan Yang, Xiangyue Wang & Shiqian Wu

Eye movements have been shown to reflect information during reading. Nevertheless, automatic identification of difficult areas of text based on eye tracking is still an understudied area. This paper focuses on natural eye movement events and proposes a framework for extracting difficult text regions based on eye-tracking patterns. The framework collects users’ reading eye-movement data using a head-mounted eye tracker, predicts fixations associated with difficult text regions, and performs text matching to accurately locate areas of reading difficulty. E...

Eye-tracking as a lens into meta-reasoning

Snehal Dhengre, Rakefet Ackerman & Ling Rothrock

Central questions in metacognitive research are how reliably people’s confidence reflect success and how mental effort is regulated during cognitive tasks. Ackerman’s Bird’s-Eye View of Cue Integration methodology exposed confidence biases in a geometric problem-solving task. We replicated one experiment, incorporating eye-tracking to expose additional confidence predictors and insights into mental effort regulation. Fifty-four university students performed the task wearing eye-tracking glasses. The original confidence biases were replicated. Notably, th...

Reduced Eye Blinking During Sentence Listening Reflects Increased Cognitive Load in Challenging Auditory Conditions

Penelope Coupal, Yue Zhang & Mickael DerocheBritish Journal of Learning Disabilities

While blink analysis was traditionally conducted within vision research, recent studies suggest that Blink Research might reflect a more general cognitive strategy for resource allocation, including with auditory tasks, but its use within the fields of Audiology or Psychoacoustics remains scarce and its interpretation largely speculative. It is hypothesized that as listening conditions become more difficult, the number of Blink Research would decrease, especially during stimulus presentation, because it reflects a window of alertness. In experiment 1, 21...

Visual processing of social and non-social stimuli in schizophrenia: investigation of the links to positive and negative symptoms

Hana H. Kutlikova, Natália Čavojská, Vladimír Ivanˇík, Alexandra Straková, Jakub Januška, Ján Peˇeňák, Anton Heretik, Michal Hajdúk, Vladimír Ivančík & Ján Pečeňák

INTRODUCTION: Schizophrenia (SCZ) spectrum is characterised by aberrant processing of social cues. However, little is known about the specific stages of visual attention and their connection to subclinical and clinical symptoms in psychosis. This study aimed to investigate the visual processing of social and non-social parts of naturalistic scenes, and its link to positive and negative symptoms.METHODS: Employing eye-tracking and a free-viewing paradigm, we tested 27 individuals with SCZ and 28 matched controls and compared them on measures capturing bot...

Phasic alertness impairs cognitive control by amplifying competition between evidence accumulators

Jeshua Tromp, Franz Wurm, Federica Lucchi, Roy de Kleijn & Sander Nieuwenhuis

Although phasic alertness generally benefits cognitive performance, it often increases the impact of distracting information, resulting in impaired decision-making and cognitive control. However, it is unclear why phasic alertness has these negative effects. Here, we present a novel, biologically-informed account, according to which phasic alertness generates a transient, evidence-independent input to the decision process. This shortens overall response times, but also amplifies competition between evidence accumulators, thus slowing down decision-making...

Analytic vs. synthetic decision-making: a behavioral and EEG study with real-world decision-making scenarios

Roberta A. Allegretta, Laura Angioletti & Michela Balconi

Decision-making can rely on two mental strategies—synthetic (a top-down process in which decisions are made by evaluating the overall situation) or analytic (a bottom-up driven process guided by a detailed examination of individual elements)—following opposite cognitive pathways, shaping how individuals process information and make choices. This study investigates the behavioral and neural correlates of analytic and synthetic decision-making strategies. A total of 30 participants read five real-life scenarios and chose between two alternatives representi...

Investigating a mental effort explanation of the generation effect using Pupil Researchlometry

Ania M. Grudzien & Nash Unsworth

The “generation effect” is a phenomenon whereby people have better memory for information that is self-generated compared to information that is passively read. Throughout the years mtheories have been proposed to explain this effect, one of which is the “mental effort theory,” which suggests that more mental effort is allocated to self-generated information, meaning that the act of generating information inherently requires more mental effort than processing existing information. In a series of four paired-associates memory experiments, Pupil Researchlo...

Attentional control mechanisms in forming first impressions of data retrieval systems: exploring top-down and bottom-up factors

Ping Wang, Xueyi Li, Qiao Li & Siying Wu

In response to the growing data needs of researchers, data retrieval systems have emerged as extensions of literature retrieval systems, often adopting brand extension strategies that replicate the user interfaces of established literature retrieval platforms. This design similarity seeks to leverage familiarity to cultivate positive first impressions, resulting in user interfaces that include both high goal-relevance areas (focused on data discovery) and low goal-relevance areas (modeled after literature retrieval). Without effective attention control, ...

Visual focus and physiological parameters of air pistol shooters under different conditions: a psychophysiological perspective

Gülçin Güler, Deniz Şimşek, Seçkin Tuncer & Daniel Mon-López

The aim of this study was to examine visual focus, attention processes, and physiological parameters of air pistol shooters under different pressure conditions. Thirty-two (n = 9 elite, n = 11 intermediate and n = 12 novice) air pistol shooters performed 10 shots in both control condition and pressure condition. Quiet eye (QE) duration, Pupil Research size, skin conductance (SC) and heart rate (HR) were recorded simultaneously during shooting. SC and HR values were significantly higher in pressure condition compared to control condition; however, QE dura...

Comparing Static and Dynamic Decision Tasks Using Pupil Researchlometry: Expected Loss is More Important than Defined Reward

Chris Baber & Daniel N. Cassenti

We report on two experiments using Pupil Researchlometry to explore decision-making. In Experiment 1, participants observed a static image of the game. In Experiment 2, participants interacted with a computer agent in a cooperative game. A Tobii Pro Fusion running at 120Hz tracked participants’ eyes. Ten participants completed nine trials in each experiment. Percentage change in Pupil Research diameter from a baseline, in Experiment 1, is similar for both targets, suggesting that participants treat low and high rewards equally. In experiment 2, there is ...

Virtual street crossing and scanning behavior in people with hemianopia: A step toward successful crossings

Eva M. J. L. Postuma, Gera A. de Haan, Joost Heutink & Frans W. CornelissenInternational Journal of Environmental Research and Public Health

Individuals with homonymous hemianopia (HH) may benefit from adopting compensatory crossing and scanning strategies to successfully cross streets. In this study, we explored the effect of HH on street crossing outcomes, crossing behavior and scanning behavior in a virtual environment. Individuals with real HH (N = 18), unimpaired vision (N = 18), and simulated HH (N = 18) crossed a virtual street displayed through a head-mounted display. Virtual cars approached from both directions, traveling at a speed of either 30 or 50 km/h. Participants' crossing and...

  • Tobii VR
  • SDK

The lexicalization of emojis: the influence of frequency and functions of emojis in sentences on this process—a study based on eye movement tracking

Wanhong Lu, Haoge Du, Feng Gu & Jianghua HanCreating Communication and Media Research Labs

The lexicalization of emojis reflects the dynamic evolutionary characteristics of the linguistic symbol system in the digital age. The influence of usage frequency and the different functions of emojis in sentences on this process is also a research topic worthy of exploration. This study employed eye-tracking technology, with 98 native Chinese speakers as participants, and selected Chinese sentences as experimental stimuli to compare the processing differences of emojis with different frequencies (high frequency and low frequency) and different function...

Bornean orangutans (Pongo pygmaeus) show an attentional bias toward a male secondary sexual trait

Tom S. Roth, Evy van Berlo, Juan Olvido Perea‐García & Mariska E. Kret

Visual attention mechanisms help organisms prioritize evolutionarily relevant stimuli, like threats and mating opportunities. Individuals may, therefore, attend to specific facial features. In humans, it has consistently been shown that secondary sexual traits and attractive faces capture and hold attention. By contrast, evidence for such biases in nonhuman primates, especially great apes, remains scarce. To address this gap, we conducted two eye‐tracking experiments with four zoo‐housed Bornean orangutans (Pongo pygmaeus), a species characterized by ext...

Brain–computer interface control with artificial intelligence copilots

Johannes Y. Lee, Sangjoon Lee, Abhishek Mishra, Xu Yan, Brandon McMahan, Brent Gaisford, Charles Kobashigawa, Mike Qu, Chang Xie & Jonathan C. Kao

Motor brain–computer interfaces (BCIs) decode neural signals to help people with paralysis move and communicate. Even with important advances in the past two decades, BCIs face a key obstacle to clinical viability: BCI performance should strongly outweigh costs and risks. To significantly increase the BCI performance, we use shared autonomy, where artificial intelligence (Artificial Intelligence) copilots collaborate with BCI users to achieve task goals. We demonstrate this Artificial Intelligence-BCI in a non-invasive BCI system decoding electroencephal...

Mutual gaze and later social attention development in infants at typical and elevated familial likelihood for ASD and/or ADHD

D. Ilyka, Y. Jiang, J. Begum-Ali, L. Mason, A. Gui, A. Gui, T. Gliga, S. Lloyd-Fox, S. Lloyd-Fox, E. Jones, T. Charman, M.H. Johnson, M.H. Johnson, The BASIS/STAARS Study Team, The BASIS/STAARS Study Team, The BASIS/STAARS Study Team, The BASIS/STAARS Study Team & The BASIS/STAARS Study TeamEarly Human Development

Atypical social attention is a feature of autism spectrum disorder (ASD) and attention-deficit/hyperactivity disorder (ADHD), yet this has not yet been studied during toy-free naturalistic parent-infant interactions in infants at elevated likelihood of developing ADHD (EL-ADHD). We coded mutual gaze from caregiver-infant free-play videos recorded at 4-7 months in infants with typical likelihood (TL; n = 37), elevated likelihood of ASD (EL-ASD; n = 55), ADHD (EL-ADHD; n = 13) or both (EL-ASD + ADHD; n = 13). Face-orienting responses were measured using an...

Social Connectedness Without Eye Contact: 18- but Not 9-Month-Olds Use Proximal Touch to Infer Third-Party Joint Attention During Observational Learning

Maleen Thiele, Gustaf Gredebäck & Daniel B. M. HaunDevelopmental Research

Decades of research have highlighted the important role of joint attention in early cultural learning. However, most previous studies focused on a limited range of joint attention settings involving the learner's first-person participation in joint visual attention, characterized by eye contact and triadic gaze following. This has created an incomplete picture, tending to neglect the diversity in which infants experience social connectedness in their daily lives. To deepen our understanding of the multifaceted nature of joint attention, this study invest...

Investigating autistic hyperfocus and monotropism: Limited convergence of event-related potentials, laboratory tasks, and questionnaire responses

Patrick Dwyer, Andre Sillas, Clifford D. Saron & Susan M. RiveraResearch in Autism

Purpose The autistic-developed monotropism account suggests autism is characterised by hyperfocus towards interests, although hyperfocus research has not explored associations among self-/caregiver-report and lab-based measures. Other findings suggest autistic attention has an enhanced capacity and/or is unusually prone to involuntary capture. This study used questionnaires and lab-based tasks to investigate autistic attention and probe its relations to inattention/distractibility, sensory experiences, and anxiety. Methods 18 autistic and 22 comparison a...

Context effects: discourse structure influences narrative ability in autism and first-degree relatives

Emily Landau, Kritika Nayar, Kritika Nayar, Gary E. Martin, Cassandra Stevens, Cassandra Stevens, Jiayin Xing, Jiayin Xing, Janna Guilfoyle, Joseph C. Y. Lau & Molly LoshFrontiers in Psychiatry

Introduction: Narrative, or storytelling, ability is a well-documented area of difficulty in autism spectrum disorder (ASD) and is an important skill that is related to social-communicative success. Evidence also demonstrates subtle narrative differences among first-degree relatives of autistic individuals, including parents (ASD parents) and siblings (ASD siblings), suggesting narrative ability may reflect genetic influences related to ASD. Less structured contexts, such as free form narrative retellings (i.e., without scaffolding via visual aids), requ...

Investigating Saccade Research-Onset Locked EEG Signatures of Face Perception during Free-Viewing in a Naturalistic Virtual Environment

Debora Nolte, Vincent Schmidt, Aitana Grasso-Cladera, Peter König & Peter Königeneuro

Current research strives to investigate cognitive processes under natural conditions. Virtual reality and EEG are promising techniques combining naturalistic settings with close experimental control. However, mquestions and technical challenges remain, e.g., are Saccade Research onsets a suitable replacement of fixation onsets as key events in continuous gaze trajectories ( Amme et al., 2024), and consequently, can VR capture differences across different stimulus categories associated with varying Saccade Research durations? To address both questions, we...

  • Tobii VR
  • LSL
  • SDK

SenseSeek Dataset: Multimodal Sensing to Study Information Seeking Behaviors

Kaixin Ji, Danula Hettiachchi, Falk Scholer, Flora D. Salim & Damiano SpinaProceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies

Information processing tasks involve complex cognitive mechanisms that are shaped by various factors, including individual goals, prior experience, and system environments. Understanding such behaviors requires a sophisticated and personalized data capture of how one interacts with modern information systems (e.g., web search engines). Passive sensors, such as wearables, capturing physiological and behavioral data, have the potential to provide solutions in this context. This paper presents a novel dataset, SenseSeek, designed to evaluate the effectivene...

No clear evidence for a domain-general violation of expectation effect in the Pupil Researchlary responses of 9- to 10-month-olds

Christine Michel, Christine Michel, Miriam Langeloh, Miriam Langeloh, Markus R. Tünte, Moritz Köster, Stefanie Hoehl & Stefanie HoehlPLOS One

Violation of expectation (VOE) paradigms are key to understanding infants' early knowledge. In VOE paradigms, infants are presented sequences of events either according with or violating regularities of their physical or social environment. Infants' violated expectations may result in a surprise response, such as longer looking times or specific neural correlates. There is an increasing interest in utilizing infants' Pupil Research dilation as an index of their surprise. However, to date, no study has systematically examined infants' Pupil Researchlary r...

  • Tobii Pro X60 / X120 / T60 / T120
  • SDK
  • Open Source Presentation

Field Usability and Validity of Eye-Tracking Instrumentation With the Early Childhood Test Among Children Aged 2–4 Years Old in Northern Coastal Ecuador

Itziar Familiar-Lopez, Hannah Lalonde, Andrew Harris, Elizabeth Foot, María Sol Garcés, María Sol Garcés, Nergiz Turgut, Nergiz Turgut, Karen Levy, Joseph N. S. Eisenberg, Gwenyth O. Lee & Gwenyth O. LeeNeuropsychology

OBJECTIVE: There is a need for effective cognitive assessment tools to evaluate the development of very young children in resource-limited low- and middle-income country settings. Our objective was to evaluate the field usability of a computer-based attention test and its concurrent validity with a caregiver-reported screener of neurodevelopment in rural, Ecuadorian children.METHOD: To assess a computer-based attention test in a resource-limited setting, 41 Ecuadorian children between 2 and 4 years of age were evaluated once with the Early Childhood Test...

The combination of physical exercise and slow-paced breathing on psychophysiological indices of emotion reactivity, psychosocial stress reactivity and recovery: A multimodal investigation

Emmanuelle Schoonjans, Emmanuelle Schoonjans, Zefeng Li, Jens Allaert, Jens Allaert, Evi Wezenbeek, Evi Wezenbeek, Pieter Van den Berghe, Pieter Van den Berghe, Simon Helleputte, Stefanie De Smet, Stefanie De Smet, Rudi De Raedt & Marie-Anne VanderhasseltBehaviour Research and Therapy

Stress is a major public health problem calling for scalable interventions. Physical activity (PA) and slow-paced breathing (SPB) can reduce stress, both by modulating cardiac parasympathetic activity. Given their shared target but different mechanisms, combining SPB and PA could enhance their stress-reducing effects. This study therefore explores whether SPB (vs control breathing at a faster rate) after PA increases the impact of PA on psychophysiological indices of emotional reactivity and psychosocial stress reactivity and recovery. In a crossover ran...

Assessment and recognition of driver situation awareness in conditional autonomous driving: Integrating cognitive psychology and machine learning

Jing Huang, Tingnan Liu, Yezi Hu, Zhipeng He & Lin HuJournal of Industrial Information Integration

Driver Situation Awareness (SA) is crucial for the safety of conditional autonomous driving, posing a significant human factors challenge for the automotive industry in its pursuit of intelligent driving systems. To guide future automotive system design and enhance Human–Machine Interaction (HMI), the present paper presents an interdisciplinary solution that achieves the assessment and recognition of driver SA by deeply integrating cognitive psychology theories and machine learning techniques. First, a takeover driving study was designed and conducted du...

earEOG via periauricular electrodes to facilitate eye tracking in a natural headphone form factor

Tobias King, Michael Knierim, Philipp Lepold, Christopher Clarke, Hans Gellersen, Hans Gellersen, Michael Beigl & Tobias RöddigerScientific Reports

Eye tracking technology is frequently utilized to diagnose eye and neurological disorders, assess sleep and fatigue, study human visual perception, and enable novel gaze-based interaction methods. However, traditional eye tracking methodologies are constrained by bespoke hardware that is often cumbersome to wear, complex to apply, and demands substantial computational resources. To overcome these limitations, we investigated the application of Electrooculography (EOG) eye tracking using 14 electrodes positioned around the ears, integrated into a custom-b...

An EEG-network-metric based approach to real-time trust inference in human-autonomy teaming

Gregory Bales, Allison P. A. Hayman, Torin K. Clark, Jason Dekarske, Sanjay Joshi & Zhaodan KongFrontiers in Neuroergonomics

Efficient and effective teaming between humans and autonomous systems requires the establishment and maintenance of trust to maximize team task performance. Despite advances in autonomous systems, human expertise remains critical in tasks fraught with deviations from procedures or plans that cannot be pre-programmed. As autonomous systems become more sophisticated, they will possess the ability to positively influence interactions with their human partners, provided the autonomous systems have a real-time estimation of their human partner's cognitive sta...

Decoding the Digits: How Number Notation Influences Cognitive Effort and Performance in Chinese-to-English Sight Translation

Xueyan Zong, Lei Song & Shanshan YangBehavioral Sciences

Numbers present persistent challenges in interpreting, yet cognitive mechanisms underlying notation-specific processing remain underexplored. While eye-tracking studies in visually-assisted simultaneous interpreting have advanced number research, they predominantly examine Arabic numerals in non-Chinese contexts-neglecting notation diversity increasingly prevalent in computer-assisted interpreting systems where Automatic Speech Recognition outputs vary across languages. Addressing these gaps, this study investigated how number notation (Arabic digits vs....

Value-Driven Anticipatory Looking to Emotional Faces in 8-Month-Old Infants

Mitsuhiko Ishikawa, Tim J. Smith & Tim J. SmithEmotion

Developmental studies have adopted preferential-looking paradigms to investigate infant interest in emotional face stimuli. However, because of the attention-grabbing nature of threatening stimuli, research has reported inconsistent results regarding infants' fixation on happy and angry faces. A recent value-based framework of social looking behavior suggested that infants' looking behavior depends on the value of looking (i.e., the expected reward value of a specific looking behavior). Using anticipatory-looking tests alongside preferential-looking test...

Socially oriented attention in young children with neurofibromatosis type 1: An eye‐tracking study

Kristina M. Haebich, Kristina M. Haebich, Darren R. Hocking, Darren R. Hocking, Hayley Darke, Rachel Mackenzie, Kathryn N. North, Kathryn N. North, Giacomo Vivanti, Jonathan M. Payne, Jonathan M. Payne & Jonathan M. PayneDevelopmental Medicine & Child Neurology

Artificial IntelligenceM: To examine visual engagement to social stimuli and response to joint attention in young children with neurofibromatosis type 1 (NF1) and typically developing peers (controls).METHOD: Forty-five preschool children were studied cross-sectionally (mean age [SD] = 4 years 3 months [10 months]), 25 with NF1 and 20 typically developing controls. Participants passively viewed two eye-tracking paradigms. The first measured participants' time to first social fixation and duration of attention to social stimuli. The second assessed respon...

  • Tobii Pro X60 / X120 / T60 / T120
  • Tobii Pro Studio

The effects of an integrated sports and arts intervention on response joint attention (RJA) eye-movement characteristics in children with mild autism

Qi-Fan Wu & Wei-Min CaiPLOS One

This study examines whether integrating sports and arts interventions enhances response joint attention (RJA) in children with mild autism and provides insights for diversifying intervention strategies for autism. 2024.6–2024.12,Twenty-four children with autism, aged 6–12 years, were recruited from an autism association in Anhui Province, China. Participants were randomized using a computer-generated sequence (allocation concealed from assessors) assigned to an experimental group (n = 12) or a control group (n = 12). Over 12 weeks, the experimental group...

Refining Mathematical Task Difficulty for Accurate Mental Workload Estimation

Denny Yu, Dongyang Li, Emily Garcia, Eugenio Frias-Miranda, Jingkun Wang & Zhengming Zhang

Accurate classification of mathematical difficulty is essential for quantifying mental workload (MWL) in cognitive research. This study introduces a novel method that defines difficulty based on the number of interim values stored during each stage of verbal arithmetic. Twenty-six participants completed six levels of math tasks, with task performance and eye-tracking data (fixations and Saccade Researchs) collected to evaluate the framework. Performance results showed significantly higher accuracy in Levels 1 and 2 and meaningful differences between Leve...

Self-relevant facial threat attracts peripheral attention

David Terburg & Sjoerd StuitPLOS One

Threat-relevance theory suggests that gaze direction determines the self-relevance of facial threats. Indeed, angry eye-contact is a more relevant threat compared to its counterpart with averted gaze. Similarly, fearful eye-contact is not a threat to the observer, but averted fearful gaze can signal a relevant threat nearby. Following evidence that amygdala-reactivity to self-relevant threat depends on coarse visual processing, we investigate whether self-relevant threat attracts attention due to processing of low spatial frequency information via periph...

Exploring preparatory reading in bidirectional sight and written translation through clustering analysis of eye-tracking data

Jia Feng, Michael Carl & Shirong ChenSoftware and Systems Modeling

Preparatory reading—the phase between a translator’s initial reading of the source text and the production of the first word of the target text—remains underexplored despite its crucial role in both sight (SiT) and written translation (WT). This study examined preparatory reading patterns of 32 student translators, focusing on the effects of translation mode (SiT vs. WT) and direction (L1-to-L2 vs. L2-to-L1). Translators’ attention allocation, cognitive effort, and reading speed were measured using preparatory reading duration, average fixation duration,...

The effects of acute alcohol intake on endogenous vs. exogenous attention in visual perception

Dan Huang, Fusong Chen, Kun Liao & Yao Chen

Acute alcohol consumption is known to impair visual perception, yet the underlying mechanisms remain poorly understood. Visual perception is influenced by visual attention, which comprises two distinct components: endogenous (voluntary) and exogenous (involuntary) attention. This study investigated how a moderate alcohol dose alters attentional modulation of visual perception. Participants performed an orientation discrimination task, reporting the tilt of a peripheral Gabor patch target. Valid, neutral, or invalid precues-central (endogenous) or periphe...

  • Tobii Pro X60 / X120 / T60 / T120
  • SDK
  • Open Source Presentation

Influence of a Short‐Term Attention Intervention on the Attentional Skills of Toddlers With Suspected or Confirmed Autism Spectrum Disorder

Emily J. H. Jones, Isabel M. Smith, Jessica A. Brian, Lonnie Zwaigenbaum, Lori‐Ann R. Sacrey, Mark H. Johnson & Sam WassEvolution and Human Behavior

Examination of the effectiveness of an attention intervention using a randomized controlled trial for toddlers with suspected or confirmed autism spectrum disorder (ASD). Data was collected from Alberta, Ontario, and Nova Scotia, Canada between February 2018 and February 2020 (halted due to COVID‐19 pandemic). Participants were 35 toddlers randomized to the attention condition (age at start: 25.49 + 3.91 months; 29 boys; mother’s ethnicity: 65% white) and 34 toddlers randomized to a control condition. (age at start: 26.32 + 3.55 months; 24 boys; mother’s...

Audio-Visual Speech Synchrony Impacts Gaze Patterns in Autism

Jialu Chen, Jing Liu, Li Yi, Qiandong Wang, Qinyi Liu, Tingni Yin, Xiaoyun Gong, Xing Su, Xue Li, Xuerong Luo & Zhaozheng JiTeaching and Learning in Nursing

In daily conversations, people integrate multimodal cues from faces and adapt their gaze patterns to enhance comprehension according to the situation. Here we used eye-tracking to explore whether autistic individuals can adjust their face-viewing patterns flexibly when speech audio and visual information are asynchronous, with a primary focus on preschool-aged children. Participants from preschool cohort, including 72 autistic and 57 non-autistic individuals aged 3–6 years, watched videos of an actress speaking in either temporal synchrony or asynchrony ...

Inferring Comprehension of Social Interaction from Eye Tracking in Neurodiverse Individuals in Rural Settings

Addy P. Bolton, Andie Madsen, Anna J. Erickson, Bernadette McCrory, Carter Storrusten, George Horowitz, Gloria Marie Baldevia, Grace Clark, Jesse Melius, Katherine E. Pliska, Mackenzie K. Hughes, Mara Campbell, Nadezhda (Nadya) Modyanova & Yanwen Xu

Background: Research shows deficiencies in social abilities in Autism Spectrum Disorder (ASD) are related to impaired Theory of Mind (ToM), further negatively impacted by language impairment. Both challenges are especially pronounced in rural populations. Given that ~25-35% of children with ASD are minimally verbal or nonspeaking, we employed a low-verbal ToM task, using eye tracking to measure attention, to better represent ASD population for ToM evaluation. Methods: Colle et al.’s (2007) low-verbal ToM task was adapted as 26 15-60 second videos, ...

Listening Effort for Soft Speech in Quiet

Florian Denk, Hendrik Husstedt, Jennifer Schmidt, Luca Wiederschein, Markus Kemper & Robert WiedenbeckBritish Journal of Learning Disabilities

In addition to speech intelligibility, listening effort has emerged as a critical indicator of hearing performance. It can be defined as the effort experienced or invested in solving an auditory task. Subjective, behavioral, and physiological methods have been employed to assess listening effort. While previous studies have focused predominantly evaluated listening effort at clearly audible levels, such as in speech-in-noise conditions, we present findings from a study investigating listening effort for soft speech in quiet. Twenty young adults with norm...

Reciprocal trust: how the interpreter’s professional face is defended and sustained multimodally in video-mediated interpreting

Esther de Boe, Mathijs Verhaegen & Nina Reviers

In dialogue interpreting (DI), trust is considered a prerequisite for mutual understanding. Clients must trust interpreters’ professional competence, while interpreters rely on clients to recognise their professional role and engage cooperatively. Moments of interpreter-initiated repair potentially threaten interpreters’ professional face, impacting trust building. Drawing on a micro-analytical, interactional framework, this study investigates reciprocal trust by analysing how interpreters defend their professional face and how clients sustain this. Give...

Optimal phase for central and peripheral visual detection differs within the stride-cycle

Cameron Kyle Phan, David Alais & Matthew J Davidson

It is important to investigate perception in the context of natural behaviour in order to reach a holistic account of how sensory processes are coordinated with actions. In particular, the effect of walking upon perceptual and cognitive functions has recently been investigated in the context of how common voluntary actions may dynamically impact upon visual detection. This work has revealed that walking can enhance peripheral visual processing, and that during walking, performance on a visual detection task alternates through good and bad periods within ...

  • Tobii VR
  • SDK

Simultaneous interpreting experience enhances semantic prediction in Turkish

Deniz Özkan, Ebru Diriker & Ena Hodzik

This study investigates prediction based on verb semantics in a Turkish monolingual comprehension task in professional and student Turkish (A)–English (B) interpreters. Predictive eye movements were compared between the two groups to examine potential differences in the size of the semantic prediction effect. In addition, the participants’ working memory capacity was measured to see whether working memory facilitates prediction and whether this facilitatory effect differs between the two groups. We found a stronger semantic prediction eff...

  • Tobii Pro X60 / X120 / T60 / T120

Improving question answering from short texts by 9- to 11-year-old children using induction tasks

Christine Ros, Delphine Oger, Elise Tornare, Nicolas Vibert & Sabine Févin

Visually searching for verbal information is a complex activity for young readers. An eye-tracking experiment was conducted to investigate whether preactivation of different word-processing pathways by means of semantic or perceptual induction tasks could help children aged 9 to 11 to search for answers to questions in short texts (about 150 words). The type of questions asked (surface vs. inferential) and the nature of the induction tasks (semantic vs. perceptual) were manipulated. In addition, the quality of students’ lexical representations was assess...

  • Tobii Pro X60 / X120 / T60 / T120
  • Tobii Pro Studio

Contrastive Verbal Guidance: A Beneficial Context for Attention To Events and Their Memory?

Amit Singh & Katharina J. RohlfingiScience

Research suggests that presenting an action via multimodal stimulation (verbal and visual) enhances its perception. To highlight this, in most studies, assertive instructions are generally presented before the occurrence of the visual subevent(s). However, verbal instructions need not always be assertive; they can also include negation to contrast the present event with a prior one, thereby facilitating processing—a phenomenon known as contextual facilitation. In our study, we investigated whether using negation to guide an action sequence facilitates ac...

Multimodal Framework for Automatic Behavior Analysis of Children with Autism During ADOS-2

Ádám Fodor, András Lőrincz, András Sárkány, Bruno Carlos Dos Santos Melício, Emily Dillon, Kaan Karaköse, Kristian Fenech, Latha Soorya, Linyun Xiang, Mohamed Chetouani, Péter Kun & Viktor Varga

The rising prevalence of autism spectrum disorder, coupled with limited professional resources, highlights the urgency of developing efficient diagnostic tools. While standardized assessments exist, identifying subtle communication deficits, especially during multimodal interactions, remains time-consuming and prone to human error. To address this, we propose an automated behavior analysis framework that aims to support clinicians by accurately detecting both verbal and non-verbal communication markers. Specifically, we put forth a composite artificial i...

The neural impact of editing on viewer narrative cognition in virtual reality films: eye-tracking insights into neural mechanisms

Qiaoling Zou, Wanyu Zheng, Zishun Su, Li Zhang, Ziqing Zhuo & Dongning LiCreating Communication and Media Research Labs

IntroductionThe development of virtual reality (VR) films requires novel editing strategies to optimize narrative cognition in immersive environments. While traditional film editing guides attention through controlled sequences of shots, the interactive nature of VR disrupts linear storytelling, challenging creators to balance emotional experience and spatial coherence. By combining eye-tracking technology with neuroscientific findings, this study aims to investigate how different editing techniques in virtual reality (VR) films affect viewers' narrative...

Challenges with shifting, regardless of disengagement: attention mechanisms and eye movements in Williams syndrome

Astrid Hallman, Charlotte Willfors, Christine Fawcett, Matilda A. Frick, Ann Nordgren & Johan Lundin KlebergComputer Animation and Virtual Worlds

BackgroundPeople with Williams syndrome (WS) face challenges in various areas of cognitive processing, including attention. Previous studies suggest that these challenges are particularly pronounced when disengagement of attention from a previously attended stimulus is required, as compared to shifting attention without the need to disengage. Difficulties with attention could in turn be implicated in several of the behavioral characteristics of WS. Here, disengagement and shifting of visual attention, together with Pupil Research dilation, were independe...

Investigating EFL learners’ reading comprehension processes across multiple choice and short answer tasks

Jufang Kong & Mingwei Pan

Reading comprehension is an essential language skill and cognitive ability usually elicited and examined through tasks. Investigations into the effects of task type on reading comprehension have mostly focused on reading outcome (accuracy) and drawn divergent conclusions because of research instrument restrictions. This study employed eye tracking to explore 43 Chinese English as a foreign language (EFL) learners’ reading comprehension processes with the multiple choice (MC) and short answer (SA) tasks based on Khalifa and Weir’s model of reading. It was...

Cluttered screens: an eye-tracking study of visual attention allocation among viewers of TV news

Jan Hensellek

Contemporary television news programmes are often complex examples of hybrid communication (see Bucher, ‘Multimodal understanding or reception as interaction’, 2011). Television news presents related as well as unrelated information in both a linear and non-linear fashion by combining the news read with a variety of visual elements. Studies utilizing eye-tracking have found the visual attention received by the various types of elements to vary considerably (see Josephson and Holmes, ‘Clutter or content? How on-screen enhancements affect how TV viewer...

Choosing Versus Rejecting: The Effect of Decision Mode on Subsequent Preferential Choices

Sangsuk Yoon & Vinod Venkatraman

People often make decisions by either choosing an alternative they like (choose mode) or rejecting alternatives they dislike (reject mode). Previous research has demonstrated that these two decision modes involve distinct cognitive processes. In the current work, we further investigate whether these distinct cognitive processes in these two decision modes symmetrically or asymmetrically impact people's subsequent preferences for their preferred (chosen or nonrejected) alternatives. Across three experiments involving consumer goods, we found that particip...

  • Tobii Pro X60 / X120 / T60 / T120

Eyes Tell All: Dissecting Attentional Bias in Social Anxiety through Emotional Faces

Yifan ZHAO, Chengshi LI, Yibo JIANG & Hongge JIA

The present study employed eye-tracking technology and a free-viewing paradigm to explore the mechanisms of attentional bias toward emotional faces in individuals with social anxiety, using real and cartoon faces (angry, happy, disgusted, neutral) as stimuli. In Experiment 1, socially anxious individuals demonstrated significantly reduced total fixation duration and count on the eye regions of all four emotional face types presented by real people compared to controls. They also showed shorter fixation durations and fewer fixations on the facial area ass...

ConASD: Contrastive Few Shot Learning for Detecting Autism Spectrum Disorder via Eye Tracking Scanpath

Sharifah Mousli, Sona Taheri & Estrid He

Detecting Autism Spectrum Disorder (ASD) using Eye Tracking (ET) datasets is a challenging task and has been a long-standing problem. Recently, there has been a trend of developing ASD diagnosis models based on machine learning (ML), especially deep learning techniques. In this paper, we show that these existing methods still struggle to make accurate diagnoses in few-shot learning (FSL) settings, where the data available for training is limited in amount and imbalanced in nature. To address this challenge, we propose a model, named ConASD, for effective...

Prediction efficiency and incremental processing strategy during spoken language comprehension in autistic children: an eye-tracking study

Zihui Hua, Tianbi Li, Ruoxi Shi, Ran Wei & Li YiScientific Reports

BackgroundLanguage difficulties are common in autism, with several theoretical perspectives proposing that difficulties in forming and updating predictions may underlie the cognitive profile of autism. However, research examining prediction in the language domain among autistic children remains limited, with inconsistent findings regarding prediction efficiency and insufficient investigation of how autistic children incrementally integrate multiple semantic elements during language processing. This study addresses these gaps by investigating both predict...

Performance‐Based Executive Functions Predict Internalising but Not Externalising Maladaptive Behaviour in Students With ID

Stephan Kehl & Nina Römer

BackgroundMaladaptive behaviour is common in students with intellectual disability (ID). While executive functions (EFs) in typically developing children and adolescents are associated with maladaptive behaviour, there is currently contradictory and only fragmented empirical evidence on this association in students with ID. However, following impairments of EFs in this population, investigating this relationship could enhance the understanding of the development of maladaptive behaviour in students with ID.MethodThe sample consisted of 45 students with I...

Developmental trajectories of predictive mechanisms in language comprehension.

Armando Quetzalcóatl Angulo-Chavira, Alejandra Mitzi Castellón-Flores & Natalia Arias-TrejoTeaching Mathematics and its Applications An International Journal of the IMA

In this investigation, we delved into the developmental progression of two predictive mechanisms in language comprehension: the associative (Mechanism 1) and the context- and intention-dependent (Mechanism 2). Across three experiments, we assessed the ability to predict semantic content based on syntactic cues among toddlers and adults. Participants were exposed to correction (e.g., "In the yard, I saw a dog, no, a rabbit") and coordination (e.g., "In the yard, I saw a dog and a rabbit") sentences. Concurrently, they viewed four competing images: two nou...

  • Tobii Pro X60 / X120 / T60 / T120
  • Tobii Pro Lab
  • Open Source Presentation

Infants Discriminate Subtle Nasal Contrasts Late: Evidence From Field Psycholinguistic Experiments on Tagalog-Learning Infants in the Philippines

Rowena Garcia, Rowena Garcia, Rowena Garcia, Michael C. Valdez & Natalie Boll-AvetisyanDevelopmental Research

Studies suggest that infants initially show universal discrimination abilities. However, this narrative has been heavily based on Indo-European languages. It has also been proposed that infants' speech sound discrimination is affected by acoustic salience, such that acoustically subtle contrasts are not discriminated until the end of an infant's first year. Furthermore, others have suggested an influence of word position and positional frequency in discrimination abilities. In Study 1, we analyzed a child-directed corpus of Tagalog and found that the /n/...

Dis/Associations Between Language and In‐the‐Moment Mental Rotation Effort in Autism

Caroline Larson, Caroline Larson, Laura M. Morett, Laura M. Morett, Sophie Barth, Stephanie Durrleman & Mila VulchanovaAutism Research

In-the-moment dissociations between language and visuospatial systems in autism spectrum disorder (ASD) may explain notable heterogeneity observed in both language and visuospatial skills. The current study used Pupil Researchlometry, a physiological measure of in-the-moment cognitive effort, during a mental rotation task to examine associations between structural language and visuospatial cognition. Participants were 25 children and young adults with ASD and 25 age- and IQ-matched neurotypical (NT) peers. The mental rotation task involved four condition...

  • Tobii Pro X60 / X120 / T60 / T120

Embracing chaos: the unpredictability of animated logos shapes users’ sustained attention

Wen Guan, Dong Min Cho & Li ZhengFrontiers in Psychology

Introduction: Animated logos have become a substantial investment in brand marketing, and designers tend to use flashy presentation effects for brand animations. Brands must understand how effectively animated logos capture users' attention in media communication of visual distractions. However, the reasons for the impact on users' sustained attention are not yet clear. By investigating users' perceptions of animated brand logos, this study proposes a new dimension: "perceived unpredictability."Methods: Combining previous studies on physics, psychology, ...

Cross-language interactions during concurrent comprehension and production: evidence from simultaneous interpreters

Xueni Zhang, Binghan Zheng, Yan Jing Wu & Yan Jing WuApplied Psycholinguistics

Abstract It has been established that bilinguals activate both languages even when only one language is being used. However, little is known about how the two languages are co-activated during simultaneous interpreting (SI), a demanding task involving intensive code-switching. This study investigated (1) the effect of task on cross-language co-activation and (2) the time course of co-activations triggered by form and meaning. Thirty-one professional interpreters were recruited to complete a cross-language task (English-to-Chinese SI) and a within-languag...

Visualisation Patterns in Visual Reasoning Tasks with Different Complexity Levels: Insights from Human and Machine Approach

Debayan Bhattacharya, Amit Mahendra Paikrao, Soumya Panja, Anup Kumar Roy & Rajlakshmi GuhaLecture Notes in Educational TechnologyProceedings of the International Conference on Technology 4 Education 2024, Volume 1

Task complexity plays a crucial role in cognitive development, problem-solving skills, and effective learning. Engaging with complex tasks stimulates higher-order thinking, boosts learner motivation, and prepares students for real-world challenges and advanced studies. This study investigates how different levels of task complexity (low, medium, high) affect visual attention sequences and contrasts human scanpaths with those derived from the Compositional Language and Elementary Visual Reasoning (CLEVR) dataset’s computational model. Using eye-tracking t...

EEG and Eye-Tracking Signal Fusion for Mild Depression Identification Under Visual Illusion Stimulation

Yuhui Pan, Yuze Zhang, Zhongliang Yu & Lili Li2025 IEEE International Conference on Mechatronics and Automation (ICMA)

To overcome the subjectivity inherent in traditional depression diagnosis, this study explored the potential for objective detection using multimodal physiological signals and deep learning. Electroencephalogram (EEG) and eye-tracking data were collected from healthy controls (HC) and a mild depression (MD) group while they viewed a rotating tunnel visual illusion stimulus. Functional connectivity was characterized using Pearson correlation coefficient matrices derived from EEG signals, and eye-tracking trajectory data were processed. A dual-stream deep ...

  • SDK
  • Open Source Presentation

Hyper to Dynamic and Static Facial Expression and Emotions in Social Anxiety: An Eye-Tracking Study

Rianne Gomes e Claudino, Ricardo Basso Garcia & Nelson Torro-AlvesPSYCHOLOGY AND NEUROSCIENCE

Objective: Research has shown attentional bias and hyper in individuals with social anxiety during the observation of emotional Facial Expression and Emotions, particularly with static stimuli. We investigated the recognition of dynamic and static Facial Expression and Emotions and eye-tracking correlates. Method: Participants were 56 volunteers divided into a control group and a social anxiety group (SAG). Stimuli were emotional faces of joy, disgust, anger, and sadness presented in four emotional intensities (25%, 50%, 75%, 100%) statically and dynamic...

Very Young Children Learning German Notice the Incorrect Syllable Stress of Words

Ulrike Schild & Claudia Katrin FriedrichLanguages

Syllable stress can help to quickly identify words in a language with variable stress placement like German. Here, we asked at what age incorrect syllable stress impairs language learners’ attempts to assign meaning to familiar words. We recorded the looking times of young children learning German aged from 4 to 15 months (infants, N69) and 2 to 4 years (toddlers, N28). Participants saw displays of two pictures (e.g., a car and a baby); one of both objects (the target) was named. The disyllabic name of the target was either correctly stressed on the firs...

Early Emerging Gradients in Children's Eye Movement Times Across Levels of Household Resources

Jukka M. Leppänen, Juha Pyykkö, Denise Evans, Lezanie Coetzee, Günther Fink, Aisha K. Yousafzai, David H. Hamer, David H. Hamer, Doug Parkerson & Peter C. RockersDevelopmental Science

Studies in low-resource settings suggest that multiple aspects of early childhood development are sensitive to the relative poverty of a child's environment. We examined whether direct, quantitative measures of early developing cognitive functions show a similar association with relative poverty. Eye movement latencies were recorded in children at 7, 17, and 36 months in rural South Africa (N = 374). The latency to respond to the appearance of visual objects was inversely associated with a proxy measure of the child's socioeconomic environment (household...

Pupil Research responses to social stimuli are associated with adaptive behaviors across the first 24 months of life

Rebecca Grzadzinski, Rebecca Grzadzinski, Rebecca Grzadzinski, Raymond S. Carpenter, Raymond S. Carpenter, Josh Rutsohn, Alapika Jatkar, Kattia Mata, Ambika Bhatt, Maria M. Ortiz-Juza, Maria M. Ortiz-Juza, Maria M. Ortiz-Juza, Madison R. Dennehey, Donna Gilleskie, Jed T. Elison, Nicolas Pégard, Nicolas Pégard, Nicolas Pégard, Nicolas Pégard, Jose Rodriguez-Romaguera, Jose Rodriguez-Romaguera, Jose Rodriguez-Romaguera, Jose Rodriguez-Romaguera, Jose Rodriguez-Romaguera & Jose Rodriguez-RomagueraJournal of Neurodevelopmental Disorders

BackgroundPupil Research changes in response to well-controlled stimuli can be used to understand processes that regulate attention, learning, and arousal.This study investigates whether Pupil Research dynamics to social stimuli are associated with concurrent adaptive behavior in typically developing infants. To accomplish this, we developed and assessed Pupil Researchlary responses to Stimuli for Early Social Arousal and Motivation in Infants (SESAMI).MethodsA sample of forty-six typically developing children aged six to twenty-four months were exposed ...

Effects of appearance modifications on oral presentation anxiety in video conferencing

Ziting Gong & Hideaki KanaiScientific Reports

Oral presentations are considered to provoke high levels of anxiety, yet limited research has explored this phenomenon in the context of video conferences. Considering the feasibility of private facial filters in video calls and the impact of audience appearance on speakers’ experiences, we propose modifying the visual representation of the audience to reduce oral presentation anxiety in video conferences. We found literature evidence supporting the effectiveness of both highly familiar appearances and attractive anime characters in reducing anxiety. Bui...

Investigating Foreign Language Vocabulary Recognition in Children with ADHD and Autism with the Use of Eye Tracking Technology

Georgia Andreou & Ariadni ArgatzopoulouBrain Sciences

BACKGROUND: Neurodivergent students, including those with Autism Spectrum Disorder (ASD) and Attention Deficit/Hyperactivity Disorder (ADHD), frequently encounter challenges in several areas of foreign language (FL) learning, including vocabulary acquisition. This exploratory study aimed to investigate real-time English as a Foreign Language (EFL) word recognition using eye tracking within the Visual World Paradigm (VWP). Specifically, it examined whether gaze patterns could serve as indicators of successful word recognition, how these patterns varied ac...

Sign- vs. goal-tracking is associated with greater adiposity and altered functional connectivity in response to a naturalistic food paradigm

Afroditi Papantoni, Afroditi Papantoni, Grace E Shearrer, Lindsey Smith Taillie, Saame Raza Shaikh, Katie A Meyer, Elianna Paninos, Alexxai V Kravitz, Kyle S Burger, Kyle S Burger & Kyle S BurgerPhysiology & Behavior

Our modern food environment is full of highly palatable, ultra-processed foods that influence our eating behaviors. The reinforcement learning framework posits that some individuals readily assign motivational value to environmental cues (e.g., food ads) that predict reward, biasing their attention and making them more susceptible to seek that reward. These individuals are characterized as sign-trackers and differ from goal-trackers who do not tend to assign motivational value to those reward-predicting environmental cues. Here, we tested whether this we...

Eyes on the prize: Eye-tracking evidence of attentional biases toward gambling and natural rewards

Francisco-Luis Sánchez-Fernández, María Isabel Viedma-Del-Jesus, José-Ángel Ibáñez-Zapata, Juan Sánchez-Fernández & Francisco-Javier Montoro-RíosInternational Journal of Psychophysiology

The present study investigates attentional biases (ABs) in gamblers and non-gamblers, focusing on both gambling-related and food-related stimuli to examine the relationship between these biases and the Incentive Sensitization (IS) and Reward Deficiency Syndrome (RDS) models of addiction. Using an eye-tracking methodology, we assess how ABs differ across three conditions involving two types of images: Food vs. Gambling, Food vs. Neutral, and Gambling vs. Neutral. Gamblers showed a significant AB toward gambling-related stimuli compared to neutral cues, su...

Analyzing Visual Attention in Virtual Crime Scene Investigations Using Eye-Tracking and VR: Insights for Cognitive Modeling

Wen-Chao Yang, Wen-Chao Yang, Chih-Hung Shih, Chih-Hung Shih, Jiajun Jiang, Jiajun Jiang, cxchen@odu.edu,, Sergio Pallas Enguita, Sergio Pallas Enguita, cxchen@odu.edu,, Chung-Hao Chen, Chung-Hao Chen & cxchen@odu.edu,Electronics

Understanding human perceptual strategies in high-stakes environments, such as crime scene investigations, is essential for developing cognitive models that reflect expert decision-making. This study presents an immersive experimental framework that utilizes virtual reality (VR) and eye-tracking technologies to capture and analyze visual attention during simulated forensic tasks. A360° panoramic crime scene, constructed using the Nikon KeyMission 360 camera, was integrated into a VR system with HTC Vive and Tobii Pro eye-tracking components. A total of 4...

  • Tobii VR
  • SDK

A foundation model-based framework for unsupervised gaze anomaly detection

Kritika Johari, Jung-Jae Kim, Wei Quin Yow & U-Xuan TanKnowledge-Based Systems

Traditional gaze analysis methods for online lecture largely depend on predefined average gaze features and self-reported ground-truths, limiting their ability to obtain real-time status in unsupervised settings. To address this, we propose Gaze-READ (Gaze Representative Embedding and Anomaly Detection), a framework that integrates gaze behavior analysis with unsupervised anomaly detection to systematically identify attention shifts caused by external stimuli. Our approach leverages GazeMTM (Masked Time-Series Modeling of Gaze), which employs MOMENT, a t...

Peripheral overconfidence in a scene categorization task

Nino Sharvashidze, Matteo Toscani & Matteo ValsecchiJournal of Vision

Our ability to detect and discriminate stimuli differs across the visual field. Does metaperception (i.e., visual confidence) follow these differences? Evidence is mixed, as studies have reported overconfidence in peripheral detection tasks and underconfidence in a peripheral local orientation discrimination task. Here, we tested whether overconfidence can arise in a task that aligns with the strengths of peripheral vision: rapid scene categorization. In each interval, our participants viewed a scene only in the periphery (scotoma) or only in the center ...

  • SDK

Sign Tracking and Alcohol Consumption: A Translational Computerized Task Assessing Individual Differences in Humans

Michelle Heck, Jessica Simon, Damien Lesenfants, Vincent Didone, Patrick Anselme & Etienne QuertemontMotivation Science

Individuals differ in their tendency to assign motivational value to reward-predictive cues, conceptualized as “sign tracker” (ST) versus “goal tracker” (GT) behaviors in animal models. STs approach a reward-predictive cue, while GTs go to the location of reward delivery. An intermediate phenotype is sometimes identified. These profiles have been linked to addiction vulnerability because of a higher propensity to sign-track in drug-addicted rats. However, efforts to translate this model to humans have yielded inconsistent findings, partly because of vari...

  • SDK

Is Pupil Research Response to Speech and Music in Toddlers with Cochlear Implants Asymmetric?

Amanda Saksida, Amanda Saksida, Marta Fantoni, Sara Ghiselli & Eva OrzanAudiology Research

Background: Ear advantage (EA) reflects hemispheric asymmetries in auditory processing. While a right-ear advantage (REA) for speech and a left-ear advantage (LEA) for music are well documented in typically developing individuals, it is unclear how these patterns manifest in young children with cochlear implants (CIs). This study investigated whether Pupil Researchlometry could reveal asymmetric listening efforts in toddlers with bilateral CIs when listening to speech and music under monaural stimulation. Methods: Thirteen toddlers (mean age = 36.2 month...

  • Tobii Pro X60 / X120 / T60 / T120

Predicting anxiety symptoms through gaze-directed attention: A mobile eye-tracking study of adolescents during a real-world speech task

Emily Hutchinson, Erica Huynh, Mary Woody, Dev Chopra, Amelia Lint, Enoch Du, Kristy Benoit Allen, Cecile Ladouceur & Jennifer SilkJournal of Anxiety Disorders

Adolescence is a key period in which anxiety symptoms dramatically increase, particularly among adolescent girls. Identifying potentially-modifiable risk factors that contribute to anxiety symptoms may be critical to mitigate anxiety symptoms and disorders among youth. Attention biases are one set of cognitive risk factors implicated in the development and maintenance of anxiety disorders. Yet previous research remains mixed as to what pattern of attention bias characterizes adolescents at-risk for developing anxiety. Further, prior literature has largel...

Memory Detection in Virtual Reality: The Effect of Scene Modifications

Ine Van der Cruyssen, Ine Van der Cruyssen, Gershon Ben-Shakhar, Bruno Verschuere & Yoni PertzovJournal of Applied Research in Memory and Cognition

Can your eyes give away your deepest secrets? In two preregistered studies, we examined whether eye movements toward modified areas of a crime scene enable to detect crime knowledge. After committing either a mock crime or an unrelated task, guilty (Study 1 n = 12; Study 2 n = 63) and innocent (Study 1 n = 21; Study 2 n = 74) participants viewed the crime scene in virtual reality to which several salient modifications were made. Guilty participants looked more (Study 1 d = 0.88; Study 2 d = 0.65) and earlier (Study 1 d = 0.66; Study 2 d = 0.52) at these ...

Spatial Guidance Overrides Dynamic Saliency in VR: An Eye-Tracking Study on Gestalt Grouping Mechanisms and Visual Attention Patterns

Qiaoling Zou, Qiaoling Zou, Wanyu Zheng, Wanyu Zheng, Xinyan Jiang, Xinyan Jiang, Dongning Li & Dongning LiJournal of Eye Movement Research

(1) Background: Virtual Reality (VR) films challenge traditional visual cognition by offering novel perceptual experiences. This study investigates the applicability of Gestalt grouping principles in dynamic VR scenes, the influence of VR environments on grouping efficiency, and the relationship between viewer experience and grouping effects. (2) Methods: Eye-tracking experiments were conducted with 42 participants using the HTC Vive Pro Eye and Tobii Pro Lab. Participants watched a non-narrative VR film with fixed camera positions to eliminate narrative...

Multimodal deep learning for art behavior analysis and personalized teaching path generation

Yikun Li & Jie ShiDiscover Artificial Intelligence

In the current era of continuous innovation in educational philosophy, the importance of art education for students ‘creativity, aesthetic ability, and all-round development has become increasingly prominent, with personalized education becoming a key trend. This study focuses on art education, aiming to address the lack of personalization in traditional teaching methods by proposing innovative solutions using multimodal deep learning technology. The research constructs a Multimodal Feature Fusion Network (MFFN) and an Evolutionary Path Generation Algori...

When adding a little is adding too much: how discourse particles force immediate reanalysis and increase processing costs in under-specific contexts

Pia Järnefelt, Gustaf Gredebäck & Gunnar NorrmanLanguage and Cognition

Abstract Highly frequent discourse particles (DPs) express speaker attitudes and guide utterance interpretation, but we still lack a satisfactory explanation of how DPs are actually processed. Some results show facilitation, while others show processing costs. Previous studies have aimed to elicit core meanings of DPs embedded in highly plausible contexts, in contrast to more unlikely contexts that force two quite different interpretations. The present study uses a novel eye-tracking experiment where DPs instead are presented in low-constraint contexts. ...

Reading Assessment and Eye Movement Analysis in Bilateral Central Scotoma Due to Age-Related Macular Degeneration

Journal of Eye Movement Research

This study investigates reading performances and eye movements in individuals with eccentric fixation due to age-related macular degeneration (AMD). Overall, 17 individuals with bilateral AMD (7 males; mean age 77.47 ± 5.96 years) and 17 controls (10 males; mean age 72.18 ± 5.98 years) were assessed for reading visual acuity (VA), reading speed (Minnesota low vision reading chart in Slovene, MNREAD-SI), and near contrast sensitivity (Pelli-Robson). Microperimetry (NIDEK MP-3) was used to evaluate preferential retinal locus (PRL) location and fixation sta...

The impact of time pressure on decision-making and visual search characteristics in basketball players

Qiulin Wang & Zhi GuoCreating Communication and Media Research Labs

ObjectiveThis study aimed to investigate the effects of time pressure on decision-making and visual search behavior among college basketball players with different levels of expertise.MethodsFollowing the expert–novice paradigm, a total of 40 male participants were recruited, including 20 trained basketball athletes and 20 non-athlete college students. A  × 2 mixed factorial design was employed, with athletic expertise (athletes vs. non-athletes) as the between-subjects factor and time pressure (present vs. absent) as the within-subjects factor. Particip...

Eye-tracking measures of oculomotor speed and control as markers of cognitive ability in Malawian adolescent population: Secondary analysis of a randomized controlled trial

Karoliina Videman, Ulla Ashorn, Per Ashorn, Lotta Hallamaa, Kenneth Maleta, Charles Mangani & Jukka M. Leppänen

Processing speed and response control are fundamental properties of brain function and potential markers of cognitive ability. This study, a secondary analysis of a randomized controlled trial, examined whether eye-tracking measures of saccadic reaction time and gaze control are associated with an established cognitive ability test, Raven’s coloured progressive matrices (CPM), among 13-year-old rural Malawian adolescents (1003 participants, 50.3% boys). Mean prosaccadic reaction time (pSRTm), antiSaccade Research error rate (PE) and CPM result were obtai...

Tri-manual interaction in hybrid BCI-VR systems: integrating gaze, EEG control for enhanced 3D object manipulation

Jian Teng, Sukyoung Cho & Shaw-mung LeeProceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility

Brain-computer interface (BCI) integration with virtual reality (VR) has progressed from single-limb control to multi-limb coordination, yet achieving intuitive tri-manual operation remains challenging. This study presents a consumer-grade hybrid BCI-VR framework enabling simultaneous control of two biological hands and a virtual third limb through integration of Tobii eye-tracking, NeuroSky single-channel EEG, and non-haptic controllers. The system employs e-Sense attention thresholds (>80% for 300 ms) to trigger virtual hand activation combined ...

The Feasibility of Remote Visual-World Eye-Tracking With Young Children

Zoe Ovans, Meli René Ayala, Rhosean Asmah, Anqi Hu, Monique Montoute, Amanda Owen Van Horne, Zhenghan Qi, Giovanna Morini & Yi Ting Huang

Visual-world eye-tracking has long been a useful tool for measuring young children’s real-time interpretation of words and sentences. Recently, researchers have extended this method to virtual platforms to reduce equipment costs and recruit more diverse participants. However, there is currently limited guidance on best practices, which require individual researchers to invent their own methodologies and may prevent broader adoption. Here, we present three broad approaches for implementing nine remote visual-world eye-tracking studies, and show that this ...

Infants in Control—Evidence for Agency in 6‐ to 10‐Months‐Old Infants in a Gaze‐Contingent Eye Tracking Paradigm

Florian Markus Bednarski, Katrin Rothmaler, Simon M. Hofmann & Charlotte Grosse WiesmannEvolution and Human Behavior

The ability to control movement is a core element of agency. Previous studies of infant agency have focused on responses to sensory contingencies but neglected the importance of infants' control as a necessary indicator of agency. Here, we test whether infants flexibly control their eye movements with a gaze‐contingent eye tracking paradigm. Infants aged 6–10 months (N = 45, 18 female, recruited in a city of about 600.000 inhabitants in Germin 2022) were presented images hidden under a unicolored surface, which they could scratch free by gazing over the ...

  • Tobii Pro X60 / X120 / T60 / T120
  • SDK

Evaluation of the effect of trimline types of clear aligners on esthetic perception using eye-tracking technology and visual analog scale

Merve Kurnaz, Nuray Akbıyık Bayam, Semir Öztürk & Sibel Biren

INTRODUCTION: This study aimed to compare the impact of clear aligners with different edge finishes on esthetic perception across various specialties, using eye-tracking technology and the visual analog scale.METHODS: Three different trimlines are designed at the gingival border: short scallop, straight, and straight extended. The designed aligners were taken in the mouth without a retractor, in a dark environment with a softbox. The prepared images were turned into a survey via the Google Docs document service. The survey questioning esthetic success ac...

Learning to Draw Is Learning to See: Analyzing Eye Tracking Patterns for Assisted Observational Drawing

Fengqi Liu, Longji Huang, Zhengyu Huang & Zeyu Wang

Drawing is an artistic process involving extensive observation. Understanding how professional artists observe as they draw has significant value because it offers insight into their perception patterns and acquired skills. While previous studies used eye tracking to analyze the drawing process, they fell short in aligning gaze data with drawing actions due to the spatial and temporal gaps between observation and drawing in a model-to-paper setup. This paper presents a study in an image-to-image setup, in which artists observe a reference image and draw ...

The Cross‐Cultural Interplay of Visual Attention and Artistic Design in Comics: Insights From Eye‐Tracking Evidence on American and Japanese Readers

Yuki Shimizu, Motohiro Kozawa, Keiichi Watanuki, James S. Uleman & Honami AriharaiScience

This study investigated cross‐cultural differences in visual attention patterns during comic reading, focusing on participants with Japanese and American cultural backgrounds. Using an eye‐tracking paradigm, we examined attention processes as participants viewed pages from American comics and Japanese manga featuring objective or subjective viewpoints. The results showed that for objective pages, American readers exhibited relatively longer fixations on focal objects, while Japanese readers allocated relatively more attention to backgrounds, aligning wit...

Canonical cortico-hippocampal dynamics underlie memory of navigational episodes and its early decline in aging

Jaeseob Lim, Sang-Eon Park, Sang-Hun Lee & Sang Ah Lee

Successful encoding of a navigational episode entails the dynamic processing of perceptual information, time-locked to the appearance of salient landmarks and turns along the way. We hypothesized that identical navigational experiences will be represented in a similar manner across individuals and that a deviation from such canonical dynamics in the cortico-hippocampal network may underlie differences in navigational memory across individuals and its decline in aging. 76 participants (42 females) across two age groups (young: 20-30 years, aging: 50-65 ye...

How Do Learners Read the\xa0Content in\xa0a\xa0Multi-source Reading-to-Write Task? – A Multimodal Study

Debarshi Nath, Dragan Gašević, Yizhou Fan & Ramkumar Rajendran

Text comprehension is an important skill that a student can develop, and reading behaviours like skimming and scanning can provide deep insights into how comprehension unfolds in realtime. These behaviours can be examined through deliberate eye movements, which offer a unique lens for investigating reading processes. Yet, most studies rely on low-level eye gaze metrics, such as fixations, as proxies for reading that do not distinguish reading from other tasks like video watching. More precise operationalisations of reading behaviours can provide deeper i...

Ocular measures of controlled processing: Examining the use of proactive cognitive control in the AX-CPT

Jason F. Reimer, Kevin P. Rosales, Anthony Sierra, Kyle Mobly & Andrew Rivera

Assessing the use of proactive cognitive control is essential for understanding how thoughts and actions are regulated. The present study aimed to determine whether proactive control can be measured through patterns of eye movements during the cue–probe delay in a spatially modified AX-CPT. Across two experiments, we found that gaze activity at screen locations where cues and probes appeared predicted both the extent of proactive control adopted by participants and their ability to override a prepotent response tendency. However, the specific cognitive p...

  • Tobii Pro X60 / X120 / T60 / T120
  • Tobii Pro Studio

Predicting Cognitive Workload in Visuospatial Tasks Using Pupil Researchlometry: A Machine Learning Approach

Sachithra Karunathilake, Nurul Ahad Choudhury, Akash Deep & Pratima Saravanan

Monitoring and controlling cognitive workload are critical for maintaining smooth performance in complex visuospatial tasks that require high mental effort. This study utilizes Pupil Researchlometry in conjunction with machine learning models to predict cognitive workload during a Lego building task. Twenty university students participated in the complex Lego building task, and their Pupil Research diameter data were collected using eye-tracking glasses. After the data were preprocessed and normalized, the K-means clustering method classified baseline-co...

Measuring Attention Patterns

Esther Greussing

This chapter serves as an exploration of the fundamental principles of eye-tracking as a research methodology. It delves into the technical underpinnings of eye-tracking devices, elucidates key metrics used in academic literature, and demonstrates the diverse spectrum of research inquiries that can be effectively addressed through this approach. Encompassing news consumption across multiple platforms and modalities, including on social media sites like Facebook and within search engine results, the methodology’s versatility is showcased. By further discu...

Evaluating Automated Gaze Mapping Across Laboratory and Field Study Settings

Celina Vetter, Rebecca Nauli, Ruth Häusler Hermann & Maarten Uijt De Haag

Eye Tracking (ET) is used in different industries to understand human visual attention, cognitive load, and decision-making processes by capturing where, and for how long a person focuses their attention. A major challenge in processing ET data is mapping gaze points to dynamic Areas of Interest (AOIs) while accounting for data variability and head movements. The purpose of this research is to compare and evaluate methods for automatic gaze-to-AOI mapping to improve efficiency and accuracy in gaze analysis. An ArUco-marker based analytical software was d...

Eye-Tracking Metrics and Visuospatial Task Complexity: A Comparative Analysis

Sachithra Karunathilake, Connor Meissner & Pratima Saravanan

Visuospatial tasks involve varied eye behaviors such as rapid visual search, fixations, and Pupil Research adjustments. Understanding how eye-tracking metrics change during visuospatial tasks of varying complexity provides valuable insights into cognitive processes related to task complexity. This study explores the differences in eye-tracking metrics between simple and complex visuospatial tasks. This study was conducted in a controlled laboratory setting with a cohort of 20 university students who built two Lego models as simple and complex tasks. The ...

Light green background enhances reading performance in visual display terminal tasks

Xiangyun Li, Yu Guan, Ruilin Wu & Xuejun BaiCreating Communication and Media Research Labs

Visual context plays an important role in reading behavior. However, the effects of background color on reading performance remain underexplored. This study investigated how background color (white vs. light green) affects reading performance, visual fatigue, emotion, and physiological responses in first language (L1, Chinese) and second language (L2, English) reading contexts. Forty university students completed reading tasks under both background color conditions, and self-report, behavioral, eye-tracking, and physiological data were collected. The res...

Eyes Don’t Lie: Indifferent to Artificial Intelligence-Generated Depression Screenings

Yeganeh Shahsavar & Avishek Choudhury

This study explored how users respond to a depression self-diagnosis app with two outcomes: “doctor-generated” and “Artificial Intelligence-generated.” The doctor-generated result was based on participants’ actual PHQ-9 depression scores, while the Artificial Intelligence-generated result was randomly selected and sometimes matched the true diagnosis. Participants ( n  = 47) with depressive symptoms used the app while Pupil Research dilation was recorded using a Tobii Pro Spectrum eye tracker. Pupil Research dilation was analyzed before and during th...

Eye Movement Patterns of Reading Literary Texts for Translation

Defeng Li, Jiayi Wang & Zhengyu Zhang

This study explores the eye movement patterns of reading literary texts for translation using eye-tracking technology. It compares four tasks: reading aloud, sight translation, text copying, and written translation. Results show that translation tasks involve more fixations per word, longer reading times, and higher regression probabilities than non-translation tasks. The study identifies four initial orientation styles: systematic planners, quick planners, scanners, and head starters. It also discerns online planning behaviors such as sentence planning,...

Bridging traditional and Artificial Intelligence-assisted simultaneous interpreting: empirical insights for curriculum design

Meng Guo, Yuxing Xie, Lili Han, Victoria Lai Cheng Lei & Defeng LiComputers Environment and Urban Systems

As artificial intelligence (Artificial Intelligence) technologies increasingly permeate the field of interpreting, it becomes imperative for interpreters to adapt and develop the requisite skills to excel in this evolving landscape. While Artificial Intelligence-assisted simultaneous interpreting (SI), specifically through the use of automatic live captioning tools demonstrates potential to enhance rendition accuracy, few empirical studies examine the pedagogical approaches specific to Artificial Intelligence-assisted SI training. This study aims to addr...

  • Tobii Pro 1750 / 2150
  • SDK

From Test Scores to Neural Spikes: Predicting Students’ Abstract Reasoning Ability Using EEG with Attention-Based Models

Abstract reasoning is a key ability for students’ cognitive development, yet traditional methods often fail to provide an accurate and objective assessment. We propose a novel machine learning approach that utilises EEG data from low-cost headsets to predict response correctness in abstract reasoning tasks. This paper presents an adaptive LSTM model incorporating multi-head attention for analysing EEG data acquired during both the reasoning (pre-response) and feedback (post-response) phases of abstract reasoning questions. Results demonstrate the model’s...

Eye-tracking evidence for the causal-historical theory of reference

Filippo Domaneschi, Nicolò D’Agruma, Massimiliano Vignolo & Camilo R. Ronderos

In this paper, we present an experiment that shows conflicting findings from truth-value judgments and eye-tracking data for testing reference assignment of proper names. We argue that if eye-tracking is a more reliable method than truth-value judgment tasks, then our eye-tracking data provide stronger empirical support for the causal-historical theory of reference for proper names. We also argue that eye-tracking and truth-value judgments cannot both be reliable techniques for resolving the debate. If they were, they should yield convergent results. Ins...

Exploring Fixation Times During Emotional Decoding in Intimate Partner Violence Perpetrators: An Eye-Tracking Pilot Study

Carolina Sarrate-Costa, Marisol Lila, Luis Moya-Albiol & Ángel Romero-MartínezErgonomics

Background/Objectives: Deficits in emotion recognition abilities have been described as risk factors for intimate partner violence (IPV) perpetration. However, much of this research is based on self-reports or instruments that present limited psychometric properties. While current scientific literature supports the use of eye tracking to assess cognitive and emotional processes, including emotional decoding abilities, there is a gap in the scientific literature when it comes to measuring these processes in IPV perpetrators using eye tracking in an emotio...

Individual differences in verb aspect processing in monolinguals and bilingual heritage speakers of Turkish

Nisa Büyükyıldırım, Özce Özceçelik, Serkan Uygun & Onur Özsoy

Language processing in monolingual and heritage speakers shows variation when the concept of aspect processing, an understudied phenomenon in the literature, is taken into consideration. In this regard, this study focuses on grammatical aspect (i.e., imperfective and perfective) in monolingual and heritage speakers of Turkish, and aims to uncover Turkish monolinguals’ and heritage speakers’ processing of perfective aspect for completed events and imperfective aspect for ongoing events. Furthermore, the study also aims to explore whether language proficie...

SEED-MYA: A Novel Myanmar Multimodal Dataset for Enhancing Emotion Recognition

Khin Pa Pa Aung, Hao-Long Yin, Tian-Fang Ma, Wei-Long Zheng & Bao-Liang LuThe International Journal of Advanced Manufacturing Technology

Emotional text-to-speech (TTS) technology has achieved significant progress in recent years; however, challenges remain owing to the inherent complexity of emotions and limitations of the available emotional speech datasets and models. Previous studies typically relied on limited emotional speech datasets or required extensive manual annotations, restricting their ability to generalize across different speakers and emotional styles. In this paper, we present EmoSphere++, an emotion-controllable zero-shot TTS model that can control emotional style and int...

Detecting the contribution of V5/MT in reading, reading-related tasks, eye-movements and EEG-oscillations in children and adolescents with developmental dyslexia via high-definition tDCS: a protocol study

Federica Somma, Giulia Lazzaro, Samy Rima, Kristina Rainich, Christa Müller-Axt, Michael Christoph Schmid, Stefano Vicari, Katharina von Kriegstein & Deny Menghini

BackgroundNeuroscientific theories of Developmental Dyslexia (DD) primarily focus on language-related dysfunctions and their associated brain networks. However, DD is also associated with alterations in sensory pathways. For example, there is reduced connectivity in DD, in comparison to controls, between the left lateral geniculate nucleus (LGN) and V5/MT, a motion-sensitive visual area implicated in reading. Most neurostimulation studies in children with DD target language-related brain regions to improve reading, often overlooking motion-sensitive visu...

Spatial regularities in a closed-loop audiovisual search task bias subsequent free-viewing behavior

Sebastiano Cinetto, Elvio Blini, Andrea Zangrossi, Maurizio Corbetta & Marco Zorzi

Statistical learning of spatial regularities during visual search leads to prioritization of target-rich locations. The resulting attentional bias may subsequently affect orienting and search behavior in similar tasks but its transfer to free viewing has not been demonstrated. We exploited a novel closed-loop paradigm where human observers searched for invisible target locations on a screen only guided by real-time auditory feedback conveying gaze-target distance. Unbeknownst to participants, location probability was biased towards one hemifield. Free vi...

Covering the eyes or mouth of a speaker does not prevent word learning in typically developing infants

Teaching Mathematics and its Applications An International Journal of the IMA

Abstract Infant gaze-following skills and selective attention to the mouth of talking faces during their first year correlate with their vocabulary growth in their second year. This correlational evidence has led to the hypothesis that these attentional strategies are key mechanisms supporting word acquisition, a process which drastically improves during toddlerhood. If so, covering the eyes or mouth region of a talking face that teaches toddlers novel word–object associations should disrupt or diminish their word learning performance. To test this relat...

Multimodal processing in simultaneous interpreting with text: Evidence from ear-eye-voice span and performance

Shanshan Yang, Defeng Li & Victoria Lai Cheng LeiSoftware and Systems Modeling

Simultaneous interpreting (SI) with text, a hybrid modality combining auditory and visual inputs, presents greater cognitive complexity than traditional SI. This study investigates multimodal processing in Chinese-English SI with text by examining how source speech rate and professional experience modulate interpreters’ Ear-Eye-Voice Span (EIVS)—a temporal measure reflecting the cognitive coordination among auditory input, visual processing, and verbal output—and interpreting performance. Using eye-tracking technology, we analyzed EIVS patterns in 15 pro...

Fast mapping in hominids

Dahliane Labertoniere, Vanessa A. D. Wilson, Carla Pascual-Guàrdia, Katrin Skoruppa & Klaus Zuberbühler

Fast mapping is essential when children acquire language, but whether the required cognition is uniquely human or shared with animals is debated. Although documented in dogs and cats, both species have a history of domestication of social cognition, so that it remains unclear whether fast mapping is naturally present in non-domesticated animals. Here, we used an eye-tracking paradigm to test three species of hominids – gorillas, orangutans and humans – in their ability to rapidly learn to associate novel sounds with objects in their everyday noisy enviro...

Ecological harshness cues modulate food preferences and visual attention: An eye-tracking study

Ray Garza, Dariela Galindo, Karla P. Garcia & Tiffany Gutierrez

Food scarcity in an ancestral environment has led to an evolved psychology that shapes our decision making in eating. To buffer against times of uncertainty and food shortages, humans have a predisposition to prefer foods that are energy dense, and this may be explained by cognitive mechanisms that drive our search and preferences for foods. In the current study, the role of ecological harshness cues (e.g., safety, resource scarcity, violence) and anticipated food scarcity in desirability and visual attention to high vs. low-caloric food items. Participa...

Aging alters face expressions processing and recognition: insights on possible neural mechanisms

Francesca Ginatempo, Nicola Loi, Mohammed Zeroual, Marinella Iole Cadoni, Mauro Fadda, Andrea Lagorio & Franca Deriu

The present work investigated how aging influences the different stages of face expressions processing: fixation patterns, early perception, face motor response and recognition. Thirty-four participants (17 young, 17 senior) were subjected to i) recording of fixation patterns, ii) recording of the P100 and the N170 components of event-related potentials, iii) excitability of short intracortical inhibition (SICI) and intracortical facilitation (ICF) of the face primary motor cortex (face M1) , and iv) recognition task during the passive viewing of neutral...

  • Tobii Pro Studio
  • Psychtoolbox

Social rejection in minority groups and its impact on current and future mental health: a study in transgender people

Meltem Kiyar, Jens Allaert, Sarah Collet, Marie-Anne Vanderhasselt, Guy T’Sjoen & Sven C. Mueller

Background Minority groups including transgender persons are frequently subjected to social rejection and ostracism, leading to minority stress. This stress may lead to a variety of adverse mental and physical health outcomes. Yet, the impact of this stress on underlying psychophysiology in transgender people has not been tested experimentally. Methods Using the “first impressions paradigm” this study examined psychophysiological feedback to experimentally-induced social rejection in hormone-naïve transgender people (37 trans men (TM) and 27 trans women...

Discover cutting-edge publications in Psychology and neuroscience
See all publications

Enhance Your Psychology and Neuroscience Research

Leverage eye tracking technology to gain deeper insights into human cognition, behavior, and decision-making in your research.