home

Eye tracking insights in psychology and neuroscience Q1 2025

Eye tracking technology has significantly advanced research in psychology and neuroscience by providing precise insights into cognitive processes. This quarter's studies highlight how eye tracking elucidates language processing, attention distribution, and emotional recognition. For instance, it reveals how dominant language affects rubric reading, how problem gamblers' visual attention differs, and how infants learn facial expressions. These findings underscore the value of eye tracking in understanding complex cognitive and behavioral dynamics.

How dominant language influences rubric reading and task performance: Insights from eye-tracking research

Ernesto Panadero, Pablo Delgado, Lucía Barrenetxea-Mínguez, David Zamorano, Leire Pinedo & Alazne Fernández-Ortube

The students’ dominant language might influence how they use and process a rubric and its subsequent effect on task performance. However, our knowledge about these effects is limited. This study investigates how the dominant language of students is associated with their rubric reading patterns and their task performance in a written landscape analysis in Spanish. Participants were 80 higher education students with different dominant language (Spanish-dominant speakers, SDS; Basque-Spanish speakers, BSS) from six undergraduate programmes. We employed a ra...

His face is not smiling but Neke!: A preliminary study of 21-month-old infants’ use of mutual exclusivity in learning facial expression labels

Shinnosuke Ikeda

The process by which children acquire labels for facial expressions remains poorly understood. It has been posited that novel designations for facial expressions may be acquired during early childhood, specifically after the age of 2 years, through a process of elimination. However, research has demonstrated that this elimination process, referred to as the mutual exclusivity constraint, can be employed in the acquisition of nouns even before the age of 2 years. The present study investigated whether 21-month-old infants (N = 20) could establish associat...

How Children With and Without Developmental Language Disorder Use Prosody and Gestures to Process Phrasal Ambiguities

Albert Giberga, Ernesto Guerra, Nadia Ahufinger, Alfonso Igualada, Mari Aguilera & Núria Esteve-Gibert

Prosody is crucial for resolving phrasal ambiguities. Recent research suggests that gestures can enhance this process, which may be especially useful for children with Developmental Language Disorder (DLD), who have impaired structural language. This study investigates how children with DLD use prosodic and gestural cues to interpret phrasal ambiguities. Catalan-speaking children with and without DLD heard sentences with two possible interpretations, a high (less common) and low (more common) attachment interpretation of the verb clause. Sentences were p...

Focal attention peaks and laterality bias in problem gamblers: an eye-tracking investigation

Yayoi Shigemune & Akira Midorikawa

Problem gambling has been associated with attentional biases toward gambling-related stimuli, but less is known about how problem gamblers distribute their visual attention during gambling tasks. This eye-tracking study investigated differences in sustained visual attention between problem gamblers (PGs; n = 22) and non-problem gamblers (NPGs; n = 22) during a gambling task using neutral picture pairs. While total gaze time toward stimuli did not differ between the groups, PGs showed distinctive characteristics in their visual attentional allocation. Spe...

The impact of reading time constraints on text comprehension and eye movements

Nicolas Vibert, Zorha Colas & Frederic R. DanionSpringer Series in Healthcare Management and Innovation Medical Device Management

Although the time available to read a text is crucial for comprehension, there is not yet any comprehensive within-participant study describing how text comprehension decreases and readers’ eye movements are adjusted with increasing time constraints. Consequently, this study examined how imposing reading times influenced both text comprehension and eye movements. Thirty participants had to read three-sentence texts within a time limit (6.3, 9.5, 19.0 or 38.0 s) or without a time constraint, and then to answer a question about each text to assess comprehe...

Let’s See If You Can Hear: The Effect of Stimulus Type and Intensity to Pupil Diameter Response in Infants and Adults

Amanda Saksida, Sašo Živanović, Saba Battelino & Eva Orzan

Pupil dilation can serve as a measure of auditory attention. It has been proposed as an objective measure for adjusting hearing aid configurations, and as a measure of hearing threshold in the pediatric population. Here we explore (1) whether the pupillary dilation response (PDR) to audible sounds can be reliably measured in normally hearing infants within their average attention span, and in normally hearing adults, (2) how accurate within-participant models are in classifying PDR based on the stimulus type at various intensity levels, (3) whether the a...

How limited cognitive resources impact the attentional effects of self-talk: An eye-tracking study in dart

Lu Geng, , Rong Zou, , Jinkun Li, Lin Yu & Xiaobin HongSoftware and Systems Modeling

The study aimed to investigate whether self-talk could enhance participants’ motor performance and attention, even in the presence of distracting interferences and while experiencing ego depletion. To achieve this, 43 novices were randomly assigned into a self-talk group and a control group. Only the self-talk group received the self-talk intervention, and all participants performed a dart throwing task after experiencing ego depletion. In addition, noise interference was added during the dart throwing process. The results indicated that, as predicted, p...

Does ESG information draw more visual attention than financial information?

Dennis D Fehrenbacher & Naomi S Soderstrom

Recent disclosure mandates focus on reporting information about nonfinancial dimensions of performance regarding corporate environmental social and governance (ESG) activities and impacts. Unlike financial information, few programs teach students how to read and interpret ESG disclosures. Further, ESG information tends to be nonfinancial, non-standardized, and lacks a consistent measurement basis (e.g. tons of emissions or kilowatt hours of energy). This makes it difficult for decision-makers to aggregate and process ESG information. In a laboratory expe...

Activation of Thematic and Taxonomic Relations During Lexical‐Semantic Processing in Autistic Children: Evidence From Eye Movements

Zihui Hua, Tianbi Li, Ruoxi Shi, Ran Wei & Li Yi

This study investigated the activation of thematic and taxonomic relations during online lexical‐semantic processing in autistic children using an eye‐tracking competition task. Thirty‐six preschool‐aged autistic children and 35 age‐, gender‐, and verbal‐IQ‐matched neurotypical (NT) children viewed arrays containing a target object, a thematically related competitor, a taxonomically related competitor, and an unrelated distractor while hearing the target word. Results revealed three key findings. First, both groups demonstrated activation of thematic and...

Applying multiscale entropy for evaluating website visual complexity in an agile project: Using physiological data

Chih-Feng Cheng, Chiuhsiang Joe Lin & Ching-Yu LinInternational Journal of Human–Computer Interaction

The perceived visual complexity of a website immediately and persistently impacts the user experience. However, existing visual complexity research methods in the literature are not suitable for agile website development, often associating visual complexity with website structure and requiring advanced programming skills and large participant samples. This study proposes an accessible, definition-independent method to evaluate website complexity using multiscale entropy analysis of physiological signals. Our results show that the multiscale entropy deriv...

How does campus-scape influence university students restorative experiences: Evidences from simultaneously collected physiological and psychological data

Jingyuan Zhang, Sai Liu, Kun Liu & Fang Bian

"Time in nature" is widely acknowledged as beneficial for physical and psychological health. The landscape environment of campus – referred to as "campus-scape" – plays a crucial role in influencing students’ mental health. It provides outdoor spaces where university students sought for relief and recreation, yet it remains under-researched. In this study, we address a limitation in the static assessment of restorative effects of campus-scape, and extend the focus from visual to non-visual and event landscape, using simultaneously collected psychological...

Disrupted visual attention relates to cognitive development in infants with Neurofibromatosis Type 1

Jannath Begum-Ali, Luke Mason, Tony Charman, Mark H. Johnson, Jonathan Green, Shruti Garg, Emily J. H. Jones, Mary Agyapong, Tessel Bazelmans, Leila Dafner, Mutluhan Ersoy, Teodora Gliga, Amy Goodwin, Rianne Haartsen, Hanna Halkola, Alexandra Hendry, Rebecca Holman, Sarah Kalwarowsky, Anna Kolesnik, Sarah Lloyd-Fox, Nisha Narvekar, Laura Pirazzoli, Chloë Taylor, Grace Vassallo, Emma Burkitt-Wright, Judith Eelloo, D Gareth Evans, Siobhan West, Eileen Hupton, Lauren Lewis, Louise Robinson, Angus Dobbie, Ruth Drimer, Saghira Malik Sharif, Rachel Jones, Susan Musson, Catherine Prem, Miranda Splitt, Karen Horridge, Diana Baralle, Carolyn Redman & Helen Tomkins

Neurofibromatosis Type 1 is a genetic condition diagnosed in infancy that substantially increases the likelihood of a child experiencing cognitive and developmental difficulties, including Autism Spectrum Disorder (ASD) and Attention Deficit Hyperactivity Disorder (ADHD). Children with NF1 show clear differences in attention, but whether these differences emerge in early development and how they relate to broader difficulties with cognitive and learning skills is unclear. To address this question requires longitudinal prospective studies from infancy, wh...

Translation of compound terms: Cognitive insights

Silvana Deilen, Ekaterina Lapshinova-Koltunski & Anna Lafrenz

In this paper, we analyse how English compound terms presented in specialized texts are rendered in the German target text by linking this transfer to the translationese phenomena of explicitation, implicitation and equivalence. We also use eye-tracking data to measure the cognitive effort that is related to the applied translation strategy. Our results indicate that when translating compound terms, translators usually prefer to choose the structural equivalent, i.e., a German compound. In addition, we found that explicitating a compound requires more co...

Determining dual-task costs and exploring interindividual responsiveness to an opponent using virtual reality

S. Pastel, A. Schwadtke, A. Krahmer, K. Altrogge, D. Bürger, F. Heilmann & K. Witte

Dual-task (DT) ability is essential in sports, where athletes must perform motor and cognitive tasks simultaneously. Virtual reality (VR), with its enhanced performance and affordability, offers a valuable tool for training and assessing these abilities. This study aimed to develop VR scenarios to measure DT costs and compare DT ability between athletes from individual (IG) and team (TG) sports using a basketball-specific scenario.

  • Tobii VR

A Cross‐Cultural Analysis of Infants Spatial Attention on the Infant Orienting With Attention (IOWA) Task

Michaela C. DeBolt, Bess L. Caswell, Matthews George, Kenneth Maleta, Elizabeth L. Prado, Shannon Ross‐Sheehy, Christine P. Stewart & Lisa M. Oakes

Research with Western samples has uncovered the rapid development of infants' visual attention. This study evaluated spatial attention in 6‐ to 9‐month‐old infants living in rural Malawi (N = 511;  = 255,  = 427) or suburban California, United States (N = 57,  = 29,  = 37) in 2018–2019. Using the Infant Orienting With Attention (IOWA) task, results showed that infants were faster and more accurate to fixate a target when a cue validly predicted the target location and were slower and less accurate when the cue was invalid. However, compared to US infants...

Not all emotional expressions facilitate recognition of other-race faces in Chinese infants

Shaoying Liu, Shuaike Hu, Jiali Chen, Linlin Yan & Guangxi Liu

Previous research has shown that the addition of happy or angry expressions to other-race faces can assist infants in overcoming the perceptual narrowing of face race and reinstating their recognition of other-race faces. In the present study, we examined how different facial expressions (happy, angry, fearful, and neutral) influence the recognition of African faces among Chinese infants aged 8 to 12 months. We employed a visual familiarization task and measured infants’ looking time. The results revealed that infants exhibited above-chance discriminatio...

  • Tobii Pro 1750 / 2150
  • Tobii Pro Studio

Attachment is in the eye of the beholder: a pupillometry study on emotion processing

Stefania Victorita Vacaru, Theodore E. A. Waters & Sabine HunniusPLOS One

Early attachment relationships exert lasting effects on psychophysical health across the lifespan. Limited behavioral evidence suggests that these effects stem from how individuals perceive, interpret, and respond to their environment. This study investigated whether adults’ attachment representations modulate autonomic responses to happy and sad facial expressions, evidenced by changes in pupil size. We utilized a sample of healthy adults (N = 100; 68% females, 18–35 years, prevalently White European). In an eye-tracking experiment, we assessed pupil di...

Understanding Bicycle Riding Behavior and Attention on University Campuses: A Hierarchical Modeling Approach

Wenyun Tang, Yang Tao, Jiayu Gu, Jiahui Chen & Chaoying Yin

The traffic behavior characteristics within university campuses have received limited scholarly attention, despite their distinct differences from external road networks. These differences include the predominance of non-motorized vehicles and pedestrians in traffic flow composition, as well as traffic peaks primarily coinciding with class transition periods. To investigate the riding behavior of cyclists on university campuses, this study examines cyclist attention, proposes a novel method for constructing a rider attention recognition framework, utiliz...

Digitizing contract administration via electroencephalography: Exploring the brain-behavior link in contract clause review

Xinyan Wei, Pin-Chao Liao & Heap-Yih Chong

Digital transformation in contract administration seeks to improve efficiency and transparency, yet cognitive biases in contract interpretation remain unresolved. This paper investigates how stakeholders' professional expertise shapes their cognitive and behavioral responses to contract terms, particularly for the main contractor's obligations or liabilities. A controlled experiment was designed to compare three groups of samples using electroencephalography (EEG) and behavioral metrics. The legal practice group demonstrated shorter gaze durations, highe...

Eye movements and user emotional experience: a study in interface design

Ningna Sun & Yufei JiangCreating Communication and Media Research Labs

The purpose of this study is to explore the correlation between eye movement metrics and user emotional experience metrics during the user’s process of using the interface in a task-oriented manner through an eye-tracking study. Fifty-four participants were recruited, who were divided into two groups and asked to complete the same task using two different sets of interfaces. The two sets of interfaces were proved to have differences in the emotional experience of users before the experiment. The participants’ eye movement data were recorded as they opera...

Emotion Processing in Late Adulthood: The Effect of Emotional Valence and Face Age on Behavior and Scanning Patterns

Bozana Meinhardt-Injac, Nicole Altvater-Mackensen, Alexandra Mohs, Jean-Christophe Goulet-Pelletier & Isabelle Boutet

Age-related differences in emotion recognition are well-documented in older adults aged 65 and above, with stimulus valence and the age of the model being key influencing factors. This study examined these variables across three experiments using a novel set of images depicting younger and older models expressing positive and negative emotions (e.g., happy vs. sad; interested vs. bored). Experiment 1 focused on valence-arousal dimensions, Experiment 2 on emotion recognition accuracy, and Experiment 3 on visual fixation patterns. Age-related differences w...

Enhancing visual perception: The independent and additive effects of temporal and feature-based attention

Dan Huang, Feng Gao & Yao Chen

Researchers often study selective attention in the temporal domain in isolation, but in real-life situations, it typically works together with other types of attention. The interplay between temporal attention (focusing on when) and feature-based attention (focusing on what) is one important aspect of attention that remains poorly understood. To investigate this, we asked subjects to report the orientation of one of the two stimuli sequentially presented at the same position. We used a cue consisting of two arrows to manipulate both temporal and feature-...

  • Tobii Pro X60 / X120 / T60 / T120
  • Psychtoolbox

Smishing: Exploring How Different Persuasion Techniques Influence Users Emotions, Cognitions, and Identification Accuracy

Nour El Shamy, Wei Xie & Chen Zhong

Smishing, a rising phishing threat via SMS, affects millions of mobile users and businesses annually. It employs psychological persuasion techniques to deceive users into downloading malware and disclosing sensitive information, rendering victims vulnerable to social and financial exploitation. Research on phishing has typically focused on emails and social networks. However, despite its increasing prevalence, smishing remains understudied. In this research-in-progress, we aim to address this gap by building on Cognitive Dissonance Phishing Persuasion Th...

Distribution of Globe Excursions Within the Orbits Monitored by Eye Tracking Glasses in Ambulatory Subjects Engaged in Their Normal Daily Activities

Yicen J. Zheng, Thomas N. Gentry, John R. Economides & Jonathan C. Horton

Purpose: It is unknown how gaze angle deviates over the course of normal daily activities, and whether its distribution is affected by vergence. To address these issues, an eye tracker was used to record eye positions in ambulatory subjects engaged in their usual pursuits. Methods: Twenty-seven normal subjects with a mean age of 23.6 years (range, 4–68 years) wore the eye tracking glasses, generating 328 min/person of usable data. Histograms were compiled to show the distribution of (1) horizontal gaze angles, (2) vertical gaze angles, and (3) vergence....

Toddlers Viewing Fantastical Cartoons: Evidence of an Immediate Reduction in Endogenous Control Without an Increase in Stimulus‐Driven Exogenous Control

Claire Essex, Rachael Bedford, Teodora Gliga & Tim J. SmithAustralian Journal of Agricultural and Resource Economics

Empirical studies have shown immediate detrimental effects of TV viewing on children's executive functions (EFs). Existing theories of TV viewing have proposed that such depletion could occur due to fantastical cartoons triggering an attention bias towards salient features of the stimuli (e.g., stimulus‐driven exogenous attention). However, a co‐occurrence of salient visual features known to drive attention exogenously in fantastical cartoons means it is unclear which aspect of the content is problematic. In the present study, we matched clips on visual ...

Long-term memory facilitates spontaneous memory usage through multiple pathways

Levi Kumle, Joel Kovoor, Rhianna L. Watt, Sage E.P. Boettcher, Anna C. Nobre & Dejan Draschkow

Memories scaffold ongoing cognition and behavior.1,2,3,4,5 Surprisingly, when given the “sensorimnemonic” choice6 between using working memory (WM) and sampling sensory information from the environment, reliance on WM is much lower than expected.7,8,9,10,11,12,13 Here, we ask how the availability of long-term memory (LTM), alongside WM, changes how participants spontaneously sample sensory information in service of memory encoding, rely on their memory, and coordinate the two. Participants copied a model display by selecting realistic objects from a reso...

  • Tobii VR

The development of visual attention to the Ebbinghaus illusion across two cultures

Sawa Senzaki, Yuki Shimizu & Sydney IbePLOS One

Selective attention typically becomes more refined with age, improving significantly from early to middle childhood. However, under certain conditions, such as the Ebbinghaus illusion task, younger children may display more focused selective attention than older children and adults. Cross-cultural differences have also been documented, with North American participants tending to focus selectively on central targets, while East Asian participants attending holistically and showing greater susceptibility to the illusion. Despite these findings, the physiol...

Three Hundred Hertz Transcutaneous Auricular Vagus Nerve Stimulation VNS Impacts Pupil Size Non‐Linearly as a Function of Intensity

Ian Phillips, Michael A. Johns, Nick B. Pandža, Regina C. Calloway, Valerie P. Karuzis & Stefanie E. Kuchinsky

Transcutaneous auricular vagus nerve stimulation (taVNS) is a neuromodulatory technique that may have numerous potential health and human performance benefits. However, optimal stimulation parameters for maximizing taVNS efficacy are unknown. Progress is impeded by disagreement on the identification of a biomarker that reliably indexes activation of neuromodulatory systems targeted by taVNS, including the locus coeruleus‐norepinephrine (LC‐NE) system. Pupil size varies with LC‐NE activity and is one potential taVNS biomarker that has shown inconsistent s...

  • Tobii Pro X60 / X120 / T60 / T120
  • Psychopy

No evidence for association between pupil size and fluid intelligence among either children or adults

Patricia Lorente, Veera Ruuskanen, Sebastiaan Mathôt, Antonio Crespo & Jonas Radl

Recent studies have investigated resting-state, or baseline, pupil size as a general measure of cognitive abilities, based on the earlier finding that larger pupils might be predictive of higher general intelligence or working memory capacity. However, evidence for such relationships has been mixed, and all previous studies thus far have focused on adult samples. The present study adds to this debate by examining the correlation between fluid intelligence and baseline pupil size in a sample of both children (10 years old) and adults (their parents). Impo...

Effects of the Threatened Moral Self on Visitors’ Environmentally Responsible Behavior: Insights From a Lab-in-the-Field Experiment

Xianyang Hu, Feifei Hua, Ganghua Chen & Minyue Lu

Although the threatened moral self has received increasing academic attention, researchers have not yet considered its priming prerequisite in the tourism context or its influence on visitor-related behavior. This research aims to fill this gap by exploring boundary conditions of the threatened moral self and how it influences visitors’ environmentally responsible behavior. A lab-in-the-field experiment reveals the following regarding boundary conditions of the threatened moral self in tourism: the moral behavior that stimulus material depicts must be re...

Internal State Estimation via Physiological Data and Their Modulation by Environmental Context during Social Activity

Ayumu Yamashita, Hiroki Maeda, Jouh Yeong Chew & Kaoru Amano

Understanding individuals' internal cognitive states during group interactions is crucial for enhancing group dynamics and communication. This study investigated internal states by analyzing physiological data—EEG, electrocardiography, and pupil size—collected from high school students during group discussions. Using a data-driven clustering method, we identified four distinct internal states, each corresponding to the different power distributions in the four frequency bands of EEG activity. These states were associated with specific behaviors such as g...

Machine Learning Techniques for Simulating Human Psychophysical Testing of Low‐Resolution Phosphene Face Images in Artificial Vision

Na Min An, Hyeonhee Roh, Sein Kim, Jae Hun Kim & Maesoon Im

To evaluate the quality of artificial visual percepts generated by emerging methodologies, researchers often rely on labor‐intensive and tedious human psychophysical experiments. These experiments necessitate repeated iterations upon any major/minor modifications in the hardware/software configurations. Here, the capacity of standard machine learning (ML) models is investigated to accurately replicate quaternary match‐to‐sample tasks using low‐resolution facial images represented by arrays of phosphenes as input stimuli. Initially, the performance of the...

Different effects of emotional valence on overt attention and recognition memory

R. Gerald Monkman, Leonard Faul, Julia Maybury, Sandry M. Garcia, Jane Chung, Haley Echols, Nicole K. Koziol, Samantha E. Williams, Jessica D. Payne & Elizabeth A. Kensinger

Extensive research has revealed enhanced attention and memory for emotional relative to neutral content. Amongst emotional information, valence effects can also arise: negative information often is preferentially attended and remembered relative to positive information, although the opposite valence effect can also occur. Little research has examined how valence effects in attention relate to valence effects in memory. This is the open question we addressed in this study, by tracking the eye gaze of 53 participants (ages 18–64) while they viewed scenes c...

Baby don’t cry: Unconscious sensitivity to sad baby faces.

E. Guida, M. Addabbo & C. Turati

Infant cues are known to play a crucial role in eliciting caregiving responses, making them essential for survival and development of offspring. Yet, it is still unknown whether infant faces may attract adults’ attention when presented under the level of consciousness. Using a disengagement task and an eye-tracker procedure, this study investigated whether the subliminal exposure to emotional baby vs adult faces affects mothers’ (N = 57) and non-mothers’ (N = 57) attention disengagement. Independently from their parental status, women had longer saccadic...

  • Tobii Pro X60 / X120 / T60 / T120

Event-related potential reveals partial face cognitive mechanisms through machine learning

Ingon Chanpornpakdi, Yodchanan Wongsawat & Toshihisa Tanaka

During the SARS-CoV-2 pandemic, wearing masks became a daily practice, and the cognitive mechanisms of how people correctly recognize a masked face are still questioned. In our previous study, we investigated the electroencephalogram evoked corresponding to the presented images, called the event-related potential, during the partial face cognition task and employed a machine learning model to interpret the cognitive activity. We found that the combination of the xDAWN spatial filter, covariance matrix, tangent space mapping, and support vector machine mo...

Atypical audio-visual neural synchrony and speech processing in early autism

Xiaoyue Wang, Sophie Bouton, Nada Kojovic, Anne-Lise Giraud & Marie Schaer

Children with Autism Spectrum disorder (ASD) often exhibit communication difficulties that may stem from basic auditory temporal integration impairment but also be aggravated by an audio-visual integration deficit, resulting in a lack of interest in face-to-face communication. This study addresses whether speech processing anomalies in young autistic children (mean age 3.09-year-old) are associated with alterations of audio-visual temporal integration.

Early knowledge of word order in Palestinian Arabic: An eye-tracking study

Tala Nazzal, Jingtao Zhu & Anna Gavarró

This paper addresses the underexplored realm of early parameter setting in language acquisition before the two-word stage, in a less researched language, Palestinian Arabic. Building on Franck et al.’s (2013) exploration of the verb–direct or indirect object/direct or indirect object–verb (VO/OV) parameter in infants exposed to French, we investigate the acquisition of the VO order (as opposed to OV) in 17-month-old native Palestinian Arabic infants using a combination of the preferential looking paradigm, the weird word order paradigm, and pseudo-verbs....

Performance rankings reduce cognitive processing of underlying performance information

Lisa Hohensinn, Jurgen Willems, Bert George & Steven Van de Walle

Performance information is often presented in a ranked format. Rankings aggregate a multitude of performance dimensions into an overall score. Simultaneously, rankings may constrain cognitive processing of performance information because they distract users’ attention away from the information underlying the ranking calculation. We test this adverse effect using university performance rankings in an eye-tracking experiment based on 1,071 decisions from 153 student-participants. Results show that performance rankings reduce cognitive processing of the und...

Effects of Noise and Reward on Pupil Size and Electroencephalographic Speech Tracking in a Word‐Detection Task

Speech is hard to understand when there is background noise. Speech intelligibility and listening effort both affect our ability to understand speech, but the relative contribution of these factors is hard to disentangle. Previous studies suggest that speech intelligibility could be assessed with EEG speech tracking and listening effort via pupil size. However, these measures may be confounded, because poor intelligibility may require a larger effort. To address this, we developed a novel word‐detection paradigm that allows for a rapid behavioural assess...

Preschoolers’ use of emotional prosody in an unfamiliar language

Yomna Waly, Craig G. Chambers & Susan A. Graham

Rapid and accurate recognition of another’s emotions is critical to successful communication. Previous research indicates that preschoolers can use emotional prosody in familiar languages to identify an object being referred to by a speaker (i.e., associate a happy tone with an intact object and a sad tone with a broken object). Here, we examined whether listeners’ use of emotional prosody is tied to language comprehension by testing English-speaking preschoolers’ and adults’ use of emotional prosody when presented with utterances spoken in Arabic. In Ex...

Pupillary Responses Reflect Image Memorability

Ryosuke Niimi

This study examined whether pupil size varies as a function of the memorability of natural scene images. In Experiment 1, participants were asked to memorize, recognize, and passively view high‐ and low‐memorability images from an established dataset. The baseline‐corrected pupil sizes were larger for high‐memorability images, but only during old trials in the recognition phase. However, after implementing stricter controls for image luminance and arousal, pupil dilation for high‐memorability images was observed across all phases: memorization, recogniti...

AI and Eye Tracking Reveal Design Elements’ Impact on E-Magazine Reader Engagement

Hedda Martina Šola, Fayyaz Hussain Qureshi & Sarwar Khawaja

This study investigates the impact of intelligible background speech on reading disruption utilising neuromarketing methodologies, specifically an eye-tracking webcam (Tobii Sticky) and AI eye-tracking software (Predict, v.1.0.). A cohort of 144 participants from Oxford Business College underwent emotional impact testing, while an AI eye-tracking algorithm analysed attention patterns across 180,000 eye-tracking recordings. Two articles from OxConnect Magazine were presented in varying background formats. Python-based analysis revealed that the HND articl...

Increased observation of predictable visual stimuli in children with potential autism spectrum disorder

Mikimasa OmoriPLOS One

Children with autism spectrum disorder (ASD) often exhibit social communication impairments and restricted, repetitive behaviors (RRB). Previous studies have shown that children with ASD prefer observing repetitive movements over random movements, reflecting RRB symptoms, but the developmental timeline of this preference remains unclear. New evidence suggests that children with ASD may develop predictive processing abilities for repeated behaviors, providing insight into how they recognize and respond to predictable patterns. This study employed a prefer...

Impact of warning label shapes on perceived healthfulness and consumer attention

Ana M Arboleda

Countries’ regulations mandate front-of-package (FOP) labeling to promote awareness of healthy eating habits. In the Colombian context, this study examined the impact of FOP nutrient warnings on potato chip perceptions, considering the warning’s shape. Experiment 1 found that warning shape (circle or octagon vs. control) had a similar effect on perceived healthfulness. Furthermore, the FOP warning reduced the perceived healthfulness of healthy chips but did not affect perceptions of potato chip packages. Experiment 2 assessed how warning shape influenced...

Unveiling the gaze: deciphering key factors in selecting knowledge workers through eye-tracking analysis

Mahshid Pourhosein & Mehdi Sabokro

The purpose of this study is to identify and analyze the characteristics and visual patterns of successful knowledge workers using quantitative methods, particularly eye-tracking technology. By conducting a systematic review and matching identified factors with theoretical literature, the research aims to uncover key attributes that contribute to the effectiveness of knowledge workers. These insights are intended to improve employee selection processes, ensuring the right candidates are chosen based on their cognitive, behavioral and visual traits.

Task-blind adaptive virtual reality: Is it possible to help users without knowing their assignments?

Simon Besga, Nancy Rodriguez, Arnaud Sallaberry, Thomas Papastergiou & Pascal Poncelet

The exploration of complex environments (reconstructed locations, immersive data visualisation, etc.) is one of the primary applications of virtual reality (VR) because of the feeling of immersion and the natural interactions that it provides. When exploration is completely free, users easily become disoriented and frustrated due to multiple factors such as task difficulty, interaction techniques, spatial understanding, immersion breaches, etc. Adaptive VR systems aim to overcome these difficulties and increase performance by providing clues to help the ...

  • Tobii VR

Counterfactual thinking is associated with impoverished attentional control in women prone to self-critical rumination

Jens Allaert, Rudi De Raedt, Alvaro Sanchez-Lopez & Marie-Anne Vanderhasselt

Excessive engagement in counterfactual thinking (CFT), where individuals imagine alternative outcomes to past events, is associated with rumination, a process characterized by repetitive negative self-referential thoughts. Attentional control difficulties are closely linked with rumination, and negative thoughts can negatively impact attentional control among rumination-prone individuals. This study aimed to investigate the relationship between CFT and emotional and non-emotional attentional control among individuals with varying levels of self-critical ...

Artificial Intelligence-Enhanced Interview Success: Leveraging Eye-Tracking and Cognitive Measures to Support Self-Regulation in College Students with Attention-Deficit/Hyperactivity Disorder

Tahnee L. Wilder & Nicole E. Stratchan

This study investigates how cognitive and self-regulation factors impact online interview performance among college students with ADHD. With unemployment rates for individuals with disabilities significantly higher than the general population, understanding the unique challenges posed by AI-driven virtual interviews is critical. Forty-six students with ADHD completed a structured interview simulation using the Big Interview platform, coupled with eye-tracking data and cognitive assessments. Results reveal that higher-performing participants (Gold tier) d...

Automatic Classification of Difficulty of Texts from Eye Gaze and Physiological Measures of L2 English Speakers

Javier Melo, Leigh Fernandez & Shoya IshimaruLecture Notes in Information Systems and Organisation Technology Driven Transformation

Reading is an essential method for adults to learn new languages, but difficulty reading texts in a foreign language can increase learners’ anxiety. Identifying text difficulty from the reader’s perspective can aid language learning by tailoring texts to readers’ needs. There is little research focusing on L2 speakers or using a multimodal approach, i.e., using multiple sensors, to detect subjective difficulty. In this study ( $N=30$ ) we determined L2 speakers’ subjective difficulty while reading using language proficiency and objective text difficulty,...

Active control over exploration improves memory in toddlers

Yi-Lin Li, Francesco Poli & Azzurra Ruggeri

Across two experiments, we implemented a novel gaze-contingent eye-tracking paradigm to investigate the early emergence of memory benefits from active control over exploration and to examine how exploratory behaviours affect memory formation in early development. Toddlers (experiment 1: n = 36, 18–36 months; experiment 2: n = 41, 23–36 months) were either allowed to actively control their exploration (active condition) or presented with the same information that they could only passively observe (passive condition in experiment 1; yok...

    Experience modulates gaze behavior and the effectiveness of information pickup to overcome the inversion effect in biological motion perception

    Xiaoye Michael Wang, Zhichen Feng, Mingming Yang, Jing Samantha Pan, Margaret A. Wilson & Qin ZhuSoftware and Systems Modeling

    The inversion effect in biological motion suggests that presenting a point-light display (PLD) in an inverted orientation impairs the observer’s ability to perceive the movement, likely due to the observer’s unfamiliarity with the dynamic characteristics of inverted motion. Vertical dancers (VDs), accustomed to performing and perceiving others to perform dance movements in an inverted orientation while being suspended in the air, offer a unique perspective on this phenomenon. A previous study showed that VDs were more sensitive to the artificial inversio...

    Designing children’s media: taxonomies as a scaffold for learning and attention

    Tanya Kaefer, Susan B. Neuman & Ashley M. Pinkham

    The goal of this study was to develop an educational video that emphasized taxonomic relationships as a means of supporting attention and learning for preschoolers. We used a design study method to iteratively design, develop, implement and evaluate a video. In each iteration we evaluated the success of the video based on children’s attention, as measured through eye-tracking, their recognition of target vocabulary words introduced in the video, and the relationship between attention and vocabulary recognition. In the first iteration we tested 56 childre...

    • Tobii Pro X60 / X120 / T60 / T120
    • Tobii Pro Studio

    Pedestrian decision-making uncertainty in urgent scenarios modulates multi-level, neural hierarchies

    Quan Li, Siyuan Liu, Shi Shang, Bowen Li, Xiaorong Gao, Jianqiang Wang & Bingbing Nie

    Uncertainty in pedestrian decision-making in urgent traffic scenarios significantly influences safe interactions with automated vehicles. However, the underlying mechanisms governing such decision-making behavior remain insufficiently understood. To bridge this gap, we design two experimental paradigms of varying complexity to simulate spatiotemporal pressure and the consequences of decision failures: a high-fidelity virtual reality pedestrian-vehicle interaction experiment and a simplified dynamic stimulus task. Our findings reveal that as stimulus urge...

    Entrainment of visuomotor responses to target speed during interception

    Mario Treviño & Inmaculada Márquez

    Motor actions adapt dynamically to external changes through the brain’s ability to predict sensory outcomes and adjust for discrepancies between anticipated and actual sensory inputs. In this study, we investigated how changes in target speed (vT) and direction influenced visuomotor responses, focusing on gaze and manual joystick control during an interception task. Participants tracked a moving target with sinusoidal variations in vT and directional changes, generating sensory prediction errors and requiring real-time adjustments. Our results demonstrat...

    • LSL
    • Psychtoolbox

    Perceptual, Not Attentional, Guidance Drives Happy Superiority in Complex Visual Search

    Sjoerd M. Stuit, M. Alejandra Pardo Sanchez & David Terburg

    Emotional facial expressions are thought to attract attention differentially based on their emotional content. While anger is thought to attract the most attention during visual search, happy superiority effects are reported as well. As multiple studies point out confounds associated with such emotional superiority, further investigation into the underlying mechanisms is required. Here, we tested visual search behaviors when searching for angry faces, happy faces, or either happy or angry faces simultaneously using diverse distractors displaying many oth...

    Studying the interplay of context and semantic content in the interpretation of adversative conjunctions with eye-tracking

    Ghyslain Cantin-Savoie, Grégoire Winterstein & Denis Foucambert

    The French adversative connective mais, much like its English counterpart but, takes two conjuncts and indicates that they stand in some kind of opposition. The nature of this opposition is often discussed in the existing literature of adversatives. Using an eyetracking experiment, we look at where and when this opposition appears to be manifested in a sentence reading task, using superiority comparatives sentences that appear degraded without a supportive context, as well as inferiority comparatives that do not seem to require such specific contextual i...

    Using Eye-Tracking Data to Examine Response Processes in Digital Competence Assessment for Validation Purposes

    Juan Bartolomé, Pablo Garaizar, Erlantz Loizaga & Leire Bastida

    Background: When measuring complex cognitive constructs, it is crucial to correctly design the evaluation items in order to trigger the intended knowledge and skills. Furthermore, assessing the validity of an assessment requires considering not only the content of the evaluation tasks, but also how examinees perform by engaging construct-relevant response processes. Objectives: We used eye-tracking techniques to examine item response processes in the assessment of digital competence. The eye-tracking observations helped to fill an ‘explanatory gap’ by pr...

    Fixation-related potentials during a virtual navigation task: The influence of image statistics on early cortical processing

    Anna Madison, Chloe Callahan-Flintoft, Steven M. Thurman, Russell A. Cohen Hoffing, Jonathan Touryan & Anthony J. Ries

    Historically, electrophysiological correlates of scene processing have been studied with experiments using static stimuli presented for discrete timescales where participants maintain a fixed eye position. Gaps remain in generalizing these findings to real-world conditions where eye movements are made to select new visual information and where the environment remains stable but changes with our position and orientation in space, driving dynamic visual stimulation. Co-recording of eye movements and electroencephalography (EEG) is an approach to leverage f...

    The effect of ego depletion on intertemporal decision making: explanation from attribute-based models

    Hong-Yue Sun, Li-Na Chen, Qian Zhang & Cheng-Ming Jiang

    Based on the attribute-based models, this study used both self-report surveys and eye-tracking technology to uncover the process mechanism by which ego depletion influences intertemporal choice. The results showed that activation of ego depletion would affect inter-dimensional differences comparison, which mediated the effect of ego depletion on intertemporal choice. Compared to participants in the control condition, those in the depletion condition perceived a greater difference in the delay than outcome dimensions between the two options, thus making d...

    Eyes on the Pupil Size: Pupillary Response During Sentence Processing in Aphasia

    Christina Sen, Noelle Abbott, Niloofar Akhavan, Carolyn Baker & Tracy LoveErgonomics

    Background/Objectives: Individuals with chronic agrammatic aphasia demonstrate real-time sentence processing difficulties at the lexical and structural levels. Research using time-sensitive measures, such as priming and eye-tracking, have associated these difficulties with temporal delays in accessing semantic representations that are needed in real time during sentence structure building. In this study, we examined the real-time processing effort linked to sentence processing in individuals with aphasia and neurotypical, age-matched control participants...

    • Tobii Pro X60 / X120 / T60 / T120

    Emotional Movement Kinematics Guide Twelve‐Month‐Olds’ Visual, but Not Manual, Exploration

    Joanna M. Rutkowska, Julia Mermier, Marlene Meyer, Hermann Bulf, Chiara Turati & Sabine HunniusDiscover Applied Sciences

    The ability to recognize and act on others' emotions is crucial for navigating social interactions successfully and learning about the world. One way in which others' emotions are observable is through their movement kinematics. Movement information is available even at a distance or when an individual's face is not visible. Infants have been shown to be sensitive to emotions in movement kinematics of transporting actions, like moving an object from one to another place. However, it is still unknown whether they associate the manipulated object with the ...

    • Tobii Pro X60 / X120 / T60 / T120
    • Tobii Pro Studio

    What Does It Mean to Stand Out? How Visual Design and Presentation Affect Attention and Memory in a Warning Message

    Nicholas Waugh, Jeannette Sutton, Laura Fischer & Ginger Orton

    In emergency communication, it is essential to call attention to key information that can be interpreted quickly and remembered easily. Individuals possess a limited number of cognitive resources to allocate to message processing in an emergency. Because of this, they are more likely to allocate attention to messages they are motivated to care about or to message attributes that stand out. In this study, we focus on how warning messages are attended to when they are viewed in a busy media environment and ask the question: “What does it mean to stand out?...

    Contribution of Topic Background Knowledge to Language Learning Outcomes through Parent–child Dialogic Reading

    Yang Dong, Bonnie Wing‐Yin Chow, Gelin Xia, Jianhong Mo & Hang Dong

    The article explored the impact of topic background knowledge (TBK) on children's language ability development and reading‐related emotional factors. TBK refers to the foundational knowledge that children possess concerning a specific subject or topic. The content schemata theory suggests that a high level of TBK facilitates information processing during reading activities, benefiting language learning outcomes, fostering reading interest, and reducing reading anxiety. The current study used experts' evaluation of TBK levels that children might have towa...

    • Tobii Pro Studio

    The ECOLANG Multimodal Corpus of adult-child and adult-adult Language

    Yan Gu, Ed Donnellan, Beata Grzyb, Gwen Brekelmans, Margherita Murgiano, Ricarda Brieke, Pamela Perniss & Gabriella Vigliocco

    Communication comprises a wealth of multimodal signals (e.g., gestures, eye gaze, intonation) in addition to speech and there is a growing interest in the study of multimodal language by psychologists, linguists, neuroscientists and computer scientists. The ECOLANG corpus provides audiovisual recordings and ELAN annotations of multimodal behaviours (speech transcription, gesture, object manipulation, and eye gaze) by British and American English-speaking adults engaged in semi-naturalistic conversation with their child (N = 38, children 3-4 years old, fa...

    EyeDraw: Investigating the Perceived Effects of Shared Gaze on Remote Collaborative Drawing

    Eryn Ma, Priya Dixit, Andy Han, Nicholas Marsano, Brooke Sparks, Ashley Sun, Lucas Tiangco, Tongyu Zhou, Jeff Huang & Alexandra Papoutsaki

    Shared gaze, where collaborators can see each other's point of gaze visualized on their screen in real time, is a novel non-verbal mechanism that augments remote collaborations and increases shared awareness and common grounding. While past studies have focused on well-structured tasks and analyzed task performance and efficiency, our study explores the domain of collaborative drawing for recreational purposes and focuses on collaborators' own perceptions. We surveyed 75 users of online collaborative drawing platforms who mostly drew collaboratively for ...

      A Randomized Trial of Virtual Reality Eye Movement Desensitization and Reprocessing Therapy for Major Depressive Disorder With Childhood Trauma: A 3-Month Follow-Up Study

      Objective: Eye movement desensitization and reprocessing therapy (EMDR) is effective in treating major depressive disorder (MDD) with childhood trauma, and virtual reality (VR) can further extend its application form. However, the utilization of VR-EMDR in treating MDD with childhood trauma is still in its infancy, and whether it can improve depressive symptoms and traumatic experience remains unknown. Method: Seventy-two MDD patients were randomly allocated to the intervention group and the wait-list control group on a 1:1 basis. The intervention group ...

      • Tobii VR

      Children’s moral self-concept relates to moral judgment, but not to arousal

      Anja Kaßecker, Antonia Misch, Markus Paulus, Natalie Christner & Carolina Pletti

      We investigated the relationships among the moral self-concept, arousal reactions to third-party moral situations, and moral judgment in 5- to 7-year-old children (N = 59). Children’s moral self-concept was assessed using a puppet task. In addition, children were shown audiovisual scenes depicting prosocial, antisocial, and neutral interactions between children. We measured phasic pupil dilation responses to the actions and collected children’s judgments of the actions. The results show that children judged antisocial behavior as more negative and prosoc...

      • Tobii Pro 1750 / 2150
      • Tobii Pro Studio

      The effect of context on the processing and learning of novel L2 vocabulary while reading

      Radha Chandy, Raquel Serrano & Ana Pellicer-Sánchez

      Encountering new words multiple times in the input is crucial for incidental vocabulary acquisition. While there is extensive research exploring the impact of word frequency on both learning and processing of novel vocabulary during reading, there is a notable gap in studies examining how contextual factors impact these processes, especially when reading texts, rather than short sentences. The present study aims to fill this gap by exploring the effect of contextual diversity or sameness on adult L2 English learners’ processing and incidental learning of...

      Measuring Reading Comprehension Processes of Students With and Without Reading Difficulties Through Eye Movement

      Yongseok Yoo, Woori Kim & Mikyung Shin

      In this study, we examined the differences in reading comprehension processes between students with and without reading difficulties. A total of 72 third- and fourth-grade students in South Korea participated in the study; of these, 28 were identified as having reading difficulties and 44 were not. Multiple types of tasks were administered to evaluate the participants’ eye-movement behaviors, including reading different types of texts and answering questions. Nonparametric tests were conducted on the students’ responses, and the results indicated that st...

      Developmental trajectories of visual orienting functions in children born very or extremely preterm

      Maud M. van Gils, Alja Bijlsma, Marijn J. Vermeulen, Irwin K.M. Reiss, Koen F.M. Joosten, Marlou J.G. Kooiker & Johan J.M. Pel

      Background and aims: Preterm birth increases the risk of neurodevelopmental impairments, such as Cerebral Visual Impairment (CVI), which affects visual processing. Assessing visual functions in young children is challenging with traditional methods that often rely on verbal/motor responses. The aim of the study was to investigate the developmental trajectories of Visual Orienting Functions (VOF) in children born very preterm (<32 weeks gestational age) between 2 and 5 years corrected age (CA) using eye tracking. Methods: 263 children born preterm underwe...

      Impaired visual perceptual accuracy in the upper visual field induces asymmetric performance in position estimation for falling and rising objects

      Takashi Hirata & Nobuyuki Kawai

      Humans can estimate the time and position of a moving object's arrival. However, numerous studies have demonstrated superior position estimation accuracy for descending objects compared with ascending objects. We tested whether the accuracy of position estimation for ascending and descending objects differs between the upper and lower visual fields. Using a head-mounted display, participants observed a target object ascending or descending toward a goal located at 8.7° or 17.1° above or below from the center of the monitor in the upper and lower visual f...

      • Tobii VR
      Discover cutting-edge publications in Psychology and neuroscience
      See all publications

      Enhance your research with eye tracking insights

      Leverage eye tracking to gain deeper understanding in cognitive and behavioral studies. Discover new dimensions in psychology and neuroscience.