Subjective Ratings Research Articles

Evaluating Gesture Generation in a Large-scale Open Challenge: The GENEA Challenge 2022

This article reports on the second GENEA Challenge to benchmark data-driven automatic co-speech gesture generation. Participating teams used the same speech and motion dataset to build gesture-generation systems. Motion generated by all these systems was rendered to video using a standardised visualisation pipeline and evaluated in several large, crowdsourced user studies. Unlike when comparing different research articles, differences in results are here only due to differences between methods, enabling direct comparison between systems. The dataset was based on 18 hours of full-body motion capture, including fingers, of different persons engaging in a dyadic conversation. Ten teams participated in the challenge across two tiers: full-body and upper-body gesticulation. For each tier, we evaluated both the human-likeness of the gesture motion and its appropriateness for the specific speech signal. Our evaluations decouple human-likeness from gesture appropriateness, which has been a difficult problem in the field. The evaluation results show some synthetic gesture conditions being rated as significantly more human-like than 3D human motion capture. To the best of our knowledge, this has not been demonstrated before. On the other hand, all synthetic motion is found to be vastly less appropriate for the speech than the original motion-capture recordings. We also find that conventional objective metrics do not correlate well with subjective human-likeness ratings in this large evaluation. The one exception is the Fréchet gesture distance (FGD), which achieves a Kendall’s tau rank correlation of around -0.5. Based on the challenge results we formulate numerous recommendations for system building and evaluation.

Metacognitive Awareness and the Subjective Experience of Remembering in Aphantasia.

Individuals with aphantasia, a nonclinical condition typically characterized by mental imagery deficits, often report reduced episodic memory. However, findings have hitherto rested largely on subjective self-reports, with few studies experimentally investigating both objective and subjective aspects of episodic memory in aphantasia. In this study, we tested both aspects of remembering in aphantasic individuals using a custom 3-D object and spatial memory task that manipulated visuospatial perspective, which is considered to be a key factor determining the subjective experience of remembering. Objective and subjective measures of memory performance were taken for both object and spatial memory features under different perspective conditions. Surprisingly, aphantasic participants were found to be unimpaired on all objective memory measures, including those for object memory features, despite reporting weaker overall mental imagery experience and lower subjective vividness ratings on the memory task. These results add to newly emerging evidence that aphantasia is a heterogenous condition, where some aphantasic individuals may lack metacognitive awareness of mental imagery rather than mental imagery itself. In addition, we found that both participant groups remembered object memory features with greater precision when encoded and retrieved in the first person versus third person, suggesting a first-person perspective might facilitate subjective memory reliving by enhancing the representational quality of scene contents.

Defining criteria for disease activity states in systemic juvenile idiopathic arthritis based on the systemic Juvenile Arthritis Disease Activity Score.

To develop and validate cutoff values in the systemic Juvenile Arthritis Disease Activity Score 10 (sJADAS10) that distinguish the states of inactive disease (ID), minimal disease activity (MiDA), moderate disease activity (MoDA), and high disease activity (HDA) in children with systemic juvenile idiopathic arthritis (sJIA), based on subjective disease state assessment by the treating pediatric rheumatologist. The cutoffs definition cohort was composed of 400 patients enrolled at 30 pediatric rheumatology centers in 11 countries. Using the subjective physician rating as an external criterion, 6 methods were applied to identify the cutoffs: mapping, calculation of percentiles of cumulative score distribution, Youden index, 90% specificity, maximum agreement, and ROC curve analysis. Sixty percent of the patients were assigned to the definition cohort and 40% to the validation cohort. Cutoff validation was conducted by assessing discriminative ability. The sJADAS10 cutoffs that separated ID from MiDA, MiDA from MoDA, and MoDA from HDA were ≤ 2.9, ≤ 10, and > 20.6. The cutoffs discriminated strongly among different levels of pain, between patients with or without morning stiffness, and between patients whose parents judged their disease status as remission or persistent activity/flare or were satisfied or not satisfied with current illness outcome. The sJADAS cutoffs revealed good metrologic properties in both definition and validation cohorts, and are therefore suitable for use in clinical trials and routine practice.

Sex-based dyad differences on informant reports of participants’ daily functioning

Functional assessment in neurocognitive evaluation is often provided via informant reports. These subjective reports can vary based on the characteristics of informants and their relationships with participants, such as informant sex. However, whether informant sex intersects with participant sex to impact subjective ratings of participants’ daily functioning, and whether such effects mirror observed patterns in neuropsychological performance, has not been adequately examined with ethnoracially diverse samples. We examined differences among participant-informant sex-based dyads on subjective informant reports of participants’ daily functioning (assessed via the Functional Activities Questionnaire [FAQ]), and whether any observed differences on reported functioning corresponded to differences in objective participant performance on neuropsychological performance, among middle-aged and older Hispanic/Latino (n = 543), non-Hispanic Black (NHB; n = 1030), and non-Hispanic White (NHW; n = 5356) adults in the National Alzheimer’s Coordinating Center cohort (n = 6929). Analysis of covariance (ANCOVA) tests revealed significant dyad differences on FAQ scores in the NHB (p<.001) and NHW subsamples (p<.05), but not in the Hispanic/Latino subsample (p>.05). For the Hispanic/Latino and NHB subsamples, ANCOVA tests revealed no significant effects of dyad on neuropsychological performance (ps>.01), whereas for the NHW subsample, ANCOVA tests revealed significant dyad differences on performance in multiple cognitive domains (ps<.01). Nevertheless, the pattern of dyad differences on neuropsychological performance did not mirror the pattern of observed differences on FAQ scores in the NHW subsample. Findings and their implications, including potential contributions of other informant characteristics on observed dyad differences on reported functioning, are discussed.

Subjective Affective Responses to Natural Scenes Require Understanding, Not Spatial Frequency Bands.

It is debated whether emotional processing and response depend on semantic identification or are preferentially tied to specific information in natural scenes, such as global features or local details. The present study aimed to further examine the relationship between scene understanding and affective response while manipulating visual content. To this end, we presented affective and neutral natural scenes which were progressively band-filtered to contain global features (low spatial frequencies) or local details (high spatial frequencies) and assessed both affective response and scene understanding. We observed that, if scene content was correctly reported, subjective ratings of arousal and valence were modulated by the affective content of the scene, and this modulation was similar across spatial frequency bands. On the other hand, no affective modulation of subjective ratings was observed if picture content was not correctly reported. The present results indicate that subjective affective response requires content understanding, and it is not tied to a specific spatial frequency range.

Ingestible pills reveal gastric correlates of emotions.

Although it is generally held that gastrointestinal (GI) signals are related to emotions, direct evidence for such a link is currently lacking. One of the reasons why the internal milieu of the GI system is poorly investigated is because visceral organs are difficult to access and monitor. To directly measure the influence of endoluminal markers of GI activity on the emotional experience, we asked a group of healthy male participants to ingest a pill that measured pH, pressure, and temperature of their GI tract while they watched video clips that consistently induced disgust, fear, happiness, sadness, or a control neutral state. In addition to the objective physiological markers of GI activity, subjective ratings of perceived emotions and visceral (i.e. gastric, respiratory and cardiac) sensations were recorded, as well as changes in heart rate (HR), heart rate variability (HRV) and spontaneous eyes blinks as non-gastric behavioral and autonomic markers of the emotional experience. We found that when participants observed fearful and disgusting video clips, they reported to perceive not only cardiac and respiratory sensations but also gastric sensations, such as nausea. Moreover, we found that there was a clear relation between the physiology of the stomach and the perceived emotions. Specifically, when disgusting video clips were displayed, the more acidic the pH, the more participants reported feelings of disgust and fear; the less acidic the pH, the more they reported happiness. Complementing the results found in the deep gastric realm, we found that disgusting stimuli induced a significant increase in HRV compared to the neutral scenarios, and together with fearful video clips a decrease in HR. Our findings suggest that gastric signals contribute to unique emotional states and that ingestible pills may open new avenues for exploring the deep-body physiology of emotions.

Prospective Effects of Self-Rated Health on Dementia Risk in Two Twin Studies of Aging

Subjective health ratings are associated with dementia risk such that those who rate their health more poorly have increased risk for dementia. The genetic and environmental mechanisms underlying this association are unclear, as prior research cannot rule out whether the association is due to genetic confounds. The current study addresses this gap in two samples of twins, one from Sweden (N = 548) and one from Denmark (N = 4,373). Using genetically-informed, bivariate regression models, we assessed whether additive genetic effects explained the association between subjective health and dementia risk as indexed by a latent variable proxy measure. Age at intake, sex, education, depressive symptomatology, and follow-up time between subjective health and dementia risk assessments were included as covariates. Results indicate that genetic variance and other sources of confounding accounted for the majority of the effect of subjective health ratings on dementia risk. After adjusting for genetic confounding and other covariates, a small correlation was observed between subjective health and latent dementia risk in the Danish sample (rE = − .09, p < .05). The results provide further support for the genetic association between subjective health and dementia risk, and also suggest that subjective ratings of health measures may be useful for predicting dementia risk.

EEG, EOG, Likert Scale, and Interview Approaches for Assessing Stressful Hazard Perception Scenarios

This study aimed to detect stressful hazard perception scenarios subjectively and objectively when using intelligent driving systems. We used electrooculography (EOG), electroencephalography (EEG), subjective ratings, and interviews to identify potential stressful hazard perceptions and record improvements in an intelligent navigation-guided pilot (NGP) system. Moreover, we analyzed electrophysiological data. Our study contributes to the use of engagement, concentration, and phase locking value connectivity based on EEG to support previous research methodologies using beta power, pupil size, fixation ratio, fixation duration, and subjective evaluations for investigating hazard perception. Our analyses showed that stressful hazard perception scenarios occurred mainly when encountering broken and solid lines, frequent lane changes, cars approaching suddenly, several cars driving in parallel, and the decision to change lanes but immediately pulling back upon using the NPG system. Our findings shed light on obtaining accurate results based on subjective and objective evaluations for developing intelligent driving systems.

Low-dose radiation as a preconditioning regimen for dendritic cell vaccines.

e14519 Background: Dendritic cells are potent antigen-presenting cells that induce the adaptive immune system to protect against cancer. While anti-tumor immunity can be improved with dendritic cell vaccines, it is not fully known what approved preconditioning agents, if any, improve dendritic cell vaccine-induced antitumor T-cell response and tumor elimination. We explored the effect of low-dose radiation (LDR), cyclophosphamide, and paclitaxel as preconditioning regiments for a dendritic cell vaccine. Methods: KP tumors were engineered with ovalbumin and orthotopically injected subcutaneously (SQ) into the flank of wild type B6 mice. Preconditioning regiments of a control, LDR (2 Gy), cyclophosphamide (20mg/kg), LDR (2 Gy) + cyclophosphamide (20mg/kg), and paclitaxel (20mg/kg) were given on day 4. Bone marrow dendritic cells (DCs) were electroporated with ovalbumin peptide SIINFEKL and then one million cells were injected i.v. on day 5 and 8. Blood collection was done and ovalbumin-specific T-cell populations were examined by tetramer staining for SIINFEKL-specific TCR over time. Tumor size was measured over time and survival data was analyzed accordingly. Results: LDR effectively produced a significant increase in CD8+ SIINFEKL tetramer+ T-cell count per uL of blood compared to the non-preconditioned group. In addition, this LDR preconditioning regiment produced a significantly improved tumor response over time. The overall survival rate of subjects receiving LDR was significantly improved compared to all other groups. Conclusions: Here, we find that LDR is most effective as a preconditioning regimen prior to dendritic cell vaccination for inducing an antitumor T-cell response and achieving tumor control over time. LDR provides a promising method to supplement dendritic cell vaccination and potentially improve patient outcomes. Further study is needed to confirm its efficacy.

High Frequency Heart Rate Variability is Associated with Sensitivity to Affective Touch

C-tactile afferents (CTs) are a class of unmyelinated, mechanosensitive nerve fibre that respond optimally to skin temperature, slow moving touch typical of a caress. They are hypothesised to signal the rewarding value of affiliative tactile interactions. While CT firing frequency is positively correlated with subjective ratings of touch pleasantness, trait differences in sensitivity to the specific hedonic value of CT targeted touch have been reported.Inter-individual differences in vagally mediated, high frequency heart rate variability (HF-HRV) have been linked to variation in visual social cognition. Thus, the aim of the present study was to examine the relationship between resting state HF-HRV and sensitivity to socially relevant CT targeted touch.58 healthy participants first had a 5-minute electrocardiogram. They then rated the pleasantness of 5 randomly presented velocities of robotically delivered touch. Three velocities fell within (1, 3, 10 cm/s) and two outside (0.3, 30 cm/s) the CT optimal range. Each velocity was delivered twice.On a group level, affective touch ratings were described by a negative quadratic function, with CT optimal velocities rated as more pleasant than slower and faster speeds. Simple regression analysis confirmed participants’ HF-HRV was significantly predicted by the quadratic curve fit of their touch ratings, with higher HF-HRV was associated with a better quadratic fit.These findings indicate that, in line with previous observations that higher HF-HRV is associated with enhanced sensitivity to visual social cues, trait differences in autonomic control could account for previously reported individual differences in CT sensitivity.

Computed tomography assessment of robotic versus fluoroscopic implant accuracy in sacroiliac joint fusion.

Computed tomography is considered the gold-standard imaging tool to evaluate spinal implant accuracy. However, there are no studies that evaluate the accuracy of robotic sacroiliac joint (SIJ) implant placement using CT to date. The aim of this study was to compare the accuracy of implant placement on CT between robotic and fluoroscopic navigation for SIJ fusion and the subsequent complications and clinical outcomes of suboptimally placed screws. A retrospective analysis of SIJ fusions utilizing either robotic or fluoroscopic guidance at a single institution was conducted from 2014 to 2023. Implant placement accuracy was evaluated on intra- or postoperative CT. Primary endpoints were SIJ screw placement accuracy and complications. Secondary endpoints were pain status at the first and second follow-ups and rates of 2-year revision surgery. Statistical analysis was performed using chi-square tests. Sixty-nine patients who underwent 78 SIJ fusions were included, of which 63 were robotic and 15 were fluoroscopic. The mean age of the cohort at the time of surgery was 55.9 ± 14.2 years, and 35 patients (50.7%) were female. There were 135 robotically placed and 34 fluoroscopically placed implants. A significant difference was found in implant placement accuracy between robotic and fluoroscopic fusion (97.8% vs 76.5%, p < 0.001). When comparing optimal versus suboptimal implant placement, no difference was found in the presence of 30-day complications (p = 0.98). No intraoperative complications were present in this cohort. No difference was found in subjective pain status at the first (p = 0.69) and second (p = 0.45) follow-ups between optimal and suboptimal implant placement. No patients underwent 2-year revision surgery. Use of robotic navigation was significantly more accurate than the use of fluoroscopic navigation for SIJ implant placement. Complications overall were low and not different between optimally and suboptimally placed implants. Suboptimally placed implants did not differ in degree of subjective pain improvement or rates of revision surgery postoperatively.

Effects of hand catalepsy on subjective trance perception and relative parasympathetic tone in healthy volunteers during pleasant hypnotic session: a randomized controlled study.

This study was designed to evaluate the effects on hand catalepsy on parasympathetic tone assessed using Analgesia/Nociception Index (ANI) and on subjective rating of absorption, dissociation, and time perception among healthy volunteers. This was a randomized controlled trial including participants to a medical hypnosis congress in France. Ninety volunteers were randomized in two arms, all receiving a fifteen-minute positive hypnotic trance, with or without hand catalepsy. The relative parasympathetic tone assessed by ANI (Analgesia/Nociception Index), heart rate and respiratory rate were recorded at different times of the study protocol. The actual duration of the hypnotic session, calculated from eye closing to eye opening, was also recorded. At the end of the hypnotic trance, participants subjectively rated their level of absorption and dissociation on a 0-10 scale. They were also asked to estimate the duration of the hypnotic session from eye closing to eye opening. In total, ninety subjects were included in the study. One subject was excluded because of deviation in the protocol standard, leaving eighty-nine subjects for analysis. Subject characteristics were similar between groups. There was a statistically different increase in ANI and decrease in both heart rate and respiratory rate over time with no difference with or without hand catalepsy. There was no statistically significant difference in absorption and dissociation subjective scales between groups. The median [Q1-Q3] actual duration of hypnotic sessions was similar between the catalepsy and the control groups (9 [8-10] min vs. 8 [7-10] min, respectively). However, subjects in the catalepsy group estimated a longer duration of the hypnotic session (12 [10-15] min) than in the control group (10 [5-10] min) with a mean ± SD overestimation of 3 ± 4min (p < 0.001). Parasympathetic comfort increased during the hypnotic trance with no difference between groups. However, adding hand catalepsy to a pleasant hypnotic trance did not appear to increase feelings of absorption or dissociation but created time distortion on the longer side that could be useful in some clinical settings. Nevertheless, further study is still needed to determine more precisely the physiological and psychological effects on hand catalepsy during the hypnotic trance.

Brain-wide representation of social knowledge.

Understanding how the human brain maps different dimensions of social conceptualizations remains a key unresolved issue. We performed a functional magnetic resonance imaging (MRI) study in which participants were exposed to audio definitions of personality traits and asked to simulate experiences associated with the concepts. Half of the concepts were affective (e.g. empathetic), and the other half were non-affective (e.g. intelligent). Orthogonally, half of the concepts were highly likable (e.g. sincere) and half were socially undesirable (e.g. liar). Behaviourally, we observed that the dimension of social desirability reflected the participant's subjective ratings better than affect. FMRI decoding results showed that both social desirability and affect could be decoded in local patterns of activity through distributed brain regions including the superior temporal, inferior frontal, precuneus and key nodes of the default mode network in posterior/anterior cingulate and ventromedial prefrontal cortex. Decoding accuracy was better for social desirability than affect. A representational similarity analysis further demonstrated that a deep language model significantly predicted brain activity associated with the concepts in bilateral regions of superior and anterior temporal lobes. The results demonstrate a brain-wide representation of social knowledge, involving default model network systems that support the multimodal simulation of social experience, with a further reliance on language-related preprocessing.

Arousal, interindividual differences and temporal binding a psychophysiological study.

The sense of agency varies as a function of arousal in negative emotional contexts. As yet, it is unknown whether the same is true for positive affect, and how inter-individual characteristics might predict these effects. Temporal binding, an implicit measure of the sense of agency, was measured in 59 participants before and after watching either an emotionally neutral film clip or a positive film clip with high or low arousal. Analyses included participants' individual differences in subjective affective ratings, physiological arousal (pupillometry, skin conductance, heart rate), striatal dopamine levels via eye blink rates, and psychopathy. Linear mixed models showed that sexual arousal decreased temporal binding whereas calm pleasure had no facilitation effect on binding. Striatal dopamine levels were positively linked whereas subjective and physiological arousal may be negatively associated with binding towards actions. Psychopathic traits reduced the effect of high arousal on binding towards actions. These results provide evidence that individual differences influence the extent to which the temporal binding is affected by high arousing states with positive valence.

Acute psychosocial stress modulates neural and behavioral substrates of cognitive control.

Acute psychosocial stress affects learning, memory, and attention, but the evidence for the influence of stress on the neural processes supporting cognitive control remains mixed. We investigated how acute psychosocial stress influences performance and neural processing during the Go/NoGo task-an established cognitive control task. The experimental group underwent the Trier Social Stress Test (TSST) acute stress induction, whereas the control group completed personality questionnaires. Then, participants completed a functional magnetic resonance imaging (fMRI) Go/NoGo task, with self-report, blood pressure and salivary cortisol measurements of induced stress taken intermittently throughout the experimental session. The TSST was successful in eliciting a stress response, as indicated by significant Stress > Control between-group differences in subjective stress ratings and systolic blood pressure. We did not identify significant differences in cortisol levels, however. The stress induction also impacted subsequent Go/NoGo task performance, with participants who underwent the TSST making fewer commission errors on trials requiring the most inhibitory control (NoGo Green) relative to the control group, suggesting increased vigilance. Univariate analysis of fMRI task-evoked brain activity revealed no differences between stress and control groups for any region. However, using multivariate pattern analysis, stress and control groups were reliably differentiated by activation patterns contrasting the most demanding NoGo trials (i.e., NoGo Green trials) versus baseline in the medial intraparietal area (mIPA, affiliated with the dorsal attention network) and subregions of the cerebellum (affiliated with the default mode network). These results align with prior reports linking the mIPA and the cerebellum to visuomotor coordination, a function central to cognitive control processes underlying goal-directed behavior. This suggests that stressor-induced hypervigilance may produce a facilitative effect on response inhibition which is represented neurally by the activation patterns of cognitive control regions.

The impact of text type on Chinese-English translation effort: an investigation with reference to translation entropy

Various factors affect translation effort. This research aims to explore the impact of source text type on Chinese-English translation effort with reference to translation entropy. An eye-tracking and key-logging experiment was conducted. Thirty-one student translators translated four text types, namely legal, advertising, news, and poetic texts. Data analyses show that there is a significant difference in participants’ effort of translating the four texts, which can be seen in such indicators as subjective ratings, fixation, pause, translation time, and edits. We further studied participants’ translations and calculated the translation entropy for each text type, which is a measure of uncertainty in translation. Analysis shows that there is a significant difference in translation entropy among the four text types, which provides evidence that source text features affect translation uncertainty and, hence, translation effort to search for appropriate options. The discussions are intended to provide further insight into the impact of text type on the translation process, and the result confirms the reliability of translation entropy as a predictor of translation effort.

Eye tracking and audio sensors to evaluate surgeon's non-technical skills: An empirical study

Non-Technical Skills (NTS) of medical teams are currently measured using subjective and resource-intensive ratings given by experts. This study explores if objective NTS assessment approaches with eye-tracking and audio sensors can measure teamwork and communication skills in surgery. Eight surgeons participated in a simulated two-phase surgical scenario developed to assess their NTS. Sensor-based audio, eye tracking and video data were collected and analyzed along with rating from the NOTSS scale. Different levels of communication were detected by the sensor data during the two phases of the simulated surgery. Sensor data detected leadership qualities among surgeons based on speech metrics, and eye tracking offered additional evidence about gaze patterns related to NTS. This objective approach to NTS measurement captured differences in communication in greater detail as opposed to a single collective rating obtained using current assessment tools.

The Impact of Different Interruptions on Perceived Stress: Developing a Multimodal Measurement for Early Detection

This study presents the experimental findings investigating the effect of different interruptions on stress levels and validates indicators for interruption detection based on machine learning. Data were collected from one hundred and four subjects across simulated office-like tasks (i.e., writing and problem-solving) by four interruption types (i.e., distraction, intrusion, break, and multitasking). Behavioral data (RT and error rate), physiological signals (HR and EDR), and subjective ratings were recorded. Features based on ANOVA were extracted and entered into the classification models as inputs to examine how well different variables could be used to evaluate interruptions. Different stress outcomes were found on objective and subjective measures by interruption type. Also, we found that a combination of physiological signals, behavioral data, and subjective ratings provides the best accuracy. Additionally, the results suggest that task performance is a more reliable indicator than subjective ratings for interruption measurement and classification. This study uses methods that could be adapted for office workers, and the results provide preliminary support for developing an early interruption detection system. The methods employed in this research may benefit office staff, and the results offer preliminary support for developing an early interruption detection system to enhance worker health and company productivity.

Beyond built density: From coarse to fine-grained analyses of emotional experiences in urban environments

The migration of individuals to urban centers in the last century has coincided with a rise in stress-related mental health issues among city dwellers compared to their rural counterparts. Neurourbanism, a burgeoning field, seeks to comprehend the determinants of individual well-being within the urban context. This study investigated the impact of urban density on subjective emotional experiences with a focus on how urban density factors are operationalized in this research field. Using a remote desktop protocol coupled with eye tracking technology, we presented participants with realistic urban stimuli from Berlin, Germany, to assess gaze patterns and subjective responses. Following a two-step analytical approach, we first used a two-factorial design based on low/high built density and absent/present greenery, reflecting the common approach to operationalizing urban density. Subsequently, semantic segmentation of the stimuli was performed, providing a more fine-grained, continuous quantification of density factors allowing for a comparison of this approach with the first categorical analysis. Lastly, individual gaze patterns were exploratively analyzed to predict the impact of directed attention to different classes of urban density on subjective experiences. Dichotomous classification replicated previous findings indicating that high built density was associated with more negative subjective ratings compared to low density, and images lacking greenery received more negative ratings than those with green spaces. Using a continuous quantification of urban density factors and adding additional object classes (cars, people, sky) led to different results compared to the dichotomous approach. Gaze patterns only partially echoed subjective ratings, suggesting urban density factors influence ratings via a general urban scene impression without the need for directed attention towards them. These findings underscore the multifaceted influence of density factors on emotional appraisal in urban spaces, emphasizing the importance of chosen methods. The study demonstrates that fine-grained analyses of urban density factors enhance our understanding of how the urban environment affects the well-being of city dwellers.

Complexity matters: Normalization to prototypical viewpoint induces memory distortion along the vertical axis of scenes.

Scene memory is prone to systematic distortions potentially arising from experience with the external world. Boundary transformation, a well-known memory distortion effect along the near-far axis of the three-dimensional space, represents the observer's erroneous recall of scenes' viewing distance. Researchers argued that normalization to the prototypical viewpoint with the high-probability viewing distance influenced this phenomenon. Herein, we hypothesized that the prototypical viewpoint also exists in the vertical Angle of View (AOV) dimension and could cause memory distortion along scenes' vertical axis. Human subjects of both sexes were recruited to test this hypothesis and two behavioral experiments were conducted, revealing a systematic memory distortion in the vertical AOV in both the forced choice (n = 79) and free adjustment (n = 30) tasks. Furthermore, the regression analysis implied that the complexity information asymmetry in scenes' vertical axis and the independent subjective AOV ratings from a large set of online participants (n = 1208) could jointly predict AOV biases. Furthermore, in a functional Magnetic Resonance Imaging (fMRI) experiment (n = 24), we demonstrated the involvement of areas in the ventral visual pathway (V3/V4, PPA, and OPA) in AOV bias judgment. Additionally, in a Magnetoencephalography (MEG) experiment (n = 20), we could significantly decode the subjects' AOV bias judgments ∼140 ms after scene onset and the low-level visual complexity information around the similar temporal interval. These findings suggest that AOV bias is driven by the normalization process and associated with the neural activities in the early stage of scene processing.Significance Statement Perceiving a scene with high precision is critical for our navigation and interaction with the surrounding environment. However, systematic memory distortion is quite common. Herein, we discovered that scene memory could be distorted to the upper or lower visual field. According to the behavioral results, multiple measures of scenes' complexity information were critically involved in the formation of this memory distortion. Furthermore, the results support the normalization theory regarding the existence of a high-probability prototypical viewpoint in scene processing. Our findings also suggested that the normalization process-induced scene memory distortion could be beneficial for the observer's future action selection. The identified complexity measures could be used in designing Artificial Intelligence (AI) systems with navigational functions.