Naturalistic Environment Research Articles

Sleep and psychotic symptoms: An actigraphy and diary study with young adults with low and elevated psychosis proneness

Experimental research has shown that poor sleep triggers psychotic experiences, even in healthy participants. This warrants an in-depth investigation of this mechanism in a naturalistic environment, an exploration of which particular aspects of poor sleep trigger psychotic symptoms, and a test for reverse effects of symptoms on sleep. For this purpose, we conducted a 14-day ambulatory assessment study with 82 young adults (age: M = 21.24 years, SD = 1.54; 64.6% female), half of which were characterized by elevated psychosis proneness. Objective sleep parameters (actigraphically-measured sleep time, wake after sleep onset, sleep efficiency), self-reported sleep parameters (feeling rested, dream recall, dream valence), and psychotic symptoms (paranoid symptoms, hallucinatory experiences) were assessed once per day. Using multilevel regressions (928 data points), we found that shorter sleep time and negative dream valence predicted paranoid symptoms, whereas feeling less rested and dream recall predicted hallucinatory experiences. In participants with elevated psychosis proneness, associations with the aforementioned sleep parameters were increased for hallucinatory experiences but not for paranoid symptoms. Finally, we found bidirectional associations between poor sleep and paranoid symptoms but only unidirectional associations between poor sleep and hallucinatory experiences. The findings corroborate the relevance of sleep disturbance as a predictor of psychotic experiences. Future studies should further investigate the potential of sleep interventions to prevent psychotic symptoms and disorders.

What's in a shape? Evidence of gender category associations with basic forms

Five experiments tested the possibility that basic shapes – squares, circles, and equilateral triangles – are gendered. Based on morphological, evolutionary, and socialization considerations, we hypothesized that square shapes would be associated with the male gender category and circles with the female gender category. Results on both direct (self-report) and indirect (IAT, priming) measures were consistent with the hypothesized associations. Squares and circles were strongly and consistently associated with gender concepts including masculinity/femininity, gendered terms, and traits. When these shapes appeared in a naturalistic environment, their presence served as a belongingness cue for both men and women. These results attest to the existence of gender associations in responses to some basic shapes and, more broadly, raise the possibility that social cognitive processes might play a central role in perception and judgment of social and non-social entities alike.

On the Evolution of a Radical Concept: Affordances According to Gibson and Their Subsequent Use and Development

James J. Gibson, the founder of ecological psychology, introduced a radical empiricist approach to perception and action centered on direct perception in naturalistic environments that was counter to popular representational views of his time. This direct perception approach and the associated introduction of the affordance concept have been extremely influential in several fields of study. However, since its inception, the affordance concept has evolved in a manner such that it now deviates significantly from Gibson’s original intention. This review follows use of the affordance concept by four sets of influential experimental psychologists: Gibson, Donald Norman, Mike Tucker and Rob Ellis, and Daniel Bub and Michael Masson. Particular attention is paid to the manner in which they applied the concept and the contributions provided by each set of researchers. The primary goal of this review is to determine what cognitive psychologists can take away from developments within the field and what considerations should be taken into account when using the term affordance. Having a more thorough understanding of the factors that led to the concept of affordance and its recent reformulations will better equip cognitive psychologists and, by extension, human factors researchers to further advance the study of perception–action relations.

The Dynamics of Attention Shifts Among Concurrent Speech in a Naturalistic Multi-speaker Virtual Environment.

Focusing attention on one speaker on the background of other irrelevant speech can be a challenging feat. A longstanding question in attention research is whether and how frequently individuals shift their attention towards task-irrelevant speech, arguably leading to occasional detection of words in a so-called unattended message. However, this has been difficult to gauge empirically, particularly when participants attend to continuous natural speech, due to the lack of appropriate metrics for detecting shifts in internal attention. Here we introduce a new experimental platform for studying the dynamic deployment of attention among concurrent speakers, utilizing a unique combination of Virtual Reality (VR) and Eye-Tracking technology. We created a Virtual Café in which participants sit across from and attend to the narrative of a target speaker. We manipulated the number and location of distractor speakers by placing additional characters throughout the Virtual Café. By monitoring participant’s eye-gaze dynamics, we studied the patterns of overt attention-shifts among concurrent speakers as well as the consequences of these shifts on speech comprehension. Our results reveal important individual differences in the gaze-pattern displayed during selective attention to speech. While some participants stayed fixated on a target speaker throughout the entire experiment, approximately 30% of participants frequently shifted their gaze toward distractor speakers or other locations in the environment, regardless of the severity of audiovisual distraction. Critically, preforming frequent gaze-shifts negatively impacted the comprehension of target speech, and participants made more mistakes when looking away from the target speaker. We also found that gaze-shifts occurred primarily during gaps in the acoustic input, suggesting that momentary reductions in acoustic masking prompt attention-shifts between competing speakers, in line with “glimpsing” theories of processing speech in noise. These results open a new window into understanding the dynamics of attention as they wax and wane over time, and the different listening patterns employed for dealing with the influx of sensory input in multisensory environments. Moreover, the novel approach developed here for tracking the locus of momentary attention in a naturalistic virtual-reality environment holds high promise for extending the study of human behavior and cognition and bridging the gap between the laboratory and real-life.

Wearable Long-Term Social Sensing for Mental Wellbeing

Long-term wellbeing monitoring is an underlying theme in many local and national policies and procedures outlined by governments and health care services. Natural, efficacious, and trustworthy monitoring by using wearable sensors is necessary for researchers to find and establish the interrelationships of affective computing, body sensor networks (BSNs), social signal processing, and physical mental health. Specially, Giancarlo Fortino has an outstanding contribution for applying BSNs on health monitoring. This paper investigated how technology can help to objectively monitor an individual’s wellbeing in a naturalistic environment. For this purpose, we designed and implemented a wearable device with the integration of multi-sensors which consist of audio sensing, behavior monitoring, environment, and physiological sensing. In order to avoid privacy issues, four audio-wellbeing features are embedded into a wearable hardware platform to automatically evaluate speech information without preserving raw audio data. In addition, four weeks of long-term monitoring experiment studies have been conducted in conjunction with a series of wellbeing questionnaires in a group of students. The relationships between physical and mental health were investigated objectively by utilizing data from speech, behavioral activities and ambient factors in a completely natural daily situation.

Quasi-Operational Testing of Real-Time Storm-Longevity Prediction via Machine Learning

Abstract Real-time prediction of storm longevity is a critical challenge for National Weather Service (NWS) forecasters. These predictions can guide forecasters when they issue warnings and implicitly inform them about the potential severity of a storm. This paper presents a machine-learning (ML) system that was used for real-time prediction of storm longevity in the Probabilistic Hazard Information (PHI) tool, making it a Research-to-Operations (R2O) project. Currently, PHI provides forecasters with real-time storm variables and severity predictions from the ProbSevere system, but these predictions do not include storm longevity. We specifically designed our system to be tested in PHI during the 2016 and 2017 Hazardous Weather Testbed (HWT) experiments, which are a quasi-operational naturalistic environment. We considered three ML methods that have proven in prior work to be strong predictors for many weather prediction tasks: elastic nets, random forests, and gradient-boosted regression trees. We present experiments comparing the three ML methods with different types of input data, discuss trade-offs between forecast quality and requirements for real-time deployment, and present both subjective (human-based) and objective evaluation of real-time deployment in the HWT. Results demonstrate that the ML system has lower error than human forecasters, which suggests that it could be used to guide future storm-based warnings, enabling forecasters to focus on other aspects of the warning system.

From Hong Kong Diabetes Register to JADE Program to RAMP-DM for Data-Driven Actions.

In 1995, the Hong Kong Diabetes Register (HKDR) was established by a doctor-nurse team at a university-affiliated, publicly funded, hospital-based diabetes center using a structured protocol for gathering data to stratify risk, triage care, empower patients, and individualize treatment. This research-driven quality improvement program has motivated the introduction of a territory-wide diabetes risk assessment and management program provided by 18 hospital-based diabetes centers since 2000. By linking the data-rich HKDR to the territory-wide electronic medical record, risk equations were developed and validated to predict clinical outcomes. In 2007, the HKDR protocol was digitalized to establish the web-based Joint Asia Diabetes Evaluation (JADE) Program complete with risk levels and algorithms for issuance of personalized reports to reduce clinical inertia and empower self-management. Through this technologically assisted, integrated diabetes care program, we have generated big data to track secular trends, identify unmet needs, and verify interventions in a naturalistic environment. In 2009, the JADE Program was adapted to form the Risk Assessment and Management Program for Diabetes Mellitus (RAMP-DM) in the publicly funded primary care clinics, which reduced all major events by 30-60% in patients without complications. Meanwhile, a JADE-assisted assessment and empowerment program provided by a university-affiliated, self-funded, nurse-coordinated diabetes center, aimed at complementing medical care in the community, also reduced all major events by 30-50% in patients with different risk levels. By combining universal health coverage, public-private partnerships, and data-driven integrated care, the Hong Kong experience provides a possible solution than can be adapted elsewhere to make quality diabetes care accessible, affordable, and sustainable.

Convolutional Neural Network-based Speech Enhancement for Cochlear Implant Recipients.

Attempts to develop speech enhancement algorithms with improved speech intelligibility for cochlear implant (CI) users have met with limited success. To improve speech enhancement methods for CI users, we propose to perform speech enhancement in a cochlear filter-bank feature space, a feature-set specifically designed for CI users based on CI auditory stimuli. We leverage a convolutional neural network (CNN) to extract both stationary and non-stationary components of environmental acoustics and speech. We propose three CNN architectures: (1) vanilla CNN that directly generates the enhanced signal; (2) spectral-subtraction-style CNN (SS-CNN) that first predicts noise and then generates the enhanced signal by subtracting noise from the noisy signal; (3) Wiener-style CNN (Wiener-CNN) that generates an optimal mask for suppressing noise. An important problem of the proposed networks is that they introduce considerable delays, which limits their real-time application for CI users. To address this, this study also considers causal variations of these networks. Our experiments show that the proposed networks (both causal and non-causal forms) achieve significant improvement over existing baseline systems. We also found that causal Wiener-CNN outperforms other networks, and leads to the best overall envelope coefficient measure (ECM). The proposed algorithms represent a viable option for implementation on the CCi-MOBILE research platform as a pre-processor for CI users in naturalistic environments.

Are Humans Prepared to Detect, Fear, and Avoid Snakes? The Mismatch Between Laboratory and Ecological Evidence.

Since Seligman (1971) statement that the vast majority of phobias are about objects essential to the survival of a species, a multitude of laboratory studies followed, supporting the finding that humans learn to fear and detect snakes (and other animals) faster than other stimuli. Most of these studies used schematic drawings, images, or pictures of snakes, and only a small amount of fieldwork in naturalistic environments was done. We address fear preparedness theories and automatic fast detection data from mainstream laboratory data and compare it with ethobehavioral information relative to snakes, predator-prey interaction, and snakes’ defensive kinematics strikes in order to analyze their potential matching. From this analysis, four main findings arose, namely that (1) snakebites occur when people are very close to the snake and are unaware or unable to escape the bite; (2) human visual detection and escape response is slow compared to the speed of snake strikes; (3) in natural environments, snake experts are often unable to see snakes existing nearby; (4) animate objects in general capture more attention over other stimuli and dangerous, but recent objects in evolutionary terms are also able to be detected fast. The issues mentioned above pose several challenges to evolutionary psychology-based theories expecting to find special-purpose neural modules. The older selective habituation hypothesis (Schleidt, 1961) that prey animals start with a rather general predator image from which specific harmless cues are removed by habituation might deserve reconsideration.

A validation study of a consumer wearable sleep tracker compared to a portable EEG system in naturalistic conditions

ObjectiveTo compare a wearable device, the Fitbit Versa (FV), to a validated portable single-channel EEG system across multiple nights in a naturalistic environment. MethodsTwenty participants (10 men and 10 women) aged 25–67 years were recruited for the present study. Study duration was 14 days during which participants were asked to wear the FV daily and nightly. The study intended to reproduce free-living conditions; thus, no guidelines for sleep or activity were imposed on the participants. A total of 138 person-nights, equivalent to 76,539 epochs, were used in the validation process. Sleep measures were compared between the FV and portable EEG using Bland-Altman plots, paired t-tests and epoch-by-epoch (EBE) analyses. ResultsThe FV showed no significant bias with the EEG for the global sleep measures time in bed (TIB) and total sleep time (TST), and for calculated sleep efficiency (cSE = [TST/TIB] x 100). The FV had 92.1% sensitivity, 54.1% specificity, and 88.5% accuracy with a Cohen's kappa of 0.41, but a prevalence- and bias adjusted kappa of 0.77. The predictive values for sleep (PVS; positive predictive value) and wakefulness (PVW; negative predictive value) were 95.0% and 42.0%, respectively. The FV showed significant bias compared to the portable EEG for time spent in specific sleep stages, for SE as provided by FV, for sleep onset latency, sleep period time, and wake after sleep onset. ConclusionsThe consumer sleep tracker could be a useful tool for measuring sleep duration in longitudinal epidemiologic naturalistic studies albeit with some limitations in specificity.

Manipulating the visibility of barriers to improve spatial navigation efficiency and cognitive mapping

Previous studies from psychology, neuroscience and geography showed that environmental barriers fragment the representation of the environment, reduce spatial navigation efficiency, distort distance estimation and make spatial updating difficult. Despite these negative effects, limited research has examined how to overcome barriers and if individual differences mediate their causes and potential interventions. We hypothesize that the reduced visibility caused by barriers plays a major role in accumulating error in spatial updating and encoding spatial relationships. We tested this using virtual navigation to grant participants ‘X-ray’ vision during environment encoding (i.e., barriers become translucent) and quantifying cognitive mapping benefits of counteracting fragmented visibility. We found that compared to the participants trained with naturalistic environment visibility, participants trained in the translucent environment had better performance in wayfinding and pointing tasks, which are theorized to measure navigation efficiency and cognitive mapping. Interestingly, these benefits were only observed in participants with high self-report sense of direction. Together, our results provide important insight into (1) how perceptual barrier effects manifest, even when physical fragmentation of space is held constant, (2) establish a novel intervention that can improve spatial learning, and (3) provide evidence that individual differences modulate perceptual barrier effects and the efficacy of such interventions.

Investigating Evoked EEG Responses to Targets Presented in Virtual Reality.

Virtual reality (VR) offers the potential to study brain function in complex, ecologically realistic environments. However, the additional degrees of freedom make analysis more challenging, particularly with respect to evoked neural responses. In this paper we designed a target detection task in VR where we varied the visual angle of targets as subjects moved through a three dimensional maze. We investigated how the latency and shape of the classic P300 evoked response varied as a function of locking the electroencephalogram data to the target image onset, the target-saccade intersection, and the first fixation on the target. We found, as expected, a systematic shift in the timing of the evoked responses as a function of the type of response locking, as well as a difference in the shape of the waveforms. Interestingly, single-trial analysis showed that the peak discriminability of the evoked responses does not differ between image locked and saccade locked analysis, though it decreases significantly when fixation locked. These results suggest that there is a spread in the perception of visual information in VR environments across time and visual space. Our results point to the importance of considering how information may be perceived in naturalistic environments, specifically those that have more complexity and higher degrees of freedom than in traditional laboratory paradigms.

Error monitoring and daily life executive functioning

Error monitoring during task execution is reflected in post-error slowing (PES), which refers to the tendency to slow down performance after making an error in order to prevent future mistakes. The key question of the present study is whether poor error monitoring (reduced magnitude of PES) has negative consequences for daily life executive function skills, as well as functioning in different life settings such as work, family, social, and academic settings. Eighty-five university students performed a lexical decision task and completed The Executive Function Index Scale (EFI), and the Weiss Functional Impairments Rating Scale (WFIRS). Individual academic achievement was measured using the Grade Point Average. Statistical analysis revealed that a decreased magnitude of PES was weakly associated with less efficient planning (one of the executive functions). Results suggest that error monitoring, as measured by PES, was not associated with functioning in a naturalistic environment, but could be interpreted to some extent as an experimental marker of planning in daily life executive functioning.

An expert’s mind in action: Assessing attentional focus, workload and performance in a dynamic, naturalistic environment

ABSTRACT The aims of this study were to (1) to explore attentional strategies in expert judo players and (2) investigate how attentional focus affects performance effectiveness and perceptions of workload in expert judo players during real competitions. Fourteen expert male judo players participated in the study. A simulated recall method was used following participants’ competition to explore contents of attention qualitatively. The data analysis process for the qualitative portion of the study was an iterative process between inductive and deductive analyses. Quantitative analyses of performance outcomes and workload were then associated with the qualitative findings. Qualitative results revealed that the focus of attention was dynamic and complex, with technical aspects of the movements as the highest identified focus. Quantitative analyses revealed that reporting a lower quantity of attentional cues and higher percentage of focus on opponent resulted in higher performance effectiveness and less perceptions of workload. This study indicates that cognitive control and automaticity may work in a synergistic manner for successful skill execution in expert performance.

Amygdala growth from youth to adulthood in the macaque monkey.

Emerging evidence suggests that the human amygdala undergoes extensive growth through adolescence, coinciding with the acquisition of complex socioemotional learning. Our objective was to longitudinally map volumetric growth of the nonhuman primate amygdala in a controlled, naturalistic social environment from birth to adulthood. Magnetic resonance images were collected at five time-points in 24 male and female rhesus macaques from 6 months to adulthood at 5 years. We then compared amygdala growth to other brain regions, including newly collected isocortical gray and white matter volumes, and previously published data on the same cohort. We found that amygdala volume increases by nearly 50% from age 6 months to 5 years. This dramatic growth is in contrast to overall brain and hippocampal volume, which peak near 3 years, white matter, which slows from 3 to 5 years, and isocortical gray, which has a net decrease. Similar to isocortical gray and hippocampal volumes, amygdala volume is ~8% larger in males than females. Rate of growth does not differ by sex. Although the underlying neurobiological substrate for protracted amygdala growth into adulthood is unclear, we propose it may be due in part to the unique cellular development of immature neurons in paralaminar nucleus that mature in size and connectivity with age. Prolonged amygdala maturation raises the possibility that environmental and genetic perturbations that disrupt this trajectory may contribute to the emergence of psychiatric disorders, such as anxiety, depression, schizophrenia, and autism; all in which the amygdala is strongly implicated.

From Ecological Momentary Assessment (EMA) to Ecological Momentary Intervention (EMI): Past and Future Directions for Ambulatory Assessment and Interventions in Eating Disorders.

Ambulatory assessment methods, including ecological momentary assessment (EMA), have often been used in eating disorders (EDs) to assess the type, frequency, and temporal sequencing of ED symptoms occurring in naturalistic environments. Relatedly, growing research in EDs has explored the utility of ecological momentary interventions (EMIs) to target ED symptoms. The aims of the present review were to (1) synthesize recent literature pertaining to ambulatory assessment/EMA and EMI in EDs, and (2) identify relevant limitations and future directions in these domains. With respect to ambulatory assessment and EMA, there has been substantial growth in the expansion of constructs assessed with EMA, the exploration of state- vs. trait-level processes, integration of objective and passive assessment approaches, and consideration of methodological issues. The EMI literature in EDs also continues to grow, though most of the recent research focuses on mobile health (mHealth) technologies with relatively minimal EMI components that adapt to momentary contextual information. Despite these encouraging advances, there remain several promising areas of ambulatory assessment research and clinical applications in EDs going forward. These include integration of passive data collection, use of EMA in treatment evaluation and design, evaluation of dynamic system processes, inclusion of diverse samples, and development and evaluation of adaptive, tailored EMIs such as just-in-time adaptive interventions. While much remains to be learned in each of these domains, the continual growth in mobile technology has potential to facilitate and refine our understanding of the nature of ED psychopathology and ultimately improve intervention approaches.

Motor resonance during linguistic processing as shown by EEG in a naturalistic VR environment

Embodied cognition studies have shown motor resonance during action language processing, indicating that linguistic representations are at least partially multimodal. However, constraints of this activation linked to linguistic and extra-linguistic context, function and timing have not yet been fully explored. Importantly, embodied cognition binds social and physical contexts to cognition, suggesting that more ecologically valid contexts will yield more valid measures of cognitive processing. Herein, we measured cortical motor activation during language processing in a fully immersive Cave automatic virtual environment (CAVE). EEG was recorded while participants engaged in a Go/No-Go task. They heard action verbs and, for Go trials, performed a corresponding action on a virtual object. ERSP (event-related spectral perturbation) was calculated during verb processing, corresponding to the pattern of power suppression (event-related desynchronization – ERD) and enhancement (event-related synchronization – ERS) relative to the reference interval. Significant ERD emerged during verb processing in both the µ (8–13 Hz) and beta band (20–30 Hz) for both Go and No-Go trials. µ ERD emerged in the 400–500 msec time window, associated with lexical-semantic processing. Greater µ ERD emerged for Go compared to No-Go trials. The present results provide compelling evidence in a naturalistic setting of how motor and linguistic processes interact.

Gymnastic-Based Movement Therapy for Children With Neurodevelopmental Disabilities: Results From a Pilot Feasibility Study

Background: Developmental and behavioral issues often limit the participation of children with neurodevelopmental disabilities (NDD) in community-based activities with their peers, which decreases opportunities for their social learning and development. Parents of children with NDD seek out programs that address physical and psychosocial development. Several studies already support the positive effects for the child to attend physical activity programs (PAPs). However, these studies are highly prone to biases and Hawthorne effect. In the planning stage of a large prospective study to assess the effectiveness of PAPs we reviewed the records of children who participated in a gymnastic-based program, the Empowering Steps Movement Therapy (ESMT). Besides generating useful data for developing the prospective study we thought these data reflect the rate of changes in context of normal practice in a naturalistic environment; therefore protected from Hawthorne effect and other biases.Design: This is a historical cohort: the files of 67 children with NDD were examined across a 2-year period (Jan 2011 to Jan 2013). As part of standard practice, the ESMT therapists document changes in motor function every 6 months, using the ESMT's proprietary motor scale. Parents also completed a parental questionnaire in June 2011 regarding their perceptions of changes in their child's physical and psychosocial function, as well as family functioning since their child started the program.Results: Linear Mixed Effects Model clearly identified three groups according to changes in motor function: the ones with rapid changes (mostly functional children with autism spectrum disorder: n = 13), the ones with moderate changes (different types of NDD diagnoses: n = 41) and the ones that did not change or even decreased motor skills over the follow-up (children with complex diseases or uncontrolled epilepsy despite treatment: n = 13). Parental questionnaires (n = 39) reported improvement in most of the children's physical and psychosocial abilities; they also indicated improvement in some of the family parameters. There was no association between the changes in children's motor functions and parents' responses to the questionnaire.Conclusion: Despite limitations due to the retrospective nature of the study, the absence of a control group and the absence of validated measurement tools, the observed positive effects of attending movement therapy center on motor performance and psychosocial development confirm in a naturalistic environment what has been shown in context of clinical trials or quasi-experimental studies. These results are not conclusive. They warrant further, rigorous investigation using validated instruments, independent assessors, and control groups.

S59. Digital Cognitive Assessment: Results From the Testmybrain NIMH RDoC Field Test Battery Report

Digital technology has become a major target area for the development of assessments that can be deployed through mobile devices, across large cohorts, and in naturalistic environments. Here, we summarize the results of a report commissioned by the NIMH to evaluate mobile assessments of cognition and their appropriateness for deployment in a field test battery.

Modular structure within groups causes information loss but can improve decision accuracy.

Many animal groups exhibit signatures of persistent internal modular structure, whereby individuals consistently interact with certain groupmates more than others. In such groups, information relevant to a collective decision may spread unevenly through the group, but how this impacts the quality of the resulting decision is not well understood. Here, we explicitly model modularity within animal groups and examine how it affects the amount of information represented in collective decisions, as well as the accuracy of those decisions. We find that modular structure necessarily causes a loss of information, effectively silencing the input from a fraction of the group. However, the effect of this information loss on collective accuracy depends on the informational environment in which the decision is made. In simple environments, the information loss is detrimental to collective accuracy. By contrast, in complex environments, modularity tends to improve accuracy. This is because small group sizes typically maximize collective accuracy in such environments, and modular structure allows a large group to behave like a smaller group (in terms of its decision-making). These results suggest that in naturalistic environments containing correlated information, large animal groups may be able to exploit modular structure to improve decision accuracy while retaining other benefits of large group size.This article is part of the theme issue ‘Liquid brains, solid brains: How distributed cognitive architectures process information’.