Digital Phenotyping Research Articles

Smartphone Voice Calls Provide Early Biomarkers of Parkinsonism in Rapid Eye Movement Sleep Behavior Disorder.

Speech dysfunction represents one of the initial motor manifestations to develop in Parkinson's disease (PD) and is measurable through smartphone. The aim was to develop a fully automated and noise-resistant smartphone-based system that can unobtrusively screen for prodromal parkinsonian speech disorder in subjects with isolated rapid eye movement sleep behavior disorder (iRBD) in a real-world scenario. This cross-sectional study assessed regular, everyday voice call data from individuals with iRBD compared to early PD patients and healthy controls via a developed smartphone application. The participants also performed an active, regular reading of a short passage on their smartphone. Smartphone data were continuously collected for up to 3 months after the standard in-person assessments at the clinic. A total of 3525 calls that led to 5990 minutes of preprocessed speech were extracted from 72 participants, comprising 21 iRBD patients, 26 PD patients, and 25 controls. With a high area under the curve of 0.85 between iRBD patients and controls, the combination of passive and active smartphone data provided a comparable or even more sensitive evaluation than laboratory examination using a high-quality microphone. The most sensitive features to induce prodromal neurodegeneration in iRBD included imprecise vowel articulation during phone calls (P = 0.03) and monopitch in reading (P = 0.05). Eighteen minutes of speech corresponding to approximately nine calls was sufficient to obtain the best sensitivity for the screening. We consider the developed tool widely applicable to deep longitudinal digital phenotyping data with future applications in neuroprotective trials, deep brain stimulation optimization, neuropsychiatry, speech therapy, population screening, and beyond. © 2024 The Author(s). Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

T56 - Prospective Acceptability of Digital Phenotyping Among Pregnant and Parenting People With Opioid Use Disorder

T56 - Prospective Acceptability of Digital Phenotyping Among Pregnant and Parenting People With Opioid Use Disorder

Linguistic style as a digital marker for depression severity: An ambulatory assessment pilot study in patients with depressive disorder undergoing sleep deprivation therapy.

Digital phenotyping and monitoring tools are the most promising approaches to automatically detect upcoming depressive episodes. Especially, linguistic style has been seen as a potential behavioral marker of depression, as cross-sectional studies showed, for example, less frequent use of positive emotion words, intensified use of negative emotion words, and more self-references in patients with depression compared to healthy controls. However, longitudinal studies are sparse and therefore it remains unclear whether within-person fluctuations in depression severity are associated with individuals' linguistic style. To capture affective states and concomitant speech samples longitudinally, we used an ambulatory assessment approach sampling multiple times a day via smartphones in patients diagnosed with depressive disorder undergoing sleep deprivation therapy. This intervention promises a rapid change of affective symptoms within a short period of time, assuring sufficient variability in depressive symptoms. We extracted word categories from the transcribed speech samples using the Linguistic Inquiry and Word Count. Our analyses revealed that more pleasant affective momentary states (lower reported depression severity, lower negative affective state, higher positive affective state, (positive) valence, energetic arousal and calmness) are mirrored in the use of less negative emotion words and more positive emotion words. We conclude that a patient's linguistic style, especially the use of positive and negative emotion words, is associated with self-reported affective states and thus is a promising feature for speech-based automated monitoring and prediction of upcoming episodes, ultimately leading to better patient care.

Implementing Digital Multispectral 3D Scanning Technology for Rapid Assessment of Hemp (Cannabis sativa L.) Weed Competitive Traits

The economic significance of hemp (Cannabis sativa L.) as a source of grain, fiber, and flower is rising steadily. However, due to the lack of registered herbicides effective in hemp cultivation, growers have limited weed management options. Plant height, biomass, and canopy architecture may affect crop–weed competition. Greenhouse experiments conducted at the joint Clemson University Coastal Research and Education Center and USDA-ARS research facility at Charleston, SC, USA used 27 hemp varieties, grown under controlled temperature and light conditions. Weekly plant scans using a digital multispectral phenotyping system, integrated with machine learning algorithms of the PlantEye F500 instrument, (Phenospex, Heerlen, Netherlands) captured high-resolution 3D models and spectral data of the plants. Manual and scanner-based measurements were validated and analyzed using statistical methods to assess plant growth and morphology. This study included validation tests showing a significant correlation (p < 0.001) between digital and manual measurements (R2 = 0.89 for biomass, R2 = 0.94 for height), indicating high precision. The use of 3D multispectral scanning significantly reduces the time-intensive nature of manual measurements, allowing for a more efficient assessment of morphological traits. These findings suggest that digital phenotyping can enhance integrated weed management strategies and improve hemp crop productivity by facilitating the selection of competitive hemp varieties.

Digital phenotyping correlates of mobile cognitive measures in schizophrenia: A multisite global mental health feasibility trial

Digital phenotyping correlates of mobile cognitive measures in schizophrenia: A multisite global mental health feasibility trial

Ethical Dimensions of Digital Phenotyping Within the Context of Mental Healthcare

AbstractDigital phenotyping (DP) refers to the emerging field within digital (mental) health that involves the collection of data from individual’s digital devices (smartphones, wearable, Internet usage, etc.) to monitor and analyse their behaviours, activities and health-related patterns. That such ‘digital footprint’ data can be mined for behavioural insights is an intriguing idea, which has motivated an increasing amount of research activity, particularly in the field of digital mental health. Whilst of potentially revolutionary utility in (mental) healthcare, the idea of DP also raises a set of rich sociotechnical, ethical and philosophical considerations, and a cottage industry of sociotechnical and ethical critiques of DP has emerged, particularly within the humanities. Within this scene of early empirical investigation in the health/behavioural sciences on the one hand and general conceptual critiques from the humanities on the other, in this paper we instead explore a case for the potential utility of DP in circumstances of clinical mental health practice and examine its ethical dimensions in this context. After providing an explicatory framework for DP and making a case for it within this framework, we subsequently examine the ethical pros and cons of three topics pertaining to DP in clinical practice, namely (1) issues in psychometric assessment/testing, (2) the role and responsibilities of mental health practitioners with regard to DP technology, and (3) the value DP can afford clients in terms of self-awareness/empowerment and strengthening the therapeutic alliance with their clinician.

Associations of Physical Activity and Heart Rate Variability from a Two-Week ECG Monitor with Cognitive Function and Dementia: The ARIC Neurocognitive Study.

Low physical activity (PA) measured by accelerometers and low heart rate variability (HRV) measured from short-term ECG recordings are associated with worse cognitive function. Wearable long-term ECG monitors are now widely used, and some devices also include an accelerometer. The objective of this study was to evaluate whether PA or HRV measured from long-term ECG monitors was associated with cognitive function among older adults. A total of 1590 ARIC participants had free-living PA and HRV measured over 14 days using the Zio® XT Patch [aged 72-94 years, 58% female, 32% Black]. Cognitive function was measured by cognitive factor scores and adjudicated dementia or mild cognitive impairment (MCI) status. Adjusted linear or multinomial regression models examined whether higher PA or higher HRV was cross-sectionally associated with higher factor scores or lower odds of MCI/dementia. Each 1-unit increase in the total amount of PA was associated with higher global cognition (β = 0.30, 95% CI: 0.16-0.44) and executive function scores (β = 0.38, 95% CI: 0.22-0.53) and lower odds of MCI (OR = 0.38, 95% CI: 0.22-0.67) or dementia (OR = 0.25, 95% CI: 0.08-0.74). HRV (i.e., SDNN and rMSSD) was not associated with cognitive function. More research is needed to define the role of wearable ECG monitors as a tool for digital phenotyping of dementia.

Digital Phenotyping of Geriatric Depression Using a Community-Based Digital Mental Health Monitoring Platform for Socially Vulnerable Older Adults and Their Community Caregivers: 6-Week Living Lab Single-Arm Pilot Study.

Despite the increasing need for digital services to support geriatric mental health, the development and implementation of digital mental health care systems for older adults have been hindered by a lack of studies involving socially vulnerable older adult users and their caregivers in natural living environments. This study aims to determine whether digital sensing data on heart rate variability, sleep quality, and physical activity can predict same-day or next-day depressive symptoms among socially vulnerable older adults in their everyday living environments. In addition, this study tested the feasibility of a digital mental health monitoring platform designed to inform older adult users and their community caregivers about day-to-day changes in the health status of older adults. A single-arm, nonrandomized living lab pilot study was conducted with socially vulnerable older adults (n=25), their community caregivers (n=16), and a managerial social worker over a 6-week period during and after the COVID-19 pandemic. Depressive symptoms were assessed daily using the 9-item Patient Health Questionnaire via scripted verbal conversations with a mobile chatbot. Digital biomarkers for depression, including heart rate variability, sleep, and physical activity, were measured using a wearable sensor (Fitbit Sense) that was worn continuously, except during charging times. Daily individualized feedback, using traffic signal signs, on the health status of older adult users regarding stress, sleep, physical activity, and health emergency status was displayed on a mobile app for the users and on a web application for their community caregivers. Multilevel modeling was used to examine whether the digital biomarkers predicted same-day or next-day depressive symptoms. Study staff conducted pre- and postsurveys in person at the homes of older adult users to monitor changes in depressive symptoms, sleep quality, and system usability. Among the 31 older adult participants, 25 provided data for the living lab and 24 provided data for the pre-post test analysis. The multilevel modeling results showed that increases in daily sleep fragmentation (P=.003) and sleep efficiency (P=.001) compared with one's average were associated with an increased risk of daily depressive symptoms in older adults. The pre-post test results indicated improvements in depressive symptoms (P=.048) and sleep quality (P=.02), but not in the system usability (P=.18). The findings suggest that wearable sensors assessing sleep quality may be utilized to predict daily fluctuations in depressive symptoms among socially vulnerable older adults. The results also imply that receiving individualized health feedback and sharing it with community caregivers may help improve the mental health of older adults. However, additional in-person training may be necessary to enhance usability. ClinicalTrials.gov NCT06270121; https://clinicaltrials.gov/study/NCT06270121.

The dynamics of emotion expression on Twitter and mental health in a UK longitudinal study

Introduction & BackgroundAn estimated 4.95 billion people used social media in 2023, with the average user active on around seven platforms for over two hours per day. This widespread use leads to abundant digital footprint data around interactions with social media. These data can be collected continuously and reflect real behaviour of users in naturalistic settings. These strengths have led researchers to propose the use of social media data in digital phenotyping, where digital footprints can be used to quantify and predict health conditions. Mental health assessment in particular could benefit, as existing approaches, such as self-report questionnaires and inpatient assessment, are unable to perform the real-time monitoring that digital phenotyping could potentially achieve. Digital phenotyping models for mental health require careful consideration of what aspects of social media data to include. Including all data users generate could result in models that are overfitted and difficult to explain. Studies are required that explore the relationship between specific aspects of social media data, such as the time course of expressed emotion, and gold-standard measures of mental health. Objectives & ApproachWith participants’ consent, we linked Twitter data to self-reported measures of mental health from the Avon Longitudinal Study of Parents and Children. We performed sentiment analysis using three different approaches—LIWC, VADER and RoBERTa—to estimate the amount, variability and instability of positive and negative emotional content in each participant’s Tweets over a one-year period. We explored the association between these measures of emotion expression and self-reported scores of depressive symptoms, anxiety symptoms and wellbeing. These mental health measures are the Short Mood and Feelings Questionnaire, the Generalized Anxiety 7 and the Warwick Edinburgh Mental Wellbeing Scale. Relevance to Digital FootprintsOur research is highly relevant to digital footprint research, as it involves the use of digital footprint data (i.e. Twitter data) to predict mental health outcomes. Conclusions & ImplicationsThe results of our analysis will inform the development of digital footprint based phenotyping for mental health that could one day provide information to supplement clinical assessments.

The Potential for Digital Phenotyping in Understanding Mindfulness App Engagement Patterns: A Pilot Study.

Background: Low app engagement is a central barrier to digital mental health efficacy. With mindfulness-based mental health apps growing in popularity, there is a need for new understanding of factors influencing engagement. This study utilized digital phenotyping to understand real-time patterns of engagement around app-based mindfulness. Different engagement metrics are presented that measure both the total number of app-based activities participants completed each week, as well as the proportion of days that participants engaged with the app each week. Method: Data were derived from two iterations of a four-week study exploring app engagement in college students (n = 169). This secondary analysis investigated the relationships between general and mindfulness-based app engagement with passive data metrics (sleep duration, home time, and screen duration) at a weekly level, as well as the relationship between demographics and engagement. Additional clinically focused analysis was performed on three case studies of participants with high mindfulness activity completion. Results: Demographic variables such as gender, race/ethnicity, and age lacked a significant association with mindfulness app-based engagement. Passive data variables such as sleep and screen duration were significant predictors for different metrics of general and mindfulness-based app engagement at a weekly level. There was a significant interaction effect for screen duration between the number of mindfulness activities completed and whether or not the participant received a mindfulness notification. K-means clusters analyses using passive data features to predict mindfulness activity completion had low performance. Conclusions: While there are no simple solutions to predicting engagement with mindfulness apps, utilizing digital phenotyping approaches at a population and personal level offers new potential. The signal from digital phenotyping warrants more investigation; even small increases in engagement with mindfulness apps may have a tremendous impact given their already high prevalence of engagement, availability, and potential to engage patients across demographics.

Feasibility of Observing Cerebrovascular Disease Phenotypes with Smartphone Monitoring: Study Design Considerations for Real-World Studies.

Accelerated by the adoption of remote monitoring during the COVID-19 pandemic, interest in using digitally captured behavioral data to predict patient outcomes has grown; however, it is unclear how feasible digital phenotyping studies may be in patients with recent ischemic stroke or transient ischemic attack. In this perspective, we present participant feedback and relevant smartphone data metrics suggesting that digital phenotyping of post-stroke depression is feasible. Additionally, we proffer thoughtful considerations for designing feasible real-world study protocols tracking cerebrovascular dysfunction with smartphone sensors.

The continued hype and hope of digital phenotyping

The continued hype and hope of digital phenotyping

Assessing Digital Phenotyping for App Recommendations and Sustained Engagement: A Pilot Study (Preprint)

Assessing Digital Phenotyping for App Recommendations and Sustained Engagement: A Pilot Study (Preprint)

Digital phenotyping data and anomaly detection methods to assess changes in mood and anxiety symptoms across a transdiagnostic clinical sample.

Clinical assessment of mood and anxiety change often relies on clinical assessment or self-reported scales. Using smartphone digital phenotyping data and resulting markers of behavior (e.g., sleep) to augment clinical symptom scores offers a scalable and potentially more valid method to understand changes in patients' state. This paper explores the potential of using a combination of active and passive sensors in the context of smartphone-based digital phenotyping to assess mood and anxiety changes in two distinct cohorts of patients to assess the preliminary reliability and validity of this digital phenotyping method. Participants from two different cohorts, each n = 76, one with diagnoses of depression/anxiety and the other schizophrenia, utilized mindLAMP to collect active data (e.g., surveys on mood/anxiety), along with passive data consisting of smartphone digital phenotyping data (geolocation, accelerometer, and screen state) for at least 1 month. Using anomaly detection algorithms, we assessed if statistical anomalies in the combination of active and passive data could predict changes in mood/anxiety scores as measured via smartphone surveys. The anomaly detection model was reliably able to predict symptom change of 4 points or greater for depression as measured by the PHQ-9 and anxiety as measured for the GAD-8 for both patient populations, with an area under the ROC curve of 0.65 and 0.80 for each respectively. For both PHQ-9 and GAD-7, these AUCs were maintained when predicting significant symptom change at least 7 days in advance. Active data alone predicted around 52% and 75% of the symptom variability for the depression/anxiety and schizophrenia populations respectively. These results indicate the feasibility of anomaly detection for predicting symptom change in transdiagnostic cohorts. These results across different patient groups, different countries, and different sites (India and the US) suggest anomaly detection of smartphone digital phenotyping data may offer a reliable and valid approach to predicting symptom change. Future work should emphasize prospective application of these statistical methods.

Using Wearable Digital Devices to Screen Children for Mental Health Conditions: Ethical Promises and Challenges.

In response to a burgeoning pediatric mental health epidemic, recent guidelines have instructed pediatricians to regularly screen their patients for mental health disorders with consistency and standardization. Yet, gold-standard screening surveys to evaluate mental health problems in children typically rely solely on reports given by caregivers, who tend to unintentionally under-report, and in some cases over-report, child symptomology. Digital phenotype screening tools (DPSTs), currently being developed in research settings, may help overcome reporting bias by providing objective measures of physiology and behavior to supplement child mental health screening. Prior to their implementation in pediatric practice, however, the ethical dimensions of DPSTs should be explored. Herein, we consider some promises and challenges of DPSTs under three broad categories: accuracy and bias, privacy, and accessibility and implementation. We find that DPSTs have demonstrated accuracy, may eliminate concerns regarding under- and over-reporting, and may be more accessible than gold-standard surveys. However, we also find that if DPSTs are not responsibly developed and deployed, they may be biased, raise privacy concerns, and be cost-prohibitive. To counteract these potential shortcomings, we identify ways to support the responsible and ethical development of DPSTs for clinical practice to improve mental health screening in children.

Beyond the physical: Digital phenotyping and the complexity of surgical recovery

Digital phenotyping, the moment-by-moment quantification of human behavior in situ using data from personal digital devices, is a potentially powerful tool for increasing understanding of recovery from surgery. While physical metrics are often emphasized, measures of emotional, cognitive, and psychosocial function are important aspects for the surgeon, a better understanding of which can lead to improved preoperative counseling and optimization, shared decision-making, and monitoring of recovery after surgery. A growing number of studies have begun to characterize these techniques. Ultimately, this tool may provide rich data about the perioperative period that will help surgeons and patients alike.

YOLO-Based Phenotyping of Apple Blotch Disease (Diplocarpon coronariae) in Genetic Resources after Artificial Inoculation

YOLO-Based Phenotyping of Apple Blotch Disease (Diplocarpon coronariae) in Genetic Resources after Artificial Inoculation

Moderation Effects of Daily Behavior on Associations Between Symptoms and Social Participation Outcomes After Burn Injury: A 6-Month Digital Phenotyping Study

ObjectiveTo examine the moderation effects of daily behavior on the associations between symptoms and social participation outcomes after burn injury. DesignA 6-month prospective cohort study. SettingCommunity. ParticipantsTwenty-four adult burn survivors. InterventionsNot applicable. Main Outcome MeasuresSymptoms and social participation outcomes were assessed weekly using smartphone surveys, including symptoms of pain (Patient-Reported Outcomes Measurement Information System [PROMIS] Pain Intensity and Pain Interference), anxiety (PROMIS Anxiety), and depression (Patient Health Questionnaire), as well as outcomes of social interactions and social activities (Life Impact Burn Recovery Evaluation [LIBRE] Social Interactions and Social Activities). Daily behaviors were automatically recorded by a smartphone application and smartphone logs, including physical activity (steps, travel miles, and activity minutes), sleep (sleep hours), and social contact (number of phone calls and message contacts). ResultsMultilevel models controlling for demographic and burn injury variables examined the associations between symptoms and social participation outcomes and the moderation effects of daily behaviors. Lower (worse) LIBRE Social Interactions and LIBRE Social Activities scores were significantly associated with higher (worse) PROMIS Pain Intensity, PROMIS Pain Interference, PROMIS Anxiety, and Patient Health Questionnaire-8 scores (P<.05). Additionally, daily steps and activity minutes were associated with LIBRE Social Interactions and LIBRE Social Activities (P<.05), and significantly moderated the association between PROMIS Anxiety and LIBRE Social Activities (P<.001). ConclusionsSocial participation outcomes are associated with pain, anxiety, and depression symptoms after burn injury, and are buffered by daily physical activity. Future intervention studies should examine physical activity promotion to improve social recovery after burns.

Digital Interventions to Understand and Mitigate Stress Response: Protocol for Process and Content Evaluation of a Cohort Study.

Staffing and resource shortages, especially during the COVID-19 pandemic, have increased stress levels among health care workers. Many health care workers have reported feeling unable to maintain the quality of care expected within their profession, which, at times, may lead to moral distress and moral injury. Currently, interventions for moral distress and moral injury are limited. This study has the following aims: (1) to characterize and reduce stress and moral distress related to decision-making in morally complex situations using a virtual reality (VR) scenario and a didactic intervention; (2) to identify features contributing to mental health outcomes using wearable, physiological, and self-reported questionnaire data; and (3) to create a personal digital phenotype profile that characterizes stress and moral distress at the individual level. This will be a single cohort, pre- and posttest study of 100 nursing professionals in Ontario, Canada. Participants will undergo a VR simulation that requires them to make morally complex decisions related to patient care, which will be administered before and after an educational video on techniques to mitigate distress. During the VR session, participants will complete questionnaires measuring their distress and moral distress, and physiological data (electrocardiogram, electrodermal activity, plethysmography, and respiration) will be collected to assess their stress response. In a subsequent 12-week follow-up period, participants will complete regular assessments measuring clinical outcomes, including distress, moral distress, anxiety, depression, and loneliness. A wearable device will also be used to collect continuous data for 2 weeks before, throughout, and for 12 weeks after the VR session. A pre-post comparison will be conducted to analyze the effects of the VR intervention, and machine learning will be used to create a personal digital phenotype profile for each participant using the physiological, wearable, and self-reported data. Finally, thematic analysis of post-VR debriefing sessions and exit interviews will examine reoccurring codes and overarching themes expressed across participants' experiences. The study was funded in 2022 and received research ethics board approval in April 2023. The study is ongoing. It is expected that the VR scenario will elicit stress and moral distress. Additionally, the didactic intervention is anticipated to improve understanding of and decrease feelings of stress and moral distress. Models of digital phenotypes developed and integrated with wearables could allow for the prediction of risk and the assessment of treatment responses in individuals experiencing moral distress in real-time and naturalistic contexts. This paradigm could also be used in other populations prone to moral distress and injury, such as military and public safety personnel. ClinicalTrials.gov NCT05923398; https://clinicaltrials.gov/study/NCT05923398. DERR1-10.2196/54180.

An algorithm to identify patients aged 0–3 with rare genetic disorders

BackgroundWith over 7000 Mendelian disorders, identifying children with a specific rare genetic disorder diagnosis through structured electronic medical record data is challenging given incompleteness of records, inaccurate medical diagnosis coding, as well as heterogeneity in clinical symptoms and procedures for specific disorders. We sought to develop a digital phenotyping algorithm (PheIndex) using electronic medical records to identify children aged 0–3 diagnosed with genetic disorders or who present with illness with an increased risk for genetic disorders.ResultsThrough expert opinion, we established 13 criteria for the algorithm and derived a score and a classification. The performance of each criterion and the classification were validated by chart review. PheIndex identified 1,088 children out of 93,154 live births who may be at an increased risk for genetic disorders. Chart review demonstrated that the algorithm achieved 90% sensitivity, 97% specificity, and 94% accuracy.ConclusionsThe PheIndex algorithm can help identify when a rare genetic disorder may be present, alerting providers to consider ordering a diagnostic genetic test and/or referring a patient to a medical geneticist.