Perceived Realism and Voice Naturalness of Virtual Humans: Structural Equation Modeling of Behavioral Intentions among Black American Adults

  • Abstract
  • Literature Map
  • Similar Papers
Abstract
Translate article icon Translate Article Star icon
Take notes icon Take Notes

Virtual health assistants, digital characters designed to guide patients through healthcare interventions, offer scalable solutions, but their effectiveness may depend on user perceptions of realism. This study investigated how the visual fidelity and voice modality of virtual health assistants influence perceived realism, perceived voice naturalness, and intentions to screen for colorectal cancer among Black American adults aged 45–75. In a 2×4 factorial between-participants experiment (N=266), participants were randomized to virtual health assistants varying in visual fidelity and voice modality. Structural equation modeling revealed that voice naturalness had a strong positive effect on perceived realism, which in turn significantly predicted screening intentions. Visual fidelity also contributed directly to perceived realism, though to a lesser extent. These results suggest that enhancing voice naturalness in virtual health assistants may be a critical design priority for improving engagement and promoting preventive health behaviors in digital health interventions.

Similar Papers
  • Research Article
  • Cite Count Icon 1
  • 10.3310/gjhg1331
Design and deployment of digital health interventions to reduce the risk of the digital divide and to inform development of the living with COVID recovery: a systematic scoping review.
  • Oct 1, 2025
  • Health and social care delivery research
  • Fiona L Hamilton + 8 more

Digital health interventions can support health-related knowledge transfer, for example through websites or mobile applications, and may reduce health inequalities by making health care available, where access is difficult, and by translating content to overcome language barriers. However, digital health intervention can also increase health inequalities due to the digital divide. To reach digitally excluded populations, design and delivery mechanisms need to specifically address this issue. This review was conducted during the evolving COVID-19 pandemic and informed the rapid design, deployment and evaluation of a post-COVID-19 rehabilitation digital health intervention: 'Living with COVID Recovery' (LWCR). LWCR needed to be engaging and usable for patients and to avoid exacerbating health inequalities. LWCR was introduced as a service into 33 NHS clinics, was used by 7679 patients, and evaluation ran from August 2020 to December 2022. To identify evidence-based digital health intervention design and deployment features conducive to mitigating the digital divide. Cochrane Library, Epistemonikos, National Institute for Health and Care Excellence Evidence, PROSPERO, PubMed (with MEDLINE and Europe PMC) and Turning Research into Practice; OpenGrey and Google Scholar were searched for primary research studies published in English from 1 October 2011 to 1 October 2021. Adults who were likely to be affected by the digital divide, including older age, minority ethnic groups, lower income/education level and in any healthcare setting. Any digital health intervention with features of design and/or deployment intended to enable access and engagement by the population of focus. Any or none. Any related to participants' access and/or use of digital health intervention and/or change in digital skills and confidence. Data from studies that met the inclusion criteria were extracted, narratively synthesised and thematically analysed. Twenty-two papers met the inclusion criteria. Digital health interventions evaluated included telehealth, text message interventions, virtual assistants, self-management programmes and decision aids. Co-development with end-users, user testing through iterative design cycles, digital health interventions that also helped improve digital skills and digital health literacy, tailoring for low literacy through animations, pictures, videos and writing for low reading ages; virtual assistants to collect information from patients and guide the use of a digital health intervention. Free devices and data, or signposting to sources of cheap/free devices and Wi-Fi, text message interventions, providing 'human support', providing tailored digital skills education as part of the intervention and enabling peer/family support. Our search extended to late 2021, and there has been a massive increase in the literature following the pandemic. However, as our review was undertaken to inform the LWCR digital health intervention design and deployment, we have reported the results that informed this work. The studies included in the review were heterogeneous, so generalisability may be limited. Few randomised controlled trials assessed the digital health intervention's impact on digital health skills by using validated measures. Using the design and deployment findings described above when developing digital health interventions may help overcome the digital divide. Beyond informing the LWCR digital health intervention development, the review findings have wider implications for the equitable design, delivery and evaluation of digital health interventions. This article presents independent research funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme as award number NIHR132243.

  • Supplementary Content
  • Cite Count Icon 16
  • 10.2196/52609
Acceptability of Digital Mental Health Interventions for Depression and Anxiety: Systematic Review
  • Oct 28, 2024
  • Journal of Medical Internet Research
  • Carrie K Y Lau + 4 more

BackgroundDepression and anxiety disorders are common, and treatment often includes psychological interventions. Digital health interventions, delivered through technologies such as web-based programs and mobile apps, are increasingly used in mental health treatment. Acceptability, the extent to which an intervention is viewed positively, has been identified as contributing to patient adherence and engagement with digital health interventions. Acceptability, therefore, impacts the benefit derived from using digital health interventions in treatment. Understanding the acceptability of digital mental health interventions among patients with depression or anxiety disorders is essential to maximize the effectiveness of their treatment.ObjectiveThis review investigated the acceptability of technology-based interventions among patients with depression or anxiety disorders.MethodsA systematic review was performed based on PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) and PROSPERO (International Prospective Register of Systematic Reviews) guidelines. We searched PubMed, Web of Science, and Ovid in May 2022. Studies were included if they evaluated digital interventions for the treatment of depression or anxiety disorders and investigated their acceptability among adult patients. Studies were excluded if they targeted only specific populations (eg, those with specific physical health conditions), investigated acceptability in healthy individuals or patients under the age of 18 years, involved no direct interaction between patients and technologies, used technology only as a platform for traditional care (eg, videoconferencing), had patients using technologies only in clinical or laboratory settings, or involved virtual reality technologies. Acceptability outcome data were narratively synthesized by the direction of acceptability using vote counting. Included studies were evaluated using levels of evidence from the Oxford Centre for Evidence-Based Medicine. The risk of bias was assessed using a tool designed for this review and GRADE (Grading of Recommendations, Assessment, Development, and Evaluation).ResultsA total of 143 articles met the inclusion criteria, comprising 67 (47%) articles on interventions for depression, 65 (45%) articles on interventions for anxiety disorders, and 11 (8%) articles on interventions for both. Overall, 90 (63%) were randomized controlled trials, 50 (35%) were other quantitative studies, and 3 (2%) were qualitative studies. Interventions used web-based programs, mobile apps, and computer programs. Cognitive behavioral therapy was the basis of 71% (102/143) of the interventions. Digital mental health interventions were generally acceptable among patients with depression or anxiety disorders, with 88% (126/143) indicating positive acceptability, 8% (11/143) mixed results, and 4% (6/143) insufficient information to categorize the direction of acceptability. The available research evidence was of moderate quality.ConclusionsDigital mental health interventions seem to be acceptable to patients with depression or anxiety disorders. Consistent use of validated measures for acceptability would enhance the quality of evidence. Careful design of acceptability as an evaluation outcome can further improve the quality of evidence and reduce the risk of bias.Trial RegistrationOpen Science Framework Y7MJ4; https://doi.org/10.17605/OSF.IO/SPR8M

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 325
  • 10.2196/16317
Engaging Children and Young People in Digital Mental Health Interventions: Systematic Review of Modes of Delivery, Facilitators, and Barriers.
  • Jun 23, 2020
  • Journal of Medical Internet Research
  • Shaun Liverpool + 13 more

BackgroundThere is a high prevalence of children and young people (CYP) experiencing mental health (MH) problems. Owing to accessibility, affordability, and scalability, an increasing number of digital health interventions (DHIs) have been developed and incorporated into MH treatment. Studies have shown the potential of DHIs to improve MH outcomes. However, the modes of delivery used to engage CYP in digital MH interventions may differ, with implications for the extent to which findings pertain to the level of engagement with the DHI. Knowledge of the various modalities could aid in the development of interventions that are acceptable and feasible.ObjectiveThis review aimed to (1) identify modes of delivery used in CYP digital MH interventions, (2) explore influencing factors to usage and implementation, and (3) investigate ways in which the interventions have been evaluated and whether CYP engage in DHIs.MethodsA literature search was performed in the Cochrane Library, Excerpta Medica dataBASE (EMBASE), Medical Literature Analysis and Retrieval System Online (MEDLINE), and PsycINFO databases using 3 key concepts “child and adolescent mental health,” “digital intervention,” and “engagement.” Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were followed using rigorous inclusion criteria and screening by at least two reviewers. The selected articles were assessed for quality using the mixed methods appraisal tool, and data were extracted to address the review aims. Data aggregation and synthesis were conducted and presented as descriptive numerical summaries and a narrative synthesis, respectively.ResultsThis study identified 6 modes of delivery from 83 articles and 71 interventions for engaging CYP: (1) websites, (2) games and computer-assisted programs, (3) apps, (4) robots and digital devices, (5) virtual reality, and (6) mobile text messaging. Overall, 2 themes emerged highlighting intervention-specific and person-specific barriers and facilitators to CYP’s engagement. These themes encompassed factors such as suitability, usability, and acceptability of the DHIs and motivation, capability, and opportunity for the CYP using DHIs. The literature highlighted that CYP prefer DHIs with features such as videos, limited text, ability to personalize, ability to connect with others, and options to receive text message reminders. The findings of this review suggest a high average retention rate of 79% in studies involving various DHIs.ConclusionsThe development of DHIs is increasing and may be of interest to CYP, particularly in the area of MH treatment. With continuous technological advancements, it is important to know which modalities may increase engagement and help CYP who are facing MH problems. This review identified the existing modalities and highlighted the influencing factors from the perspective of CYP. This knowledge provides information that can be used to design and evaluate new interventions and offers important theoretical insights into how and why CYP engage in DHIs.

  • Research Article
  • Cite Count Icon 1
  • 10.1097/jcn.0000000000000985
Digital Technology in Cardiovascular Health: Role and Evidence Supporting Its Use.
  • Mar 31, 2023
  • The Journal of cardiovascular nursing
  • Pamela Martyn-Nemeth + 1 more

Digital health technology provides opportunities to leverage artificial intelligence and other digital applications to promote cardiovascular health. Digital health technologies include artificial intelligence (such as machine learning [ML], neural networks),1 analytic systems, mobile apps, wearables, email, text messaging, and telemedicine.2 In this article, we review the role of digital technology in cardiovascular health and a selection of recent studies to evaluate the evidence of its effectiveness. Artificial intelligence is broadly defined as the capability of computer systems to perform tasks similar to humans.3 Examples include vision, speech, pattern recognition, and decision making. Machine learning is the ability of the computer program to learn from experience. This typically occurs from analysis of large sets of data processed through human-derived algorithms to enhance, predict, and explain outcomes.4 An example of the use of ML in clinical care is cardiovascular disease (CVD) prediction and electrocardiographic interpretation. Neural networks, named after the human nervous system, are nonlinear statistic models that control where signals are sent. Neural networks can be used for decision making such as cardiovascular diagnosis confirmation. Digital Technology Use in Cardiovascular Risk Assessment Several studies have demonstrated improved CVD risk factor identification using ML compared with traditional risk assessment tools. Researchers developed an ML risk calculator and compared it with the American College of Cardiology/American Heart Association CVD risk calculator in 6459 participants from the Multi-Ethnic Study of Atherosclerosis.5 Study participants were free of CVD at baseline and followed for 13 years. Results revealed that the American College of Cardiology/American Heart Association risk calculator was less precise: statin therapy was recommended to 46% of the sample, with 23.8% of CVD events occurring in those not recommended a statin. In comparison, the ML risk calculator recommended a statin to 11% of the sample, with 14.4% of CVD events occurring in those not recommended a statin.5 Similarly in 3 cohorts from Australia, 4 ML models were developed and compared with the 2008 Framingham model. The ML models provided 2.7% to 5.2% better predictions across all 3 cohorts.6 Taken together, the authors of these studies suggest ML provides promise in providing more precise estimates of CVD risk. Digital Health Interventions for Cardiovascular Disease Prevention Digital health interventions have the potential to provide a personalized approach to promote cardiovascular health. Behavior change theory is a key component of digital interventions and includes theoretical frameworks such as supportive accountability,7 self-efficacy theory,8 social cognitive theory, and the health belief model.9 Precision healthcare has been promoted for decades. Many of the challenges in operationalizing precision healthcare are healthcare accessibility, scheduling, care continuity, and inadequate knowledge exchange between provides and patients.10 Thus, promotion of healthy lifestyles and lifestyle risk factor reduction remain inadequately addressed in patients with CVD.11 To achieve sustainable change, individual-level personalized strategies may be leveraged through digital health interventions. Evidence of the effectiveness of digital health interventions has varied but is promising overall. Text messaging has been successfully used to provide information regarding healthy diet and physical activity recommendations, monitoring, and individual feedback. Text messaging has resulted in improvements in diet and activity in many (TextMe,12 Mobile MyPlate,13 MyQuest,14 Text-To-Move15), but not all studies.16 Smartphone/mobile apps have been designed to improve dietary and physical activity behavior. Examples include apps that track dietary patterns and activity through user input of text or visual images.17,18 Users can set their own goals and receive feedback on progress toward goals. Reviews of smartphone apps have had variable results with many demonstrating short-term improvement. Villinger et al19 conducted a systematic review and meta-analysis of the effectiveness of mobile app interventions on nutrition behaviors (41 studies, 27 randomized controlled trials [RCTs]). Findings revealed significantly improved nutrition behaviors and nutrition-related outcomes (P = .004 and P = .043, respectively). A second systematic review of 27, primarily RCTs, found significant between-group improvements in 19 of the 27 studies.20 A meta-analysis of 6 RCTs in adults using a smartphone app as the primary component of the intervention revealed a trend for more steps per day in the intervention compared with the control groups, with programs lasting less than 3 months more effective than longer programs.21 Taken together, text messaging and smartphone/mobile apps have the potential to improve lifestyle behaviors associated with cardiovascular health. The addition of strategies to increase sustainability of the effects needs to be assessed. Digital Health Interventions: Primary and Secondary Prevention Widmer et al2 conducted a meta-analysis of 51 RCTs and cohort studies using digital health interventions for the prevention of CVD events and risk factor modification. Subgroup analyses of primary prevention studies (2 studies) did not provide evidence of a statistically significant reduction in CVD outcomes. However, evaluation of individual risk factors in primary prevention studies found a significant reduction in weight (11 studies; −3.35 lb), systolic blood pressure (23 studies; mean difference, −2.12 mm Hg), total cholesterol (13 studies; mean difference, −5.19 mg/dL), low-density lipoprotein cholesterol (8 studies; mean difference, −4.96 mg/dL), and glucose (6 studies; mean difference, −1.38 mg/dL).2 A subgroup analysis of secondary prevention studies demonstrated a significant impact of digital interventions on CVD outcomes (relative risk, 0.60; a 40% relative risk reduction), improvement in body mass index (6 studies; mean difference, −0.31 kg/m2) but no improvement in weight, systolic blood pressure, total cholesterol, low-density lipoprotein cholesterol, and glucose. Taken together, this meta-analysis suggested that digital interventions were beneficial not only in lowering CVD events in higher-risk patients but also in lowering risk factors in primary prevention approaches.2 In a second meta-analysis conducted by Akinosun et al,11 researchers analyzed 25 RCTs in patients with traditional CVD risk factors who received a digital intervention versus usual care.11 Findings revealed benefits in total cholesterol (mean difference, −0.29), high-density lipoprotein cholesterol (mean difference, −0.09), low-density lipoprotein (mean difference, 0.18), physical activity (mean difference 0.23), physical inactivity (relative risk, 0.54), and diet (relative risk, 0.79). There was no significant improvement in body mass index, systolic and diastolic blood pressure, hemoglobin A1C, alcohol intake, smoking, and medication adherence. Authors concluded that digital interventions were more effective at improving healthy behaviors than reducing unhealthy behaviors. In patients who experienced a myocardial infarction, a digital health intervention providing medication reminders, vital sign and activity tracking, education, and outpatient care coordination resulted in a 52% lower 30-day readmission rate compared with usual care.22 Sociodemographic characteristics (age, sex, and race) did not influence use of the digital intervention, highlighting a potential role for digital interventions in the promotion of equity in social determinants of health.23 Digital Health Interventions in Cardiac Rehabilitation Cardiac rehabilitation is an essential component of secondary prevention of CVD.24 Some patients face barriers in participation in cardiac rehabilitation due to physical accessibility, time, and travel.25 Digital health interventions have the potential to bridge these barriers and increase participation. Digital delivery of cardiac rehabilitation therapy with real-time personalized support has several advantages.26 In a systematic review of 31 studies in which authors examined digital health interventions for cardiac rehabilitation, the results revealed that cardiac rehabilitation program adherence was greater in patients using digital interventions than traditional methods alone. Secondary benefits were found in self-efficacy, weight management, diet, and quality of life. Taken together, digital cardiac rehabilitation was feasible and effective whether used alone or in combination with traditional cardiac rehabilitation.26 Conclusion Digital health technology is an evolving field with tremendous potential to improve cardiovascular health. Cardiovascular disease remains the major cause of death in the United States. The age-adjusted mortality rate has increased in the last decade. More people died from CVD causes in 2020 (nearly 900 000 deaths) than any year since 2003.27 Opportunities to reduce CVD and CVD risk have not been fully leveraged, and digital technology interventions have the potential to meet this need. Digital health technology also has the potential to provide equitable and personalized care. Device data, electronic medical record data, and social determinants of health data provide an opportunity to combine and identify longitudinal trends and risk factors before CVD begins. In the future, large data sets can be created that can be analyzed using ML to identify patterns and structures within and among the data to provide a more robust risk assessment to promote CVD prevention.

  • Research Article
  • 10.1161/str.56.suppl_1.ns5
Abstract NS5: Application of Digital Health Interventions in Quality of Life and Psychological Status of Stroke Patients: Systematic Review and Meta-analysis
  • Feb 1, 2025
  • Stroke
  • Lu Chen + 2 more

Background and purpose: The aim of this study is to assess the impacts of digital health interventions on quality of life and mental status in stroke patients. Stroke is one of the leading causes of death and disability worldwide, and patients are often associated with emotional problems such as depression and anxiety during recovery, hence, it is important to explore effective interventions. Digital health intervention technologies, including virtual reality (VR), telemedicine, and robotic assistance, are the focus of this study because of their innovation and potential effects. Methods: Following predefined protocols, the study searched four databases up to November 2023, screened for relevant randomized controlled trials (RCTs), and extracted data on quality of life and psychological status, including depression/anxiety. A total of 17 studies involving 1437 participants were included. The study used different digital health interventions, including VR, robotic-assisted and telemedicine, and standardized mean differences (SMD) and 95% confidence intervals (CI) were used to assess intervention effectiveness. Results: The data show that digital health interventions are more effective than conventional treatments in improving the quality of life of stroke patients and reducing the incidence of psychological disorders. In particular, significant differences were observed in the intervention groups for VR (SMD = 0.90, 95% CI = [0.07, 1.73]), robotic-assisted (SMD = -0.65, 95% CI = [-1.11, -0.19]) and telemedicine (SMD = 0.27, 95% CI=[0.11, 0.44]). In addition, the study found that digital health interventions were effective in reducing the incidence of depression in stroke patients, thereby improving their psychological well-being. Conclusions: Digital health interventions have been shown to be effective in improving the quality of life and psychological well-being of stroke patients. However, it is worth noting that anxiety levels did not significantly improve among patients with digital health interventions. This suggests that future research should adjust its focus to explore whether specific factors associated with stroke patients correlate with the effectiveness of digital interventions in improving anxiety states. It is also necessary to assess the long-term effects of digital health interventions. Further exploration is needed to optimize the approach, intensity, and frequency of digital health interventions for stroke patients.

  • Research Article
  • Cite Count Icon 1
  • 10.3389/fmed.2024.1375622
Digital versus non-digital health interventions to improve iron supplementation in pregnant women: a systematic review and meta-analysis.
  • May 30, 2024
  • Frontiers in medicine
  • Yu Shao + 2 more

To investigate the effects of digital health interventions for improving adherence to oral iron supplementation in pregnant women. Five databases were searched from their inception to October 2023 with no date restrictions. Randomized controlled trials (RCTs) that assessed the effects of digital health interventions on adherence to oral iron supplementation (e.g., tablets and capsules) compared to non-digital health interventions for pregnant women were eligible. We calculated standardized mean differences (SMDs) and mean differences (MDs) with 95% confidence intervals (CIs) for continuous variables using the inverse variance method. We calculated odds ratios (OR) with 95%CI for categorical variables using the Mantel-Haenszel model. The certainty of the evidence was assessed using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach. The risk of bias of the included RCTs was assessed using the Cochrane risk of bias tool 2.0. Ten trials with 1,633 participants were included. Based on 7 trials, digital health interventions can improve objective adherence rate comparing with non-digital health interventions (1,289 participants, OR = 4.07 [2.19, 7.57], p < 0.001, I2 = 69%) in pregnant women. Digital health interventions can improve subjective adherence behavior comparing with non-digital health interventions (3 trials, 434 participants, SMD = 0.82 [0.62, 1.01], p < 0.001, I2 = 0%) in pregnant women. Based on 3 trials, digital health interventions can improve tablets consumption comparing with non-digital health interventions (333 participants, SMD = 1.00 [0.57, 1.42], p < 0.001, I2 = 66%) in pregnant women. Digital health interventions can improve hemoglobin level comparing with non-digital health interventions (7 trials, 1,216 participants, MD = 0.59 [0.31, 0.88], p < 0.001, I2 = 93%) in pregnant women. Digital health interventions were effective at improving adherence to oral iron supplementation and hemoglobin levels in pregnant women.

  • Research Article
  • Cite Count Icon 49
  • 10.7717/peerj.13111
Effectiveness of digital mental health interventions for university students: an umbrella review.
  • Mar 31, 2022
  • PeerJ
  • Sophia Harith + 4 more

BackgroundPoor mental health among university students remains a pressing public health issue. Over the past few years, digital health interventions have been developed and considered promising in increasing psychological wellbeing among university students. Therefore, this umbrella review aims to synthesize evidence on digital health interventions targeting university students and to evaluate their effectiveness.MethodsA systematic literature search was performed in April 2021 searching PubMed, Psychology and Behavioural Science Collection, Web of Science, ERIC, and Scopus for systematic reviews and meta-analyses on digital mental health interventions targeting university students. The review protocol was registered in the International Prospective Register of Systematic Reviews PROSPERO [CRD42021234773].ResultsThe initital literature search resulted in 806 records of which seven remained after duplicates were removed and evaluated against the inclusion criteria. Effectiveness was reported and categorized into the following six delivery types: (a) web-based, online/computer-delivered interventions (b) computer-based Cognitive Behavior Therapy (CBT), (c) mobile applications and short message service (d) virtual reality interventions (e) skills training (f) relaxation and exposure-based therapy. Results indicated web-based online/computer delivered-interventions were effective or at least partially effective at decressing depression, anxiety, stress and eating disorder symptoms. This was similar for skills-training interventions, CBT-based intervention and mobile applications. However, digital mental health interventions using virtual reality and relaxation, exposure-based therapy was inconclusive. Due to the variation in study settings and inconsistencies in reporting, effectiveness was greatly dependent on the delivery format, targeted mental health problem and targeted purpose group.ConclusionThe findings provide evidence for the beneficial effect of digital mental health interventions for university students. However, this review calls for a more systematic approach in testing and reporting the effectiveness of digital mental health interventions.

  • Research Article
  • 10.2196/64967
Designing a Visual Analytics Tool to Support Data Analysis Tasks of Digital Mental Health Interventions: Case Study.
  • Jul 31, 2024
  • JMIR human factors
  • Gyuwon Jung + 4 more

Digital health interventions (DHIs) are widely used to manage users' health in everyday life through digital devices. The use of DHIs generates various data, such as records of intervention use and the status of target symptoms, providing researchers with data-driven insights for improving these interventions even after deployment. Although DHI researchers have investigated these data, existing analysis practices have been fragmented, limiting a comprehensive understanding of the data. We proposed an analysis task model to help DHI researchers analyze observational data from a holistic perspective. This model was then used to prototype an interactive visual analytics tool. We aimed to evaluate the suitability of the model for DHI data analysis and explore task support using a visual analytics tool. We constructed a data analysis task model using 3 key components (ie, user grouping criteria) for DHI data analysis: user characteristics, user engagement with DHIs, and the effectiveness of DHIs on target symptoms based on comparisons before and after the intervention. On the basis of this model, we designed Maum Health Analytics, a medium-fidelity prototype of an interactive visual analytics tool. Each feature of the prototype was mapped one-to-one to the analysis task described in the model. To investigate whether the proposed model adequately reflects real-world DHI analysis needs, we conducted a preliminary user study with 5 groups of researchers (N=15). Participants explored the tool through scenario-based analysis tasks using in-the-wild data collected from a mobile DHI service targeting depressive symptoms. Following the session, we conducted interviews to assess the appropriateness of the defined tasks and the usability and practical utility of the visual analytics tool. DHI researchers responded positively to both the analysis task model and the visual analytics tool. In the interviews, participants noted that the tool supported the identification of users who needed additional care, informed content recommendations, and helped analyze intervention effectiveness in relation to user characteristics and engagement levels. They also appreciated the tool's role in simplifying analytic tasks and supporting communication across multidisciplinary teams. Additional suggestions included improvements for continuity across tasks and more detailed engagement metrics. We proposed an analysis task model and designed an interactive visual analytics tool to support DHI researchers. Our user study showed that the model allows a holistic investigation of DHI data by integrating key analysis components and that the prototype tool simplifies analytic tasks and enhances communication among researchers. As DHIs grow, the proposed model and tool can effectively meet the data analysis requirements of researchers and improve efficiency.

  • Supplementary Content
  • 10.2196/68112
Digital Health Interventions Providing Behavioral Assessment and Goal Prioritization Support: Scoping Review
  • Aug 28, 2025
  • Journal of Medical Internet Research
  • Ilona Margaret Mcneill + 2 more

BackgroundAffordability of health care systems depends on populations’ engagement in preventive health behavior and appropriate self-management of long-term conditions. Digital health interventions (DHIs) could facilitate this by prompting and supporting individual health behavior change. Behavior change is often undermined by suboptimal prioritization of goals. Therefore, DHIs aiming to promote behavior change should help users identify behavior patterns that need changing and scaffold goal prioritization.ObjectiveThis scoping review explores the extent to which DHIs are supporting users to identify and prioritize goals relevant to managing and improving health.MethodsThe review followed the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. Web of Science (Core Collection), Scopus, Ovid (Embase, MEDLINE, PsycINFO, and Global Health), and EBSCOHOST (Academic Search Complete and CINAHL Complete) were searched for literature on the development and evaluation of digital interventions that (1) assess users’ current health or health-related behaviors and (2) offer support on prioritization of health-related goals.ResultsFifty-six papers were included. These identified 19 unique DHIs. Targeted populations included the general population (n=10), those at risk of or diagnosed with cardiovascular disease (n=4), those at risk of or diagnosed with diabetes (n=2), those diagnosed with cancer (n=2), or those diagnosed with HIV (n=1). One DHI targeted preconception among African American women. All DHIs targeted physical activity and most (n=17) targeted diet and smoking, closely followed by alcohol use (n=15) and mental health (n=13). Social wellbeing (n=5), sleep (n=4), and pain (n=1) were less commonly included. All 19 DHIs included a health risk assessment with feedback identifying health domains in need of improvement, but only four asked users to select a prioritized change goal. Outcome evaluations were conducted for most (n=14), with nine DHIs evaluated using at least one randomized control trial (RCT). Almost half of all DHIs (n=9) reported at least one evaluation of behavioral outcomes, mostly employing RCTs (7/9). Six of 19 reported at least one evaluation of psychological health outcomes, again mostly employing RCTs (5/6). Among the seven DHIs for which behavioral outcomes were evaluated using a RCT, effects were mixed, with only one DHI showing significant effects across all assessed behavioral outcomes. Three found significant effects for some, but not all, outcomes or timepoints, and three found no significant effects.ConclusionsAlthough all 19 DHIs provided some advice about which health-related goals to prioritize, most did not actively prompt users to set such priorities. DHIs showing the most promise in terms of health behavior change were those that explicitly promoted users to prioritize changing specified health behaviors. This review highlights how DHIs could provide greater behavior change support and provides the basis for designing more effective DHIs.

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 11
  • 10.2196/41240
Tough Talks COVID-19 Digital Health Intervention for Vaccine Hesitancy Among Black Young Adults: Protocol for a Hybrid Type 1 Effectiveness Implementation Randomized Controlled Trial.
  • Feb 13, 2023
  • JMIR Research Protocols
  • Henna Budhwani + 11 more

Interventions for increasing the uptake of COVID-19 vaccination among Black young adults are central to ending the pandemic. Black young adults experience harms from structural forces, such as racism and stigma, that reduce receptivity to traditional public health messaging due to skepticism and distrust. As such, Black young adults continue to represent a priority population on which to focus efforts for promoting COVID-19 vaccine uptake. In aims 1 and 2, the Tough Talks digital health intervention for HIV disclosure will be adapted to address COVID-19 vaccine hesitancy and tailored to the experiences of Black young adults in the southern United States (Tough Talks for COVID-19). In aim 3, the newly adapted Tough Talks for COVID-19 digital health intervention will be tested across the following three southern states: Alabama, Georgia, and North Carolina. Our innovative digital health intervention study will include qualitative and quantitative assessments. A unique combination of methodological techniques, including web-based surveys, choose-your-own-adventures, digital storytelling, user acceptability testing, and community-based participatory approaches, will culminate in a 2-arm hybrid type 1 effectiveness implementation randomized controlled trial, wherein participants will be randomized to the Tough Talks for COVID-19 intervention arm or a standard-of-care control condition (N=360). Logistic regression will be used to determine the effect of the treatment arm on the probability of vaccination uptake (primary COVID-19 vaccine series or recommended boosters). Concurrently, the inner and outer contexts of implementation will be ascertained and catalogued to inform future scale-up. Florida State University's institutional review board approved the study (STUDY00003617). Our study was funded at the end of April 2021. Aim 1 data collection concluded in early 2022. The entire study is expected to conclude in January 2025. If effective, our digital health intervention will be poised for broad, rapid dissemination to reduce COVID-19 mortality among unvaccinated Black young adults in the southern United States. Our findings will have the potential to inform efforts that seek to address medical mistrust through participatory approaches. The lessons learned from the conduct of our study could be instrumental in improving health care engagement among Black young adults for several critical areas that disproportionately harm this community, such as tobacco control and diabetes prevention. ClinicalTrials.gov NCT05490329; https://clinicaltrials.gov/ct2/show/NCT05490329. DERR1-10.2196/41240.

  • PDF Download Icon
  • Preprint Article
  • 10.2196/preprints.64967
Designing a Visual Analytics Tool to Support Analysis Tasks of Digital Mental Health Interventions: A Proof-of-Concept Study (Preprint)
  • Jul 31, 2024
  • Gyuwon Jung + 4 more

BACKGROUND Digital Health Interventions (DHIs) are widely used to manage users' health in everyday life through digital devices. The use of DHIs generates various data, such as records of intervention usage and the status of target symptoms, providing researchers with data-driven insights for improving these interventions even after deployment. Although DHI researchers have investigated this data, existing analysis practices have been carried out in a fragmented manner, limiting the comprehensive understanding of the data. OBJECTIVE We proposed an analysis task model to help DHI researchers analyze observational data from a holistic perspective. This model was then used to prototype an interactive visual analytics tool. Our objective is to evaluate the model’s suitability for DHI data analysis and explore task support through a visual analytics tool. METHODS We constructed an analysis task model based on data analysis practices from existing DHI research. Moreover, we designed 'Maum Health Analytics,' an initial prototype of an interactive visual analytics tool that supports the tasks included in the proposed model. To investigate whether our model adequately covers the DHI data analysis process, we conducted a preliminary user study with five groups of DHI researchers (n=15). During this process, we had them use Maum Health Analytics within given data analysis scenarios, providing analyzed results from in-the-wild data collected in a non-experimental setting through a mobile DHI service targeting depressive symptoms. After using the analytics tool, we interviewed the DHI researchers to determine whether the analysis tasks were appropriate and how the information provided by the tool could be utilized in practice. RESULTS Our analysis task model was created using three key components (i.e., user grouping criteria) for DHI data analysis: user characteristics, user engagement with DHIs, and the effectiveness of DHIs on the target symptom via pre-post comparisons. Furthermore, the prototype of interactive visual analytics was designed, with each feature mapped one-to-one to an analysis task described in the model. From the interview sessions, DHI researchers valued group-level analysis that enabled identifying users who need care, improving intervention content and recommendations, and understanding the effectiveness of DHIs in connection with user characteristics and engagement levels. They also noted several benefits of the model and tool, such as simplifying analysis tasks and supporting communication among diverse experts. CONCLUSIONS We proposed an analysis task model and designed an interactive visual analytics tool to support DHI researchers. Our user study showed that the model allows a holistic investigation of DHI data by integrating key analysis components, and the prototype tool simplifies analytic tasks and enhances communication among researchers. As DHIs grow, our model and tool could effectively meet the data analysis needs of researchers and improve efficiency.

  • Research Article
  • Cite Count Icon 43
  • 10.1177/20552076231219117
Co-design of digital health interventions with young people: A scoping review.
  • Jan 1, 2023
  • Digital health
  • Jessica Malloy + 4 more

Innovative health promotion strategies are crucial for enhancing global quality of life and curbing premature deaths. Digital health promotion is particularly impactful for young individuals often using internet-connected devices. Collaborative methodologies in digital intervention research offer insights into supporting youth during key life stages, such as adolescence. This review sought to examine the literature on digital health interventions for youth co-designed via participatory frameworks. Following the Joanna Briggs Institute Manual and an adapted Arksey & O'Malley's 6-stage framework, this review utilised the PRISMA-ScR checklist for structured reporting. Peer-reviewed research where young individuals (15-35 years) contributed to digital health intervention design was analysed. Systematic synthesis adhered to Braun & Clarke's Thematic Analysis Guidelines, mapping data to research queries and thematic framework. Eighteen articles were systematically synthesised, revealing seven main themes: digital tool, inquiry field, report aim, participatory activities, intervention attributes and behavioural change support. Seventeen distinctive digital health interventions were assessed, mostly within risk mitigation and mental health domains. Predominantly, interventions were web-based, with mental wellness websites emerging as the prevalent tool. User experience testing stood out as the primary reported outcome. Several innovative digital health interventions targeting youth have been identified. Platforms including social media, specialised apps, websites and video games are instrumental for health advice and clinical support dissemination, overcoming access and cost barriers. Participatory techniques are integral for the efficacy of digital health resources, encompassing youth aspirations and anticipations. Continued efforts will enrich comprehension of optimal practices in digital health promotion and intervention formulation.

  • Research Article
  • Cite Count Icon 1
  • 10.1016/j.puhe.2025.105847
Facilitators and challenges of co-creating digital public health interventions: A Health CASCADE multi-case exploratory study.
  • Oct 1, 2025
  • Public health
  • Vinayak Anand-Kumar + 8 more

Facilitators and challenges of co-creating digital public health interventions: A Health CASCADE multi-case exploratory study.

  • Research Article
  • Cite Count Icon 316
  • 10.2196/25847
Evidence on Digital Mental Health Interventions for Adolescents and Young People: Systematic Overview.
  • Apr 29, 2021
  • JMIR mental health
  • Susanna Lehtimaki + 4 more

BackgroundAn estimated 1 in 5 adolescents experience a mental health disorder each year; yet because of barriers to accessing and seeking care, most remain undiagnosed and untreated. Furthermore, the early emergence of psychopathology contributes to a lifelong course of challenges across a broad set of functional domains, so addressing this early in the life course is essential. With increasing digital connectivity, including in low- and middle-income countries, digital health technologies are considered promising for addressing mental health among adolescents and young people. In recent years, a growing number of digital health interventions, including more than 2 million web-based mental health apps, have been developed to address a range of mental health issues.ObjectiveThis review aims to synthesize the current evidence on digital health interventions targeting adolescents and young people with mental health conditions, aged between 10-24 years, with a focus on effectiveness, cost-effectiveness, and generalizability to low-resource settings (eg, low- and middle-income countries).MethodsWe searched MEDLINE, PubMed, PsycINFO, and Cochrane databases between January 2010 and June 2020 for systematic reviews and meta-analyses on digital mental health interventions targeting adolescents and young people aged between 10-24 years. Two authors independently screened the studies, extracted data, and assessed the quality of the reviews.ResultsIn this systematic overview, we included 18 systematic reviews and meta-analyses. We found evidence on the effectiveness of computerized cognitive behavioral therapy on anxiety and depression, whereas the effectiveness of other digital mental health interventions remains inconclusive. Interventions with an in-person element with a professional, peer, or parent were associated with greater effectiveness, adherence, and lower dropout than fully automatized or self-administered interventions. Despite the proposed utility of digital interventions for increasing accessibility of treatment across settings, no study has reported sample-specific metrics of social context (eg, socioeconomic background) or focused on low-resource settings.ConclusionsAlthough digital interventions for mental health can be effective for both supplementing and supplanting traditional mental health treatment, only a small proportion of existing digital platforms are evidence based. Furthermore, their cost-effectiveness and effectiveness, including in low- and middle-income countries, have been understudied. Widespread adoption and scale-up of digital mental health interventions, especially in settings with limited resources for health, will require more rigorous and consistent demonstrations of effectiveness and cost-effectiveness vis-à-vis the type of service provided, target population, and the current standard of care.

  • Research Article
  • Cite Count Icon 1
  • 10.1177/20552076251328549
Digital health interventions for spinal surgery patients: A systematic scoping review.
  • Apr 1, 2025
  • Digital health
  • Annemieke Y Van Der Horst + 4 more

The potential of digital health interventions to optimize healthcare is promising also in the context of spinal surgery. However, a systematic review assessing the quality of digital health interventions for spinal surgery patients and the potential effects on these patients is lacking. The objective of the current scoping review was to provide a systematic overview of digital health interventions for spinal surgery patients described in scientific literature. The focus was on describing the current digital health interventions, assessing the quality of these descriptions, reviewing the reported effects and assessing the methodological quality of the included studies. A total of 14 full-text articles, describing 11 digital health interventions were included in the final analysis. These digital health interventions ranged from a website and app to a mobile phone messaging system and mobile phone interface. Most digital health interventions aim to improve adherence to rehabilitation guidelines and physical health. The included studies were generally of moderate to high quality and showed significant effects on physical health. Vital aspects of digital interventions such as "working mechanism theory" and "prompts and reminders" were often absent in the description of interventions. The study of digital interventions for spinal surgery patient is emerging and promising. However, there is a scarcity of studies using a rigorous design. A more systematic and comprehensive framework for developing and describing digital interventions for spinal surgery patients is highly recommended.

Save Icon
Up Arrow
Open/Close
  • Ask R Discovery Star icon
  • Chat PDF Star icon

AI summaries and top papers from 250M+ research sources.