Validating telehealth assessment of physical concussion symptoms.

Agreement between telehealth and in-person assessment of patients with chronic musculoskeletal conditions presenting to an advanced-practice physiotherapy screening clinic

TPS2099 Background: Gliomas are the most common primary central nervous system (CNS) malignancy in adults, accounting for 26.3% of all brain tumors. Care at high volume centers is associated with an overall survival benefit, but access to in-person evaluations can be challenging due to disease-related neurological disability and loss of income. Telehealth represents a convenient and efficient alternative to in-person evaluations, but acceptability and comparative safety of this care delivery modality has not been prospectively evaluated among glioma patients undergoing chemotherapy. Methods: This single-arm non-randomized pragmatic clinical trial evaluates patient satisfaction with, and safety of video-enabled telehealth assessments compared to in-person evaluations for patients with glioma undergoing temozolomide chemotherapy. The study includes adult patients with a diagnosis of glioma requiring adjuvant temozolomide chemotherapy. Participants act as their own controls, alternating between in-person and telehealth assessments while undergoing chemotherapy dosed per standard of care. Monitoring labs are completed locally and transmitted electronically. For participants without access to Wi-Fi or a device (e.g. mobile phone or computer), cellular-enabled tablet devices are provided to facilitate appointments and completion of electronic study components. All participants who travel to in-person appointments are reimbursed for travel expenses. The primary outcome measure is patient satisfaction with care delivered, as measured by institutional Press-Ganey survey scores obtained following telehealth and in-person assessments. A key secondary outcome measure is completion rate of planned oral chemotherapy, tracked using a digital pill diary incorporated into our institutional electronic health record. The digital diary allows real-time tracking of chemotherapy adherence and adverse events experienced by participants. Other secondary outcomes include acute care utilization days following telehealth and in-person visits (defined as emergency department evaluations and days of inpatient stay), neurologic disability as measured by the Neurologic Assessment in Neuro-Oncology (NANO) scale, and disease related quality of life measured by the EORTC QLQ-C30. All participant surveys are self-reported and completed electronically. This decentralized pragmatic clinical trial provides unprecedented, prospective real-world data on utilization of telehealth services compared to in-person visits for patients undergoing chemotherapy for glioma. We expect the data generated to inform the design and conduct of future decentralized interventional neuro-oncology trials. NCT06625047 opened for enrollment in October 2024, 16 of 30 intended participants were accrued as of January 2025. Clinical trial information: NCT06625047 .

Protocol for neuro-oncology anywhere 242: Pilot study evaluating telehealth and in-person assessments in patients with glioma receiving oral chemotherapy

Health facility assessments provide important data to measure the quality of health services delivered to populations. These assessments are comprehensive, resource intensive, and periodic to inform medium- to-longer-term policies. However, in absence of other reliable data sources, country decision makers often rely on outdated data to address service delivery challenges that change more frequently. High-frequency phone surveys are a potential option to improve the efficiency and timeliness of collecting time-sensitive service delivery indicators in-between comprehensive in-person assessments. The objectives of this study are to assess the reliability, concurrent criterion validity, and non-response rates in a rapid phone-based health facility assessment developed by the Global Financing Facility’s FASTR initiative compared to a comprehensive in-person health facility assessment developed by the World Bank’s Service Delivery Indicators Health Program. The in-person survey and corresponding in-person item verification will serve as the gold standard. Both surveys will be administered to an identical sample of 500 health facilities in Tajikistan using the same data collection entity. To assess reliability, percent agreement, Cohens Kappa, and prevalence and bias adjusted Kappa will be calculated. To assess concurrent criterion validity, sensitivity and specificity will be calculated, with a cut-off of.7 used for adequate validity. The study will further compare response rates and dropout rates of both surveys using simple t-tests and balance tests to identify if the characteristics of the phone-based and in-person survey samples are similar after accounting for any differences in survey response rates. The results of this study will provide important insights into the reliability and validity of phone-based data collection approaches for health facility assessments. This is critical as Ministries of Health seek to establish and sustain more continuous data collection, analysis, and use of health facility-level data to complement periodic in-person assessments to improve the quality of services provided to their populations.

In Patients Admitted to a Home Rehabilitation Service, Can a Physical Examination of Muscle, Fat, and Fluid Status be Completed Remotely Via Videocall? A Validation Study.

Background: Digital health has accelerated telehealth uptake, yet evidence comparing video-based musculoskeletal assessment with traditional in-person examination is limited. This study evaluated the concurrent validity and interrater reliability of video-based physiotherapy assessment versus face-to-face assessment in patients with knee pain. Methods: Patients with knee pain underwent randomized consecutive in-person and video-based assessments by experienced musculoskeletal physiotherapists. Clinical diagnoses were categorized into seven groups (red flag, yellow flag, arthrogenic, tendinopathy, patellofemoral pain, muscle sprain, neurogenic). Primary outcomes were intermethod agreement and Cohen’s kappa; sensitivity, specificity, PPV, NPV, and interrater reliability for video assessments were also reported. Results: Forty-five participants (mean age 38 ± 6.5 years; 55.6% female) completed the study. In-person and video-based assessments produced identical diagnoses in 43/45 cases (Cohen’s κ = 0.92, p < 0.001). Telehealth accuracy was high across all diagnostic categories (90–100%). Interrater agreement between video-based assessors was 93.3% (κ = 0.89, p < 0.001). Agreement between assessments was moderately associated with KOOS (r = 0.312, p = 0.037). Conclusions: In this selected pragmatic sample, video-based physiotherapy assessment demonstrated high concurrent agreement and excellent interrater reliability with face-to-face assessment. Given the study’s sample size, repeated-measures design, and lack of an independent reference standard, these results indicate feasibility and intermethod agreement rather than diagnostic equivalence. Video assessment may be a feasible option for triage and management in selected settings, but further research in larger, more diverse populations and evaluation against independent reference standards is required.

This study modified established clinical balance and walking measures and estimated the reliability, validity, and feasibility of using these measures to assess people post-stroke via videoconferencing. Twenty-eight people with chronic stroke were recruited and completed the in-person balance and mobility tests. Five clinical measures were modified as virtual assessments over videoconferencing. Feasibility was evaluated by task completion rate, occurrence of adverse events, and technical difficulties. Test-retest reliability and agreement were examined by intra-class correlations and standard error of measurement between two testing days. Convergent validity was examined by the magnitude of associations between in-person and virtual assessments using Pearson or Spearman rank correlation. Twenty-one participants (52% female) participated in both in-person and virtual assessments. No adverse events occurred. Technical challenges were experienced by eight participants. Test-retest reliability for timed up and go test, 30-seconds sit-to-stand, five-times sit-to-stand, functional reach test, and tandem stance resulted in intra-class coefficients of 0.97, 0.90, 0.77, 0.54, and 0.50 respectively. The standard error of measurement was low across all virtual assessments. The timed up and go test, five-times sit-to-stand, and 30-seconds sit-to-stand showed relationship with in-person assessments (r = -0.55 to -0.81). Virtual assessment of walking and balance function in ambulatory people post-stroke is feasible; however, technical challenges were experienced. The test-retest reliability of virtual assessments of timed up and go test and sit-to-stand tasks for people with stroke, together with strong convergent validity of the measures compared to in-person assessments is promising.

Crisaborole ointment, 2%, is a nonsteroidal topical phosphodiesterase 4 inhibitor approved for the treatment of mild-to-moderate atopic dermatitis. To evaluate the efficacy and safety of crisaborole in stasis dermatitis (SD). In this randomized, double-blind, vehicle-controlled, decentralized phase 2a study (NCT04091087), 65 participants aged ≥45years with SD without active ulceration received crisaborole or vehicle (1:1) twice-daily for 6weeks. The primary end point was percentage change from baseline in total sign score at week 6 based on in-person assessment. Crisaborole-treated participants had significantly reduced total sign score from baseline versus vehicle based on in-person (nondermatologist) assessment (-32.4% vs -18.1%, P=.0299) and central reader (dermatologists) assessment of photographs (-52.5% vs -10.3%, P=.0004). Efficacy according to success and improvement per Investigator's Global Assessment score and lesional percentage body surface area reached statistical significance based on central reader but not in-person assessments. Skin and subcutaneous tissue disorders were common all-causality treatment-emergent adverse events with crisaborole. Small sample size and short treatment duration were key limitations. In-person assessment was not conducted by dermatologists. Crisaborole improved signs and symptoms of SD and was well tolerated. Central reader assessment represents a promising approach for siteless clinical research.

BackgroundPhysical function is a key health indicator in older people. Interchangeable remote and in-person assessments could improve monitoring flexibility.ObjectiveTo evaluate feasibility, safety and agreement between remote home and in-person laboratory physical function assessments in community-living older people.MethodsThirty-seven people aged 60+ completed remote and in-person assessments of the five-times Sit-to-Stand (5STS), Timed Up-and-Go (TUG), standing balance test, 4 m Walk and Short Physical Performance Battery (SPPB) in counter-balanced order, two days apart. Feasibility was assessed as technological and environmental barriers, safety as adverse events, and agreement using intraclass correlation coefficients (ICCs) and smallest detectable differences (SDD), and based on kappa using clinical cutpoints (κ).ResultsAll participants completed the remote assessments without adverse events; 8% experienced minor connectivity issues. In-person performance was better for 5STS, TUG, 4 m Walk and standing balance; SPPB scores were comparable. Agreement was good for 5STS, TUG and standing balance (ICCs: 0.89 [95% confidence interval: 0.79–0.94], 0.85 [0.54–0.94], 0.77 [0.59–0.88], respectively)) and moderate for 4 m Walk and SPPB (ICCs: 0.64 [0.19–0.84] and 0.68 [0.46–0.82], respectively). SDD values for 5STS, TUG and SPPB fell within clinically acceptable ranges; categorical agreement was substantial (κ: 0.65, 0.77 and 0.65, respectively).ConclusionsRemote 5STS and TUG assessments showed good agreement, supporting their use with existing cut-points. Differences between settings in standing balance and walking speed (affecting SPPB) suggest caution in interpretation. Telehealth offers a feasible, safe option for monitoring physical function, though protocol refinements are needed for walking speed and standing balance.

Introduction Telehealth assessment (TA) is a quickly emerging practice, offered with increasing frequency across many different clinical contexts. TA is also well-received by most patients, and there are numerous guidelines and training opportunities which can support effective telehealth practice. Although there are extensive recommended practices, these guidelines have rarely been evaluated empirically, particularly on personality measures. While existing research is limited, it does generally support the idea that TA and in-person assessment (IA) produce fairly equitable test scores. The MMPI-3, a recently released and highly popular personality and psychopathology measure has been the subject of several of those experimental or student (non-client) based studies; however, no study to date has evaluated these trends within a clinical sample. This study empirically tests for differences in TA and IA test scores on the MMPI-3 validity scores when following recommended administration procedures. Method Data were from a retrospective chart review. Veterans (n = 550) who underwent psychological assessment in a Veterans Affairs Medical Center ADHD evaluation clinic were contrasted between in person and telehealth assessment modalities on the MMPI-2-RF and MMPI-3. Groups were compared using t tests, chi square, and base rates. Results Results suggest that there were minimal differences in elevation rates or mean scores across modality, supporting the use of TA. Conclusions This study’s findings support the use of the MMPI via TA with ADHD evaluations, Veterans, and in neuro/psychological evaluation settings more generally. Observed elevation rates and mean scores of this study were notably different from those seen in other VA service clinics sampled nationally, which is an area of future investigation.

To compare teleassessment of pressure ulcers in individuals with spinal cord injury in a simulated remote setting with in-person assessments in a wound clinic. Pressure ulcers were assessed using a 3-megapixel digital camera; images of each ulcer were forwarded to a laptop in a separate room. Nurses completed a medical history and wound database form. A plastic surgeon reviewed the images and database and completed a questionnaire concerning the "remote" teleassessment or teleconsultation. When needed, the plastic surgeon obtained additional information using live audio-video interaction with the participant or nurse. After the teleassessment was completed, the plastic surgeon then assessed the individual and wound live and completed the same questionnaire used for the teleassessment. Wound clinic of a rehabilitation hospital. Individuals with a spinal cord injury and 1 or more pressure ulcers who were seen for initial or follow-up evaluations. Percentage of agreement for teleassessment versus live responses to 4 yes/no questions regarding the need to change wound management, satisfaction with teleassessment, need for referral, and need for additional information. Seventeen individuals with 20 wounds were evaluated. The total percentage of agreement for teleassessment versus live decisions was 89% (80% to 95%). The highest percentages of agreement were for the need to change wound management and the need for referral (both 95%); the lowest percentages of agreement were for satisfaction with teleassessment for making treatment decisions (85%) and the need to obtain additional information (80%). Teleassessment of pressure ulcers in individuals with a spinal cord injury using digital images and a standard database compared well with in-person assessment, which is similar to results reported for other pathologic conditions.

Objective Compare the efficiency of remote telehealth flap assessments with traditional in-person flap assessments. Study Design Observational study with retrospective review. Setting Tertiary academic medical center. Subjects and Methods All patients undergoing head and neck free tissue transfer were included in the study. All patients whose surgery was performed at hospital A underwent an in-person flap check overnight. Those at hospital B received a remote flap assessment. The primary outcome was total time spent performing the midnight flap assessment, including travel time. Data were gathered prospectively using an online survey. Results Sixty consecutive patients met inclusion criteria. On the night of the surgery, 31 had an in-person flap check while 29 had a video telehealth flap check. There were no partial or total flap losses or take-backs resulting from the flap checks. Mean (SD) times for in-person and remote assessments were 34 (16) minutes (range, 10-60 minutes) and 13 (8) minutes (range, 5-35 minutes), respectively ( P < .001). House staff unanimously felt the remote telehealth system improved their quality of life without affecting their perception of the quality of the flap assessment ( P = .001). Conclusion Compared with in-person flap assessments in this cohort, telehealth assessments allowed more efficient examination of free tissue reconstructions while yielding seemingly equivalent information. Therefore, remote telehealth flap checks may provide useful information supporting the use of high-fidelity remote data-streaming technology in the delivery of complex care to patients distant from their care provider.

Use of telehealth assessments for toddlers at increased likelihood of autism spectrum disorder (ASD) began prior to the global COVID-19 pandemic; however, the value of telehealth assessments as an alternative to in-person assessment (IPA) became clearer during the pandemic. The Naturalistic Observation Diagnosis Assessment (NODA™), previously demonstrated as a valid and reliable tool to evaluate asynchronous behaviors for early diagnosis, was enhanced to add synchronous collection of behaviors to assist clinicians in making a differential diagnosis of ASD. This study was conducted to validate the information gathered through NODA-Enhanced (NODA-E™) as compared to a gold standard IPA. Forty-nine toddlers aged 16.0-32.1months of age, recruited through community pediatric offices and a tertiary ASD clinic, participated in both NODA-E and IPA assessments. There was high agreement between the two assessment protocols for overall diagnosis (46 of 49 cases; 93.6%; κ = .878), specific diagnostic criteria for social communication and social interaction (SCI; range 95.9-98%; κ = .918-.959), and for two of four criteria specified for restricted and repetitive behaviors (RRB; range 87.8-98%; κ = .755 and .959). There was lower agreement for two subcategories of RRBs (range 65.3-67.3%; κ = .306 and .347). NODA-E is a tool that can assist clinicians in making reliable and valid early ASD diagnoses using both asynchronous and synchronous information gathered via telehealth and offers an additional tool within a clinician's assessment toolbox.

Simple SummaryTo expand the reach of lifestyle interventions among cancer survivors, in-person anthropometric and physical performance assessments were adapted to remote means and evaluated for feasibility, safety, validity, and reliability. Cancer survivors and supportive partners (n = 112) were approached to participate in three sessions (two remote and one in-person) of anthropometric and physical performance testing and results were compared. There was 98% uptake and no adverse events. ICCs for remote assessments ranged from moderate (8’ timed walk = 0.47), to strong (8’ get-up-and-go = 0.74), to very strong (30 s chair stand = 0.80; sit-and-reach = 0.86; 2 min step test = 0.87; back scratch = 0.90; weight = 0.93; and waist circumference = 0.98) (p-values < 0.001). One-hundred percent concordance was found for side-by-side and semi-tandem balance and 87.5–90.3% for tandem stances. No significant differences between remote and in-person assessments were found for weight, 8’ timed walk, and 8’ get-up-and-go. Remote anthropometric and physical performance assessments are reliable, valid, acceptable, and safe among cancer survivors and supportive partners.(1) Background: Anthropometric and physical performance testing is commonly done in lifestyle research and is traditionally performed in-person. To expand the scalability of lifestyle interventions among cancer survivors, in-person assessments were adapted to remote means and evaluated for feasibility, safety, validity, and reliability. (2) Methods: Cancer survivors and supportive partners were approached to participate in three anthropometric and physical performance testing sessions (two remote/one in-person). Correlations, concordance, and differences between testing modes were evaluated. (3) Results: 110-of-112 individuals approached for testing participated (98% uptake); the sample was 78% female, 64% non-Hispanic White, of mean age 58 years and body mass index = 32.4 kg/m2. ICCs for remote assessments ranged from moderate (8’ walk = 0.47), to strong (8’ get-up-and-go = 0.74), to very strong (30 s chair stand = 0.80; sit-and-reach = 0.86; 2 min step test = 0.87; back scratch = 0.90; weight = 0.93; waist circumference = 0.98) (p-values < 0.001). Perfect concordance (100%) was found for side-by-side and semi-tandem balance, and 87.5–90.3% for tandem balance. No significant differences between remote and in-person assessments were found for weight, 8’ walk, and 8’ get-up-and-go. No adverse events occurred and 75% indicated no preference or preferred virtual testing to in-person. (4) Conclusions: Remote anthropometric and physical performance assessments are reliable, valid, acceptable, and safe among cancer survivors and supportive partners.

P025Mail-order pharmacy dispensing of mifepristone for medication abortion after in-person clinical assessment