Remote Cognitive Assessment Research Articles

Mayo Normative Studies: regression-based normative data for remote self-administration of the Stricker Learning Span, Symbols Test and Mayo Test Drive Screening Battery Composite and validation in individuals with Mild Cognitive Impairment and dementia.

Few normative data for unsupervised, remotely-administered computerized cognitive measures are available. We examined variables to include in normative models for Mayo Test Drive (a multi-device remote cognitive assessment platform) measures, developed normative data, and validated the norms. 1240 Cognitively Unimpaired (CU) adults ages 32-100-years (96% white) from the Mayo Clinic Study of Aging and Mayo Alzheimer's Disease Research Center with Clinical Dementia Rating® of 0 were included. We converted raw scores to normalized scaled scores and derived regression-based normative data adjusting for age, age2, sex and education (base model); alternative norms are also provided (age+age2+sex; age+age2). We assessed additional terms using an a priori cut-off of 1% variance improvement above the base model. We examined low test performance rates (<-1 standard deviation) in independent validation samples (n=167 CU, n=64 mild cognitive impairment (MCI), n=14 dementia). Rates were significantly different when 95% confidence intervals (CI) did not include the expected 14.7% base rate. No model terms met the a priori cut-off beyond the base model, including device type, response input source (e.g., mouse, etc.) or session interference. Norms showed expected low performance rates in CU and greater rates of low performance in MCI and dementia in independent validation samples. Typical normative models appear appropriate for remote self-administered MTD measures and are sensitive to cognitive impairment. Device type and response input source did not explain enough variance for inclusion in normative models but are important for individual-level interpretation. Future work will increase inclusion of individuals from under-represented groups.

Neuro-oncology anywhere: A decentralized approach to clinical trials in brain tumors and beyond.

TPS1647 Background: The majority of patients with primary and secondary central nervous system (CNS) malignancy develop cognitive impairment, fatigue, and mood-related symptoms. Radiotherapy has been shown to contribute to symptom burden often limiting quality of life and functional status. The development of interventions mitigating neurocognitive toxicity requires an accurate assessment of function and symptom burden. Formal neuropsychological evaluation is resource and time intensive, and often challenging to incorporate in routine clinical practice. There is a critical need to accurately assess cognition without causing undue burden to cancer patients while evaluating the efficacy of interventions that can be scaled and implemented at a population level. Methods: To adequately assess the neurocognitive function and related symptoms in patients with CNS malignancy we have designed an open-label decentralized clinical trial that will randomize patients who received intracranial radiation for primary or metastatic brain tumors in a 1:1 allocation to a therapy targeting radiation-related toxicity (metformin shipped to patient home) plus health promotion with a wearable device vs. health promotion with a wearable device alone. Participants will be stratified based on tumor type (glioblastoma vs. other glioma vs. brain metastases vs. meningioma) and age (&lt;70 vs. 70+ years). Participants will be provided a wearable device for monitoring health status. Participants will undergo serial remote cognitive assessments with the Mayo Test Development Through Rapid Iteration, Validation and Expansion platform (Mayo Test Drive). Remote reported symptom collection via patient surveys and remote neurologic examination by telehealth will also be incorporated. Cognitive assessments and symptom surveys will be designed for completion on a smartphone, tablet, or computer device. Health data will be collected from the wearable device, including the number of steps per day and sleep quality/duration. Participants receiving metformin will utilize device apps to report medication adherence and adverse events. Study-related laboratory assessments will be completed remotely and transmitted electronically. This decentralized clinical trial will provide real-world cognitive and quality-of-life data for patients with primary and metastatic brain tumors while providing preliminary data on the effectiveness of device-based health promotion with or without metformin for treating radiation-related cognitive decline. Results gained from this study will guide future trials in neuro-oncology and other fields. This study is expected to open in March 2024.

Introducing the Tele-OCS: Preliminary evidence of validity for a remotely administered version of The Oxford Cognitive Screen

Background Remote cognitive assessments are increasingly used with the rising popularity of teleneuropsychology. Here, we evaluated the performance of the remotely administered Oxford Cognitive Screen (Tele-OCS) compared to in-person administration in adult stroke survivors. Methods 40 stroke survivors (M age = 69.30, SD = 10.44; sex = 30% female) completed in-person and remote versions of the OCS on average 30 days apart, with different trained examiners. The order of administration was counterbalanced. Cohen’s d estimates were used to compare performance between modalities. Results We found that the proportion of OCS subtasks impaired did not differ across modalities (d &lt;.001). With regards to raw subtask scores, only the picture naming subtask and executive score from the trail making subtask were found to be statistically different across modalities, though raw differences were minimal (&lt;1 point difference on average). These statistical differences did not affect impairment classifications. Conclusions The Tele-OCS classified cognitive impairments in a comparable way to the in-person version. The validation of the Tele-OCS allows for remote assessment to increase accessibility and pragmatically aid in addressing the clinical need for stroke-specific cognitive screening in a wider population.

A remote digital memory composite to detect cognitive impairment in memory clinic samples in unsupervised settings using mobile devices

Remote monitoring of cognition holds the promise to facilitate case-finding in clinical care and the individual detection of cognitive impairment in clinical and research settings. In the context of Alzheimer’s disease, this is particularly relevant for patients who seek medical advice due to memory problems. Here, we develop a remote digital memory composite (RDMC) score from an unsupervised remote cognitive assessment battery focused on episodic memory and long-term recall and assess its construct validity, retest reliability, and diagnostic accuracy when predicting MCI-grade impairment in a memory clinic sample and healthy controls. A total of 199 participants were recruited from three cohorts and included as healthy controls (n = 97), individuals with subjective cognitive decline (n = 59), or patients with mild cognitive impairment (n = 43). Participants performed cognitive assessments in a fully remote and unsupervised setting via a smartphone app. The derived RDMC score is significantly correlated with the PACC5 score across participants and demonstrates good retest reliability. Diagnostic accuracy for discriminating memory impairment from no impairment is high (cross-validated AUC = 0.83, 95% CI [0.66, 0.99]) with a sensitivity of 0.82 and a specificity of 0.72. Thus, unsupervised remote cognitive assessments implemented in the neotiv digital platform show good discrimination between cognitively impaired and unimpaired individuals, further demonstrating that it is feasible to complement the neuropsychological assessment of episodic memory with unsupervised and remote assessments on mobile devices. This contributes to recent efforts to implement remote assessment of episodic memory for case-finding and monitoring in large research studies and clinical care.

Relationships between hourly cognitive variability and risk of Alzheimer's disease revealed with mixed-effects location scale models.

Observational studies on aging and Alzheimer's disease (AD) typically focus on mean-level changes in cognitive performance over relatively long periods of time (years or decades). Additionally, some studies have examined how trial-level fluctuations in speeded reaction time are related to both age and AD. The aim of the current project was to describe patterns of variability across repeated days of testing as a function of AD risk in cognitively normal older adults. The current project examined the performance of the Ambulatory Research in Cognition (ARC) smartphone application, a high-frequency remote cognitive assessment paradigm, that administers brief tests of episodic memory, spatial working memory, and processing speed. Bayesian mixed-effects location scale models were used to explore differences in mean cognitive performance and intraindividual variability across 28 repeated sessions over a 1-week assessment interval as function of age and genetic risk of AD, specifically the presence of at least one apolipoprotein E (APOE) ε4 allele. Mean performance on processing speed and working memory was negatively related to age and APOE status. More importantly, e4 carriers exhibited increased session-level variability on a test of processing speed compared to noncarriers. Age and education did not consistently relate to cognitive variability, contrary to expectations. Preclinical AD risk, defined as possessing at least one APOE ε4 allele, is not only associated with mean-level performance differences, but also with increases in variability across repeated testing occasions particularly on a test of processing speed. Thus, cognitive variability may serve as an additional and important indicator of AD risk. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Feasibility, satisfaction, and test‐retest reliability of repeated remote memory assessments with older adults

AbstractBackgroundFrequent, remote cognitive assessments may improve sensitivity to subtle cognitive decline associated with preclinical Alzheimer’s disease (AD). To gain insight on how use of this technology can be optimized, the objective of this study is to determine if feasibility, satisfaction, or test‐retest reliability (TRR) vary depending on task frequency schedules or demographic characteristics.MethodParticipants were recruited from a longitudinal aging cohort to complete three memory tasks via smartphone or tablet using the neotiv application: Object‐In‐Room Recall (ORR), Mnemonic Discrimination for Objects and Scenes (MDT‐OS), and Complex Scene Recognition (CSR). Participants were randomly assigned to complete 24 remote sessions over one year either: (1) every other week or (2) for multiple days within one week every other month. Each session lasted approximately 10 minutes, including one memory task followed by a delayed retrieval session 90 minutes later. Chi‐square tests were used to assess differences in feasibility, acceptability for participants who completed at least 3 sessions, and satisfaction based on task schedule, gender, age, or education. ICC was used to determine TRR of visit 2 to 3 (“V2‐V3”) and an average of visits 1+2 and 3+4 (“V1+2‐V3+4”).Result115 participants (mean age = 68.4, 66% women) enrolled; 49 completed all remote sessions to date (Table 1). Willingness to enroll differed by education (X2 = 4.2, p = .04), such that participants with at least a bachelor’s degree were more likely to enroll. Withdrawal from the study occurred more often for those scheduled to the every other week condition (X2 = 6.2, p = .01) than the every other month condition. Measures of acceptability and satisfaction did not differ by task schedule or demographics. TRR from V2‐V3 and V1+2‐V3+4 were adequate, (CSR: ICC = 0.56 and 0.64, ORR: ICC = 0.58 and 0.66, MDT‐OS: ICC = 0.38 and 0.52).ConclusionParticipants with a bachelor’s degree or higher were more likely to enroll. Reported satisfaction was similar for both task frequency schedules; however, drop‐outs occurred more frequently in those assigned to complete tasks every other week, which could suggest that it is a less optimal task schedule. TRR was moderate for all three tasks. Altogether, results suggest that repeated mobile cognitive testing can be utilized to track cognitive performance remotely.

Fatigue Interacts with Amyloid Status To Predict Daily Working Memory Performance in Preclinical Alzheimer’s Disease

AbstractBackgroundSmartphone‐based cognitive assessment has the potential to reduce barriers to cognitive screening and increase sensitivity to detect preclinical Alzheimer’s disease (AD). Ecological momentary assessment of cognition is novel, and it is not yet well understood how psychological factors (i.e., mood, stress, and fatigue) may impact cognitive performance in remote, real‐world settings. We aimed to evaluate whether psychological factors influence daily cognitive performance differently between older adults with and without AD‐related pathologic change.MethodParticipants (N = 73) were cognitively unimpaired adults aged 60‐80 years (71% female, 89% White, 16.5 mean years of education) recruited for a digital cognitive assessment study. Participants had amyloid (Aβ) PET imaging results available from prior research participation [(n = 25 Aβ positive (Aβ+) and n = 48 Aβ negative (Aβ‐)]. A modified Telephone Interview for Cognitive Status (TICSm) score of ≥34 was used to indicate normal cognition. Participants completed 8 consecutive days of cognitive assessment using Mobile Monitoring of Cognitive Change (M2C2), a smartphone‐based testing platform developed as part of the National Institute of Aging’s Mobile Toolbox. Brief (i.e., 3‐4 minute) M2C2 sessions were assigned three times daily (morning, afternoon, and evening). Tasks included measures of visual working memory (WM, “Color shapes”), processing speed (PS, “Symbol search”), and episodic memory (EM, “Prices”). Multilevel modeling was used to examine the impact of self‐reported mood, stress, fatigue, and Aβ status on daily cognitive performance while controlling for age, sex, education, and time of day.ResultDaily fatigue was found to interact with amyloid status such that Aβ+ individuals performed worse on the WM task when experiencing higher levels of fatigue (Est. = .004, p = .01) Higher levels of daily stress were associated with poorer performance on the PS task (Est. = ‐.0005, p = .03) but no interaction with Aβ status was observed. There were no significant relationships between mood and cognitive performance.ConclusionWe demonstrated that psychological factors including fatigue and stress may impact performance on remote cognitive assessments. Results also suggested that fatigue may impact daily cognitive performance more among those with AD pathological change. These preliminary results suggest that psychological factors should be considered when determining optimal windows for remote cognitive screening.

REAL AD – A realistic screening approach for preclinical Alzheimer’s disease

AbstractBackgroundFor disease‐modifying treatments to be successful in Alzheimer’s disease (AD), it is essential to identify individuals in the early phases of the disease, characterised by first biomarker abnormalities. At present, most AD diagnoses in Sweden are made within primary care which is not equipped for detecting individuals who are at risk of developing AD dementia. Considering current treatment developments, it will be essential to have access to biomarkers to aid an informed diagnosis already in primary care. REAL AD will evaluate the feasibility of a screening approach for preclinical AD using remote cognitive testing and blood‐based biomarkers in a naturalistic setting.MethodREAL AD is a collaborative initiative between the Swedish Västra Götaland County Council (VGR), VGR Primary Care, the Sahlgrenska University Hospital, the University of Gothenburg and pharmaceutical industry partners. A targeted PR‐campaign will facilitate reaching a recruitment goal of a minimum of 3000 socioeconomically and ethnically diverse individuals aged 50‐80 years without AD dementia. All participants will perform remote cognitive testing at home and undergo blood sampling at a local primary care unit on two occasions. Based on baseline blood biomarker profiles, a subgroup of participants will be enrolled into a validation study and further undergo CSF sampling, neuroimaging and clinical and neuropsychological assessment, also on two occasions.ResultLongitudinal remote cognitive assessment and blood sampling will be conducted at baseline and after 18 months, the blood samples will be analysed for a range of established and novel biomarkers. Within the validation study, results of the screening approach will be validated against established neuropsychological, CSF, MRI and [18F]RO948 tau PET assessments, and the feasibility of implementing this approach in the existing primary care infrastructure will be evaluated. We plan to present first data on recruitment and implementation at AAIC.ConclusionREAL AD aims to evaluate the applicability of a population‐based screening method to detect preclinical AD in a naturalistic setting and to inform the implementation of recent biomarker developments in clinical routine.

Red flags for remote cognitive assessment: An expert consensus study using the Delphi method

Red flags for remote cognitive assessment: An expert consensus study using the Delphi method

97 Looking in the Webcam Reflection: A Scoping Review of Videoconferencing-Based Teleneuropsychological Assessment Since the Start of the COVID-19 Pandemic

Objective:Following the start of the SARS-COV-2 (COVID-19) pandemic there was a rapid uptake in teleneuropsychology (TeleNP). Many clinicians and researchers used videoconferencing technologies (e.g., Zoom®) to conduct remote neuropsychological assessments. Prior reviews (e.g., Marra et al., 2020) have indicated promise for the use of videoconference-based approaches to cognitive assessment under certain circumstances, though arguably nobody foresaw the widespread use of teleNP during the pandemic. Given the rapid expansion in the teleNP literature in the past couple of years, in this scoping review we specifically discuss research updates made during the COVID-19 pandemic pertaining to teleNP assessment of adults conducted via videoconferencing and their potential clinical applications.Participants and Methods:GoogleScholar and PubMed were used to search for peer-reviewed original research articles published between January 1, 2020 (i.e., the approximate beginning of the COVID-19 pandemic) and August 1, 2022. Broad search terms were used pertaining to teleNP, remote cognitive assessment, videoconferencing, and neuropsychological assessment, resulting in 16 articles.Results:Though most of the included studies were based in the United States (n=5), there was international representation across studies (Chile=1; United Kingdom=1; Australia=2; New Zealand=1; France=2; Greece=1; Japan=2, Singapore=1). All of the identified articles examined TeleNP-related research questions using cognitive tests administered via videoconferencing that have been previously studied in-person to varying degrees. Several of the studies focused on psychometric characterization (i.e., reliability and validity) of the examined tests when delivered via videoconferencing, whereas others focused on demonstrating the relative equivalence of neuropsychological scores obtained via videoconferencing versus in-person evaluations.Conclusions:Formal psychometric studies of traditional in-person neuropsychological tests delivered via videoconferencing since the start of the COVID-19 pandemic suggest that this remote modality of assessment is generally reliable and valid. Moreover, multiple recent studies have demonstrated relative equivalence of neuropsychological scores obtained via videoconferencing versus neuropsychological test scores obtained in-person. When considered alongside teleNP research conducted prior to the COVID-19 pandemic (e.g. Cullum et al., 2014), recent studies on videoconference-based neuropsychological assessment indicate that videoconferencing may not necessarily be a complete substitute for an in-person comprehensive evaluation given the inherent limitations of the procedure. However, teleNP via videoconferencing may be a promising tool in the neuropsychologist’s toolbox because it can help reduce common barriers to in-person neuropsychological assessment (e.g., travel time to clinics). Additional research on videoconferencing-based cognitive assessment is needed, especially in low-and-middle income countries (LMIC) and diverse populations where there may be more economic barriers to remote neuropsychological assessment relative to more economically-developed countries. Notably it is possible that research from LMIC may have been missed through the screening processes used in this review (e.g., inclusion of articles written in English).

91 Remote Smartphone-Based Assessment Predicts Standard Neuropsychological Test Performance and Cerebral Amyloid Status in Cognitively Normal Older Adults

Objective:Routine cognitive screening in the elderly may facilitate earlier diagnosis of neurodegenerative diseases and access to care and resources for patients and families. However, despite growing rates of Alzheimer's and related disorders (ADRD), the availability and implementation of cognitive screening for older adults in the US remains quite limited. Remote cognitive assessment via smartphone app may reduce several barriers to more widespread screening. We examined the validity of a remote app-based cognitive screening protocol in healthy older adults by examining remote task convergence with standard-person assessments and cerebral amyloid (Aß) status as an AD biomarker.Participants and Methods:Participants (N =117) were cognitively unimpaired adults aged 60-80 years (67.5% female, 88% White, 75% education &gt; 16 years). A portion had Aß PET imaging results available from prior research participation [(Aß positive (Aß+) n =26, and Aß negative (Aß-) n = 44]. A modified Telephone Interview for Cognitive Status (TICSm) cutoff score of &gt;34 was used to establish unimpaired cognition. Participants completed 8 consecutive assessment days using Mobile Monitoring of Cognitive Change (M2C2), a smartphone app-based testing platform developed as part of the National Institute of Aging's Mobile Toolbox initiative. Brief (i.e., 3-4 minute) M2C2 sessions were assigned daily within morning, afternoon, and evening time windows. Tasks included measures of visual working memory (WM), processing speed (PS), and episodic memory (EM) (see Thompson et al., 2022). Participants then completed a battery of standard neuropsychological assessments in-person at a follow-up visit.Results:Participants completed 22.6 (SD = 2.6) out of 24 assigned sessions (3 sessions x 8 days) on average. Performance on all M2C2 tasks decreased significantly with age. Women performed significantly better on WM and EM tasks relative to men. There were no detectable significant differences in performance by race or education. Shorter mean reaction time on M2C2 PS trials predicted faster Trails A and B completion (ß = .26, p &lt; .01, 95% CI [3.8, 23.3] and ß = .20, p &lt; .05, 95% CI [.23, 6.8], respectively). Greater mean M2C2 WM accuracy predicted longer maximum backward digital span (ß = .24, p = .01, 95% CI [.02, .16]). Greater mean M2C2 EM accuracy predicted stronger Logical Memory delayed recall (ß = .33, p &lt; .001, 95% CI [.004, .012]) and total immediate recall on the Free and Cued Selective Reminding Test (ß = .19, p &lt; .05, 95% CI [.000, .006]). Moreover, EM significantly distinguished Aß- and Aß+ individuals (t (68) = 3.0, p &lt; .01) with fair accuracy (AUC = .72).Conclusions:Mean performance across 8-days on each M2C2 task predicted same-domain cognitive task performance on a standard assessment battery, with medium effect sizes. Performance on the EM task was also sensitive to cerebral Aß status, consistent with subtle memory changes implicated in the preclinical stage of AD. These findings support the validity of this remote testing protocol in healthy older adults, with implications for future efforts to facilitate accessible and sensitive cognitive screening for early detection of ADRD. Limitations include the restricted generalizability of this primarily white and college educated sample.

90 Feasibility of Repeated Remote Memory Assessment with Mobile Devices to Detect Subtle Cognitive Decline in Older Adults

Objective:Frequent and remote cognitive assessment may improve sensitivity to subtle cognitive decline associated with preclinical Alzheimer’s disease (AD). The objective of this study was to evaluate the feasibility and acceptability of repeated remote memory assessment in late middle-aged and older adults.Participants and Methods:We recruited participants from a longitudinal aging cohort to complete three medial temporal lobe-based memory paradigms (Object-In-Room Recall [ORR], Mnemonic Discrimination for Objects and Scenes [MDT-OS], Complex Scene Recognition [CSR]) using the neotiv application at repeated intervals over one year. We conducted initial telephone calls to perform screening, consent, and download instructions. Participants were assigned 24 remote sessions on a smartphone or tablet and were alerted via push notification when an assignment was ready to complete. Participants were randomly assigned to: (1) complete memory tests every other week or (2) complete memory tests for multiple days within one week every other month. Each remote session lasts approximately 10 minutes and includes one memory paradigm and brief usability/acceptability questionnaires followed by a delayed retrieval session 90 minutes later. Feasibility metrics examined included participation, retention, compliance, and usability/acceptability.Results:Of 150 participants recruited, 113 consented and were enrolled into the study (participation rate = 75%). Current retention rate is 75%, with 85/113 currently active (n=73) or completed (n=12). Of the 85 active or completed participants, the mean age is 68.7 (range = 4882), 64% are women, 70% used a smartphone (30% tablet), 84 are cognitively unimpaired and 1 has mild cognitive impairment. The primary threat to retention was participants consenting into the study but never registering in the app or completing their first scheduled assignment. After enrollment, 130 telephone calls were made by study staff to facilitate registration into the app or to remind participants to complete tasks. 74-80% of participants completed delayed retrieval tasks within 30 minutes of push notification, but average retrieval time was 125137 minutes post-learning trials. Regarding acceptability/usability, 94% agreed the application was easy to use, 56% enjoyed completing the mobile memory tests (36% felt neutral), 40% prefer remote mobile memory tests to standard in-person paper and pencil tests, and 50% understood the test instructions. 87% felt the frequency of tests assigned was “just right” (13% “too often”) and 90% felt the test length was “just right” (7% too short, 3% too long). Participants who completed all 24 sessions to date (n=12) all endorsed being “satisfied” or “very satisfied” with the platform and visit schedule, as well as recommended continued use of this type of cognitive testing.Conclusions:Remote memory assessment using smartphones and tablets is feasible and acceptable for cognitively unimpaired late middle-aged and older adults. Follow-up by study staff was needed to ensure adequate retention. Comprehension of instructions and compliance with completing delayed retrieval tasks within the expected timeframe was lower than expected. These feedback will be incorporated into an updated version of the app to improve compliance and retention. Longitudinal data collection is ongoing and results will be updated with a larger sample. Results will be compared across frequency schedule groups.

3 Stricker Learning Span criterion validity: remote self-administration of a computer adaptive word list memory test shows similar ability to differentiate PET-defined biomarker groups as in-person Rey Auditory Verbal Learning Test performance in cognitively unimpaired individuals on the Alzheimer’s continuum

Objective:The Stricker Learning Span (SLS) is a computer-adaptive word list memory test specifically designed for remote assessment and self-administration on a web-based multi-device platform (Mayo Test Drive). Given recent evidence suggesting the prominence of learning impairment in preclinical Alzheimer’s disease (AD), the SLS places greater emphasis on learning than delayed memory compared to traditional word list memory tests (see Stricker et al., Neuropsychology in press for review and test details). The primary study aim was to establish criterion validity of the SLS by comparing the ability of the remotely-administered SLS and inperson administered Rey Auditory Verbal Learning Test (AVLT) to differentiate biomarkerdefined groups in cognitively unimpaired (CU) individuals on the Alzheimer’s continuum.Participants and Methods:Mayo Clinic Study of Aging CU participants (N=319; mean age=71, SD=11; mean education=16, SD=2; 47% female) completed a brief remote cognitive assessment (∼0.5 months from in-person visit). Brain amyloid and brain tau PET scans were available within 3 years. Overlapping groups were formed for 1) those on the Alzheimer’s disease (AD) continuum (A+, n=110) or not (A-, n=209), and for 2) those with biological AD (A+T+, n=43) vs no evidence of AD pathology (A-T-, n=181). Primary neuropsychological outcome variables were sum of trials for both the SLS and AVLT. Secondary outcome variables examined comparability of learning (1-5 total) and delay performances. Linear model ANOVAs were used to investigate biomarker subgroup differences and Hedge’s G effect sizes were derived, with and without adjusting for demographic variables (age, education, sex).Results:Both SLS and AVLT performances were worse in the biomarker positive relative to biomarker negative groups (unadjusted p’s&lt;.05). Because biomarker positive groups were significantly older than biomarker negative groups, group differences were attenuated after adjusting for demographic variables, but SLS remained significant for A+ vs A- and for A+T+ vs A-T- comparisons (adjusted p’s&lt;.05) and AVLT approached significance (p’s .05-.10). The effect sizes for the SLS were slightly better (qualitatively, no statistical comparison) for separating biomarker-defined CU groups in comparison to AVLT. For A+ vs A- and A+T+ vs A-T- comparisons, unadjusted effect sizes for SLS were -0.53 and -0.81 and for AVLT were -0.47 and -0.61, respectively; adjusted effect sizes for SLS were -0.25 and -0.42 and for AVLT were -0.19 and -0.26, respectively. In secondary analyses, learning and delay variables were similar in terms of ability to separate biomarker groups. For example, unadjusted effect sizes for SLS learning (-.80) was similar to SLS delay (.76), and AVLT learning (-.58) was similar to AVLT 30-minute delay (-.55) for the A+T+ vs AT- comparison.Conclusions:Remotely administered SLS performed similarly to the in-person-administered AVLT in its ability to separate biomarker-defined groups in CU individuals, providing evidence of criterion validity. The SLS showed significantly worse performance in A+ and A+T+ groups (relative to A- and A-T-groups) in this CU sample after demographic adjustment, suggesting potential sensitivity to detecting transitional cognitive decline in preclinical AD. Measures emphasizing learning should be given equal consideration as measures of delayed memory in AD-focused studies, particularly in the preclinical phase.

51 Feasibility of Remote Administration of a Modified UDSv3 Cognitive Battery

Objective:Face-to-face administration is the “gold standard” for both research and clinical cognitive assessments. However, many factors may impede or prevent face-to-face assessments, including distance to clinic, limited mobility, eyesight, or transportation. The COVID19 pandemic further widened gaps in access to care and clinical research participation. Alternatives to face-to-face assessments may provide an opportunity to alleviate the burden caused by both the COVID-19 pandemic and longer standing social inequities. The objectives of this study were to develop and assess the feasibility of a telephone- and video-administered version of the Uniform Data Set (UDS) v3 cognitive batteries for use by NIH-funded Alzheimer’s Disease Research Centers (ADRCs) and other research programs.Participants and Methods:Ninety-three individuals (M age: 72.8 years; education: 15.6 years; 72% female; 84% White) enrolled in our ADRC were included. Their most recent adjudicated cognitive status was normal cognition (N=44), MCI (N=35), mild dementia (N=11) or other (N=3). They completed portions of the UDSv3 cognitive battery, plus the RAVLT, either by telephone or video-format within approximately 6 months (M:151 days) of their annual in-person visit, where they completed the same in-person cognitive assessments. Some measures were substituted (Oral Trails for TMT; Blind MoCA for MoCA) to allow for phone administration. Participants also answered questions about the pleasantness, difficulty level, and preference for administration mode. Cognitive testers provided ratings of perceived validity of the assessment. Participants’ cognitive status was adjudicated by a group of cognitive experts blinded to most recent inperson cognitive status.Results:When results from video and phone modalities were combined, the remote assessments were rated as pleasant as the inperson assessment by 74% of participants. 75% rated the level of difficulty completing the remote cognitive assessment the same as the in-person testing. Overall perceived validity of the testing session, determined by cognitive assessors (video = 92%; phone = 87.5%), was good. There was generally good concordance between test scores obtained remotely and in-person (r = .3 -.8; p &lt; .05), regardless of whether they were administered by phone or video, though individual test correlations differed slightly by mode. Substituted measures also generally correlated well, with the exception of TMT-A and OTMT-A (p &gt; .05). Agreement between adjudicated cognitive status obtained remotely and cognitive status based on in-person data was generally high (78%), with slightly better concordance between video/in-person (82%) vs phone/in-person (76%).Conclusions:This pilot study provided support for the use of telephone- and video-administered cognitive assessments using the UDSv3 among individuals with normal cognitive function and some degree of cognitive impairment. Participants found the experience similarly pleasant and no more difficult than inperson assessment. Test scores obtained remotely correlated well with those obtained in person, with some variability across individual tests. Adjudication of cognitive status did not differ significantly whether it was based on data obtained remotely or in-person. The study was limited by its’ small sample size, large test-retest window, and lack of randomization to test-modality order. Current efforts are underway to more fully validate this battery of tests for remote assessment. Funded by: P30 AG072947 &amp; P30 AG049638-05S1

The use of the integrated cognitive assessment to improve the efficiency of primary care referrals to memory services in the accelerating dementia pathway technologies study.

Current primary care cognitive assessment tools are either crude or time-consuming instruments that can only detect cognitive impairment when it is well established. This leads to unnecessary or late referrals to memory services, by which time the disease may have already progressed into more severe stages. Due to the COVID-19 pandemic, some memory services have adapted to the new environment by shifting to remote assessments of patients to meet service user demand. However, the use of remote cognitive assessments has been inconsistent, and there has been little evaluation of the outcome of such a change in clinical practice. Emerging research has highlighted computerized cognitive tests, such as the Integrated Cognitive Assessment (ICA), as the leading candidates for adoption in clinical practice. This is true both during the pandemic and in the post-COVID-19 era as part of healthcare innovation. The Accelerating Dementias Pathways Technologies (ADePT) Study was initiated in order to address this challenge and develop a real-world evidence basis to support the adoption of ICA as an inexpensive screening tool for the detection of cognitive impairment and improving the efficiency of the dementia care pathway. Ninety-nine patients aged 55-90 who have been referred to a memory clinic by a general practitioner (GP) were recruited. Participants completed the ICA either at home or in the clinic along with medical history and usability questionnaires. The GP referral and ICA outcome were compared with the specialist diagnosis obtained at the memory clinic.Participants were given the option to carry out a retest visit where they were again given the chance to take the ICA test either remotely or face-to-face. The primary outcome of the study compared GP referral with specialist diagnosis of mild cognitive impairment (MCI) and dementia. Of those the GP referred to memory clinics, 78% were necessary referrals, with ~22% unnecessary referrals, or patients who should have been referred to other services as they had disorders other than MCI/dementia. In the same population the ICA was able to correctly identify cognitive impairment in ~90% of patients, with approximately 9% of patients being false negatives. From the subset of unnecessary GP referrals, the ICA classified ~72% of those as not having cognitive impairment, suggesting that these unnecessary referrals may not have been made if the ICA was in use. ICA demonstrated a sensitivity of 93% for dementia and 83% for MCI, with a specificity of 80% for both conditions in detecting cognitive impairment. Additionally, the test-retest prediction agreement for the ICA was 87.5%. The results from this study demonstrate the potential of the ICA as a screening tool, which can be used to support accurate referrals from primary care settings, along with the work conducted in memory clinics and in secondary care. The ICA's sensitivity and specificity in detecting cognitive impairment in MCI surpassed the overall standard of care reported in existing literature.

Remote cognitive assessment to early detection of cognitive decline.

Remote cognitive assessment to early detection of cognitive decline.

Reliability of Unsupervised Digital Cognitive Assessment in a Large Adult Population Across the Aging Lifespan from INTUITION: A Brain Health Study (S8.009)

<h3>Objective:</h3> To assess the feasibility and reliability of an unsupervised, digital cognitive battery performed by participants enrolled in the INTUITION (NCT05058950) study, who represent a U.S. adult population at-risk for cognitive decline. <h3>Background:</h3> Mobile and remote cognitive assessments may expedite patient screening for populations vulnerable to accelerated brain aging. As access to personal electronics increases, the modalities for data collection widen. Emerging evidence supports the case for the feasibility and validity of remote, digital cognitive assessments. However, test-retest reliability remains unknown in unsupervised settings and when performed at scale in diverse, heterogenous populations. <h3>Design/Methods:</h3> The INTUITION study is an observational two-year virtual study of 23,000 adults across the aging lifespan. Participants complete a monthly web-based 30-minute digital cognitive battery on a personal computing device. The assessment contains five tasks from the Cambridge Neuropsychological Test Automated Battery (CANTAB), which is designed to interrogate performance on specific cognitive domains, including attention, executive function, and episodic memory. We assessed test-retest reliability for key cognitive outcome variables with Pearson and intra-class correlations. <h3>Results:</h3> The INTUITION study was 91% enrolled (N=20,916) as of September 2022. N=9,415 participants have provided at least 5 sequential CANTAB assessments. Moderate-to-high test-retest reliability was observed for key outcome variables (range; r=0.42–0.80). Subtle, but measurable learning effects were noted across initial sessions and then abated alongside rising performance reliability following subsequent assessments. We present detailed test-retest reliabilities for representative outcomes of each CANTAB assessment from the total study population and by cohort. <h3>Conclusions:</h3> We demonstrated moderate-to-strong reliability in key cognitive outcome measures and reliability increased as a function of age. Reliability findings were comparable to those reported in the literature for supervised cognitive assessments. These initial results suggest remote and unsupervised cognitive testing is plausible and sufficiently reliable and can be self-administered in ecologically valid real-world settings. <b>Disclosure:</b> Dr. Erkkinen has received personal compensation in the range of $5,000-$9,999 for serving as a Consultant for Biogen. Dr. Butler has received personal compensation for serving as an employee of Biogen. Dr. Butler has stock in Biogen. Dr. Brown has received personal compensation for serving as an employee of Biogen. Dr. Brown has stock in Biogen. Mr. Hobbs has received personal compensation for serving as an employee of Biogen. Mr. Hobbs has stock in Biogen. Audrey Gabelle has nothing to disclose. Dr. Becker has received personal compensation for serving as an employee of Biogen. Dr. Saha-Chaudhuri has received personal compensation for serving as an employee of Biogen. Dr. Saha-Chaudhuri has received personal compensation in the range of $10,000-$49,999 for serving as a Consultant for Biogen. Dr. Saha-Chaudhuri has stock in Biogen. Dr. Ash has received personal compensation for serving as an employee of Biogen. Mr. Kenny has received personal compensation for serving as an employee of Biogen. Mr. Kenny has stock in Biogen. Dr. Lenyoun has received personal compensation for serving as an employee of Apple. Dr. Lenyoun has stock in Apple. Matt Bianchi has nothing to disclose. Dr. Belachew has received personal compensation for serving as an employee of Biogen Inc. Dr. Belachew has received stock or an ownership interest from Biogen Inc.

Remote assessment of cognition and quality of life following radiotherapy for nasopharyngeal carcinoma: deep-learning-based predictive models and MRI correlates.

Irradiation of the brain regions from nasopharyngeal carcinoma (NPC) radiotherapy (RT) is frequently unavoidable, which may result in radiation-induced cognitive deficit. Using deep learning (DL), the study aims to develop prediction models in predicting compromised cognition in patients following NPC RT using remote assessments and determine their relation to the quality of life (QoL) and MRI changes. Seventy patients (20-76 aged) with MRI imaging (pre- and post-RT (6months-1year)) and complete cognitive assessments were recruited. Hippocampus, temporal lobes (TLs), and cerebellum were delineated and dosimetry parameters were extracted. Assessments were given post-RT via telephone (Telephone Interview Cognitive Status (TICS), Telephone Montreal Cognitive Assessment (T-MoCA), Telephone Mini Addenbrooke's Cognitive Examination (Tele-MACE), and QLQ-H&N 43). Regression and deep neural network (DNN) models were used to predict post-RT cognition using anatomical and treatment dose features. Remote cognitive assessments were inter-correlated (r > 0.9). TLs showed significance in pre- and post-RT volume differences and cognitive deficits, that are correlated with RT-associated volume atrophy and dose distribution. Good classification accuracy based on DNN area under receiver operating curve (AUROC) for cognitive prediction (T-MoCA AUROC = 0.878, TICS AUROC = 0.89, Tele-MACE AUROC = 0.919). DL-based prediction models assessed using remote assessments can assist in predicting cognitive deficit following NPC RT. Comparable results of remote assessments in assessing cognition suggest its possibility in replacing standard assessments. Application of prediction models in individual patient enables tailored interventions to be provided in managing cognitive changes following NPC RT.

Remote assessment of cognition and quality of life following radiotherapy for glioma: deep-learning-based predictive models and MRI correlates.

Glioma irradiation often unavoidably damages the brain volume and affects cognition. This study aims to evaluate the relationship of remote cognitive assessments in determining cognitive impairment of irradiated glioma patients in relation to the quality of life and MRI changes. Thirty patients (16-76 aged) with two imaging (pre- and post-RT) and completed cognitive assessments were recruited. Cerebellum, right and left temporal lobes, corpus callosum, amygdala and spinal cord were delineated and their dosimetry parameters were collected. Cognitive assessments were given post-RT via telephone (Telephone Interview Cognitive Status (TICS), Telephone Montreal Cognitive Assessment (T-MoCA), Telephone Mini Addenbrooke's Cognitive Examination (Tele-MACE)). Regression models and deep neural network (DNN) were used to evaluate the relationship between brain volume, cognition and treatment dose in patients. Cognitive assessments were highly inter-correlated (r > 0.9) and impairment was shown between pre- and post-RT findings. Brain volume atrophy was shown post-RT, and cognitive impairments were correlated with radiotherapy-associated volume atrophy and dose-dependent in the left temporal lobe, corpus callosum, cerebellum and amygdala. DNN showed a good area under the curve for cognitive prediction; TICS (0.952), T-MoCA (0.909) and Tele-MACE (0.822). Cognition can be evaluated remotely in which radiotherapy-related brain injury is dose-dependent and volume-dependent. Prediction models can assist in the early identification of patients at risk for neurocognitive decline following RT for glioma, thus facilitating potential treatment interventions.

Introducing the Tele-OCS: A validated remotely administered version of The Oxford Cognitive Screen

Background Remote cognitive assessments are increasingly used with the rising popularity of teleneuropsychology. Here, we evaluated the performance of the remotely administered Oxford Cognitive Screen (Tele-OCS) compared to in-person administration in adult stroke survivors. Methods 40 stroke survivors (M age = 69.30, SD = 10.44; sex = 30% female) completed in-person and remote versions of the OCS on average 30 days apart, with different trained examiners. The order of administration was counterbalanced. Cohen’s d estimates were used to compare performance between modalities. Results We found that the proportion of OCS subtasks impaired did not differ across modalities (d = 0). With regards to raw subtask scores, only the picture naming subtask and executive score from the trail making subtask were found to be statistically different across modalities, though raw differences were minimal (&lt;1 point difference on average). These statistical differences did not affect impairment classifications. Conclusions The Tele-OCS classified cognitive impairments in a comparable way to the in-person version. The validation of the Tele-OCS allows for remote assessment to increase accessibility and pragmatically aid in addressing the clinical need for stroke-specific cognitive screening in a wider population.