Design and development of the intelligent voice recognition‐based cognitive assessment WeChat mini‐program

Abstract

AbstractBackgroundEarly screening of mild cognitive impairment (MCI) is crucial for the elderly to access formal diagnosis and intervention of Alzheimer’s Disease (AD) and related dementias (ADRD) at early stages. Owing to the rapid development of artificial intelligence (AI) and voice recognition technology, the detection method using speech patterns as digital biomarkers collected by digital consumer devices can accommodate a huge demand for early and large‐scale detection. We here reported the design and development of the Shanghai Cognitive Screening (SCS) mini‐program, the first intelligent voice recognition‐based cognitive assessment WeChat mini‐program in China.MethodThe SCS mini‐program was developed based on the cognitive paradigm and classic pencil‐and‐paper neuropsychological assessments (e.g. Montreal cognitive assessment basic [MoCA‐B]). Through Automatic Speech Recognition (ASR), users speak to complete tasks including Naming, Immediate Recall, Delayed Recall, Symbol Digit Modalities Test (SDMT), Delayed RecallII, and Recognition (Figure 1). The acoustic, phonetics, and linguistic speech pattern variables would also be extracted and processed as digital biomarkers. The SCS intelligent prediction model enrolls speech pattern digital biomarkers, individual task scores, and time use variables with age, gender, and education level as linking variables, which enables to grade the user’s global cognitive function and individual cognitive domains (Figure 2).ResultAfter completing all tasks in the SCS, users can immediately read the comprehensive results which are divided into 4 categories corresponding to 4 grading intervals: “healthy” (cognitively normal), “low risk” (suspected SCD), “medium‐high risk” (suspected MCI), and “high risk” (suspected AD). We also use a radar chart with scores of cognitive domains (i.e., memory, attention, visual perception, language, and executive functions), a memory trend graph (i.e., immediate and delayed recalls), an attention persistence graph, and related advice in the automatically generated report (Figure 3).ConclusionThe SCS mini‐program is more efficient and economical compared to traditional paper‐based cognitive assessments. It is suitable for clinical cognitive assessment, remote self‐rating, and community screening for MCI and dementias among Chinese older adults and other ADRD high‐risk groups. Clinical trials are yet to be conducted to validate the accuracy and diagnostic value of the SCS WeChat mini‐program.