Digital Assessment Tool Research Articles

Implementation of an interactive, digital cancer risk assessment tool in a Medicaid-predominant, racially-diverse gynecology clinic in Brooklyn, New York

Implementation of an interactive, digital cancer risk assessment tool in a Medicaid-predominant, racially-diverse gynecology clinic in Brooklyn, New York

The use of abstract animations and a graphical body image for assessing pain outcomes among adults with sickle cell disease

Painimation, a novel digital pain assessment tool, allows patients to communicate their pain quality, intensity, and location using abstract animations and a paintable body image. This study determined the construct validity of pain animations and body image measures by testing correlations with validated pain outcomes in adults with sickle cell disease (SCD). Analyses used baseline data from a multisite randomized trial of 359 adults with SCD and chronic pain. Participants completed questionnaires on demographics, pain severity, frequency and interference, catastrophizing, opioid use, mood and quality of life, plus the Painimation app. Participants were categorized by selected pain animations, and were split into groups based on the proportion of painted body image. The “shooting” pain animation and greater body image scores associated with poorer pain outcomes in univariate analyses, except “happy” mood days. Potential confounding was evaluated by age, gender, race, education, disability, site, depression, and anxiety. Only depression scores significantly covaried in multivariate models, accounting for the effect of greater body image score and shooting animation on all outcomes except daily pain intensity. Both pain animations and body image measures correlated with validated pain outcomes, quality of life and mental health measures. This demonstrates animations and body image data can assess SCD pain severity, potentially with more accuracy than a 0-10 scale. In exploratory analyses, depression scores accounted for the association between Painimation and other pain outcomes. Future research will explore whether Painimation can differentiate biological and psychosocial pain components. PerspectiveThis article presents the preliminary construct validity of Painimation in sickle cell disease (SCD) by examining the associations of “pain animations” and body area image data with daily e-diary and traditional self-report pain outcomes.

Development of a new digital sexual health assessment tool to help patients better understand the factors involved in their sexual disorders – “The Sexual Dysfunction Evaluation Tool” (SEXDET)

IntroductionA visual digital tool called SEXual Dysfunction Evaluation Tool (SEX-DET) was created for assessing the causes of sexual dysfunction, based on a biopsychosocialsexual and relational schema, to assist patients in understanding the relative influence of the various factors contributing to their sexual dysfunction. The aim of this study was to evaluate satisfaction of this tool in sexual dysfunction patients and practitioners. MethodsA satisfaction study of the SEX-DET was performed in 50 patients (20 F, 30 M) consulting for a sexual trouble and 3 practitioners. The main reasons for consultation were erectile dysfunction (36%) and desire disorder (30%). ResultsAll the participants agreed that the SEX-DET helped them to understand the origin their trouble (46% strongly, 42% moderately, 12% somewhat), the various factors involved (56% strongly, 22% moderately and 18% somewhat) and the management of their trouble (6% strongly, 47% moderately, 33% somewhat). Overall, 94% of participants found that the SEX-DET was easy to use (58% strongly, 16% moderately and 20% somewhat). Practitioners acknowledged the user-friendly interface, its critical role in improving patients’ understanding and providing a comprehensive visualization of the dimensions associated with sexual dysfunction, even if one practitioner threatened the tool's intrinsic inclination to oversimplify complex data. ConclusionSEX-DET enabled to improve patients’ understanding of their trouble and helped practitioners in structuring better communication during consultations communication regarding sexual dysfunction. The shortcomings of this study was its focus on short-term outcomes, self-reported data, and the absence of control group.

Experiences of Using a Digital Guidance and Assessment Tool (the Technology-Optimized Practice Process in Nursing Application) During Clinical Practice in a Nursing Home: Focus Group Study Among Nursing Students.

Nursing students' learning during clinical practice is largely influenced by the quality of the guidance they receive from their nurse preceptors. Students that have attended placement in nursing home settings have called for more time with nurse preceptors and an opportunity for more help from the nurses for reflection and developing critical thinking skills. To strengthen students' guidance and assessment and enhance students' learning in the practice setting, it has also been recommended to improve the collaboration between faculties and nurse preceptors. This study explores first-year nursing students' experiences of using the Technology-Optimized Practice Process in Nursing (TOPP-N) application in 4 nursing homes in Norway. TOPP-N was developed to support guidance and assessment in clinical practice in nursing education. Four focus groups were conducted with 19 nursing students from 2 university campuses in Norway. The data collection and directed content analysis were based on DeLone and McLean's information system success model. Some participants had difficulties learning to use the TOPP-N tool, particularly those who had not attended the 1-hour digital course. Furthermore, participants remarked that the content of the TOPP-N guidance module could be better adjusted to the current clinical placement, level of education, and individual achievements to be more usable. Despite this, most participants liked the TOPP-N application's concept. Using the TOPP-N mobile app for guidance and assessment was found to be very flexible. The frequency and ways of using the application varied among the participants. Most participants perceived that the use of TOPP-N facilitated awareness of learning objectives and enabled continuous reflection and feedback from nurse preceptors. However, the findings indicate that the TOPP-N application's perceived usefulness was highly dependent on the preparedness and use of the app among nurse preceptors (or absence thereof). This study offers information about critical success factors perceived by nursing students related to the use of the TOPP-N application. To develop similar learning management systems that are usable and efficient, developers should focus on personalizing the content, clarifying procedures for use, and enhancing the training and motivation of users, that is, students, nurse preceptors, and educators.

Effect of digital competence on scan time and scan error in intraoral scanning

Objectives: This study aimed to test whether the digital competence of dental hygienists can affect their intraoral scanning potential in terms of scan time and error. Methods: Dental hygienists and dental hygiene students who had never used an intraoral scanner were surveyed to determine their digital competence. Individual data collected using an intraoral scanner was compared with reference data collected using a model scanner to identify scanning errors, and participants’ scanning times were measured. Results: A significant decrease in scanning time was observed as the overall level of digital competence increased. The increase in digital skills and digital knowledge led to a decrease in scanning time by 3.73 and 3.98 minutes, respectively. Conclusions: This study found that digital competence was associated with reduced scan times, but less so with scan errors. This may be due to recent advances in scanning software, and future studies may need to develop a digital competence assessment tool that is more appropriate for the dental field.

Navigating the Fourth Industrial Revolution: SBRI - A Comprehensive Digital Maturity Assessment Tool and Road to Industry 4.0 for Small Manufacturing Enterprises

Navigating the Fourth Industrial Revolution: SBRI - A Comprehensive Digital Maturity Assessment Tool and Road to Industry 4.0 for Small Manufacturing Enterprises

Screens and Preschools: The Bilingual English Language Learner Assessment as a Curriculum-Compliant Digital Application.

The increase in digital tools in early childhood education highlights the need for evidence-based assessments that support cognitive development and align with educational requirements and technological advances. This study contributes to the evaluation of the Bilingual English Language Learner Assessment (BELLA), designed to enhance early learning through curriculum-aligned tasks in preschool-aged children. Data were collected from 17 schools, including 506 preschool children, using a mixed-model approach to assess BELLA's capacity to appraise early numeracy, literacy, science, and social/emotional development. Analyses included a three-way ANOVA to examine the effects of sex, age, and sub-domain on pass rates and mixed-effects models to evaluate interactions between age and domain. The results indicated a significant effect of age on performance across all domains, with older children demonstrating higher pass rates (p < 0.0001). No significant gender bias was detected. The interaction between age and domain was also significant (p < 0.0001), suggesting domain-specific age-related performance trends, which aligns with internal validity requirements. These findings position BELLA within the growing body of literature on digital media use in early childhood assessment and education, highlighting its potential as a curriculum-compliant digital assessment tool that evaluates and supports cognitive development without a gender bias. This study contributes to the field by providing empirical evidence of BELLA's effectiveness and suggesting future research directions, including the exploration of its bilingual (and potentially multilingual) applications and external validation against existing evidence-based assessments.

Test-retest reliability, practice effects and estimates of change: A study on the Mindmore digital cognitive assessment tool.

The present study aimed to establish test-retest reliability and investigate practice effects of the Mindmore cognitive assessment tool, a digital adaptation of traditional pencil and paper tests designed for self-administration. Additionally, normative change scores for the most frequently used tests were derived. A total of 149 healthy Swedish adults (aged 20-79) completed the test battery twice, 1 month apart. The battery assessed attention and processing speed, memory, language, visuospatial functions, and executive functions. Test-retest reliability, measured by ICC and Spearman coefficients, and practice effects were estimated for 22 main-scores and 33 sub-scores. Regression models were used to assess change in performance while controlling for demographics, computer equipment, testing location (online or in-laboratory) and baseline performance for 12 main-scores and nine sub-scores. Test-retest reliability was good for 11 main-scores (≥0.70), satisfactory for five (0.60-0.69), and minimal for six (<0.60) albeit three having satisfactory sub-scores. Practice effects were observed for tests with a major speed component, but not for reaction time, sustained attention, verbal memory and naming (alternate forms), nor visuospatial functions. Trackpad negatively influenced change for one test. Demographics and testing location did not significantly affect the change scores. Our study provides support for test-retest reliability and practice effects of the Mindmore cognitive assessment tool which were comparable to those of traditional tests. These findings, together with the normative change scores, can aid researchers and clinicians in interpreting test results and distinguishing between normal variations in performance and changes indicative of clinical impairment.

Validity of a digital photo-based dietary assessment tool: Development and initial evaluation.

Background and aim: To evaluate the validity and user satisfaction of a digital photo-based dietary assessment tool as an alternative to the hand-written paper record method that assists researchers during the pandemic. This study compared nutrient intake and users' satisfaction with methods between a digital photo-based dietary assessment tool, known as the Nutrinote Gama app, and food weighing as the gold standard. Methods: Fifty college students majoring in food and nutrition (90% were women; median age, 21 years) took pictures of their foods and beverages before and after consumption and then uploaded them to the Nutrinote Gama application. Trained nutritionists evaluated plate wastes, and nutritional content was revealed on the Nutrinote Gama application. Parallel to the photo-based method, they kept a weight dietary record and sent it to the researcher. A questionnaire was used to assess participants' satisfaction. Results: No statistical differences (p = 0.89) were observed in the measurement of energy intake between Nutrinote Gama (mean ± standard deviation [SD] = 582.8 ± 131) and food weighing (mean ± SD = 566.1 ± 133). No statistical differences (p = 0.59) were also observed in the measurement of protein, fat (p = 0.434), and carbohydrate (p = 230). The energy, protein, fat, and carbohydrate intakes estimated from the two methods were significantly correlated (r = 0.86, 0.870, 0.811, 0.738, respectively). Over 70% of participants were satisfied with the photo-based record. Conclusion: The results indicate that this digital photo-based dietary assessment tool is valid and user-friendly to estimate nutrient intake.

Facilitators and Barriers to the Implementation of a Digital Pain Assessment Tool in Pediatric Oncology Practice: A Qualitative Evaluation of a Quality Improvement Project.

Background: Most children and adolescents with cancer experience acute pain, and many experience longer-lasting chronic pain, negatively impacting health-related quality of life and resulting in long-term morbidity. Digital apps can aid in enhancing pain assessment and management by offering children and adolescents with cancer an accessible tool to describe their pain as a multifaceted biopsychosocial construct. Pain Squad is a useable, acceptable, and psychometrically sound multidimensional cancer pain assessment app for children and adolescents with cancer. This project aimed to evaluate the capacity to implement Pain Squad into routine pediatric oncology practice. Method: Nurse champions were asked to prescribe the Pain Squad app to patients over a 6-month implementation period. After the implementation period, we conducted audiorecorded, semistructured interviews with nurse champions to investigate the facilitators and barriers related to nurses' experiences with implementing Pain Squad. Results: The facilitators and barriers to Pain Squad implementation were organized into four overarching Consolidated Framework for Implementation Research (CFIR)-related themes: (a) characteristics of the Pain Squad app; (b) clinic setting and its context; (c) nurse implementation champions; and (d) the process of implementing Pain Squad into clinical practice. Conclusions: Interviewed nurses believed Pain Squad had the potential to improve child cancer pain care, but barriers to everyday use were evident, described in relation to the internal setting, especially the lack of compatibility between app prescription and current nurse workflows. The use of CFIR to map identified implementation facilitators and barriers can formally support the recognition of factors that may boost the chances of successful uptake.

Cultural adaptation of the brain health assessment for early detection of cognitive impairment in Southeast Nigeria.

The aging population in developing countries demands parallel improvements in brain health assessment services to mitigate stigma, promote healthy aging, and diagnose cognitive impairments including dementia in primary health care (PHC) facilities. The lack of culturally appropriate cognitive assessment tools in PHC facilities delays early detection. This study aims to culturally adapt a brief digital cognitive assessment tool for PHC professionals in Southeast Nigeria. A total of 30 participants (15 healthcare workers HCW and 15 community members) were selected to be culturally representative of the community. We completed focus groups and pilot testing to evaluate and refine the Brain Health Assessment (BHA) a subset of tools from the Tablet-based Cognitive Assessment Tool (TabCAT) known to be sensitive to cognitive impairment in other settings. We examined BHA subtests across local languages (Pidgin and Igbo) spoken at two geriatric clinics in Anambra State Southeast Nigeria. Following structured approaches in focus groups, adaptations were made to the Favorites (memory) and Line Length (visuospatial) subtests based on their input. Participants found the new adaptations to have good construct validity for the region. The BHA subtests showed content validity for future work needed to validate the tool for detecting early cognitive changes associated with dementia and Alzheimer's disease in PHC settings. The use of culturally adapted and concise digital cognitive assessment tools relevant to healthcare professionals in Southeast Nigeria's PHCs is advocated.

Improving feasibility and timeliness of hereditary cancer risk assessment with a brief patient-administered digital tool and rapidly available telehealth genetic counseling.

10614 Background: Multiple guidelines recommend hereditary cancer risk assessment for all adults, yet it rarely is performed. This is largely due to the time-consuming nature of such assessments and difficulty with access to genetic counseling for those at high risk. We designed a care model to address these issues that is suitable for both oncology and non-oncology settings. It includes a brief patient-administered and clinically validated digital hereditary cancer risk assessment tool, followed by immediate online self-scheduling features for telehealth genetic counseling, with appointments available within 48 hours. The digital tool uses a guideline-based algorithm to assess whether genetic testing for hereditary cancer risk is indicated. Here we aim to evaluate the effectiveness and timeliness of this model. Methods: We conducted a retrospective chart review of consecutive patients that engaged with this model from May 2021 to August 2023 at 32 obstetrics and gynecology clinics. We also used nationwide data from the National Society of Genetic Counselor's (NSGC) Professional Status Survey. To assess timeliness of genetic counseling appointments in this care model, we compared the time from scheduling the appointment to the start of the appointment to wait times at health systems for comparable non-urgent cancer genetic counseling appointments, from the NSGC data. Effectiveness was assessed via rates of completion of the tool and scheduling of genetic counseling. Results: 2538 patients (98% female, mean age 37 years, 3.9% with a personal history of cancer) initiated the care model and 95% (2415/2538) completed the risk assessment tool. A quarter (26% (628/2415)) met criteria for germline genetic testing. The median time to complete the tool was 2.7 minutes (IQR 2.9). At the end of the tool, patients could click a button to schedule an appointment with a genetic counselor to discuss hereditary cancer risk and genetic testing. 44% (274/628) booked an appointment. The median time from scheduling to genetic counseling appointment was 2.8 days (IQR 4.9 days), which is shorter than the median wait time for comparable genetic counseling appointments at health systems in the nationwide NSGC dataset (21 days (IQR 53 days); p&lt;&lt; 0.01). Conclusions: The tool completion rate, rate of patients meeting criteria, and uptake of genetic counseling indicate the model is effective. Timeliness was improved by this model, with the digital tool assessing risk in ~3 minutes, compared to previous reports of ~30 minutes for manual hereditary cancer risk assessment. In addition, the timeliness of genetic counseling appointments was markedly better than the current standard of care. These findings suggest that this care model can support physicians in providing timely guideline-recommended hereditary cancer risk assessment to their patients.

CSP2023: 28 - Digital Health Technology - Narrowing or Widening the Digital Divide? Learning From Validation of a Musculoskeletal Digital Assessment Tool (DART)

CSP2023: 28 - Digital Health Technology - Narrowing or Widening the Digital Divide? Learning From Validation of a Musculoskeletal Digital Assessment Tool (DART)

Development and first-stage validation of a digital version of the Digit Symbol Substitution test for use in assessing cognitive function in older people with diabetes.

To describe the development and report the first-stage validation of a digital version of the digit symbol substitution test (DSST), for assessment of cognitive function in older people with diabetes. A multidisciplinary team of experts was convened to conceptualize and build a digital version of the DSST and develop a machine-learning (ML) algorithm to analyse the inputs. One hundred individuals with type 2 diabetes (aged ≥ 60 years) were invited to participate in a one-time meeting in which both the digital and the pencil-and-paper (P&P) versions of the DSST were administered. Information pertaining to demographics, laboratory measurements, and diabetes indices was collected. The correlation between the digital and P&P versions of the test was determined. Additionally, as part of the validation process, the performance of the digital version in people with and without known risk factors for cognitive impairment was analysed. The ML model yielded an overall accuracy of 89.1%. A strong correlation was found between the P&P and digital versions (r = 0.76, p < 0.001) of the DSST, as well as between the ML model and the manual reading of the digital DSST (r = 0.99, p < 0.001). This study describes the development of and provides first-stage validation data for a newly developed digital cognitive assessment tool that may be used for screening and surveillance of cognitive function in older people with diabetes. More studies are needed to further validate this tool, especially when self-administered and in different clinical settings.

Management of Ocular Surface Inflammation with Persistent Epithelial Defects Using a Sutureless Human Amniotic Membrane Dehydrated Matrix: A Prospective Study Utilizing a Digital Ocular Surface Assessment Tool.

To report the outcomes of using a sutureless human amniotic membrane dehydrated matrix (HAMDM) in the management of a range of ocular surface conditions utilizing a digital ocular surface disease assessment tool. Two UK NHS Trusts - Queen Victoria Hospital Foundation Trust (East Grinstead and Maidstone) and Tunbridge Wells Trust (Kent) - prospectively treated patients with ocular surface disease with sutureless HAMDM. The patient cohort was assessed for resolution of epithelial defects, ocular surface inflammation, and best-corrected visual acuity pre- and posttreatment. Measurements of ocular surface inflammation and epithelial defect size were assessed using AOS digital imaging software, a validated tool for objective grading of bulbar conjunctival redness and measurement of corneal epithelial defects. A total of 47 applications of sutureless HAMDM on 46 eyes of 46 patients (25 male, 21 female, age 9-94 years) were assessed across various etiologies for an average of 24.0±14.1 days. Patients with limbal stem-cell deficiency (n=17), persistent epithelial defects (n=16), neurotrophic corneal disease (n=7), filamentary keratitis (n=2), corneal erosion (n=1), corneal thinning (n=1), ocular surface inflammation (n=1), and traumatic corneal laceration (n=1) were included in the study. Across all patents, 63% of eyes showed complete healing of epithelial defects and 32.6% of eyes showed partial resolution. The average rate of healing (wound closure) was 0.36 mm2 per day across the overall patient cohort, and the rate of healing in cases with complete resolution of epithelial defects was 0.41 mm2 per day. Inflammation across all four quadrants of the ocular surface remained stable. Visual acuity across the patient cohort remained stable (61%) and improved in 26% of patients (0.06±0.51 logMAR). Sutureless HAMDM application can be accomplished in just a few minutes and effectively treat a range of ocular surface disease in a clinical, nonsurgical setting. The AOS imaging software offered a quantitative methodology for measuring epithelial defect size and inflammation state.

Exploring underlying factors for variations in digital upskilling

This study aims to analyse the impact of demographic and educational factors on in digital upskilling. We address the relationship between digital skills, critical thinking skills and the student learning experience in courses with embedded upskilling programs. Statistical analysis and exploratory research are used to analyse the data collected by the digital fitness app developed by a global company leading digital talent transformation. Our research identified the following demographic indicators that have influenced individuals’ digital upskilling: Gender, Race, Residency, Pell-eligibility, Age, in addition to six academic indicators including department, major, class level, first-time freshman, High School GPA and ACT score. Discussion of findings and future research directions would lead to novel research articles focusing on longitudinal studies to assess digital skills. Also, this study shows the need for a new assessment tool to expand the scope and the sample size of the study. This article provides a valuable guidance for policy makers, higher-education institutions, educators, students, and employers, who are looking for digital talent or skill sets needed for digital transformation. The main contribution lays in data collection and analysis. This is the first study using a globally accepted digital talent assessment tool to collect data at a minority serving institution.

ExamMate-Online Examination Portal

In today's digital era, the demand for remote learning and online education has surged, necessitating robust platforms for conducting examinations remotely. This research paper introduces ExamMate, an online examination portal tailored to streamline the assessment process within educational institutions and organizations. ExamMate is designed with the core objectives of simplifying examination procedures, enhancing accessibility for administrators and examinees, and ensuring the integrity of assessments. This paper outlines the key features of ExamMate, including its user-friendly interface, customizable exam creation tools, and comprehensive security measures. The platform offers a diverse range of question formats, such as multiple-choice, short answer, and essay questions, catering to various assessment needs. ExamMate prioritizes security through encryption protocols, authentication mechanisms, and anti-cheating measures to maintain the fairness and credibility of assessments. KEYWORD: Exam Mate Online examination portal, Remote proctoring, Exam scheduling, Exam registration, Secure online exams, Student assessment platform, Digital assessment tool, Student performance tracking, Exam grading.

Abstract LB145: Implementing timely germline genetic testing for patients with pancreatic cancer via a point-of-care digital education and health assessment tool

Abstract Introduction: Pancreatic ductal adenocarcinoma (PDAC) is the third leading cause of cancer-related deaths in the United States. National guidelines recommend germline genetic testing (GT) for all PDAC patients, but only 6.8-19% obtain GT. Current GT barriers include under-referral and genetic counselor shortage. Our goal was to improve uptake of GT among PDAC patients using a novel delivery model for genetic education and testing. Methods: The Genetic Information for Treatment Decisions (GIFTD) Initiative at Moffitt Cancer Center was created to streamline education and GT for PDAC patients. A Genetic Risk Education Coordinator (GREC), trained by licensed, board-certified genetic counselors, was hired to identify eligible patients and facilitate GT during clinician appointments. In partnership with Nest Genomics, a digital point-of-care tool was developed to collect personal and family history information, provide education about GT, and assess interest in GT. Patients receive a link from Nest ahead of their appointment via text and/or email to invite them to provide information and view education via mobile device. An auto-generated summary report with an indicator regarding GT interest is created in real-time for the GREC. Results: Seventy patients were invited to the Nest tool over the six-week launch period. Of those who opened the link, 83% (35/42) logged into their Nest account. Of these patients who logged into Nest, 71% (25/35) completed Nest’s GT education. The GREC met with 68% (17/25) of the patients that completed the education. 76% (13/17) of these patients were consented to GT. There were 2 patients who initially indicated that they were not interested in genetic testing in Nest but changed their mind after meeting with the GREC. Conclusion: Moffitt's collaboration with Nest through the GREC has successfully facilitated prompt germline genetic testing for PDAC patients, aiding in informed treatment decisions and family screening. Our preliminary findings suggest that the scalable Nest tool successfully captures PDAC patients who may be interested in GT, but follow-up with the GREC may further increase GT rates. Future directions for increasing uptake of GT and adhering to national guidelines include additional personalization and enhancement of the Nest tool. Citation Format: Jennifer B. Permuth, Sophie Moravec, Laura V. Barton, Revathy Suresh, Susan T. Vadaparampi, Jessica Rivera Rivera, J. Kevin Hicks, Teresa Ho, Dae Won Kim, Russel Palm, Pamela J. Hodul, Tara Schmidlen, Moran Snir, Laura Hayward. Implementing timely germline genetic testing for patients with pancreatic cancer via a point-of-care digital education and health assessment tool [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 2 (Late-Breaking, Clinical Trial, and Invited Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(7_Suppl):Abstract nr LB145.

Unearthing Subtle Cognitive Variations: A Digital Screening Tool for Detecting and Monitoring Mild Cognitive Impairment

Early diagnosis of mild cognitive impairment (MCI) is pivotal in mitigating the risk of cognitive impairment and the onset of dementia. However, prevailing clinical cognitive screening tests and biomarker assessment approaches often suffer from drawbacks such as high cost, invasiveness, time consumption, or subjectivity. In China, existing digital cognitive assessment tools face multiple challenges due to their distinctive cultural, language, and healthcare landscape. Therefore, we embarked on a study to develop a digital cognitive assessment tool, evaluate its efficacy in distinguishing between healthy individuals and MCI patients, and examine its acceptability among Chinese older adults. Through a series of symposiums, programming, and interviews with stakeholders, we iteratively designed the "BrainNursing" mobile application. The system consists of eleven single tasks and three dual tasks, each taking only 1–3 minutes. Subsequently, we conducted statistical comparisons of movement kinetics and physiological signals recorded during cognitive testing in 181 older adults to investigate which parameters could serve as effective digital biomarkers for MCI screening. Leveraging machine learning classifiers and a majority voting principle, we evaluated the classification performance of the BrainNursing system in detecting MCI, yielding an accuracy rate of 90.3%. Furthermore, our analysis of movement kinetics revealed that time, score, and sequence features are crucial in cognitive assessment. Contrasting with their healthy counterparts, MCI patients exhibited decreased heart rate variability, increased sympathetic nervous system activity, and weakened autonomic nervous system regulation in response to stimuli during cognitive testing. Finally, user experience feedback indicated that participants universally perceived BrainNursing as a convenient and user-friendly cognitive screening tool and provided valuable insights for further improvement.

Digital Assessment Tools: As a Media for Assesing High School Science Learning

This research is to produce a suitable digital assessment tool for high school students' in chemical literacy with validity, reliability, levels of difficulty and discrimination power. The research metodology is Research and Development (R&amp;D) using the Oriondo and Dallo-Antonio model. The research stages include planning the test instrument, testing, determining empirical validity, determining reliability, and interpreting test scores. In the planning (instrument creation), where the validation score estimates by experts in content, language, construction, and media are above 0.8, indicating that the test instrument is considered suitable for further testing to estimate validity, reliability, difficulty levels, and discrimination power. Out of the 25 developed questions, 24 fit the Rasch model. The reliability of Instrument Part I is 0.67, and Part II is 0.65, falling into the "sufficient" category. The questions exhibit varied difficulty levels, ranging from very easy to very difficult, with a standard deviation (SD) of 0.21 for Part I and 0.14 for Part II. The separation achieved by Instrument Part I is into 4 ability groups, while Instrument Part II separates into 2 ability groups. The distractors for multiple-choice questions fall into the "good" and "very good" categories, fulfilling their intended function effectively.