Digital Assessment System Research Articles

Novel Digital Assessment System for Upper-Limb Movement in Stroke Patients Using Markless-Sensing Technology and Deep Learning Algorithms

Novel Digital Assessment System for Upper-Limb Movement in Stroke Patients Using Markless-Sensing Technology and Deep Learning Algorithms

Feasibility of the CART In‐Home Technology Platform in a Pilot Study of Hispanic Older Adults Residing in South Texas

AbstractBackgroundAs Alzheimer’s disease (AD) prevalence rises, the development of effective screening tools is necessary to aid in earlier AD diagnosis. In the USA, Hispanic and Non‐Hispanic Black adults are at a disproportionately higher risk of developing dementia than non‐Hispanic whites but are poorly represented in AD research. A digital assessment system ‐ the Collaborative Aging Research using Technology (CART) platform, has been developed to remotely and continuously detect early declines in cognition by analyzing changes in everyday activity levels. Although the platform is promising, installing digital technology in a home can cause concerns over privacy and user friendliness, especially in older adults. In our CART pilot study at UTHSCSA, we sought to determine the feasibility of deploying the CART platform in an underrepresented, mostly Hispanic population and to gain insight from their experiences.MethodSeven cognitively intact participants were enrolled in our year‐long pilot study. The CART platform consisted of a watch‐actigraph, digital scale, electronic pillbox, bed mat (measuring sleep), and wall‐mounted motion sensors. Participants completed weekly online surveys including mood assessments, the UDS3 neuropsychological battery at baseline and one‐year follow‐up, and an end‐of‐study user experiences survey. Wilcoxon signed rank exact tests were used to determine significance.ResultOur cohort consisted of five Hispanic, one non‐Hispanic Black, and one non‐Hispanic white participant, ages 65‐80. There were no significant changes in cognition, daily steps, sleep, weight, or heart and respiratory rate measured during sleep over the course of the study (p>0.05). Self‐reported depressive symptoms decreased (p = 0.034) (Figure 1J). Weekly survey results supported this finding because self‐reported feelings of loneliness and “blue mood” also decreased. Responses to the user experience survey demonstrated that participants found the technology installation satisfactory (43%) or very satisfactory (57%) and thought that their privacy concerns were addressed satisfactorily (43%) or very satisfactorily (57%) (Figure 2).ConclusionOur results suggest that the CART platform was widely accepted by our mostly Hispanic older adult participants and that they were comfortable with the study devices. The findings support the feasibility of increasing representation of diverse older adults in dementia prevention research using digital devices.

Towards Sustainable Educational Management: A Best Practice Model for Digital Assessments in Higher Institutions of Learning in Uganda

This study was conducted in institutions of higher learning from different regions of the country. The participants included students, academic staff and technical staff. Numerous digital assessment-related challenges experienced during the Covid-19 were identified such as the slow Learning Management System (LMS), and failure to access the digital assessment system, among others. Data was collected through closed-ended questionnaires and interviews with key informants. Quantitative data was analysed descriptively using R, whereas qualitative data was analysed using Amos. Reliability and validity of the questionnaire were tested by Cronbach’s alpha coefficient and Kaiser-Meyer-Olkin (KMO) test, respectively. The results were ranked based on the challenges that appeared most frequently to the least presented. A best practice model is presented with guidelines and measures for achieving successful administration of digital assessments for all stakeholders in the education ecosystem. It is anticipated that the successful adoption and implementation of the model will lead to effective and sustainable education management. Design science, an artefact-based methodology, was used to support the design of the model. The design followed design science-recommended steps. The model is, however, yet to be validated among the body of experts

Effect of a digital assessment system for the preclinical tooth preparation of metal-ceramic crowns: A pilot study

Tooth preparation is a fundamental aspect of prosthodontics and serves as a focal point in preclinical courses. Conventional pedagogy relies heavily on the expertise of instructors, whereas digital technology has the potential to offer instantaneous feedback. The efficacy of a digital assessment system in comparison with traditional teaching methods remains uncertain. The purpose of this study was to compare the training effects of traditional assessment and digital evaluation on tooth preparations for the metal-ceramic crowns performed by preclinical students on the convergence angle and tooth reduction. A total of 40 predoctoral students were randomly divided into the digital group and the traditional group to complete tooth preparation for a metal-ceramic crown on a left mandibular first molar. Students in the traditional group were taught by an experienced instructor, while the digital group students were trained by an objective digital assessment system without instructor guidance. Each student completed the tooth preparation in 20min, received feedback according to the respective training methods, and later prepared another tooth. In this way, all students completed 4 tooth preparations in 2 weeks. All preparations were evaluated by an optical scanner. Parameters for comparing the digital group with the traditional group were the convergence angle and reduction at different stages. Questionnaires on the digital training system were answered by the students of the digital group. The t tests or Wilcoxon signed rank tests and chi-squared tests were used to analyze the differences between the 2 groups (α=.01). A decreasing trend in convergence angle was seen in both groups, but the 2 groups were statistically similar (P>.01). After training, a decreasing trend was seen in under-reduction and overreduction on 5 surfaces in the digital group. Conversely, in the traditional group, a noteworthy increase was seen in under-reduction on the distal surface (P=.002). Nevertheless, no significant difference was found between the 2 groups (P>.01). According to the results of the questionnaire, over 80% of the students had a positive attitude toward the digital assessment system, and more than 80% of the students expressed their interest in the digital assessment system for tooth preparation training. Traditional teaching and digital feedback provided similar training effects to improve the quality of tooth preparations for preclinical dental students.

Use of an interactive digital assessment tool in mathematics education for engineers

Basic courses in mathematics for engineers often have more than several hundred participants. To achieve the learning goals it is necessary that the students work actively on specific problems. While working on the problems, students require assistance. As a supplement to guidance by lecturers and teaching assistants, NTNU has piloted use of a digital assessment system STACK, that enables constructive feedback and is to some degree interactive.
 We will discuss how we integrate digital assessment into daily teaching practices, show examples of the problems and present some qualitative data collected from actual students.

Comparison Between Conventional and Digital Essay Writing Assessment System: Consumer Concept and User Friendly

Significant changes occurred in education system; teaching and learning technology in this new era. The changes can be revised through the existence of digital assessment system for essay writing. In utilizing and interpreting these changes, this study was conducted to examine the use of digital and conventional assessment system for Form Three among Malay teachers. The survey method was used in this study. The samples of the study are 60 teachers of the national secondary school which taught Malay Language for form three in Selangor and Federal Territory of Kuala Lumpur. The data are described descriptively and inferentially. Descriptive data are mean and standard deviation. Inferential data was analyzed using ANCOVA statistics. The findings show that there is a significant difference in teachers' opinion on the use of digital assessment system and the use of conventional assessment materials that based on consumer concept and user friendly. From that perspective, digital scoring system make teachers more dynamic in scoring the essay writing for form three. Therefore, it is recommended to the Ministry of Education to implement and revise the use of digital assessment system to improve the process for primary and secondary schools.

A digital assessment system for evaluating kinetic tremor in essential tremor and Parkinson\u2019s disease

BackgroundSpiral drawing on papers is a common tremor evaluation tool for diagnosing patients with essential tremor (ET) or Parkinson’s disease (PD). No standard drawing methods and parameters that use graphic tablets are yet available for objective evaluation.MethodsThis study established a tremor assessment system for tremor severity by using graphic tablets. Twelve patients with ET and twelve patients with PD were tested to establish system algorithms, and six additional patients were tested with the developed system to evaluate its performance. The patients also performed spiral drawing with three guiding paradigms on a graphic tablet: traced along a given spiral (S1), performed freehand drawing (S2), and traced along a guiding point (S3). Three parameters were calculated to quantify tremor severity: the means of radial difference per radian (|dr/dθ|), the means of radial difference per second (|dr/dt|), and the area under curve (AUC) of the frequency spectrum of the velocity. Each patient’s drawing was also evaluated using a visual rating scale (VRS) by experienced physicians. The interrater reliability was examined to identify the most consistent test paradigm.ResultsThe parameter |dr/dθ| and AUC correlated well with the VRS (R > 0.8) in S1, S2 and S3 tests. The S1 test presented the best interrater reliability (Weighted Kappa coefficient, k = 0.80) among three tests. The Weighted Kappa coefficients are 0.67 and 0.71 in S2 and S3 tests, respectively.ConclusionsWe developed three different guiding paradigms for spiral drawing on a digital graphic tablet for clinical tests. Three parameters were calculated to represent the tremor severity in spiral drawing and used to quantify temporal and spatial characteristics of tremor, and provided good correlation with current clinical assessments. The test “traced along a given spiral” is recommended due to its good interrater reliability.

Development of American Sign Language Guidelines for K-12 Academic Assessments

The U.S. federal Every Student Succeeds Act (ESSA) was enacted with goals of closing achievement gaps and providing all students with access to equitable and high-quality instruction. One requirement of ESSA is annual statewide testing of students in grades 3-8 and once in high school. Some students, including many deaf or hard-of-hearing (D/HH) students, are eligible to use test supports, in the form of accommodations and accessibility tools, during state testing. Although technology allows accommodations and accessibility tools to be embedded within a digital assessment system, the success of this approach depends on the ability of test developers to appropriately represent content in accommodated forms. The Guidelines for Accessible Assessment Project (GAAP) sought to develop evidence- and consensus-based guidelines for representing test content in American Sign Language. In this article, we present an overview of GAAP, review of the literature, rationale, qualitative and quantitative research findings, and lessons learned.

Relationship between the Chinese Version Weehsler intelligence scale for children and the Das-Naglieri cognitive assessment system in children with attention deficit hyperactivity disorder

Objective To explore the relationship between the Chinese Version Wechsler intelligence scale for children(C-WISC) and the Das-Naglieri cognitive assessment system(DN: CAS) in children with attention deficit hyperactivity disorder (ADHD). Methods Thirty-two children with ADHD were evaluated with C-WISC and the digital remote assessment system——DN: CAS, and both results were administered for correlation analysis. Results The results showed that there was a strong correlation between the full intelligence quotient (FIQ) of C-WISC and the full score of DN: CAS, also the scores in Plan, Simultaneous, and Successive of DN-CAS, and the correlation coefficient was between 0.6 to 0.8. There was a strong correlation between the full score of DN: CAS and the verbal comprehension IQ(VCIQ), perceptual organization IQ(POIQ), memory/concentration IQ(M/CIQ), verbal IQ(VIQ), and performance IQ(PIQ) of C-WISC, as the correlation coefficient ranges from 0.6 to 0.8. There was also a strong correlation between the score in Planning and VCIQ, POIQ, M/CIQ, VIQ of C-WISC. As to the score in Simultaneous of DN: CAS and POIQ, VIQ, PIQ of C-WISC, the correlation was also strong with the correlation coefficient ranging from 0.6 to 0.8. For the rest of the sub-tests of C-WISC and DN: CAS, there was moderate correlation between them, the correlation coefficient was from 0.4 to 0.6. Conclusions These results show that the correlation between C-WISC and DN: CAS in children with ADHD is significant. The correlation coefficient shows diversity in the sub-tests of C-WISC and DN: CAS. Key words: Attention deficit hyperactivity disorder; Chinese Version Weehsler intelligence scale for children; Das-Naglieri cognitive assessment system; Correlation

The prognostic value of the quality of life parameters in patients with idiopathic scoliosis treated operatively (Poster)

implemented as a means of quantifying posture in physiotherapy departments in the near future. Objectives: The first objective of this study was to devise a protocol for use with patients with different spinal dysfunctions. The second objective was to produce a database of normative back shape values in young adults. These baseline values would then enable the comparison of subjects with healthy backs to the backs of patients with spinal problems. Subjects: 100 healthy subjects aged 20–40 years old were recruited. Subjects were excluded if they had any lower limb or back injury that prevented the subject standing for the duration of data collection. Instrumentation: This study used a relatively low-cost (<£3000), portable system, known as the MIDAS (Middlesbrough Integrated Digital Assessment System), with software specifically designed for the assessment of back posture. Procedure: The patient was positioned in front of the MIDAS, allowing measurement of landmarks of their back for posture assessment. Data collection involved one tester touching the MIDAS stylus tip to each of the marked points in a standardized order dictated by the software and pressing the foot pedal of the MIDAS to store the position on the computer. Results: The results indicate that overall young adults are very symmetrical. The mean distances between the left and right sides of the back and the average values were then calculated. Only the distance between the scapula and the acromion process was significantly smaller on the left side than the right side. It is possible that this is related to the fact that most subjects were right handed. A map of 3D back patient values for normative distances and angles was produced and will be shown at the presentation. Conclusions: Our results will provide a normative database for clinicians (physiotherapist, chiropractors, spinal surgeon) who routinely assess back posture. The method we have devised will also provide an evidenced based objective alternative to just ‘‘eyeballing’’ back posture during clinical evaluation.

Computerized back postural assessment in physiotherapy practice: Intra-rater and inter-rater reliability of the MIDAS system

Assessment of spinal posture during physiotherapy practice is routine, yet few objective measures exist to this end. The Middlesbrough Integrated Digital Assessment System (MIDAS) is a low cost portable system able to record 3D information on posture. The purpose of this study was to assess both the intra-rater and inter-rater reliability of the MIDAS system. Twenty-five healthy subjects were recruited. A repeated measures design was used to record fifteen pre-palpated landmarks on the back of each subject. To limit the sources of variability, the principal researcher palpated the landmarks for each subject. Each of three raters took two measurements on each subject in a standardized upright posture. X (medio-lateral), Y (antero-posterior) and Z (height) landmark positions were recorded via a computer interface. Both intra-rater agreement (mean ICCs - rater 1 r=0.970, rater 2 r=0.965 and rater 3 r=0.965, p< 0.001) and inter-rater agreement (mean ICCs r=0.967, p< 0.001) was very high between repeated measures and between markers. Error values for the z-axis (height) were the lowest. The MIDAS demonstrated both high inter-rater and intra-rater reliability and provides an objective method for the assessment of posture in physiotherapy practice.

Digital imaging system for assessing posterior capsular opacification: a preliminary report

Purpose: Posterior capsular opacification (PCO) is the commonest complication of cataract surgery. The aim of this work is to develop a system that could be used by primary care practitioners to monitor the progression of PCO using familiar equipment.Methods: A Kodak DCS 100 (Eastman Kodak, Rochester, NY, USA) digital data back, which uses a Nikon F3 body, was connected to the camera port of a Nikon FS‐2 photo slit‐lamp. A fixation stimulus was developed and systematic studies carried out to determine optimum exposure and slit‐lamp settings using patients recruited from the YAG laser capsulotomy clinic at the Royal Eye Unit, Kingston Hospital. In all cases conventional illumination was used. Inter and intraobserver trials were then carried out using observers ranging from a non‐clinician to an experienced ophthalmologist. All images were analysed using ImagePro Plus image processing software prior to statistical analysis.Results: Optimum slit‐lamp parameters were found to be a 45° slit beam angle, 3 mm slit width and 25× magnification. The flash intensity was set to 2. The optimum camera and digital storage unit speed settings were both ISO 200 for fibrotic PCO but 800 and 1600, respectively, for Elschnig pearl type PCO. Intra‐observer repeatability gave ±0.375 mm (95% confidence) variation in fixation. However, initial results from interobserver trials showed significant variability.Conclusions: The current digital assessment system uses a standard piece of consulting room equipment coupled to a digital 35 mm camera. Initial results indicate that it should be suitable for use in monitoring PCO although a more exact measurement protocol is required to reduce interobserver variability. Work is currently underway to complete validation trials and to find suitable image statistics.