Set Of Assessment Tools Research Articles

Evaluar para avanzar: resultados de una estrategia nacional de evaluación formativa

Evaluar para Avanzar 3.o a 11.o is an initiative of the Colombian national government for supporting teaching and learning in primary, secondary and high school level, through a set of tools for formative assessment. We present the results of a study intended to identify the results of the implementation of Evaluar para Avanzar during the years 2020 and 2021. For this, we approximate the perception and experiences of the teachers, school principals and students through focal groups and interviews, whose analysis reveals the need to improve the appropriation of the objectives of the strategy and the use of the tools it offers, so that it fulfills its purpose of contributing to the improvement of pedagogical strategies based on the monitoring of students’ learning, their emotional needs and those of their environment; impacting educational quality in the long term.

Older Adult Fall Risk Prediction with Deep Learning and Timed Up and Go (TUG) Test Data.

Falls are a major health hazard for older adults; therefore, in the context of an aging population, predicting the risk of a patient suffering falls in the near future is of great impact for health care systems. Currently, the standard prospective fall risk assessment instrument relies on a set of clinical and functional mobility assessment tools, one of them being the Timed Up and Go (TUG) test. Recently, wearable inertial measurement units (IMUs) have been proposed to capture motion data that would allow for the building of estimates of fall risk. The hypothesis of this study is that the data gathered from IMU readings while the patient is performing the TUG test can be used to build a predictive model that would provide an estimate of the probability of suffering a fall in the near future, i.e., assessing prospective fall risk. This study applies deep learning convolutional neural networks (CNN) and recurrent neural networks (RNN) to build such predictive models based on features extracted from IMU data acquired during TUG test realizations. Data were obtained from a cohort of 106 older adults wearing wireless IMU sensors with sampling frequencies of 100 Hz while performing the TUG test. The dependent variable is a binary variable that is true if the patient suffered a fall in the six-month follow-up period. This variable was used as the output variable for the supervised training and validations of the deep learning architectures and competing machine learning approaches. A hold-out validation process using 75 subjects for training and 31 subjects for testing was repeated one hundred times to obtain robust estimations of model performances At each repetition, 5-fold cross-validation was carried out to select the best model over the training subset. Best results were achieved by a bidirectional long short-term memory (BLSTM), obtaining an accuracy of 0.83 and AUC of 0.73 with good sensitivity and specificity values.

Proposing a selective sub-tool to activate the role of parks in achieving the resilience of Egyptian cities

The concept of a Resilient City is considered one of the most important contemporary trends in sustainable planning, due to the many risks that cities are exposed to. Parks can support underlying environmental functions and offer several social-ecological advantages when they are strategically located, constructed, and managed. Parks represent one of the most important components of the city and by achieving resilience for an important element in the city, this is reflected in supporting the urban resilience of the city as a whole. The research problem focuses on neglecting the role of parks in achieving the city’s urban resilience, and the absence of clear indicators to activate its resilience in cities. The research addresses the issue by defining a comprehensive theoretical framework that integrates resilient park guidelines and comes up with a proposal for indicators for activating resilient parks. The Egyptian cities, which are developing countries, were chosen to apply the concepts of the study to them. The research deals with the monitoring and analysis of a set of city resilience assessment tools, to reach the most appropriate tools for evaluating one of the components of the city and appropriate to the nature of Egyptian cities and to be guided by this tool to extract a set of proposed indicators for evaluating the resilience park. The City Resilience Index (CRI) tool was developed based on the City Resilience Framework (CRF) and was selected as the best-fit measurement tool. This highlighted the main findings of the research and suggested indicators of park resilience activation.

Integrated Health and Personality Adaptation Model (IHPAM) for Men Amidst Russia-Ukraine Conflict: Navigating Psychosomatic Health

In the midst of the Russia-Ukraine war and the ongoing challenges of the post-COVID era, this study presents the Integrated Health and Personality Adaptation Model (IHPAM), focusing on the critical examination of psychosomatic health determinants in Ukrainian men. Materials and methods. Conducted on a sample of 708 men from the Kyiv region, the research applies a comprehensive set of assessment tools to probe the complex interactions between physical health, psychological stress, personality dynamics, and adaptive coping mechanisms. We used the I-structural test of Ammon, Lifestyle Index (LSI), Short Form-36 (SF-36), Assessment of the level of health by the main functional systems, Clinical questionnaire for the identification and assessment of neurotic conditions and rigorous factor analysis with SPSS-28. Results. The study identifies five key factors within the IHPAM: Physical Functioning Nexus, Destructive Functions of the Personality, The Psychological Stress Nexus, The Constructive Personality Matrix, and The Adaptive Defense Mechanisms. The IHPAM model underscores the multifaceted impact of the Russia-Ukraine war and the COVID-19 pandemic on men’s health, revealing significant psychosomatic disturbances. The study highlights the necessity for healthcare systems to adopt a holistic view, recognizing the pivotal role of psychological support, alongside physical health care, in mitigating the adverse effects of such unprecedented global and local stressors. Conclusions. IHPAM advocates for an integrated healthcare approach to the complex interdependencies between physical health, psychological wellbeing, and the socio-political environment, urging for targeted interventions that address the comprehensive health needs of men during times of crisis.

Developing and Validating Assessment Tools for Measuring Undergraduate Students’ Academic Engagement and Academic Achievement: Lessons Learned from a Pilot Research Project

In the initial stage of their federally funded research project, the authors detail how they developed and validated a set of assessment tools aimed at measuring undergraduate students’ academic engagement and their own definition of academic success. To ensure the tools were measuring what they were intended to, and that they were reliable, the authors enlisted content experts, including a librarian with academic engagement expertise, three educational psychologists with specialization in college students’ engagement, self-regulation, and related fields, and two psychometricians with knowledge of psychological measurement. The authors also reflect on the lessons they learned from the process of developing and validating the assessment tools.

XÂY DỰNG CÔNG CỤ ĐÁNH GIÁ NĂNG LỰC KHOA HỌC CỦA HỌC SINH TRONG DẠY HỌC CHỦ ĐỀ “TRÁI ĐẤT VÀ BẦU TRỜI” MÔN TỰ NHIÊN VÀ XÃ HỘI LỚP 3

The article is based on assessment theory, mainly the theory of Robert Glaser, proposing the process of capacity assessment, designing a scientific competency framework in teaching Nature and Society subjects in primary school, which includes 10 criteria, and each criterion consists of 3 levels. From analyzing the requirements of the topic “Earth and Sky” in the subject of Nature and Society, the research has proposed 6 principles, thereby building a 5-step process to design a set of assessment tools. The assessment, based on student achievement requirements, includes 30 questions and exercises, 10 checklists, 2 rating scales, 3 evaluation sheets according to criteria, and learning record samples. The toolkit, after testing on 34 primary school teachers, has been standardized and developed guidelines for use in assessing students in primary schools.

Development of Image Processing and AI Model for Drone Based Environmental Monitoring System

Data from environmental monitoring can be used to identify possible risks or adjustments to ecological patterns. Early detection reduces risks and lessens the effects on the environment and public health by allowing for prompt responses to ecological imbalances, pollution incidents, and natural disasters. Decision-making and analysis can be done in real time when Artificial Intelligence (AI) is integrated with Unmanned Aerial Vehicles (UAV) technology. With the help of these technologies, environmental monitoring is made possible with a more complete and effective set of tools for assessment, analysis, and reaction to changing environmental conditions. Multiple studies have shown that forest fires in India have been happening more often recently. Lightning, extremely hot weather, and dry conditions are the three main elements that might spontaneously ignite a forest fire. Both natural and man-made ecosystems are affected by forest fires. Forest fire photos are pre-processed using the Sobel and Canny filter. A Convolutional Neural Network (CNN)–based Forest Fire Image Classification Network (DFNet) using the publicly accessible Kaggle dataset is proposed in this study. The suggested DFNet classifier's hyperparameters are fine-tuned with the help of Spotted Hyena Optimizer (SHO). With a performance level of 99.4 percent, the suggested DFNet model outperformed the state-of-the-art models, providing substantial backing for environmental monitoring.

Bearings on Classroom Assessment Practices: From Perception to Practice

This study examines the assessment strategies and practices at Oran 2 University, Algeria. It attempts to explore the impact of assessment procedures on learners’ motivation and academic achievements. This research adopted a mixed-methods case study design wherein both quantitative and qualitative data collection and analysis procedures were used to explore tertiary teachers’ assessment strategies while assessing their learners’ competencies. A random sample of 30 tertiary teachers formed the target population during the first semester of the academic year 2022. Findings reveal that some teachers continue to rely on a limited set of assessment tools as the sole means of evaluation to meet the diverse needs of their learners. However, the study also highlights that teachers also showed a good understanding of the necessary knowledge and training required before implementing assessment tools to provide students with the necessary feedback. The results also indicate an essential need for in-service training, pedagogical support, and professional development to meet the challenges identified by teachers in adapting and maintaining effective assessment practices at all levels of tertiary education.

The "zorgkassen": a unique access point to social health insurance in Flanders

In Flanders all citizens with a care need can apply for a health care budget to assist them in the extra expenses they face due to their precarious health and social circumstances. The “zorgkassen” are the single point of contact for the Flemish social protection. This means they act as the single access point for all questions concerning both professionals and citizens. These questions concern not only billing but also care requests about the Flemish social protection. The main purpose of this system is making care in Flanders financially accessible. The “zorgkassen” also collect the solidarity contribution every Flemish citizen contributes obligatory to the system. With these contributions and government funding, the “zorgkassen” can support defined groups through care budgets. 
 During the presentation we will show how this system of a unique access point and the sectors involved contribute towards integrated care. Through a client’s testimonial, we will show why the care budget makes a difference and also allows citizens to live longer at home.
 THE SINGLE POINT OF CONTACT
 This single point of contact put into pratice, the ""zorgkassen"" are responsible for: applications, disbursements, information about an individual case and the rights in the different parts of Flemish social protection. It makes procedures to open social rights within the system as clear and simple as possible for the citizens as well as the sector and the government. Even though ”zorgkassen” are focusing on digitalisation, they remain physically accessible to citizens at the same time. 
 Some examples of how the ”zorgkassen” contribute towards integrated care:
 
 The use of Interrai instruments (‘BelRai’)’ to identify the care needs of vulnerable people in a standardized way through one set of assessment tools: 
 
 The data are registered electronically which facilitates the exchange of information between different care actors, such as between facilities or institutions and individual care actors. Research is pending to investigate the implementation of BelRai as a case mix financing tool.
 Example: with a total score of at least 13 points on the BelRai Screener, you qualify for a care budget.
 
 
 Equal treatment for all citizens by automatically granting social rights: 
 
 By digitalising the various parts of the Flemish social protection, the “zorgkassen” can maximize their commitment to automatically granting social rights. The single point of contact has all the information on an individual case, allowing applications to be handled more efficiently and transparently. 
 Example: Residents staying in a residential care center in Flanders are automatically entitled to a care budget. 
 
 Another example for which the “zorgkassen” are the single point of contact: funding the multidisciplinary client meetings 
 
 A multidisciplinary client meeting is requested when the care becomes too complex and additional coordination between the person, the informal care and the care team is needed. The multidisciplinary client meeting is a method that helps facilitate integrated care in practice and helps build the bridge between care and welfare.

Wearable Internet of Things Gait Sensors for Quantitative Assessment of Myers–Briggs Type Indicator Personality

Gait is a typical habitual human behavior and manifestation of personality. The unique properties of individual gaits may offer important clues in the assessment of personality. However, assessing personality accurately through quantitative gait analysis remains a daunting challenge. Herein, targeting young individuals, standardized gait data are obtained from 114 subjects with a wearable gait sensor, and the Myers–Briggs Type Indicator (MBTl) personality scale is used to assess their corresponding personality types. Artificial intelligence algorithms are used to systematically mine the relationship between gaits and 16 personality types. The work shows that gait parameters can indicate the personality of a subject from the four MBTI dimensions of E‐l, S‐N, T‐F, and J‐P with a concordance rate as high as 95%, 96%, 91%, and 91%, respectively. The overall measurement accuracy for the 16 personality types is 88.16%. Moreover, a personality tracking experiment on all the subjects after one year to assess the stability of their personality is also conducted. This research, which is based on a smart wearable Internet of Things gait sensor, not only establishes a new connection between behavioral analysis and personality assessment but also provides a set of accurate research tools for the quantitative assessment of personality.

Development of a Set of Assessment Tools for Health Professionals to Design a Tailored Rehabilitation Exercise and Sports Program for People with Stroke in South Korea: A Delphi Study

Development of a Set of Assessment Tools for Health Professionals to Design a Tailored Rehabilitation Exercise and Sports Program for People with Stroke in South Korea: A Delphi Study

Acute Hearing Deficits associated with Weapons Exposure inSection734 Blast Overpressure Study (BOS).

This prospective, multi-site, observational study describes ongoing efforts in support of the Fiscal Year 2018 National Defense Authorization Act (NDAA) Section734 Blast Overpressure Study (BOS) to identify the acute effects impulse and blast exposure have on hearing abilities of the Warfighter in various military training environments. Hearing thresholds, a binaural tone detection task, and auditory symptoms were collected before and immediately following weapons exposure across nine military training environments from January 2020 to October 2022. An additional 25 non-exposed control participants also completed the behavioral test battery. A boothless audiometer was used to measure hearing ability in the field. Sound level meters were attached on-body to record the exposure environment throughout training. Mean threshold change for the blast-exposed group was worse than the control group. Of the 188 blast-exposed participants, 23 experienced a temporary threshold shift (TTS) acutely after exposure. A decrease in binaural tone detection performance and increased symptom severity was found when comparing blast-exposed participants with a TTS versus those without a significant change in hearing. A complex but consistent relationship between measured exposure level (LAeq8hr) and the magnitude of the resulting TTS is suggested in the available data. Recent discussions on Section734 studies examining the effects of repetitive blast exposure have indicated that hearing-related issues were a critical problem that needed additional research. Study outcomes provide highly repeatable results across various weapons systems with hazardous blast exposure. This standardized set of hearing assessment tools for evaluating acute effects of noise under field conditions has been critically important in improving our understanding of TTS in prospective human subject research.

Formative behavioral assessment across eight constructs: Dependability of direct behavior ratings and formative behavior rating measures

Due to their promise as a feasible tool for evaluating the effects of school-based interventions, Direct Behavior Ratings (DBR) have received much research attention over the past 2 decades. Although DBR methodology has demonstrated much promise, favorable psychometric characteristics only have been demonstrated for tools measuring a small number of constructs. Likewise, although a variety of methods of DBR have been proposed, most extant studies have focused on the use of single-item methods. The present study examined the dependability of four methods of formative behavioral assessment (i.e., single-item and multi-item ratings administered either daily [DBR] or weekly [formative behavior rating measures or FBRM]) across eight psychological constructs (i.e., interpersonal skills, academic engagement, organizational skills, disruptive behavior, oppositional behavior, interpersonal conflict, anxious depressed, and social withdrawal). School-based professionals (N = 91; i.e., teachers, paraprofessionals, and intervention specialists) each rated one student across all eight constructs after being assigned to one of the four assessment conditions. Dependability estimates varied substantially across methods and constructs (range = 0.75–0.96), although findings of the present study support the use of the broad set of formative assessment tools evaluated.

Development and analysis of quality assessment tools for different types of patient information – websites, decision aids, question prompt lists, and videos

ObjectiveOur working group has developed a set of quality assessment tools for different types of patient information material. In this paper we review and evaluate these tools and their development process over the past eight years.MethodsWe compared the content and structure of quality assessment tools for websites, patient decision aids (PDAs), question prompt lists (QPLs), and videos. Using data from their various applications, we calculated inter-rater concordance using Kendall’s W.ResultsThe assessment tools differ in content, structure and length, but many core aspects remained throughout the development over time. We found a relatively large variance regarding the amount of quality aspects combined into one item, which may influence the weighting of those aspects in the final scores of evaluated material. Inter-rater concordance was good in almost all applications of the tool. Subgroups of similar expertise showed higher concordance rates than the overall agreement.ConclusionAll four assessment tools are ready to be used by people of different expertise. However, varying expertise may lead to some differences in the resulting assessments when using the tools. The lay and patient perspective needs to be further explored and taken into close consideration when refining the instruments.

A multi-source behavioral and physiological recording system for cognitive assessment

Cognitive assessment has a broad application prospect, including estimate of childhood neuro development and maturation, diagnosis of neurodegenerative diseases, and selection for special profession. With the development of computer technique and behavioral recording sensors, the method of cognitive assessment has been replaced from paper scale test to human–computer interaction. We can not only obtain the results of tasks, but also make it possible to acquire multiple behavioral and physiological data during the task. However, there is still a strong challenge of recording multi-source data synchronously during multi-dimensional cognitive assessments. Therefore, we built a multi-source cognitive assessment system can record multi-pattern behavioral and physiological data and feedback at different spatiotemporal levels. Under this system, we developed a multi-source diagnostic toolset for cognitive assessment, including eye tracking, hand movement, EEG and human–computer interaction data during the cognitive task. 238 participants with different mental disorders were assessed using this system. The results showed that our diagnostic toolset can be used to study the behavioral abnormalities of patients with mental disorders through the characteristics of multi-source data. Furthermore, this system can provide some objective diagnostic criteria such as behavioral characters and EEG features for diagnosis of mental disorders.

Optimized image registration algorithm at subpixel level for Geostationary Operational Environmental Satellite-R Advanced Baseline Imager navigation and registration performance assessment

The image navigation and registration (INR) performance assessment for the Geostationary Operational Environmental Satellite-R (GOES-R) Advanced Baseline Imager (ABI) is an image registration process at the subpixel level, which involves the registration of images from GOES-R ABI with corresponding images from Landsat at the same scene. We present an optimized image registration algorithm for GOES-R ABI INR performance assessment (GAIPA): a gradient descent algorithm with a Sobel edge-enhancement procedure and a normalized lookup table (NLUT) image transformation (GDSN), which is an area-based image registration approach with Pearson correlation as the similarity metric. Sobel edge enhancements increase the sensitivity of Pearson correlations that lead to much improved registration accuracy. NLUT transformations minimize radiance differences between GOES-R ABI images acquired at different times and Landsat reference images on image registration outcomes, which lead to improvements in correlation values and quality of image registration outputs. Evaluations of registration accuracy and quality metrics in GDSN show considerable improvements in computational efficiency, registration accuracy, and quality over the approach implemented on the image INR performance assessment tool set. Pearson correlations can be effective and robust similarity metrics in image registration at the subpixel level with implementing Sobel edge enhancement and NLUT transformation. The statistical analysis of the image registration outputs for GAIPA shows the new algorithm provides considerable improvements in reducing the uncertainties in the registration outputs.

Body Uneasiness, Body Figure Perception, and Body Weight: Factor Structure and Longitudinal Measurement Invariance of a Set of Attitudinal and Perceptual Body Image Assessment Tools in Adolescents.

Body image is a multifaceted construct that includes attitudinal and perceptual components, but its attention has mainly been focused on the facet of body dissatisfaction. The present longitudinal study extended the validation of a multifacet attitudinal questionnaire, the Body Uneasiness Test (BUT), against perceptions of body shape and weight. A convenient sample of adolescents took part in a 2-year unbalanced panel study (5 waves). The participants completed the BUT questionnaire and selected their perceived actual, ideal, and reflected body figures along the Contour Drawing Rating Scale; ideal/actual and ideal/normative body mass index discrepancies were also included. After replicating the expected five-factor structure of the BUT items, results from confirmatory factor analysis revealed that the five BUT scales loaded on an attitudinal dimension, whereas the perceived body figures and the discrepancy indices were on a perceptive domain. Such a two-domain structure of body image measures showed gender and seasonal (1-year) measurement invariance, whereas longitudinal 6-month and 18-month invariance partially failed. Overall, the present findings support the validity of the Body Uneasiness Test in adolescence, further demonstrating a preliminary multidimensional structure of body image onto which attitudinal and perceptual body image-related measures were projected.

Data Combination: Interferometry and Single-dish Imaging in Radio Astronomy

Modern interferometers routinely provide radio-astronomical images down to subarcsecond resolution. However, interferometers filter out spatial scales larger than those sampled by the shortest baselines, which affects the measurement of both spatial and spectral features. Complementary single-dish data are vital for recovering the true flux distribution of spatially resolved astronomical sources with such extended emission. In this work, we provide an overview of the prominent available methods to combine single-dish and interferometric observations. We test each of these methods in the framework of the CASA data analysis software package on both synthetic continuum and observed spectral data sets. We develop a set of new assessment tools that are generally applicable to all radio-astronomical cases of data combination. Applying these new assessment diagnostics, we evaluate the methods’ performance and demonstrate the significant improvement of the combined results in comparison to purely interferometric reductions. We provide combination and assessment scripts as add-on material. Our results highlight the advantage of using data combination to ensure high-quality science images of spatially resolved objects.

Software-Based Supplementary Materials in MAPEH for Enhanced Learning Resource Management and Delivery System

The study aimed to determine the effectiveness of a software-based supplementary material in MAPEH in enhancing the learning resource management of the said subject and ultimately, enriching learners’ performance in MAPEH. The respondents were 160 students from JHS in Pagbilao National High School, Division of Quezon, stratified sampling was used due to the existing classification per grade level. The study used mixed-method research and utilized experimental, descriptive-evaluative, and phenomenological research designs to come up with the findings and analyses of data. A set of assessment tools as well as a survey questionnaire were used to observe the effectiveness of software-based supplementary material in MAPEH. Data were analyzed using frequency, percentage, t-test, Pearson correlation coefficient, and phenomenological. The salient findings of the study are summarized as follows: Student’s pre-test results were low while; the overall mean of post-test was high. The Test of correlation between the effectiveness of software-based supplementary materials and the perception of the respondents was found to be Very effective. There were significant differences between the pre and post-assessment tests after the utilization of the software-based supplementary materials in MAPEH. The study recommends that the DepEd officials may help the teachers who intend to replicate the creation of software-based supplementary material to seek assistance from software creators. Keywords: software-based supplementary materials, competency, learning resource management, delivery system

Evaluation of Conversational Skills in Children with Intellectual Disability and Their Mothers’ Parenting Styles

Background: Non-specific intellectual disability (ID) with a prevalence of approximately 1% is relatively common and has profound negative effects on language development. However, it has received little research attention, especially regarding conversational skills. Developing methods to detect, assess, and categorize conversational skills has created major challenges for speech-language pathologists due to their importance as part of adaptive behaviors in children with ID. Objectives: The present study aimed to examine pragmatic skills through a socio-conversational model, as well as to define the parenting styles of their mothers accordingly. Methods: A total of 21 children with ID enrolled in preschool-grade 2 were included in this study. A comprehensive set of language assessment tools, including the Test of Language Development-Persian: 3 (TOLD-P):3, Conversational Rating Scale, Vineland Social Growth Scale, and Socio-Conversational Analysis of interaction between child-mother was administered. The descriptive indices, including mean, standard deviation (SD), and percentiles were computed using SPSS-24. The Spearman-rho was applied to search for possible correlation between conversational skills and general language indices. Results: The Means for non-verbal age (based on Leiter test) and chronological age were 4.43 and 7.98 years, respectively. According to the composite scores of the TOLD-P:3, children with ID scored below 69, except for semantics. Their language age for eight subscales of the TOLD-P:3 was 3:04, but it was 5:38 for word articulation. The mean ± SD for different variables were: MLU = 1.95 ± 0.88, TTR = 0.64 ± 0.16, the number of total sentences = 14.52 ± 13.35, and the percentage of complex sentences = 19.71 ± 39.94. Over 60 percentages of the participants scored below average in social growth scale. All children scored as “no or infrequent pragmatic skills” or “pragmatic skills are emerging” in the Conversational Rating Scale. Two-thirds of the mothers had “authoritarian” parenting style. Conclusions: A remarkable delay in language skills, especially in conversational skills of children with non-specific ID, was found and highlighted. The most common parenting style was detected to be controlling style; due to the limitations of our study, however, no definite conclusion was drawn concerning the causal relationship between parenting style and children’s language delays. Children with ID played different roles during interaction, but most of them were inclined to be “passive conversationalist”.