Development Of Assessment Instrument Research Articles

Violence Risk Assessment Tools Used in Forensic and Acute Psychiatry in North America: A Scoping Review

Violence in psychiatric settings presents a significant risk to patients, staff, and society at large. With over 400 risk assessment tools available globally, their applications and the risks they assess vary, allowing for diverse use in different situations. This scoping review investigated the risk management tools utilized in North America’s forensic psychiatry and acute psychiatric units, aiming to identify which ones are mainly used. A comprehensive search was conducted across PubMed, Embase, and PsycINFO databases, following PRISMA Guidelines, covering the literature from their inception date until 2023. Criteria for study inclusion required a focus on risk management tool use in forensic or acute psychiatric settings, originality (original studies, case reports, or systematic reviews), and a North American context. Out of 3059 identified studies, 40 were thoroughly analyzed. Commonly used risk assessment scales include HARM-FV, eHARM-FV, HCR-20, PCL-R, START, BVC, and DASA, with their reliability varying by the clinical context and the assessed population. The review highlights the heterogeneous application of static and dynamic scales across clinical settings, underscoring a need for more precise tools to improve risk assessments in forensic psychiatry, signaling a call for the development and validation of more sophisticated assessment instruments.

Research Trends in Assessment Instrument Development in Vocational High Schools: a Literature Review

Research on evaluation instruments in Vocational High Schools (SMK) indicates a varied pattern. Nevertheless, there has been limited study and evaluation of the information provided in the research. This study seeks to examine research trends on the development of assessment instruments in SMK, based on published articles from 2019 to 2024, with a primary emphasis on the development of these instruments. The methodology employed is a literature review. This study involved a literature evaluation of 25 publications regarding developing assessment tools from various Indonesian journals, utilizing Publish or Perish and Google Scholar for data collection. The research indicated a decline in the number of studies addressing the creation of evaluation tools in vocational schools from 2019 to 2024. The R&D model is the predominant development model. Instruments for assessing knowledge are predominantly created. The creation of HOTS-based assessment tools exhibits a nearly equitable distribution. Moreover, the creation of evaluation tools predominantly lacks technological platforms.

Analysis of Assessment Instrument Needs to Measure Students Critical Thinking Skills and Self-Efficacy in Physics Learning

This research is a preliminary study that aims to determine the needs of teachers and students in the learning process, especially in the material of particle motion dynamics. The research method chosen was a survey, which was conducted on 20 physics teachers and 30 high school students in the MIPA field in Lampung Province using Google Form. The collected data were then curated and analyzed to identify and address educational needs. The results of the data analysis showed a demand for assessment instruments that can measure critical thinking skills and self-efficacy in physics learning. According to the survey, 45% of teachers never assess critical thinking skills and 60% of teachers never assess self-efficacy. Teachers do not apply because of the lack of examples or instruments owned to assess critical thinking skills and self-efficacy. Teachers also do not have assessment instruments that are easy, practical, and appropriate during the learning process. Physics learning assessment at school has not optimized critical thinking skills well, so critical thinking skills are still low, and self-efficacy is still an obstacle. Therefore, the development of assessment instruments to measure critical thinking skills and student self-efficacy in physics learning is very important.

Development of a Learning Style Diagnostic Assessment Instrument Based on Experiential Learning Theory

Development of a Learning Style Diagnostic Assessment Instrument Based on Experiential Learning Theory

Rasch Model Analysis to Develop Assessment Instruments for Student's Science Process Skills on Chemical Bonding Material

The assessment of student's science process skills (SPS) on chemical bonding material in schools does not yet meet the learning outcomes of the Merdeka curriculum, because the instruments used by teachers are more focused on knowledge aspects. The purpose of this research is to develop an assessment instrument for science process skills in the topic of chemical bonding. The type of this research is Research and Development (R&D) using the Rasch model modified by Liu. This research produced 18 questions tailored to the number of learning objectives in the chemical bonding material and the indicators of scientific process skills in the Merdeka curriculum, which consist of 1) observing, 2) questioning and predicting, 3) planning and conducting investigations. 4) processing, analyzing data and information, 5) evaluating and reflecting, and 6) communicating results. The logical validity test was conducted by 5 validators consisting of 3 chemistry lecturers from FMIPA UNP and 2 chemistry teachers from State Senior High School (SMAN) 1 Banuhampu. The raw validation data were analyzed using Minifaced software, which showed that the data were valid according to the model. The raw trial data on 60 students from SMAN 1 Banuhampu were analyzed using Ministep, showing that all questions met the criteria of being valid, reliable, and having good difficulty and discrimination indices according to Rasch. These results indicate that the developed instrument is effective in measuring students' SPS on chemical bonding material and can be used to support learning based on a scientific approach.

PENGEMBANGAN INSTRUMEN PENILAIAN THREE-TIER MULTIPLE CHOICE UNTUK MENGUKUR KETERAMPILAN BERPIKIR KRITIS SISWA PADA MATERI TERMOKIMIA

The purpose of this study is to develop a three-level multiple choice assessment instrument to measure critical thinking skills of students at SMA Negeri 5 Bengkulu City on thermochemical material. The development model used is the ADDIE model. The research subject is class XI MIPA 4 at SMA Negeri 5 Bengkulu City in the academic year 2022/2023. The research data were obtained from needs analysis, expert validation sheets, empirical test analysis, reliability, difficulty level, discriminatory power, distractor analysis, and analysis of students' critical thinking skills. The number of instruments developed is 20 three-tier multiple choice questions. The results of the study: (1) The three-level multiple choice test instrument on the thermochemical material developed was declared valid by the validator with a minimum CVR value of 0.78 and a CVI value of 0.91 with a very good category (2) The results of the empirical validity test carried out on 68 students and obtained 14 valid questions (3) A three-level assessment instrument with several choices that can be used to measure students' thinking skills (4) The results of the implementation of developing critical thinking skills instruments obtained 2 students with very critical categories, 2 students with critical categories, 16 students in the moderately critical category, 13 students in the less critical category, and 1 student in the uncritical category. (4) The results of the development of the three-tier multiple choice assessment instrument can be used to measure students' critical thinking skills.

Development of Honesty Attitude Assessment Instruments for Junior and Senior High School Students

Development of Honesty Attitude Assessment Instruments for Junior and Senior High School Students

Pengembangan Instrumen Asesmen Kompetensi Minimum Numerasi pada Domain Data dan Ketidakpastian untuk Siswa SMP

This study aims to produce valid and practical minimum competency assessment instrument. This study uses the research and development (R&D) of the ADDIE model. The subjects of this study consisted of 32 students in grades VIII SMP Negeri 1 Anyar. The instruments used consisted of expert validation sheets, student response questionnaires, and minimum competency assessment instrument. The data analysis techniques in this study are quantitative analysis and qualitative analysis. Based on the results of research and development of the minimum numeracy competency assessment instrument in the uncertainty and data domain for junior high schools, it was concluded that two questions were very valid, five questions were valid, and one question was invalid. Based on the power of differentiation, invalid questions can be revised or do not need to be used. Meanwhile, the results of the student response questionnaire were obtained by 84%, meaning that it included very practical criteria with 83% for the content aspect, 80% for the construction aspect, and 90% for the language aspect. Thus, this minimum competency assessment instrument can be used in mathematics learning.

Development and psychometric evaluation of the ethical conflict assessment instrument in nursing: A mixed-method protocol study

BACKGROUND: Ethical conflict among nurses has a significant impact on their health and the quality of nursing care. The lack of specific ethical and legal signs and obstacles for reporting ethical conflict in nurses has made diagnosis and the management of its negative consequences difficult. This study aims to develop a valid, reliable, evidence-based instrument to assess the ethical conflict of nurses in the sociocultural and managerial context of Iran. MATERIALS AND METHODS: This is an exploratory mixed-method study that will be conducted using a sequential qualitative–quantitative design (QUAL → quan) consisting of four sequential phases to develop the instrument. In the first phase, a qualitative study (semistructured interview) will be conducted to explain nurses’ experiences and perceptions of ethical conflict. In the second phase, a literature review, along with textual content analysis, will be used. In the third phase, the items will be developed and the primary instrument will be designed based on the findings of the qualitative study and the literature review by a panel of experts. Finally, in the fourth phase, the psychometric properties of the Instrument, including validity (face, content, construct, and criterion validities) and reliability (internal consistency and stability) are evaluated. CONCLUSION: The findings of our study will enrich the description of ethical conflict in nursing and will facilitate advancing research in ethical conflict in nursing, a new but important concept in Nursing management. Thus, laying the groundwork for more targeted and effective knowledge-translation interventions in the future.

PENGEMBANGAN INTRUMEN PENILAIAN PENDIDIKAN AGAMA ISLAM

Effective assessment in learning is a key element in determining the success of educational goals. This study aims to explore more deeply the development of Islamic Religious Education assessment instruments. This study uses a library research approach, meaning that researchers only deal directly with sources available in the library such as articles, books and others, from these data sources researchers present a deep understanding of the development of Islamic Religious Education assessment instruments. The significance and novelty of the development of Islamic Religious Education assessment instruments emphasizes 1) the integration of socio-spiritual attitudes, knowledge, and skills that were previously more focused on the spiritual dimension alone, now shifting the paradigm of Islamic Religious Education learning from a doctrinal approach to an integrative approach that is relevant to the needs of students in the modern era. 2) Emphasis on the implementation of Islamic values ​​in practice, the application of Islamic teaching values is not just a theoretical understanding but also links Islamic Religious Education learning with critical and applicable thinking skills based on the teachings of the Qur'an and Hadith. 3) There is a relationship between character education and Islamic civilization, this strengthens the relevance of learning Islamic Religious Education in the global context and its contribution to building a civilized society.

Measurement of Science Literacy Skills of Elementary School Teacher Education Students: Development and Validity Testing of Assessment Instruments

This study aims to develop and test the validity and reliability of a scientific literacy instrument for students of the Elementary School Teacher Education (PGSD) Program. The instrument was designed to measure three dimensions of scientific literacy: content knowledge, procedural knowledge, and epistemic knowledge, focusing on Earth and Space Science topics. A total of 18 questions were constructed based on indicators that assess the ability to explain scientific phenomena, evaluate scientific investigations, and interpret scientific data. The instrument was tested on 33 PGSD students at Universitas Sebelas Maret (UNS) and analyzed using the Content Validity Index (CVI) and reliability tests via SPSS software. The results indicated that most items were valid, with an S-CVI/Ave value of 0.981 and an S-CVI/UA value of 0.8333. However, one item was found invalid with an I-CVI score of 0.67. The reliability test showed that some questions had a good level of reliability, while others required revision due to low reliability. Additionally, analysis using the Item Response Theory (IRT) revealed that the questions varied in difficulty and discrimination, with most questions having positive discrimination values and a range of difficulty levels. Overall, the instrument was found to be valid and reliable for assessing the scientific literacy of PGSD students, although some questions need revision to improve consistency and accuracy.

Shared decision-making in long-term care: A systematic review of assessment instruments

This systematic review explored the instruments used to measure Shared Decision Making (SDM) within long-term care (LTC) settings. Relevant publications from the period between January 2000 and October 2022 were searched across five databases. Thirty-six SDM assessment instruments were identified, which encompassed those measuring SDM for LTC recipients/family caregivers and/or healthcare providers. These instruments were either specifically tailored for LTC settings or more broadly applicable across healthcare contexts, including LTC. In terms of psychometric properties of the instruments, internal consistency reliability, content validity, structural validity, and hypothesis testing were commonly tested. The findings of this research can aid health researchers, managers, and scholars in choosing suitable instruments for assessing SDM in specific LTC scenarios, considering factors such as measurement scope, assessment methods, and instrument reliability. Additionally, these findings offer valuable insights for the future development of high-quality SDM assessment instruments in LTC field.

Some hope for a dimensional assessment? A critical review of psychometric validated (semi-)structured interview to assess eating disorders.

Given that eating disorders (EDs) are considered one of the deadliest mental illnesses, the development of appropriate assessment instruments is a necessity. Despite the extensive literature on assessing EDs, there has been a lack of focus on semi-structured interviews. The purpose of this article is to provide a comprehensive review of psychometrically validated semi-structured interviews for EDs. Included studies (N=24) were required to present a semi-structured interview for EDs that has been validated through a psychometric process. The APA PsycNet, MEDLINE, APA Psycinfo, Pubmed, and Health & Psychosocial Instruments databases were searched. The literature search included publications through May 2024, with no earliest year restriction. A total of six instruments were identified and reviewed in terms of conceptual design, purpose and content, psychometric characteristics, and strengths and limitations. Three main findings were highlighted: (a) only half of the instruments are up to date; (b) the instruments are based on either a categorical or a mixed categorical-dimensional approach; and (c) the predominance of the categorical approach. The results are discussed regarding the conceptual approaches of the instrument to provide clinical and research implications. Despite the many strengths of the instrument, additional psychometric research is needed.

Development of Assessment Instruments with a Contextual Approach to Determine the Profile of Conservation Education and Learning Independence on Biodiversity

Conservation education is one of the noble values that must be preserved and students can maintain the sustainability of biodiversity around them. This study aimed to develop an assessment instrument to determine the profile of conservation education and learning independence on biodiversity. This type of research is R D with a 4-D model. The population of the study is all students of grade 10 of State Senior High School 1 Godean and the samples used are grade 10D and 10F. The data collection technique used a five-question essay instrument sheet to determine conservation education and a Guttman scale questionnaire instrument to determine learning independence. The analysis technique used descriptive quantitative and qualitative. The results of this study were that the instrument was said to be good with revisions according to the construct validator. The validity of the question items showed that the essay questions were said to be valid, reliable, had a discriminatory power between good enough, and the difficulty level ranged from easy to moderate according to the empirical validator. The value of students' conservation education fell into the good category with a complete value achievement of 73%. Students' learning independence is also classified as very high, because all indicators are dominated by very high indicators. These results indicate that the profile of conservation education and learning independence of students at State Senior High School 1 Godean is classified as good and very high

Development of assessment instrument business proposal for students' systems thinking skills on business model canvas in bioentrepreneurship course

Business Model Canvas (BMC) is a business model that must be mastered by students in the Bioentrepreneurship course as an initial provision for entering the entrepreneurial world, while in compiling Business Model Canvas (BMC) systematic thinking skills are needed. This study aims to provide an assessment instrument to measure students' system thinking skills in Business Model Canvas (BMC) material. The method used in this research is exploratory mixed method with exploratory sequential design stages. The participants involved were 40 students of Biology study program who contracted Bioentrepreneur course in one of the universities in Bandung City. The instrument was developed in the form of an assessment rubric with 29 indicators of systems thinking skills in Business Model Canvas. The quality of the instrument with validity based on expert judgment obtained a value of 89.3% with a very valid category, and the quality of the instrument with inter-rater reliability based on Cronbach's Alpha value obtained a value of 0.762 to 1.000 which is categorized as very good. Students' system thinking skills can emerge and be measured in the creation of a Business Model Canvas (BMC) in a business proposal by using the developed assessment instrument. So that the novelty in this study is that the assessment instrument of students' system thinking ability in making Business Model Canvas is declared valid and feasible for use in Bioentrepreneurship courses.

Participative development of a culture-sensitive instrument to measure substance use in Syrian refugees

Abstract Background Rarely assessment instruments have been developed with end users such as refugees or those suffering from mental health conditions. Refugees’ experiences pre-, during, and post-flight are associated with various mental health problems including substance use disorders. Systematic reviews on the prevalence of substance use disorders in refugees worldwide show heterogeneous results. To address possible misclassification due to the lack of refugee-sensitive instruments we aimed to develop a refugee-sensitive instrument. Methods We applied a three-step triangulation study design. First, we conducted a three-stage delphi-process in 2019 and 2020. We recruited Syrian medical doctors for the study. Second, we conducted six focus group discussions with Syrian refugees and medical doctors. Third, we conducted expert checks with medical doctors and professionals providing psycho-social services for refugees. For all focus group discussions, audio recordings were translated and transcribed. Computer-assisted thematic analysis was performed applying a deductive approach with semantic coding. Results The refugee-sensitive instrument consists of seven domains of substance use: lifetime use of relevant types of substances, frequency, intensity, self-perception of, and situations posing a risk for substance use, ability to perform, craving, tolerance, and intentions to reduce or quit substance use. Discussion The instrument has been developed qualitatively, however, a limitation is that it could not be validated in a quantitative large sample of refugees. In spite of this limitation, this is - to the best of our knowledge - the first instrument that has been developed in a participatory approach together with end-users. Outlook The study suggests that developing assessment instruments in a participatory approach is feasible. Participatory development of assessment instruments is in line with the new paradigm of co-creation of mental health conditions management.

Development of Diagnostic, Formative and Summative Assessment Instruments in the PjBL Model to Stimulate Students' Critical and Creative Thinking Skills

It is hoped that current education can produce human resources who have strong critical and creative thinking abilities. Students must have critical and creative thinking skills to be able to solve problems efficiently and effectively. The benchmark for determining student success in learning is through evaluation which includes measurements and assessments. The aim of this research is to develop diagnostic, formative and summative assessment instruments in the PjBL model to stimulate critical and creative thinking skills. This type of research is research & development using the ADDIE model. The results of this research obtained the validity of the assessment instrument in the project based learning model with a valid category. The level of practicality of the assessment instrument was categorized as practical by teachers and students. The results of the effectiveness of the knowledge aspect with the results of the pretest and posttest are seen from the classical completeness of each skill which has reached a level of completeness above the minimum expected score. The N-Gain value shows results that meet the high criteria.

Development of Diagnostic, Formative and Summative Assessment Instruments in the PjBL Model to Strengthen the Profile of Pancasila Physics Students

This research has two purposes. The first is to develop a diagnostic, formative and summative assessment tool using the Project Based Learning (PjBL) model to strengthen the profile of Pancasila physics students. The second is to examine the validity and usability of the developed assessment tool. The first objective outcome is the product of assessment tools in the form of activity and assessment sheets. The outcome of the second objective is to obtain a valid and practical assessment tool that strengthens the student profile of Pancasila. The conclusion from the development of this tool is that the tool developed in the form of activity and assessment pages is practical and suitable for use in the classroom to strengthen the profile of Pancasila physics students.

Understanding the Concept of Patient Safety Culture: Constitutive and Operational Definitions for Health Care Organizations.

Patient safety culture is crucial for improving health care quality, however, there is no consensus on its definition. This study aimed to clarify and update the concept of patient safety culture. We employed Norris' 6-step concept clarification method. The content was organized through a scoping review of 4 databases. Twelve health professionals participated in focus groups and 10 experts participated in content validation. The content validity coefficient (CVC) was calculated for agreement between experts. Three patient safety culture domains were identified: organizational, professional, and patient and family participation. The experts rated the definitions favorably, with high CVC scores (>0.87), indicating good agreement. The operational definitions were reduced from 76 to 54 items after expert evaluation. An updated definition of patient safety culture is provided, which can inform development of assessment instruments by managers and health care professionals.

Development and validation of assessment instruments for cervical collar and spinal board placement in simulated environments for nursing students in the care of polytrauma patients

BackgroundMultiple trauma injuries are the leading cause of death and disability in people under the age of 45 and require prompt and specialised care. However, medical and nursing education programmes do not always include specific training in emergency pre-hospital care, resulting in a lack of basic practical skills in trauma management.ObjectiveTo develop and validate two instruments for assessing nursing students’ competence in cervical collar and spinal board application in simulated pre-hospital emergency scenarios.MethodThis is an instrumental study that involves the development of two assessment instruments and the evaluation of their psychometric properties in a sample of 392 nursing students. Content validity was assessed using expert judgement, by calculating the content validity ratio (CVR) for each item and the scale level content validity index average (S-CVI/Ave) for the instruments. Exploratory factor analysis using the MINRES extraction method and Promax rotation was performed to analyse the performance of the items and structure of the rubrics. Internal consistency was analysed using the Omega coefficient and inter-rater agreement was assessed using Cohen’s Kappa coefficient.ResultsInitially, two rubrics were obtained: one with six items for cervical collar placement (S-CVI/Ave = 0.86) and one with nine items for spinal board placement (S-CVI/Ave = 0.81). Both had a single-factor structure, with all items having factor loadings greater than 0.34 for the cervical collar rubric and 0.56 for the spinal board rubric, except for item 2 of the cervical collar rubric (λ = 0.24), which was subsequently removed. The final cervical collar rubric (five items) had an overall internal consistency of 0.84 and the spinal board rubric had an overall internal consistency of 0.90, calculated using the Omega statistic. The weighted Kappa coefficient for each item ranged from acceptable (0.32) to substantial (0.79). These results show that we have successfully developed two sufficiently valid instruments to assess the immobilisation competencies proposed in the objective of the study.ConclusionWhilst further research is needed to fully establish their psychometric properties, these instruments offer a valuable starting point for evaluating nursing students' competence in cervical collar and spinal board application in simulated pre-hospital scenarios.