Questionable Validity Research Articles

DEVELOPING HOTS-BASED MATHEMATICS ASSESSMENT INSTRUMENTS TO IMPROVE CRITICAL THINKING SKILLS OF PROSPECTIVE ELEMENTARY SCHOOL TEACHERS

The current reality is that most teachers have not developed their students' Higher Order Thinking (HOTS) skills. This is because the teachers themselves do not understand HOTS well. This research aims to develop HOTS-based mathematics assessment instruments for prospective elementary school teachers. The type and model of research conducted is research and development (R n D), Borg & Gall model. The product developed is a 10-item HOTS question. The questions that have been compiled are validated by three validators. Valid questions were tested on students who took Mathematics Learning courses. The trial was conducted with the aim of determining the quality of the instrument using classical test theory, namely validity, reliability, difficulty index, and distinguishing power. The results showed that the HOTS-based mathematics assessment instrument met the criteria of a quality instrument, namely very valid, high reliability, with good differentiation and difficulty levels. Thus, the instrument developed is suitable to be used to measure the HOTS ability of prospective teacher students. From the results of the test analysis, it was found that the students' ability to solve HOTS-based problems obtained an average of 74.65 was in the moderate category and the results of the analysis of students' critical thinking skills obtained 62.89% also in the moderate category. So it can be concluded that students' ability to solve HOTS-based questions is directly proportional to students' critical thinking skills. Thus, it can be concluded that HOTS-based assessment instruments can improve the critical thinking skills of prospective elementary school teachers.

Design and evaluation of UltRASim: An immersive simulator for learning ultrasound-guided regional anesthesia basic skills

Virtual reality shows great promise as a technology for training healthcare professionals within a secure simulated environment. This work presents the design, development, and assessment of UltRASim: an immersive simulator for ultrasound-guided regional anesthesia. First, task and skills analyses were performed with domain experts to build the task model of the procedure and determine the simulator’s learning objectives and design constraints. Then, a face and content validity study was conducted with eighteen anesthesiologists to assess the simulator’s prototype. The responses to seven of eleven face validity questions were predominantly positive, indicating a favorable reception. The primary concerns pertained to the fidelity of haptic feedback during needle insertion. This suggests incorporating a higher fidelity haptic device in future design iterations. Conversely, responses to all six questions related to the content validity were predominantly positive. Participants found that the simulator held significant potential as a training tool, particularly for developing hand–eye coordination skills. These findings validate several design choices and highlight areas for improvement in subsequent iterations of UltRASim before its formal validation as a training tool.

The Development of Assessment Instrument Based on Wordwall to Measure Process Science Skills for Environmental Pollution

This study aims to determine the validity, practicality, and effectiveness of an assessment instruments based on Wordwall in measuring students' science process skills of junior high school science learning in environmental pollution materials. This research is a type of development research (Research and Development) that refers to the procedure of the Borg and Gall development model which has stages including research and information collecting, planning, develop the preliminary form of the product, product design validation, main product revisions, main field testing, operational product revision, operational field testing, final product revision. The subject of the study was a grade VII student of SMPN 2 Ajung, Jember. This study used instruments in the form of validation sheets, practicality sheets, student questionnaire sheets, and science process skills tests. Data analysis techniques used in research consist of validity test analysis, practicality test analysis, and effectiveness test analysis. The results showed that out of 20 multiple-choice questions developed from aspects of material, construction, and language based on the assessment of 3 validators were declared very valid and worthy of use without revision. The twenty multiple-choice questions tested have valid question item validity. The assessment instrument has a reliability value of 0.612. The difficulty level analysis obtained 5 easy criteria questions, 14 medium criteria questions, and 1 difficult criteria question. The effectiveness of the assessment instrument obtained the average results of students' science process skills of 55%, including the sufficient category and student response questionnaires of 81%, so they were declared very good.

Quality Analysis of Indonesian Language Test Questions Class VII SMP Negeri 11 Ruteng Using Iteman Programme Version 4.3

The purpose of this study was to describe the validity, reliability, difficulty index, differentiation index, and the effectiveness of distractors on the even semester Indonesian language test questions of class VII SMP Negeri 11 Ruteng, Manggarai Regency in the 2022/2023 academic year using the Iteman version 4.3 programme. The method used was descriptive quantitative. The validity results show that the 40 items of multiple choice questions compiled are valid questions. The reliability results of 40 questions tested on 25 students obtained an Alpha Cronbach score of 0.788. Thus, the question is declared reliable because the amount of the reliability index is more than 0.60. The average index of difficulty (ITK) of all items is 0.433, with 9 questions at the easy level, 10 questions at the medium level, 12 questions at the difficult level, and 9 other questions at the very difficult level. The average index of discriminating power (IDB) is 0.246 with 13 questions declared feasible, 5 questions declared moderate (feasible and do not need to be revised), 7 questions declared good enough (feasible and need to be revised), 15 questions declared unfit. The results of the effectiveness of the distractors showed that 39 of the questions were functioning and 1 question option was not functioning

Application and Limitation of Fisher Model

This essay explores the Fisher Effect hypothesis, which posits a direct relationship between nominal interest rates and expected inflation. It delves into the Fisher model's concept, its implications, and its significance in economics. The research question of the model's validity and applicability is examined through a review of current research findings, revealing mixed results. The essay highlights the diverse applications of the Fisher model in monetary policy, finance, and decision-making across various economic sectors. However, it also discusses the model's limitations, including its assumptions, data quality concerns, short-term focus, and neglect of risk premiums. Future research directions are proposed to enhance the model's accuracy and applicability. In conclusion, this essay emphasizes the importance of recognizing both the strengths and weaknesses of the Fisher Effect and the need for ongoing refinement in its application to navigate the complexities of the economic landscape.

On the External Validity of Average-case Analyses of Graph Algorithms

The number one criticism of average-case analysis is that we do not actually know the probability distribution of real-world inputs. Thus, analyzing an algorithm on some random model has no implications for practical performance. At its core, this criticism doubts the existence of external validity ; i.e., it assumes that algorithmic behavior on the somewhat simple and clean models does not translate beyond the models to practical performance real-world input. With this article, we provide a first step toward studying the question of external validity systematically. To this end, we evaluate the performance of six graph algorithms on a collection of 2,740 sparse real-world networks depending on two properties: heterogeneity (variance in the degree distribution) and locality (tendency of edges to connect vertices that are already close). We compare this with the performance on generated networks with varying locality and heterogeneity. We find that the performance in the idealized setting of network models translates surprisingly well to real-world networks. Moreover, heterogeneity and locality appear to be the core properties impacting the performance of many graph algorithms.

Pengaruh Bimbingan Karir Terhadap Kemantapan Keputusan Karir Siswa Kelas XII SMK Swasta Bandung 1

This research aims to find out: analyze whether there is an influence of career guidance on the career stability of Class XII students at Private Vocational School I Bandung. This type of research is quantitative quasi-experiment (quasi-experiment) with pre-test and post-test one group design. The subjects of this research were 32 students in class XII of Private Vocational School I Bandung. The sampling technique used purposive sampling. The data for this research was taken using a self-confidence questionnaire with 30 valid and realistic questions, then the data was analyzed using the SPSS test. Pre-test data to overcome feelings of lack of self-confidence obtained an average score of 2.045. Meanwhile, post test data on self-confidence obtained an average score of 3.875. This means that the average score of students after receiving group guidance services for career stability is higher than before receiving career guidance services for stability. From data analysis it is obtained that Fcount = 15 with a = 0.05 while Ftable = 4. From these data it can be seen that Fcount > Ftable where 15>4. This means that the hypothesis is accepted. The influence of career guidance on student career stability by contributing 33.4% to increasing the career stability of Class XII students at Private Vocational School I Bandung. This shows that there is an influence given or the hypothesis can be accepted.

Perspectives or Misperceptions? Why Better Land-Use Data Are Critical to Housing Policy Debates

Research correlating stringency in land-use regulation to low housing supply, high housing costs, and segregation relies on surveys of planners about land-use regulation. Housing policy reform proposals rely on much of this same research. We assess the reliability and validity of questions from three surveys using objective data on land-use regulation and its application. Response errors indicate that planners systematically underestimate the stringency effects of local regulation while overestimating the impact of state law. This signals potential bias that may skew some analysis. Scholars should account for this potential bias when analyzing survey data to inform land-use policy debates.

Eksplorasi Validitas dan Reliabilitas Soal Pemahaman Konsep Dalam Asesmen Pembelajaran

Students’ understanding of concept can be measured and assessed using mathematical concept understanding test instruments. The instrument to be used must be prepared to meet the criteria for a good instrument. Therefore, the aim of this research is to determine the validity and reliability of students' conceptual understanding questions in learning assessments. This type of research is qualitative research using descriptive methods. Data was obtained through tests and interviews with mathematics subject teachers. The subjects in this research were class IX students at MTsN 2 Kerinci, totaling 22 students in 1 class. Based on the results of validity calculations using the Pearson Product Moment formula and t test, as well as calculations of question reliability using the Cronbach's Alpha formula, it was found that each question item was valid and reliable, so this test instrument can be used to measure students' ability to understand mathematical concepts.

Pengembangan Dan Uji Validitas Soal-Soal Kemampuan Pemahaman Konsep Pada Materi Soal Himpunan

Understanding concepts is very important in learning mathematics, because with a thorough understanding, students can solve a problem and are able to apply this learning to the real world. This research aims to develop and test the validity of conceptual understanding ability questions on set question material in Class VIID MTsN 2 Kerinci. This type of research uses development research. The research subjects were class VII D students consisting of 26 students. The data collection techniques used were tests, interviews and documentation. The results of the research show that students have a very good understanding of concepts. It can be seen from the results of the analysis of the test question data that it can be seen that there are 8 students (22.9%) included in the category of having the ability to understand concepts very well, 5 students (14.3%) included in the category of having the ability understanding of the concept was good, 7 students (20.0%) were in the sufficient category, and 5 students (14.3%) were in the poor category. This means that overall there are 8 students out of 25 students who have the ability to understand concepts in the very good category. This shows that set material questions have a potential effect on students' ability to understand concepts.

Pengaruh Pengendalian Emosi Terhadap Orientasi Pelayanan Publik Anggota Polres Sukoharjo

This research examines the relationship between the ability to control the emotions of Sukoharjo Police members and their level of public service orientation. Respondents involved members of the Sukoharjo Police with an age range of 18 to 57 years. The type of research is quantitative. Data was collected through a questionnaire that included sample characteristics based on age. Test data requirements include tests of validity, reliability, normality and classical assumptions. The validity test results show a number of valid questions in the variables of emotional control and public service orientation. The reliability test using Cronbach's Alpha confirms that the two variables are reliable. The normality test shows that the data is normally distributed. Classic assumption tests such as linearity and heteroscedasticity tests provide results that support the validity of regression analysis. The simple linear hypothesis test resulted in a significance value (Sig.) of 0.000 and this is smaller than 0.05. So it can be concluded that emotional control has a significant effect on public service orientation. This shows that emotional control has a significant effect on public service orientation.

Protocol to measure validity and reliability of colorectal, breast, cervical and lung cancer screening questions from the 2021 National Health Interview Survey: Methodology and design.

Previous studies demonstrate that self-reports of mammography screening for breast cancer and colonoscopy screening for colorectal cancer demonstrate concordance, based on adherence to screening guidelines, with electronic medical records (EMRs) in over 90% of those interviewed, as well as high sensitivity and specificity, and can be used for monitoring our Healthy People goals. However, for screening tests for cervical and lung cancers, and for various sub-populations, concordance between self-report and EMRs has been noticeably lower with poor sensitivity or specificity. This study aims to test the validity and reliability of lung, colorectal, cervical, and breast cancer screening questions from the 2021 and 2022 National Health Interview Survey (NHIS). We present the protocol for a study designed to measure the validity and reliability of the NHIS cancer screening questions compared to EMRs from four US-based healthcare systems. We planned a randomized trial of a phone- vs web-based survey with NHIS questions that were previously revised based on extensive cognitive interviewing. Our planned sample size will be 1576 validity interviews, and 1260 interviews randomly assigned at 1 or 3 months after the initial interview. We are enrolling people eligible for cancer screening based on age, sex, and smoking history per US Preventive Services Task Force recommendations. We will evaluate question validity using concordance, sensitivity, specificity, positive predictive value, negative predictive value, and report-to-records ratio. We further are randomizing participants to complete a second survey 1 vs 3 months later to assess question reliability. We suggest that typical measures of concordance may need to be reconsidered in evaluating cancer screening questions.

Implementation of the São Paulo Nursing Courses Consortium for the Progress Test: experience report.

To report the experience of implementing the São Paulo Nursing Courses Consortium for the Progress Test. This is an experience report of the consortium's work in Progress Test preparation and application for Public Schools of Nursing in São Paulo in 2019, 2021 and 2022, with a descriptive analysis of the work process and the results obtained. The consortium's activities are structured into the following stages: planning; theme review; distributing and requesting questions; professor training; question elaboration; question reception; question selection; question validation; student registration; test application; analysis and dissemination of results. A total of 57.3% of enrolled students participated. There was a predominance of questions of medium difficulty and a gradual progression in the level of discrimination of the questions, with, in 2022, 82.5% being considered adequate. The consortium has allowed the test to be applied interinstitutionally, with greater scope, accuracy, and quality of questions. Through this experience, it is expected to encourage progress testing in undergraduate nursing courses in other contexts.

Role of electromedical personnel in ensuring the availability of electromedical device in hospitals

Objective: To examine the validity and reliability of a questionnaire used to assess the role of electromedical personnel in ensuring the availability of electromedical equipment for healthcare services in Indonesian hospitals, both during normal times and the COVID-19 pandemic. Methodology: This study involved the participation of 70 electromedical personnel from government hospitals in Surabaya and Yogyakarta, which are central and referral hospitals for COVID-19 patients. The questionnaire consisted of 16 questions that represented various skills required by electromedical personnel, including maintenance, repair, testing, monitoring, calibration, inspection, safety, fitness for use testing, assembly, installation planning, and review of electromedical devices. To evaluate the validity and reliability of the questionnaire, statistical measures such as Pearson product-moment correlation and Cronbach's alpha coefficient were utilized. The Smart PLS 3.0 program was employed to conduct these tests. Results: The reliability test demonstrated that all valid questions in the questionnaire were reliable, as indicated by a Cronbach's alpha coefficient of 0.936. Among the authorities assessed, the highest coefficient values for the role of conducting inspection of device performance (0.813) and the role of conducting safety inspections (0.821). Conclusion: The questionnaire is a valid and reliable research instrument for measuring the role of electromedical personnel in ensuring the availability of electromedical equipment in hospitals.

Modeling the Productivity of Human Resources with an Emphasis on Social Capital with the Approach of Learning Organizations in the Country's Higher Education

The purpose of the current research is to find a model of human resources productivity with an emphasis on social capital with the approach of learning organizations in higher education of the country. The current research is mixed and in terms of its purpose, it is of the type of basic-applied research and in terms of the method of collecting information, it is of the survey type. The statistical population of the current research will be all experts of higher education in the country, including management professors. who were selected purposefully, using the method of the number of questions in structural equations, 280 people were selected for the quantitative part and 17 university experts were selected for the qualitative part. In order to collect data, thematic analysis method was first used by interview, after confirming the questions by confirmatory factor analysis, the questionnaire was used to conduct the quantitative part of the research. Content validity was used to determine the validity of the questionnaire, and after compiling the final questionnaire, the expertise of university professors and experts was used to determine the content validity. that the questionnaires were approved. In order to analyze the data in the qualitative part, thematic analysis method, interviews and manual coding were used, and in the quantitative part, Smart PLS3.3 and SPSS22 software including confirmatory factor analysis tests were used. The findings of the research show that in the qualitative part, 45 factors were identified in 3 organizational, individual and environmental dimensions. And after analyzing the confirmatory factor and confirming the validity and reliability of the research questions in the quantitative part, the pattern and research questions were confirmed. One of the most important factors in the progress of an organization is the productivity of human resources. In today's changing and complex conditions that govern the economic, social, political, etc. environment, one of the factors that can help the survival of the organization is the issue of productivity, so human power has always played a significant role in the efficiency of organizations.

Designing and Validating the Model of Empowering Faculty Members to Encourage Students to Engage in Entrepreneurial Activities

The present research adopts an exploratory and foundational approach to provide a conceptual framework for explaining the empowerment of faculty members in encouraging students' entrepreneurial activities. The statistical population of the qualitative and quantitative sections of the study consists of all faculty members of Farhangian University, totaling 820 individuals. The qualitative sample was selected using snowball and purposive sampling methods, consisting of 15 participants, while the quantitative sample was determined using the Morgan table and random sampling, totaling 265 participants. The data collection instruments for the qualitative section were semi-structured interviews, and for the quantitative section, a researcher-made questionnaire was used. The content validity of the interview questions and questionnaire was confirmed by 5 faculty members of Farhangian University. The reliability of the interview results was calculated and confirmed using the Holsti test with a coefficient of 0.81, and the questionnaire reliability was assessed and confirmed using Cronbach's alpha coefficient, which was equivalent to 0.837. The data analyzed using MAXQDA 20.4.2, IBM SPSS Statistics 26, and SmartPLS 3 software. The data analysis conducted using a data-driven theoretical framework, which included open, axial, and selective coding to achieve the extracted pattern from the research. The qualitative findings indicate that 6 dimensions, 14 factors, and 62 components of empowering faculty members are effective in encouraging students' entrepreneurial activities. The quantitative findings confirm the extracted pattern. Absolute and parsimonious fit indices support the desired fit of the empowerment model of faculty members in encouraging students' entrepreneurial activities.

An examination of negative one-star patient reviews for foot and ankle orthopedic surgery: A retrospective analysis

BackgroundDespite the questionable validity of online-based physician review websites (PRWs), negative reviews can adversely affect a provider's practice. Several investigations have explored the effect of extremely negative “one-star” reviews across subspecialties such as adult reconstruction, sports medicine, and orthopaedic traumatology; however, to date, no study has explored one-star reviews in foot and ankle surgery. The goal of this study was to characterize factors that contribute to extremely negative, one-star reviews for foot and ankle surgeons on Vitals.com. MethodsA retrospective analysis of negative one-star reviews with corresponding patient complaints for foot and ankle surgeons (both orthopaedic surgeons as well as podiatrists) in the United States. Physicians included were selected within a 10-mile radius of the top ten largest cities in the United States. Data was stratified by patient type (e.g., those receiving surgery and those not undergoing surgical intervention) and binned according to type of patient complaint, as previously described. ResultsOf the 2645 foot and ankle surgeons identified in our initial query, 13.8% of surgeons contained one-star reviews eligible for analysis. Patient complaints related to bedside manner and patient experience are the causative factors accounting for 41.5% of the one-star reviews of foot and ankle surgeons for nonsurgical-related complaints. Surgical complications and other outcomes-related factors comprised roughly 50% of the complaints related to surgical patients. ConclusionIn conclusion, complaints related to bedside manner and patient experience are the causative factors accounting for 41.5% of the one-star reviews of foot and ankle surgeons for nonsurgical-related complaints. Surgical complications and other outcomes-related factors comprised roughly half of the complaints related to surgery. This data serves to inform practicing foot and ankle surgeons as to the influences behind patients leaving extremely negative reviews on PRWs. Level of clinical evidenceIV

Development Of Google Form-Based Learning Outcome Evaluation Instruments For Animal Development Courses In The Biology Education Study Program FMIPA UNIMED

This study aimed to develop a valid and reliable google form-based learning outcome evaluation instrument for the Animal Development course. The instrument was developed following the 4D development model (define, design, develop, dessiminate). The research subjects were Biology Education Study Program (PSPB) class of 2021 class B students totaling 26 people. Data were obtained from validation questionnaires and student response questionnaires. The initial design of the learning outcome evaluation instrument consisted of 50 questions. Based on the validator's assessment, an instrument consisting of 25 valid and reliable questions was obtained. The results of validation by evaluation instrument experts obtained an average percentage of 98.6% with a very feasible category. Based on the validity analysis of the Aiken index, the value V = 0.942 was obtained with high validity criteria. Instrument reliability using Cronbach's Alpha obtained a value of 0.796 with high criteria (reliable), while the analysis of ICC reliability data obtained the results of inter-rater agreement of 0.796, and for each rater the consistency is 0.565. It can be concluded that the agreement between raters is very strong and each rater has a fairly good consistency. The results of the data analysis of student responses showed that each indicator was rated very well with an average percentage of 88%.theresa612

Cultivating the 21st-century learners' competencies by considering the education components of the curricula: a step towards realizing sustainable development

PurposeThe present study aimed to develop the competencies of 21st-century learners by considering the characteristics of the education element in the curricula.Design/methodology/approachThe study employed a qualitative research design and a content analysis technique. The research population consisted of 20 curriculum design professors selected via a snowball sampling method until data saturation was reached. The research instrument was semistructured interviewing. The content validity of the interview questions was determined according to 5 curriculum design experts' opinions. Four credibility, transferability, dependability and confirmability criteria were used to increase the accuracy of qualitative data. The findings were analyzed using thematic analysis (structural-interpretive) through open, axial and selective coding.FindingsEducation characteristics in competency-based curricula were categorized into knowledge, skills, attitude and educational values. Knowledge includes pedagogical knowledge, content knowledge, pedagogical content knowledge and pedagogical technological knowledge; teaching skills include organization, facilitation, care and flexibility; educational attitudes consist of educational and pedagogical attitudes; and educational values include individual and group-social values.Originality/valueThe present research put three critical dimensions together: the competencies of the new-age learners from the perspective of the curriculum, which is the heart of the education process and is aimed at sustainable development, which is the priority of the countries today.

Using Military Screening Questions to Anonymously Recruit Post-9/11 Era Service Members andVeterans Using Online Survey Methods.

The ability to collect data on posttraumatic reactions following military sexual trauma is impacted by data collection methods, such that under-reporting can occur when data are believed to be identifiable. This may be especially true for topics that are sensitive, including sexual trauma. Ensuring participation from service members using non-identifiable methods is challenging when service history cannot be confirmed. The COVID-19 pandemic complicated data collection due to contact and social distancing requirements and limitations. To attempt to overcome these challenges, this study utilized an anonymous survey delivered by Qualtrics, Inc. with military validation checks that served as a screening mechanism. The purpose of the current report is to describe the development and use of military validation questions to recruit a sample of military sexual assault survivors using an anonymous survey. Qualtrics, Inc., a data collection software company, was contracted to collect data on military service members and veterans who reported military sexual assault. We developed and piloted four validation checks regarding military knowledge, which had to be answered correctly before participants could engage in the survey. This information was common to those who have served but uncommon to civilians, ensuring, to the best of our ability, that those responding were or had been service members. An incorrect response to any of the validation checks resulted in termination from the study. The probability of guessing correctly all four items was 0.16%. The current study collected data on 200 women and 200 men, all of whom reported military sexual assault. Data collection took approximately 6 weeks to complete. The validation checks resulted in screening out 1,450 potential participants who provided fraudulent responses. The average cost per participant, which included recruitment costs and participant payment, was $20. Given the histories of military sexual assault, the cohort reported high rates of probable positive screens for posttraumatic stress disorder (PTSD), suicide risk, and moderately severe depression, as well as other interpersonal challenges that are typically reported by those exposed to sexual assault, suggesting our validation checks were effective in recruiting the desired sample. Though not an original goal of our recruitment efforts, 9.75% (n = 39) of our sample identified as a sexual orientation other than heterosexual, including gay, bisexual, questioning, or "other." Use of Qualtrics, Inc. to incorporate validation checks helped us to be more reasonably confident that we were collecting data from military service members who reported military sexual assault. While the probability of a person without current or past military service passing the validation checks was low, it was not impossible. An unanticipated benefit of this platform was the short duration of time it took to complete data collection; the sample was collected within about 6 weeks. This platform may be a good option for investigators who cannot collect face-to-face data.