Questionable Validity Research Articles

VALIDASI SOAL-SOAL BERBASIS LITERASI MATERI PERPINDAHAN KALOR UNTUK MAHASISWA PENDIDIKAN GURU SEKOLAH DASAR

The purpose of this study is to find a form of literacy and numeracy-based e-module with the specific aim of knowing the validity of literacy-based questions on heat transfer material for elementary school teacher education students. This research was conducted at the University of PGRI Ronggolawe Tuban (UNIROW) Primary School Teacher Education (PGSD) study program. The object of the research is PGSD UNIROW students batch 2021. The time of the research starts from February to May 2022. The research design used in this study is the Dick and Carey development model. This research design is used because it is more specific in its development. In the early stages of research, research is carried out, namely the research stage or literature study to obtain information about the needs of the product to be developed. The stages of development carried out consist of five stages, namely (1) needs analysis, (2) analysis of forms of literacy-based questions, (3) material analysis with the skills to be achieved, (4) formulating skills achievement goals, ( 5) validation of literacy-based questions. The validation results show that the expert assessment of the literacy-based questions developed is in the very good category with a percentage of 92.5%. The results of language validation get good criteria with a percentage of 75%. Based on these results, literacy-based questions deserve to be tested on students.

Perspective: Machine learning in experimental solid mechanics

Experimental solid mechanics is at a pivotal point where machine learning (ML) approaches are rapidly proliferating into the discovery process due to significant advances in data storage and processing capabilities. Much of the ML that is being adopted by the mechanics community was initially developed for application outside of science and engineering, and has the potential to produce results of questionable physical validity. To ensure that these data-driven approaches are trustworthy, there is a clear need to embed physical principles into their architectures, to evaluate and compare ML frameworks against benchmark datasets, and to test their broader extensibility. Frameworks must be grounded in a clear objective, quantifiable error, and a well-defined scope of extensibility. These principles enable ML models with a wide range of architectures to be meaningfully categorized, compared, evaluated, and extended to broader experimental and computational frameworks. Application of these principles are demonstrated through an investigation of ML models in two different use cases, acoustic emission and resonant ultrasound spectroscopy, along with a discussion of outlooks for the future of trustworthy ML in experimental mechanics.

Pengembangan Soal Kognitif Berbasis Hots dalam Mata Pelajaran Sejarah pada Pokok Bahasan Perkembangan Kerajaan Islam di Indonesia pada Masa Islam Untuk Siswa Kelas X

In education, assessment means the process of collecting and processing information for the purpose of student learning outcomes. To carry out this assessment, the teacher needs an instrument assessment in the form of questions that develop HOTS. In this era, students must have high-order thinking skills (HOTS), one of which is critical thinking. The importance of higher-order thinking skills can be seen from the government's efforts to integrate learning that is strengthened in character education, literacy, HOTS-based learning today. Therefore, this study aims to develop valid HOTS-based questions. With question-based that can be used to measure students' critical thinking. the research model used in this study is an example of the development of Educational Research according to Tessmer. The data analysis technique used is quantitative analysis which aims to determine the validity of the questions. The validity of this development item was obtained based on the verification results of history education teachers. The results of this development were in the form of questions consisting of 10 HOTS-based questions to measure students' critical intelligence, with a discussion of the development of Islam in Indonesia being tested on class X students at SMA N 1 Tanggga Batu.

Level of Understanding of Football Rules for Parents in the SESKOM 2022 Competition

This research is motivated by youth competitions or tournaments between soccer schools, many parents accompany students to compete. When accompanying students to compete, it is often found that the guardians of students are involved in protesting to the referee and giving excessive instructions to players. Sometimes students have followed the referee's decision, but the parents still do not accept what has been decided, resulting in the match being hampered. This research is quantitative descriptive. The method used in this research is a survey method. The instrument used is a questionnaire. The instruments that have been arranged are consulted with experts, then the validity test is carried out with the results of 12 of 20 valid questions and a reliability of 0.840. The population in this study was the guardians of students who were in the SESKOM 2022 tournament in Sumberejo with a total of 30 people. The data analysis technique used is descriptive analysis with percentages. The results showed that the level of understanding of the parents' understanding of the rules of the competition game for young people was in the good category of 66%. Of the total research objects, which amounted to 30 people, it was found that the very good category was 23% (7 people), the good category was 47% (14 people), the sufficient category was 23% (7 people), the less category was 7% (2 people) and the very less by 0% (none).

A process for assessing the reliability and validity of questions for use in online surveys: Exploring how communication technology is used between Lead Maternity Carer midwives and pregnant people in Aotearoa New Zealand

There is growing use of communication technology in Aotearoa New Zealand. How it is used between midwives and pregnant people is unknown. Surveys are ideal for gathering information when there is little known of a phenomenon. Aligning questions to a midwifery informed framework provides an innovate approach to explore this issue. To assess reliability and validity of questions for two online surveys using a tool created for an expert advisory group of midwives with experience in survey design and midwifery practice. An innovative approach is taken to validate questions for two online surveys using an expert advisory group of seven midwifery academic researchers with experience in both quantitative and qualitative research designs, and midwifery practice. The group were asked to rate items using a 4-point rating scale ranging from strongly agree to strongly disagree. Analysis of the scoring was undertaken using Content Validity Index, Cronbach’s alpha coefficient and review of comments by the group. Quantitative scoring of both survey instruments were valid and reliable. The overall Content Validity Index score was 0.92 (midwives) and 0.93 (pregnant people). The overall Cronbach’s alpha coefficient score was .78 (midwives) and .83 (pregnant people). Qualitative comments reinforced the validity and reliability of survey questions. An innovative approach was taken in assessing the reliability and validity of two online surveys using a midwifery expert advisory group and a midwifery framework to situate the surveys within a midwifery body of expertise and knowledge. The comments made by midwifery experts provided an extra layer in the validation of survey instruments using Content Validity Index and Cronbach’s alpha coefficient scoring. Creating a tool for validating questions developed by midwives for an expert group of midwives recognises the potential patriarchal roots of knowledge production and dissemination and enables marginalised voices to be heard.

The measurement of gender expression in survey research

Previous research on the survey measurement of sexual orientation, gender identity, and gender expression (SOGIE) often focuses on the measurement of identity, with comparably little research focused on gender expression as a key feature of how gender is lived and experienced. This study examines the reliability and validity of survey questions about gender expression in a 2-by-5-by-2 factorial experiment that varies the question order, type of response scale, and the order of gender presentation in the response scale.The results indicate that the effect of which (side of the) scale is presented first on gender expression varies by gender for each of the unipolar items and one of the bipolar items (behavior). In addition, the unipolar items also show distinctions among the gender minority population in ratings of gender expression as well as more nuance with respect to concurrent validity in predicting health outcomes among cisgender respondents. The results of this study have implications for researchers who are interested in accounting for gender holistically in survey and health disparities research.

Development of PISA-Type Questions and Activities in a Smartphone Context

Sometimes our smartphone's internal storage is complete, and we must download an application that is very necessary at that time; this is where numeracy plays a role in solving this problem, namely the way we download the desired application with a complete smartphone's internal storage. This study aims to produce valid and practical PISA-type questions and activities using a smartphone context and potentially effective on students' numeracy skills. This design research-type development study comprised a preliminary and formative evaluation phase consisting of the design stage, self-evaluation stage, expert review stage, one-to-one stage, and small group stage. This research used question grids, question cards, assessment rubrics, lesson plans, PISA-type questions, and student activity sheets as its tools. This study was initiated owing to the insufficient numeracy skills of Indonesian students. This study focuses on seventh-grade students at secondary school number 59 Palembang, Indonesia. The qualitative findings of this research are based on field data collected through walkthroughs, observations, tests, interviews, and document reviews. This research yielded PISA-type questions and activities, namely four activity questions and six evaluation questions with smartphone context that seventh graders may utilize to develop their numeracy abilities. In conclusion, PISA-type questions and activities in the context of smartphones can be used in classroom learning to strengthen students' numeracy skills.

Validation and Reliability of Lifestyle Instruments for Indonesian Adolescents with Hypertension Family History: A Rasch Model

BACKGROUND: There are lifestyle changes among adolescents in this modern era, such as less physical activities, because many activities can be carried out using modern technology, unhealthy food habits such as eating junk food, canned food and beverages, and preserved fruits and vegetables, poor sleeping habits, stress, and smoking behavior. These lifestyles are harmful and lead to cardiometabolic diseases such as obesity and hypertension, especially in adolescents with hypertension history in the family. AIM: This study aimed to assess the validation and reliability of healthy lifestyle instruments for Indonesian adolescents with a family history of hypertension. METHODS: This study is a survey research conducted from July 2021 to February 2022 in South Sumatera, Indonesia. The subjects were adolescents with a family history of hypertension and recruited using purposive random sampling. Adolescents aged 10–18 years old who returned signed parental consent forms, gave written assent to participate, and completed the questionnaire were included in the study. The questionnaire was consisted of three sections, Section I contained internal factors, Section II related to external factors, and Section III related to healthy lifestyle. The study was approved by the Research Ethics Committee Universitas Padjadjaran Bandung. Winsteps software was used to analyze the validity, reliability, unidimentionality, and rating scale. RESULTS: Obtained 103 valid question items with OUTFIT values 0.5 < mean square < 1.5; −2.0 < ZSTD < 2.0; and the point measure correlation (Pt Mean Corr) value is in the range of 0.32 < Pt Measure Corr < 0.85. The reliability value of respondents and instruments is 0.88, with a ’Cronbach’s alpha value of 0.95. The raw variance explained by the measured value is 72.3%, and all unexplained variance values are <15%. CONCLUSIONS: Healthy lifestyle instruments are valid and reliable, so it is feasible to measure the healthy lifestyle of Indonesian adolescents with a family history of hypertension. This instrument can measure the success of a program or intervention in changing a lifestyle in adolescents at risk of developing hypertension, especially adolescents with a family history of hypertension. We suggest further research involving more participants in a broader area. We hope the healthy lifestyle instruments can be used in a standardized manner for all regions of Indonesia.

Drawing on Siedentop’s Legacy to Revisit Systematic Observation of Teaching: Identifying and Addressing Key Validity and Reliability Questions

ABSTRACT Focusing on systematic observation, one of the most potent methods of studying teaching quality, represents one of the numerous contributions of Daryl Siedentop to the profession. While he had a clear focus on issues of validity and reliability concerning systematic observation, over the past decades, attention to such issues appears to have eroded. By drawing on Siedentop’s contribution to systematic observation and the guidance he provided on gathering quality data, in this paper we discuss the lessons learned from his work regarding what needs to be observed, how, by whom, and under what conditions – all addressing important validity and reliability issues. We argue that closely attending to these issues is critical not only for reinvigorating a research field initiated by scholars such as Siedentop but also for restoring its key role in studying teaching quality.

Utilization of Inquiry-Based Approach and its Influence on Students’ Attitudes towards Biology in Secondary Schools in Kiambu County, Kenya

Attitude incorporates beliefs and ideas, feelings and tendency of like or dislike about a subject or an object. Attitude towards Biology is related to motivation and influences performance (Diaz et al., 2021). One of the ways students are motivated to learn is when they are taught Biology through inquiry-based approach (IBA). They become interested, and develop positive attitudes towards Biology (Annan et al., 2019). The purpose of this study was to determine students’ attitudes towards Biology when using IBA in Githunguri sub-County, Kiambu County, Kenya. The research question was, what are students’ attitudes towards Biology when learning through IBA? The study targeted 37 public secondary schools, 1,194 Form 3 students and 14 teachers. Purposive sampling was employed to select 11 secondary schools with laboratories and 14 experienced teachers while simple random sampling was used to select 344 students. Questionnaires and interview were employed for data collection. Quantitative data was analysed using descriptive analysis and Statistical Package of Social Sciences. Qualitative data was analysed using narratives. The findings show that most students have positive attitudes towards Biology when taught using IBA. They found Biology as requirement for careers such as medicine. Although most students have positive attitudes towards Biology, some have inadequate understanding of basic concepts due to difficult Biology terminologies. It is concluded that a range of factors including, availability of resources which include computers and internet facilities, are key to helping students understand difficult concepts and do research in Biology. Ensuring the validity of test questions in the Biology papers set for the Kenya Certificate of Secondary Education (KCSE), will facilitate the development of positive attitudes and interest in Biology. It is recommended that Teachers should be provided with more resources to simplify Biology concepts and terminologies in order to alleviate fears, thereby encouraging students’ positive attitudes towards Biology.

The Effect of Overconfidence Bias and Representativeness Bias on Investment Decision With Risk Tolerance as Mediating Variable

This research is intended to determine the effect of overconfidence bias and representative bias on investment decisions with risk tolerance as a mediating variable. The object of this research is investors who invest in the Indonesian Capital Market. The technique of collecting data is by using a questionnaire through online media and a literature study with the criteria of active investors with a sample of 200 investors. Data analysis in this study uses an alternative method of Structural Equation Modeling (SEM) version 3.0. The first stage in this research is to test the validity of each variable's questions along with their reliability. The second stage examines the relationship between overconfidence bias and representativeness bias on investment decisions with risk tolerance as a mediating variable. The results of this study indicate that the overconfidence bias variable and the representative bias have a significant positive effect on investment decisions either directly or through the mediating risk tolerance variable.

Designing an Effective Training and Internship Model in the University Curriculum from the Perspective of Faculty Members

Considering the importance and role of training and internship courses in empowering students and graduates, the present study was conducted with the aim of designing an effective training and internship model in the curriculum. The research method was qualitative and the participants included faculty members of University of Tehran, Shahid Bahonar University of Kerman, Isfahan University of Technology, Shahid Sadoughi University of Yazd, Mazandaran University, Valiasr University of Rafsanjan, Ferdowsi University of Mashhad, Sirjan University of Technology and Shiraz University, who have presented at least one internship course. Validity and reliability of the interview questions were confirmed by experts. After analyzing 30 interviews, the researchers could have limited themselves to the same number of interviews according to the principle of theoretical saturation, but since the variety of academic fields and universities was considerable, the interviews continued up to 80 people on a quota basis. By analyzing the interviews, the current status of the implementation of these courses showed that, according to faculty members, internships are not implemented effectively and 8 components of time, personal problems, organizational structure and organization, lack of allocation of necessary and sufficient resources, lack of proper understanding of the program by individuals, lack of commitment of individuals and organizations, lack of proper evaluation and monitoring system and lack of inter-organizational and interpersonal communication system were as the main obstacles to effective implementation of these courses. Considering that the main problem in the lack of effective implementation of internship courses is the lack of proper and sufficient coordination and communication between the circles of organizations (Ministries, university and work environments) and the circles of individuals (Faculty members, supervisor of internship center and student) with each other, a model was designed based on which it is appropriate to form minimum interactions between faculty member and student in training and internship courses, and the main emphasis should be on creating communication circles.

Shared economy development model with economic development approach in Iran's sports industry

This study aimed to develop a model for developing a shared economy with an economic development approach in the Iranian sports industry. The research method was a two-stage exploratory combination of instrument making. In the qualitative part, the purposeful sampling method and theoretical saturation technique were performed. The tools used were to identify semi-structured interviews (with focus groups) and study documents. To ensure the validity and reliability of the study, the Lincoln and Guba evaluation methods were used. In the quantitative part, the research method was a descriptive survey. The statistical population was the economic activists in sports and sports marketing students. According to Cochran’s sample size determination formula, 384 people were considered as the sample. to collect data from the questionnaire of the framework model of the shared economy model in sports with an economic development approach that includes 43 items that have been extracted according to the theoretical foundations and the qualitative part of the research. Eight professors of sports management were used to evaluate the face validity and the carcass model was used for the content validity of the questionnaire questions. (CVR=0.86) and content validity was confirmed. Cronbach's approved alpha was also used. Descriptive statistics and structural equation modeling were used to analyze the data to evaluate the fit of the research model. The results of the research in the qualitative section showed that after examining the Delphi method and performing the first stage, 31 items were identified. In the second stage, 40 items were identified, and in the third stage; Finally, 50 items were identified. The three dimensions of human ecology, fiscal policy, and value-oriented processes emerged as a framework for the model of a shared economy in sports with an economic development approach. And in the quantitative part, the human ecology dimension with a value of 0.71 affects the value-oriented process dimension with a value of 0.65 and the fiscal policy dimension with a value of 0.63 affects the framework for the development of a shared economy in sport. The results also showed that the research model has a good fit. Therefore, it is suggested that the sports organizations' managers pay attention to the factors of this research to implement economic development by emphasizing a shared economy.

Visual Question Generation From Remote Sensing Images

Visual question generation (VQG) is a fundamental task in vision-language understanding that aims to generate relevant questions about the given input image. In this paper, we propose a paragraph-based VQG approach for generating intelligent questions in natural language about remote sensing (RS) images. Specifically, our proposed framework consists of two transformer-based vision and language models. First, we employ a swin-transformer encoder to generate a multi-scale representative visual feature from the image. Then, this feature is used as a prefix to guide a generative pre-trained transformer-2 (GPT-2) decoder in generating multiple questions in the form of a paragraph to cover the abundant visual information contained in the RS scene. To train the model, the language decoder is fine-tuned on RS dataset to generate a set of relevant questions from the RS image. We evaluate our model on two visual question-answering (VQA) datasets in RS. Additionally, we construct a new dataset termed TextRS-VQA for better evaluation for our VQG model. This dataset consists of questions completely annotated by humans which addresses the high redundancy of the questions in prior VQA datasets. Extensive experiments using several accuracy and diversity metrics demonstrate the effectiveness of our proposed VQG model in generating meaningful, valid, and diverse questions from RS images. The TextRS-VQA dataset is available at: <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/yakoubbazi/TextRS</uri> .

Item analysis of multiple-choice questions in pharmacology among medical undergraduates

Background: Assessment plays an essential role in the evaluation of learning, and multiple-choice questions (MCQs) are one of the components of examinations. Item analysis enables identifying good MCQs based on difficulty index (DIF I), discrimination index (DI), and distractor effectiveness (DE). The assessment of learning will be more meaningful with routine item analysis. Aims and Objectives: The item analysis helps us to assess the validity and reliability of MCQs and to generate a valid MCQ question bank for future use. Materials and Methods: A set of 30 single best response type MCQs or items was used for assessment in 155 phase II MBBS students at a medical college in Mangalore. Each item was pre-validated before and later analyzed for its DIF I, DI, and DE. Results: In the study, the means of DIF I were 55.91 ± 18.48%, DI, was 0.35 ± 0.16%, and distractor efficiency was 72.19 ± 29.15%. Out of 30 items, 22 had a “good to acceptable” level of DIF I, and 18 items had “good to excellent” discrimination power. 81% were functional distractors among 120 distractors. A correlation r = 0.1968 indicates a positive correlation between DIF I and DI. Conclusion: The majority of the MCQs in this study fell within the acceptable range when measured against the three factors analyzed. This suggests that the key to developing valid and reliable MCQs is possible only when regular item analysis is done for all MCQ-based tests.

Racial Differences in Sexuality: A Sex Worker Survey

Racial differences in sexuality are difficult to study due to the privacy of sexual intercourse and the questionable validity of self-reports. We use a novel method to study racial differences: surveying sex workers. We surveyed 129 American female sex workers. We asked them to rate the ethnicities with whom they had had intercourse on thirteen traits and behaviors for five different racial groups: Blacks, Hispanics, Whites, East Asians, Indians, and Jews. The largest reported differences between Blacks and Whites include Blacks having larger penises (d = 1.23, p < .001), that they preferred buttocks over breasts (d = 2.38), and that they preferred doggy-style over missionary (d = 1.42, p < .001). Compared to Blacks, Whites were rated as being particularly interested in kinky sex (d = 0.70, p < .001) and kissing (d = 0.85, p < .001) as well as being faster to ejaculate (d = 0.97, p < .001). Keywords: Sexual behavior, Race differences, Prostitutes, Stereotypes, Sex workers.

Toward a Unified mHealth Platform: A Survey of Current User Challenges and Expectations

Mobile health (mHealth) applications have become ubiquitous and have enabled self-monitoring to help provide better health outcomes. However, the wide availability of mHealth apps introduces new challenges when users need to download and use several apps. While past app evaluations have highlighted many issues, the surrounding work is limited. This study aims to analyse the current user challenges and expectations from future mHealth apps. This information is important to inform and guide the design of better and more attractive mHealth platforms of the future. For our empirical investigation of user feedback, we designed an anonymous online survey using key dimensions from the Mobile Application Rating Scale (MARS), the Technology Acceptance Model (TAM) and the Value Proposition Canvas. Our survey was distributed via online channels such as Twitter and LinkedIn, and we received 70 valid responses that indicated challenges such as functional overlaps between different apps, unnecessary features, and poor customizability. Similarly, most respondents expressed their preference for a single platform to manage their health. These challenges suggest the need to design more capable unified mHealth platforms that can be tailored to a user’s needs. While the development of such platforms raise valid questions around the increase in software complexity and privacy concerns around user data, an open design can address these concerns and offer a better experience. Overall, these findings indicate the need for more research into mHealth app design strategies where the regular use of more than one app must be considered to create better, more engaging mHealth apps.

Parents’ perspective in the evaluation of a parental report inventory for the assessment of child communication development

Parents? reports are accepted in practice and can be a valid and reliable source of information in research on children?s communicative development and any delays in this. Nevertheless, parents? reports may have important limitations that need to be considered: parental positive bias; parents? understanding of the child language comprehension; and parents? education and limited linguistic knowledge. In this paper, we take the stance that parents are most interested in an adequate assessment, and obtaining reliable input from them is certainly important. We amplify the voice of parents by synthesizing their experiences with a parental report inventory as a method based on the usage of the adapted version of the MacArthur-Bates Communicative Development Inventory. With that aim, we conducted a qualitative inductive thematic analysis of focus group discussions and additional open-ended validation questions. Six emerging themes and sub-themes were identified and presented with illustrative quotations. Results revealed that the adaptation of original CDIs to languages with radically different morpho-syntactic structures may produce items that are hard to recognize and understand without a context. We bring to light parent-specific difficulties in performing this task and provide a critical understanding of parents? reports as a method of language development assessment. We discuss potential solutions to parents? dilemmas that inevitably arise when reporting on their child?s communication, as well as answers to researchers?/practitioners? dilemmas regarding the validity and reliability of parental reporting.

BlockchainPedia: A Comprehensive Framework for Blockchain Network Comparison

Since the release of blockchain technology back in 2008, a huge number of blockchain-based systems have been developed. As of Sep’22, there are at least 1,000 blockchain systems ready to be used, with at least four types of networks: public, private, hybrid, and consortium. With the many options you can choose from, a valid question arises: How can we choose a system that fits best with our needs? The purpose of Blockchain Pedia is to help users make the best decision in choosing the right blockchain system, giving the possibility to see the differences between multiple options. The application is designed for anyone who wants to build a project based on blockchain technology, giving recommendations based on the needs of the developer.

Feedback of the faculty participants on training workshop on developing multiple choice questions

Introduction: Multiple choice questions are commonly used tools for the written assessment of undergraduate health professions students. Faculty members need training for the development of valid and reliable multiple choice questions. For this purpose, Bilwal medical college organized one-day training workshop on developing multiple choice questions for newly recruited faculty members in March 2021. The main objective of the study was to assess the feedback of the participants on training workshop. Methods: This descriptive cross-sectional study assessed the feedback of the participants of training workshop on developing multiple choice questions. The feedback questionnaire had four questions. First was on “rating training workshop on scale 1 to 10 (1=poor, 10=excellent) for usefulness, content, relevance, facilitation and overall”. Second was on confidence of the participants in developing MCQs after participation based on Likert scale 1 to 4 (1=not confident to 4=extremely confident). Third was on perceptions of the participants on strengths of training workshop. Lastly, fourth was on areas for improvement. The data was analyzed for central tendency using microsoft excel. Results: Participants’ feedback rating about usefulness (8.82±1.51), content (8.12±1.69), relevance (8.35±1.46), facilitation (8.41±1.46) and overall (global) rating (8.35±1.41) was remarkable. Their confidence level after participation (3.41±0.51) was noticeable. Conclusions: The perceptions of the participants immediate after the training workshop i.e, their reaction was positive.