Validity Results Research Articles

THE DEVELOPMENT OF PROJECT BASED LEARNING E-MODULE ABOUT STRUCTURE AND FUNCTION OF LIVING CREATURES TOPIC

The general background of this research is the limited teaching materials equipped with project-based learning assessment instruments as recommended in Kurikulum Merdeka. The purpose of this research is to produce a Project Based Learning (PjBL) based e-module on the structure and function of living creatures topic that is valid, practical and effective.The type of research used is Research and Development (R&D) with 4-D model’s consisting of the stages of defining, designing, developing and disseminating. However, this research was only untill the development stage due to time constraints. The research instruments consist of teacher questionnaires, student questionnaires, validity test questionnaires, practicality test questionnaires, and effectiveness test questionnaires. The data obtained was analyzed using a formula to analyze the results of validity, practicality and effectiveness tests. The research results show that the PjBL-based e-module developed is valid with an average 88%. The level of practicality is practical with an average 88%. The level of effectiveness is effective which is 84% ​​on average. Based on the research results, it can be concluded that the PjBL-based science learning e-module on the material Structure and Function of the Body of Living Creatures meets the valid, practical and effective categories.

Improving Organizational Performance by Creating an Instrument That Can Help Keep Misuse of Manager Power Under Control

Power misuse by managers in organizations is a wide-spread problem that has significant negative consequences for organizational performance. At the same time, published research on attempts of diagnosing power misuse is scarce. As such, organizations keep facing this problem without help from academia on handling it. The authors of this paper suggest addressing the issue by utilizing a regular survey with the purpose of diagnosing potential power misuse by supervising managers of an organization. The information collected via such a survey can be a powerful feedback instrument toward changing or continuing the state of affairs. Such a survey is developed in this paper. The survey has adequate face validity and Cronbach’s alpha reliability of 0.93. Furthermore, its criterion, convergent, external structure, and discriminant validity results indicate their good levels. Therefore, the survey may be recommended for use in the organizational setting. Utilization of this instrument can potentially lead to the increase of employee accomplishments, and the improvement of organization-wide performance.

Sales Performance Analysis in Adding New Indihome Customers (Case Study in Telkom Jember Area)

Sales Force is an important part of PT Telkom Indonesia's position which has a role in making the company successful. Sales Force finds it difficult to make offers to get customers. Sales Forces do not get a fixed salary, they only get a fee based on new customer orders whose been activated on the same day, so this makes Sales Force less motivated to work. It is suspected that there is miss preception between the Sales Force and the Organization which can influence their job satisfaction and performance. This research presents the results of descriptive statistical analysis, validity and reliability tests of measurement model parameters, as well as the results of testing the research structural model. The descriptive statistical analysis, validity test and reliability test in this research were analyzed using SMARTPLS software. Meanwhile, hypothesis testing and model suitability analysis in this research were carried out using the variance-based Structural Equation Modeling (SEM) method. Data collection was carried out directly by distributing questionnaires to 101 respondents, who were in the IndiHome Sales area for the period 2019 – July 2023. For the result analysis, Work Motivation and Self Efficacy have positive significant for Sales Force Job Satisfaction. Work motivation and Climate Organization have a positive significant effect on Sales Force Job Performance. Climate Organization does not have a significant effect on job satisfaction. Self-Efficacy does not have a significant effect on Performance. Job Satisfaction does not have a significant effect on Sales Performance.

Feasibility of Biopreneurship Project-Based Science Module for Students in the Bagek Kembar Ecotourism Area

The biopreneurship project-based science module is teaching material designed to combine biological concepts with entrepreneurship through project-based learning. This research aims to develop a biopreneurship-based science module valid for increasing students' scientific literacy, entrepreneurial motivation, and environmental literacy in the Bagek Kembar Ecotourism Area. This research is development research using the ADDIE model, namely Analyze, Design, Development, Implementation, and Evaluation. The development and validation stages of the module were carried out at the University of Mataram and SMA Negeri 1 Sekotong. The research instrument was a validation questionnaire given to science experts and teachers. The validity of the Science Module is based on the Aiken V Index. The results of the biopreneurship project-based science module validity show that the Aiken V Index for the size and appearance of the module cover, module design, module content, and language used are 0.95, 0.95, 0.93, and 0.94, respectively. Included in the valid category. This research concludes that the biopreneurship project-based science module is suitable for use in schools to increase students' scientific literacy, entrepreneurial motivation, and environmental literacy in Bagek Kembar ecotourism.

Development of English Board Learning Media to Increase Learning Motivation in English Subjects in Grade 3 of Elementary Madrasah

Students are less motivated to follow the English learning process. The methods and approaches used by teachers are less interesting to students, still centered on the teacher. This study developed English board learning media, and to increase student enthusiasm and make it easier for teachers to transfer knowledge to students. English Board is expected to be fun, interesting, and motivating, and not make students bored when participating in English learning activities. The "English Board" learning media can increase student enthusiasm in learning and provide a pleasant learning experience for students. English Board media uses a research and development model. This study was only conducted in five stages, namely: 1) potential and problem stage, 2) data collection stage, 3) product design stage, 4) product validation stage, and 5) product revision stage. The results of the media validity obtained an average percentage of 89.77%, this result is included in the category of very good or very suitable for use in implementing English learning activities.

Development of Learning Media Using the Articulate Storyline Application in Integrated Thematic Learning

This research is motivated by the conventional nature of learning that takes place in the classroom, that is, it is still teacher-centered, not student-centered. This research aims to produce learning media using the Articulate Storyline application in integrated thematic learning that is valid, practical and effective to improve student learning outcomes in class III elementary schools. This research uses research and development (R&D) methods with the ADDIE development model which has five stages, namely Analysis, Design, Development, Implementation, Evaluation. At the analysis stage, observations and interviews were carried out with teachers and students in elementary schools, at the design stage a learning media was designed according to the data and facts obtained. At the development stage of the learning media that has been designed, validation is carried out to find out whether the product is valid for application. Validation is carried out in three stages: first, validation by five validators who are experts in their respective fields with an overall average result of 88 with a very valid category. The results obtained after evaluating the practicality test of the teacher response questionnaire obtained an average score of 91 in the very practical category, and the student response questionnaire obtained an average score of 90 which was in the very practical category. In the effectiveness test, the learning results obtained an average value of 89 in the effective category and for the N-Gain Score an average value of 0.74 was obtained with a percentage of 74, including the effective category. Based on the results of validity, practicality and effectiveness tests, it can be concluded that the learning media using the Articulate Storyline Application in thematic learning is a valid, practical and effective learning media.

Psychometric Properties of the Credibility/Expectancy Questionnaire in Individuals with Opioid Use Disorder

ABSTRACT Credibility and expectancy are important aspects of therapy/treatment processes. We aimed to perform cross-cultural validation and examine the psychometric properties of the Credibility/Expectancy Questionnaire (CEQ). Ninety-one patients with opioid use disorder from Tobacco, Alcohol, and Drug Addiction Treatment Program were included in the study. Sociodemographic data form, CEQ, Beck Depression Inventory (BDI), State and Trait Anxiety Inventory (STAI), and Attitudes Toward Seeking Psychological Professional Help Scale-Short Form (ATSPPHS-SF) were filled out by participants. Confirmatory factor analyses showed that CEQ has two factors in our sample, similar to the original version. Reliability analyses showed that CEQ has a high internal consistency and test-retest reliability. Regarding convergent validity results, CEQ was correlated with ATSPPHS-SF. No significant correlation was found between CEQ and BDI and STAI regarding discriminant validity results. In conclusion, the Turkish version of CEQ is a valid, reliable scale and could be used in patients with opioid use disorder. In patients with opioid use disorder, we contributed to the addiction literature by adapting a short and effective survey that measures trust and expectation.

Tests employed in the psychometric validation of the Insulin Treatment Appraisal Scale (ITAS) in T2DM patients; a systematic review of the literature

BackgroundPsychological Insulin Resistance (PIR) and negative perceptions regarding insulin treatment are noteworthy challenges in T2DM management, which hinder the timely initiation of insulin treatment. To get past these obstacles a reliable tool is required to evaluate patients’ perspectives on insulin administration. Our study aims to conduct a comprehensive systematic review to evaluate the validity and reliability of different validation tests used in the psychometric validation of the ITAS in T2DM patients.MethodsA literature search was carried out, using PubMed, Google Scholar, EMBASE, Cochrane Library and Science Direct. Only those studies assessing content validity, construct validity, concurrent validity, discriminant validity, internal consistency reliability (Cronbach’ α), and items-total correlation were retrieved.ResultsA total of 14 studies illustrated the validity and reliability of ITAS in T2DM patients. Content validity results of S-CVI was 0.97, and I-CVI was 0.8–1.00. Construct validity with factor loading was greater than the threshold value of 0.3. The concurrent validity of ITAS vs. PAID, WHO-5, and SPI was 0.35 (P < 0.05), −0.14 (P < 0.05), and 0.80 (P < 0.001) respectively. The mean difference between insulin and non-insulin group was significant (P < 0.001) showing reliable discriminant validity. Reported results of Cronbach’s α for the main scale (0.79–0.89), subscale-1 (0.72–0.9), and subscale-2 (0.61–0.89) showed “good to excellent” internal consistency reliability of ITAS. Item-total correlation results for the main scale, subscale-1, and subscale-2 were (0.40–0.82), (0.31–0.74) and (0.34–0.58) respectively. Test-retest reliability of ITAS was 0.571–0.87.ConclusionsStudy findings confirm the robustness of various validation tests utilized in the psychometric validation of ITAS in T2DM patients. ITAS is a well-validated and reliable tool for determining the perspectives, PIR, and changes in patients’ perception over time and it can be used to overcome hurdles in the timely initiation of insulin treatment in T2DM patients.

Developing Electronic School Report (E-Rapor) for Strengthening the Profile of Pancasila Students

The research aims to develop an electronic school report (e-report/e-rapor) to assess the achievement of competencies profiling Pancasila students. The development of this e-report facilitated the needs of schools that did not have an assessment system for the implementation of the Enhancing Pancasila Student Profiles Project (EP4). The e-report was developed in accordance with the Decision Letter of the Education Standards, Curriculum, and Assessment Agency (BSKAP) number 009. The development of this e-report used the development method approach, commonly known as Research and Development (R&amp;D). To test the feasibility of the developed e-report, it was evaluated based on two aspects: content validity and effectiveness. The respondents in this research were 30 teachers and/or school principals. The data analysis technique for analyzing data from the interactive e-report development process was descriptive to explain the process and the effectiveness for the product. The results of the e-report validity on the accuracy of dimensions and elements were as follows: 54% very accurate, 40% accurate, and 6% fairly accurate. Meanwhile, the accuracy of the assessment was 54% very accurate, 43% accurate, and 3% fairly accurate. The accuracy of other components was 57% very accurate, 37% accurate, and 6% fairly accurate. The e-report effectiveness on ease of use was as follows: 50% very easy, 47% easy, and 3% fairly easy. Then, the e-report attractiveness was 43% very attractive, 47% attractive, and 10% fairly attractive. The conformity of appearance with the EP4 concept was 60% very suitable, 34% suitable, and 6% fairly suitable. As a result, the e-report was recommended in assessing the implementation of EP4.

Nurses Wasteful Behaviors Attitude Scale: Validity and Reliability Study

Objective: This study aims to develop the "Nurses Wasteful Behaviors Attitude Scale" as a new measurement tool to evaluate the attitudes of nurses’ wasteful behaviours. Methods: The first phase of this study was carried out between May and September 2019, by conducting in-depth interviews with 60 healthcare professionals working in a university, a public and a private hospital, to provide maximum diversity using quantitative design. In the second stage of the research, a 56-item scale draft was created using the qualitative data. Using this draft, data was collected from 408 healthcare professionals working in the hospitals that formed the sample between January and March 2020. As a result of exploratory factor analysis, a scale consisting of 5 factors and 24 items was obtained. In the third and final stage of the research, to prevent bias in the scale items and to work with nurses, the literature was scanned and updated and an item pool consisting of 52 items was created. After the content validity results, a 50-item scale draft was obtained. Between February and December 2022, data was obtained from 503 nurses online. Results: The content validity index of the scale is 0.96. According to the exploratory factor analysis, the scale consists of 30 items and five sub-dimensions; sub-dimensions explained 58.17% of the total variance. The Cronbach's alpha value is .93. Conclusion: The scale has high internal consistency, time invariance, and fit indices. This scale can help take initiatives to prevent wasteful behaviors in hospitals and ensure sustainability.

Development of an Ergonomics Risk Assessment Tool for Pushing and Pulling (PUSHPULL) Activities at the Workplace

The observational method remains the most widely utilized for assessing the risk factor of Work-related Musculoskeletal Disorders (WMSDs) as it is inexpensive, quick and practical in field data collection. However, there is some limitation with the current risk assessment on Pushing and Pulling (PP), such as the need to use expensive force measuring equipment, limited coverage of critical variables for assessing the risk and psychometric properties for the method, which is not adequately established. This study aims to develop a new method for assessing the PP of wheeled equipment called the PUSHPULL method and establish the reliability and validity of the PUSHPULL method. Two stages are involved in developing the PUSHPULL method: i) development of PUSHPULL specification and ii) psychometric properties evaluation. Selection of variables for inclusion in the PUSHPULL method employed three strategies: i) literature review, ii) expert panel review, and iii) survey among Occupational Safety and Health (OSH) practitioners. Current assessment methods were also reviewed to assist in assigning rating scores. Psychometric properties evaluation was performed for content validity (representative, relevance and clarity) and inter and intra-rater reliability testing. Consequently, content validity was performed by six experts. The results of content validity (S-CVI/Ave) were discovered to be in the acceptable range of 0.97, 0.98 and 0.82, respectively, for representativeness, relevance and clarity. Based on the inputs from the expert panel, improvements were made, and prototype 2 was generated. Prototype 2 underwent reliability testing, and Gwet AC1 was discovered to be 0.596 (moderate) and 0.77 (good), respectively, for inter and intra-rater reliability. The PUSHPULL method was developed based on empirical data from a literature review, expert panel review and inputs from OSH practitioners. The method covers all the significant variables related to the risk of PP. Moreover, the reliability and validity of the PUSHPULL method were clarified during the development stage. The tool can determine the risk level and prioritize the intervention.

Aplikasi E-Modul Suhu dan Kalor sebagai Rancangan Bahan Ajar Fisika di SMA

Physics learning in SMA Negeri 1 Lumajang often uses textbooks rather than learning modules as learning resources, so it is necessary to develop physics e-modules. This study aims to determine the development design and the validity of physics e-modules of temperature and heat material in senior high school. The research method used is descriptive which describe phenomena or characteristics of the population under the study. The research instrument is a validation questionnaire, interview guidelines, and documentation. The data obtained were the results of validation conducted by 3 expert validators and 2 user validators. The results showed that the average value of the five validators covering four aspect of eligibility namely content, construct, language, the content feasibility aspect gets a score of 83%, the construct feasibility aspect gets a score of 83%, the language feasibility aspect gets a score of 90%, the display feasibility aspect gets a score of 86%. The overall average validation aspects of the five validators get a value of 85,8% with very valid criteria. Based on the research results obtained, it can be concluded that the physics e-module of temperature and heat material gets validity results with very valid criteria and can be tested for development to students at the research school.

Developing Questionnaires for the Technology Acceptance Model (TAM): A Study on the Teachers’ Acceptance of Using Online Education

Since the Movement Control Order (MCO) in 2020, Malaysia's Ministry of Education (MOE) has recommended online learning sessions. Traditional teaching methods need to be replaced with more modern approaches. This change allows students to participate in distance learning, making online learning more widely accepted in education. However, the challenges of online communication have intensified due to the pandemic. Some teachers may find the complexity of online platforms an obstacle and may use this as an excuse to avoid using technology. Another issue is the lack of computer proficiency, which can create a fear of technology. Additionally, the convenience of learning from any location at any time should be considered. Previous studies have shown that user motivation plays a crucial role in accepting technology. This study aims to develop an instrument that measures teachers’ acceptance of online learning based on the Technology Acceptance Model (TAM). The article will focus on developing a questionnaire to assess the following variables: teacher’s Perceived Usefulness, Perceived Convenience, Perceived Ease of Use, Attitude, Intention to Use, and Usage Behaviour in accepting technology. The study used a quantitative approach. The pilot test was conducted on the instrument for 40 secondary school teachers in Perak. The data were analysed both descriptively and inferentially. The reliability and validity results were significant and are expected to aid future researchers in developing better assessment tools. Keywords: Instrument development, questionnaire, Technology Acceptance Model, teachers’ acceptance, online education.

Validity of Local Wisdom-Based Insets Learning Model to Improve Critical Thinking Skills of Senior High School Students

Objective: This study aims to produce a valid learning tool for the local wisdom-based insets model to improve the critical thinking skills of high school students. Method: This research uses the Instructional Design Model (IDM) 1) needs analysis, 2) design and development of prototypes, 3) validation of socio-scientific issues, and 4) testing of socio-scientific issues prototypes. socio-scientific issues validation, 4) socio-scientific issues prototype testing, 5) socio-scientific issues evaluation, 6) socio-scientific issues revision. Validity was measured based on validation results from three expert lecturers. Data analysis was done descriptively and quantitatively. Results: The overall average test results of content validity with a very valid category, the overall average of construct validity with a very valid category, and the overall average validity of learning devices with a very valid category. The results showed that the insets model learning device based on local wisdom is valid for improving the critical thinking skills of high school students. Novelty: Students' critical thinking skills can be trained by integrating local wisdom-based insets learning model for 21st-century education.

Development of Encyclopedia Learning Media Based on Local Vegetables as An Innovative Biology Learning Resource

This research aims to produce an encyclopedia learning media that is both valid and practical for improving students' understanding of biodiversity material. The research utilized a modified 4-D development model, streamlined into 3-D, which included the stages of Define, Design, and Develop. The instruments used comprise interviews and documentation. Data analysis included validation of the encyclopedia's development and analysis of student responses to the developed media. The results from the validation tests and student responses indicated positive outcomes. Media experts rated the validation at 95.83% (very valid), material experts at 84.28% (very valid), and language experts at 83.33% (valid). Students who responded to the small-scale trial were very good, scoring 92.18% (very valid), while those who responded to the large-scale trial were also very good, at 91.03% (very valid). In conclusion, the validity results were very positive and the response outcomes were highly favorable. Thus, the encyclopedia media is deemed valid for use by educators and students in the biodiversity learning process.

DEVELOPMENT OF ETHNOSCIENCE-BASED INTEGRATED SCIENCE E-MODULES USING FLIPBOOKS ON THE THEME OF REBON SHRIMP PASTE

Integrated science learning in ethnoscience is very important because students can know the concrete form of local culture by constructing indigenous knowledge of the community in the process of making shrimp paste into scientific knowledge which is implemented through learning media in the form of e-modules. The purpose of this study was to produce an e-module and determine the level of validity, and student readability to an integrated science-based e-module based on ethnoscience using a flipbook with the theme of rebon shrimp paste. This type of research is development research using the ADDIE development model. The population in this study were all students of class VIII MTsN 2 Sumenep with a sample of class VIII-B. Sampling using purposive sampling technique. The instruments used were validation sheets of media experts, material experts, science teachers, and questionnaires student readability. The results showed that: 1) The results of the media aspect validity were 88.74% and the reliability value was 95.71% with very valid and very reliable categories. The value of the validity of the material aspect is 86.11% and the reliability value is 89.66% with a very valid and very reliable category. 2) Students' readability scores a percentage value of 88.18% with a very good category.

Psychometric properties of the Online Learner Satisfaction Instrument (OLSI): construct validity, convergent validity, and measurement invariance

The present study evaluated the validity of the Online Learner Satisfaction Instrument (OLSI) in terms of construct and convergent validity, and measurement invariance across demographic groups. The study results revealed that the factor structures generally confirmed to the original factor structure proposed in the instrument. Also, some subfactors showed a high correlation, suggesting a potential unidimensionality within each factor. The results of the convergent validity showed that the course subscale had high correlations with learner and instructor subscales, yielding inter-subscale correlations. The results of the measurement invariance testing showed that OLSI was interpreted the same way across participants of different gender and ethnic groups. However, measurement invariance was not supported across different educational levels (undergraduate vs. graduate).

Pengaruh Penerapan Budaya Agile terhadap Keterlibatan dan Kinerja Karyawan PT. ASDP Indonesia Ferry (Persero)

This research explores the impact of implementing Agile Culture on employee engagement and performance at PT ASDP Indonesia Ferry. Through a quantitative approach with a cross sectional survey design, data was collected from randomly selected employees. The analysis results show that Agile Culture has a significant influence on employee engagement and performance. Although the structural model showed low predictive power, the results of validity and reliability tests confirmed consistency in variable measurement. These findings confirm the great potential of Agile Culture in creating a responsive and productive work environment. The practical implication is that PT ASDP Indonesia Ferry can strengthen the implementation of Agile Culture through training and managerial support, while paying attention to factors that influence the predictive power of the model. Recommendations for further research include expanding the variables and sample population for a deeper understanding of the impact of Agile Culture. In conclusion, this research confirms that Agile Culture is an effective strategy in increasing employee engagement and performance, providing a foundation for the development of more effective HR strategies in the future.

Analisis Kualitas Instrumen Penilaian Berbasis Kelas untuk Mengukur Kompetensi Literasi Sains Peserta Didik SMA pada Materi Energi Terbarukan

The aim of this research is to analyze the quality of class-based instruments in the domains of knowledge, attitudes and skills to measure scientific literacy competency. This research uses a limited ADDIE research design consisting of Analyze, Design and Development stages. Data was collected using test and questionnaire methods. This research was tested on 30 Unesa Physics Education Study Program students. Theoretical validity results show that the assessment instrument prepared meets the valid category. The theoretical validity results were obtained from validation by 3 expert validators, namely 2 Unesa Physics Education lecturers and 1 MBI Amanatul Ummah Pacet Mojokerto teacher. Empirical validity was obtained from testing the assessment instrument on 30 active Unesa Physics Education students with a total of 15 questions. Then, the question item was declared valid with an rcount of 0.922 and an rtable of 0.361.

Cross-cultural adaptation of the empowerment scale of pregnant women in China context: An integrative method of translation and linguistic validation.

To translate the Empowerment Scale for Pregnant Women (ESPW) into Chinese and to assess its linguistic validity. The integrative method of the translation process, the Delphi technique, and cognitive interviews were used to implement cross-cultural adaptation and enhance comprehensibility and linguistic validation. This study recruited 14 experts in the expert review and cognitively reviewed 15 pregnant women. The two-round Delphi method created agreement on cultural applicability. The results of content validity achieved good levels: The item-level content validity index (CVI) ranged from 0.78 to 1.00, and the scale-level content validity index, calculated using two different formulas, were 0.97 and 0.81, respectively. Kappa values ranged from 0.74 to 1.00. Pregnant women could understand most of the items and response options in the cognitive interview. The revisions to the wording were made based on suggestions from experts and pregnant women. The prefinal simplified Chinese ESPW was semantically and conceptually equivalent to the English version, which was well prepared for further psychometric tests in the next stage of cross-cultural adaptation. This comprehensive method successfully developed a Chinese tool to measure the empowerment of pregnant women, indicating the international applicability of this tool and the methodological scientific nature. The simplified Chinese ESPW has the potential to support the identification of empowerment levels of pregnant women and the evaluation of the effectiveness of health education and promotion programmes.