Validity Results Research Articles

Analysis of Validity and Learner Response to the Development of Pro-Environment Based Teaching Materials on Global Warming Material

Pro˗environmental attitudes are specific actions a person takes to minimize the negative impacts of human activities on the environment and environmental health. This research aims to determine the validity and response of senior high school students to environment˗based teaching materials. This study is classified as research and development (R&D), and the ADDIE model, which stands for analysis, design, development, implementation, and evaluation, is the paradigm used. Two media validators and two material validators verified the teaching materials. The validation results from material aspects obtained a percentage of 1.6% and media aspects a percentage of 6%, both of which are included in the valid category. Students' response results to teaching materials are in the very practical categories, with a mean percentage of 85%. Based on the results of validity and student responses, it can be concluded that the pro-environment-based teaching materials on global warming developed are valid and can be used in the physics learning process in high schools to increase students' knowledge and character towards the environment.

Contact point marking with the OccluSense system-an invitro study on reliability and validity.

Occlusal contacts can be stained and thereby visualised employing occlusal indicators. Qualitative and quantitative indicators are differentiated. The hybrid system OccluSense supposedly combines analogue contact marking and digital registration of contacts. The reliability and validity of its contact marking have not yet been validated. The aim of this controlled randomised in-vitro study was to examine the reliability and validity of analogue contact staining with OccluSense compared to Arti-Fol and the reference standard Gnatho-Film. An experimental apparatus was designed to simulate static occlusion. The occlusal contacts were stained 50 times with Gnatho-Film to determine the average number and location of contacts registered. For comparison, the contacts were pre-stained with Gnatho-Film and then registered with Arti-Fol or OccluSense 50 times each. Every staining was statistically evaluated and compared to Gnatho-Film alone, regarding the number and location of contacts. Based on the observed characteristic staining behaviour of OccluSense, a modified evaluation strategy was developed for its colour markings (OccluSense (mod.)). Both evaluations of OccluSense determine that the same number of contacts was registered in over 94% of all cases. Neither OccluSense nor Arti-Fol stain the exact same number of contacts as Gnatho-Film, but the modified evaluation OccluSense (mod.) did improve the results for validity. When employing the modified evaluation strategy, OccluSense staining achieves similar reliability and validity as the reference standard. Pre-colouring of occlusal contacts with Gnatho-Film and the modified evaluation strategy, might become standard for analysing occlusal contacts stained by OccluSense in the future.

School Participation Questionnaire (SPQ): Italian Translation, Cultural Adaptation, and Pilot Testing in Children with Neurodevelopmental Disorders.

According to leading occupational therapy models, the environment appears to be a key element in fostering occupational performance and participation. There is an emerging need to identify an instrument that can assess these aspects in the school environment. Currently, there are no rating scales in Italy for the school participation of children with neurodevelopmental disorders. For this reason, this study aims to culturally adapt and translate the School Participation Questionnaire (SPQ) to Italian and to pilot test the translated Italian version on children with neurodevelopmental disorders. The original scale was translated from English to Italian using the guidelines "Translation and Cultural Adaptation of Patient Reported Outcomes Measures-Principles of Good Practice". The psychometric properties analyzed were the following: content validity, construct validity, cross-cultural validity, and internal consistency. Construct validity was assessed using the Italian version of the Sensory Processing Measure (SPM). The Italian version of the SPQ was administered to 22 children. The mean ± SD of the score was 9.32 ± 1.36; Cronbach's α was 0.935 (p < 0.01). The Pearson's correlation coefficient with the SPM scores was -0.622 (p < 0.01). This pilot testing study for the validation of the Italian version of the SPQ showed good validity and reliability results. Thanks to this study, it would be possible to further analyze the tool for the evaluation of the environment and school participation of children with neurodevelopmental disorders, in particular autism spectrum disorder. It is a quick and easy instrument that focuses on the environment as an active variable in the child's occupational performance.

Development of An Interactive E-Module Based on Blended Learning to Enhance Student Independence and Learning Outcomes

This study aims to analyze the feasibility and effectiveness of interactive e-modules based on blended learning to increase independence and learning outcomes on acid-base materials. This research is development research using the Borg &amp; Gall model which consists of ; 1) Research and Information collection, 2) Product planning, 3) Product development, 4) Product validation, 5) Product revision, 6) Product trial. The subjects of this study were chemistry lecturers and chemistry teachers as well as students of SMA Negeri 1 Krembung Sidoarjo who took chemistry specialization. The instruments used were review and validation sheets, learning independence questionnaires, response questionnaires, and learning outcomes test sheets. Data analysis using the N-gain to determine the increase in student independence and learning outcomes. The validation results are processed using the mode of each statement, the results of content validity get mode 5 with very valid criteria, and construct validity get mode 4 with valid criteria. The results of this study indicate that learning chemistry using interactive e-modules based on blended learning can increase learning independence with an n-gain value at 3 meetings of 0.49 in the medium category and learning outcomes with an average n-gain value of 0.69 in the moderate category. Therefore, the interactive e-module based on blended learning developed is feasible and effective to be used to improve students' independence and learning outcomes on acid-base materials.

Differentiated Science Student Worksheets : What is the Level of Collaboration Skills of Students of the Elementary School Teacher Education Study Program?

This study aims to develop content-differentiated science student worksheets for students of the elementary school teacher education study program, especially on the subject of the human respiratory system, and analyze its effect on student collaboration skills. This research method used research and development with the 4D model (define, design, development, and dissemination). The sample in this study was 142 2nd semester students of elementary school teacher education study program at PGRI University Yogyakarta. The data was taken through student worksheets documentation, score lists, interviews, observations, validation assessment scales, and student collaboration skills questionnaires. The data analysis technique in this study used qualitative descriptive analysis techniques. Based on the research results, the student worksheets products that have been developed meet the validity criteria with an overall average of 97% in the very valid category. The validity and reliability results of the student collaboration skills questionnaire for the student worksheets developed have met the valid and reliable criteria. The results of the student collaboration skills trial given to 142 students on the developed student worksheets were the order of the number of students who always carried out collaboration skills starting from the responsible aspect (79%), the respect aspect (77%), the productive work aspect (71 %), aspects show flexibility (71%), and aspects contribute actively (38%). Meanwhile, the average number of students is 22% of students at a good level in collaborating and 78% of students are very good at collaborating.

Development of Teaching Material Based on Massenrempulu Localwisdom for Early Childhood Education in Enrekang Regency

This research is research and development using the ADDIE Model which aims to (1) reveal in detail the need for Massenrempulu local wisdom-based teaching materials for PAUD in Enrekang Regency, (2) describe the validity of Massenrempulu local wisdom-based teaching materials for PAUD in Enrekang Regency, and (3) describes the practicality of teaching materials based on Massenrempulu local wisdom for PAUD in Enrekang Regency. The subjects in this research were TK Negeri Percontohan Enrekang Ragency. The data in this research were obtained from validity tests based on expert opinions, practicality tests based on teacher responses, and effectiveness tests based on the results of pre-test and post-test students' learning motivation. Based on the results of validity, practicality and effectiveness tests, itcan beconcluded that Massenrempulu local wisdom-based teaching materials are valid, practical and effective for use in PAUD in Enrekang Regency.

대학생 미래 리터러시 진단도구 개발 및 타당화

Objectives The purpose of this study is to develop and validate diagnostic tools for futures literacy. To achieve this, definitions of future literacy, identification of sub-elements, and diagnostic items were proposed. Methods Through analysis of previous research, the definition, components, and diagnostic items of future literacy were identified, and feasibility was reviewed through the Delphi survey technique targeting 11 experts. To ensure the construct validity and reliability of the items, data were collected from 244 college students. Exploratory factor analysis was performed on the collected data, and confirmatory factor analysis was performed using the AMOS program to specifically verify the model suitability and validity of the factors and items. Results Reflecting the results of the construct validity and reliability analysis of 68 items, a total of 39 items were deleted, and a diagnostic tool consisting of a total of 29 items was completed. When examining the results of factor analysis and reliability analysis for a total of 29 diagnostic items, the Bartlett sphericity test result was significant at p &lt; .001, and KMO was .861, which was above .5, so it appeared to be a matrix suitable for factor analysis. Conclusions Ultimately, the definition and components of future literacy and 29 diagnostic items defined by factor were confirmed, which can be used as a quantified diagnostic inventory in planning and operating future literacy education programs.

Development of Test Instruments Utilizing Multiple Representations for Enhancing Understanding of Motion Kinematics

Problem-solving in physics remains low due to the limited use of varied or multi-representation test instruments. This study aims to develop a multi-representation-based test instrument on kinematic motion and describe the results of the logical validity and empirical trials of the developed multi-representation-based test instrument for kinematic motion. This research follows a Research and Development (R&amp;D) approach, using stages synthesized from various expert opinions, ranging from needs analysis to test assembly. The research instrument consists of a multi-representation-based test consisting of 30 questions. The data were analyzed using ANATES after being reviewed by three experts. The results indicate that 30 test items were successfully developed, with an average logical validity score of 0.63, demonstrating that the test instrument is valid and feasible for use. Based on statistical analysis, including item validity, difficulty level, discrimination index, and reliability, the empirical validity results show that 11 test items are suitable for use.

Diagnosing Elementary School Students' Representation of Light Concept Through the Five-tier Diagnostic Test

Elementary school students do not yet have a scientific understanding of light. For example, they represent vision as the process of objects being hit by light and the eye being automatically able to see them. Their verbal and visual representations present irrelevance to scientific beliefs. Students need to understand science more comprehensively through multiple-representation learning. The relevant diagnostic tests are needed to find out student multiple-representation profiles. However, diagnostic tests identifying multiple-representation profiles of elementary school students are still rare. This paper aims to communicate the results of development, validity, and reliability, as well as trials of the five-tier diagnostic test (5TDT) in measuring multiple representations of elementary school students about light concepts. The 5TDT is a developed version of the four-tier where there are answer choices and reasons and the level of student confidence in answering both. A package of 15 questions was developed, tested for readability by elementary school teachers and students, and then piloted. Two hundred twenty-seven elementary school students who had studied the concept of light attempted this test. Internal validity was submitted to five experts and showed valid results with several improvement notes. Meanwhile, the results of statistical tests on external validity and reliability show that the five-tier diagnostic test is valid and reliable. The five-tier diagnostic test can measure the diversity of students' representation of their ideas regarding the light concept with more precision. It is shown that they are dominating the Lack of Representation (LOR) level of 39% and Misconception (MIS) level of 31%.

The Influence of Paylater and Affiliate Features on Consumer Buying Interest in Shopping on the Shopee Aplication

The paylater feature is a digital payment feature that uses an e- commerce platform, purchasing goods among teenagers is very lacking due to the economic conditions that are currently unstable. The method used in this research is quantitative method. The population in this study was conducted at the unswagati Cirebon campus, level 1-4 management study program as many as 147 respondents. The sampling technique used by researchers is non-probability sampling with purposive sampling technique and data analysis used in this researcher is regression and descriptive analysis then the analysis methods used in this study include validity test, cross tabulation, reliability test, normality test, multicollinearity test, hypothesis testing, path analysis fit model test using SPSS and amos Softwer analysis tools to test the effect of paylater and affiliate features on consumer buying interest. The results of this study indicate that the paylater feature has a positive effect on consumer buying interest, affiliates have an effect on consumer buying interest. Because the validity and reliability test results are less than 0.1362, the normality test is less than 0, 01, the multicoronality test is less than 10, hypothesis testing, the results show that all hypotheses are accepted, because the C.R value is more than 1.98, namely with a C.R value of 7.875 and 11.532 respectively. And the P value also shows the same result if the P value is less than 0.05 or symbolized * (below 0.01), it means that the two hypotheses have a significant effect or are accepted. path analysis fit model test is accepted because the GFT measure shows a P-value of more than 0.05, RMSE less than 0.08, CMIN less than 2.00, GFI less than 0.90, AGFI less than, 0.90, CFI more than 0.90, TLI more than 0.90. So it can be stated that the path analysis model fit test is accepted.

Feasibility of Four-Tier Multiple Choice Diagnostic Test for Identification Conception on Chemical Equilibrium Concept

The purpose of this study was to obtain the feasibility of a four-tier multiple choice (4TMC) diagnostic test instrument for the identification of conceptions on chemical equilibrium material in terms of validity, practicality, and effectiveness criteria. This type of research is ADDIE development research with the Analyze, Design, Development, and Evaluation stages. Validity is obtained from a validation sheet consisting of construct, content, and language validity which gets mode = 4, so that the four-tier multiple choice instrument is said to be valid. Practicality is obtained from a learner response questionnaire supported by a learner activity observation sheet. Practicality in terms of the student's response questionnaire is 84% with a very practical category, while the student activity observation sheet gets mode = 1, so the diagnostic test instrument is said to be practical. Effectiveness is obtained from the diagnostic test instrument reliability test. The Cronbach alpha value obtained in the reliability test was 0.798, so the diagnostic test instrument developed was declared reliable. Based on the results of validity, practicality, and effectiveness, the four-tier multiple choice diagnostic test instrument is declared suitable for use.

Correlation of Character Values in the Qur'an and Hadith in Hamziyah Ahmad Syauqi Poetry Towards the Ethics of PBA College Students at UIN Walisongo

This study aims to determine the correlation of character values in the Qur'an and hadith in Hamziyah Ahmad Syauqi on the ethics of PBA UIN Walisongo College Students. The approach used to obtain data is a mix method through the technique of distributing questionnaires, observations and interviews. with the pattern "the dominant-less dominat design", Population of PBA College Students of UIN Walisongo Semarang. The samples used in this study were 50 PBA UIN Walisongo College Students, 3 lecturers and 10 College Students to conduct interviews. The data collection technique used in this needs analysis is a survey technique. The questionnaire was used as a tool that was compiled and distributed through the Google form platform. The data analysis used is descriptive statistical analysis. Based on the validity and reliability test results, it can be determined that the questionnaire used for data collection has valid and reliable items. According to the survey results, 97% of the character values contained in Hamziyah ahmad syauqi affect College Students' ethics.

Pengembangan E-Modul berbasis Website untuk Pengoptimalan Pembelajaran Daring pada Mata Kuliah Anatomi Tumbuhan

This research aims to develop website-based e-module learning media to optimize online learning in plant anatomy courses in the Biology Education Study Program at UIN Alauddin Makassar. This research and development research uses the ADDIE (Analyze, Design, Develop, Implement, Evaluate) development model. Data collection instruments include validation sheets, questionnaires, and learning outcomes tests. The data analysis technique is related to measuring the validity, practicality and effectiveness of website-based e-modules. The research results show that the website-based e-module learning media for optimizing online learning in plant anatomy courses meets the valid, practical and effective categories. Based on the results of validity and practicality, this media is suitable and practical for use as a learning medium in plant anatomy courses, especially in blended learning.

Development of Teaching Performance Evaluation Application for Lecturers Using K-Nearest Neighbor Method with Manhattan Distance Approach

Based on the initial observation, there are several underlying issues that form the basis of this research. The teaching performance evaluation at Padang State University has limitations regarding the courses to be evaluated. Each student can only evaluate 5 (five) courses per semester, where these five courses are randomly selected by the system, allowing each student to evaluate different courses even in the same class. The evaluation of teaching performance at Padang State University is not specific to individual lecturers but to the courses. One course can be taught by several lecturers, so students evaluating the learning cannot provide assessments for each lecturer. This results in each lecturer not having their own performance results. Furthermore, the teaching performance evaluation at Padang State University does not have a classification for the filled evaluations, thus requiring a long time to calculate the final results. This study uses the Research and Development (R&amp;D) method with the 4-D development model consisting of four stages: definition, design, development, and dissemination. The type of data used is primary data obtained from 3 media validators, the evaluation administration of Padang State University, and 46 students. The data analysis technique used is descriptive data analysis to describe the validity and practicality of the developed lecturer performance evaluation application. The results of this development study produced a lecturer performance evaluation with 202 training data, 47 test data, resulting in an accurate system with a precision value of 88.76%, a recall value of 89.93%, and a program accuracy value of 94.04%. The validity results of the web-based learning evaluation conducted by media experts obtained a score of 0.864 with a valid category. The practicality value of using web-based lecturer performance evaluation by students obtained a score of 87.42 with a practical category. Meanwhile, the practicality value obtained by the evaluation administration of Padang State University is 89.33 with a practical category.

Assessing the Creative Thinking Level of In-Service Chemistry Teachers Using a Case Study Test

In the 21st century is an urge that teachers are not only required to change teaching methods but also have a role and responsibility to be able to motivate students' reasoning and logic to think critically, creatively, and innovatively. This study was conducted to assess the level of creative thinking skills of high school chemistry teachers in one of the districts/cities in Yogyakarta Province. As a survey with a quantitative approach, this study involved 24 in-service chemistry teachers as respondents. All of the population became the respondents in this study so that saturated sampling technique was applied. Creative thinking skills were measured using the creative thinking skill test (CTST). The results of the Aiken content analysis validity show that the instrument was suitable to apply with a score of 0.92. Six out of 10 test items are empirically valid with a reliability value of 0.697. CTST was filled in by respondents at the chemistry teachers' meeting forum. Data analysis was carried out using descriptive statistics to answer the categories of in-service chemistry teachers’ creative thinking. Based on the results of CTST, it was 3.20 related to a sufficient creative thinking level category. The current research result suggests professional training for teachers to optimize their creativity in chemistry teaching strategy.

Quality of Education Services and Community Satisfaction with SDIT Using The Servqual Model

This research develops a model through measuring the quality of educational services towards the competitive excellence of SDIT (Integrated Islamic Primary Schools). This research aims to test the gap scores for each dimension of each SDIT, thus it can determine the right marketing strategy to satisfy and increase the interest of new students’ parents who believe that their children will receive an education at an excellent Islamic Elementary School. The research was using a quantitative approach through respondent description, item validity and reliability, and ServQual model statistical tests. The population in the research was all people who believe in Integrated Islamic Primary School education in Klaten Regency. This research used a purposive sampling technique of 100 respondents. The attributes in the questionnaire were adapted from the ServQual concept which is suitable in the realm of educational research including tangibles, reliability, responsiveness, assurance and empathy. Quantitative tests include validity tests, item reliability and ServQual confirmation tests. The test results of validity and reliability were valid and reliable. The confirmation test score has a positive average value of 60.27 with the lowest positive value in the reliabilities dimension of 28.45, followed by tangibles 34.28, responsiveness 72.58 assurance 88.44 and empathy has the highest value of 127.60. Improvement efforts must continue to be made by the SDIT management with an emphasis on improving the value that still has the lowest positive dimension followed by the next positive value. Increasing the quality of SDIT's educational services by implementing the Total Quality Management concept optimally will lead to increased community satisfaction and strengthened SDIT's competitive performance in the future.

Reliability, Validity and Acceptability of the PEDI-CAT with ASD Scales for Australian Children and Youth on the Autism Spectrum.

The PEDI-CAT (ASD) is used to assess functioning of children and youth on the autism spectrum; however, current psychometric evidence is limited. This study aimed to explore the reliability, validity and acceptability of the PEDI-CAT (ASD) using a large Australian sample. Caregivers of 134 children and youth on the spectrum participated in clinical assessments involving the administration of the PEDI-CAT (ASD), Vineland-3, PEDI-CAT (Original) and a feedback instrument. The PEDI-CAT (ASD) content was compared to the ICF Core Sets for ASD to summarize areas of functioning assessed and relevance to autism. The PEDI-CAT (ASD) demonstrated good to excellent internal consistency and test-re-test reliability. Parallel forms reliability with the PEDI-CAT (Original) included significant correlations (good to excellent), however, t-tests showed significantly higher Social/Cognitive scores for the ASD version. Convergent validity results demonstrated that most PEDI-CAT (ASD) and Vineland-3 core domains were significantly correlated (poor to good). Content analysis revealed that the PEDI-CAT (ASD) covered less than half of the ICF Core Sets for ASD (mostly Activities and Participation codes). Just over half the codes assigned to the PEDI-CAT (ASD) were represented in the ICF Core Sets for ASD. Feedback on the acceptability of the measure was mixed, but overall was it was considered user-friendly and efficient. The PEDI-CAT (ASD) had adequate psychometric properties and acceptability as a measure of Activities and Participation codes. However, it lacks comprehensiveness and relevance when compared to the ICF Core Sets for ASD and has the potential to overestimate functioning.

Interrater reliability of the violence risk assessment checklist for youth: a case vignette study

BackgroundFacilities providing health- and social services for youth are commonly faced with the need for assessment and management of violent behavior. These providers often experience shortage of resources, compromising the feasibility of conducting comprehensive violence risk assessments. The Violence Risk Assessment Checklist for Youth aged 12–18 (V-RISK-Y) is a 12-item violence risk screening instrument developed to rapidly identify youth at high risk for violent behavior in situations requiring expedient evaluation of violence risk. The V-RISK-Y instrument was piloted in acute psychiatric units for youth, yielding positive results of predictive validity. The aim of the present study was to assess the interrater reliability of V-RISK-Y in child and adolescent psychiatric units and acute child protective services institutions.MethodsA case vignette study design was utilized to assess interrater reliability of V-RISK-Y. Staff at youth facilities (N = 163) in Norway and Sweden scored V-RISK-Y for three vignettes, and interrater reliability was assessed with the intraclass correlation coefficient (ICC).ResultsResults indicate good interrater reliability for the sum score and Low-Moderate-High risk level appraisal across staff from the different facilities and professions. For single items, interrater reliability ranged from poor to excellent.ConclusionsThis study is an important step in establishing the psychometric properties of V-RISK-Y. Findings support the structured professional judgment tradition the instrument is based on, with high agreement on the overall risk assessment. This study had a case vignette design, and the next step is to assess the reliability and validity of V-RISK-Y in naturalistic settings.

Unlocking Business Success: The Role of Financial Literacy, Innovation Capability, and Government Support

Purpose: This study aims to analyse the effect of financial literacy and innovation capability on business performance with government support as a mediating variable. Theoretical framework: Government Support as a mediation was analyzed the effect of financial literacy and innovation capability on business performance. Method: A quantitative methods approach was used by distributing questionnaires to 110 Food &amp; Beverage MSME in Jakarta Area. The data collection process was carried out using google form, then analysed using path analysis processed using Smart-PLS. Result: This study found that financial literacy has positive impact on government support but innovation capability has not, then innovation capability and government support have the positive effect on MSME performance, but financial literacy has no impact on MSME performance. The mediation test found that government support mediates the effect of innovation capability and financial literacy on MSME performance. Research, Practical &amp; Social implications: This finding suggests that the government as a regulator should continue to increase its support for MSME actors so as to improve the performance of MSME businesses. This finding encourages MSME actors to have strong instincts in creating and implementing the latest innovations in their business to get government support in improving their business. Originality/value: This study uses 3 business performance indicators using primary data which are usually used in analysing the company's secondary data, with sufficient validity and reliability results, the use of these indicators is also suitable in analysing business performance in primary data.

Designing and validating of a questionnaire measuring perceived self-care ability (PSCA) in chronic stroke patients at home

BackgroundPatients with a stroke often cannot care for themselves after hospital discharge. Assessment of their self-care ability is the first step in planning post-discharge home care. This study aimed to design and validate a measure of perceived self-care ability (PSCA) in stroke patients.MethodsA sequential-exploratory mixed method was conducted in Tehran, Iran, in 2020–2021. The qualitative phase involved in-depth semi-structured interviews with 12 participants. Transcripts were content analyzed. The results guided the development of 81 items. psychometric properties such as face validity (Impact Score > 1.5), content validity ratio (CVR > 0.63), content validity index (Item Content Validity Index: ICVI > 0.78, Scale Content Validity Index/Average: SCVI/Ave > 0.8) and Kappa value (Kappa > 0.7), internal consistency (Cronbach’s alpha > 0.7), relative reliability (ICC: inter class correlation coefficient), absolute reliability (Standard Error of Measurement: SEM and Minimal Detectable Changes: MDC), convergent validity (Correlation Coefficient between 0.4–0.7), interpretability, responsiveness, feasibility, and ceiling and floor effects were assessed.ResultsContent analysis of the qualitative interviews yielded 5 major categories and 9 subcategories that reflected "Perceptual stability", "Cognitive fluctuations", "Sensory, Motor and Physical health",” The subjective nature" and "The dynamic nature” of PSCA. Results of face and content validity reduced the number of items to 32, capturing three dimensions of PSCA in chronic stroke patients; these dimensions included perceptual ability, threatened health status, and sensory, motor, and cognitive ability. The findings supported the reliability and validity of the measure.ConclusionsThe PSCA questionnaire was developed and validated within the Iranian culture. It is useful in assessing the self-care of patients with stroke and in informing practice.