Content Validation Process Research Articles

Medical students attitudes towards patients with disability: a scale validation study

BackgroundDisparities in health outcomes among persons with disabilities (PWD) are influenced by preventable factors including negative attitudes and discriminatory practices of healthcare professionals and the limited training of medical students in working with PWD.ObjectiveThe purpose of this study was to validate the “Medical Students’ Attitudes Towards Patients with Disabilities” (MSA-PWD) scale among Lebanese medical students and identify associated factors.MethodA scale validation study was conducted as part of the standard internal evaluation process at the medical school, using a cross-sectional design based on a qualitative content validity process, involving students from years 1 to 4. The study included questions from previous tools, and others encouraging students to reflect on their encounters with PWD and share their insights. Statistical procedures were applied to assess the reliability and validity of the tool, including construct validity, convergent validity, known-group validity, and trend analysis.ResultsAfter a careful selection of the related items, the MSA-PWD scale demonstrated high construct validity and internal consistency, along with good convergent validity and known-group validity. Factor 1 of the scale was able to differentiate between different enrollment years of medical students, correlating with the self-assessment tool for confidence in dealing with PWD and clinical experience scenarios.ConclusionThe “Medical Students’ Attitudes Towards Patients with Disabilities” scale validated in this study is a comprehensive instrument that can distinguish between different medical school enrollment classes. The newly developed scale was valid, and reliable.

Combined exercise Intervention protocol validation in sedentary workers health risk with Nonspecific Chronic low back pain People

Background: Most chronic low back pain is nonspecific as the cause of the pain is unknown. Hence exercise protocol focussing on one area of fitness is not appropriate. A general exercise programme that combines muscular strength, flexibility and aerobic fitness would benefit the rehabilitation of Nonspecific Chronic Low Back Pain and its health risk. The present study aimed to validate the content of the combined exercise intervention protocol. Methods: The development and expert judgement stages are part of the content validation process. The development of the exercise protocol was based on a comprehensive literature review. The protocol was created in a step-by-step progressive manner. Exercises for flexibility (20 minutes), stabilisation and strengthening (20 minutes), and aerobic (20 minutes) make up the three main parts of the exercise protocol. 12 independent professionals with a minimum of 10 years of experience were invited. Ten of the twelve specialists consented to take part in the study. In India, all of the professionals were engaged in orthopaedic and musculoskeletal physical therapy. There are two professors, three associate professors, and five senior physiotherapists among the experts. Responses were gathered by mail. During the validation phase, The Exercise protocol was graded by the experts on relevance and ease of performance using a 5-point scale. After collecting the responses content validity index and kappa values were calculated. Results: 37 out of 39 items in the combined exercise intervention protocol showed good agreement. Treadmill walking with 60-75% and 80% and above target heart rate showed a kappa value of 0.66 for relevance and 0.50 for ease of performance. Conclusions: The designed exercise protocol exhibited good content validity.

Development and validation of Tamil version of CARIES-QC questionnaire among socially marginalized school children in Chennai City.

The Caries Impacts and Experiences Questionnaire for Children (CARIES-QC), which was developed to assess dental caries-specific Child Oral Health Related Quality of Life (COHRQoL), has been translated into few world languages. To develop and validate the Tamil version of Caries Impacts and Experience Questionnaire for Children (CARIES-QC). This cross-sectional study was conducted among socially marginalized school children in Chennai City. The initial translation of the English CARIES-QC questionnaire to Tamil was made by two independent translators followed by an expert committee discussion to derive a prefinal version of the Tamil questionnaire. Subsequently, content validation was performed by bilingual subject experts followed by preliminary pilot testing among 30 school children aged 8-10 years studying in Adidravidar Welfare High School, Chennai, to produce the final version of the questionnaire. Convergent validity, discriminant validity, and test-retest reliability of the translated questionnaire were tested among 191 children. The content validation process revealed that the translated version had relevant questions and content coverage (Scale-wise Content Validity Index score = .91). The children with and without dental caries had mean CARIES-QC scores of 5.39 + 3.7 and 3.71 + 5.1, respectively, and their statistically significant difference (p-value = .04) between them indicates the scale's satisfactory discriminant validity. The Cronbach's alpha was .87 indicating the questionnaire's good internal consistency. The newly developed Tamil CARIES-QC questionnaire is a valid and reliable tool for assessing COHRQoL among Tamil-speaking school children.

Knowledge of development during pregnancy and the transition to parenthood: Psychometric properties of the Domains of Development Instrument

Researchers and practitioners need robust measurement tools for evaluating knowledge of child development to better support parents and their children during pregnancy and the transition to parenthood. We addressed this need by evaluating the psychometric properties of the Domains of Development Instrument (DoDI) for measuring knowledge of developmental milestones from birth to 3 years. We evaluated four types of validity evidence for the DoDI: test content, response processes, internal structure, and relations to other variables. We convened an expert panel to evaluate test content and conducted cognitive interviews with mothers to evaluate response processes. We also collected responses from a sample of 418 English-speaking pregnant women to evaluate internal structure and relations to other variables. We observed content validity and response process validity, as well as the predicted internal structure, internal consistency, test–retest reliability, and convergent validity. We conclude with recommendations for future research with the DoDI.

Psychometric properties of the newly developed self-report environmental determinants of health questionnaire (EDH-Q): development and validation

BackgroundThe environmental determinants of health (EDH) have a significant impact on people’s physical, mental, and social wellbeing. Everyone needs access to environmental resources of all types, including food, materials, and energy, to survive. Currently, no valid and reliable instrument exists for evaluating individuals’ perceived levels of EDH. Hence, the purpose of this study was to develop and validate the environmental determinants of health questionnaire (EDH-Q) among undergraduate students in Nigeria.MethodWe conducted a cross-sectional survey among undergraduate students in Nigeria to assess the psychometric properties of the newly developed Environmental Determinants of Health Questionnaire (EDH-Q). Respondents were selected using a convenience sampling approach to evaluate their perceptions of environmental determinants of health. The Content Validity Index (CVI) and Face Validity Index (FVI) were calculated to ascertain the scale’s content validity and response process validity, respectively. Additionally, exploratory factor analysis (EFA), confirmatory factor analysis (CFA), composite reliability (CR), average variance extracted (AVE), Cronbach’s alpha, and intraclass correlation coefficient (ICC) were computed to assess the scale’s construct validity.ResultsThe study involved 300 respondents in the EFA (males 55.7%, females 44.3%) and 430 respondents in the CFA (males 54.0%, females 46.0%). In the EFA, two constructs were identified (the natural environment and the built environment). The EFA model was able to explain 63.57% of the total cumulative variance, and the factor correlation was 0.671. The whole scale Cronbach’s alpha value was 0.947, while the two constructs’ Cronbach’s alpha values were 0.918 (natural environment) and 0.935 (built environment). In the CFA, six pairs of error covariances were included between items within the same construct to improve the fit indices of the initial proposed measurement model. The final re-specified measurement model showed that the EDH-Q, which has two constructs and 18 items, has adequate construct validity (CFI = 0.948, TLI = 0.938, SRMR = 0.046, RMSEA = 0.052, and RMSEA p-value = 0.344). The CRs were 0.845 (natural environment) and 0.854 (built environment). The ICCs were 0.976 (natural environment) and 0.970 (built environment).ConclusionThe results show that the newly created EDH-Q has sufficient construct validity and may be utilized to assess participants’ perceptions of their level of EDH. Researchers should examine this instrument in populations with different age ranges and other demographic characteristics, as the present study only applied it to undergraduate students who may share similar characteristics.

Single-Leg Countermovement Jump Compensation Assessment: Content Validity of a Checklist.

Jump actions are common in several sports, and their performance is related to a myriad of biomechanical and physiological factors, with links to athletic performance and imbalances. Currently, a valid, field-based, easy-to-use tool to assess the quality of an explosive jump movement, similar to the required sports movements, is unavailable. Thus, the present study aimed to design and validate a field-based, easy-to-use tool that can be used to assess the quality of movement during an explosive single-leg countermovement jump (SL-CMJ). Ten experts participated in the content validation process for the checklist, including checking item relevance, definition accuracy, and scoring adequacy. Content validity was measured using the Aikens V format. The checklist included the items "Foot orientation," "Knee valgus/varus," "Internal/external hip flexed orientation," "Pelvis tilt," "Thorax tilt," "Thorax rotation," "Foot pronation/supination," "Asymmetrical hip," and "Lumbo-pelvic association". The items achieved a 0.60-0.99 in relevance, 0.70-1.00 in definition accuracy, and 0.80-0.83 in scoring adequacies in the Aikens V proof. The results from the context validation process suggest that the tool may be appropriate to assess athletes' quality of explosive movement. Furthermore, the results derived from such assessments may help to design better and safer training interventions.

Developing a Tool for Assessing Perceived Parental Socialization of Emotions in Adolescents and Young Adults.

Parenting practices have been described as the practices employed by a parent and the parent-child communication, with the focus on raising a child in the best possible manner while instilling cultural,ethical, and personal values. One similar yet different construct that holds significance in the development of a child is parental socialization of emotion. Parental socialization of emotion is the interaction between the parents and child regarding the emotional experience of the child. This has been considered an essential marker of the development of the emotional and social competence of an individual. There are several scales in the aspect of parenting practices. However, scales for parental socialization of emotionespecially considering the perception of adolescents and young adults have yet to fully be explored. The aim of the study is to establish a comprehensive tool that enables the measurement of perceived parental socialization of emotion (PPSE). The process of tool construction, data collection, and analysis was done in five phases that included reviewing existing tools and identification of domains (Phase 1); generation of an item pool (Phase 2); content validity, face validity, and inter-rater reliability (Phase 3); finalization of the tool for data collection (Phase 4); and data collection and analysis (Phase 5). The study for tool construction included participants from ages 13-28 years representing adolescents and young adults from schools and colleges located in New Delhi, India, as well as Gwalior, Madhya Pradesh, India. The research designused was a cross-sectional design, and the data were collected through purposive sampling, including males (N = 337) and females (N = 424). Exploratory factor analysis (EFA) was used to check the factorability and for item reduction. The results aided in reducing the number of items from 160 to 46 including the process of content validity, inter-rater reliability, item-total statistic, and factor loading of EFA. The factors above the eigenvalue of 3 were retained whileitems above the factor loading of 0.50 were taken into consideration. A good Cronbach's alpha coefficientof 0.88 for the overall tool was established, with 0.89, 0.84, and 0.87 for the domains Awareness, Acceptance, and Coaching, respectively. The scale constructed includes both the positive and negative emotions of an individual and tries to understand the perspective of the receiver of the parenting practice. The study helps in understanding the phenomenon of PPSE, which might also aid in creating awareness regarding efficient parenting practices.

Development and Preliminary Validation of a Scale to Measure Perceived Therapist's Knowledge about Gender Identity Diversity among Trans and Non-Binary Individuals in Puerto Rico.

This study aimed to describe the development of the Perceived Therapist's Knowledge about Gender Identity Diversity Scale and to preliminarily validate this scale by describing its psychometric properties. This research instrument was constructed based on the existing literature and recommendations for instrument development. Initially, a 36-item scale was devised to assess perceived openness and knowledge about gender identity diversity in therapy. The content validation process involved 12 expert judges, leading to a refined 25-item scale. Participants consisting of 57 trans and non-binary Puerto Rican individuals completed the scale. Exploratory factor analysis revealed a unidimensional structure, supporting a single factor named "perceived knowledge about gender identity diversity in therapy." The final scale demonstrated excellent reliability (α = 0.978; Sα = 0.980; ω = 0.979), indicating strong internal consistency. This validated scale contributes to assessing primarily Hispanic trans and non-binary individuals' perceptions of their therapists' knowledge about gender identity diversity.

Validation of entrustable professional activities for use in neonatal care residency programs

ObjectiveDefine and develop a set of entrustable professional activities (EPAs) to link clinical training and assessment of the hospital components of neonatal care in neonatology medical residency programs. MethodsAn exploratory study was conducted in two phases using a modified Delphi approach. In the first phase, a committee of five neonatology residency program coordinators drafted an initial set of EPAs based on the national matrix of competencies and on EPAs defined by international organizations. In the second phase, a group of neonatal care physicians and medical residents rated the indispensability and clarity of the EPAs and provided comments and suggestions. ResultsSeven EPAs were drafted by the coordinators´ committee (n = 5) and used in the content validation process with a group (n = 37) of neonatal care physicians and medical residents. In the first Delphi round, all EPAs reached a content validity index (CVI) above 0.8. The coordinators´ committee analyzed comments and suggestions and revised the EPAs. A second Delphi round with the revised EPAs was conducted to validate and all items maintained a CVI above 0.8 for indispensability and clarity. ConclusionSeven entrustable professional activities were developed to assess residents in the hospital components of neonatal care medicine. These EPAs might contribute to implementing competency-based neonatology medical residency programs grounded in core professional activities.

Development of a Ramayana-based Counseling Module for Persons with Common Mental Health Disorders

Background: Common mental health disorders (CMDs) affect nearly 10% of the population, with the majority (80%) remaining untreated. Culturally relevant counseling approaches can be a means to reach many untreated persons. We describe the development and validation of a socioculturally relevant counseling module based on the Ramayana for persons with CMDs. Methods: The study employed an exploratory research framework to design the counseling module. The module underwent a comprehensive review of the Valmiki Ramayana to ensure its cultural relevance. Content validation was performed by mental health professionals from the field of Indian psychology. Concurrently, a panel of 15 experts from diverse backgrounds in Indian psychology validated the counseling module based on the Ramayana. Results: Based on the results of expert interviews ( n = 15), the counseling techniques, encompassing concepts, anecdotes, and narratives, were finalized. These interviews also contributed to the refinement of the counseling module. The primary objective of the content validation process was to systematically assess the appropriateness, accuracy, and practicality of the various components within the module. The content validation demonstrated that all items contained within the module exceeded the established threshold of p = .59. Conclusions: The developed counseling module based on the Ramayana is feasible to be implemented as a sociocultural intervention for persons with CMDs. By assisting persons to enhance coping abilities and improve overall well-being, this module offers a valuable resource for mental health intervention in the Indian sociocultural context. It fosters a culturally sensitive and practical approach to address the diverse mental health needs of the population.

Quality Text Book Assessment System

The Quality Textbook Assessment System (QTAS) is a sophisticated methodology aimed at rigorously evaluating the quality and appropriateness of textbooks utilized within educational contexts. With the proliferation of educational materials and the pivotal role textbooks play in shaping students' learning experiences, there arises a critical need for a systematic approach to assess their efficacy and alignment with educational standards. QTAS addresses this need by providing educators, curriculum developers, and policymakers with a structured framework for textbook evaluation. The primary objectives of QTAS are multifaceted. Firstly, it seeks to ensure the accuracy and reliability of information presented in textbooks across various subjects and grade levels. Through meticulous fact- checking and content validation processes, QTAS identifies and rectifies inaccuracies, misconceptions, and biases that may compromise the integrity of educational materials. Additionally, QTAS evaluates the clarity and coherence of textbook content, assessing its ability to facilitate comprehension and knowledge retention among students. Moreover, QTAS places a strong emphasis on the alignment of textbooks with established educational standards and learning objectives. By scrutinizing the curriculum relevance and instructional coherence of textbooks, QTAS helps educators select materials that seamlessly integrate with existing teaching practices and educational frameworks. Furthermore, QTAS evaluates the inclusivity and diversity of textbook content, ensuring representation and recognition of diverse perspectives, cultures, and identities. Incorporating both qualitative and quantitative assessment methods, QTAS employs a combination of expert reviews, stakeholder feedback, and statistical analyses to evaluate textbooks comprehensively. This holistic approach enables QTAS to generate nuanced insights into the strengths and weaknesses of educational materials, guiding informed decision-making regarding textbook adoption, adaptation, or supplementation..

Construction and validation of the Nursing Care Self-assessment Scale in Obstetric Services (EAESO)

Objective: To describe the stages of construction and validation of the Nursing Care Self-Assessment Scale in Obstetric Services. Methods: Methodological study, based on the Psychometric Model proposed by Pasquali. The stages were covered: theoretical foundation; selection and elaboration of items and domains; content validation. Descriptive statistical analysis was performed. Internal validity of the construct analyzed by the Content Validity Coefficient and internal consistency by Cronbach's alpha. Results: Scale with 31 items for self-assessment of obstetric nursing care evaluated by 7 experts. Items with a Content Validity Coefficient of less than 0.8 were modified. Second evaluation, with 5 experts, resulted in a Content Validity Coefficient greater than 0.8. Semantic analysis carried out with 56 nursing professionals. In the end, the scale consisted of 23 questions and obtained a Cronbach's alpha of 0.764. Conclusions: The scale demonstrated good results in the content validation process, verbal comprehension and internal consistency.

Development of the pediatric narcolepsy patient-reported outcomes scale (PN-PROs)

BackgroundPediatric narcolepsy is a chronic neurological disorder that impacts the health and overall wellbeing of children and adolescents with the disease. Meaningful and regular assessment of symptom frequency and severity is important for the long-term management of narcolepsy and for optimizing quality of life. However, there is currently no patient-reported outcomes (PROs) measure developed from both patient and expert input that is designed specifically to assess the impact of pediatric narcolepsy on daily life and overall disease burden.MethodsWe conducted a qualitative mixed-methods study to develop a novel patient-reported outcomes measure for pediatric narcolepsy patients. We created and refined a conceptual framework through literature review, semi-structured interviews with narcolepsy experts, and focus groups of children and adolescents with narcolepsy and their parents. Guided by the domains and facets identified in our conceptual framework and further literature review, we developed a PROs item bank. Our team further refined the item bank and classified items through team discussions and expert guidance. Content validity of the item pool was evaluated with expert review, readability analysis, and cognitive interviews with narcolepsy patients.ResultsThrough our processes, we developed a PROs item bank comprising two domains (narcolepsy symptoms and functional impairment) that contains 10 facets. The final item bank consists of 55 items, with 27 items representing five facets of narcolepsy symptoms (behavior, cataplexy, cognitive difficulties, sleep quality, and sleepiness) and 28 items representing five facets of functional impairment (bothered by/worried about symptom, cognitive/academic, global functioning, safety, and social).ConclusionWe developed items for the Pediatric Narcolepsy Patient-Reported Outcomes (PN-PROs) measure that incorporates expert insight, published literature, and testimony from children/adolescents living with narcolepsy and their families. Upon completion of the psychometric testing and content validation process, we believe the PN-PROs will provide a useful longitudinal measure of disease control and standardize outcome assessments in clinical practice and research studies.

Knowledge and handling practices for raw hen's eggs during purchase, preparation, storage, and consumption: a cross sectional study

The study aimed to assess the hen’s eggs knowledge, handling practices, and consumption among Palestinian consumers using the cross-sectional survey design. Online questionnaire was sent via social media platforms including well-known Facebook and WhatsApp groups in West bank, Gaza and Jerusalem, along with an invitation explaining the research objectives and the voluntary participation. The online questionnaire consisted of three main sections: socio demographic, knowledge and practices for hen’s eggs during purchase, preparation, storage, and consumption. The items were developed based on previous literature and international guidelines for hen's eggs purchase and handling, and subjected to content validity process, followed by a pilot study to determine the reliability of the questionnaire using Cronbach’s alpha test. The final data were analysed based on the dichotomous Rach model for knowledge and polytomous Rasch model for practices using Winsteps version 5.1.3. The Rasch SPSS output interval data files were used in the inferential analyses tests (one-way ANOVA test and independent samples t-test). The Rasch analysis showed that on average the participants had quite low level of knowledge of hen's eggs consumption safety, (person ability Mean 0.10 logit). The item difficulty measures ranged between + 1.65 (most difficult) and − 2.24 logit (easiest). It was not easy for the participants to endorse the items pertaining their practices in handling the hen’s eggs during purchase, preparation, storage and consumption, (person ability Mean − 0.11 logit). The item difficulty measures ranged between + 2.68 logits (most difficult) to − 2.45 logit (easiest). In addition, female participants significantly outperformed males in knowledge scores; and the level of hen's eggs hygiene practices and storage during purchase depended on participants’ knowledge level. The research recommended interventional programs to enhance Palestinians’ awareness and knowledge about hen's eggs knowledge, handling practices, and consumption. Further quantitative and qualitative research studies were also recommended.

Cross-Cultural Validation of the Healthcare Provider's Practices, Attitudes, Self-Confidence, and Knowledge Regarding Bullying Questionnaire.

How can we know the reality of the context of bullying in the field of primary health care? The aim of this study is to obtain a validated and reliable tool that allows measurement of the involvement of primary care professionals in addressing bullying through a systematic content validation process. A cross-cultural validation of the Healthcare Provider's Practices, Attitudes, Self-Confidence, and Knowledge Regarding Bullying Questionnaire was conducted for the Spanish perspective. This involved linguistic adaptation through translation-back-translation, content validity index (CVI) analysis, construct validity using confirmatory factor analysis (CFA), and internal consistency (Cronbach's α). The total CVI was 0.95, with individual item scores ≥ 0.78. CFA revealed a good fit for the three subscales, with discrimination indices (item-total correlation within the dimension) > 0.30. Cronbach's α for each dimension indicated a high level of reliability, with values of 0.735 for attitudes, 0.940 for self-confidence, and 0.895 for knowledge. The questionnaire is valid and reliable for evaluating the knowledge, attitudes, and self-confidence of primary care professionals in Spain regarding bullying. Its validity and reliability guarantee its potential use in other health settings and may lead to better training of professionals and school biopsychosocial health.

Face and content validity of a mobile delirium screening tool adapted for use in the medical setting (eDIS-MED): Welcome to the machine.

Following a user-centred redesign and refinement process of an electronic delirium screening tool (eDIS-MED), further accuracy assessment was performed prior to anticipated testing in the clinical setting. Content validity of each of the existing questions was evaluated by an expert group in the domains of clarity, relevance and importance. Questions with a Content Validity Index (CVI) <0.80 were reviewed by the development group for potential revision. Items with CVI <0.70 were discarded. Next, face validity of the entirety of the tests was conducted and readability measured. A panel of five clinical experts evaluated the test battery comprising eDIS-MED. The content validity process endorsed 61 items. The overall scale CVI was 0.92. Eighty-eight per cent of the responses with regard to question relevancy, usefulness and appropriateness were positive. The questions were deemed fifth grade level and very easy to read. A revised electronic screening tool was shown to be accurate according to an expert group. A clinical validation study is planned.

Expert-Type Content Validity Applications to Doctor of Nursing Practice Projects.

Background: Developing rigorous doctor of nursing practice (DNP) projects continues to challenge faculty and doctoral students. To address project rigor, expert content validity methods have been applied to clinical projects. Students implement expert content validity processes to literature-based project components. Objectives: The objectives of this study are to describe some of the developmental phases of DNP projects during the courses of one DNP program and to explore one strategy for increasing the rigor of DNP projects, review details on expert-type content validity methods, and examine literature for projects implementing an alternate application of expert-type content validity and scoring approaches to components of DNP projects. Methods: Expert content validity methods are described for DNP projects, such as guidelines, teaching plans, support groups, and algorithms. They are used to judge components generated from initial content analysis strategies. Types of expert panelists and descriptions of scoring ranks on project components are presented to represent different expert content validity strategies. Results The steps are presented to support expert content validity processes. Conclusions: DNP projects challenge faculty and students to create systematically constructed quality improvement projects on important and interesting clinical problems. The expert context validity process is one approach of enhancing project rigor. Implications for Nursing: An outline offers steps to establish expert content validity for translational DNP projects.

Construction and validation of checklist for referral to the hyperbaric oxygen therapy unit

The objective was to build and validate a checklist for referring hospitalized patients to the hyperbaric oxygen therapy unit. This is a methodological study with a quantitative approach carried out in three stages: 1) scoping review on the topic, including the taxonomies of the North American Nursing Diagnosis Association and Nursing Interventions Classification; 2) construction of the instrument based on the characterization of the checklist items with the cross-mapping between the results of the scoping review and the titles of the diagnoses from the NANDA I taxonomy, choosing the NIC interventions; and 3) content and appearance validation process using the Delphi technique composed of a panel of judges. Items with a Content Validity Index ≥ 0.90 and checklist reliability based on Kappa agreement ≥ 0.80 were considered valid. After constructing and structuring the checklist, the Delphi stage was carried out with the responses of 10 judges, to validate the content and appearance. The checklist was categorized into 14 items. The 1st round evaluated the individual content of the items, the 2nd round evaluated the attributes of the instrument and the 3rd round the appearance and general evaluation. The level of agreement between the judges and the validation of content and appearance reached final values of 1.00. The checklist for referral to Hyperbaric Oxygen Therapy Units was considered an important support instrument and favors the communicative process between health teams.

Health vulnerability: evidence of validity of an item bank

Objective: To analyze the evidence of content validity and response process of a health vulnerability item bank. Methods: Psychometric study with support of Pasquali’s theoretical pole in which 62 specialists with different sociodemographic and academic characteristics were selected and 15 of them responded to the content validity questionnaire. After adjustments, the bank moved to the response process validity phase and was evaluated by 12 health service users. A content validity coefficient was used to evaluate the items and the bank, which had the reliability assessed by the binomial test, considering a percentage of 80% and p-value &gt;0.05. Results: The bank presented good evidence of content validity by experts. The coefficients were 0.87 for the subject element, 0.86 for the social element and 0.865 for the general element. The target audience made suggestions in the response process validity phase to better understand the items (total coefficient: 0.89), which were considered clear, accurate and understandable. Conclusion: The final version of the item bank has 535 items, 238 for the subject and 297 for the social element. It presents evidence of validity of content and response process and is suitable for testing the validity of internal structure.

Investigating The Content Validity of An Iot-Acceptance Survey Instrument in Higher Education: A Study in The Context of Sindh, Pakistan

In the realm of educational research, this study embarks on a pivotal exploration into the acceptance of the Internet of Things (IoT) by students in their learning environment. Recognizing the indispensable role of content validity in ensuring the robustness of measurement tools, particularly in the context of questionnaire development, this research meticulously employed a systematic approach guided by evidence and best practices. Drawing inspiration from the Unified Theory of Acceptance and Use of Technology 2 (UTAUT 2) model, our aim was to bridge a critical gap in the existing body of knowledge. IoT, a cornerstone in Higher Education Institutes (HEIs), prompted the development of a sophisticated educational acceptance instrument. However, prior to embarking on the pilot study phase, our focus turned to the intricate process of content validation. Six esteemed experts were judiciously selected to form our expert panel, each bringing a wealth of experience and knowledge to the evaluation. Employing the Expert Panel Rating Chart (EPRC), their invaluable insights were systematically incorporated, utilizing both item-level Content Validity Index (I-CVI) and scale-level CVI (S-CVI). The outcomes not only met but exceeded the established thresholds of acceptability, affirming the content validity of our instrument. The significance of this meticulous content validation process cannot be overstated. It serves as the bedrock upon which the reliability and validity of our educational acceptance instrument rest. As latent variables and study items underwent meticulous scrutiny and refinement, the resultant instrument emerged as a beacon of precision, ready to navigate the uncharted waters of assessing students' acceptance levels of IoT in their academic journey. In essence, this research underscores the paramount importance of content validity in the development of assessment tools, offering a methodologically robust approach anchored in evidence and best practices. The validated UTAUT2-based acceptance instrument now stands poised to contribute significantly to future studies, unraveling the intricate dynamics of IoT acceptance and its applications in the realm of university education.