Evidence Of Content Validity Research Articles

Evaluation of an adapted version of the International Trauma Questionnaire for use by people with intellectual disabilities.

The International Trauma Questionnaire (ITQ) is a novel assessment instrument that is aligned to the ICD-11 diagnoses of post-traumatic stress disorder (PTSD) and complex PTSD (CPTSD). The purpose of this study was to develop and evaluate an adapted version of the ITQ suitable for use by people with intellectual disabilities. The ITQ-ID follows the original ITQ, using wording developed in collaboration with a focus group of people with intellectual disabilities The ITQ-ID was administered to 40 people with intellectual disabilities recruited from learning disability forensic and community settings, alongside a Trauma Information Form and the Impact of Event Scale-Intellectual Disabilities (IES-IDs). Most participants reported multiple traumatizing events. Around half of the participants met strict criteria for a diagnosis of PTSD, and around three quarters met looser criteria. Depending on definitions, between 66% and 93% of those who met criteria for PTSD also met criteria for a diagnosis of CPTSD. The ITQ-ID showed a single-component structure, with very good-to-excellent internal consistency, excellent test-retest reliability, and evidence of concurrent, discriminant, and content validity. The results support the potential of the ITQ-ID for assessment of PTSD and CPTSD in people with intellectual disabilities in both clinical and research contexts and highlight the need for further validation work.

Assessing the psychometric properties of quality of life measures in individuals with amyotrophic lateral sclerosis: a systematic review.

Amyotrophic lateral sclerosis (ALS) is the most common motor neuron disease in adults. There are many patient-reported outcome measures (PROMs) for measuring quality of life (QoL) and health-related QoL (HRQoL) within this population; however, there is limited consensus regardingwhich are most valid, reliable, responsive, and interpretable. This systematic review assesses the psychometric properties and interpretability of QoL and HRQoL PROMs for individuals with ALS. This review was conducted following the Consensus-based Standards for the selection of health Measurement Instruments(COSMIN) methodology for systematic reviews of PROMs. MEDLINE, EMBASE, and CINAHL databases were searched. Studies were included if their aim was to evaluate one or more psychometric properties or the interpretability of QoL or HRQoL PROMs in individuals with ALS. We screened 2713 abstracts, reviewed 60 full-text articles, and included 37 articles. Fifteen PROMs were evaluated including generic HRQoL (e.g., SF-36), ALS-specific HRQoL (e.g., ALSAQ-40), and individualized QoL (e.g., SEIQoL) measures. Evidence for internal consistency and test-retest reliability were acceptable. For convergent validity, 84% of hypotheses were met. For known-groups validity, outcomes were able to distinguish between healthy cohorts and other conditions. Responsiveness results ranged from low to high correlations with other measures over 3-24months. Evidence for content validity, structural validity, measurement error, and divergent validity was limited. This review identified evidence in support of the ALSAQ-40 or ALSAQ-5 for individuals with ALS. These findings canguide healthcare practitioners when selecting evidence-based QoL and HRQoL PROMs for patients and provide researchers withinsight into gaps in the literature.

Scale quality in second-language anxiety and WTC: A methodological synthesis

AbstractAs survey research in second language acquisition grows in popularity, the adherence to best practices associated with questionnaire quality is critical for a better understanding of factors that influence second language (L2) development. To ensure that a self-report scale targets the construct of interest and does it consistently and accurately, authors of primary research should demonstrate that their instrument possesses acceptable evidence of validity and reliability. To this end, this methodological synthesis focused on the state of scale quality in L2 anxiety and willingness to communicate (WTC) research by examining key methodological issues of quantitative survey research and offering empirically grounded suggestions for future studies. A close examination of 232 peer-reviewed articles that used 385 L2 anxiety and WTC scales demonstrated, among other findings, the lack of evidence for scale content and construct validity. The implications of this study contribute to concurrent attempts at methodological reform in applied linguistics.

Questionário de Adaptação ao Ensino Superior Remoto: Adaptação e Estudo Psicométrico com Universitários

Abstract Due to the need to understand the academic adaptation in the temporary transition from the in-person to the virtual modality, the general objective of this research is to adapt the Academic Adaptation to Higher Education Questionnaire for remote teaching. The specific objectives are to investigate their evidence of content validity and internal structure-based validity and reliability estimates. The questionnaire was adapted for remote teaching in the first stage of the research. The questionnaire was, then, evaluated by three judges and 12 students, whose results evidenced the content validity. Subsequently, 319 students answered the questionnaire. With confirmatory factor analysis, a plausible model was identified, containing five factors (Institutional, Social, Study, Personal-Emotional, and Career Planning), indicating validity based on the internal structure. Additionally, the questionnaire showed adequate accuracy indices (ω >.85). The practical implications are traced, and we also suggest for the questionnaire to be adjusted for the hybrid teaching modality.

Vulnerability to physical inactivity: evidence of content validity and response processes.

To analyze content validity evidence and response processes of a bank of items for measuring vulnerability to physical inactivity in adults. Methodological study, with 13 specialists and 46 representatives of the target population. The Content Validity Index (CVI) and binomial test were calculated; data obtained through validity based on response processes were collected through interviews. Of the 105 constructed items, 16 were excluded (CVI<0.78); 89 items showed agreement <80% in the psychometric criteria, being modified. Of the 101 items that remained (CVI>0.78), 34 were changed and 4 were deleted after evaluating the evidence of response processes. In the end, 97 items remained, with a global CVI of 0.92, organized into two dimensions: Subject (CVI=0.91) and Social (CVI=0.94). The items presented adequate parameters and evidence of validity; and can subsidize the construction of instruments that consider the subject's and social vulnerability in understanding physical inactivity.

Vulnerability to physical inactivity: evidence of content validity and response processes

RESUMO Objetivo: Analisar evidências de validade de conteúdo e processos de resposta de um banco de itens para mensuração da vulnerabilidade à inatividade física de adultos. Método: Estudo metodológico, com 13 especialistas e 46 representantes da população-alvo. Calculou-se o Índice de Validade de Conteúdo (IVC) e teste binomial; os dados obtidos pela validade baseada nos processos de respostas foram coletados mediante entrevistas. Resultados: Dos 105 itens construídos, 16 foram excluídos (IVC&lt;0,78); 89 itens apresentaram concordância &lt;80% nos critérios psicométricos, sendo modificados. Dos 101 itens que permaneceram (IVC&gt;0,78), 34 foram alterados e 4 eliminados após avaliação das evidências dos processos de resposta. Ao final, permaneceram 97 itens, com IVC global de 0,92, organizados em duas dimensões: Sujeito (IVC=0,91) e Social (IVC=0,94). Conclusão: Os itens apresentaram parâmetros e evidências de validade adequados; e podem subsidiar a construção de instrumentos que consideram a vulnerabilidade do sujeito e social na compreensão da inatividade física.

TECNOLOGIA EDUCATIVA SOBRE SAÚDE PARA MULHERES PRIVADAS DE LIBERDADE À LUZ DO LETRAMENTO EM SAÚDE

ABSTRACT Objective: to validate the content of educational videos for incarcerated women, in the light of health literacy. Method: methodological study with development of three videos for incarcerated women with themes chosen by them (Menstrual Cycle, Arterial Hypertension and Epilepsy), developed in four stages: construction of storyboards, validation by expert judges, construction of videos and validation by the public. The validation process was performed by seven judges with the Health Educational Content Validation Instrument, the Suitability Assessment of Materials and readability analysis. For approval, it was established that the agreement between judges should be higher than 80%, and the adequacy, according to the SAM, should be 40-100%. The incarcerated women evaluated the videos in August 2022, in a women's public prison in Ceará, using the Assistive Technology Assessment Instrument, considering the level of agreement of the positive responses above 70%. Results: the validation instrument result of the storyboards ranged from 0.92 to 1.0. In the Suitability Assessment, a percentage of 85.2% to 88.8% was reached, categorizing the materials as superior. As for readability, the values obtained (70.9 to 78.1) place the texts as easy or very easy to read. The evaluation by the target audience showed that the videos were adequate (97.8-100%). Conclusion: the three videos constructed were suitable for incarcerated women, with evidence of content validity and may be used in health education actions for this public.

Cross-cultural adaptation and content validity of the Adverse Events Associated with Nursing Practices instrument.

To conduct the cross-cultural adaptation and evaluate the evidence of content validity of the Adverse Events Associated with Nursing Practices instrument in the Brazilian context. Psychometric study, conducted between June 2021 and February 2023, following the stages of the Patient-Reported Outcomes Measurement Information System protocol. Semantic, idiomatic, experimental and conceptual equivalences were evaluated, along with content validity evidence, considering Content Validity Ratio (CVR) parameters, with the participation of 25 experts. A Brazilian version with 55 items was obtained, demonstrating good linguistic equivalence to the original version (agreement rate=99.2%), and adjustments in the items writing. CVR values remained above 0.60. Cognitive testing indicated good understanding, confirmed by the 31 participants in this stage, with a short application time (average = 17 minutes). The final version of the instrument showed good linguistic equivalence, strong evidence of content validity and a good response process in the Brazilian context.

Elaboration of the Fear of Missing Out (FoMO) Scale at Work: Evidence of Content Validity

Elaboration of the Fear of Missing Out (FoMO) Scale at Work: Evidence of Content Validity

Content validity evidence of the Brazilian version of the Cognitive Symptom Checklist-Work-21.

to cross-culturally adapt and assess the content validity evidence of the Cognitive Symptom Checklist-Work-21 for the Brazilian context. a psychometric study of cross-cultural adaptation, covering the stages of translation, reconciliation, back-translation, intercultural equivalence assessment and content validity evidence analysis, considering Content Validity Ratio parameters in breast cancer survivors. the translations were equivalent to the original version. Colloquial expressions were modified, tense, verbal adjusted, and two items containing multiple commands were separated. The final version now contains 22 items, presenting semantic, conceptual, idiomatic and experimental equivalences. The pre-test indicated good understanding and ease in the response process. the final version was defined as "Lista de verificação de sintomas cognitivos relacionados ao trabalho - 22 itens", showing good linguistic equivalence and strong evidence of content validity in the Brazilian context.

Development and content validity of a website for patients with coronary artery disease.

to develop and analyze content validity evidence of a website for patients with coronary artery disease. a methodological study, carried out in the phases: Definition - determined contents for inclusion in the website, architecture and design; Implementation - subjects included in the website; Assessment - website submitted to analysis by 13 experts and eight laypersons regarding organization, content and design, on a scale of 1 (no agreement) to 4 (complete agreement). Items that reached Content Validity Ratio (CVR) higher than the established critical values and Content Validity Index greater than 0.80 were considered valid. eight domains related to secondary prevention in coronary heart disease were included on the website. Critical CVR and adequate CVI were obtained according to professional and lay experts. the website was developed, achieving adequate content validity evidence, and can be used as an educational tool for this population.

JOGO DE TABULEIRO SOBRE ESTILO DE VIDA SAUDÁVEL PARA PESSOAS COM DOENÇA ARTERIAL CORONARIANA

ABSTRACT Objective: to develop and analyze content and face validity evidence of a board game to promote healthy lifestyle habits for patients with coronary artery disease. Method: this is a psychometric study of development and validity of a board game for health education. Data collection was carried out between October 2021 and January 2022. Initially, the game rules were described and, sequentially, themes related to cardiovascular prevention were identified, used as a basis for card development. The game was submitted to assessment by 14 experts in terms of clarity, theoretical relevance, practical relevance, image visibility and relationship between image and text, through a Likert scale score. The content validity coefficient was calculated for each round, with a coefficient greater than 0.57 being considered valid. New assessment rounds were performed until the appropriate coefficient was reached. Results: the board game was built containing images of anthropomorphized hearts alluding to healthy lifestyle habits and 45 spaces. A total of 69 cards were developed containing the themes of healthy eating, physical activity and the importance of smoking and alcohol cessation. In the first round of assessment, three cards did not reach the minimum content validity coefficient. They were reformulated and sent to a second round of assessment, and was considered validated in this new round. Conclusion: the game, its rules and its content showed adequate content validity evidence after the second round. Further studies to analyze its effect on lifestyle modification should be carried out.

Workload assessment: cross-cultural adaptation, content validity and instrument reliability.

to adapt, validate the content and assess the reliability of the instrument National Aeronautics and Space Administration - Task Load Index, translated into Brazilian Portuguese. a methodological study, divided into five steps: translation; synthesis; back-translation; assessment of the Portuguese version by an expert committee; pre-test and content validity of the final version by health professionals working in inpatient units. The Content Validity Index (CVI) (minimum 0.80) and Cronbach's alpha (minimum 0.70) were calculated. in the first round, in the agreement analysis of the translated version, three items did not reach the minimum CVI value. It was decided to remove the statement. The instrument title and items "performance" and "effort" were changed. There was consensus and approval of the final version in the pre-test step. the NASA Task Load Index instrument, adapted to Brazilian Portuguese, presents reliability and content validity evidence.

Psychometric properties of the Brazilian Portuguese version of the Copenhagen Burnout Inventory (CBI) in healthcare professionals.

Burnout syndrome (BS) in healthcare professionals (HCP) has been a major concern, and even more so during the coronavirus disease 2019 (COVID-19) pandemic. The need for adequate tools to assess BS is urgent. The objective of this study was to validate the Brazilian Portuguese version of the Copenhagen Burnout Inventory (CBI) in HCP. The sample comprised 1,054 Brazilian HCP. Data were collected for 1 month (May-2020 to June-2020) using an online self-administered questionnaire. All three CBI dimensions demonstrated optimal reliability. All consistency measures attained values > 0.90. Split-half correlation values with Spearman-Brown reliability were higher than 0.8. The parallel analysis suggested two factors: personal burnout (PB) and work-related burnout (WB) items were associated with factor 1, and client-related burnout (CB) items were associated with factor 2. Our study corroborates the validity of the Brazilian Portuguese version of the CBI, pointing to a close relation between PB and WB in HCP. A public domain tool with evidence quality to ensure sufficient content validity can aid in burnout evaluation and encourage both expansion of the research field and accurate detection and treatment of this syndrome in Brazilian HCP.

Elaboração e validação da Escala Brasileira de Percepção sobre Eutanásia

Abstract This research elaborated an instrument to identify nurses’ perception on euthanasia and test its content validity, response process, internal structure and reliability evidences. A psychometric study was conducted through evaluation by a committee of judges, pre-test, and validation. The latter step included 821 nurses. Exploratory and confirmatory factor analyses were performed. A total of 55 items were elaborated based on a literature review. After review by judges and applying the suggested changes, all items showed agreement above 80% between evaluators. Exploratory and confirmatory factor analyses indicated a satisfactory fit of a two-dimensional model and good reliability indices (α=0.85; Ω=0.89). The 12-item scale showed good validity and reliability evidences, and can be used to measure nurses’ perception on euthanasia.

Qualitative Analysis of the Content Validity of the Virtual Reality Functional Capacity Assessment Tool (VRFCAT) in Schizophrenia: A Multi-Stakeholder Perspective.

The US Food and Drug Agency (FDA) requires clinical trials targeting cognitive impairment associated with schizophrenia (CIAS) to demonstrate the functional relevance of cognitive improvements by employing a functional co-primary measure. Although quantitative evidence supports the suitability of the Virtual Reality Functional Capacity Assessment Tool (VRFCAT) for this purpose, FDA guidelines for qualification of clinical outcome assessments require evidence of content validity, defined as qualitative evidence that key stakeholders view the measure as relevant and important. To collect this important qualitative data, semi-structured interviews were conducted with outpatients with schizophrenia (n = 24), caregivers (n = 12), and professional peer support specialists (n = 12) to elicit their views about the definition and importance of functional independence, the importance of the functional domains assessed by the VRFCAT (meal planning, using transportation, handling money, shopping), and the relevance of the VRFCAT tasks to these domains. Qualitative thematic analyses revealed consistent themes across groups in defining functional independence, including performing instrumental self-care, financial, and social tasks; making decisions autonomously; and not depending on others to carry out daily activities. There were, however, notable differences in their views regarding the importance of and barriers to functional independence. All groups viewed the VRFCAT as assessing skill domains that are central to independent functioning and, with some minor differences, the VRFCAT tasks were viewed as relevant and meaningful examples of the domains. These qualitative results provide converging evidence that key stakeholders view the VRFCAT as a content-valid measure.

Scale of concern about COVID-19 infection in Peruvian Health Care Workers

IntroductionThe global SARS-CoV-2 pandemic has generated concern about contagion, especially among healthcare workers who are on the front line. ObjectiveTo design and analyse the evidence of content validity, internal structure and reliability of a measure of concern about the spread of COVID-19 among Peruvian healthcare workers. Material and methodsQuantitative study and instrumental design. The scale was administered to 321 health science professionals (78 males and 243 females), whose ages ranged from 22 to 64 years (38.12 ± 9.61). ResultsAiken’s V-coefficient values were statistically significant. An exploratory factor analysis was performed which indicated the existence of a single factor, and confirmatory factor analysis (CFA) confirmed a satisfactory six-factor model. The CFA solution obtained adequate fit indices (RMSEA = 0.079; P = .05; TLI = 0.967; IFC = 0.980; GFI = 0.971, and AGFI = 0.931), and showed good internal consistency based on Cronbach's alpha coefficient (α = 0.865; CI 95%, 0.83−0.89). ConclusionsThe scale of concern for COVID-19 infection is a valid and reliable brief measure that can be used for research and professional purposes.

Content validation of an instrument for hemotherapy attention in liver transplants: promoting biomonitoring in health

Objective: to develop and validate the content of an instrument to monitor hemotherapy attention in liver transplant patients. Methods: methodological study in two stages: 1) Scoping review to identify relevant topics for the elaboration of the instrument; 2) Content validation with five specialists in two rounds, using the Delphi technique. Results: the final version of the instrument for hemotherapy care to liver transplant patients had four dimensions: Patient identification; Preoperative; Intraoperative; and Postoperative, to a total of 54 items. After the second round, all items had a content validation index of 0.8 or higher, and the instrument had a final score of 0.97. Conclusion: the instrument showed evidence of content validity, meaning it is a useful tool to monitor hemotherapy care for liver transplant patients. Contributions for the practice: the validation of this instrument will provide teams of transfusion and transplant centers with essential information to guide safe and efficient hemotherapy attention during the entirety of the liver transplant process.

Development of educational videos about bathing in bed newborns admitted to a neonatal unit.

to develop and analyze evidence of content validity of educational videos about bathing newborns in bed in a neonatal unit. applied and methodological research, carried out from December/2020 to February/2022, in three phases: pre-production, production, post-production. Validity was carried out by nurses specializing in social communication and nursing professionals, including the Brazilian Sign Language and assessment by nursing students. The Content Validity Index and Cronbach's alpha above 0.8 were considered for analysis. the videos were entitled "Best practices: bathing newborns in the heated crib" and "Best practices: bathing newborns in the incubator", lasting seven minutes each, divided into six scenes that demonstrated the approach to parents, environment and material organization, preparing newborns, bathing and after-bath care. the videos will support permanent education processes, academic training and professional training in nursing.

Content validation of the nursing diagnosis "inadequate social support network".

To evaluate evidence of content validity of the nursing diagnosis "inadequate social support network". A methodological study of the content validation type, carried out with 23 judges who evaluated the adequacy of the title, definition, class and domain of the nursing diagnosis "inadequate social support network". The judges also assessed the relevance of 28 clinical indicators and 32 etiological factors, which were considered valid when the Content Validity Index was ≥ 0.9. The judges agreed with the proposed title and suggested changes to the definition of the nursing diagnosis. They recommended its inclusion in Domain 7 - "Roles and relationships" and Class 3 - "Role performance" of the NANDA-I taxonomy. In addition, 19 clinical indicators and 27 etiological factors were considered relevant. The nursing diagnosis "inadequate social support network" had its theoretical structure validated in terms of content, which can support the practice of nurses in the operationalization of the Nursing Process.