Excellent Validity Research Articles

Response Rates, Reliability, and Convergent Validity in Experience Sampling Data.

This study examined associations of compliance rate with the reliability and convergent validity of intoxication and negative affect assessments in experience sampling method (ESM) data in three samples (Veterans, Sexual Minority Men, and College Students). Convergent validity was operationalized as within-person associations between daily aggregates of random in situ assessments and retrospective daily assessments or transdermal alcohol assessments. Measures with lower ICC require more assessments for a reliable aggregate (e.g., daily mean). In this regard, the number of completed assessments and intraclass correlation (ICC), rather than compliance with the protocol per se, determines reliability. Although convergent validity was correlated with compliance rate, the relatively weak associations reflect that there are individuals with excellent compliance yet poor convergent validity as well as individuals with poor compliance and excellent convergent validity. The pattern of results does not show a clear threshold for compliance (e.g., 80%) that differentiates good versus poor validity.

Factors Affecting Romantic Relationship in Lebanon

The concepts of romance and love are rapidly evolving with new modalities of romantic relationships in Lebanon (civil marriage, cohabitation) along with a catastrophic economic crisis affecting the country since 2019, and being ranked among the top ten crises worldwide. This document represents a cross-sectional study investigating 585 Lebanese participants from different Lebanese regions randomly sampled using the snowball method. Besides, the Relationship dynamics scale (RDS) was used to evaluate vulnerability for conflicts in the context of romantic relationship and their correlates, with a very good internal consistency (Cronbach’s Alpha of 0.908) and an excellent validity (Factor analysis using Promax technique). The results are as follows: A higher vulnerability for conflicts in the context of amorous relations is associated with having a child or a partner with handicap or receiving an actual chronic treatment (personal, for children or for the partner), having 3 or more children and finally having high financial stressors. Moreover, this survey evaluated factors modulating financial burden and stress using the InCharge Financial Distress / Financial Well-Being (IFDFW) scale. The results showed that working only with day shifts schedule, being male, having physical activity of a minimum of 2.5 hours per week, having a partner working outside Lebanon, having an income in currency other than Lebanese Pound, and being married at an age above 30 years are associated with less stressful economic status. While on the other hand, having a history of chronic treatment (Personal, Partner or children) and being married before 18 years were correlated with high levels of economic stress.

Comprehensive Validation of the German Version of the LIMB-Q.

Lower extremity trauma significantly impacts patients' lives, requiring a nuanced approach to evaluate outcomes beyond clinical measures. The LIMB-Q, a patient-reported outcome measure (PROM), assesses the multifaceted impacts of lower extremity trauma, including physical and emotional dimensions, from the patient's perspective. This study validates the German version of the LIMB-Q. We relied on the translation of the LIMB-Q that had followed the International Society for Pharmacoeconomics and Outcomes Research best practice guidelines. Sixty patients who had undergone reconstructive surgery or amputation of the lower limb completed the LIMB-Q, Lower Extremity Functional Scale (LEFS), and Short Form Health Survey (SF-36). Internal consistency of the German LIMB-Q was determined by Cronbach's alpha, and reliability was assessed using the intraclass correlation coefficient. Construct validity was analyzed using Pearson correlation coefficients between the LIMB-Q, LEFS, and SF-36. Validation involved 60 patients. Internal consistency in a test-retest subset of 5 patients was good to excellent (α: 0.891 to 0.965). The intraclass correlation coefficient for these scales ranged from 0.821 to 1. The LIMB-Q domains significantly correlated with the corresponding domains of the SF-36 and LEFS, confirming excellent construct validity. The German version of the LIMB-Q is conceptually equivalent to the original English version. It is a reliable and valid PROM for assessing physical and psychological impairments in patients who have undergone lower extremity reconstructive surgery or amputation.

Validity of the PEDOMETER® mobile application for evaluating cardiorespiratory fitness and fatigue resistance in cardiac rehabilitation. A pilot study

A mobile application (app) may facilitate the administration of the 6-minute walk test (6MWT), a commonly used tool in cardiac rehabilitation. This pilot study, conducted with cardiac rehabilitation patients, aimed to evaluate: 1) the criterion validity of the PEDOMETER® app compared to the 6MWT in assessing cardiorespiratory fitness and fatigue resistance, and 2) the construct validity of the PEDOMETER ® app in relation to the Hospital Anxiety and Depression Scale (HADS) and the Health Index of the EuroQol-5D 3L questionnaire (EQ-5D). Twenty patients undergoing cardiac rehabilitation at HM Puerta del Sur Hospital (Mostoles, Spain) performed the 6MWT while using the PEDOMETER ® app on a smartphone worn on their arm. Pearson's correlation coefficient was calculated to assess the relationship between the distance recorded in meters during the 6MWT and that recorded by the app, as well as between the app and the anxiety and depression dimensions of the HADS, and the Health Index EQ-5D. The criterion validity of the 6MWT and the PEDOMETER ® app was excellent (r = 0.981; p < 0.001). Regarding construct validity, the app showed a moderate negative correlation with the depression dimension of the HADS (r= -0.493), but not with the anxiety dimension or the EQ-5D. The free PEDOMETER ® app demonstrates excellent criterion validity when compared to the 6MWT. The app shows a moderate negative correlation with the depression dimension of the HADS.

A New Adaptation of the Authentic Leadership Questionnaire in Turkish: Evidence From Nursing.

There is a wide range of leadership approaches, and it is important to measure the types and impact of leadership in nursing. This study aimed to adapt the Authentic Leadership Questionnaire and test its suitability in the Turkish nursing context. Employing a two-phase cross-cultural research design in accordance with STROBE guidelines, language adaptation was conducted following ISPOR guidelines. Subsequently, data were collected from a sample of 382 nurses across three hospitals in İzmir, Turkey. The confirmatory factor analysis confirmed the four sub-scale structures and indices revealed an adequate fit. The content validity index score was 0.97 for the questionnaire and greater than 0.80 for its items, demonstrating excellent validity. The intraclass correlation coefficient obtained was 0.80, indicating a good level of reliability. The findings confirm the questionnaire has the potential to determine the extent and impact of authentic leadership being practiced in hospital settings. It could be used in a range of hospital settings to ensure that accurate evidence concerning authentic leadership is gathered and used to inform the further development of nursing leadership more widely.

Cross-cultural adaptation, reliability and validity of the persian version of the functional assessment scale for acute hamstring injuries

BackgroundThe Functional Assessment Scale for Acute Hamstring Injuries (FASH) which measure symptom’s severity and impact on physical activity and sports ability in individuals with acute hamstring muscle injury, is not available in Persian. The aim of this study was to translate and cross-culturally adapt the FASH questionnaire to Persian and to assess the psychometric properties of the translated version.MethodsThe Persian-translation and cross-cultural adaptation processes were based on World Health Organization method. A total of 160 participants compromising of four groups: (1) acute hamstring injury (N = 40), (2) other lower extremity injury (N = 40), (3) risk of acute injury (N = 40), and (4) healthy control (N = 40) were recruited to complete the Persian version of FASH (FASH-P) questionnaire twice with an interval of 48–60 h. The Short Form Health Survey (SF-36) and Lower Extremity Functional Scale (LEFS) were used to assess the criterion validity. Test-retest reliability, internal consistency, criterion validity, Dimensionality and floor/ceiling effects were evaluated to assess the FASH-P psychometric properties.ResultsThe FASH questionnaire were translated to Persian without any major problems. The FASH-P showed excellent power of differentiation because the scores were significantly different among the four groups. Regarding psychometric performances, excellent test–retest reliability (Intraclass correlation coefficient of 0.997) and a high level of internal consistency (Cronbach’s alpha of 0.966) were observed. The FASH-P total score was significantly correlated with SF-36 and LEFS questionnaires representing an excellent criterion validity. No floor or ceiling effect were found for total score in Hamstring muscle injury group.ConclusionsDue to the excellent psychometric performance, the FASH-P can be used as a reliable and valid tool for evaluating the severity of symptoms and sports ability in Persian-speaking patients with hamstring muscle injury.

Multirepresentation Ability Analysis of Wave Matter Using Physics Education Technology

Education is the primary capital of a nation's progress, because with education, the human resources that a nation possesses will become quality. Physics is a branch of natural science, specifically studying natural phenomena and events through several scientific and systematic methods. The research is aimed at developing a tool to evaluate the multirepresentation of wave matter using Physics Education Technology. The methods used in this research are quantitative methods and the research is carried out by providing filling issues that will analyze verbal multirepresentation capabilities, tables and graphs. The research will be carried out at Semarang University using samples of civil engineering students. Research procedures through preliminary stages by drawing up a research plan. Preparing and compiling wave learning modules using the simulation facilities of Physics Education Technology, then compiling evaluation tools that are subject-based with multi-representation verbal approaches, tables and graphs. Validation of learning modules and evaluation tools to determine whether it is worthy of use or not, validation is carried out by 2 experts. Validation of test instruments by experts on material aspects averaged 93%, on construction aspects 94% and on language aspects reached 92%, of which results show that the instruments have excellent validity. In the finite scale test, the highest multirepresentation ability is communicating from mathematics to verbal and its mathematical abilities, while the lowest is in the ability to picture to mathematics and physics.

Development and evaluation of a caregiver checklist for primary care.

Family caregivers serve vital functions in older adults' health care, but their own needs are not systematically assessed in routine care delivery. The present study employed a user-centered approach to develop and evaluate a pragmatic checklist to support proactive identification and discussion of caregivers' concerns in primary care. Checklist development proceeded according to a preestablished methodology involving domain identification, item generation, overall construction, and revision. The checklist subsequently underwent formal evaluation by 25 subject matter experts (SMEs), including primary care clinicians, family caregivers, and health services researchers who assessed the checklist's content validity and appraised its overall utility, ease of use, and mode of administration. The checklist showed excellent content validity. None of the items were found to be superfluous, indicating that the checklist covered relevant content domains. Subject matter experts reported that the checklist was easy to use, just the right length, and would be helpful in identifying and prompting a discussion about caregivers' needs. Their preferences regarding how the checklist should be administered were variable. Minor revisions to the checklist focused on enhancing its applicability to caregivers from low- and middle-income families and those from underrepresented backgrounds. Results indicate that the checklist is an appropriate tool for identifying caregivers' needs and concerns. Findings lay the groundwork for pilot testing in primary care to confirm the checklist's clinical feasibility and evaluate its preliminary impact on family-centered care quality and outcomes for primary care clinics. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Development of the quality improvement collaborative questionnaire (QuIC) to explore quality improvement partnerships to teach pre-registration nursing students

Background Quality improvement partnerships between healthcare organisations and higher education require further research to explore their potential to provide a valuable education experience for pre-registration nursing students. Aims Develop and validate a questionnaire for nurse academics to evaluate quality improvement content in pre-registration nursing curricula and the extent of partnership with higher education providers in developing this content. Conduct a pilot test of the questionnaire. Study design Use a content validity approach. Methods The Australian higher education sector was the setting and participants were nurse academics with knowledge of the quality improvement content taught in pre-registration nursing courses. The quality improvement collaboration (QuIC) questionnaire was informed by the literature and sent to ten quality improvement and higher education experts for content validation. Each question was scored on a Likert scale for relevance and clarity. The QuIC questionnaire was distributed by email to the 37 higher education organisations offering pre-registration programmes in Australia. Descriptive statistics were used to analyse the questionnaire data. Results Eight experts completed the content validity questionnaire in full, with the QuIC questionnaire achieving an excellent content validity score of 0.94 for relevance and clarity. The QuIC questionnaire was completed by 24 participants. The results indicated that quality improvement education partnerships are only used occasionally in Australia. The education methods used to teach this content were case studies (online cases n = 11, 46%; patient cases n = 9, 38%) and the development of quality improvement education materials (n = 7, 29%). Conclusions The QuIC questionnaire demonstrates excellent relevance and clarity, and is the first in the literature to address the constructs of quality improvement education and partnerships. The pilot results provide insight into quality improvement education methods used in Australia and the presence of partnerships. These results may be used to assist in the implementation of quality improvement education partnerships into curricula across the health professions.

Abstract 4137716: Development and Content Validation of the Heart Failure Symptom Management Motivation Questionnaire

Introduction: Adequate heart failure (HF) self-management is crucial for alleviating distressing symptoms. While disease knowledge is important, it is insufficient for sustained self-care. Patient motivation plays a key role in successful self-management interventions. However, tools assessing motivation for HF symptom self-management are lacking. Aims: To develop the Heart Failure Symptom Management Motivation (HF-SMM) questionnaire and assess its content validity with nurse experts. Methods: A cross-sectional study occurred in three phases from November 2022 to April 2024. Initially, we conducted a systematic review to identify motivation assessment instruments for cardiovascular self-care and assess their psychometric properties. We then designed the HF-SMM items based on existing tools, guidelines, and clinical expertise, focusing on four HF symptoms: anxiety, depression, edema, and fatigue. The questionnaire comprised three subscales: autonomous motivation, controlled motivation, and amotivation. Nurse experts with doctoral degrees and HF experience assessed 96 items about questionnaire clarity and relevance via Delphi rounds, using a 4-point Likert scale. Items with a content validity index (I-CVI) between .80 to 1.00 were deemed acceptable. The average I-CVI of all items resulted in the scale content validity index average (S-CVI/Ave) with a cutoff point of .90. Results: We invited ten experts, with nine participating. They had an average of 17.1 ± 10.7 years of HF clinical experience and 11.6 ± 7.4 years of research experience. In the initial Delphi round, items scored I-CVI ranging from .44 to 1.00 for anxiety, depression, and fatigue, and .66 to 1.00 for edema, resulting in an S-CVI/Ave of .81. After the first round, 54 items with I-CVI &gt;.80 were retained (56.2%), and 42 items were revised (43.8%). A second Delphi round, with 77.7% of the original experts, showed most items with excellent I-CVI scores (&gt; .80; 84; 87.5%), with only ten items needing clarity revisions (10.4%). The overall CVI of the questionnaire was excellent with a S-CVI/ Ave of .90 after two rounds of validation. Conclusions: The HF-SMM questionnaire demonstrates excellent content validity for assessing motivation in HF self-management. Future studies should incorporate cognitive interviews to understand better patient perceptions about the items.

Patient-centred composite scores as tools for assesment of response to biological therapy for paediatric and adult severe asthma.

We have previously developed Core Outcome Measures sets for Severe Asthma (COMSA) by multi-stakeholder consensus. There are no patient-centred tools to quantify response to biologics for severe asthma. We aimed to develop paediatric and adult CompOsite iNdexes For Response in asthMa (CONFiRM) incorporating clinical parameters and patient-reported quality of life (QoL). International expert healthcare professionals (HCPs) and patients with severe asthma were invited to: 1) develop consensus levels of clinically relevant changes for each outcome measure within COMSA; 2) use multicriteria decision analysis to develop the CONFiRM scores and 3) assess their internal validity. A separate group of HCPs evaluated CONFiRM's external validity. Five levels of change for each COMSA outcome were agreed. Severe exacerbations and maintenance oral corticosteroids use were rated as most important in determining both paediatric and adult CONFiRM scores. There was strong agreement between HCPs and patients, although patients assigned greater importance to QoL. The CONFiRM score quantified response to a biological from -31 (deterioration) to 69 (best possible response). Paediatric and adult CONFiRMs had good discriminative ability for a sufficient (AUC≥0.92) and a substantial (AUC≥0.95) response to biologics. Both CONFiRMs demonstrated excellent external validity (Spearman correlation coefficients 0.9 and 0.8 for paediatric and adult respectively (p<0.0001)). We have developed novel patient-centred paediatric and adult CONFiRMs which include QoL measures. CONFiRMs should allow a more holistic understanding of response for the patient and a standardised assessment of the effectiveness of biologics between studies. Further research is needed to prospectively validate CONFiRM scores.

Psychometric Testing of the Cross-Culturally Adapted Thai Version of the Caregiver Self-Efficacy in Contributing to Patient Self-Care Scale in Caregivers of Patients With Chronic Illnesses.

To evaluate the psychometric properties of the Caregiver Self-Efficacy in Contributing to Patient Self-Care Scale (CSE-CSC). The CSE-CSC scale was developed congruently with the Caregiver Contribution to Self-Care of Patient with Chronic Illness Inventory (CC-SC-CII) to assess caregiver self-efficacy (CSE), the motivation factor of caregiving. Its applicability in Asian populations, including Thailand, was limited. Psychometric tests were guided by COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) principles. This included translating the English version into Thai, following the principles of good practice for the translation and cultural adaptation process for patient-reported outcome (PRO) measures. Nine nursing experts evaluated the content validity. The analysis included caregivers of patients with chronic conditions from 16 primary care centres in Thailand. We tested the structural validity using exploratory factor analysis (EFA), confirmatory factor analysis (CFA) and concurrent validity for CC-SC-CII-v2. We tested the scale's reliability with methods for multidimensional and unidimensional constructs, the intraclass correlation coefficients (ICCs) and measurement error variance. Kappa coefficient (k = 1.00) indicated the scale's excellent content validity. The final analysis included a total of 407 samples. The EFA with the first split-half subsample (n = 194) extracted a two-dimensional structure. One reflected CSE in Maintenance and Monitoring behaviour and another captured CSE in Management behaviour. CFA with the second split-half subsample (n = 213) and the overall sample (n = 407) supported the scale's bidimensional model with high factor loadings. Each dimension and the overall CSE-CSC scale positively correlated with each scale and the overall CC-SC-CII-v2. McDonald's ω and Cronbach's α (both ranged from 0.91-0.94) indicated excellent internal reliability. Test-retest reliability showed ICCs between 0.95 and 0.96. Measurement error yielded satisfactory results. Testing of the Thai CSE-CSC scale supported validity and reliability, indicating that the scale can apply to Thai caregivers. This scale can be used in clinical practice and research to evaluate CSE in contribution to patient self-care.

Development and evaluation of the Trauma Screener-Intellectual Disability: a post-traumatic stress disorder screening tool for adults with mild intellectual disability or borderline intellectual functioning.

This study aimed to evaluate the validity and reliability of the adult self-report and proxy version of the Trauma Screener-Intellectual Disability (TS-ID) in adults with mild intellectual disability or borderline intellectual functioning (MID-BIF). An optimal cut-off value was determined for the ratio of specificity to sensitivity for predicting the diagnosis of post-traumatic stress disorder (PTSD). The TS-ID was adapted from a Dutch Child and Adolescent Trauma Screener, for use with adults with MID-BIF. Outcomes based on the TS-ID were compared with the presence of PTSD, as classified using the Diagnostic Interview Trauma and Stressors-Intellectual Disability (Mevissen et al. 2018). The TS-ID adult version was administered to 97 participants with MID-BIF who lived in supported housing, whereas the TS-ID proxy version was administered to 92 family members or professional caregivers. The TS-ID adult version showed high internal consistency (Cronbach's α=.94) and excellent validity (AUC=.94) for distinguishing PTSD in adults with MID-BIF. Optimal specificity and sensitivity was found at a cut-off score of 18. Although the TS-ID proxy version demonstrated excellent internal consistency (Cronbach's α=.93), it showed no validity in statistically distinguishing PTSD in adults with MID-BIF. The TS-ID showed favourable psychometric qualities as a screening instrument of PTSD in the case for people with MID-BIF.

Validation of the Short Form Shoulder Instability Return to Sport After Injury (SIRSI-5) and Its Association With Return to Sports.

Psychosocial readiness is thought to be important in establishing whether athletes are ready to return to sports (RTS). The 5-item Shoulder Instability-Return to Sport After Injury (SIRSI-5) is a short-form version of the 12-item questionnaire (SIRSI-12), which was validated in a postoperative Argentinian population and associated with psychological readiness to RTS. It is unknown if the SIRSI-5 is valid in surgical and nonsurgical populations in other geographic locations. To establish whether the SIRSI-5 is valid in another population and if it is associated with RTS. Cross-sectional study (diagnosis); Level of evidence, 3. A total of 79 participants with anterior shoulder instability managed operatively and nonoperatively were included. The SIRSI-5 and SIRSI-12 total scores were calculated. Intraclass correlation coefficients (ICCs) and Pearson correlations assessed convergent validity between SIRSI-5 and SIRSI-12. Logistic regression was used to assess the discrimination ability (leave-one-out cross-validation [LOOCV]) of a preexisting SIRSI-5 cut point score (≥59/100) to determine participants who had returned to their preinjury level of sport. In addition, the discrimination ability (LOOCV) of multivariable machine learning models including age, sex, time since injury (months), SIRSI-5 (continuous score), surgery, and contact/noncontact sport to predict return to preinjury level sport was also assessed. The Youden index was calculated to assess the models' performance. Of the 79 participants, 62 (78.5%) were male and 27 (34%) had been treated surgically. Only 32% (n = 25) of participants had returned to preinjury level sport. The SIRSI-5 and SIRSI-12 were highly correlated (r > 0.9) with high levels of agreement (ICC, 0.90; 95% CI, 0.76-0.95). The prediction accuracy of the SIRSI-5 cut point score model was 66% (Youden index, 0; sensitivity, 4%; specificity, 94%). The best prediction accuracy obtained through a machine learning model (multilayer perceptron) was 72% (Youden index, 0.4; sensitivity, 64%; specificity, 76%). The SIRSI-5 has excellent convergent validity with the SIRSI-12 to measure psychological readiness to RTS and can be used clinically with less patient burden than the SIRSI-12. However, in a population of surgically and nonsurgically treated contact athletes, the SIRSI-5 with a cut point of ≥59/100 had low levels of prediction accuracy for RTS at preinjury level. The SIRSI-5 should not be utilized in isolation to determine readiness to RTS, and clinicians should consider other factors such as age, type of sport, and time since injury to underpin their clinical reasoning when deciding for RTS.

Cross-Cultural Translation and Validation of the Thai Version of the Scale for the Assessment and Rating of Ataxia (SARA-TH).

To culturally adapt the original English Scale for the Assessment and Rating of Ataxia to Thai (SARA-TH) and to evaluate the reliability and validity of the SARA-TH in assessing ataxia in acute ischemic stroke or transient ischemic attack (TIA) patients, as assessed by three healthcare professionals. The SARA underwent translation and cross-cultural adaptation to Thai according to established guidelines. Reliability (e.g., internal consistency, intrarater reliability, interrater reliability) and validity (e.g., content validity, convergent validity) were assessed in a sample of 50 participants with ataxia after acute ischemic stroke or TIA. Spearman correlation analysis was used to examine the relationships between the SARA-TH and the Barthel Index (BI-TH), the National Institutes of Health Stroke Scale (NIHSS-TH), and the International Cooperative Ataxia Rating Scale (ICARS) to assess convergent validity. Interrater and intrarater reliability among experienced and novice neurologists, physiotherapists, and occupational therapists were assessed using weighted kappa. The SARA-TH demonstrated good comprehension and exhibited no significant floor or ceiling effects. It showed excellent internal consistency (Cronbach's α≥0.776). Significant correlations were found between the SARA-TH score and the BI-TH score (rs=-0.743 to -0.665), NIHSS- TH score (rs=0.404-0.513), and ICARS score (rs=0.859-0.917). The intrarater reliability for each rater ranged from 0.724 to 1.000 (p<0.01), and the interrater reliability varied from 0.281 to 0.927 (p<0.01). The SARA-TH has excellent internal consistency, validity, and intrarater reliability, as well as acceptable interrater reliability among health professionals with varying levels of experience. It is recommended for assessing ataxia severity in individuals following acute ischemic stroke or TIA.

Development and validation of a Knowledge, Attitudes and Practices (KAP) questionnaire for healthcare professionals on environmental sustainability in healthcare in Southern Africa

Background Global environmental degradation is increasingly driving poor health outcomes worldwide. Healthcare systems and services are often not environmentally sustainable and compound the problem, while healthcare professionals are also recognised as key leaders in advancing sustainable healthcare. To adopt this leadership position, healthcare professionals’ knowledge, attitudes, and practices regarding environmental sustainability in healthcare must be established. This article reports the development and validation of a new instrument for this purpose that corresponds to the specificities of the Southern African context. Methods Questionnaire development followed a seven-stage process. Information was obtained from a 2021 study titled ‘South African Healthcare Professionals’ Knowledge, Attitudes, and Practices Regarding Environmental Sustainability in Healthcare: A Mixed-Methods Study’ to develop the instrument. Information was also sourced from the literature regarding environmental sustainability and healthcare to generate the first questionnaire with 29 items. The following stages included two rounds of expert input, separated by a pilot study with the target population to receive feedback regarding the instrument’s structure, relevance, and length. Content validity was determined through statistical analysis. Results Feedback was received from nine experts in stage two and 13 pilot-study participants in stage four and incorporated to improve the questionnaire. In stage six, the questionnaire was rated by seven experts. The content validity index of the questionnaire was calculated at two different stages, after which the indices were compared. Following a final edit, the questionnaire has 24 questionnaire items. The closing analysis calculated the scale content validity index average (S-CVI/Ave) of 0,922; this indicates that the final questionnaire has excellent content validity. Conclusion A questionnaire that assesses the knowledge, attitudes and practices of healthcare professionals regarding environmental sustainability in Southern Africa has been developed and validated. This questionnaire can now be used for further studies in Southern Africa.

Comparing the properties of traditional and novel approaches to the modified Rankin scale: Systematic review and meta-analysis.

The Modified Rankin Scale (mRS) is the most commonly used functional measure in stroke research but is limited by inter-rater reliability (IRR). Various interventions to improve mRS application have been described. We aimed to compare properties of differing approaches to mRS assessment. Multidisciplinary databases (MEDLINE, EMBASE, Health and Psychosocial Instruments [OVID], CINAHL, PsycINFO [EBSCO]) were searched for adult human stroke studies describing psychometric properties of mRS. Two researchers independently screened 20% titles and abstracts, reviewed all full studies, extracted data, and conducted risk of bias (ROB) analysis. Primary outcomes for random-effects meta-analysis were IRR measured by kappa (K) and weighted kappa (KW). Validity and inter-modality reliability measures (Spearman's rho, KW) were also summarised. From 897 titles, 46 studies were eligible, including twelve differing approaches to mRS, 8608 participants. There was high ROB in 14 (30.4%) studies. Overall, reliability was substantial (n = 29 studies, K = 0.65, 95% CI: 0.58-0.71) but IRR was higher for novel approaches to mRS, for example, the Rankin Focussed Assessment (n = 2 studies, K = 0.94, 95% CI: 0.90-0.98) than standard mRS (n = 13 studies, K = 0.55, 95%CI:0.46-0.64). Reliability improved following the introduction of mRS training (K = 0.56, 95% CI: 0.44-0.67; vs K = 0.69, 95% CI: 0.62-0.77). Validity ranged from poor to excellent, with an excellent overall concurrent validity of novel scales (n = 6 studies, KW = 0.86, 95% CI: 0.75-0.97). The agreement between face-to-face and telephone administration was substantial (n = 5 studies, KW = 0.80, 95% CI: 0.74-0.87). The mRS is a valid measure of function but IRR remains an issue. The present findings are limited by a high ROB and possible publication bias. Interventions to improve mRS reliability (training, structured interview, adjudication) seem to be beneficial, but single interventions do not completely remove reliability concerns.

Revised Hospital Survey on Patient Safety Culture (HSOPSC 2.0): cultural adaptation, validity and reliability of the Malay version

BackgroundSurveys on Patient Safety Culture™ Hospital Survey (HSOPSC) developed by the U.S. Agency for Healthcare Research and Quality (AHRQ) has been adopted worldwide. The Hospital Survey on Patient Safety Culture (HSOPSC) version 2.0 was released in 2019, but there have been no publications to date of its translation and validation for use in Malaysia. This study aimed to translate and cross-culturally adapt the revised HSOPSC 2.0 into the Malay language and determine its psychometric properties including the content, face, and construct validity, and reliability analyses.MethodsThis study was conducted from April – June 2023 and divided into three stages: translation and cultural adaptation; content and face validation; and construct validation using confirmatory factor analysis and reliability testing among 319 healthcare personnel from a public university hospital in Malaysia.ResultsThe translated instrument demonstrated excellent content validity (I-CVI = 0.80 ~ 1.0, SCVI-average = 0.96) and face validity (I-FVI = 0.80 ~ 1.0, SFVI-average = 0.98). Reliability testing was acceptable (Cronbach’s α = 0.60 ~ 0.80) but indicated that reverse-coded items were poorly perceived. Confirmatory factor analysis showed a satisfactory model fit for the translated instrument (RMSEA = 0.08, GFI = 0.80, CFI = 0.80, and χ2/df = 2.96). Six items had very low factor loadings (< 0.40), with two constructs “Staffing and Work Pace” and “Response to Error” having AVE < 0.4, but acceptable CR ≥ 0.6. No items were removed from the questionnaire despite low factor loadings following a consensus from an expert panel.ConclusionThe Malay version of the HSOPSC 2.0 containing ten domains and 32 items demonstrated satisfactory psychometric properties following expert consensus, with acceptable reliability and construct validity for measuring patient safety culture. Given factor loadings smaller than 0.40 in six items, broader validation is suggested to support the use of the translated instrument in the Malaysian healthcare setting.

Adaptation and validation of an inventory for assessing subjective task value beliefs regarding the decision to pursue postgraduate studies

The desire to pursue postgraduate studies is motivated by several interrelated and multifaceted factors ranging from intrinsic to extrinsic. However, little consensus exists in the literature regarding an instrument that assesses an individual's motivation for pursuing postgraduate education. In this study, we adapted and validated a pre-existing inventory that evaluates the individuals' motives for pursuing postgraduate studies using the subjective task value beliefs framework. The study, in particular, focused on assessing the factor structure, construct validity, and reliability of the adapted scale. Study participation invitations were sent to a pool of postgraduate students in two higher education institutions, of which 501 students finally responded to the online questionnaire. The exploratory and confirmatory factor analyses were used to analyse the data to address the research objectives. The results revealed a five-factor structure for the adapted scale with excellent construct validity and reliability indicators. The findings of the research add value to the psychometric literature and also provide a useful instrument for use among instructors, researchers, and university administrators in their line of duty.

Psychometric Assessment of the Temporal Bisection Task with Discrete and Continuous Response Formats

Abstract The temporal bisection task has long been used to study time perception as well as measure individual differences in time perception ability. The task involves training participants on short and long reference durations before presenting intermediate durations and asking participants to classify them as ‘short’ or ‘long’. However, there is little information about how well the bisection task measures individual differences in timing ability. To bridge this gap, we assessed the psychometric properties of measures obtained from a classic temporal bisection task: Weber ratio and percent correct. Because measures with binary responses tend to require many trials to reach adequate reliability, we also assessed the psychometric properties of a modified bisection task which used a continuous response format. In this task, participants represented intermediate durations on a visual analogue scale. Estimation error was used as the outcome measure. Participants (n = 46) completed the classic and modified bisection tasks twice across two sessions approximately one week apart. The modified bisection task had excellent internal consistency and test–retest reliability, while the classic task had fair to good internal consistency and good test–retest reliability. Overall, estimation error had the highest reliability, followed by percent correct, and then Weber ratio. In terms of validity, there was excellent convergent validity between the classic and modified bisection tasks. As an exploratory analysis, we assessed how the number of trials affected the reliability of each outcome measure across the two tasks. Based on this, we make recommendations on how to optimize reliability for both tasks in future research.