Maximal Reliability Research Articles

Psychometrics evaluation of the Persian version of Attitudes toward Patient Safety Questionnaire (APSQ-III) in nursing students

BackgroundThe topic of patient safety and attitudes toward patient safety among health professionals is a main priority of healthcare systems globally. This study aims to investigate the psychometric properties of APSQ-III among Iranian nursing students.MethodsThere were 307 undergraduate nursing students who participated in the cross-sectional methodological study, from December 2022 to January 2023. Content validity, Construct validity and reliability of the APSQ-III was evaluated.ResultsIn the exploratory factor analysis, three factors were identified from 11 items, accounting for 58% of the total variance. The confirmatory factor analysis indices confirmed the model fit (χ2(38) = 91.851, p < 0.001, χ2/df = 2.417, CFI = 0.966, PNFI = 0.652, IFI = 0.966, TLI = 0.951 and RMSEA = 0.068). The results of the reliability evaluation indicated that the factors demonstrated a satisfactory level of internal consistency, as evidenced by Cronbach's alpha (α) and McDonald's omega (ω) values. Additionally, the Composite Reliability (CR) and Maximal Reliability H were both above 0.8, further supporting the reliability of the factors.ConclusionThe results of this study support the valid and reliable APSQ-III with 11 items and three factors. This questionnaire can be used to assess patient safety attitude among nursing students.

Note on the radical inflation in the estimates of error variance in measurement models

This note discusses the radical technical inflation in error variance and the related standard error of test scores from both conceptual and empirical viewpoints. This technical inflation arises as a direct consequence of the technical underestimation of item-score correlation by the product–moment coefficient of correlation (PMC), which is embedded in the traditional estimators of reliability such as coefficients alpha, theta, omega, or rho (maximal reliability). Specifically, in educational settings where compilations usually include both easy and difficult items, the estimate by PMC may substantially deviate from the true association between an item and the score. Consequently, the use of traditional estimators of reliability leads to technically inflated estimates of standard errors, as the error variance related to these traditional measurement models is significantly inflated, resulting in deflated reliability estimates. In educational testing, employing deflation-corrected standard errors, calculated using deflation-corrected reliability estimators, would provide a more accurate measure of the test score’s true precision.

Evaluation of Maximal Reliability for Multidimensional Measuring Instruments Using Structural Equation Modeling

Multidimensional measuring instruments are often used in behavioral, social, educational, marketing, and biomedical research. For these scales, the paper discusses how to find the optimal score based on their components that is associated with the highest possible reliability. Within the framework of structural equation modeling, an approach to point and interval estimation of the maximal reliability coefficient of general structure measuring instruments is outlined. The procedure allows obtaining in addition the linear combination of all scale components that possesses maximal reliability. The described method is applicable in empirical research with popular statistical software, and is illustrated using an example.

Factor Structure and Reliability of the Persian Version of Body Esteem Scale Among Iranian Adults: Exploratory Graph Analysis Approach.

Background and Purpose: The present study aimed to examine the psychometric properties of the Persian version of the Mendelson and White Body Esteem Scale in Iranian adults. Methods: This cross-sectional study design was used and carried out in 2023. Following the inclusion criteria, 500 adults were gathered from Tehran (Tehran, Iran) with an accessible sampling method. After translation of Body Esteem Scale to Persian language, construct validity (with factor analysis and exploratory graph analysis) and reliability were assessed. Results: The mean age of the participants was 30.66 (standard deviation = 7.40) years. The results of Maximum Likelihood Exploratory Factor Analysis (MLEFA) with Promax with Kaiser normalization rotation extracted three factors accounting for 43.4% of the variance comprising 21 items. Also, after necessary modifications during confirmatory factor analysis, the final model was approved. As for construct reliability, the Cronbach's alpha, Composite Reliability, and Maximal Reliability for all constructs were greater than 0.7, demonstrating good internal consistency and construct reliability. Conclusions: According to results, the Persian version of Body Esteem Scale has a valid structure and acceptable reliability. This scale can be used by health professionals in many ways.

Confirmatory factor analysis of the Teacher Efficacy for Inclusive Practices scale: A study of teachers in Bosnia and Herzegovina

AbstractThe Teacher Efficacy for Inclusive Practices (TEIP) scale is a widely used instrument for assessing teachers' effectiveness in implementing inclusive practices. The TEIP has not been validated in Bosnia and Herzegovina (BIH). The goal of the present study was to conduct a confirmatory factor analysis (CFA) of the TEIP in a sample of teachers in BIH. The sample consisted of 239 elementary school teachers (204 females, 35 males; mean age‐ 43.5 years, SD‐ 8.3 years). The results of the CFA found that the original TEIP structure was not a good fit for our data. However, through some modifications on the item level, we created a satisfactory model that retained the same structure as the original TEIC. The composite reliability and construct maximal reliability were well above the recommended cut point of 0.70 for all factors. Our findings suggest that the modified version of the TEIP has the potential to be an effective and useful instrument for assessing teachers' efficacy in inclusive practices in BIH. This study represents an important step towards the cultural adaptation and validation of the TEIP in BIH, highlighting areas for future research and application in diverse educational contexts.

Parental hesitancy toward children vaccination: a multi-country psychometric and predictive study

AimUnderstanding vaccine hesitancy, as a critical concern for public health, cannot occur without the use of validated measures applicable and relevant to the samples they are assessing. The current study aimed to validate the Vaccine Hesitancy Scale (VHS) and to investigate the predictors of children’s vaccine hesitancy among parents from Australia, China, Iran, and Turkey. To ensure the high quality of the present observational study the STROBE checklist was utilized.DesignA cross-sectional study.MethodIn total, 6,073 parent participants completed the web-based survey between 8 August 2021 and 1 October 2021. The content and construct validity of the Vaccine Hesitancy Scale was assessed. Cronbach’s alpha and McDonald’s omega were used to assess the scale’s internal consistency, composite reliability (C.R.) and maximal reliability (MaxR) were used to assess the construct reliability. Multiple linear regression was used to predict parental vaccine hesitancy from gender, social media activity, and perceived financial well-being.ResultsThe results found that the VHS had a two-factor structure (i.e., lack of confidence and risk) and a total of 9 items. The measure showed metric invariance across four very different countries/cultures, showed evidence of good reliability, and showed evidence of validity. As expected, analyses indicated that parental vaccine hesitancy was higher in people who identify as female, more affluent, and more active on social media.ConclusionsThe present research marks one of the first studies to evaluate vaccine hesitancy in multiple countries that demonstrated VHS validity and reliability. Findings from this study have implications for future research examining vaccine hesitancy and vaccine-preventable diseases and community health nurses.

Monte Carlo simulation studies of reliability in psychometrics

Monte Carlo simulation studies are widely used in reliability research. This study reviewed 85 published Monte Carlo simulation studies investigating reliability. The review focused on the prevalence of particular reliability estimation methods and estimators, as well as adherence to previous recommendations for the Monte Carlo simulation method. It appears researchers do not fully adhere to these recommendations. Most of the reviewed studies have limitations in at least one of the following: reporting on the data generation procedure, selection of the number of replications, selection of conditions, benchmark utilization, and performance evaluation. Findings also suggest internal consistency in general and coefficient α are the most prevalent. Conversely, some reliability estimation methods and estimators that can be useful under many empirical conditions appear to be mostly overlooked. In the case of internal consistency, these are relatively obscure forms of α, λ2, λ4, μ-series, Kristof's coefficient, Feldt-Gilmer coefficient, maximal reliability, greatest lower bound to reliability, ω family, structural equation modeling-based coefficients, and internal consistency confidence intervals. Overlooked reliability estimation methods are parallel forms, test-retest, multilevel reliability, latent class-based reliability, reliability of an individual, and Bayesian reliability. Suggestions for future research have been offered.

Applying the Taguchi Method to Improve Key Parameters of Extrusion Vacuum-Forming Quality.

This research investigates the control of thickness and weight in plastic extrusion vacuum-thermoforming products to identify optimal key parameters for cost reduction and energy savings. The initial step involves identifying crucial influencing factors. In this step, the Delphi technique was employed through a questionnaire administered to a panel of expert scholars to ensure minimal error and maximal reliability in determining key influencing factors. Consensus was sought to establish appropriateness and consistency. Subsequently, the Taguchi method was applied for quality design and planning of the extrusion vacuum-forming process. The experimental design parameters were selected using an L18 (21 × 37) orthogonal array, and the desired quality characteristics were determined. Comparative analysis of quantitative production data from two consecutive experiments was conducted, and based on F-values and contribution analysis, the combination of control factors maximizing the Signal-to-Noise (S/N) ratio was identified. The objective is to seek optimal parameters for improving the quality of the plastic polypropylene (PP cup lid) manufacturing process, reducing process variability, and identifying the most robust production conditions. Through multiple actual production prediction experiments, it was determined that five control factors, "polypropylene new material ratio," "T-die lips adjustment thickness", "mirror wheel temperature stability", "molding vacuum pressure time", and "forming mold area design", contribute to the maximization of the S/N ratio, i.e., minimizing variability. Statistical validation confirms a significant improvement in product quality and weight control. Noteworthily, the quality control model and experimental design parameters established in this study are also applicable to other plastic products and bio-based materials, such as PET, HIPS, and biodegradable PLA lids with added calcium carbonate. The results of the experimental production demonstrate its ability to consistently control product weight within the range of 3.4 ± 0.1 g, approaching the specified tolerance limits. This capability results in approximately 2.6% cost savings in product weight, contributing significantly to achieving a company's KPI goals for environmental conservation, energy efficiency, and operational cost reduction. Therefore, the findings of this study represent a substantial and tangible contribution.

Bayesian Maximal Reliability Evaluation Using Latent Variable Modeling

ABSTRACT We discuss an application of Bayesian factor analysis for estimation of the optimal linear combination and associated maximal reliability of a multi-component measuring instrument. The described procedure yields point and credibility interval estimates of this reliability coefficient, which are readily obtained in educational and behavioral measurement research. In addition, the outlined method permits evaluation of the gain in measurement consistency resulting from utilizing the maximal reliability coefficient instead of the traditionally used overall sum score reliability. The discussed Bayesian inference approach is applicable with widely available software in empirical studies, and is illustrated using a data example.

Testing and validating the collaborative for academic, social, and emotional learning (CASEL) model in the context of Ethiopian secondary schools: Factorial analysis

Social-emotional learning (SEL) is widely recognized for fostering students' social and emotional skills essential for academic and personal growth, yet culturally validated SEL assessment tools are scarce, especially in Ethiopia. The study aimed to establish a psychometrically sound measurement scale to assess SEL and competence in secondary school students in eastern Ethiopia. Utilizing a correlational research design, exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were employed to develop a suitable SEL measurement model. The sample comprised 406 participants, including 294 teachers and 112 students. Cronbach's alpha coefficients for SEL subscales ranged from .81 to .85, indicating reliable internal consistency. Construct reliability and validity were confirmed through composite reliability, maximal reliability, and discriminant and convergent validity checks. The refined four-factor model revealed the interrelatedness and significance of SEL components, with social awareness emerging as the most significant indicator. The study underscores the importance of context in shaping SEL constructs and highlights the need for educational strategies that consider cultural and contextual factors. The findings enhance the understanding of SEL in eastern Ethiopia and advocate for empirically-driven approaches to construct validation, emphasizing the interconnected nature of SEL domains in educational interventions.

On the Benefits of Using Maximal Reliability in Educational and Behavioral Research.

This note is concerned with the benefits that can result from the use of the maximal reliability and optimal linear combination concepts in educational and psychological research. Within the widely used framework of unidimensional multi-component measuring instruments, it is demonstrated that the linear combination of their components that possesses the highest possible reliability can exhibit a level of consistency considerably exceeding that of their overall sum score that is nearly routinely employed in contemporary empirical research. This optimal linear combination can be particularly useful in circumstances where one or more scale components are associated with relatively large error variances, but their removal from the instrument can lead to a notable loss in validity due to construct underrepresentation. The discussion is illustrated with a numerical example.

Multiposture leg tracking for temporarily vision restricted environments based on fusion of laser and radar sensor data

AbstractLeg tracking is an established field in mobile robotics and machine vision in general. These algorithms, however, only distinguish the scene between leg and nonleg detections. In application fields like firefighting, where people tend to choose squatting or crouching over standing postures, those methods will inevitably fail. Further, tracking based on a single sensor system may reduce the overall reliability if brought to outdoor or complex environments with limited vision on the target objectives. Therefore, we extend our recent work to a multiposture detection system based on laser and radar sensors, that are fused to allow for maximal reliability and accuracy in scenarios as complex as indoor firefighting with vastly limited vision. The proposed tracking pipeline is trained and extensively validated on a new data set. We show that the radar tracker reaches state‐of‐the‐art performance, and that laser and fusion tracker outperform recent methods.

Understanding Employees’ Energy Saving in the Workplace: DR and the Philippines’ Realities

Understanding how employees act at work to save energy and the meaning for sustainability and environmental protection is essential. This research aimed to analyze the influences of Subjective Norms (SN), Descriptive Norms (DN), and Environmental Knowledge (EK) on employees’ intention to save energy (ISE) in the Philippines (PH) and the Dominican Republic (DR). The effects of SN, DN, and EK on ISE were evaluated by comparing two developing countries and the mediation effect of EK on the relationship between DN, SN, and ISE. Confirmatory factor analysis (CFA), followed by structural equation modeling and path analysis based on samples collected from employees from DR (340) and PH (339), was performed. Also, construct convergent and discriminant validity were assessed using composite reliability, maximal reliability, average variance extracted, and maximum shared variance. The findings of this study indicate that SN influences ISE positively among employees in PH (β = 0.15, p &lt; 0.05) but not among employees in DR. Descriptive Norms positively influence ISE among employees in PH (β = 0.47, p &lt; 0.01) and DR (β = 0.27, p &lt; 0.01), while EK has a positive and significant influence on the ISE among employees in PH (β = 0.22, p &lt; 0.01) and not in DR. There is a partial mediation effect between SN and EK on ISE when EK is the mediator in PH, and no mediation effects for RD. The intention to save energy is significant in economic terms because reducing energy consumption can help decrease energy costs and improve business profitability and competitiveness; in social terms, it can reduce energy consumption worldwide and improve social health, reducing gas emissions and pollution.

A twisted yieldable rock bolt as a tool for dissipation of the ground pressure energy

An innovative design of a twisted yieldable rock bolt has been developed using the system analysis of conventional rock bolt technology, a thermodynamic approach, and a theory of technical creativity. This bolt consists of one single piece of a metal cylindrical rod having longitudinal feathers that provided its maximal reliability and minimized the cost. The bolt can be driven into a hole with a pneumatic hammer and creates a set of dissipative structures during rock mass deformation that facilitates and intensifies the dissipation of ground pressure energy causing stress relief around an underground opening. A 30 cm section of the bolt was successfully tested in special laboratory equipment, one 1.8 m bolt in a mechanic workshop, and fifty-five 1.8 m bolts in an underground entry of a coal mine. The behavior of this bolt was simulated on the FLA3D model to verify its basic parameters and to understand deeper abilities to yield and resist rock mass deformation. This bolt is fastened to the hole's wall for its entire length, thus the resistance and the energy dissipation indicators of this bolt are extensive parameters, hence the 2-m-length bolt can exceed the performance of the best modern prototypes. This bolt is relevant to provide stability to underground openings in hard squeezing conditions.

Attenuation-Corrected Estimators of Reliability.

The estimates of reliability are usually attenuated and deflated because the item–score correlation (, Rit) embedded in the most widely used estimators is affected by several sources of mechanical error in the estimation. Empirical examples show that, in some types of datasets, the estimates by traditional alpha may be deflated by 0.40–0.60 units of reliability and those by maximal reliability by 0.40 units of reliability. This article proposes a new kind of estimator of correlation: attenuation-corrected correlation (R AC ): the proportion of observed correlation with the maximal possible correlation reachable by the given item and score. By replacing with R AC in known formulas of estimators of reliability, we get attenuation-corrected alpha, theta, omega, and maximal reliability which all belong to a family of so-called deflation-corrected estimators of reliability.

Psychometric evaluation of the acute care nurses' job satisfaction scale-revised.

The aim of this study was to validate a job satisfaction scale among acute care nurses in the context of Qatar. Cross-sectional correlational survey. A convenience sampling technique was used to recruit 295 acute care nurses between June 2021-September 2021. Exploratory factor analysis followed by confirmatory factor analysis was used for item reduction and convergent and discriminant validity evaluation. Pearson's correlations were conducted to evaluate the concurrent and convergent validity of the revised scale. Reliability was tested using several internal consistency indicators. A revised scale was proposed, the Acute Care Nurses Job Satisfaction Scale-Revised (ACNJSS-R) scale; it is composed of 13 items loaded on five factors. The composite reliability and the maximal reliability were >.7 for all factors. The study provides empirical support for the validity and reliability of the ACNJSS-R scale.

Validity and Reliability of Persian Version of the 12-Item Expectations Regarding Aging Survey.

Objective:The present study was designed to assess the construct validity and reliability of the Persian version of the 12-item Expectations Regarding Aging (ERA) survey among the older adult Iranian population. Methods: The Persian version of this scale was developed using translation and revision in the current study. The construct validity was assessed through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). The reliability was assessed through internal consistency (Cronbach's alpha and McDonald's omega), composite reliability (CR), and maximal reliability (MaXR). The data compiled online was based on a sample of 400 older adults aged 65 years and older. Results: The Persian version includes 12 items loading onto three factors with 12 items explaining 46.633% of the total variance with excellent internal consistency and reliability. Conclusion: The Persian version of ERA is reliable and valid that can be used to assess the ERA concept among older adults.

The Consideration of Future Consequences Scale Among Malaysian Young Adults: A Psychometric Evaluation.

Background: The consideration of future consequences (CFC) determines the extent to which individuals consider the potential future outcomes of their current behavior. The significance of assessing the CFC scale’s validation in different contexts has been acknowledged by the previous studies. While the majority of the studies have been conducted in western countries, no study has been conducted in Malaysia. The aim of the current study was to validate a Malaysian version of the CFC scale among Malaysian young adults.Methods: The methodological cross-sectional approach was adopted in this study. The study recruited 529 young adults (age range from 25 to 40) who fulfilled the inclusion criteria of the paper survey. Construct validity was assessed using content validity, convergent validity, and discriminant validity. Cronbach’s alpha, McDonald’s omega, and average inter-item correlation (AIC) were used to assess the scale’s internal consistency. Also, composite reliability (CR) and maximal reliability (MaxR) were used to assess the construct reliability. Measurement invariance was tested across gender.Results: The findings of the exploratory factor analysis indicated that the Malaysian version of the CFC scale has a two-factor structure (i.e., CFC-Future and CFC-Immediate) with 10-item explaining 61.682% of the total variance. The confirmatory factor analysis (CFA) supported the two-factor structure of the CFC scale with good construct validity. The internal consistency and CR were acceptable. [The Cronbach’s alpha, McDonald’s omega, and CR for CFC-I were 0.901 (CI 95%: 0.881–918), 0.901, and 0.887, respectively. Also, these parameters for CFC-F were 0.867 (CI 95%: 0.838–891), 0.868, and 0.867, respectively].Conclusion: We found acceptable psychometric evidence for the 10-item two-factors CFC scale used in the context of young adults in Malaysia. The validated instrument can be used in future studies to assess young adults’ CFC tendency and CFC-related behavior in Malaysia.

Psychometric Properties of the Impact of Events Scale-Revised (IES-R) Among General Iranian Population During the COVID-19 Pandemic.

Objective: The aim of this study was to translate and evaluate the validity and reliability of the Impact of Events Scale-Revised (IES-R) among the Iranian general population during the coronavirus disease 2019 (COVID-19) pandemic.Method: This study was methodological cross-sectional. It was conducted on an Iranian public population from April to July 2020 which was during the COVID-19 pandemic. Construct validity was determined through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) with a total of 500 adults recruited via online data gathering. Reliability was checked through the average inter-item correlation (AIC), Cronbach's alpha, and McDonald's omega. Convergent and divergent validity was determined using Fornell and Larcker's approach.Results: The results showed that the Persian version of IES-R had three factors, including intrusion (six items), avoidance (seven items), and hyperarousal (five items), that explained 59.22% of the total variance of the IES-R. The CFA findings indicated that all goodness-of-fit indices confirmed the model fit. The Cronbach's alpha, McDonald's omega, composite reliability (CR), and maximal reliability were excellent, and the three factors have good convergent validity.Conclusion: The findings of this study indicated that the Persian version of the IES-R scale is efficient and useful to assess post-traumatic stress disorder among Iran general population in the COVID-19 outbreak.

Perspectives on Pooled Data Analysis: the Case for an Integrated Approach

In the absence of definitive trials on the safety and efficacy of drugs, a systematic and careful synthesis of available data may provide critical information to help decision making by policy makers, medical professionals, patients and other stakeholders. However, uncritical and unbalanced use of pooled data to inform decision about important healthcare issues may have consequences that adversely impact public health, stifle innovation, and con found medical science. In this paper, we highlight current methodological issues and discuss advantages and disadvantages of alternative meta-analytic techniques. It is argued that results from pooled data analysis would have maximal reliability and usefulness in decision making if used in a holistic framework that includes presentation of data in light of all available knowledge and effective collaboration among academia, industry, regulatory bodies and other stakeholders.