Reliability Study Research Articles

Does recall bias explain the association of mood disorders with workplace harassment?

PurposeTo determine the contribution of recall bias to the observed excess in mental ill-health in those reporting harassment at work. MethodsA prospective cohort of 1885 workers in welding and electrical trades was contacted every six months for up to 5 years, asking whether they were currently anxious or depressed and whether this was made worse by work. Only at the end of the study did we ask about any workplace harassment they had experienced at work. We elicited sensitivity and specificity of self-reported bullying from published reliability studies and formulated priors that reflect the possibility of over-reporting of workplace harassment (exposure) by those whose anxiety or depression was reported to be made worse by work (cases). We applied the resulting misclassification models to probabilistic bias analysis (PBA) of relative risks. ResultsWe observe that PBA implies that it is unlikely that biased misclassification due to the study subjects' states of mind could have caused the entire observed association. Indeed, the results demonstrated that doubling of risk of anxiety or depression following workplace harassment is plausible, with the unadjusted relative risk attenuated with understated uncertainty. ConclusionsIt seems unlikely that risk of anxiety or depression following workplace harassment can be explained by the form of recall bias that we proposed.

Ultrasound Examination of the Median Nerve at Different Levels: Inter-rater Reliability Study

Ultrasound Examination of the Median Nerve at Different Levels: Inter-rater Reliability Study

Evaluation of the Oxford cognitive screen Indonesian version (OCS-Ina) for assessing cognitive function disorders: validation and reliability study

Background and objectives. The Oxford Cognitive Screen (OCS) is a valuable tool for assessing cognitive function, particularly in the context of aphasia and neglect. This study aims to assess the validity and reliability of the Indonesian version of OCS (OCS-INA), which has been adapted and translated following WHO guidelines. Materials and methods. The adaptation and translation process of OCS, in accordance with WHO guidelines, preceded the validity and reliability testing of OCS-INA. The study included participants aged 18 years and above with normal cognitive function, as assessed by the Moca-INA. Data collection took place in social institutions and healthcare facilities that met the specified inclusion criteria. Results. Among the 104 participants meeting the inclusion criteria, a majority were male (51.92%), with ages ranging from 20 to 87 years, and the highest age group being above 60 years (60%). Most participants had a high school education level (35.58%) and were not employed (62.5%). Validity testing, using the Spearman correlation coefficient formula, revealed that the majority of domains had calculated correlation coefficients (r values) exceeding the table values (0.1927). In terms of reliability, the kappa p statistic indicated very good agreement for six examination tasks: semantic (0.874), orientation (0.842), verbal memory (0.822), episodic memory (0.870), and visual field test (1.000). Good agreement scores were obtained for the picture naming test (0.774), sentence reading (0.726), and calculation (0.774). Conclusions. In conclusion, OCS-INA demonstrates both validity and reliability as a screening tool for cognitive impairment. It serves as a valuable complement to existing instruments used for similar purposes.

Pro-Social Behavior Scale (PSBS) Development Study

In this study, it was aimed to develop a measurement tool to measure the prosocial behaviors of adolescents. The research was carried out on 540 students studying at secondary and high school levels in Istanbul and Küçükçekmece districts. After the exploratory factor analysis, it was observed that the scale consisted of 4 sub-dimensions: empathy, altruism, sympathy and self-worth. The theoretical structure of these four dimensions of the scale was supported by confirmatory factor analysis. The variance explained by all items of the scale was measured as 66.75. In order to support the validity level of the scale, it was observed that the correlations between the item discrimination values of the items calculated with the t-test and the subscale scores were significant. The external validity of the scale was compared with the previously developed prosocial behavior scale and significant relationships were found between them. Cronbach Alpha values were calculated for the reliability study of the scale, and it was observed that the reliability values of the scale, including the total scale scores, ranged between .74 and .91. In the light of the psychometric data obtained as a result, a measurement tool with high reliability and validity values was developed for adolescents.

MODERN DİN ALGISI ÖLÇEĞİNİN (MODÖ) GELİŞTİRİLMESİ: GEÇERLİK VE GÜVENİRLİK ÇALIŞMASI

Bu araştırmada lise öğrencilerinin modern din algılarını tespit etmek için Modern Din Algısı adında bir ölçeğin geliştirilmesi amaçlanmıştır. AFA için 324; DFA için 320 toplamda 644 öğrenciyle bu çalışma yürütülmüştür. Uzman görüşleri ve pilot uygulama sonuçlarına göre AFA öncesi 24 maddeden oluşan bir ölçek formuna ulaşılmış ve bu form öğrencilere uygulanmıştır. AFA sonrası 15 maddeden oluşan ölçek formu elde edilmiştir. DFA sonucu 2 madde ölçekten çıkarılarak 13 maddeli yapıya ulaşılmıştır. MODÖ, üç boyut (Eklektik-Senkretik/Spiritüalist; Dini Otoriteye Karşıtlık/Özerk; Rasyonalist/Pozitivist) ve 13 maddeden oluşmaktadır. Ölçeğin toplam varyansı %50,30 olarak bulunmuş, KMO değeri ,885; Barlett test değeri, 1491,816’dır. Cronbach Alpha güvenirlik katsayısı ,875; ikiye ayırma güvenirlik analiz değeri ,782 ve boyutların ayırt edicilik düzeylerini belirlemek için %27’lik alt-üst grup puanları arasında yapılan t-test sonuçları sırasıyla t(88)= –35,84, –38,24, – 35,38, –33,87 p< ,01 olarak bulunmuştur. DFA sonuçları model uyum indekslerini iyi düzeyde karşıladığı için oluşturulan yapının istatistiksel ve kuramsal açılardan uygun olduğu değerlendirilmektedir. Sonuç olarak MODÖ’nün geçerli ve güvenilir olduğu belirlenmiştir.

Validity and reliability study of Turkish version of abbreviated science anxiety scale

The aim of this study is to adapt “Abbreviated Science Anxiety Scale”(ASAS) developed by Megreya et al. (2021) to Turkish and to investigate the reliability and validity of Turkish-ASAS. In the adaptation study, some steps were determined and implemented. After the English-Turkish translation validity of ASAS was ensured, data were collected within the scope of the survey study for reliability and validity studies. The study group in the scale adaptation study are experts (teaching staff in science education, Science teacher, and English teacher) and 410 middle school students (Grade 5, 6, 7 and 8). After the descriptive statistics and item analysis were made, a exploratory and confirmatory factor analysis was performed to reveal the factor structure. The adaptation stage findings shows the two-factor structure of ASAS. These factors are “learning science anxiety” and “science evaluation anxiety”. Cronbach Alpha reliability coefficient for ASAS-Turkish was calculated as 0.703. As in the original scale, ASAS-Turkish is a 5-point Likert type scale and consisting of 9 items. The results show that ASAS-Turkish is a short, valid and reliable tool. Low scores on the ASAS indicate low anxiety and high scores indicate high anxiety. It can be used to guide and enhance scientific study.

THE ONLINE DATING INTENSITY SCALE (ODI): VALIDITY AND RELIABILITY STUDY OF TURKISH FORM

The main purpose of the current research is to adapt the Online Dating Intensity Scale (CFAS), developed by Bloom and Taylor (2019) to evaluate the frequency of use of individuals using online dating programs, into Turkish and to conduct reliability and validity studies of the scale. The sample of the research consists of 110 participants who have previously used and/or are currently using any online dating program. Within the scope of the current study, the original form of the scale was translated into Turkish by experts, and the back-translation was made by experts fluent in both languages. For the validity and reliability analyses of the scale, Confirmatory Factor Analysis (CFA) was examined for construct validity, and Cronbach alpha internal consistency coefficient and Composite Reliability (CR) coefficients were examined for reliability analyses. Research findings revealed that the two-factor solution was confirmed in Confirmatory Factor Analysis (CFA). In addition, the Cronbach Alpha Coefficient of the scale is 0.92, and the Composite Reliability (CR) coefficients are 0.86 for the attitudes and 0.71 for intensity sub-dimensions. As a result, it was concluded that the scale has very good psychometric properties and allows a valid and reliable assessment of the intensity of online dating experiences in Turkish culture.

An investigation into accidents in laboratories in universities in China caused by human error: A study based on improved CREAM and SPAR-H

Although considerable research has been devoted to improving safety in university laboratories, accidents, in that environment, have still occurred frequently at the cost of serious injury or even death of laboratory personnel. Currently, few Human Reliability Analyses (HRA) have been conducted with respect to a university laboratory. The aim of the research was to conduct a reliability study relating to human behaviour in a university laboratory to explore quantitatively the causes and influencing factors relating to the frequency of laboratory accidents. Improved Cognitive Reliability and Error Analysis Method (CREAM) and improved Standardized Plant Analysis Risk HRA (SPAR-H) were employed to assess Human Error Probability (HEP) of 23 subjects. The HEP calculated through improved CREAM proved more accurate than results obtained through improved SPAR-H. Unexpectedly, the results demonstrated that under similar environmental conditions, the HEP of subjects did not decrease with an increase in educational background, including additional experimental time and experience. Moreover, environmental conditions exerted greater impact on personnel reliability than Human Inherent Factors (HIFs) in laboratories. It is anticipated that the study would provide valuable insights, in respect of research methods, and to serve as a practical basis for lowering the accident rate in university laboratories.

Adaptation of student feedback literacy scale into Turkish culture: A study of reliability and validity

The present study reports on the adaptation of the Student Feedback Literacy Scale developed for the Turkish learning context by following a rigorous scale adaptation process. Three groups participated in this study: 31 undergraduate students in the translation stage, and two groups, including 291 and 401 undergraduate students, in the construct validity stages. The statistical analyses include paired-samples t-test, correlation analysis, Exploratory Factor Analysis (EFA), Confirmatory Factor Analysis (CFA), multi-group CFA, and reliability analyses. According to the EFA results, two items under two different factors were removed from the scale due to their low factor loadings and negative impact on the reliability indices. The results from CFA and reliability analyses indicated that the Student Feedback Literacy Scale including 22 items and six factors of Eliciting, Processing, Enacting, Appreciation of Feedback, Readiness to Engage, and Commitment to Engage is valid and reliable in Turkish learning context. This adapted instrument can be used by researchers and practitioners working with Turkish undergraduate students to better capture students’ level of feedback literacy, enabling the development of tailored feedback strategies. It can also serve as pre- and post-tests in longitudinal research, allowing for a critical evaluation of pedagogical interventions designed to enhance student feedback literacy.

Feasibility of the pitch efficiency rating: A novel tool for systematic assessment of pitching mechanics in developing throwing athletes.

Injuries in younger baseball athletes continue to increase despite work characterizing risk factors. Three-dimensional (3D) motion capture may identify suboptimal pitching mechanics that predispose an athlete to injury, but 3D-motion analysis is often inaccessible. Thus, there is a gap between the current biomechanics literature and its practical application in young athletes. The current study aims to assess the reliability of the pitch efficiency rating (PER) as a systematic tool to evaluate throwing mechanics in developing baseball pitchers. To determine the feasibility of application and reliability of a novel, scientifically informed tool (PER) for the assessment of pitching mechanics. Reliability study using Bland-Altman methods for assessing agreement between two raters. Academic medical center through community outreach. Pitching mechanics were assessed and rated with the PER for 40 athletes (26 high school, 14 Division III), average age 19.0 years old (range 15.3-23.7 years old). N/A. Interrater and intrarater reliability as calculated by intraclass correlation coefficient (ICC). For initial readings comparing interrater reliability between Rater 1 and Rater 2, the ICC was calculated at 0.80 (95% confidence interval [CI] 0.66-0.89) and 0.76 (95% CI 0.60-0.86) for the second set of ratings. Regarding intrarater reliability across reads, ICC was found to be 0.63 (95% CI 0.43-0.79) for Rater 1, and 0.91 for Rater 2 (95% CI 0.85-0.95). The present study introduces the PER as a potential tool for evaluating pitching mechanics. However, the intrarater reliability of the PER did not meet preestablished criteria in one of the two pilot raters. Further study is needed to continue to assess the reliability of the tool across diverse demographics.

Academic Buoyancy: A Scale Development and Validation Study

The primary aim of this study was to develop a reliable and valid tool for evaluating students' academic buoyancy. After the exploratory factor analysis, a structure comprising 26 items and five factors was formed. These factors were identified as commitment, composure, confidence, coordination, and control, collectively explaining 60.20% of the overall variance. CFA was performed, and the fit index values were found as follows: χ2=815.113, df=286, (χ2/ df =2.85), RMSEA=.07, CFI=.88, GFI=.85, IFI=.88. It was concluded that all values obtained from CFA analysis are sufficient to verify the structure. It was also supposed that the 26 items-five factor structure was confirmed as a model. Related to the validity and reliability studies of the scale, the convergent and discriminant validity were checked. Each factor demonstrated Cronbach's alpha coefficients ranging from .90 to .71. After examining all the results, it was found out that the scale is valid and reliable for measuring students' academic buoyancy.

Validity and Reliability of the Turkish Version of the Gastroesophageal Reflux Disease Quality of Life Questionnaire

Objective: Gastroesophageal reflux is a disease that is common in society and affects quality of life. The aim of the present study was to test the validity and reliability of the Turkish version of the Gastroesophageal Reflux Disease Quality of Life scale.
 Methods: A total of 161 patients with gastroesophageal reflux disease who applied to the gastroenterology outpatient department of a university hospital between July 2017 – October 2017 constituted the sample of this study. The study was a methodological and descriptive study. In the validity and reliability studies, the language validity, content validity, internal consistency (Cronbach’s alpha reliability coefficient) and confirmatory factor analysis methods were used.
 Results: The Cronbach’s alpha reliability coefficient of the Gastroesophageal Reflux Disease Quality of Life scale was α = 0.885, while its content validity ranged between 0.84-0.92. According to confirmatory factor analysis, the 4-factor structure of the scale, consisting of 16 items, generally had good fit.
 Conclusion: The Turkish version of the Gastroesophageal Reflux Disease Quality of Life scale was found to be a valid and reliable scale that can be used to measure the quality of life of individuals diagnosed with gastroesophageal reflux disease.

Erkennen und Bewältigen von Einsamkeit im betrieblichen Kontext

Recognizing and coping with loneliness in the workplace context Objectives: Loneliness manifests itself as an unpleasant feeling that arises when social relationships are perceived as inadequate. While temporary loneliness can be helpful, permanent loneliness is associated with mental and physical illness. As some causes and effects can also be found in the workplace context, companies should address the issue. Method: A systematic literature search was conducted to identify both scientific and practice-orientated publications on dealing with loneliness in the workplace context. Results: Many people spend a large proportion of their time at work, which therefore offers ideal conditions for raising awareness of the issue and taking preventative action. At present, however, loneliness still seems to be little known in German companies, although there are few reliable studies on the subject. Even if loneliness is not caused solely by the company, there are targeted measures available to protect employees so that they do not become lonely and to support those already affected with offers of help. Various approaches to prevention, early detection, and intervention for those affected by loneliness are presented, which can be applied in the workplace context. Conclusions: Loneliness must be understood as a shared task that can affect everyone and for which everyone can take joint responsibility. Although politicians are already looking for solutions, the issue should also be given greater attention in the world of work. It is important to establish the workplace as a social place that may serve as a resource for social relationships and at the same time offers opportunities for prevention and intervention. Keywords: loneliness – companies – occupational health management – prevention – intervention

Child and Adolescent Mindfulness Measure Turkish Validity and Reliability Study

Child and Adolescent Mindfulness Measure Turkish Validity and Reliability Study

The Food Technology Neophobia Scale: A Validity and Reliability Study in Turkish

As expected, technology is an inevitable part of the contemporary food industry, and consumers may adopt diverse individual and cultural attitudes toward food products produced using new technology and technological methods. In this regard, the literature offers a previously introduced 13-item instrument, the Food Technology Neophobia Scale (FTNS), to measure such consumer attitudes. Thus, the present study sought the validity and reliability of the FTNS in the Turkish context. Accordingly, we performed relevant analyses on the data of 410 participants using the SPSS and LISREL programs. The findings revealed relatively high item-total correlations (0.65-0.74), Cronbach’s alpha coefficient (0.92), and test-retest correlation coefficient (0.81). Thus, we concluded consistent and reliable scale items. Furthermore, the confirmatory factor analysis (CFA) yielded the fit indices indicating acceptable to good model-data fit. The error variances of the items are low, while there are no items with poor factor loading. In conclusion, the 13-item FTNS is a valid and reliable scale to measure food technology neophobia in the Turkish context.

The Turkish Version of the Compassionate Care Assessment Tool: A Validity and Reliability Study.

Background and Purpose: The Compassionate Care Assessment Tool was designed to evaluate the compassionate care characteristics of nurses. The aim of this study was to examine the validity and reliability of the Turkish version. Methods: This study was a methodological type of study. Data were collected from 300 patients hospitalized in different services. Data were analyzed using SPSS 22.0 and LISREL 8.7. Exploratory and confirmatory factor analyses were used to analyze the data. Results: The content validity index of the scale was 0.94. Confirmatory factor analysis conducted on the Turkish form showed that all items fell within the subscales of the original scale. and that their factor loads were between 0.37 and 0.78. The Cronbach's alpha of the scale was 0.897. Conclusions: The tool is a valid and reliable tool for evaluating compassionate care given by nurses.

DEVELOPMENT OF THE 21ST CENTURY TECHNOLOGY LITERACY SKILLS SCALE, VALIDITY AND RELIABILITY STUDY

This study aimed to develop a valid and reliable scale to determine the opinions of high school students and teachers about 21st century technology literacy skills. During the scale development phase, an item pool of 36 items that provided content validity was created, after expert opinion, the number of items was reduced to 32 items in total, and the scale was applied to a total of 794 people for the first application of the scale development phase. The data obtained as a result of the first application were subjected to exploratory factor analysis (EFA) and reliability studies. As a result of the analysis, a three-factor scale ("Ability to Comprehend Technology", "Ability to Use Technology" and "Paying Attention") consisting of a total of 18 items, whose validity and reliability were ensured, was obtained. To test the suitability of the factor structure of the scale, confirmatory factor analysis (CFA) was performed by applying the scale to a total of 418 people. As a result of the analysis, the factor structure (fit index values) of the scale was found to be within the desired reference ranges. In line with the sub-objectives of the study, significant differences were observed according to the gender variable of students and teachers. No significant difference emerged according to the variables of teachers' seniority years. It was observed that there was a significant difference between students and teachers in favor of teachers in all dimensions. As a result of all analysis studies of the scale, a scale consisting of 14 items in total, whose validity and reliability have been sufficiently proven, has been developed and can be applied to high school students.<p> </p><p><strong> Article visualizations:</strong></p><p><img src="/-counters-/lit/0758/a.php" alt="Hit counter" /></p>

The Dejour classification for trochlear dysplasia shows slight interobserver and substantial intraobserver reliability.

Trochlear dysplasia is one of the main risk factors for recurrent patellar dislocation. The Dejour classification identifies four categories that can be used to classify trochlear dysplasia. The purpose of this study is to evaluate the inter- and intraobserver reliability of the Dejour classification for trochlear dysplasia. The hypothesis was that both intra- and interobserver reliability would be at least moderate. This is a cross-sectional, reliability study. Twenty-eight examiners from the International Patellofemoral Study Group 2022 meeting evaluated lateral radiographs of the knee and axial magnetic resonance images from 15 cases of patellofemoral instability with trochlear dysplasia. They classified each case according to Dejour's classification for trochlear dysplasia (A-D). There were three rounds: one with only computed radiograph (CR), one with only magnetic resonance imaging (MRI) and one with both. Inter- and intraobserver reliability were calculated using κ coefficient (0-1). The mean age of patients was: 14.6 years; 60% were female and 53% had open physis. The interobserver reliability κ probabilities were 0.2 (CR), 0.13 (MRI) and 0.12 (CR and MRI). The intraobserver reliability κ probabilities were 0.45 (CR), 0.44 (MRI) and 0.65 (CR and MRI). The Dejour classification for trochlear dysplasia has slight interobserver reliability and substantial intraobserver reliability. Level I.

Measuring the robustness of predictive probability for early stopping in two-group comparisons

Physical experiments are often expensive and time-consuming. Test engineers must certify the compatibility of aircraft and their weapon systems before they can be deployed in the field, but the testing required is time consuming, expensive, and resource limited. Adopting Bayesian adaptive designs is a promising way to borrow from the successes seen in the clinical trials domain. The use of predictive probability (PP) to stop testing early and make faster decisions is particularly appealing given the aforementioned constraints. Given the high-consequence nature of the tests performed in the national security space, a strong understanding of new methods is required before being deployed. Although PP has been thoroughly studied for binary data, there is less work with continuous data, where many reliability studies are interested in certifying the specification limits of components. A simulation study evaluating the robustness of this approach indicates early stopping based on PP is reasonably robust to minor assumption violations, especially when only a few interim analyses are conducted. The simulation study also compares PP to conditional power, showing its relative strengths and weaknesses. A post-hoc analysis exploring whether release requirements of a weapon system from an aircraft are within specification with desired reliability resulted in stopping the experiment early and saving 33% of the experimental runs.

Development of Flood Preparedness Behavior Scale: A Methodological Validity and Reliability Study.

Floods are the most frequent natural disasters with a significant share of their mortality. Preparedness is capable of decreasing the mortality of floods by at least 50%. This paper aims to present the psychometric properties of a scale developed to evaluate the behavior of preparedness to floods in Sudan and similar settings. In this methodological scale development study, experts assessed the content validity of the items of the developed scale. Data were collected from key persons of 413 households living in neighborhoods affected by the 2018 floods in Kassala City in Sudan. A pre-tested questionnaire of sociodemographic data and the Flood Preparedness Behavior Scale (FPBS) were distributed to the participants' houses and recollected. Construct validity of the scale was checked using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Internal consistency of the scale was checked using Cronbach's alpha. Test-retest reliability was assessed by Pearson's correlation coefficient. Item analyses and tests of significance of the difference in the mean scores of the highest and lowest score groups were carried out to ensure discriminatory power of the scale items. Experts agreed on the scale items. Construct validity of the scale was achieved using EFA by removing 34 items and retaining 25 items that were structured in three factors, named as: measures to be done before, during, and after a flood. Confirmatory factor analysis confirmed the construct obtained by EFA. The loadings of the items on their factors in both EFA and CFA were all > 0.3 with significant associations and acceptable fit indices obtained from CFA. The three factors were found to be reliable in terms of internal consistency (Cronbach's alpha coefficients for all factors were > 0.7) and test-retest reliability coefficient. In item analysis, the corrected total item correlations for all the items were > 0.3, and significant differences in the means of the highest and lowest score groups indicated good item discrimination power. The developed 25 items scale is an instrument which produces valid and reliable measures of preparedness behavior for floods in Sudan and similar settings.