Operational method of reliability and content-validity analysis: Taking "trait-symptoms" screening of individuals at high-risk for OCD as an example.

Hongxiang Bao,Danmin Miao

doi:10.1371/journal.pone.0232368

Abstract

A well-designed self-reported scale is highly applicable to current clinical and research practices. However, the problems with the scale method, such as quantitative analysis of content validity and test-retest reliability analysis of state-like variables are yet to be resolved. The main purpose of this paper is to propose an operational method for solving these problems. Additionally, it aims to enhance understanding of the research paradigm for the scale method (excluding criterion-related validity). This paper used a study that involved screening of high-risk groups for OCD (Obsessive-Compulsive Disorder), conducted 5 rounds of tests, and developed scales, reliability, and validity analysis (using sample sizes of 496, 610, 600, 600 and 990). The operational method we propose is practical, feasible, and can be used to develop and validate a scale.

Highlights

Spielberger proposed the concept of state-trait anxiety and state-trait depression; later, other scholars introduced state-trait anger [1]
A bigger reason is that most screening research focuses on OCD patients undergoing formal treatment rather than on the general population at high risk of developing OCD [5,6,7]
We attempted to define the population at high risk of OCD by taking into account its traits and symptoms, to effectively identify the high-risk population of OCD through potential temperament risk factors and severity of current symptoms

Summary

Introduction

Spielberger proposed the concept of state-trait anxiety and state-trait depression; later, other scholars introduced state-trait anger [1]. We analogously proposed the concepts of "symptom-OCD" and "trait-OCD". We used a similar model to design a "symptom-OCD combined with trait-OCD " model to screen people at a high-risk for OCD because it is one of the most prevalent psychological and behavioral disorders (a military epidemiological study on mental diseases found that the 12-month prevalence rate of OCD (2.4%) is among the highest for single diseases). Measuring OCD is complicated by its heterogeneity and high diagnostic comorbidity with other mental disorders [4]. We attempted to define the population at high risk of OCD by taking into account its traits and symptoms, to effectively identify the high-risk population of OCD through potential temperament (dispositional) risk factors and severity of current symptoms. It included beliefs (obsessional beliefs, superstition) and OCD-metacognition, consisting of 4 screening scales. In our example of OCD, the symptoms included 2 scales

Objectives

Methods

Results

Conclusion