Internal Reliability Coefficients Research Articles

Relationships Between Candidate Self-Monitoring, Perceived Personality, and Selection Interview Outcomes

A study into the relationships between candidate self-monitoring ability, interviewer perceptions of candidate personality, and interviewer outcome decisions in the context of actual graduate recruitment interviews (n = 130) is presented. Detailed psychometric norm data is also reported on the Lennox and Wolfe (1984) revised Self-Monitoring (RS-M) scale, together with the results of confirmatory factor analyses into the factor structure of this measure. It was found that candidate self-monitoring ability was only moderately and nonsignificantly related to interviewer outcome evaluations, and that self-monitoring was generally uncorrelated with the positiveness of recruiter impressions of candidate personality. Confirmatory factor analyses revealed that a two correlated factor structure for the RS-M scale, in accordance with the original authors' formulation, provided the most parsimonious fit. Norm data for the RS-M scale is reported for this sample of British graduates, including item statistics, item to subscale, item to scale correlations, and internal reliability coefficients. Implications for future research into candidate impression management, self-monitoring, interviewer decision making, and the practical implications arising from these findings are discussed.

Health-related quality of life in dialysis patients. A report from an Italian study using the SF-36 Health Survey. DIA-QOL Group.

Interest in measuring health-related quality of life (HRQoL) has increased together with an awareness that such humanistic outcomes require valid and reliable measures. In the last decade short, simple and multidimensional generic and disease-specific questionnaires have been developed. Among the several generic questionnaires available, the Short Form 36 Items Health Survey (SF-36) was translated and validated in several languages, and applied to different settings and diseases. Within the framework of a larger, prospective, multicentre study (DIA-QOL project) the SF-36 was administered to 304 patients to test its characteristics in terms of patient acceptability, and psychometric and clinical validity. Standard psychometric techniques were used to evaluate its validity in terms of convergence, divergence and internal consistency reliability (Cronbach's alpha). Correlations between clinical variables and HRQoL scores were performed to test the questionnaire's capability to capture differences across patients groups. Overall, the findings show that, in this sample, the SF-36's performance was very good. Acceptability was satisfactory, with a response rate higher than 80%. All the questionnaire scales met the psychometric standards suggested in terms of grouping and scaling assumptions. The internal reliability coefficients actually replicate the satisfactory findings reported previously for the original SF-36. In terms of the ability of the questionnaire scales to discriminate between groups expected to differ in a given health concept in relation to clinical variables, the results were also good. On average, females reported lower scores, the impact of ageing was more evident for physical scales. Diabetic patients score significantly worse on the physical function scale and patients with mental health problems score significantly lower on the mental health scale. No significant association was found with the index KtV, haemoglobin levels, body mass index, parathyroid hormone and type of dialysis. A strong association was indeed found between SF-36 scales measuring physical health concepts and the serum albumin level. This association held after adjusting for the confounding effect of age. Comparison of the health profile of the present sample with others from the US and UK and from a representative sample of the Italian general population highlights the potential of such questionnaire in dialysis setting. The SF-36 questionnaire is easy to use in Italian dialysis patients and SF-36 scores are related to important clinical aspects. This approach can help in caring for dialysis patients and can be useful in outcome assessment programmes.

Quality customer service demands human contact

Investigates the interrelationships between the factors comprising the bank customer service quality construct through path analysis. Credibility is modelled as an outcome of the causal variables staff conduct, access to teller services and communication. Staff conduct emerges as the key variable explaining the direct and indirect linkages between the causal variables and the outcome variable. Those advocating high‐technology solutions as substitutes for branch staff may be ignoring the essence of high customer service quality which involves staff‐customer contact. It is necessary to provide adequate staff numbers to serve customers and train staff to be responsive and professional in their conduct. Structural equations and OLS regression were used to decompose zero‐order bivariate correlations into direct, indirect and spurious effects in the path model. Internal reliability coefficients for the four factors and instrument reliability are also calculated with gratifying results.

The relationship between early age of onset of initial substance use and engaging in multiple health risk behaviors among young adolescents.

Previous research based on problem-behavior theory has found that early age of onset of substance use is associated with engaging in multiple health risk behaviors among high school students. It is unknown whether these relationships begin during early adolescence. To examine the relationships between early age of onset of cigarette, alcohol, marijuana, and cocaine use and engaging in multiple risk behaviors among middle school students. A modified version of the Centers for Disease Control and Prevention Youth Risk Behavior Survey was administered to 2227 sixth through eighth grade students attending 53 randomly selected middle schools in North Carolina. A Health Risk Behavior Scale was constructed from 16 behaviors, including indicators of violence and weapon carrying; current substance use; nonuse of helmets when biking, in-line skating or skateboarding; not wearing a seat belt; riding with a driver who had been drinking; and suicide plans. Among this sample of middle school students, the scale had a mean (SD) of 4.1 (2.7) (range=O-15), and had a high internal reliability coefficient (alpha(=0.74). The independent variables included first time use of cigarettes, alcohol, marijuana, and cocaine at age 11 years or earlier; actual age of onset of each substance; race and ethnicity; family composition; sex; school grade; academic ranking; and older age for school grade. These data were analyzed with analysis of variance, Spearman r, and multiple linear regression. All the independent variables were found to be associated (P<.005) with the Health Risk Behavior Scale during the bivariate analyses. When each of these significant variables were entered into a multiple regression model, having smoked at age 11 years or younger accounted for 21.9% of the variation in the Health Risk Behavior Scale. Male sex, early marijuana or cocaine use, older age, lower academic rank, white race, and living in a 1-parent family explained an additional 19.1% of variation in the model (adjusted R2=0.41, P<.001). When the actual ages of onset of the use of substances were analyzed, in order of magnitude; age of onset of smoking; male sex; age of onset of alcohol and marijuana use; age; lower academic ranking; age of onset of cocaine use; white race; and lower academic rating accounted for 52.8% (P<.001) of the variation in the Health Risk Behavior Scale. Even when considering sociodemographic factors, early age of onset of cigarette use was the strongest correlate of the number of health risk behaviors in which these young adolescents had engaged. Early onset of use of other substances was also associated with a clustering of health risk behaviors among this sample of middle school students. The findings suggest that screening for early experimentation with tobacco and other substance use will help identify young adolescents at increased risk for engaging in multiple health risk behaviors.

The Geriatric Depression Scale and Japanese American Older Adults

ABSTRACT This paper presents a summary of preliminary analyses on the utility of the Geriatric Depression Scale (CDS) using a non-clinical sample of 86 Japanese American older adults. Psychometric analyses indicated that the GDS had fairly high internal consistency and reliability with this sample. Results were comparable to the internal consistency and reliability coefficients found by the developers of the GDS with their original sample. Additionally, GDS scores were low and did not differ for men and women, indicating that the current sample was relatively healthy and non-depressed. Although the results are promising, further research on the GDS must be conducted with a larger sample of Japanese American older adults before any conclusive results can be stated. Additional recommendations for future research examining the mental health of Japanese American older adults are also presented.

The revised Conners' Parent Rating Scale (CPRS-R): factor structure, reliability, and criterion validity.

The Conners' Parent Rating Scale (CPRS) is a popular research and clinical tool for obtaining parental reports of childhood behavior problems. The present study introduces a revised CPRS (CPRS-R) which has norms derived from a large, representative sample of North American children, uses confirmatory factor analysis to develop a definitive factor structure, and has an updated item content to reflect recent knowledge and developments concerning childhood behavior problems. Exploratory and confirmatory factor-analytic results revealed a seven-factor model including the following factors: Cognitive Problems, Oppositional, Hyperactivity-Impulsivity, Anxious-Shy, Perfectionism, Social Problems, and Psychosomatic. The psychometric properties of the revised scale appear adequate as demonstrated by good internal reliability coefficients, high test-retest reliability, and effective discriminatory power. Advantages of the CPRS-R include a corresponding factor structure with the Conners' Teacher Rating Scale-Revised and comprehensive symptom coverage for attention deficit hyperactivity disorder (ADHD) and related disorders. Factor congruence with the original CPRS as well as similarities with other parent rating scales are discussed.

Students' attitudes toward computers: Validation of a computer attitude scale for 16–19 education

There is a strong need for both educators and researchers to be aware of students' attitudes toward using and interacting with computers in 16–19 education (i.e. year levels 12–14)-but as yet little work has been carried out in this area. This article therefore describes the development of an instrument for measuring the attitudes toward computers of students aged 16–19 years. Initial item selection produced a pilot scale consisting of 49 items which was administered to 266 students. Subsequent factor analysis revealed four structurally independent attitude constructs and justified retention of 21 of the original items. The revised scale was then administered to 87 Year 12–14 students for formal validation. The full instrument was found to have both a high internal reliability coefficient (0.90) and test-retest reliability (0.93), and significant construct validity ( P<0.001).

Functional status in patients with chronic fatigue syndrome, other fatiguing illnesses, and healthy individuals

Background Chronic fatigue syndrome (CFS) is a condition that may be associated with substantial disability. The Medical Outcomes Study Short-Form General Health Survey (SF-36) is an instrument that has been widely used in outpatient populations to determine functional status. Our objectives were to describe the usefulness of the SF-36 in CFS patients and to determine if subscale scores could distinguish patients with CFS from subjects with unexplained chronic fatigue (CF), major depression (MD), or acute infectious mononucleosis (AIM), and from healthy control subjects (HC). An additional goal was to ascertain if subscale scores correlated with the signs and symptoms of CFS or the presence of psychiatric disorders and fibromyalgia. Design Prospectively collected case series. setting Patients with CFS and CF were seen in a university-based referral clinic and had undergone a complete medical and psychiatric evaluation. Other study subjects were recruited from the community to participate in research studies. Participants The study included 185 patients with CFS, 246 with CF, 111 with AIM, and 25 with MD. There were 99 HC subjects. Measures The SF-36 and a structured psychiatric interview were used. The SF-36 contains 8 subscales: physical, emotional, social, and role functioning, body pain, mental health, vitality, and general health—and a structured psychiatric interview. Results Performance characteristics (internal reliability coefficients, convergent validity) of the SF-36 were excellent. A strikingly consistent pattern was found for the physical functioning, role functioning, social functioning, general health, and body pain subscales, with the lowest scores in CFS patients, intermediate scores in AIM patients, and the highest scores in the HC subjects. The CFS patients had significantly lower scores than patients with CF alone on the physical functioning ( P ≤0.01), role functioning ( P ≤0.01), and body pain ( P ≤0.001) subscales. The emotional functioning and mental health scores were worst among those with MD. The presence of fibromyalgia, being unemployed, and increasing fatigue severity all were associated with additional functional limitations across multiple functional domains, with increasing fatigue appearing to have the greatest effect. Conclusions The SF-36 is useful in assessing functional status in patients with fatiguing illnesses. Patients with CFS and CF have marked impairment of their functional status. The severity and pattern of impairment as documented by the SF-36 distinguishes patients with CFS and CF from those with MD and AIM, and from HC, but does not discriminate between CF and CFS.

Making sense of ambiguity: evaluation in internal reliability and face validity of the SF 36 questionnaire in women presenting with menorrhagia.

To determine the face validity and internal reliability of the short form 36 (SF 36) health survey questionnaire in women presenting with menorrhagia. Postal survey of women recruited by their general practitioners followed by interviews of a selected subsample. 348 women who had consulted their general practitioner with excessive menstrual bleeding and completed questionnaires after treatment. 49 women selected from this group were interviewed in depth about their health status, and requested to complete the SF 36 questionnaire. Subjective accounts of functioning and wellbeing as measured by the eight scales of the SF 36 questionnaire. Data from the postal survey indicated that the ¿general health perceptions¿ and ¿mental health¿ scales of the SF 36 questionnaire had lower internal reliability coefficients than documented elsewhere. In the follow up interviews several questions on the SF 36 questionnaire were commented on as inappropriate or difficult to answer for patients with heavy menstrual bleeding. Some questions on the SF 36 questionnaire were difficult to answer for this group of patients. Such problems can adversely effect the validity of the measure. It is suggested that comments of patients upon measures such as the SF 36 questionnaire could both determine the appropriateness of such measures for given studies and influence questionnaire design.

Internal Reliability of Rorschach Oral Dependency Scale Scores

The internal reliability of Masling, Rabie, and Blondheim's Rorschach Oral Dependency (ROD) scale was assessed in a mixed-sex sample of 200 undergraduate subjects (100 women and 100 men). ROD scale scores had adequate internal reliability when reliability was assessed using traditional procedures (i.e., odd-even, coefficient alpha). Internal reliability, coefficients derived from recently developed "minimization" and "maximization" procedures differed from traditional internal reliability coefficients, with "minimized" coefficients being smaller than traditional indexes of internal reliability and "maximized" coefficients being larger than traditional internal reliability indexes. Implications of these results for the construct validity of ROD scale scores are discussed, and suggestions regarding the assessment of internal reliability for Rorschach-derived personality and psychopathology variables are offered.

Mothers’ observations of children with Down syndrome coping with demands to adapt

Fifty-five mothers of young children with Down syndrome completed the Parenting Stress Index. A low internal reliability coefficient for the Adaptability/Plasticity Child Domain subscale raised questions regarding the validity of this scale for these children. A factor analysis of the scale itself found that the Adaptability/Plasticity factor did not perform as a uni-dimensional structure, providing instead information on the types of coping strategies used by these children when they are required to adapt.

Reliability and Validity of A Breast Self-Examination Proficiency Rating Instrument

A college laboratory was used as the setting to test the reliability and validity of a newly designed Breast Self-Examination Proficiency Rating Instrument (BSEPRI). The instrument was tested on two groups of nursing students, one instructed prior to testing and one not. BSE proficiency was scored individually for each subject as she demonstrated the procedure on a breast simulation model. Independent sample t tests were used to compare the groups. Mean scores of the instructed group were significantly higher than mean scores of the uninstructed group on the total test and on subscales of palpation and inspection. Criterion-referenced concurrent validity was assessed by correlating palpation scores with lump detection in a silicone model. Interrater reliability using percentage agreement between raters was high on 19 out of 23 criteria. Kuder-Richardson internal reliability coefficients ranged from .67 to .74.

An exploration of theoretical and practical foundations for assessing attitudes toward computers: The Computer Attitude Measure (CAM)

Over the past 10 years, researchers have assessed over 15 different constructs with respect to computer attitudes, making it difficult to interpret and compare studies using these attitude measures. An absence of theoretical justification for many constructs further complicates interpretation. In this study, four theoretically distinct constructs (cognitive, affective, behavioral, and perceived control), based on over 45 years of general attitude scale development, are examined in the form of the Computer Attitude Measure (CAM). This measure, consisting of 50 items, was administered to 647 preservice teachers to assess cognitive (student, personal, general), affective, behavioral (classroom and home), and perceived control components of computer attitudes. The internal reliability coefficient for the full measure was .95. The alpha coefficients for each attitude subscale ranged from .70 to .97. The principal components factor analysis supported the a priori assumption that the four attitude dimensions and their subscales were structurally independent. Significant positive correlations (p < .001) among all attitude subscales and computer awareness, software skill, and programming provided support for the construct validity of the CAM. Strong theoretical foundations coupled with the promising statistical results of this study suggest that the four-dimension model may be one way to reorganize and assess the multitude of constructs already identified by computer attitude researchers.

Creativity Training and the Stability and Internal Consistency of the Kirton Adaption-Innovation Inventory

In his 1986 analytic review of the first ten years of research on adaption-innovation theory, Mudd commented on the importance of continued research on the Kirton Adaption-Innovation Inventory. Suggestions pertinent to the present study involved an examination of the stability of the instrument as well as the test-retest reliability of the full scale and subscales. A Lindquist Type III analysis of variance was used to examine the influence of creativity training on the stability of the Kirton full scale scores. The scores did not change after training. There was, however, a significant effect for gender by pre- and posttest interactions for the full scale scores. Men's full scale scores were higher than women's, and only men exhibited an increase. The women's pre- and posttest scores appeared more stable. Internal reliability coefficients and test-retest reliability coefficients for both the full scale scores and the subscale scores were very adequate, but the men's scores did increase.

Measuring the Quality of Life of Dementia Patients Using the Schedule for the Evaluation of Individual Quality of Life

The importance of quality of life (QoL) assessment in research and clinical practice is gaining increasing recognition. The Schedule for the Evaluation of Individual Quality of Life (SEIQoL) is based on a phenomonological approach in which the individual’s views are central. As cognitive impairment may affect insight and the ability to make judgements this study explored the feasibility, validity and reliability of using the SEIQoL to measure the quality of life of elderly dementia patients. The SEIQoL was administered to 20 patients meeting DSM-IIIR criteria for mild dementia. Cognitive status was evaluated using the Mini-Mental State Examination (MMSE) and CAM COG (from the CAMDEX). All patients were able to complete some elements of the SEIQoL, but only 6 were willing or able to complete the full procedure. Mean CAM COG scores distinguished these 6 patients from the remaining 14 (p<.01). For these 6 dementia patients the mean internal variance (R2), an estimate of construct validity, was .70, and the internal reliability coefficient (r) was .74. It is concluded that in cases of mild cognitive impairment the SElQoL can be a feasible, valid and reliable instrument. As cognitive impairment increases patients are less likely to be able or willing to complete the SEIQoL, and proxy responses may be a necessary alternative.

The interaction with disabled persons scale: A new australian instrument to measure attitudes towards people with disabilities

Abstract This article reports results of the construct validation of a new Australian measure of attitudes towards people with disabilities. Following a statement of the theoretical background for the instrument and a critique of existing instruments, an outline is given of procedures used in the development and psychometric evaluation of the Interaction with Disabled Persons (IDP) Scale. Results indicate that test-retest and internal reliability coefficients compare favourably with existing overseas instruments and that a stable factor structure has emerged over time across a variety of samples. Support was provided for all hypotheses based on the predicted nomological network of the IDP Scale. The article closes with a discussion of current and potential applications of the instrument.

Reliability Testing of a Children's Version of the Eating Attitude Test

Abstract To study eating disorders in children, a measurement of children's eating attitudes must be available. Adolescents and adults are commonly surveyed with the Eating Attitude Test (EAT), but it is incomprehensible to children. A children's version of the EAT (ChEAT) was designed and tested on 318 children aged 8 through 13 years. Test-retest and internal reliability coefficients of the ChEAT were comparable to published studies with adults. Almost 7% of the children scored within the anorectic range on the ChEAT, closely matching the percentage reported for adolescents and adults on the EAT.

Evaluation and Validation of the Mikulecky Behavioral Reading Attitude Measure

This study examined the Mikulecky Behavioral Reading Attitude Measure (MBRAM) to ascertain whether or not the scale measures Krathwohl's five stages of attitude internalization and is a Guttman type (true hierarchical) scale in addition to being unidimensional. The results of the analysis showed that the instrument has Guttman scale properties exceeding recommended indexes. Coefficients of reproducibility, scalability, internal reliability coefficients and classical factor analyses were used to explain internal properties and subscale deviations. Although internal analysis indicated that caution should be exercised in interpreting the lowest level subscale (Attending), the MBRAM was found to measure reading attitude in true hierarchical developmental stages. Thus the MBRAM was deemed to be a valuable instrument for assessing reading attitudes of secondary and post-secondary students.

The Companion Animal Semantic Differential: Long and Short Form Reliability and Validity

The Companion Animal Semantic Differential consists of 18 bipolar semantic differential word pairs for assessing the respondent's perception of a childhood companion animal. The measure was administered by questionnaire to a sample of 188 students. The Cronbach alpha internal reliability coefficient was 0.90 for the 18-item scale. The construct validity of the scale was indicated by its significant correlations with the evaluative factor of the Pet Attitude Scale and the childhood Companion Animal Bonding Scale of .31 and .54, respectively. Factor analysis identified a short 9-item form as a one-dimensional measure of the respondent's affective attitude toward his or her pet. The short form's Cronbach alpha was .88 and its correlations with the affective factors of the Pet Attitude Scale and the childhood Companion Animal Bonding Scales were .24 and .50, respectively. The measure is included.

A study examining the psychometric properties of the SMAST-13

The psychometric properties of the Short Michigan Alcoholism Screening Test (SMAST-13), a 13-question abbreviated form of the MAST, were determined on two samples of alcoholics, with their nonalcoholic family members serving as controls. The study hypothesized that the SMAST-13 has a low specificity when used to screen family members for alcohol problems and would exhibit a low internal reliability coefficient in this population. All participants were interviewed using DSM-III criteria for alcohol abuse or dependence. Only family members who failed to meet these criteria were enrolled in the study. When a weighted cut-off score of 5 or more was used as a positive score for alcohol problems, the sensitivity was .98 in Sample A and .94 in Sample B. Utilizing the scores of the family members as controls, the specificity was .58 in Sample A and .70 in Sample B. The internal reliability of the SMAST-13, using Chronbach's alpha on the total sample, produced a reliability coefficient of r = .57 in Sample A and r = .62 in Sample B. To determine if the specificity of the SMAST-13 could be improved, the weighted cut-off score for a positive response was raised from 5 to 10. In Sample A, the specificity changed from .58 to .90 and the sensitivity dropped slightly from .98 to .92. In sample B, the specificity increased from .70 to .95; the sensitivity decreased from .95 to .85. Suggestions for changing the wording of two questions which explain the majority of the false positives are discussed. Epidemiological studies which have used the SMAST-13 to estimate the prevalence of alcohol problems in family members of alcoholics may need to reconsider their methods of classifying alcoholics.