Low Face Validity Research Articles

Face Validity

Face Validity

Exploring the Implicit Link Between Red and Aggressiveness as Well as Blue and Agreeableness.

Previous studies have found a link between red and aggressive behavior. For example, athletes who wear red uniforms in sports are considered to have a competitive advantage. So far, most previous studies have adopted self-report methods, which have low face validity and were easily influenced by the social expectations. Therefore, the study used two implicit methods to further explore the association between red and aggressiveness. A modified Stroop task was used in Experiment 1 to probe college students’ differences between “congruent” tasks (i.e., red–aggressiveness and blue–agreeableness) and “incongruent” tasks (i.e., red–agreeableness and blue–aggressiveness). Result showed that participants responded more quickly to the congruent tasks than the incongruent tasks. Then, in order to adapt to the competitive context, Experiment 2 used an implicit association test with photos of athletes as the stimulus to college students and athletes to evaluate “congruent” tasks (i.e., red uniform photo-aggressiveness and blue uniform photo-agreeableness) as well as “incongruent” tasks (i.e., red uniform photo-agreeableness and blue uniform photo-aggressiveness), respectively. According to the results, both college students and athletes respond faster to congruent tasks than to incongruent tasks. Besides, athletes’ reactions to the red–aggressiveness association are faster than college students, which may relate to the athletes’ professional experience. The athletes may be more aggressive and impulsive. Overall, the study has attempted to examine the association between red and aggressiveness through implicit methods, but in the future, researches are need to find a deep association from brain mechanism aspect.

Ecological validity of performance-based measures of executive functions: Is face validity necessary for prediction of daily functioning?

Predicting patients' ability to engage in instrumental activities of daily living (IADLs) is an important part of neuropsychological evaluation of older adults. Executive functioning (EF) is the neurocognitive domain most strongly associated with performance of IADLs. However, performance-based tests of EF have long been criticized for having poor ecological validity, largely because of their imperfect association with functional outcomes and their low face validity. However, past research has not examined whether high face validity improves a test's ability to predict IADLs. The present study examined this question. Fifty community-dwelling older adults completed 2 measures of EF that have been previously shown to be related to performance on IADL tasks: the Pillbox Test (a test with high face validity) and the Push-Turn-Taptap task (PTT; a test with low face validity). As an outcome variable, weekly pill counts were conducted across 8 weeks as an index of real-world daily medication management. Hierarchical linear regression analyses and receiver operating characteristic (ROC) curve analyses using medication management as the dependent variable revealed that the PTT outperformed the Pillbox Test both in accounting for variance in medication management and in classifying participants according to their medication management accuracy. The present study does not support the notion that face validity, in and of itself, improves the ability of performance-based EF tests to predict functional outcomes. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Improving the Diagnosis of Autism Spectrum Disorder in Fragile X Syndrome by Adapting the Social Communication Questionnaire and the Social Responsiveness Scale-2.

We carried out a psychometric assessment of the Social Communication Questionnaire (SCQ) and the Social Responsiveness Scale (SRS-2) in fragile X syndrome (FXS), relative to clinician DSM5-based diagnosis of autism spectrum disorder (ASD) in FXS. This was followed by instrument revisions that included: removal of non-discriminating and/or low face validity items for FXS; use of receiver operating characteristic (ROC) curves to determine optimal cut points for the original and revised measures; an exploratory factor analysis to outline subscales better representing ASD in FXS; and creation of a "triple criteria" diagnosis to better delineate ASD subgroups in FXS. These methods improved the sensitivity and/or specificity of the SCQ and SRS-2, but diagnostic accuracy of ASD remains problematic in FXS.

Validation of the revised Food Neophobia Scale (FNS-R) in the Italian context

Measuring individuals' level of food neophobia, i.e., the reluctance to eat novel food, is a critical task since it negatively affects diet variety and quality. Using structural equations models, the revised Food Neophobia Scale (FNS-R) was validated with a sample of 711 Italian adults. After deleting 4 items characterized by both low face validity and a suboptimal association with the other items, and after correcting statistically for the acquiescent response-set, the resulting 6-item, fully balanced FNS-R showed a good construct validity. Moreover, it showed the expected positive correlations with General Neophobia and with Disgust Sensitivity. Finally, it resulted invariant across participants’ genders, age classes, and levels of education, and across methods of administration (paper-and-pencil and on-line). Strong points and possible developments of the study are discussed.

Is 2D speckle tracking echocardiography useful for detecting and monitoring myocardial dysfunction in adult m.3243A>G carriers? \u2014 a retrospective pilot study

ObjectivesCardiomyopathy is a common complication of mitochondrial disorders, associated with increased mortality. Two dimensional speckle tracking echocardiography (2DSTE) can be used to quantify myocardial deformation. Here, we aimed to determine the usefulness of 2DSTE in detecting and monitoring subtle changes in myocardial dysfunction in carriers of the 3243A>G mutation in mitochondrial DNA.MethodsIn this retrospective pilot study, 30 symptomatic and asymptomatic carriers of the mitochondrial 3243A>G mutation of whom two subsequent echocardiograms were available were included. We measured longitudinal, circumferential and radial strain using 2DSTE. Results were compared to published reference values.ResultsSpeckle tracking was feasible in 90 % of the patients for longitudinal strain. Circumferential and radial strain showed low face validity (low number of images with sufficient quality; suboptimal tracking) and were therefore rejected for further analysis. Global longitudinal strain showed good face validity, and was abnormal in 56–70 % (depending on reference values used) of the carriers (n = 27). Reproducibility was good (mean difference of 0.83 for inter- and 0.40 for intra-rater reproducibility; ICC 0.78 and 0.89, respectively). The difference between the first and the second measurement exceeded the measurement variance in 39 % of the cases (n = 23; feasibility of follow-up 77 %).DiscussionEven in data collected as part of clinical care, two-dimensional strain echocardiography seems a feasible method to detect and monitor subtle changes in longitudinal myocardial deformation in adult carriers of the mitochondrial 3243A>G mutation. Based on our data and the reported accuracy of global longitudinal strain in other studies, we suggest the use of global longitudinal strain in a prospective follow-up or intervention study.

Assessing Technology in the Absence of Proof: Trust Based on the Interplay of Others' Opinions and the Interaction Process.

The present research addresses the question of how trust in systems is formed when unequivocal information about system accuracy and reliability is absent, and focuses on the interaction of indirect information (others' evaluations) and direct (experiential) information stemming from the interaction process. Trust in decision-supporting technology, such as route planners, is important for satisfactory user interactions. Little is known, however, about trust formation in the absence of outcome feedback, that is, when users have not yet had opportunity to verify actual outcomes. Three experiments manipulated others' evaluations ("endorsement cues") and various forms of experience-based information ("process feedback") in interactions with a route planner and measured resulting trust using rating scales and credits staked on the outcome. Subsequently, an overall analysis was conducted. Study 1 showed that effectiveness of endorsement cues on trust is moderated by mere process feedback. In Study 2, consistent (i.e., nonrandom) process feedback overruled the effect of endorsement cues on trust, whereas inconsistent process feedback did not. Study 3 showed that although the effects of consistent and inconsistent process feedback largely remained regardless of face validity, high face validity in process feedback caused higher trust than those with low face validity. An overall analysis confirmed these findings. Experiential information impacts trust even if outcome feedback is not available, and, moreover, overrules indirect trust cues-depending on the nature of the former. Designing systems so that they allow novice users to make inferences about their inner workings may foster initial trust.

Researching State Shame With the Experiential Shame Scale

ABSTRACTAlthough debilitating effects of experiencing shame are posited in several theories of emotion and motivation, little research has been conducted on individuals’ “in-the-moment” feelings of shame (i.e., state shame). However, researching state shame is challenging because individuals may deny or underreport their feelings of shame, tend to self-isolate when they feel shame, and may be unwilling or unable to express themselves when feeling shame. The Experiential Shame Scale (ESS), an “opaque” measure of physical, emotional, and social markers of shame experiences, was developed to address the difficulties of assessing state shame. Evidence obtained in three studies of individuals’ emotional reactions following personally important exam feedback suggests that students' ESS ratings were uniquely related to feelings of state shame and not to state guilt. Findings also reveal that state shame is specifically related to feelings of shock and not surprise. As intended, findings suggested that the ESS has low face validity and is not related to social desirability.

Testing the validity of the International Atomic Energy Agency (IAEA) safety culture model

This paper takes the first steps to empirically validate the widely used model of safety culture of the International Atomic Energy Agency (IAEA), composed of five dimensions, further specified by 37 attributes. To do so, three independent and complementary studies are presented. First, 290 students serve to collect evidence about the face validity of the model. Second, 48 experts in organizational behavior judge its content validity. And third, 468 workers in a Spanish nuclear power plant help to reveal how closely the theoretical five-dimensional model can be replicated. Our findings suggest that several attributes of the model may not be related to their corresponding dimensions. According to our results, a one-dimensional structure fits the data better than the five dimensions proposed by the IAEA. Moreover, the IAEA model, as it stands, seems to have rather moderate content validity and low face validity. Practical implications for researchers and practitioners are included.

A Pilot Feasibility Study of a Questionnaire to Determine European Union-Wide CAM Use

Background: No questionnaire specifically measuring the core components of complementary and alternative medicine (CAM) use has been validated for use across European Union (EU) countries. We aimed to determine the face validity, acceptability and the participants’ comprehension of a pre-existing questionnaire designed to measure ‘CAM use’, to provide a comparative, standardised questionnaire for use by health care providers, policy makers and purchasers throughout Europe. Methods: Established procedures were employed to translate the questionnaire into 4 EU languages. The translated questionnaires were piloted on 50 healthy adults from each country who may never have used CAM. 10 participants per country also took part in audio-recorded think aloud interviews about the questionnaire. The interviews were transcribed and analysed in the language in which they were conducted; findings were summarised in English. Questionnaire data were pooled across countries, and patterns of completion and missing data were analysed. Results: The questionnaire was translated into Italian, Spanish, Dutch and Romanian. The mean age of the participants was 43.6 years. 34% were male, 87.4% were either light or heavy CAM users, and 12.6% were non-users. Qualitative analysis identified common problems across countries including a ‘hard-to-read’ layout, misunderstood terminology and uncertainty in choosing response options. Quantitative analysis confirmed that a substantial minority of respondents failed to follow questionnaire instructions and that some questions had substantial rates of missing data. Conclusions: The I-CAM-Q has low face validity and low acceptability, and is likely to produce biased estimates of CAM use if applied in England, Romania, Italy, The Netherlands or Spain. Further work is required to develop the layout, terms, some response options and instructions for completion before it can be used across the EU.

Brain-derived neurotrophic factor signalling mediates antidepressant effects of lamotrigine

The anticonvulsant drug lamotrigine has been shown to produce antidepressant effects in patients with bipolar disorder. To date, only a few preclinical studies have been conducted using lamotrigine treatment in the forced swim test (FST), an animal model of depression with low face validity. The underlying mechanisms by which lamotrigine works have not been well characterized either. This study extends earlier work on the role of brain-derived neurotrophic factor (BDNF) in regulating the antidepressant actions of lamotrigine. We showed that in rats subjected to chronic unpredictable stress, chronic administration of 30 mg/kg lamotrigine ameliorates behavioural deficits of stressed rats in both sucrose preference test (SPT) and novelty-suppressed feeding test (NSFT). In parallel, chronic lamotrigine treatment up-regulates frontal and hippocampal BDNF protein expression in both naive and stressed animals, and restores the stress-induced down-regulation of BDNF levels. In addition, inhibition of BDNF signalling by infusion of K252a, an inhibitor of the BDNF receptor TrkB, blocks the antidepressant effects of lamotrigine in SPT, NSFT and FST. Taken together, this study provides further evidence that BDNF is an essential mediator for the antidepressant effects of lamotrigine.

Power and behavioral approach orientation in existing power relations and the mediating effect of income

AbstractA large number of authors have observed that the experience of power increases behavioral approach tendencies. There are however some important unresolved problems. Predominantly, the literature relies on lab manipulations, priming, and student populations. This has resulted in low face validity. Also, it is unclear what process underlies this effect. A large‐scale survey (N = 3082) reliably measures power among real low‐ and high‐power employees in existing organizations and finds strong support for the effect of power on behavioral approach. Consistent with expectations, this effect is mediated by increased access to resources. We also discuss findings that suggest the shape of this power‐approach effect might be quadratic. Copyright © 2009 John Wiley & Sons, Ltd.

Potential stereotype threat and face validity effects on cognitive‐based test performance in the classroom

Evaluation is an inherent part of education for an increasingly diverse student population. Confidence in one’s test‐taking skills, and the associated testing environment, needs to be examined from a perspective that combines the concept of Bandurian self‐efficacy with the concept of stereotype threat reactions in a diverse student sample. Factors underlying testing reactions and performance on a cognitive ability test in four different testing conditions (high or low stereotype threat and high or low test face validity) were examined in this exploratory study. The stereotype threat manipulation seemed to lower African‐American and Hispanic participants’ test scores. However, the hypothesis that there would be an interaction with face validity was only partially supported. Participants’ highest scores resulted from low stereotype threat and high face validity, as predicted. However, the lowest scores were not in the high stereotype threat/ low face validity condition as expected. Instead, most groups tended to score lower when the test was perceived to be more face valid. Stereotype threat manipulation affected Whites as well as non‐Whites, although differently. Specifically, high stereotype threat increased Whites’ cognitive ability test scores in the low face validity condition, but decreased them in the high face validity condition. Implications for testing and classroom environment design are discussed.

The measurement of postoperative pain: A comparison of intensity scales in younger and older surgical patients

The psychometric properties of pain intensity scales for the assessment of postoperative pain across the adult lifespan have not been reported. The objective of this study was to compare the feasibility and validity of the Numeric Rating Scale (NRS), Verbal Descriptor Scale (VDS), and Visual Analog Scale (horizontal (VAS-H) and vertical (VAS-V) line orientation) for the assessment of pain intensity in younger and older surgical patients. At 24 h following surgery, 504 patients, who were receiving i.v. morphine via patient‐controlled analgesia, completed the pain intensity measures and the McGill Pain Questionnaire (MPQ) in a randomized order. They were asked which scale was easiest to complete, the most accurate measure, and which they would most prefer to complete in the future, as an index of face validity. The amount of opioid self-administered was recorded. Age differences in postoperative pain intensity were not found. However, elderly patients obtained lower MPQ scores and self-administered less morphine than younger people. Psychometric analyses suggested that the NRS was the preferred pain intensity scale. It had low error rates, and higher face, convergent, divergent and criterion validity than the other scales. Most importantly, its properties were not age-related. The VDS also had a favourable profile with low error rates and good face, convergent and criterion validity. Finally, difficulties with VAS use among the elderly were identified, including high rates of unscorable data and low face validity. Its use with elderly postoperative patients should be discouraged.

What is the Impact of Corporate Governance on Organisational Performance?

Research on the importance of generally accepted “best practices” in corporate governance has generally failed to find convincing connections between these practices and organisational performance. We discuss research outcomes on the relationship between two such “best practices” (CEO/Chair duality and insider/outsider composition) and organisational performance, and find this relationship to be insignificant. We propose four possibilities for this tenuous relationship, that are not mutually exclusive: firstly, the possibility that “best practices” in governance are indeed irrelevant to organisational performance; secondly, that the operationalisation of theoretical concepts has low face validity; thirdly, that studies are too narrow, aiming to relate board attributes directly to organisational performance and ignoring other systemic factors; and lastly, the possibility that different types of organisations require different practices in corporate governance. Lastly, we address the methodological and substantive implications of each of these possibilities.

The utility of reuters for events analysis in area studies: The case of Zambia‐Zimbabwe interactions, 1982–1993

Principal investigators in the Global Events Data System project (GEDS) and others have argued that Reuters Library Report is a superior global source of events data because its coverage of the world's regions is relatively even and it is easily accessible on‐line for automated or semi‐automated coding. The question if Reuters should be coded in conjunction with regional and local sources is left open. We test three expectations: Reuters yields a greater number of events as well as more even reporting across COPDAB issue‐areas than a regional and a local source; Reuters has high face validity; and analysis of data from Reuters, a regional, and a local source will yield very different results. We perform tests of the ‘concurrence’ of data from Reuters, Africa Research Bulletin, and the Zimbabwe Herald covering interactions between Zambia and Zimbabwe from January 1st 1982 to December 31st 1993. Interrupted ARIMA time series and OLS measures of covariation are used to test whether substantive results change depending on the source(s) used. Reuters yields the highest number of events, but the frequency of events varies greatly and so did the emphasis on different COPDAB issue‐areas. Reuters does not tend to report the same events as the regional and local sources; it has low face validity for selected quarters and leads to very different inferences from those based on data from all three sources. These results indicate that Reuters is not a substitute for traditional newspaper sources but an important source to use in conjunction with them.

A multidimensional evaluation system in a basic science course in medicine

Evaluation of students is useful to assess knowledge and comprehension while motivating learning and providing feedback. In medical schools the predominant assessment vehicle is the multiple-choice question (MCQ, exam. Such exams, while useful, largely test recall and have low face validity. In the Department of Pharmacology at McGill University we have developed a multidimensional evaluation system which includes MCQs, short essay questions, small-group performance assessments, an essay project and oral exams. We consider that our system stresses the knowledge and skills required to be a successful physician while motivating students and rewarding excellence. Students are enthusiastic about the program while faculty are satisfied with the breadth and completeness of our evaluation system.

Leadership style and worker interpersonal orientation: A computer simulation study

A simulation model of an industrial work group is constructed. Because organizational simulation models possess low face validity, the author first tests the reliability of the stochastic simulation model. Reliability is defined as the capacity of the simulation model to generate consistent output time series regardless of the stream of pseudorandom numbers used in driving the model. Spectral analysis is used to compare the cyclic behavior of the output time series for the initial and replicated runs for each experimental cell. Then the output of the model is compared to a “real world” benchmark study. Lastly, in a replicated 3 × 5 experiment the model is utilized to examine the impact of leadership style and work force composition on worker productivity, job satisfaction, and group cohesiveness over a simulated period of 5 yr. Six specific hypotheses are tested. The paper demonstrates that the simulation technique is a feasible vehicle for conducting research into organizational and industrial behavior.