Paper-and-pencil Research Articles

Latent structure, measurement invariance, and further validation of an Arabic version of the brief experiential avoidance questionnaire

Experiential avoidance (EA) is a key construct in psychopathology research and practice. Thus, various measures were constructed to assess it, including the Brief Experiential Avoidance Questionnaire (BEAQ). Nevertheless, an Arabic version of the BEAQ has yet to be available, a demand that this study was conducted to fulfill. An Arabic version (BEAQ-A) was developed and tested psychometrically using data from 599 Saudi participants who completed the measures online (Mage = 28.93, ± 8.35, 65.9 % women). Exploratory and confirmatory factor analyses uncovered a 14-item hierarchical structure that comprised one second-order factor and three first-order factors: Perceived Avoidance (PA; 10 items), Procrastination (Proc.; 2 items), and Repression/Denial (RD; 2 items). Utilizing further data from a second sample that completed a paper and pencil (PP) version (N=324, Mage = 22.09, ± 3.92, 56.2 % women), this structure appeared to be partially invariant across modes of administration and gender. The Proc. and R/D loaded significantly, along with psychological distress and negative affectivity items, on the same factor in an EFA, thereby undermining their discriminant validity. All subscales demonstrated good internal consistency reliability. The R/D and BEAQ-A total scores were unique predictors of psychological inflexibility and negative affect. In contrast, depressive and anxiety symptoms, positive affect, and well-being were predicted by Proc. and R/D. In general, findings supported the psychometric suitability of BEAQ-A. However, further research is warranted to replicate findings in larger samples and examine the measure's clinical utility.

EXAMINING PHYSICS TEACHERS’ DOMAIN-SPECIFIC PEDAGOGICAL CONTENT KNOWLEDGE COMPONENTS IN LESOTHO SECONDARY SCHOOLS

Pedagogical content knowledge (PCK) is considered an important ingredient in shaping classroom practice. PCK requires valid measurement at domain-specific level on different components excluding the teaching context. While the research focuses on measuring the PCK of unqualified teachers and pre-service teachers, the description of qualified teachers’ domain-specific PCK is often overlooked. The purpose of this study was to measure quantitatively the domain-specific PCK of qualified physics teachers focusing on the five PCK components: content knowledge, pedagogical knowledge, assessment knowledge, knowledge of students and curricular knowledge. Data were collected through the paper-and pencil PCK test that was responded to by 87 Physics teachers teaching the last two years of secondary school. Data were analyzed using the Extended Rasch Model and descriptive statistics. The results revealed that Physics teachers have a low PCK in general and low levels of PCK components, the lowest being content knowledge. The study recommends regular refresher workshops for qualified teachers focused on developing different PCK components, with more emphasis on content knowledge. Keywords: pedagogical content knowledge, physics teachers, domain-specific PCK, PCK components

Reproducibility and Validity of a Self-Administered Food Safety Assessment Tool on Children and Adolescent's Risk Perception, Knowledge, and Practices.

The present study aimed to verify the instrument's reliability and validity for assessing children and adolescents' risk perception, knowledge, and food safety practices in the school context. Moreover, it aimed to test the hypothesis that both application methods (paper and pencil (PAPI) and online) are valid. The instrument comprised three questionnaires and followed a strict protocol to combine online and PAPI models, resulting in five application forms. The sample consisted of 439 Brazilian students from 10 to 14 years old (y/o). The results related to reliability and validity indicated that the knowledge questionnaire presented adequate stability and discriminant validity coefficients. The self-reported practices questionnaire obtained acceptable coefficients of stability and internal consistency. Regarding risk perception data, it was observed that students attribute a low probability of Foodborne Diseases (FBD) outbreaks occurrence and low severity of possible symptoms. In addition, students demonstrated insufficient knowledge and inadequate practices on issues related to failures associated with the time and temperature of preparation, storage, and exposure of food, contamination of food, and consumption of unsafe food. In this context, the reproducibility and validity indices need to be interpreted and discussed correctly, and young people in food safety actions are a priority in facing FBD.

Computer‐administered neuropsychological assessment batteries: Validity, reliability, and user experience in an Australian sample of community‐living older adults in the CogSCAN Study

AbstractBackgroundAccess to a “gold‐standard” in‐person neuropsychological assessment to detect cognitive decline in older adults using paper‐and‐pencil (PnP) tests is limited. Computerized neuropsychological assessments (CNAs) potentially provide lower cost, scalable, accessible alternatives but critical psychometric data on the validity, reliability and user‐experience of CNAs in older adults are lacking.Method263 community‐dwelling individuals aged 60 years and older without dementia were assigned to complete two CNA batteries and one standardised neuropsychological assessment with 14 PnP tests, one week apart (Construct Validity Group) or two CNAs on two occasions, one month apart (Reliability Group). CNAs were self‐administered under supervision. Orders of CNA batteries, and of CNA and PnP sessions were counterbalanced (Figure 1). Participants completed questionnaires evaluating their experience after each CNA battery. Four CNA batteries were investigated: Cambridge Brain Sciences (CBS), CANTAB, Cogstate, and NIH Toolbox, each containing 5—8 tests; key variables recommended by the test developers were examined (Table 1).ResultParticipant characteristics are summarised in Table 2. Concurrent Validity: Modest correlations (r’s of 0.3‐0.6) between CNA and PnP measures were observed for all CNA batteries, generally aligning with corresponding domains, though notably reflecting the multidimensionality of cognitive measures (Table 3); the strongest associations (r ≥0.5) were with attention and processing speed measures across three CNA batteries, also NIH Toolbox vocabulary, memory and executive measures.Reliability: One‐month test‐retest reliabilities of individual measures were variable (Table 4); across three batteries some, typically speed measures, had reliability coefficients ≥ 0.7. User Experience: Completion rates were high (96‐100%). Usability ratings of CNAs were high on average, although variability was large for CBS (Figure 2). Ratings of acceptability were lower than usability, though on average, participants endorsed CNAs positively.ConclusionA selection of computerized measures demonstrated adequate psychometric standards for concurrent validity with ‘gold standard’ in‐person neuropsychological assessments, alongside good usability and acceptability, though test‐retest reliability was low for many measures. CogSCAN’s comprehensive comparative data will guide researchers in selecting the most suitable CNA measures for older adults. Work in progress is investigating CNA validity, reliability and user experience in older adults with cognitive decline and culturally and linguistically diverse older adults.

Validation of At-Home Application of a Digital Cognitive Screener for Older Adults.

Standardized neuropsychological assessments of older adults are important for both clinical diagnosis and biobehavioral research. Over decades, in-person testing has been the basis for population normative values that rank cognitive performance by demographic status. Most recently, digital tools have enabled remote data collection for cognitive measures, which offers the significant promise to extend the basis for normative values to be more inclusive of a larger cross section of the older population. We developed a Remote Characterization Module (RCM), using a speech-to-text interface, as a novel digital tool to administer an at-home, 25-min cognitive screener that mimics eight standardized neuropsychological measures. Forty cognitively healthy participants were recruited from a longitudinal aging research cohort, and they performed the same measures of memory, attention, verbal fluency and set-shifting in both in-clinic paper-and-pencil (PAP) and at-home RCM versions. The results showed small differences, if any, for how participants performed on in-person and remote versions in five of eight tasks. Critically, robust correlations between their PAP and RCM scores across participants support the finding that remote, digital testing can provide a reliable assessment tool for rapid and remote screening of healthy older adults’ cognitive performance in several key domains. The implications for digital cognitive screeners are discussed.

Digital cognitive testing using a tablet-based app in patients with brain tumors: a single-center feasibility study comparing the app to the gold standard.

Healthcare digitization has led to increasing tablet-based apps to improve diagnostics, self-discipline, and well-being in patients. Moreover, patient-reported outcome measures are crucial for optimized treatment, with superior applicability if independent from patient visits. Whereas most uses cover health maintenance, only a few studies have focused on cognitive testing in neurosurgical patients despite its nature as one of the most integrative outcome measures in neurooncology. The authors performed a prospective single-center feasibility study including neurosurgical patients affected by intraaxial tumors and healthy subjects, testing cognitive function by using a digitized app-based approach and conventional paper-and-pencil (PP) tests. Healthy subjects underwent follow-up testing for retest reliability. The authors included 24 patients with brain tumor and 10 healthy subjects, all of whom completed both tests. Equivalent mean performance results were found in the tablet-based digital app and PP counterparts; whereas the digital approach had shorter test duration in patients (29.9 minutes for PP vs 21.9 minutes for app, p = 0.019) and in the healthy cohort (23.2 minutes for PP vs 16.4 minutes for app, p = 0.003), patients with brain tumor scored lower when both test strategies were applied. Results were consistent in healthy subjects after a median of 3 months. Cognitive function assessment is feasible using a digitized tablet-based app, with equivalent results to those of PP tests in healthy subjects and patients with brain tumor. Thus, this approach allows much closer follow-up independent of patient visits and might provide a viable option to improve patient follow-ups.

Investigating Teacher Assessment Practices in the Teaching of Social Studies in Malawian Primary Schools

This study investigated teacher continuous assessment (CA) practices in the teaching of social studies in Malawian primary schools. This was a qualitative case study of eight primary school teachers using classroom observation, in-depth interview and document analysis. The results revealed dominant use of continuous testing practices in form of paper and pencil tests. In addition, the assessment tasks did not support higher level of thinking as learners were not challenged by the nature of questions and activities given. Furthermore, the frequency of tasks and use of CA results aligned more to summative function than formative function as propagated by the curriculum. The implication of the findings is that the reform regarding CA in the Primary School Curriculum and Assessment Reform (PCAR) remains symbolic. If teacher CA practice is to support learning in line with the demands of PCAR, there is need to address teacher assessment literacy.

Burnout and clinical learning environment among residents in Tehran: A cross-sectional study

PurposeThis study aimed to evaluate the quality of the educational environment in Tehran University of Medical Sciences across different medical specialties and its correlation with residents’ burnout. Materials and methodsThis cross-sectional study was conducted at Tehran University of Medical Sciences among residents drawn from three largest teaching hospitals affiliated. The Maslach Burnout Inventory and Postgraduate Hospital Educational Environment Measure (PHEEM) questionnaire were used to collect data through web-based, as well as paper-and pencil questionnaires. The data was analyzed using SPSS. ResultsA total of 221 residents completed the survey, with a response rate of 82%. Burnout was reported by 67.4% of medical residents. The total PHEEM score had a negative correlation with emotional exhaustion (r = - 0.57, P < 0.001), depersonalization (r = - 0.40, P < 0.001), and a positive one with personal accomplishment (r = 0.42, P < 0.001). Perception of social support significantly predicted burnout subscales (P < 0.05). PHEEM subscales also explained a small proportion of variance in emotional exhaustion (R = 0.55, R2 = 0.308, P < .001). Clinical learning environment independent of personal characteristics was associated with residents' burnout according to multivariate regression analysis [OR = 0.567 (0.170–0.883), P = 0.012]. ConclusionClinical learning environment independent of personal characteristics was associated with residents' burnout in Iran. We suggest some initiatives to be introduced ranging from improving the clinical environments, reduce workloads and provide social support to all residents as well as encouraging them to involve in other extracurricular activities like music and physical exercise.

A Brief Online and Offline (Paper-and-Pencil) Screening Tool for Generalized Anxiety Disorder: The Final Phase in the Development and Validation of the Mental Health Screening Tool for Anxiety Disorders (MHS: A).

Generalized anxiety disorder (GAD) can cause significant socioeconomic burden and daily life dysfunction; hence, therapeutic intervention through early detection is important. This study was the final stage of a 3-year anxiety screening tool development project that evaluated the psychometric properties and diagnostic screening utility of the Mental Health Screening Tool for Anxiety Disorders (MHS: A), which measures GAD. A total of 527 Koreans completed online and offline (i.e., paper-and pencil) versions of the MHS: A, Beck Anxiety Inventory (BAI), Generalized Anxiety Disorder-7 (GAD-7), and Penn State Worry Questionnaire (PSWQ). The participants had an average age of 38.6 years and included 340 (64.5%) females. Participants were also administered the Mini-International Neuropsychiatric Interview (MINI). Internal consistency, convergent/criterion validity, item characteristics, and test information were assessed based on the item response theory (IRT), and a factor analysis and cut-off score analyses were conducted. The MHS: A had good internal consistency and good convergent validity with other anxiety scales. The two versions (online/offline) of the MHS: A were nearly identical (r = 0.908). It had a one-factor structure and showed better diagnostic accuracy (online/offline: sensitivity = 0.98/0.90, specificity = 0.80/0.83) for GAD detection than the GAD-7 and BAI. The IRT analysis indicated that the MHS: A was most informative as a screening tool for GAD. The MHS: A can serve as a clinically useful screening tool for GAD in Korea. Furthermore, it can be administered both online and offline and can be flexibly used as a brief mental health screener, especially with the current rise in telehealth.

Simultaneous Use of Alcohol and Electronic Nicotine Delivery Systems among College Students: Vaping History, Motivations for Use, and Outcome Expectancies

Introduction: Simultaneous polydrug use of electronic nicotine delivery systems (ENDS) and alcohol among college students is not well understood despite high rates of vaping and alcohol use among this population. The current study examined rates of simultaneous use and compared demographic characteristics, vaping history, motivations for initiating use, and outcome expectancies based on polydrug use status. Methods: An online and paper-and pencil questionnaire was administered to undergraduate students at a university in the northeast of the U.S. Purposive sampling strategies were used and a raffle was offered to incentivize participation. Results: Simultaneous polydrug use was prevalent in the sample of 670 college students, with 55.6% reporting simultaneous and non-simultaneous use, 34.0% reporting simultaneous use only, and 10.4% reporting non-simultaneous use only. An examination of differences based on polydrug use status indicated that students who reported simultaneous and non-simultaneous use were more likely to be males, report vaping daily, and endorse a wide range of motivations for use. Students who engaged in simultaneous use only were more likely to be females, indicate a social contextual-related motivation for initiating use, and had higher scores on appetite control, emotion regulation, and taste sensation outcome expectancies. Students who engaged in non-simultaneous use only were more likely to be nonwhite students and report the lowest expectation of health risks. Conclusions: The findings reveal differences based on simultaneous polydrug use status that can be informative in the development of contextually relevant prevention programming. Future research is needed to further explore simultaneous use of ENDS and alcohol.

Comparative assessment of academic performance in Mathematics of college freshman civil engineering students: Inputs to numeracy enhancement extension project

Objective: To determine the profile of the freshman civil engineering students in Eastern Visayas State University, Philippines; to determine the mathematics performance of the students in the diagnostic test; to determine the performance of the students in the paper-and pencil test; to identify the difference in performance of the students in the paper-and pencil test when grouped according to profile variables; to determine the difference in the performance of the students in Diagnostic Test when grouped according to profile variables; and to propose a numeracy enhancement extension project based on the result of the study. Methods: This study used a comparative research design and involved 131 civil engineering students. Findings: Based on the results of the study, the following conclusion were drawn: Majority of the freshman students in civil engineering program are graduates from public Senior High Schools in Tacloban City under the STEM track, a number of them failed in algebraic expressions, equations, straight lines, conics, and trigonometry during the diagnostic test while they performed better in math enhancement and differential calculus when grouped according to the senior high school they graduated from, type of school, and track. The performance of students in diagnostic test when grouped according to senior high school from which they graduated was found significant, while performance of students in diagnostic test when grouped according to the school type were found not significant. Finally, the performance of the students in math enhancement in the paper and pencil tests when grouped according to profile variables was found significant when grouped according to senior high school they graduated from but not significant when grouped according to school type and track. Keywords: Mathematics performance; numeracy enhancement; comparative assessment

Roles of Selected Psycho-Demographic Factors on Quality of Sex Life and Marital Satisfaction among Dual-career Couples

The study investigated the predictive roles of career self-efficacy, work-life balance and selected demographic factors on the quality of sex life and marital satisfaction among dual-career couples in Obafemi Awolowo University Ile-Ife, and assessed if there are significant differences between men and women. The study used a cross-sectional research design and 1056 dual-career men and women ( age = 43.98, σ = 9.48, ♀ = 37.0%) participated in the study. A self-administered paper and pencil questionnaire was used to collect data from samples that were conveniently drawn from the study area. Data were analyzed using Structural Equation Modelling (SEM). Results showed significant differences in structural weights, structural covariances, and structural residuals in the model outputs for both men and women careerists. The study concluded that career self-efficacy and work-life balance differentially predict the quality of sex life and marital satisfaction for both men and women in a dual-career family, and that age and job tenure are not significant predictors of quality of sex life and marital satisfaction among dual-career couples.

E-TAN, a technology-enhanced platform with tangible objects for the assessment of visual neglect: A multiple single-case study

ABSTRACT Visual neglect is a frequent and disabling consequence of right brain damage. Traditional paper-and pencil tests of neglect have limited sensitivity and ecological validity. The Baking Tray Task (BTT), instead, approaches real-life situations, because it requires participants to place 16 physical objects on a board. The number of objects placed on the left and right portions of the board provides a clinical index of visual neglect. Here we present E-TAN, a technology-enhanced platform for BTT (E-BTT). E-BTT automatically determines the object locations on the board, and also records the sequence and timing of their placement. We used E-BTT to test 9 patients with right hemisphere damage and compared their performance with that obtained by 115 healthy participants. To this end, we developed a new method of analysis of participants’ performance, based on the use of the convex hull described by the objects on the board. This measure provides an estimate of the portion of space processed by each participant and can effectively discriminate neglect patients from patients without neglect. E-TAN allows clinicians to assess visuospatial performance by using a convenient, fast, and relatively automatized procedure, that patients can even perform at home to follow-up the effects of rehabilitation.

Too Reliable to Be True? Response Bias as a Potential Source of Inflation in Paper-and-Pencil Questionnaire Reliability.

When respondents answer paper-and-pencil (PP) questionnaires, they sometimes modify their responses to correspond to previously answered items. As a result, this response bias might artificially inflate the reliability of PP questionnaires. We compared the internal consistency of PP questionnaires to computerized questionnaires that presented a different number of items on a computer screen simultaneously. Study 1 showed that a PP questionnaire’s internal consistency was higher than that of the same questionnaire presented on a computer screen with one, two or four questions per screen. Study 2 replicated these findings to show that internal consistency was also relatively high when all questions were shown on one screen. This suggests that the differences found in Study 1 were not due to the difference in presentation medium. Thus, this paper suggests that reliability measures of PP questionnaires might be inflated because of a response bias resulting from participants cross-checking their answers against ones given to previous questions.

Evaluating the Comparability of PPT and CBT by Implementing the Compulsory Islamic Culture Course Test in Jordan University

Study aims to determine whether the university students' scores in the compulsory Islamic culture course test on a selected sample differ across the paper-and pencil test (PPT) & computer-based test (CBT) versions, and to reveal the relationship between gender and the student's level of performance in the test, Therefore, the study evaluated the comparability of two versions of a compulsory Islamic culture course test (PPTs) and (CBTs). The importance of conducting the study in Jordan stems from the fact that public and private universities have begun to move away from the traditional patterns of tests such (PPTs) and went towards (CBTs), In addition to detecting which models give the best in the output and has the characteristics of the psychometric test, Furthermore indicates whether there were differences between males and females, the study sample consisted of 120 individuals, 67 females and 53 males from scientific, health and humanities colleges. The results showed that there was no significant difference between the two versions provided to students CBT and PPT with 0.36 moderate correlation indicators in the pre-CBT test, no significant differences between the males and females in the CBT test results. Therefore, on the basis of the results of the present study, the CBT test is an option and a preferred alternative for regular students of the bachelor's level at the University of Jordan.

Changing Curriculum Practice in Early Childhood Education Setting: An Action Research to Enhance Authentic Assessment

The goal of Early childhood education (ECE) is to provide environment to support children’s holistic development. Therefore, curriculum and assessment must be planned carefully to encourage activities that could nurture the development. This paper discusses the reflexive accounts of the author based on her experience, as an academician/researcher transforming an early childhood education practice in local context. The transformation from paper-and-pencil (P-P) activities/tests towards authentic curriculum and assessment practice was carried out as a democratic process guided by action research design. A catalyst in the form of Curriculum-Based Assessment (CBA) instrument was used to guide the author. There were four parts involved which are modification of (i) lesson plan, (ii) physical and social environment, (iii) children’s activities, (iv) assessment. These modifications were carried out throughout the one-year teacher training period. By applying reflexive technique to change the practice i.e. democratic approach, the training plans/syllabus had to be modified by alternating discussion with hands-on activities with the teachers. Data showed that changes in the physical settings and social atmosphere had led to a more responsive relationship between teachers and children. Hence, more criteria of development were nurtured than previously observed when children’s activities were focused on the P-P. These can be seen in the recorded photos, videos and work samples recorded in the children’s portfolio. Lack of academic qualifications and continuous trainings among the teachers posed a great challenge for the change to take place.

Abstract P4-10-11: Comparability of computerized and paper-pencil patient reported outcome (PRO) assessments – Does it matter how they are administered?

Abstract Introduction: There is an increased need to monitor and intervene to assist breast cancer (BC) survivors overcome the long-term and late effects of treatment. Many institutions are moving toward computerized assessments (CA) of PROs such as symptoms and concerns in place of more traditional paper and pencil administration, but little work has been performed to demonstrate that these very different methods of administration produce comparable results. Our goal was to evaluate the outcomes produced by these methods by comparing two similar samples of breast cancer survivors, one of which completed a PROs assessment using paper and pencil (PP), the other of which was assessed using a computerized system that links to the patient portal in use at our facility. Data collection of the CA of PROs is ongoing. Method: Women were eligible if they had a confirmed diagnosis of Stage 0-III BC, were within one year of completion of primary therapy, and were scheduled for a survivorship-focused end of treatment visit. As this was a naturalistic cohort study, no randomization was undertaken. The PRO assessment covered 19 common long-term or late effects of treatment, inquiring about their occurrence and severity in the previous month. On the day of the visit, participants in the PP cohort were provided with the questionnaire packet to complete prior to meeting with their provider. The women who completed the CA were either already enrolled in the patient portal or enrolled at the time of recruitment and sent an online version of the same questionnaire. Reminder calls and/or emails were sent to the CA participants to improve compliance. Results: 164 BC survivors completed the PP questionnaire, and 62 women completed the CA. Racial make-up, marital status, and education, were similar between groups. Women in the PP group were older than those in the CA group (55.45 vs. 51.23 yrs, p &amp;lt; 0/05) and those in the PP group were marginally more likely than those in the CA group to have been menopausal prior to treatment (50% vs. 35%, p = 0.05). With respect to PROs, there were no significant differences between groups in either the proportion of women endorsing a given symptom/concern or in the mean severity rating for any symptom/concern. The five most commonly reported concerns did differ somewhat between groups, with PP reporting Fatigue, Insomnia, Hot Flashes, Aching Joints, and Memory Difficulties, respectively, and CA reporting Fatigue, Anxiety, Body Image Problems, Memory Difficulties, and a tie between Insomnia and Depression, respectively. Conclusion: The results of the PRO assessment can be assumed to be comparable whether the method of administration is either PP or computerized. Differences found between groups in the most commonly endorsed symptoms likely reflected differences in age and menopausal status. Citation Format: Palmer SC, DeMichele A, Glanz K, Schapira M, Pucci DA, Blauch AN, Jacobs LA. Comparability of computerized and paper-pencil patient reported outcome (PRO) assessments – Does it matter how they are administered?. [abstract]. In: Proceedings of the Thirty-Eighth Annual CTRC-AACR San Antonio Breast Cancer Symposium: 2015 Dec 8-12; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2016;76(4 Suppl):Abstract nr P4-10-11.

Depression and anxiety in patients with and without same-sex attraction: differences in clinical expression, lifestyle factors, and vulnerability indicators.

BackgroundThe aim of this study was to compare clinical expressions (severity and loneliness), lifestyle factors (substance use), and vulnerability indicators (stressful childhood experiences) in patients with any same-sex attraction versus heterosexual patients diagnosed with depression and/or anxiety disorder. Little is known about this, even though it is now well documented that depression and anxiety are more prevalent among persons with same-sex attraction.MethodData, derived from the Netherlands Study of Depression and Anxiety (NESDA), allowed us to compare patients with a same-sex (n = 122) and an exclusively opposite-sex (n = 1658) attraction. Persons with same-sex attraction included persons who were attracted to both sexes. Data were collected by means of the Composite International Diagnostic Interview and paper-and pencil questionnaires.ResultsSeven percent of the patients reported any same-sex orientation. Clinical expression of depression and anxiety did not differ in relation to sexual attraction. Regarding substance use, same-sex attracted women reported more drug use than heterosexual women (drug use: 16.2% vs. 6.6%, P = 0.003). Regarding stressful childhood experiences, men with any same-sex attraction reported more sexual abuse during childhood than men with a heterosexual orientation (20.4% vs. 8.5%, P = 0.005).ConclusionsFor women with same-sex attraction substance use (especially illicit drug use) might be a coping mechanism to deal with existing symptoms or with the minority stressors they have to deal with; for same-sex attracted men stressful childhood experiences might reflect an aspect of etiology.

Validity in Computer-Based Testing: a Literature Review of Comparability Issues and Examinee Perspectives

These past years have seen the growing popularity of the Computer-Based Tests (CBTs) in various disciplines, for various purposes, although the Paper-and Pencil Based Tests (P&amp;Ps) are still in use. However, many question on whether the use of CBTs outperform the effectiveness of the P&amp;Ps or if the CBTs can become a valid measuring tool compared to the PBTs. This paper tries to present the comparison on both the CBTs and the P&amp;Ps and their respective examinee perspectives in order to figure out if doubts should arise to the emergence of the CBTs over the classic P&amp;Ps. Findings showed that the CBTs are advantageous in that they are both efficient (reducing testing time) and effective (maintaining the test reliability) over the P&amp;P versions. Nevertheless, the CBTs still need to have their variables well-designed (e.g., study design, computer algorithm) in order for the scores to be comparable to those in the P&amp;P tests since the score equivalence is one of the validity evidences needed in a CBT.

Internal consistency and measurement equivalence of the cannabis screening questions on the paper-and-pencil face-to-face ASSIST versus the online instrument.

BackgroundValidated Internet-based screening tools for cannabis use and abuse are needed. The present study aimed to establish equivalence between the previously validated Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) as a paper-and-pencil (PaP)-administered questionnaire and its online use.MethodsTwo groups of cannabis users took part in this study and the results were analyzed using structural equation modeling. One group consisted of 150 participants and was assessed with the ASSIST PaP questionnaire in a face-to-face interview (the PaP group). They were recruited from three settings: a primary health care outpatient clinic, a general psychiatric facility, and an ambulatory specialized addiction treatment facility. The other group (the Web group) comprised 1382 persons who answered the online version of the same questionnaire. This sample was drawn from people who naturalistically visited a website dedicated to helping people with cannabis addiction.ResultsThe internal consistency was good for the online questionnaire (0.74) and high for the already validated PaP questionnaire (0.91). The Web group, however, had higher scores on cannabis use than did the PaP group. The results show support for configural invariance, meaning that the one-factor structure was preserved across groups, although measurement equivalence between these two survey modes was not achieved. However, when the Web group was split into two random subsamples, measurement invariance was demonstrated between them by cross-validation.ConclusionsMeasurement equivalence was not achieved between the two survey modes. Nonetheless, subanalyses of the Web group demonstrated that the cannabis screening questions of the ASSIST can be used for online screening. Differences in ASSIST scores between samples may be due to the sensitive nature of the information surveyed, with possible underreporting in face-to-face interviews, or to the different characteristics of the Web group because of the specialized nature of the website.