Computer-administered Questionnaires Research Articles

AnswerTruthDetector: a combined cognitive load approach for separating truthful from deceptive answers in computer-administered questionnaires

Abstract In human-computer interaction, much empirical research exists. Online questionnaires increasingly play an important role. Here the quality of the results depend strongly on the quality of the given answers, and it is essential to distinguish truthful from deceptive answers. There exist elegant single modalities for deception detection in the literature, such as mouse tracking and eye tracking (in this paper, respectively, measuring the pupil diameter). Yet, no combination of these two modalities is available. This paper presents a combined approach of two cognitive-load-based lie detection approaches. We address study administrators who conduct questionnaires in the HCI, wanting to improve the validity of questionnaires.

Using Response Times for Joint Modeling of Careless Responding and Attentive Response Styles

Questionnaires are by far the most common tool for measuring noncognitive constructs in psychology and educational sciences. Response bias may pose an additional source of variation between respondents that threatens validity of conclusions drawn from questionnaire data. We present a mixture modeling approach that leverages response time data from computer-administered questionnaires for the joint identification and modeling of two commonly encountered response bias that, so far, have only been modeled separately—careless and insufficient effort responding and response styles (RS) in attentive answering. Using empirical data from the Programme for International Student Assessment 2015 background questionnaire and the case of extreme RS as an example, we illustrate how the proposed approach supports gaining a more nuanced understanding of response behavior as well as how neglecting either type of response bias may impact conclusions on respondents’ content trait levels as well as on their displayed response behavior. We further contrast the proposed approach against a more heuristic two-step procedure that first eliminates presumed careless respondents from the data and subsequently applies model-based approaches accommodating RS. To investigate the trustworthiness of results obtained in the empirical application, we conduct a parameter recovery study.

A Response-Time-Based Latent Response Mixture Model for Identifying and Modeling Careless and Insufficient Effort Responding in Survey Data

Careless and insufficient effort responding (C/IER) can pose a major threat to data quality and, as such, to validity of inferences drawn from questionnaire data. A rich body of methods aiming at its detection has been developed. Most of these methods can detect only specific types of C/IER patterns. However, typically different types of C/IER patterns occur within one data set and need to be accounted for. We present a model-based approach for detecting manifold manifestations of C/IER at once. This is achieved by leveraging response time (RT) information available from computer-administered questionnaires and integrating theoretical considerations on C/IER with recent psychometric modeling approaches. The approach a) takes the specifics of attentive response behavior on questionnaires into account by incorporating the distance–difficulty hypothesis, b) allows for attentiveness to vary on the screen-by-respondent level, c) allows for respondents with different trait and speed levels to differ in their attentiveness, and d) at once deals with various response patterns arising from C/IER. The approach makes use of item-level RTs. An adapted version for aggregated RTs is presented that supports screening for C/IER behavior on the respondent level. Parameter recovery is investigated in a simulation study. The approach is illustrated in an empirical example, comparing different RT measures and contrasting the proposed model-based procedure against indicator-based multiple-hurdle approaches.

Reliability and agreement studies: a guide for clinical investigators

On a daily basis, clinicians and researchers face the challenge of measuring multiple outcomes. From responses to therapies and assessments of disease activity, to certainty of diagnoses and innovation of...

Human Perception Relation between Thermal Comfort and Air Movement for Ceiling Mounted Personalized Ventilation System

As one kind of newly developed personalized ventilation (PV) system, the relation was explored between thermal comfort and air movement perception/acceptability/preference with tropical subjects, who had become passively acclimatized to hot conditions in the course of their day-to-day life. The tests were conducted in field environmental chamber (FEC) of National University of Singapore. 32 subjects (16 males and 16 females), performed normal office work, can choose to expose to four different PV airflow rates (4, 8, 12, 16 L/s) so as to simulating individual control. Ambient temperatures of 26°C and 23.5 °C and PV air temperatures of 26 °C, 23.5 °C and 21 °C were utilized to conduct parametric variation studies. Each combination was maintained for 15 minutes during which the subjects responded to computer-administered questionnaires. Under different PV airflow rates and ambient/PV temperature combinations, the relation between thermal comfort and air movement perception/acceptability/preference was analyzed.

A Phase 1 Randomized, Double Blind, Placebo Controlled Rectal Safety and Acceptability Study of Tenofovir 1% Gel (MTN-007)

ObjectiveRectal microbicides are needed to reduce the risk of HIV acquisition associated with unprotected receptive anal intercourse. The MTN-007 study was designed to assess the safety (general and mucosal), adherence, and acceptability of a new reduced glycerin formulation of tenofovir 1% gel.MethodsParticipants were randomized 1∶1:1∶1 to receive the reduced glycerin formulation of tenofovir 1% gel, a hydroxyethyl cellulose placebo gel, a 2% nonoxynol-9 gel, or no treatment. Each gel was administered as a single dose followed by 7 daily doses. Mucosal safety evaluation included histology, fecal calprotectin, epithelial sloughing, cytokine expression (mRNA and protein), microarrays, flow cytometry of mucosal T cell phenotype, and rectal microflora. Acceptability and adherence were determined by computer-administered questionnaires and interactive telephone response, respectively.ResultsSixty-five participants (45 men and 20 women) were recruited into the study. There were no significant differences between the numbers of ≥ Grade 2 adverse events across the arms of the study. Likelihood of future product use (acceptability) was 87% (reduced glycerin formulation of tenofovir 1% gel), 93% (hydroxyethyl cellulose placebo gel), and 63% (nonoxynol-9 gel). Fecal calprotectin, rectal microflora, and epithelial sloughing did not differ by treatment arms during the study. Suggestive evidence of differences was seen in histology, mucosal gene expression, protein expression, and T cell phenotype. These changes were mostly confined to comparisons between the nonoxynol-9 gel and other study arms.ConclusionsThe reduced glycerin formulation of tenofovir 1% gel was safe and well tolerated rectally and should be advanced to Phase 2 development.Trial RegistrationClinicalTrials.gov NCT01232803.

How accurate are adolescents in portion-size estimation using the computer tool Young Adolescents' Nutrition Assessment on Computer (YANA-C)?

Computer-administered questionnaires have received increased attention for large-scale population research on nutrition. In Belgium-Flanders, Young Adolescents' Nutrition Assessment on Computer (YANA-C) has been developed. In this tool, standardised photographs are available to assist in portion-size estimation. The purpose of the present study is to assess how accurate adolescents are in estimating portion sizes of food using YANA-C. A convenience sample, aged 11-17 years, estimated the amounts of ten commonly consumed foods (breakfast cereals, French fries, pasta, rice, apple sauce, carrots and peas, crisps, creamy velouté, red cabbage, and peas). Two procedures were followed: (1) short-term recall: adolescents (n 73) self-served their usual portions of the ten foods and estimated the amounts later the same day; (2) real-time perception: adolescents (n 128) estimated two sets (different portions) of pre-weighed portions displayed near the computer. Self-served portions were, on average, 8 % underestimated; significant underestimates were found for breakfast cereals, French fries, peas, and carrots and peas. Spearman's correlations between the self-served and estimated weights varied between 0.51 and 0.84, with an average of 0.72. The kappa statistics were moderate (>0.4) for all but one item. Pre-weighed portions were, on average, 15 % underestimated, with significant underestimates for fourteen of the twenty portions. Photographs of food items can serve as a good aid in ranking subjects; however, to assess the actual intake at a group level, underestimation must be considered.

The Acceptable Air Velocity Range for Local Air Movement in The Tropics

The perception of locally applied airflow was studied with tropical subjects who had become passively acclimatized to hot conditions in the course of their day-to-day life. During the experiments, 24 subjects (male and female) performed normal office work in a room equipped with six workstations. They were exposed to local airflow from the front and toward the face at six air velocities (0.15, 0.3, 0.45, 0.6, 0.75, and 0.9 m/s) at ambient temperatures of 26°C, and 23.5°C and local air temperatures of 26°C, 23.5°C, and 21°C. Each combination was maintained for 15 minutes, during which the subjects responded to computer-administered questionnaires on their thermal and draft sensations using visual-analogue scales. The results showed that the subjects preferred air movement within a certain range, i.e., a higher percentage was dissatisfied at both low and high velocity values. Most dissatisfaction with air movement is caused by thermal sensation, with air movement perception accounting for a smaller proportion. The subjects preferred air movement to be between “just right” and “slightly breezy” and preferred their thermal sensation to be between “neutral” and “slightly cool.” The study also identified an acceptable air velocity range from 0.3 up to 0.9 m/s under the experimental conditions. This velocity range is relevant for the design of personalized ventilation in practice. This preferred velocity range is higher than the maximum velocity permissible under ASHRAE Standard 55 (ASHRAE 2004) in situations where subjects have no control over local air movement.

Computer-Administered Interviews With Children About Maltreatment

It is widely recognized that maltreatment research should include a more child-oriented perspective. Although there are guidelines for directly interviewing children about their maltreatment experiences, oftentimes the children's ability to respond to sensitive questions may be hindered by embarrassment, shame, and/or guilt. With the technological advances of talking computers, computer-administered questionnaires may be an optimal way to interview children about maltreatment, because questions can be presented in two modalities—aurally, through headphones, and visually, on the screen. This method ensures privacy and presents questions in a gender-specific format that can be tailored to the developmental level and specific experiences of each child. This article reviews the advantages and disadvantages of using computer-administered questionnaires to ask children about their maltreatment history. Attention is also directed toward the methodological, developmental, and ethical aspects of interviewing children about maltreatment.

A meta-analytic study of social desirability distortion in computer-administered questionnaires, traditional questionnaires, and interviews.

A meta-analysis of social desirability distortion compared computer questionnaires with traditional paper-and-pencil questionnaires and face-to-face interviews in 61 studies (1967-1997; 673 effect sizes). Controlling for correlated observations, a near-zero overall effect size was obtained for computer versus paper-and-pencil questionnaires. With moderators, there was less distortion on computerized measures of social desirability responding than on the paper-and-pencil measures, especially when respondents were alone and could backtrack. There was more distortion on the computer on other scales, but distortion was small when respondents were alone, anonymous, and could backtrack. There was less distortion on computerized versions of interviews than on face-to-face interviews. Research is needed on nonlinear patterns of distortion, and on the effects of context and interface on privacy perceptions and on responses to sensitive questions.

Psychological Changes in Hundred-Day Remote Antarctic Field Groups

Psychological adaptation to extreme environments has been examined from several perspectives. In this study, two Australian teams, each consisting of six male crew members, completed computer-administered questionnaires twice weekly during 100-day traverses around the Lambert Glacier Basin, Antarctica. Only small trends were noted when data were aggregated at the group level, which is consistent with the findings of others. Data were then analyzed using pooled time-series regression. These analyses incorporated personality characteristics, environmental factors, and interpersonal factors as predictors of Group Tensions, Personal Morale, Emotional State, Cognitive Readiness, and the Team's Work Life. Most of the psychological discomfort and problems that occurred appeared to be within the individual or between individuals. They did not affect all members of the group equally.

A meta-analytic study of social desirability distortion in computer-administered questionnaires, traditional questionnaires, and interviews.

A meta-analytic study of social desirability distortion in computer-administered questionnaires, traditional questionnaires, and interviews.

Mode and gender effects on survey data quality

Affordable and user-friendly computer technology has made it possible to administer surveys on computers. However, even though computer administration of surveys is becoming a popular mode of data acquisition, little is known about the effect that this method may have on the quality of data collected. Gender differences are known to exist with regard to cognitive dimensions of computer literacy, but reports of gender effects on various modes of data collection are conflicting. This study examined the effects of mode of acquisition on data quality and the interaction effects of mode and gender. Computer-administered questionnaires and pencil-and-paper questionnaires served as the modes of administration. Omission rates, response distortion, completeness of the answer, and psychometric scale reliability were the measures of data quality. A student sample of 400 respondents was surveyed, and mode of administration did not impact data quality alone or in interaction with gender.

Response effects and computer-administered questionnaires: the role of the entry task and previous computer experience

Abstract In a field experiment at a tourist attraction, a between-subject; design was used to compare paper-and-pencil survey responses against those collected from two computer-administered questionnaire ( CAQ) packages; one using a cursor movement answering protocol, and the second using number pad entry. Three response effects were identified for the groups completing computerized questionnaires: an increase in the range of responses to scale questions, a tendency to select only one choice in answering multiple response questions, and longer answers to open-ended questions. Response effects were shown to be as much a function of the specific computer entry task, as the computerized interviewing situation in general. This finding suggests that computer-collected data should not be compared with data from other methodologies or even different questionnaire software without qualification. Respondent's previous computer experience was shown to have a marginal effect on the size of response effects, and onl...

The Response Effect of Question Order in Computer-Administered Questioning in the Social Sciences/

The authors examine question-order bias in computer-administered questioning (CAQ) by examining the responses of two survey groups. Each group rated two types of prod ucts with respect to various product attributes in a computer interactive mode. The two product sections of the survey appeared in different order for each survey group. The results suggest that question order has no effect in CAQ. In addition, the authors found that CAQ is not readily susceptible to fatigue. Keywords: computer-administered questionnaires, question-order bias, response fatigue.

Computerized and written questionnaires: Are they equivalent?

In this set of three studies, comparisons were made between computer-administered questionnaires and those administered in written form. Specifically, we examined nonclinical subjects' affective reactions to the two modes of questionnaire administration and their responses to a variety of commonly used attitude and personality measures. Subjects' affective reactions to the two modes of administration did not differ. With respect to questionnaire responses, there is some evidence suggesting that computer administration may slightly increase socially desirable responding amongst those subjects with relatively little computer experience. Overall, however, the differences between the two conditions were negligible, suggesting that social scientists should not hesitate to take advantage of the benefits of computer-administered questionnaires.