Omission Of Items Research Articles

A Review of Issues in Gamified Surveys

The term “gamification” is used for a wide variety of techniques aimed to increase respondent engagement while filling out web surveys. Suggested approaches range from rephrasing questions to sound more game-like to embedding the entire survey into a game where respondent avatars adventure through a fantasy land while answering survey questions. So far, only a few experimental studies regarding the influence of gamification on survey responding have been published in peer-reviewed journals. This article systematically reviews the current research literature on gamification in surveys by first answering the question as to what gamification entails in the context of web surveys by identifying relevant gamification elements. Next, the article discusses how these elements could influence survey data quality using the Total Survey Error framework. Finally, a systematic review of empirical evidence on gamified surveys from published and unpublished studies is provided. While most studies found in our literature review reported a positive effect of using game elements, such as challenges, story/narrative, rewards, goals/objectives, and badges, on psychological outcomes among survey respondents (e.g., fun, interest, satisfaction), the influence of these elements on behavioral outcomes (e.g., completion and break-offs, item omission, satisficing, responses) and, therefore, survey quality is more unclear. This article informs survey researchers and practitioners of the current state of research on survey gamification and identifies potential areas for future research.

Structural Validity of the Mini-Balance Evaluation Systems Test (Mini-BESTest) in People With Mild to Moderate Parkinson Disease.

The Mini-Balance Evaluation Systems Test (Mini-BESTest) is a clinical balance test comprising 14 items assumed to reflect the unidimensional construct "dynamic balance." The study objective was to examine the dimensionality of the test and the properties of each item and their interrelationships in elderly people with mild to moderate Parkinson disease (PD). This was a cross-sectional study in a laboratory setting. A total of 112 participants (mean age=73 years) with idiopathic PD (Hoehn and Yahr stages 1-3) were assessed by physical therapists. Local independence among items was examined with Rasch modeling. Unidimensionality was tested by running a principal component analysis on the residuals. An exploratory factor analysis was used to examine the structure of the test, and a confirmatory factor analysis was used to evaluate the fit of the derived model. The first residual component of the principal component analysis, with an eigenvalue of greater than 2, superseded the assumption of unidimensionality. After the omission of item 7 because of convergence problems, the exploratory factor analysis suggested that a 3-factor solution best fit the data. A confirmatory factor analysis demonstrated acceptable fit of the final model, although item 14 loaded poorly on its factor. The sample size was on the lower end of what is generally recommended. This study could not confirm that the Mini-BESTest is unidimensional. Gait items were dispersed over all factors, indicating that they may reflect different constructs. Nonetheless, as there arguably is no clinical balance test superior to the Mini-BESTest today, we recommend using the total score for assessing gross balance in this population and individual items to identify specific weaknesses. Moreover, dual tasks should be assessed separately because they are an important aspect of balance control in people with PD, reflected in only one item of the test.

The validation of an educational database for children with profound intellectual disabilities.

BackgroundThe Western Cape Forum for Intellectual Disability took the South African Government to court in 2010 on its failure to implement the right to education for Children with Severe and Profound Intellectual Disability. Subsequently, multidisciplinary teams were appointed by the Western Cape Education Department to deliver services to the Special Care Centres (SCCs). Initially, minimal information was available on this population.ObjectivesThe purpose is to document the process of developing and validating a database for the collection of routine data.MethodA descriptive analytical study design was used. A sample of convenience was drawn from individuals under the age of 18 years, enrolled in SCCs in the Western Cape. The team who entered and analysed the data reached consensus regarding the utility and feasibility of each item.ResultsData were collected on 134 children. The omission of certain items from the database was identified. Some information was not reliable or readily available. Of the instruments identified to assess function, the classification systems were found to be reliable and useful, as were the performance scales. The WeeFIM, on the other hand, was lengthy and expensive, and was therefore discarded.Discussion and conclusionsA list of items to be included was identified. Apart from an individual profile, it can be useful for service planning and monitoring, if incorporated into the central information system used to monitor the performance of all children. Without such inclusion, this most vulnerable population, despite court ruling, will not have their right to education adequately addressed.

Acceptability, reliability, referential distributions and sensitivity to change in the Young Person's Clinical Outcomes in Routine Evaluation (YP-CORE) outcome measure: replication and refinement.

Many outcome measures for young people exist, but the choices for services are limited when seeking measures that (a) are free to use in both paper and electronic format, and (b) have evidence of good psychometric properties. Data on the Young Person's Clinical Outcomes in Routine Evaluation (YP-CORE), completed by young people aged 11-16, are reported for a clinical sample (N=1269) drawn from seven services and a nonclinical sample (N=380). Analyses report item omission, reliability, referential distributions and sensitivity to change. The YP-CORE had a very low rate of missing items, with 95.6% of forms at preintervention fully completed. The overall alpha was .80, with the values for all four subsamples (11-13 and 14-16 by gender) exceeding .70. There were significant differences in mean YP-CORE scores by gender and age band, as well as distinct reliable change indices and clinically significant change cut-off points. These findings suggest that the YP-CORE satisfies standard psychometric requirements for use as a routine outcome measure for young people. Its status as a free to use measure and the availability of an increasing number of translations makes the YP-CORE a candidate outcome measure to be considered for routine services.

Assessing self-management in patients with diabetes mellitus type 2 in Germany: validation of a German version of the Summary of Diabetes Self-Care Activities measure (SDSCA-G).

BackgroundOne of the most widely used self-reporting tools assessing diabetes self-management in English is the Summary of Diabetes Self-Care Activities (SDSCA) measure. To date there is no psychometric validated instrument in German to assess self-management in patients with diabetes mellitus. Therefore, this study aimed to translate the SDSCA into German and examine its psychometric properties.MethodsThe English version of the SDSCA was translated into German following the guidelines for cultural adaptation. The German version of the SDSCA (SDSCA-G) was administered to a random sample of 315 patients with diabetes mellitus type 2. Reliability was analyzed using Cronbach’s alpha coefficient and item characteristics were assessed. Exploratory and confirmatory factor analysis (EFA and CFA) were carried out to explore the construct validity. A multivariable linear regression model was used to identify the influence of predictor variables on the SDSCA-G sum score.ResultsThe Cronbach’s alpha for the SDSCA-G (all items) was α = 0.618 and an acceptable correlation between the SDSCA-G and Self-management Diabetes Mellitus-Questionnaire (SDQ) (ρ = 0.664) was identified. The EFA suggested a four factor construct as did the postulated model. The CFA showed the goodness of fit of the SDSCA-G. However, item 4 was found to be problematic regarding the analysis of psychometric properties. The omission of item 4 yielded an increase in Cronbach’s alpha (α = 0.631) and improvements of the factor structure and model fit. No statistically significant influences of predictor variables on the SDSCA-G sum score were observed.ConclusionThe revised German version of the SDSCA (SDSCA-G) is a reliable and valid tool assessing self-management in adults with type 2 diabetes in Germany.Electronic supplementary materialThe online version of this article (doi:10.1186/s12955-014-0185-1) contains supplementary material, which is available to authorized users.

Is the Epworth Sleepiness Scale Suitable for Use in Stroke?

Background: The Epworth Sleepiness Scale (ESS-8) is frequently used in stroke but has never been validated for this condition. There is concern regarding the suitability of the driving item (item 8). A summed raw score of 10 or more (from a maximum of 24) signifies pathological sleepiness. Objective: To determine the construct validity of the ESS-8 by Rasch analysis and in particular to determine whether omission of item 8 confounds the scale. Method: A pack containing the ESS-8 and questions regarding sleep and demographics was sent to 999 patients who had experienced a stroke within the past 4 years. Data were assessed for fit to the Rasch model. Results: Analysis of 269 records revealed a unidimensional scale that was free from differential item functioning by age and sex with good overall fit to the Rasch model. Item 4 had disordered thresholds. Analysis of the ESS without item 8 (ESS-7) also revealed a valid scale. Equating person locations between the ESS-8 and ESS-7 showed no differences below a summed raw score of 18. Conclusion: The ESS-8 has good construct validity for use in stroke and is reliable at the cutpoint of 10. Summed raw scores below 18 will be unaffected if nondrivers either score as zero or simply omit item 8. The scale is therefore robust for detecting cases of pathological sleepiness in stroke but may not be suitable for measuring high levels of sleepiness in a sample containing both drivers and nondrivers. Instead, the ESS-7 could be used for this purpose.

Current Obstacles in Replicating Risk Assessment Findings: A Systematic Review of Commonly Used Actuarial Instruments

An actuarial risk assessment instrument can be considered valid if independent investigations using novel samples can replicate the findings of the instrument's development study. In order for a study to qualify as a replication, it has to adhere to the methodological protocol of the development study with respect to key design characteristics, as well as ensuring that manual-recommended guidelines of test administration have been followed. A systematic search was conducted to identify predictive validity studies (N = 84) on three commonly used actuarial instruments: the Violence Risk Appraisal Guide (VRAG), the Sex Offender Risk Appraisal Guide (SORAG), and the Static-99. Sample (sex, age, criminal history) and design (follow-up, attrition, recidivism) characteristics, as well as markers of assessment integrity (scoring reliability, item omissions, prorating procedure), were extracted from 84 studies comprising 108 samples. None of the replications matched the development study of the instrument they were attempting to cross-validate with respect to key sample and design characteristics. Furthermore none of the replications strictly followed the manual-recommended guidelines for the instruments' administration. Additional replication studies that follow the methodological protocols outlined in actuarial instruments' development studies are needed before claims of generalizability can be made.

Development of the Gerotranscendence Scale Type 2: Japanese Version

This study developed the Japanese version of the gerotranscendence scale type 2 (the GST2) and examined reliability and validity of the scale. In Japan, 525 community-dwelling older adults (male = 260, female = 265) answered a questionnaire. An exploratory factor analysis of the Japanese version of the GST2 revealed the same three-factor structure including the Dimensions of the Cosmic, the Coherence, and the Solitude, which had been reported by Tornstam with the omission of item 1. Reliability and construct validity of the Japanese version of the GST2 were confirmed. These findings provide support for use of the Japanese version of the GST2 as a measure of lifespan development among the oldest old in Japan. The GST2 can be applicable not only for older adults in Sweden but also for older adults in Japan.

100 Neonatal Disease Severity Scores and their Predictive Value 3For Early Mortality: A Population-Based Study on Subgroups of VLBW Infants

Background and aimsBenchmarking of newborn mortality needs risk-adjustment of data for heterogeneous sub-populations. To assess utility of neonatal disease severity scores CRIB, CRIB-II and PREM and impact of influenceable items...

Reminders in Web-Based Data Collection

Evidence-based insight on the effectiveness of reminders in web-based data collection in online panels is scarce. Thirty-eight studies were conducted in three different online panels to examine the effect of reminders on response rates, retention rates, and two facets of response quality (i.e., item omissions and response nondifferentiation). The studies were summarized using a meta-analytical approach including moderator tests ( N = 246,040). Results indicated that reminders in web-based data collection increase response (i.e., from 49.5% to 65.6%, ESpd = .152). However, reminders somewhat reduce retention (i.e., from 98.0% among prereminder respondents to 97.2% among reminded respondents, ESpd = −.008), which might be explained by differences in motivation and computer literacy between unreminded and reminded respondents. No differences were found between prereminder respondents and reminded respondents in item omissions and response nondifferentiation.

Can repetitive transcranial magnetic stimulation prolong the antidepressant effects of sleep deprivation?

Repetitive transcranial magnetic stimulation (rTMS) has been proposed for stabilizing the antidepressant effect of sleep deprivation (SD) by preventing the relapse after a night of recovery sleep. In this study, we aimed to replicate these data coming from a small pilot study in a larger patient sample. Thirty-seven patients were randomly assigned to receive either active or sham rTMS on four consecutive days after one night of SD. The majority of the participants had experienced an antidepressant effect of SD in the past. At each rTMS session 1000 stimuli were applied over the left dorsolateral prefrontal cortex at 10 Hz with an intensity of 110% resting motor threshold. For sham stimulation, a sham-coil system was used. Treatment effects were assessed with a modified version of the Hamilton Depression Rating Scale and a self-report well-being scale (BfS) before SD, after SD, during rTMS and 3 days after rTMS. SD led to a highly significant reduction of depressive symptoms in the whole group as reflected by a mean Hamilton Depression Rating Scales score reduction of 56% (with omission of sleep items). In both the active and the sham-stimulated group, the symptom reduction remained stable for the whole observation period. No difference between active and sham rTMS was observed. SD is capable of inducing pronounced antidepressant effects. In contrast to a previous study, active rTMS was not superior to sham rTMS in stabilizing the antidepressant effects of SD, which was mainly due to a pronounced effect in the sham group in this study population.

Can Perfume Increase The Response Rate To A Face-To-Face Survey?

After this paper reviews the literature related to the use of scent in marketing and other fields, it describes an experiment that manipulated the use of a perfume on a personal interviewer. The results indicate that perfume can be used to enhance the response rate to a face-to-face survey without incurring a sample bias or affecting the item omission rate. Suggestions for future researchers are offered.

Application Of Media Richness Theory To Data Collection

Researchers and practitioners are becoming more dependent on electronic means of data collection. This study utilizes media richness theory (MRT) as a means to better understand respondent performance in data collection among adults and adolescents. Examining the differences between paper and pencil, interview and electronic form methods of data collection, the results of this study indicate that matching task type to data collection method according to MRT principles produces improved levels of response distortion as expected; however, item omissions are not influenced in the manner anticipated from MRT concepts.

Cognitive emotion regulation questionnaire: Development of Turkish version of 18-item short form

The purpose of this study is to develop a Turkish version of the cognitive emotion regulation questionnaire (CERQ) short 18-item version. We translated and cross-culturally adapted the English version of the CERQ, and tested the reliability and factorial validity of the Turkish version (CERQ-TR). A sample of 317 Turkish university students completed the CERQ-TR. Following stepwise omission of the items with the highest ‘alpha if item deleted’ on the basis of reliability analyses results, short version of the CERQ-TR was constructed. Cronbach alpha reliability coefficients obtained from CERQ-TR short scale ranged from 0.63 to 0.74, and for the original scales, alpha is ranged from 0.65 to 0.78. Finally, confirmatory factor analyses (CFA) supported the original nine factor model. Goodness of fit statistics indicates that short form of CERQ-TR is acceptable.

Mensuração racial e campo estatístico nos censos brasileiros (1872-1940): uma abordagem convergente

Este artigo investiga os sentidos assumidos pela classificação racial nos censos brasileiros. Propõe uma análise convergente entre as convenções sociopolíticas estabelecidas para a investigação (1872, 1890, 1940) ou omissão (1920) do quesito racial dos levantamentos, em diferentes momentos históricos, e o processo de emergência da comunidade técnica de estatísticos em meio às mudanças do paradigma censitário. Como método, considera-se a circularidade existente entre o sistema social de classificação racial, as obras intelectuais de interpretação da nacionalidade vinculadas ao suporte censitário - "O povo brasileiro e sua evolução", de Oliveira Vianna (1920), e "A cultura brasileira", de Fernando de Azevedo (1940) - e o papel das exigências técnicas na tomada de posição dos estatísticos. São analisados relatórios de organizadores e comissões censitárias no plano verbal, comparando os argumentos apresentados às formas de execução das categorias e às informações e cruzamentos obtidos no plano matricial. Toma-se o censo de 1940 como ponto de inflexão na organização da atividade por acentuar o conflito estrutural entre a função prioritariamente política, até então reservada às estatísticas, e a consagração da competência técnica de seus produtores. Nesses termos, este trabalho aborda a progressiva liberação da ideologia estatística frente aos mecanismos da propaganda política sobre a cor.

Using Mobile Phones for Survey Research: A Comparison with Fixed Phones

The increase in mobile phone penetration is stimulating a trend towards the use of mobile phones to supplement or even replace traditional telephone surveys. Despite this trend, few studies have systematically compared differences between the two modes. This paper describes a study in which both mobile and fixed phones were used to collect data on a national survey on internet and cultural practices. Findings revealed significant differences between mobile phone respondents and fixed phone respondents in terms of demographic characteristics and responses to some of the substantive items of the survey. In terms of data quality the mobile phone survey proved to be different from the fixed phone survey in two indicators: completion times and percentage of respondents with item omissions. The mobile phone survey was more difficult to implement than the fixed phone survey since much more screening was required to identify working phone numbers; in addition it yielded a lower response rate than the fixed phone survey.

Utilização de medicamentos por aposentados brasileiros: 2 - Taxa de resposta e preenchimento de questionário postal em Belo Horizonte, Minas Gerais, Brasil

This paper reports on the response rate and completeness of item response in a self-administered postal survey questionnaire on use of medication by retirees 60 years or older under the Brazilian Social Security System, in Belo Horizonte, Minas Gerais State, in 2003. Questionnaires were sent in two rounds to 800 postal addresses of subjects selected by simple random sampling. The response rate was 47.8%, and there were no significant differences in the selected characteristics between respondents and non-respondents, or between early and late respondents. For almost all socio-demographic and health variables, item omission was less than or equal to 5% for both the entire sample and early or late responders. For all the medicines used, the dose and laboratory were the main items omitted. The findings indicate that details on drug use should be reevaluated in self-administered questionnaires.

Understanding quality of life for children after liver transplantation: A work in progress

Understanding quality of life for children after liver transplantation: A work in progress

Validation of the International Reading Literacy Test

In 2001, the International Association for the Evaluation of Educational Achievement (IEA) conducted a comparative study of reading literacy (PIRLS 2001). A reading comprehension assessment instrument was developed and translated into the languages of 35 participating countries for this purpose. After field testing of the instrument, the final version of the Reading Literacy Test (RLT) was established. In two studies, the validity of the Dutch version of the RLT was examined. In the first study, comparison of the linguistic characteristics of the Dutch and English versions of the test showed the Dutch passages and items to contain both a greater number of words and longer words than the English passages and items. However, the use of more and longer words did not produce a higher level of complexity with respect to content, sentence structure, text structure, or test items as judged by a panel of bilingual experts. While the Dutch children had to read more and longer words than the English children, moreover, they had no problems finishing the test within the allocated amount of time. In the second study, the possible impact of the changes made after the field testing of the RLT was examined. The omission of passages and the modification or omission of test items were found to have no consequences for the psychometric properties of the Dutch version of the test were examined.

Survey Research and Islamic Fundamentalism: A Question about Validity

Psychology of religion research has historically borrowed heavily from the quantitative approach of mainstream psychology. This study illustrates difficulties that are sometimes related to this practice, even when using instruments that have proven to be psychometrically sound. We distributed an earlier reliable and valid version of the Intratextual Fundamentalism Scale (Williamson & Hood, 2005), developed with a U.S. Christian sample, in an African American mosque for the purpose of cross-cultural validation. Among the 76 survey booklets initially distributed, 27 were returned and, of those, only 17 had usable information; almost all of these had aberrations including item omissions and handwritten comments. In view of the low response rate and atypical responses, this article presents a qualitative-type, rather than a quantitative, analysis of the data and discusses the important issue of assumed validity as it relates to contemporary religious research in cross-cultural investigations.