Use Of Survey Results Research Articles

A sequential Moken scaling approach to evaluate response quality in survey research.

Careless responding, where participants do not fully engage with item content, is pervasive in survey research. Left undetected, carelessness can compromise the interpretation and use of survey results, including information about participant locations on the construct, item difficulty, and the psychometric quality of the instrument. We present and illustrate a sequential procedure for evaluating response quality in survey research using indicators from Mokken scale analysis (MSA). We use a real data illustration and a simulation study to compare a sequential procedure to a standalone procedure. We also consider how identifying and removing responses with evidence of poor measurement properties affects item quality indicators. Results suggest that the sequential procedure was effective in identifying potentially problematic response patterns that may not always be captured by traditional methods for identifying careless responders but was not always sensitive to specific carelessness patterns. We discuss implications for research and practice.

Improving the school environment: School staff perceptions of school climate data and reporting practices.

School climate surveys have become widely used in U.S. schools, but there is little information on whether school leaders engage teachers and other staff in the process of reviewing and making use of survey results. This mixed-methods study examined staff interest, viewing, and use of survey results in a state that administers a school climate survey. Semistructured interviews with 15 staff members were conducted to gain insight into quantitative results from 16,525 staff members in 318 high schools. Survey data showed that although 84% of school staff were interested in seeing the results of their school climate survey, fewer than one-third reported seeing the results or using them for school planning or improvement. Administrators were more likely than teachers and other staff to have seen and used survey results. Content coding of the qualitative data elaborated on staff interest in reviewing and using climate data. These findings highlight the need for school leaders to collaborate with school staff on interpreting and using survey results for school climate improvement efforts.

Association Between Nonmodifiable Demographic Factors and Patient Satisfaction Scores in Spine Surgery Clinics.

The Press Ganey survey is the most widely used instrument for measuring patient satisfaction. Understanding the factors that influence these surveys may permit better use of survey results and may direct interventions to increase patient satisfaction. Press Ganey Clinician and Group Consumer Assessment of Healthcare Providers and Systems surveys administered to ambulatory spine surgery clinic patients within a large tertiary care network from May 2016 to September 2017 were retrospectively reviewed. Mean comparison testing was performed to measure associations between patient demographics and responses to "overall provider rating" and "recommend this provider's office" survey questions. Mean difference to achieve significance was set at α<0.05. A multivariate analysis was performed to determine independent factors. A total of 1400 survey responses from the offices of 11 orthopedic spine surgeons were included. Patients 18 to 34 years old had significantly lower responses to the overall provider rating question than older patients (P<.001), and increasing patient age was correlated with improved ratings. Highest education level was inversely correlated with satisfaction scores, with patients who had attained graduate level education having the lowest satisfaction scores (P=.001). Those with commercial insurance had significantly lower ratings for recommend this provider's office (P=.042) and overall provider rating (P=.022) questions than those with other insurance types. Patients administered the survey on paper had significantly lower ratings than those administered the survey online (P=.006). Provider ratings were significantly higher when the sex and ethnicity of the patient were concordant with the provider (P=.021). This study showed that independent, nonmodifiable factors such as age, education level, and survey mode were significantly associated with the satisfaction of ambulatory spine surgery clinic patients. [Orthopedics. 2019; 42(3):143-148.].

Time to reconsider the strategic role of system(s) for monitoring higher education graduates’ careers?

AbstractThe “employability” paradigm is beginning to be publicly regarded as one of the key developmental paths and “modernisation” principles of higher education institutions. In this context, the article first overviews the existing practices for tracking graduates’ early careers in Europe. Next, it identifies and discusses relevant conceptual aspects for designing system(s) for tracking graduates’ careers and using the results of graduate studies. This includes understanding and interpreting employability, possible societal tensions surrounding higher education when seeking to support the needs of graduates, employers or initiating new “professional projects”, and the development of disciplinary assumptions about career success. Third, based on the results of a national survey among higher education institutions in Slovenia, it explores institutional views related to establishing systems for monitoring graduates’ “employability”. Understanding higher education institutions’ attitudes and capacities towards monitoring the employability of their graduates is important for the success of tracking surveys in terms of their involvement in the collection of data, adapting the research instrument to reflect possible disciplinary particularities and the use of survey results. By combining the institutional perspective with the previously elaborated conceptual framework, the article calls on higher education stakeholders to support the strategic function of career monitoring systems for exploring new professional opportunities of graduates in the context of broader societal and economic developments.

The influence of media, positive perception, and identification on survey‐based measures of corruption

AbstractThis study examines the influence of some suspected sources of bias on perceptions of public sector corruption. These sources include dependence on two types of media as information sources about corruption: traditional and social media, positive perception of public employees, and social identification with public employees. Data were collected through a face‐to‐face survey of the general public in South Korea. The sample comprised 472 respondents evenly dispersed across the country. Through regression analysis, we found that dependence on traditional media—but not social media—significantly increased the perceived level of corruption. However, positive perceptions of and social identification with public employees were negatively associated with it, showing that these factors may skew respondents' perceptions of corruption. The results have implications for practitioners and researchers who design, implement, or evaluate anti‐corruption policies, suggesting the need for caution when making use of survey results.

Balancing Accountability and Improvement: A Case Study from Massachusetts

The Massachusetts Health Quality Partnership (MHQP), a coalition of health care providers and insurers, and business and government organizations, conducted a voluntary statewide survey about patients' experiences with inpatient care at Massachusetts hospitals in 1998, and made the results public. MHQP contracted with The Picker Institute (Boston) to conduct the statewide survey about seven dimensions of care for adult medical, surgical, and maternity patients at 58 hospitals across Massachusetts. The communications strategy for public report release was designed to promote fair reporting by the news media and emphasize the improvement goals of performance measurement above evaluation. Along with critical agreements on report design, trial surveys, advertising, and commitments from coalition members about the use of survey results, these measures sought to drive out fear of participation and unfair evaluation. Statewide news media coverage reflected the project's communications goals. Editorial praise for the report was widespread. The project stimulated numerous hospital quality improvement efforts and focused hospital leaders on the need to improve patients' experiences with hospital care. All participating hospitals voluntarily renewed their enrollment for a third survey and public report cycle, and new hospitals joined the project. Voluntary public release of performance information by health care providers is possible when the risks, motivations, rewards, and penalties of measurement and public reporting are understood and carefully managed. The goals of public accountability reporting will be realized sooner when it is wedded to the spirit of continuous quality improvement and when providers are engaged as partners at every step of the measurement and reporting process.

The Use of Survey Results by Democratically Controlled Organizations

This article reports afollow-up study taken three years after asurvey of is food cooperatives in California and other Western states. This study was conducted to determine the levels of dissemination and use of the survey results. Employing telephone interviews, the authors sought to determine a contact person's ability to recall the survey and to find evidence of specific applications of the results. This study uncovered instances of use previously unknown to the survey team, andfound more evidence of use in examinations of those cooperatives nearest the center conducting the survey, leading the authors to conclude that geography was the most important predictor of such usage. The authors further conclude thatfollow-up studies are both practicable and important, and that such studies should seek to find tangible instances of use rather than elicit general statements regarding value. As a final note, the authors indicate that a salutary by-product of the study was an increased interest among the organizations studied in conducting their own research.

Survey Results and Public Policy Decisions

Policy making is a vast and mysterious field of human behavior. It is only natural, therefore, that opinion researchers should have some difficulty in understanding how the results of their studies are used, if at all, and why they are not used in certain situations for which they would seem to be appropriate. Some researchers have an opportunity through contact with their clients to see how their reports affect decisions, but such experience is very limited and is seldom shared with their professional colleagues. Here is a forthright discussion of four principles concerning the use of survey results and some impressive illustrations. Launor F. Carter is Vice President of the Systems Development Corporation and has just completed a tour of duty as Chief Scientist of the United States Air Force. He presented this paper at the Annual Conference of the American Association for Public Opinion Research at Lake George on May 17, 1963.