Does the sequence of data collection influence participants’ responses to closed and open-ended questions? A methodological study

Abstract

BackgroundThe sequence used for collecting quantitative and qualitative data in concurrent mixed-methods research may influence participants’ responses. Empirical evidence is needed to determine if the order of data collection in concurrent mixed methods research biases participants’ responses to closed and open-ended questions. ObjectivesTo examine the influence of the quantitative–qualitative sequence on responses to closed and open-ended questions when assessing the same variables or aspects of a phenomenon simultaneously within the same study phase. DesignA descriptive cross-sectional, concurrent mixed-methods design was used to collect quantitative (survey) and qualitative (interview) data. The setting was a large multi-site health care centre in Canada. MethodsA convenience sample of 50 registered nurses was selected and participated in the study. Participants were randomly assigned to one of two sequences for data collection, quantitative–qualitative or qualitative–quantitative. AnalysisIndependent t-tests were performed to compare the two groups’ responses to the survey items. Directed content analysis was used to compare the participants’ responses to the interview questions. ResultsThe sequence of data collection did not greatly affect the participants’ responses to the closed-ended questions (survey items) or the open-ended questions (interview questions). ConclusionsThe sequencing of data collection, when using both survey and semi-structured interviews, may not bias participants’ responses to closed or open-ended questions. Additional research is required to confirm these findings.