Comparing a Mobile Phone Automated System With a Paper and Email Data Collection System: Substudy Within a Randomized Controlled Trial.

Diana M Bond,Antonia W Shand,Jeremy Hammond,Natasha Nassar

doi:10.2196/15284

Diana M Bond, Antonia W Shand + Show 2 more

Open Access

https://doi.org/10.2196/15284

Copy DOI

Abstract

BackgroundTraditional data collection methods using paper and email are increasingly being replaced by data collection using mobile phones, although there is limited evidence evaluating the impact of mobile phone technology as part of an automated research management system on data collection and health outcomes.ObjectiveThe aim of this study is to compare a web-based mobile phone automated system (MPAS) with a more traditional delivery and data collection system combining paper and email data collection (PEDC) in a cohort of breastfeeding women.MethodsWe conducted a substudy of a randomized controlled trial in Sydney, Australia, which included women with uncomplicated term births who intended to breastfeed. Women were recruited within 72 hours of giving birth. A quasi-randomized number of women were recruited using the PEDC system, and the remainder were recruited using the MPAS. The outcomes assessed included the effectiveness of data collection, impact on study outcomes, response rate, acceptability, and cost analysis between the MPAS and PEDC methods.ResultsWomen were recruited between April 2015 and December 2016. The analysis included 555 women: 471 using the MPAS and 84 using the PEDC. There were no differences in clinical outcomes between the 2 groups. At the end of the 8-week treatment phase, the MPAS group showed an increased response rate compared with the PEDC group (56% vs 37%; P<.001), which was also seen at the 2-, 6-, and 12-month follow-ups. At the 2-month follow-up, the MPAS participants also showed an increased rate of self-reported treatment compliance (70% vs 56%; P<.001) and a higher recommendation rate for future use (95% vs 64%; P<.001) as compared with the PEDC group. The cost analysis between the 2 groups was comparable.ConclusionsMPAS is an effective and acceptable method for improving the overall management, treatment compliance, and methodological quality of clinical research to ensure the validity and reliability of findings.

Highlights

The frequency with which women completed the daily and weekly questionnaires was consistently higher among the mobile phone automated system (MPAS) users, with a 56% average response rate over the 8-week treatment period compared with 37% (P
We have shown that the mobile phone system improved treatment compliance and response rates, demonstrated greater user satisfaction, is comparable in cost to PEDC, and does not impact study outcomes
The peak completion rate of the PEDC questionnaires was on the day the weekly questionnaires were emailed to the participants, suggesting that emailed links are a more effective method of data collection compared with paper-based data collection, they are more time consuming for the trial coordinator compared with automated SMS links

Summary

Introduction

The outcomes assessed included the effectiveness of data collection, impact on study outcomes, response rate, acceptability, and cost analysis between the MPAS and PEDC methods. The method and type of data collection system utilized to recruit participants and collect data throughout the study is important to ensure the quality, reliability, and validity of data collection It must be cost-effective and acceptable to participants, funding organizations, and researchers [4,5,6]. Paper-based data collection in research studies is gradually being replaced or used in conjunction with electronic data collection systems [7], primarily in the form of emails containing links to web-based surveys Comparison of these two methods has been well documented [8,9,10,11]

Objectives

Methods

Findings

Discussion

Conclusion