Towards improving the quality of assistive technology outcomes research

Abstract

Background The Assistive Technology Device Outcomes Research (ATDOR) checklist was developed as a reporting guideline for researchers to enhance the quality of research in this field. The checklist contains 13 items that cover outcome domains unique to assistive technology devices (ATDs). The ATDOR was intended to be an adjunct to existing publication guidelines for outcomes research. Purpose The aim of this investigation was to examine the ability of the ATDOR checklist to identify strengths and weaknesses in ATD outcomes research publications that may not be detected using another publication guideline designed for outcomes research. Methods Twenty original ATD outcome studies were scored using the Template for Intervention Description and Replication (TIDieR) checklist, and the ATDOR in two evaluation rounds. In the first round, articles were scored using the TIDieR alone. In the second round, they were scored using the TIDieR and ATDOR together. The difference in percentage scores between the two evaluation rounds was examined using the Wilcoxon signed rank-sum test for paired data. Results There was a statistically significant difference in the percentage scores between the two evaluation rounds (Wilcoxon statistic = 10, Z = −3.547, p<.000). Conclusion When used alongside the TIDieR, the ATDOR adds significant value to evaluations of reporting quality on assistive technology outcomes research. As this field continues to grow, researchers are invited to join in efforts to standardise reporting to promote healthier outcomes for ATD users. Implications for rehabilitation Reporting guidelines that evaluate research studies enhance their reporting quality and promote healthier outcomes for ATD users. The Assistive Technology Device Outcomes Research (ATDOR) checklist was shown to be a useful tool for achieving a minimum standard of reporting in the field of assistive technology. As the field of assistive technology continues to explore different methodologies, ongoing efforts to develop and update reporting guidelines are necessary in order to capture the future needs of this research area.