Abstract
Context: Empirical studies (ES) and systematic reviews (SR) play an essential role in the Human-Computer Interaction (HCI) field as its focus is on evaluating the end-user and usability of software solutions and synthesizing the evidence found by the HCI community. Even though the adoption of empirical evaluation techniques and SR has gained popularity in recent years, the consistent use of a methodology is still maturing. Goal: This study aims to provide a qualitative and quantitative assessment of the current status of ES and SR presented in the research papers published at the proceedings of the Brazilian Symposium on Human Factors in Computing Systems (IHC Symposium). Method: We conduct an empirical study on the papers over the 18 editions in the IHC Symposium to answer four research questions. Our study proposes a protocol to identify and assess ES and SR reported in the papers published at the IHC Symposium. Results: From the sample of 259 studies, we find 131 ES and SR (~51%). We have characterized and categorized the ES into case studies, experiments, and surveys. Further, we found evidence that these studies' quantity and quality have been increased over the IHC Symposium editions, and almost half of these studies give detailed information making possible their replication. Conclusion: We hope that each study's characterization can support the conduction of new ES and SR by the HCI Brazilian community, producing more reliable results and reducing or eliminating biases.
Highlights
The Human-Computer Interaction (HCI) field requires that researchers and practitioners understand the psychological, organizational, and social factors of the combined human and computer systems to build competitive software interfaces and evaluate their effects (Valverde, 2011)
Goal: This study aims to provide a qualitative and quantitative assessment of the current status of Empirical studies (ES) and systematic reviews (SR) presented in the research papers published at the proceedings of the Brazilian Symposium on Human Factors in Computing Systems (IHC Symposium)
We looked for studies related to our paper’s goal, i.e., those that performed an empirical study for analyzing the case studies, experiments, surveys, or systematic reviews conducted in the HCI field
Summary
The Human-Computer Interaction (HCI) field requires that researchers and practitioners understand the psychological, organizational, and social factors of the combined human and computer systems to build competitive software interfaces and evaluate their effects (Valverde, 2011). Software practitioners can assess their software interfaces and the techniques used to develop these interfaces. The application of empirical methods and systematic reviews requires reliable procedures and practices (Wohlin et al, 2012; Malhotra, 2015). We present some concepts related to empirical methods and systematic reviews. It discusses on (the lack of) related work and presents our preliminary study
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
