The Efficacy of GenAI Tools in Postsecondary Education

Abstract

In postsecondary education institutions, where innovative technologies continually reshape research and pedagogical approaches, the integration of generative artificial intelligence (GenAI) tools presents promising avenues for enhancing student learning experiences. This study assesses the efficacy of integrating GenAI tools, specifically chatbots, to ameliorate learning outcomes and mitigate test anxiety among postsecondary students. Within the context of an introductory psychology course, 40 participants engaged with chatbots as supplementary “study confidantes” for exam preparation and as facilitators for an essay grading task. The results from surveys administered to the participants indicated that most students found the chatbots helpful in aiding comprehension of course materials. Moreover, a substantial proportion of respondents reported an enhanced understanding of how to structure an academic paper because of their essay grading activity. Despite the favourable perception of chatbot assistance with learning course material and fostering insights into structuring scholarly essays, no discernible alterations in the levels of test anxiety among students were observed. Overall, this research underscores the latent potential of chatbots as pedagogical adjuncts, furnishing instructive insights for educators aiming to innovate instructional methodologies and optimize student learning paradigms within the domain of postsecondary education. Keywords: GenAI tools, assessments, learning outcomes