The Content Analysis of the Lesson Plans Created by ChatGPT and Google Gemini

Abstract

Following the emergence of chatbots, especially ChatGPT, researchers have begun to examine their capabilities, credibility, and reliability in educational context.  In this study, ChatGPT and Google Bard are used as technological tools to create 7th-grade lesson plans for mathematics, science, literature, and social studies classes. Using prompts, these chatbots were asked to create lesson plans for the desired course, subject, and level. The data source of this study is the content produced by these chatbots. We analyzed 18 lesson plans to identify patterns and variations within the context of learning theories and models by using the Taguette qualitative analysis program. The results show that the lesson plans created by both chatbots are strongly resemblance to human-written educational content such as sentence structures, lesson activities, and assessments. Although the activities in all lesson plans defined teachers as facilitators and offered partially constructive lesson plans, it was found that the technology-integrated activities were very limited. The findings of this study provide a practical implication of chatbots for teachers and highlights educational considerations when integrating these tools into lessons.