ABSTRACT Using the design science methodology, we develop an automated grading bot using robotic process automation (RPA) software. This grader demonstrates RPA’s capability to enhance the efficiency and accuracy of grading structured query language (SQL) queries. Validation of the RPA grader demonstrates that it can grade assignments and/or exams in 30 to 60 minutes, a task that would take a human grader approximately 50 hours. In contrast to human graders, who misgraded 5 to 8 percent of queries, the RPA grader graded all queries correctly. Notably, it correctly evaluated 188 distinct correct solutions submitted by students to a single question. To facilitate broad adoption, we provide instructions and the necessary code for implementing the RPA grader. We validate that professors and teaching assistants can successfully implement the RPA grader even with no previous bot building experience.
Read full abstract