Natural Language Processing for Learning Assessment in STEM

Abstract

Education 4.0 Framework reveals the need for the curricula of Higher Education Institutions to incorporate new learning approaches, along with new Competency Assessment Models. In the case of STEM (Science, Technology, Engineering, and Mathematics) programs, the inclusion of new technological tools is relevant to effectively assess the level reached by students in the development of transversal skills. NLP (Natural language processing) is a practical approach to understanding the effectiveness of learning processes because it provides solutions in various fields associated with the social and cultural context of Competency-Based Learning. In this study, we evaluate the usefulness of integrating NLP tools in evaluation procedures in advanced STEM subjects to aid the educator in developing competencies outside its core subject expertise. Different instruments were considered: surveys, questionnaires, interviews, observation lists, rubrics, and other tools to handle parametric data statistically. The study’s findings confirmed that the NLP tools are handy to evaluate higher-order functions and determine levels of cognitive understanding of concepts. Additionally, results showed that NLP tools could support instructors in carrying out better review and feedback sessions and providing personalized reports on oral and written communication skills.