Automatic short answer scoring using words overlapping methods

Abstract

Assessment is one of the most important things in studying. In this digital era, there are a lot of systems that have developed to handle assessment automatically. One of the system assessments that were developed by researcher is automatic scoring for essay. There are two types of essay; long and short answer essays. This paper is focused on the development of automatic short answer scoring. Some automatic scoring systems used on long answer have shown optimal results in giving a score on the students answer. Automatic long answer systems use the information retrieval method to measure similarity between students answer and references answer. Automatic short answer scoring does not give the best result yet. Short answer has a limited word in each answer. Each answer consists of one phrase to three sentences. Assessment of the short description that has limited number of words requires special handling, especially in the weighting process. With the limitations of the process of weighting the word, it cannot be done with frequency model, because the words occurrence is very rare. This study tries to compare several methods that apply the overlapping methods to determine the degree of similarity between the references answer and students answer. From the research result shows that the method Cosine Coefficient has better results than the Dice and Jaccard Coefficient methods.Assessment is one of the most important things in studying. In this digital era, there are a lot of systems that have developed to handle assessment automatically. One of the system assessments that were developed by researcher is automatic scoring for essay. There are two types of essay; long and short answer essays. This paper is focused on the development of automatic short answer scoring. Some automatic scoring systems used on long answer have shown optimal results in giving a score on the students answer. Automatic long answer systems use the information retrieval method to measure similarity between students answer and references answer. Automatic short answer scoring does not give the best result yet. Short answer has a limited word in each answer. Each answer consists of one phrase to three sentences. Assessment of the short description that has limited number of words requires special handling, especially in the weighting process. With the limitations of the process of weighting the word, it cann...