Performance Evaluation of Automated Essay Scoring Online System for Competency Assessment of Community Academy

Mohammad Idhom; I Gusti Putu Asto Buditjahjanto; Munoto; Muchlas Samani

doi:10.1109/ICVEE57061.2022.9930387

Performance Evaluation of Automated Essay Scoring Online System for Competency Assessment of Community Academy

Closed

Mohammad Idhom, I Gusti Putu Asto Buditjahjanto, Munoto, Muchlas Samani

2022 2022 5th International Conference on Vocational Education and Electrical Engineering: The Future of Electrical Engineering, Informatics, and Educational Technology Through the Freedom of Study in the Post-Pandemic Era, ICVEE 2022 - Proceeding Conference paper Cited by 4

Abstract

The essay scoring system has been done manually so far, which has become an obstacle in the learning evaluation process. The use of the Automated Essay Scoring (AES) system is an alternative to developing automated scoring applications. The purpose of this research paper is to evaluate the performance of the AES online system on the assessment of vocational education competencies in the IT Multimedia field at the Community Academy in Blitar and Pacitan, East Java. The method of this study is consisting of pre-processing text, similarity calculation with cosine similarity and correlation method to measure performance of AES with human rater. This study compares the performance of the assessment system using a human rater and the AES online system. The results show that the correlation value is 0.903569186 with excellent criteria and the MAE (Mean Absolute Error) value is 0.133547009 which indicates a fairly small error value. © 2022 IEEE.

Affiliations

Universitas Negeri Surabaya, Doctoral Program of Vocational Education, Jawa Timur, Indonesia

View full text (DOI) →

Research at a Glance

Research at a Glance

Topics & SDG Alignment

Collaboration

Author Profile (Selected)

References Overview

Journal & Source

Metadata & Integrity