Angel Novita Sinurat, Anggyi Trisnawan Putra

Usability Analysis of Educational Assistance Information Systems Using the Heuristic Evaluation and End User Computing Satisfaction (EUCS) Methods.

Introduction

Usability analysis of educational assistance information systems using the heuristic evaluation and end user computing satisfaction (eucs) methods.. Analyze SIBADIK, an educational scholarship system, using Heuristic Evaluation & EUCS. Discover major usability issues (severity 3) & low user satisfaction, offering key recommendations for UI improvement.

Abstract

User interface and user satisfaction are crucial components of a system that can significantly impact its usability. SIBADIK, as a web-based application used by many students as a scholarship platform, should have a high level of usability. However, there has been no specific research analyzing the usability of the SIBADIK website. Usability analysis is necessary to determine whether the website is acceptable to users or if there are issues that need to be addressed. The method used is heuristic evaluation combined with End-User Computing Satisfaction (EUCS) to measure user satisfaction levels before and after improvements. The sample was obtained using purposive sampling technique with Slovin formula at 10% margin of error, resulting in 95 samples. The research findings indicate that the SIBADIK website received a user satisfaction score of 2.92 (in the "fairly satisfied" category). The heuristic evaluation by three evaluators revealed a severity point of 3.0195 (rounded to 3), indicating a major usability problem that requires improvements. Twelve issues were identified on the SIBADIK website: 2 issues with Match Between System and Real World, 1 issue with User Control and Freedom, 2 issues with Consistency and Standards, 1 issue with Error Prevention, 2 issues with Recognition Rather Than Recall, 2 issues with Flexibility and Efficiency of Use, and 2 issues with Aesthetic and Minimalist Design. These identified problems serve as recommendations for improving the SIBADIK user interface.

Review

This study presents a timely and pertinent usability analysis of SIBADIK, a critical web-based scholarship platform for students, addressing a notable gap in prior research. The paper effectively combines a quantitative End-User Computing Satisfaction (EUCS) method with qualitative heuristic evaluation to assess the system's current state. By targeting a sample of 95 users through purposive sampling, the research establishes a robust foundation for understanding user perspectives and identifying system deficiencies. The chosen methodology offers a comprehensive approach to diagnosing usability challenges, ensuring both user perception and expert evaluation contribute to the analysis. The findings reveal that SIBADIK currently sits in a "fairly satisfied" category with an EUCS score of 2.92, indicating room for improvement. More critically, the heuristic evaluation by three evaluators points to a significant problem, with a severity score of 3.0195 (rounded to 3), categorizing it as a major usability issue requiring immediate attention. The research meticulously identifies 12 specific problems across seven key usability heuristics, including issues with "Match Between System and Real World," "Consistency and Standards," and "Aesthetic and Minimalist Design." This detailed breakdown provides actionable insights and forms a concrete basis for targeted improvements to the SIBADIK user interface. Overall, this research offers valuable insights into the usability of a crucial educational assistance system. Its strength lies in the dual-method approach, which not only quantifies user satisfaction but also systematically uncovers specific design flaws. While the abstract mentions measuring satisfaction "before and after improvements," the reported findings focus on the "before" state, providing a strong baseline. Future research could extend this work by implementing the suggested improvements and subsequently re-evaluating the system to demonstrate the tangible impact on both usability heuristics and user satisfaction, thereby fully realizing the potential of the "before and after" measurement outlined in the methodology.

Full Text

Comments

You need to be logged in to post a comment.