Penerapan Pola dan Tren Penggunaan Instrumen Evaluasi Usability (SUS, UEQ, HE) pada Sistem Digital

Moh.Eri Ramadhan Ghifari; Fathoni Mahardika; Dani Indra Junaedi; Asep Saeppani

doi:10.61132/merkurius.v4i3.1317

Authors

Moh.Eri Ramadhan Ghifari Universitas Sebelas April Sumedang
Fathoni Mahardika Universitas Sebelas April Sumedang
Dani Indra Junaedi Universitas Sebelas April
Asep Saeppani Universitas Sebelas April Sumedang

DOI:

https://doi.org/10.61132/merkurius.v4i3.1317

Keywords:

Digital Systems, Heuristic Evaluation, System Usability Scale, Systematic Literature Review, User Experience Questionnaire

Abstract

Usability evaluation plays a crucial role in ensuring the quality of digital systems, particularly in terms of comfort, effectiveness, and ease of use. Instruments such as the System Usability Scale (SUS), User Experience Questionnaire (UEQ), and Heuristic Evaluation (HE) are widely used in modern usability studies. This research conducts a Systematic Literature Review (SLR) to identify patterns and trends in the use of these instruments. A total of 27 initial studies were collected, and 16 were selected through the PRISMA screening procedure. The findings show that UEQ is the most frequently used instrument, especially in Learning Management Systems (LMS) and academic platforms, while SUS is commonly applied to mobile applications and digital libraries for rapid usability assessment. HE is effective in revealing fundamental interface issues such as non-intuitive navigation and layout inconsistencies. Overall, digital systems perform well in Efficiency and Perspicuity, but consistently show low scores in Novelty. This study provides an integrative knowledge map that highlights cross-instrument insights and supports the development of more intuitive, innovative, and user-centered digital systems

References

Adler, R. F., Baez, K., Morales, P., Sotelo, J., Victorson, D., & Magasi, S. (2024). Evaluating the usability of an mHealth app for empowering cancer survivors with disabilities: Heuristic evaluation and usability testing. JMIR Human Factors, 11(1). https://doi.org/10.2196/51522

Arifin, S. R. (2024). System usability scale (SUS) implementation in Ruang Baca Virtual–UT Library. MATRIX: Jurnal Manajemen Teknologi dan Informatika, 14(1), 1–8. https://doi.org/10.31940/matrix.v14i1.1-8

Boothe, C. S., Strawderman, L., Burch, R. F., Smith, B. K., Bethel, C. L., & Holmes, K. (2024). Generalized user experience questionnaire (UEQ-G): Holistic measurement of multimodal UX (Vol. 19).

Brooke, J. (1996). SUS: A quick and dirty usability scale. CRC Press.

Daffa Arisyi, N., Haykal, F. M., Setiawan, D. I., Ma, R. A., & Buana, P. A. (2025). Analisis kepuasan pengguna terhadap layanan digital akademik menggunakan system usability scale (SUS). Jurnal Komputer dan Teknologi Sains (KOMTEKS), 4(1), 29–34.

Dwi Wijanarko, B., Leandros, R., & Murad, D. F. (2024). Evaluasi pengalaman pengguna pada Learning Management System menggunakan metode user experience questionnaire. Jurnal Sistem Informasi Bisnis, 14(4), 385–392. https://doi.org/10.21456/vol14iss4pp385-392

Dyah Savitri, A., & Ratnasari, C. I. (2023). Implementasi User Experience Questionnaire (UEQ) untuk mengevaluasi pengalaman pengguna pada UII RAS. KLIK: Kajian Ilmiah Informatika dan Komputer, 4(3), 1352–1361. https://doi.org/10.30865/klik.v4i3.1444

Guntoro, G., Costaner, L., & Costaner, L. (2023). Exploring research and service information system usability by heuristic evaluation as a complement of system usability scale. Jurnal Penelitian Pendidikan IPA, 9(12), 11045–11052. https://doi.org/10.29303/jppipa.v9i12.5571

Haris, G., Julianto, I. T., & Ibrahim, M. R. (2025). Analysis of the usability level of the JKN Mobile application using the user experience questionnaire (UEQ) and importance-performance analysis (IPA) methods.

Ibrahim, A., Alexander, O., Tania, K. D., Putra, P., & Meiriza, A. (2023). Assessing user experience and usability in the OVO application: Utilizing the User Experience Questionnaire and system usability scale for evaluation. Jurnal RESTI, 7(4), 953–963. https://doi.org/10.29207/resti.v7i4.5137

International Organization for Standardization. (2018). Ergonomics of human-system interaction—Part 11: Usability: Definitions and concepts (ISO 9241-11:2018).

Kitchenham, B., & Charters, S. M. (2007). Guidelines for performing systematic literature reviews in software engineering. EBSE Technical Report.

Lewis, J. R., & Sauro, J. (2009). The factor structure of the system usability scale. Human Centered Design, 94–103.

Ling, A. M. Y., Hashim, A. S. B., & Ariffin, M. B. (2024). Usability heuristic evaluation of mobile learning applications based on the usability design model for adult learners (Vol. 15).

Maulana, A. E. (2024). Evaluasi aplikasi DOI by RJI pada aspek usability dan user experience menggunakan metode system usability scale (SUS) dan user experience questionnaire (UEQ) (Vol. 4).

Nielsen, J. (1994). 10 usability heuristics for user interface design. Nielsen Norman Group.

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., ... Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71

Saleh, A. M., Abuaddous, H. Y., Alansari, I. S., & Enaizan, O. (2022). The evaluation of user experience of learning management systems using UEQ. International Journal of Emerging Technologies in Learning, 17(7), 145–162. https://doi.org/10.3991/ijet.v17i07.29525

Santoso, H. B., Schrepp, M., & Kartono, R. Y. (2016). Measuring user experience of the student-centered e-learning environment (Vol. 13).

Schrepp, M., Hinderks, A., & Thomaschewski, J. (2014). Applying the User Experience Questionnaire (UEQ) in different evaluation scenarios (Vol. 8517).

Setiyawati, N., & Bangkalang, D. H. (2022). The comparison of evaluation on user experience and usability of mobile banking applications using User Experience Questionnaire and system usability scale. In Proceedings (p. 87). MDPI. https://doi.org/10.3390/proceedings

Turhangil Erenler, H. H. (2018). Heuristic evaluation of e-learning. International Journal of Organizational Leadership, 7.

Wicaksana, A. D., Juliansyah, R., Lubis, M. A., Fami, A., & Wahyoedi, B. (2024). Measuring the user experience of LMS CLASS-IPB using the User Experience Questionnaire method. Journal of Information Systems and Informatics, 6(2), 851–864. https://doi.org/10.51519/journalisi.v6i2.731

Wijaya Paula, E., & Ifani, A. Z. (2024). Implementation of User Experience Questionnaire (UEQ) to evaluate user experience of Edlink application.