Evaluasi Usability Sistem E-Voting Menggunakan System Usability Scale Pasca Perancangan Ulang Antarmuka
DOI:
https://doi.org/10.61132/saturnus.v4i2.1597Keywords:
E-Voting, Human-Computer Interaction, System Usability Scale, Usability Testing, User-Centered DesignAbstract
Although cryptographic security is often the main concern in e-voting system development, practical implementation failures are frequently associated with poor user interfaces that increase cognitive load and voting errors. This study evaluates the effectiveness of User-Centered Design (UCD) interventions in improving usability and voter confidence in an e-voting system. A one-group pretest-posttest design was applied to 36 respondents representing novice voters. Usability was measured using the System Usability Scale (SUS) before and after the interface redesign. The intervention focused on visual hierarchy, navigation consistency, status visibility, and error prevention. The results show a statistically significant improvement, with the mean SUS score increasing from 69.10 in the marginal category to 95.76 in the excellent category. The paired sample t-test produced t(35) = -7.3441 with p < 0.0001, while Cohen's d reached 1.2130, indicating a large practical effect. The standard deviation also decreased from 21.98 to 3.09, demonstrating a more consistent user experience. These findings indicate that interface optimization is essential for strengthening accessibility, voting accuracy, and user trust in digital democracy systems.
References
Acemyan, C. Z., Kortum, P., Byrne, M. D., & Wallach, D. S. (2014). Usability of voter verifiable, end-to-end voting systems: Baseline data for helios, Prêt à voter, and scantegrity II. 2014 Electronic Voting Technology Workshop/Workshop on Trustworthy Elections, EVT/WOTE 2014, 2(3), 26–56.
Adida, B. (2008). Helios: Web-based open-audit voting. Proceedings of the 17th USENIX Security Symposium, 335–348.
ALVAREZ, R. M., & HALL, T. E. (2008). Electronic Elections. In Electronic Elections. https://doi.org/10.2307/j.ctt7ss68
Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the system usability scale. International Journal of Human-Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776
Benaloh, J. (2006). Simple verifiable elections. EVT 2006 - 2006 USENIX/ACCURATE Electronic Voting Technology Workshop.
Brooke, J. (1996). SUS: A “quick and dirty” usability scale. Dlm. Jordan; P. W. , Thomas, B. , Weerdmeester, B. A. , & McClelland, A. L. (pnyt.),. Usability Evaluation in Industry, 207–212.
Cohen, J. (1998). Statistical_Power_Analysis_for_the_Behavioral_Sciences_Jacob_Cohen.
Don Norman. (2013). The Design of Everyday Things. Hachette UK. https://books.google.co.id/books/about/The_Design_of_Everyday_Things.html?id=I1o4DgAAQBAJ&redir_esc=y
Everett, S. P., Greene, K. K., Byrne, M. D., Wallaeh, D. S., Derr, K., Sandler, D., & Torous, T. (2008). Electronic voting machines versus traditional methods: Improved preference, similar performance. Conference on Human Factors in Computing Systems - Proceedings, 883–892. https://doi.org/10.1145/1357054.1357195
Field, A. (2013). DISCOVERING STATISTICS USING IBM SPSS STATISTICS.
Greene, K. K., Byrne, M. D., & Everett, S. P. (2004). Greene_2006_A_Comparison_of_Usability_Between_Voting_Methods.
Hassenzahl, M., & Tractinsky, N. (2006). User experience - A research agenda. Behaviour and Information Technology, 25(2), 91–97. https://doi.org/10.1080/01449290500330331
Herrnson, P. S., Niemi, R. G., Hanmer, M. J., Bederson, B. B., Conrad, F. C., & Traugott, M. W. (2008). BT ec h . n ec h.
ISO 9241-11. (2018). INTERNATIONAL STANDARD Usability : Definitions and concepts iTeh STANDARD iTeh STANDARD PREVIEW. 2018(5), 1–19. https://cdn.standards.iteh.ai/samples/63500/33c267a5a7564f298f02bbd65721a181/ISO-9241-11-2018.pdf
ISO 9241-210, I. (2019). Inte/iso/iec 9241-210:2019. (506).
Karayumak, F., Kauer, M., Olembo, M. M., Volk, T., & Volkamer, M. (2011). User study of the improved Helios voting system interfaces. Proceedings - 2011 1st Workshop on Socio-Technical Aspects in Security and Trust, STAST 2011, 37–44. https://doi.org/10.1109/STAST.2011.6059254
Krimmer, R., Volkamer, M., Braun, N., Norbert, B., Pereira, O., Schürmann, C., & Hutchison, D. (2017). 2nd International Joint Conference on Electronic Voting, E-Vote-ID 2017. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics): 10615 LNCS. https://doi.org/10.1007/978-3-319-68687-5
Lazar, J., Goldstein, D., & Taylor, A. (2015). Ensuring Digital Accessibility through Process and Policy. In Ensuring Digital Accessibility through Process and Policy. https://doi.org/10.1016/C2013-0-13367-3
Lewis, J. R., & Sauro, J. (2018). Item Benchmarks for the System Usability Scale. Journal of Usability Studies, 13(3), 158–167.
Marky, K., Kulyk, O., Renaud, K., & Volkamer, M. (2018). What did i really vote for? On the usability of verifiable e-voting schemes. Conference on Human Factors in Computing Systems - Proceedings, 2018-April, 1–13. https://doi.org/10.1145/3173574.3173750
Nielsen, J., & Molich, R. (1990). Heuristic evaluation of user interfaces. Conference on Human Factors in Computing Systems - Proceedings, (April), 249–256. https://doi.org/10.1145/97243.97281
Shneiderman. (2016). Designing_the_User_Interface_Strategies_for_Effective_Human_Computer.pdf.
Springall, D., Finkenauer, T., Durumeric, Z., Kitcat, J., Hursti, H., MacAlpine, M., & Halderman, J. A. (2014). Security analysis of the estonian internet voting system. Proceedings of the ACM Conference on Computer and Communications Security, (May), 703–715. https://doi.org/10.1145/2660267.2660315
Tullis, T. S., & Stetson, J. N. (2004). A Comparison of Questionnaires for Assessing Website Usability ABSTRACT : Introduction. Usability Professional Association Conference, 1–12. http://home.comcast.net/~tomtullis/publications/UPA2004TullisStetson.pdf
W3C. (2024). Web Content Accessibility Guidelines (WCAG). https://www.w3.org/TR/WCAG22/
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Saturnus: Jurnal Teknologi dan Sistem Informasi
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
