Pengukuran usability pada learning management system perguruan tinggi menggunakan pedoman system usability scale
DOI:
https://doi.org/10.26594/teknologi.v10i1.2010Abstract
Kebijakan pemerintah di masa pandemi berdampak pada perubahan kegiatan pembelajaran di Universitas PGRI Madiun, di mana keseluruhan proses dilaksakan secara daring, salah satunya dengan memanfaatkan ELMA (e-learning Universitas PGRI Madiun). Dalam praktiknya, pengguna mengeluh ketika menggunakan platform tersebut, salah satunya terdapat beberapa tombol yang malfungsi, beberapa menu dashboard membuat bingung pengguna, dan masih banyak permasalahan lainnya. Namun, keluhan tersebut belum bisa terakomodasi dengan baik, sehingga membuat pengguna merasa kurang nyaman dalam menggunakan platform tersebut, sehingga diperlukan evaluasi untuk mengungkap kondisi usability ELMA. Hal ini perlu dilakukan mengingat salah satu misi dari ELMA adalah mendukung pembelajaran online melalui fitur yang sesuai dengan kebutuhan pengguna. Adapaun evaluasi usablity yang bisa dilakukan salah satunya dengan menggunakan SUS (System Usability Scale). SUS merupakan salah satu instrumen evaluasi yang digunakan untuk melihat usability dari sebuah produk perangkat lunak. Berdasarkan hasil evaluasi usability terhadap 30 responden mahaiswa di berbagai lintas angkatan program studi sistem informasi, platform ELMA memiliki skor rata-rata sebesar 44 dengan rating rendah dan nilai huruf F. Hal ini menunjukkan bahwa ELMA masih memiliki tingkat kegunaan/usability yang masih rendah. Sehingga perlu adanya perbaikan, diantaranya menghilangkan menu yang dirasa tidak diperlukan, memperbaiki tampilan dari forum diskusi, perbaikan plug-in fitur live conference, perbaikan terhadap tombol yang sering terjadi malfungsi, serta percepatan loading page pada paltform tersebut.
Government policy during the pandemic has an impact on changes in learning activities at the University of PGRI Madiun, where the whole process is carried out online, one of them by utilizing ELMA (E-learning of Madiun PGRI University). In practice, users complain when using the platform, one of which is a number of useless buttons, some dashboard menus that confuse users, and many other problems. However, these complaints have not been well accommodated, so it makes users feel uncomfortable using the platform, so an evaluation is needed to understand the usability condition of ELMA. It is necessary to remember one of the ELMA's mission is to support online learning through the features according to user needs. The usablity evaluation can be done either by using SUS (System Usability Scale). SUS is one of the evaluation instrument used to look at the usability of a software product. Based on the results of usability evaluation of the 30 respondents from various forces student information system study program, ELMA platform has an average score of 44 with a "Awful" and letter grade F. This shows that ELMA still has a low level of usability. So there needs improvement, including removing the menu that was deemed unnecessary, improve the appearance of the discussion forum, repair plug-in features of a live conference, improvements to frequent malfunctions button and speed up page loading on the platform.
References
Bachtiar, M. A., & Hakim, L. (2016). Game petualangan untuk meningkatkan minat belajar siswa tentang sejarah kemerdekaan Bangsa Indonesia. Teknologi: Jurnal Ilmiah Sistem Informasi, 6(2), 80-89.
Baumgartner, J., Frei, N., Kleinke, M., Sauer, J., & Sonderegger, A. (2019). Pictorial System Usability Scale (P-SUS): Developing an Instrument for Measuring Perceived Usability. CHI '19: Proceedings of CHI Conference on Human Factors in Computing Systems. Glasgow, Scotland UK: ACM.
Borsci, S., Federici, S., Bacci, S., Gnaldi, M., & Bartolucci, F. (2015). Assessing User Satisfaction in the Era of User Experience: Comparison of the SUS, UMUX, and UMUX-LITE as a Function of Product Experience. Intl. Journal of Human–Computer Interaction, 31, 484-495.
Cronholm, S., & Goldkuhl, G. (2003). Strategies for Information Systems Evaluation- Six Generic Types. Electronic Journal of Information Systems Evaluation, 6(2), 65-74.
Derisma, D. (2020). The Usability Analysis Online Learning Site for Supporting Computer programming Course Using System Usability Scale (SUS) in a University. International Journal of Interactive Mobile Technologies (iJIM), 14(9), 182-195.
Kaya, A., Ozturk, R., & Gumussoy, C. A. (2018). Usability Measurement of Mobile Applications with System Usability Scale (SUS). In F. Calisir, E. Cevikcan, & H. C. Akdag (Ed.), the Global Joint Conference on Industrial Engineering and Its Application Areas, GJCIE. Nevsehir, Turkey: Springer.
Kusuma, W. A., Noviasari, V., & Marthasari, G. I. (2016). Analisis Usability dalam User Experience pada Sistem KRSOnline UMM menggunakan USE Questionnaire. JNTETI, 5(4), 294-301.
Mtebe, J. S. (2015). Learning Management System success: Increasing Learning Management System usage in higher education in sub-Saharan Africa. International Journal of Education and Development using Information and Communication Technology (IJEDICT), 11(2), 51-64.
Ramadhan, D. W., Soedijono, B., & Pramono, E. (2019). Pengujian Usability Website Time Excelindo Menggunakan System Usability Scale (SUS) (Studi Kasus: Website Time Excelindo). JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika), 4(2), 139-147.
Revythi, A., & Tselios, N. (2019). Extension of technology acceptance model by using system usability scale to assess behavioral intention to use e-learning. Education and Information Technologies, 24, 2341–2355.
Rusdiana, A., Sulhan, M., Arifin, I. Z., & Kamludin, U. A. (2020). Penerapan Model POE2WE Berbasis Blended Learning Google Classroom Pada Pembelajaran Masa WFH Pandemic Covid-19. Bandung: UIN Sunan Gunung Djati.
Setiawan, D., & Wicaksono, S. L. (2020). Evaluasi Usability Google Classroom Menggunakan System Usability Scale. Walisongo Journal of Information Technology, 2(1), 71-78.
Setiawan, D., Saifulloh, S., & Kurniawan, I. B. (2019). Analisis Dan Perancangan Sistem Informasi LENTERA Untuk Membentuk "Smart Society“ Di Lingkungan Kampus Menggunakan Metode OOAD (Studi Kasus: Universitas PGRI Madiun). Seminar Nasional Teknologi Informasi dan Komunikasi (pp. 155-159). Madiun: Universitas PGRI Madiun.
Setiawati, A., Rahim, A., & Kisbianty, D. (2018). Pengembangan dan Pengujian Aspek Usability pada Sistem Informasi Perpustakaan (Studi Kasus : STIKOM Dinamika Bangsa Jambi). PROCESSOR, 13(1), 1173-1188.
Sharfina, Z., & Santoso, H. B. (2016). An Indonesian adaptation of the System Usability Scale (SUS). International Conference on Advanced Computer Science and Information Systems (ICACSIS) (pp. 145-148). Malang: IEEE.
Sidik, A. (2018). Penggunaan System Usability Scale (SUS) Sebagai Evaluasi Website Berita Mobile. Technologia, 9(2), 83-88.
Sujito, F., Arifudin, R., & Arini, F. Y. (2019). An Analysis of User Interface and User Experience Using System Usability Scale and GOMS Method. Journal of Advances in Information Systems and Technology, 1(1), 65-73.
Syara, Y., Anggoro, B., Handoko, A., Haka, N. B., Kesumawardani, A. D., & Hidayah, N. (2020). The Use of Moodle-based Learning Management System (LMS) on MATE (Media Ajar Teori Evolusi). IOP Conf. Series: Journal of Physics: Conf. Series. IOP.
Downloads
Published
Issue
Section
License
Please find the rights and licenses in Teknologi: Jurnal Ilmiah Sistem Informasi. By submitting the article/manuscript of the article, the author(s) agree with this policy. No specific document sign-off is required.
1. License
The non-commercial use of the article will be governed by the Creative Commons Attribution license as currently displayed on Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
2. Author(s)' Warranties
The author warrants that the article is original, written by stated author(s), has not been published before, contains no unlawful statements, does not infringe the rights of others, is subject to copyright that is vested exclusively in the author and free of any third party rights, and that any necessary written permissions to quote from other sources have been obtained by the author(s).
3. User/Public Rights
Register's spirit is to disseminate articles published are as free as possible. Under the Creative Commons license, Register permits users to copy, distribute, display, and perform the work for non-commercial purposes only. Users will also need to attribute authors and Register on distributing works in the journal and other media of publications. Unless otherwise stated, the authors are public entities as soon as their articles got published.
4. Rights of Authors
Authors retain all their rights to the published works, such as (but not limited to) the following rights;
Copyright and other proprietary rights relating to the article, such as patent rights,
The right to use the substance of the article in own future works, including lectures and books,
The right to reproduce the article for own purposes,
The right to self-archive the article (please read out deposit policy),
The right to enter into separate, additional contractual arrangements for the non-exclusive distribution of the article's published version (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal (Register: Jurnal Ilmiah Teknologi Sistem Informasi).
5. Co-Authorship
If the article was jointly prepared by more than one author, any authors submitting the manuscript warrants that he/she has been authorized by all co-authors to be agreed on this copyright and license notice (agreement) on their behalf, and agrees to inform his/her co-authors of the terms of this policy. Register will not be held liable for anything that may arise due to the author(s) internal dispute. Register will only communicate with the corresponding author.
6. Royalties
Being an open accessed journal and disseminating articles for free under the Creative Commons license term mentioned, author(s) aware that Register entitles the author(s) to no royalties or other fees.
7. Miscellaneous
Register will publish the article (or have it published) in the journal if the article’s editorial process is successfully completed. Register's editors may modify the article to a style of punctuation, spelling, capitalization, referencing and usage that deems appropriate. The author acknowledges that the article may be published so that it will be publicly accessible and such access will be free of charge for the readers as mentioned in point 3.
