Students' Perceived Effectiveness of Artificial Intelligence in Online Learning: Evidence from Universitas Nahdlatul Ulama Lampung
DOI:
https://doi.org/10.21009/jtp.v28i2.66467Keywords:
Artificial Intelligence, Online Learning, Student Participation, Material Comprehension, Higher EducationAbstract
The integration of Artificial Intelligence (AI) in online learning has increased significantly over the past decade; however, empirical evidence regarding its effectiveness in Indonesian higher education remains limited, particularly studies employing multidimensional inferential statistical analysis. This study aims to examine the effectiveness of AI in online learning at Universitas Nahdlatul Ulama Lampung. A quantitative survey design was employed involving 105 students selected from a population of 2,163 students. The research instrument consisted of a 40-item Likert-scale questionnaire encompassing four dimensions: AI usage, online learning participation, material comprehension, and challenges and concerns. Data were analyzed using descriptive statistics and a one-sample t-test at a significance level of 0.05. The findings indicate an overall mean score of 3.44, exceeding the scale midpoint of 3.00, with a statistically significant difference from the midpoint (t = 11.18, p < 0.001, Cohen’s d = 1.09). The highest mean score was observed for material comprehension (M = 3.55), whereas online learning participation was relatively lower (M = 3.38). These findings suggest that AI plays a substantial role in supporting online learning, particularly in enhancing material comprehension and learning flexibility, although it has not yet optimally fostered active student participation. These findings provide empirical evidence for universities in designing pedagogically appropriate AI integration strategies.
References
Adiwijaya, A., Anggadwita, G., Gozali, A. A., Ramadhana, M. R., & Purbolaksono, M. D. (2026). Digital transformation in higher education: Developing a new framework. Globalisation, Societies and Education, 24(5), 1925–1946. https://doi.org/10.1080/14767724.2025.2520952
Aripradono, H. W., Nursyamsi, I., Wahab, A., & Sultan, Z. (2024). Educational Technology for Digital Transformation of Higher Education Institutions into Entrepreneurial Universities. Policy & Governance Review, 8(3), 303–322. https://doi.org/10.30589/pgr.v8i3.1019
Ba, S., Yang, L., Yan, Z., Looi, C. K., & Gašević, D. (2025). Unraveling the mechanisms and effectiveness of AI-assisted feedback in education: A systematic literature review. Computers and Education Open, 9, 100284. https://doi.org/10.1016/j.caeo.2025.100284
Baig, M. I., & Yadegaridehkordi, E. (2024). ChatGPT in the higher education: A systematic literature review and research challenges. International Journal of Educational Research, 127, 102411. https://doi.org/10.1016/j.ijer.2024.102411
Banihashem, S. K., Bond, M., Bergdahl, N., Khosravi, H., & Noroozi, O. (2025). A systematic mapping review at the intersection of artificial intelligence and self-regulated learning. International Journal of Educational Technology in Higher Education, 22(1), 50. https://doi.org/10.1186/s41239-025-00548-8
Bond, M., Bedenlier, S., Marín, V. I., & Händel, M. (2021). Emergency remote teaching in higher education: Mapping the first global online semester. International Journal of Educational Technology in Higher Education, 18(1), 50. https://doi.org/10.1186/s41239-021-00282-x
Chen, L., Chen, P., & Lin, Z. (2020). Artificial Intelligence in Education: A Review. IEEE Access, 8, 75264–75278. https://doi.org/10.1109/ACCESS.2020.2988510
Chiu, T. K. F., Lin, T.-J., & Lonka, K. (2021). Motivating Online Learning: The Challenges of COVID-19 and Beyond. The Asia-Pacific Education Researcher, 30(3), 187–190. https://doi.org/10.1007/s40299-021-00566-w
Creswell, John W. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Sage Publication.
Crompton, H., & Burke, D. (2023). Artificial intelligence in higher education: The state of the field. International Journal of Educational Technology in Higher Education, 20(1), 22. https://doi.org/10.1186/s41239-023-00392-8
Etikan, I. (2017). Sampling and Sampling Methods. Biometrics & Biostatistics International Journal, 5(6). https://doi.org/10.15406/bbij.2017.05.00149
Fairusy Fitria Haryani, Sarwanto, & Dwi Maryono. (2023). Online learning in Indonesian higher education: New indicators during the COVID-19 pandemic. International Journal of Evaluation and Research in Education (IJERE), 12(3).
Fernández, A., Gómez, B., Binjaku, K., & Meçe, E. K. (2023). Digital transformation initiatives in higher education institutions: A multivocal literature review. Education and Information Technologies, 1–32. https://doi.org/10.1007/s10639-022-11544-0
Guidance for generative AI in education and research. (2023a). UNESCO. https://doi.org/10.54675/EWZM9535
Guidance for generative AI in education and research. (2023b). UNESCO. https://doi.org/10.54675/EWZM9535
Heung, Y. M. E., & Chiu, T. K. F. (2025). How ChatGPT impacts student engagement from a systematic review and meta-analysis study. Computers and Education: Artificial Intelligence, 8, 100361. https://doi.org/10.1016/j.caeai.2025.100361
Hwang, G.-J., & Tu, Y.-F. (2021). Roles and Research Trends of Artificial Intelligence in Mathematics Education: A Bibliometric Mapping Analysis and Systematic Review. Mathematics, 9(6), 584. https://doi.org/10.3390/math9060584
Izzati, B. M., Adzra, S. S., & Saputra, M. (2024). Online Learning Acceptance in Higher Education during Covid-19 Pandemic: An Indonesian Case Study. International Journal of Technology, 15(1), 207. https://doi.org/10.14716/ijtech.v15i1.5078
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023a). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023b). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274
Lo, C. K., Hew, K. F., & Jong, M. S. (2024). The influence of ChatGPT on student engagement: A systematic review and future research agenda. Computers & Education, 219, 105100. https://doi.org/10.1016/j.compedu.2024.105100
Luo, J., Zheng, C., Yin, J., & Teo, H. H. (2025). Design and assessment of AI-based learning tools in higher education: A systematic review. International Journal of Educational Technology in Higher Education, 22(1), 42. https://doi.org/10.1186/s41239-025-00540-2
Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014). Intelligent tutoring systems and learning outcomes: A meta-analysis. Journal of Educational Psychology, 106(4), 901–918. https://doi.org/10.1037/a0037123
Otto, S., Bertel, L. B., Lyngdorf, N. E. R., Markman, A. O., Andersen, T., & Ryberg, T. (2023). Emerging Digital Practices Supporting Student-Centered Learning Environments in Higher Education: A Review of Literature and Lessons Learned from the Covid-19 Pandemic. Education and Information Technologies, 1–24. https://doi.org/10.1007/s10639-023-11789-3
Qian, Y. (2025). Pedagogical Applications of Generative AI in Higher Education: A Systematic Review of the Field. TechTrends, 69(5), 1105–1120. https://doi.org/10.1007/s11528-025-01100-1
Rizun, N., Bordean, O. N., Nikiforova, A., Beleiu, I. N., & Revina, A. (2026). Generative AI in higher education: Ethical and behavioral factors influencing students’ intentions to use ChatGPT. Computers and Education Open, 10, 100336. https://doi.org/10.1016/j.caeo.2026.100336
Setia, M. (2016). Methodology series module 3: Cross-sectional studies. Indian Journal of Dermatology, 61(3), 261. https://doi.org/10.4103/0019-5154.182410
Simon, P. D., Jiang, J., Fryer, L. K., King, R. B., & Frondozo, C. E. (2025). An Assessment of Learning Management System Use in Higher Education: Perspectives from a Comprehensive Sample of Teachers and Students. Technology, Knowledge and Learning, 30(2), 741–767. https://doi.org/10.1007/s10758-024-09734-5
Suhardi, M. (2025). Optimizing educational management with artificial intelligence in Indonesian higher education: A qualitative exploration. Journal of Educational Management and Instruction (JEMIN), 5(2), 265–280. https://doi.org/10.22515/jemin.v5i2.11046
Surjawan, D. J., Langi, A. Z. R., & Imbar, R. V. (2025). Digital Transformation for Institution Operations in Higher Education: A Literature Review. IEEE Access, 13, 61457–61468. https://doi.org/10.1109/ACCESS.2025.3557446
Tan, S. C., Lee, A. V. Y., & Lee, M. (2022). A systematic review of artificial intelligence techniques for collaborative learning over the past two decades. Computers and Education: Artificial Intelligence, 3, 100097. https://doi.org/10.1016/j.caeai.2022.100097
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(1), 15. https://doi.org/10.1186/s40561-023-00237-x
Williamson, B., & Eynon, R. (2020). Historical threads, missing links, and future directions in AI in education. Learning, Media and Technology, 45(3), 223–235. https://doi.org/10.1080/17439884.2020.1798995
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Nina Ikhwati Wahidah, Pixyoriza, Iskandar
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Jurnal Teknologi Pendidikan is an Open Access Journal. The authors who publish the manuscript in Jurnal Teknologi Pendidikan agree to the following terms.
Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)
-
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
-
ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
- You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation.
- No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
