Machine Learning Models for Predicting Student Vulnerability to Academic Stress in AI-Integrated Learning Environments

Alvina Desya Ramadhani; David Naista

doi:10.58524/aidie.v2i1.159

Authors

Alvina Desya Ramadhani Universitas Lampung Author
David Naista UIN Raden Intan Lampung Author

DOI:

https://doi.org/10.58524/aidie.v2i1.159

Keywords:

academic stress, cognitive load, digital fatigue, learning analytics

Abstract

Artificial intelligence (AI) tools are increasingly embedded in higher education, yet their relationship with students’ academic stress remains insufficiently established. This study developed and internally evaluated machine learning (ML) models for classifying academic stress vulnerability among 441 undergraduate students enrolled in AI-integrated courses at three Indonesian public universities. Using a quantitative cross-sectional predictive design, data were collected through psychometric scales, institutional GPA records, and LMS behavioral indicators. Four supervised classifiers, Gradient Boosting (GB), Random Forest (RF), Support Vector Machine with radial basis kernel (SVM-RBF), and Logistic Regression (LR), were compared using stratified train-test evaluation and five-fold cross-validation within the training data. GB achieved the strongest held-out performance (accuracy = .846, macro-F1 = .840, AUC-ROC = .930). Permutation importance indicated that cognitive load, AI literacy, and digital fatigue contributed most to classification performance. Subgroup AUC comparisons showed no significant differences across gender and discipline, although this should be interpreted cautiously. External validation and ethical governance are required before operational deployment.

Downloads

Download data is not yet available.

References

Alalawi, K., Athauda, R., & Chiong, R. (2025). An extended learning analytics framework integrating machine learning and pedagogical approaches for student performance prediction and intervention. International Journal of Artificial Intelligence in Education, 35, 1239-1287. https://doi.org/10.1007/s40593-024-00429-7

Aldosari, A. M. (2022). Improving social presence in online higher education. Frontiers in Psychology, 13, 994403. https://doi.org/10.3389/fpsyg.2022.994403

Alhazbi, S., Al-ali, A., Tabassum, A., Al-Ali, A., Al-Emadi, A., Khattab, T., & Hasan, M. A. (2024). Using learning analytics to measure self-regulated learning: A systematic review of empirical studies in higher education. Journal of Computer Assisted Learning, 40(4), 1658-1674. https://doi.org/10.1111/jcal.12982

An, R., Qian, G., et al. (2025). Digital fatigue and academic resilience among university students with grit and flexibility as mediators. Scientific Reports, 15, 45407. https://doi.org/10.1038/s41598-025-29313-7

Baker, R. S., & Hawn, A. (2022). Algorithmic bias in education. International Journal of Artificial Intelligence in Education, 32(4), 1052-1092. https://doi.org/10.1007/s40593-021-00285-9

Bañeres, D., Rodríguez-González, M. E., Guerrero-Roldán, A. E., & Karadeniz, A. (2023). An early warning system to identify and intervene online dropout learners. International Journal of Educational Technology in Higher Education, 20, 3. https://doi.org/10.1186/s41239-022-00371-5

Barbayannis, G., Bandari, M., Zheng, X., Baquerizo, H., Pecor, K. W., & Ming, X. (2022). Academic stress and mental well-being in college students: Correlations, affected groups, and COVID-19. Frontiers in Psychology, 13, 886344. https://doi.org/10.3389/fpsyg.2022.886344

Carolus, A., Koch, M. J., Straka, S., Latoschik, M. E., & Wienrich, C. (2023). MAILS - Meta AI literacy scale: Development and testing of an AI literacy questionnaire based on well-founded competency models and psychological change- and meta-competencies. Computers in Human Behavior: Artificial Humans, 1(2), 100014. https://doi.org/10.1016/j.chbah.2023.100014

Chan, C. K. Y., & Hu, W. (2023). Students' voices on generative AI: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20, 43. https://doi.org/10.1186/s41239-023-00411-8

Cheng, A., Pei, B., & Liu, C. (2025). Balancing act: Early, fair, and accurate identification of at-risk students. Journal of Learning Analytics, 12(3), 47-65. https://doi.org/10.18608/jla.2025.8761

Chiu, T. K. F., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023). Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Computers and Education: Artificial Intelligence, 4, 100118. https://doi.org/10.1016/j.caeai.2022.100118

Christou, V., Tsoulos, I., Loupas, V., Tzallas, A. T., Gogos, C., Karvelis, P. S., Antoniadis, N., Glavas, E., & Giannakeas, N. (2023). Performance and early drop prediction for higher education students using machine learning. Expert Systems with Applications, 225, 120079. https://doi.org/10.1016/j.eswa.2023.120079

Crompton, H., & Burke, D. (2023). Artificial intelligence in higher education: The state of the field. International Journal of Educational Technology in Higher Education, 20, 22. https://doi.org/10.1186/s41239-023-00392-8

Daza, A., Saboya, N., Necochea-Chamorro, J. I., Zavaleta Ramos, K., & Vásquez Valencia, Y. d. R. (2023). Systematic review of machine learning techniques to predict anxiety and stress in college students. Informatics in Medicine Unlocked, 43, 101391. https://doi.org/10.1016/j.imu.2023.101391

de Filippis, R., & Al Foysal, A. (2024). Comprehensive analysis of stress factors affecting students: A machine learning approach. Discover Artificial Intelligence, 4, 96. https://doi.org/10.1007/s44163-024-00169-6

Drira, M., et al. (2024). Machine learning methods in student mental health research: A systematic review. Applied Sciences, 14(24), 11738. https://doi.org/10.3390/app142411738

Gümüş, M. M., & Kara, M. (2025). Development and validation of the Generative AI Literacy for Learning Scale (GenAI-LLs). Australasian Journal of Educational Technology, 41(4), 1-16. https://doi.org/10.14742/ajet.10236

Hemmler, Y., & Ifenthaler, D. (2024). Self-regulated learning strategies in continuing education: A systematic review and meta-analysis. Educational Research Review, 45, 100629. https://doi.org/10.1016/j.edurev.2024.100629

Jin, S. H., Im, K., Yoo, M., Roll, I., & Seo, K. (2023). Supporting students' self-regulated learning in online learning using artificial intelligence applications. International Journal of Educational Technology in Higher Education, 20, 37. https://doi.org/10.1186/s41239-023-00406-5

Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

Kleimola, R., Hämäläinen, R., & Cattaneo, A. (2025). Promoting higher education students' self-regulated learning through learning analytics: A qualitative study. Education and Information Technologies. https://doi.org/10.1007/s10639-024-12978-4

Koch, M. J., Wienrich, C., Straka, S., Latoschik, M. E., & Carolus, A. (2024). Overview and confirmatory and exploratory factor analysis of AI literacy scales. Computers and Education: Artificial Intelligence, 7, 100310. https://doi.org/10.1016/j.caeai.2024.100310

Laupichler, M. C., Aster, A., Haverkamp, N., & Raupach, T. (2023). Development of the Scale for the Assessment of Non-Experts' AI Literacy: An exploratory factor analysis. Computers in Human Behavior Reports, 12, 100338. https://doi.org/10.1016/j.chbr.2023.100338

Laupichler, M. C., Aster, A., Schirch, J., & Raupach, T. (2022). Artificial intelligence literacy in higher and adult education: A scoping literature review. Computers and Education: Artificial Intelligence, 3, 100101. https://doi.org/10.1016/j.caeai.2022.100101

Liu, S., Zhang, Y., Zhao, L., & Liu, Z. (2025). Academic stress detection based on multisource data: A systematic review from 2012 to 2024. Interactive Learning Environments. https://doi.org/10.1080/10494820.2024.2387744

Luo, R.-Z., & Zhou, Y.-L. (2024). The effectiveness of self-regulated learning strategies in higher education blended learning: A five years systematic review. Journal of Computer Assisted Learning, 40(6), 3005-3029. https://doi.org/10.1111/jcal.13052

Mansoor, H. M. H., et al. (2024). Artificial intelligence literacy among university students: A comparative transnational survey. Frontiers in Communication, 9, 1478476. https://doi.org/10.3389/fcomm.2024.1478476

Mykota, D. (2025). A meta-analysis of social presence in higher education online education. International Journal of E-Learning & Distance Education, 40(1).

Olson, N., Oberhoffer-Fritz, R., Reiner, B., et al. (2025). Stress, student burnout and study engagement: A cross-sectional comparison of university students of different academic subjects. BMC Psychology, 13, 293. https://doi.org/10.1186/s40359-025-02602-6

Saleem, F., Chikhaoui, E., & Malik, M. I. (2024). Technostress in students and quality of online learning: Role of instructor and university support. Frontiers in Education, 9, 1309642. https://doi.org/10.3389/feduc.2024.1309642

Schaab, B. L., Calvetti, P. U., Hoffmann, S., Diaz, G. B., Rech, M., Cazella, S. C., Stein, A. T., Barros, H. M. T., da Silva, P. C., & Reppold, C. T. (2024). How do machine learning models perform in the detection of depression, anxiety, and stress among undergraduate students? A systematic review. Cadernos de Saúde Pública, 40(11), e00029323. https://doi.org/10.1590/0102-311XEN029323

Shehzad, N., Lashari, S. A., Lashari, T. A., & Hasan, M. K. (2023). Exploring the impact of instructor social presence on student engagement in online higher education. Contemporary Educational Technology, 15(4), ep488. https://doi.org/10.30935/cedtech/13823

Skulmowski, A., & Xu, K. M. (2022). Understanding cognitive load in digital and online learning: A new perspective on extraneous cognitive load. Educational Psychology Review, 34, 171-196. https://doi.org/10.1007/s10648-021-09624-7

Yağcı, M. (2022). Educational data mining: Prediction of students' academic performance using machine learning algorithms. Smart Learning Environments, 9, 11. https://doi.org/10.1186/s40561-022-00192-z