EVALUATING THE EFFECTIVENESS OF AI CHATBOTS IN HIGHER EDUCATION AND RESEARCH ACTIVITIES: PERSPECTIVES OF ALGERIAN UNIVERSITY PROFESSORS USING THE URPIC MODEL
Abstract
This study aims to evaluate the advantages of AI chatbots used by university teachers in Algeria for their education and research activities, considering increased human-machine interactions, especially with advances in natural language processing. The assessment is based on a model consisting of five dimensions: uses, reliability, privacy, integration, and constraints to use. The questionnaire items were developed based on this model, and the study sample included 246 university professors from various disciplines. The responses were analyzed using the SPSS 27 software. Among the most important findings of the research is the moderate evaluation of AI chatbots effectiveness by the study sample, based on an average level across the five aforementioned dimensions. The sample also placed significant emphasis on the criteria of reliability, privacy protection, and integration in order of importance.
References
Bettayeb, A. M., Abu Talib, M., Sobhe Altayasinah, A. Z., & Dakalbab, F. (2024). Exploring the impact of ChatGPT: conversational AI in education. Frontiers in Education ,
Bobro, N. (2024). Use of chatbots based on artificial intelligence to optimize the educational process in a higher education institution. Grail of Science(43). https://doi.org/https://doi.org/10.36074/grail-of-science.06.09.2024.040
Bolambao, F. J., Pogoy, A. M., & Plaisent, M. (2025). AI Chatbots in Higher Education: A Meta-Synthesis. In Emerging Technologies Transforming Higher Education: Instructional Design and Student Success (pp. 53-74). IGI Global. https://doi.org/10.4018 / 979 - 8 - 3693 - 3904 - 6
Elizabeth, J. G. S., Patricio, Á.-M., Kerly, P.-Z., Dennis, G., & Marco, F.-H. (2024). Unveiling the core constructs: A statistical approach to evaluating user experience with Chatbots in higher education (A case study from a university in Ecuador. Journal of infrastructure, policy and development, 01-24, 24(01). https://doi.org/10.24294/jipd.v8i10.6381
Giray, L., Jacob, J., & Gumalin, D. L. (2024). Strengths, Weaknesses, Opportunities, and Threats of Using ChatGPT in Scientific Research. International Journal of Technology in Education, 7(1), 40-58. https://doi.org/10.46328/ijte.618
Gumusel, E. (2025). A literature review of user privacy concerns in conversational chatbots: A social informatics approach: An Annual Review of Information Science and Technology (ARIST) paper. Journal of the Association for Information Science and Technology, 76(1), 121-154. https://doi.org/10.1002/asi.24898
Hashiyana, & Kamati. An Artificial Intelligence-Powered Chatbot-Integrated Web-Based Application. Advances in business strategy and competitive advantage book series. https://doi.org/10.402024. 18/979-8-3693-9586-8.ch008, 11 10
Ilić, J., Ivanović, M., & Milićević, A. K. (2024). The Impact of ChatGPT on Student Learning Experience in Higher STEM Education: A Systematic Literature Review. 21st International Conference on Information Technology Based Higher Education and Training (ITHET). Paris, France : IEEE, November
Jan, R. (2025). Examining the Reliability of ChatGPT: Identifying Retracted Scientific Literature and Ensuring Accurate Citations and References. In Impacts of Generative AI on the Future of Research and Education (pp. 367-392). IGI Global. https://doi.org/10.4018/979-8-3693-0884-4.ch014
Khandakar, H., Fazal, S. A., Afnan, K. F & ,.Hasan, K. K. (2024). Implications of artificial intelligence chatbot models in higher education. Int J Artif Intell ISSN, 2252(8938), 3809. https://doi.org/10.11591/ijai.v13.i4.pp3808-3813
Kristophorus, H., Felix, A., Aji, S., & Sandy, I. (2024). Chatbots Implementation for Students Admision. Journal of software engineering and simulation, 11(1), 44-52. https://doi.org/ 10.35629/3795-10114452
Mbwambo, N. M., & Kaaya, P. B. (2024). ChatGPT in education: Applications, concerns and recommendations. Journal of ICT Systems, 2(1), 107-124. https://doi.org/10.56279/jicts.v2i1.87
Ortiz-Garces, I., Govea, J., Andrade, R. O., & Villegas-Ch, W. (2024). Optimizing chatbot effectiveness through advanced syntactic analysis: A comprehensive study in natural language processing. Applied Sciences, 14(5), 1737. https://doi.org/10.3390/app14051737
Roldan‐Vasquez, E., Mitri, S., Bhasin, S., Bharani, T., Capasso, K., Haslinger, M., Sharma, R., & James, T. A. (2024). Reliability of artificial intelligence chatbot responses to frequently asked questions in breast surgical oncology. Journal of Surgical Oncology, 130(2), 188-203. https://doi.org/10.1002/jso.27715
Saifullah, S., Yawan, H., Syafitri, N., & Nurhaliza, S. (2024). INTEGRATING AI CHATBOT INTO LEARNING MANAGEMENT SYSTEM: ENHANCING STUDENT ENGAGEMENT AND LEARNING OUTCOMES. Dharmas Education Journal (DE_Journal), 5(2), 1346-1359. https://doi.org/10.56667/dejournal.v5i2.1605
Sandu, R., Gide, E., & Elkhodr, M. (2024). The role and impact of ChatGPT in educational practices: insights from an Australian higher education case study. Discover Education, 3(1), 71 .
Sedaghat, S. (2024). Plagiarism and wrong content as potential challenges of using chatbots like ChatGPT in medical research. Journal of Academic Ethics, 1-4 .https://doi.org/10.1007/s10805-024-09533-8
Segovia-García, N. (2024). Optimizing Student Support. A Review of the Use of AI Chatbots in Higher Education. European Public & Social Innovation Review, 9, 1-20 .
Tick, A. (2024). Exploring ChatGPT's Potential and Concerns in Higher Education. 2024 IEEE 22nd Jubilee international symposium on intelligent systems and informatics (SISY), 10.1109/SISY62279.2024.10737595
Uzoka, A., Cadet, E., & Ojukwu, P. (2024). Leveraging AI-Powered chatbots to enhance customer service efficiency and future opportunities in automated support. Computer Science & IT Research Journal. P-ISSN, 2709-0043 . https://doi.org/10.51594/csitrj.v5i10.1676
van Rensburg, H., & Reedy, N. (2024). ChatGPT in Higher Education: A Comprehensive Study of the. Proceedings of The 23rd European Conference on e-Learning, https://doi.org/10.34190/ecel.23.1.3126
Waduge, A. O., Kulasooriya, W. K. V. J. B., Ranasinghe, R. S. S., Ekanayake, I., Rathnayake, U., & Meddage, D. P. P. (2024). Navigating the Ethical Landscape of ChatGPT Integration in Scientific Research: Review of Challenges and Recommendations. Journal of Computational and Cognitive Engineering, 3(4), 360-372. https://doi.org/10.47852/bonviewJCCE42023238
Wangsa, K., Sandu, R., Karim, S., Elkhodr, M., & Gide, E. (2024). A Systematic Review and Analysis on the Potentials and Challenges of GenAI Chatbots in Higher Education. 2024 21st International Conference on Information Technology Based Higher Education and Training (ITHET), https://doi.org/10.3390/fi16070219
Williams, R. T. (2024). The ethical implications of using generative chatbots in higher education. Frontiers in Education, https://doi.org/10.3389/feduc.2023.1331607
Zafar, S., Shaheen, F., & Rehan, J. (2024). Use of ChatGPT and generative AI in higher education: opportunities, obstacles and impact on student performance. IRASD Journal of Educational Research, 5(1), 01-12 . https://doi.org/10.52131/jer.2024.v5i1.2463
Views:
155
Downloads:
111
Copyright (c) 2025 Nadia Tahmi, Nadia Brahimi, Mahdjouba Benchohra
This work is licensed under a Creative Commons Attribution 4.0 International License.
All articles are published in open-access and licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0). Hence, authors retain copyright to the content of the articles.
CC BY 4.0 License allows content to be copied, adapted, displayed, distributed, re-published or otherwise re-used for any purpose including for adaptation and commercial use provided the content is attributed.
