Designing a Teacher Recommender System: A Thematic Literature Review of Teacher Evaluation Systems
DOI:
https://doi.org/10.69569/jip.2025.513Keywords:
Recommender systems, Sentiment analysis, Student feedback, Teacher evaluation, Topic modelingAbstract
Teacher evaluation systems are limited in their ability to provide numerical ratings, often failing to analyze qualitative feedback to provide teachers with valuable insights to enhance performance. This paper conducts a thematic literature review of teacher evaluation systems and tools in articles in Google Scholar, IEEE, and Proquest databases between 2014 and 2024 to determine the most appropriate sentiment analysis (SA) and topic modeling (TM) algorithms for analyzing student feedback. The review of 48 articles found that a lexicon-based SA approach, specifically VADER with a customized Filipino lexicon, offers a robust and practical solution for sentiment detection in a multilingual context. For TM, Latent Dirichlet Allocation (LDA) with human intervention is the recommended approach, providing a balance between thematic granularity and computational feasibility. The efficacy and efficiency of both algorithms are found to improve by increasing the size of a domain-specific corpus of words. Based on these findings, the paper proposes the design of TeachAIRs. This teacher recommender system includes word cloud visualizations, sentiment scores per topic, and, most critically, actionable insights derived from the integrated analysis. The development of this system is highly recommended to provide teachers with valuable and constructive real-time feedback, ultimately enhancing teaching practices and improving student learning outcomes.
Downloads
References
Abiodun Ayeni, O., Mercy, A., et al (2020). Web-based student opinion mining system using sentiment analysis. International Journal of Information Engineering and Electronic Business, 12(5), 33–46. https://doi.org/10.5815/ijieeb.2020.05.04
Adinolfi, P., D’Avanzo, E., Lytras, M. D., Novo-Corti, I., & Picatoste, J. (2016). Sentiment analysis to evaluate teaching performance. International Journal of Knowledge Society Research, 7(4), 86–107. https://doi.org/10.4018/ijksr.2016100108
Ahmed, N., Khouro, M. A., Khan, A., Dawood, M., Dootio, M. A., & Jan, N. U. (2023). Student textual feedback sentiment analysis using machine learning techniques to improve the quality of education. Pakistan Journal of Engineering, Technology & Science, 11(2), 32–40. https://doi.org/10.22555/pjets.v11i2.1039
Al Bashaireh, R., Sabeeh, V., & Zohdy, M. (2019). Towards a new indicator for evaluating universities based on twitter sentiment analysis. Proceedings - 6th Annual Conference on Computational Science and Computational Intelligence, CSCI 2019, 1398–1404. https://doi.org/10.1109/CSCI49370.2019.00261
Ali Kandhro, I., Ameen Chhajro, M., Kumar, K., Lashari, H. N., & Khan, U. (2019). Student feedback sentiment analysis model using various machine learning schemes: A review. Indian Journal of Science and Technology, 14(12), 1–9. https://doi.org/10.17485/ijst/2019/v12i14/143243
Altrabsheh, N., Cocea, M., & Fallahkhair, S. (2014). Sentiment analysis: Towards a tool for analysing real-time students feedback. Proceedings - International Conference on Tools with Artificial Intelligence, ICTAI, 2014-December, 419–423. https://doi.org/10.1109/ICTAI.2014.70
Andrewson, S., Mason, J., & Joel, R. (2023). Leveraging NLP for personalized learning: Adaptive feedback systems in higher education. https://www.researchgate.net/publication/391319413
Aung, K. Z., & Myo, N. N. (2017). Sentiment analysis of students’ comment using lexicon based approach. Proceedings - 16th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2017. https://doi.org/10.1109/ICIS.2017.7959985
Balahadia, F. F., Fernando, M. C. G., & Juanatas, I. C. (2016). Teacher’s performance evaluation tool using opinion mining with sentiment analysis. Proceedings - 2016 IEEE Region 10 Symposium, TENSYMP 2016, 95–98. https://doi.org/10.1109/TENCONSpring.2016.7519384
Bhana, V. M. (2014). Interpersonal skills development in generation y student nurses: A literature review. In Nurse Education Today (Vol. 34, Issue 12, pp. 1430–1434). Churchill Livingstone. https://doi.org/10.1016/j.nedt.2014.05.002
Bhowmik, A., Mohd Noor, N., Saef Ullah Miah, M., Mazid-Ul-Haque, M., & Karmaker, D. (2023). A comprehensive data set for aspect-based sentiment analysis in evaluating teacher performance. AIUB Journal of Science and Engineering, 22(2), 200–213. https://doi.org/10.53799/AJSE.V22I2.862
Bhowmik, A., Nur, N. M., Saef, M., Miah, U., & Karmekar, D. (2023). Aspect-based sentiment analysis model for evaluating teachers’ performance from students’ feedback. AIUB Journal of Science and Engineering, 22(3), 287–294. https://doi.org/10.53799/ajse.v22i3.921
Borromeo, R. M., & Toyama, M. (2015). Automatic vs. crowdsourced sentiment analysis. ACM International Conference Proceeding Series, 0(CONFCODENUMBER), 90–95. https://doi.org/10.1145/2790755.2790761
Chakravarthy, V. J., Kameswari, M., Mydeen, H. D., & Seenivasan, M. (2021). Opinion mining from student text review for choosing better online courses. IOP Conference Series: Materials Science and Engineering, 1070(1), 012067. https://doi.org/10.1088/1757-899x/1070/1/012067
Clarizia, F., Colace, F., De Santo, M., Lombardi, M., Pascale, F., & Pietrosanto, A. (2018). E-learning and sentiment analysis: A case study. ACM International Conference Proceeding Series, 111–118. https://doi.org/10.1145/3178158.3178181
Creswell, J. W., & David Creswell, J. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Sage Publications, Inc. https://tinyurl.com/mryt9hvm
Dake, D. K., & Gyimah, E. (2023). Using sentiment analysis to evaluate qualitative students’ responses. Education and Information Technologies, 28(4), 4629–4647. https://doi.org/10.1007/s10639-022-11349-1
Das, S., Roy, S., Bose, R., Acharjya, P. P., & Mondal, H. (2022). Analysis of student sentiment dynamics to evaluate teachers performance in online course using machine learning. 2022 International Conference on Applied Artificial Intelligence and Computing (ICAAIC), 668–673. https://doi.org/10.1109/ICAAIC53929.2022.9792958
Edalati, M., Imran, A. S., Kastrati, Z., & Daudpota, S. M. (2022). The potential of machine learning algorithms for sentiment classification of students’ feedback on MOOCs. Lecture Notes in Networks and Systems, 296, 11–22. https://doi.org/10.1007/978-3-030-82199-9_2
Faizi, R. (2023). Using sentiment analysis to explore student feedback: A lexical approach. International Journal of Emerging Technologies in Learning, 18(9), 259–267. https://doi.org/10.3991/ijet.v18i09.38101
Fargues, M., Kadry, S., Lawal, I. A., Yassine, S., & Rauf, H. T. (2023). Automated analysis of open-ended students’ feedback using sentiment, emotion, and cognition classifications. Applied Sciences (Switzerland), 13(4). https://doi.org/10.3390/app13042061
Fernández, M. P., & Martínez, J. F. (2022). Evaluating teacher performance and teaching effectiveness: Conceptual and methodological considerations. https://doi.org/10.1007/978-3-031-13639-9_3
Gencoglu, B., Helms-Lorenz, M., Maulana, R., Jansen, E. P. W. A., & Gencoglu, O. (2023). Machine and expert judgments of student perceptions of teaching behavior in secondary education: Added value of topic modeling with big data. Computers and Education, 193. https://doi.org/10.1016/j.compedu.2022.104682
Gottipati, S., Shankararaman, V., & Lin, J. R. (2018). Latent dirichlet allocation for textual student feedback analysis. ICCE 2018 - 26th International Conference on Computers in Education, Main Conference Proceedings, 220–227. https://ink.library.smu.edu.sg/sis_research/4215
Gunasekaran, K. P. (2023). Exploring sentiment analysis techniques in natural language processing: A comprehensive review. https://doi.org/10.48550/arXiv.2305.14842
Hariyani, C. A., Hidayanto, A. N., Fitriah, N., Abidin, Z., & Wati, T. (2019). Mining student feedback to improve the quality of higher education through multi-label classification, sentiment analysis, and trend topic. 2019 4th International Conference on Information Technology, Information Systems and Electrical Engineering, ICITISEE 2019. https://doi.org/10.1109/ICITISEE48480.2019.9003818
Hashim, S., Omar, M. K., Jalil, H. A., & Sharef, N. M. (2022). Trends on technologies and artificial intelligence in education for personalized learning: Systematic literature review. International Journal of Academic Research in Progressive Education and Development, 11(1). https://doi.org/10.6007/IJARPED/v11-i1/12230
Hayat, F., Shatnawi, S., & Haig, E. (2024). Comparative analysis of topic modelling approaches on student feedback. International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, IC3K - Proceedings, 1, 226–233. https://doi.org/10.5220/0012890400003838
Hixson, T. (2019). Reactions vs. reality: Using sentiment analysis to measure university students’ responses to learning ArcGIS. Journal of Map and Geography Libraries, 15(2–3), 263–276. https://doi.org/10.1080/15420353.2020.1719266
Hujala, M., Knutas, A., Hynninen, T., & Arminen, H. (2020). Improving the quality of teaching by utilizing written student feedback: A streamlined process. Computers & Education, 157, 103965. https://doi.org/10.1016/J.COMPEDU.2020.103965
Ishmael, O., Kiely, E., Quigley, C., & McGinty, D. (2023). Topic modelling using latent dirichlet allocation (LDA) and analysis of students sentiments. 2023 20th International Joint Conference on Computer Science and Software Engineering (JCSSE), 1–6. https://doi.org/10.1109/JCSSE58229.2023.10201965
Kandhro, I. A., Wagan, A. A., Kumar, K., & Shaikh, Z. U. (2023). An efficient LSTM based cross domain aspect based sentiment analysis (CD-ABSA). Mehran University Research Journal of Engineering and Technology, 42(3), 89. https://doi.org/10.22581/muet1982.2303.10
Kandhro, I. A., Wasi, S., Kumar, K., Rind, M., & Ameen, M. (2019). Sentiment analysis of students comment by using long-short term model. Indian Journal of Science and Technology, 12(8), 1–16. https://doi.org/10.17485/ijst/2019/v12i8/141741
Karunya, K., Aarthy, S., Karthika, R., & Jegatha Deborah, L. (2020). Analysis of student feedback and recommendation to tutors. Proceedings of the 2020 IEEE International Conference on Communication and Signal Processing, ICCSP 2020. https://doi.org/10.1109/ICCSP48568.2020.9182270
Kaur, W., Balakrishnan, V., & Singh, B. (2020). Improving teaching and learning experience in engineering education using sentiment analysis techniques. IOP Conference Series: Materials Science and Engineering, 834(1). https://doi.org/10.1088/1757-899X/834/1/012026
Kim, C. M., & Kwak, E. C. (2022). An exploration of a reflective evaluation tool for the teaching competency of pre-service physical education teachers in Korea. Sustainability (Switzerland), 14(13). https://doi.org/10.3390/su14138195
Kim, H., & Qin, G. (2023). Summarizing students’ free responses for an introductory algebra-based physics course survey using cluster and sentiment analysis. IEEE Access, 11, 89052–89066. https://doi.org/10.1109/ACCESS.2023.3305260
Koufakou, A. (2024). Deep learning for opinion mining and topic classification of course reviews. Education and Information Technologies, 29(3), 2973–2997. https://doi.org/10.1007/s10639-023-117362
Kumar, A., & Jain, R. (2016). Sentiment analysis and feedback evaluation. Proceedings of the 2015 IEEE 3rd International Conference on MOOCs, Innovation and Technology in Education, MITE 2015. https://doi.org/10.1109/MITE.2015.7375359
Lalata, J. A. P., Gerardo, B., & Medina, R. (2019). A sentiment analysis model for faculty comment evaluation using ensemble machine learning algorithms. ACM International Conference Proceeding Series, 68–73. https://doi.org/10.1145/3341620.3341638
Latika Tamrakar, M., Shrivastava, P., & Ghosh, S. M. (2021). An analytical study of feature extraction techniques for student sentiment analysis. In Turkish Journal of Computer and Mathematics Education (Vol. 12, Issue 11). https://doi.org/10.1007/978-3-030-80216-5_20
Lin, F., Li, C., Lim, R. W. Y., & Lee, Y. H. (2025). Empower instructors with actionable insights: Mine and visualize student written feedback for instructors’ reflection. Computers and Education: Artificial Intelligence, 8. https://doi.org/10.1016/j.caeai.2025.100389
Lin, F., Li, C., Wei, R., Lim, Y., Yew, & Lee, H. (2024). Developing a feedback analytic tool to support instructor reflection. https://doi.org/10.58459/icce.2024.4859
Looney, J. (2011). Developing high-quality teachers: Teacher evaluation for improvemente jed_1492 440..455. http://dx.doi.org/10.2307/41343393
Malebary, S. J., & Abulfaraj, A. W. (2024). A stacking ensemble based on lexicon and machine learning methods for the sentiment analysis of tweets. Mathematics, 12(21). https://doi.org/10.3390/math12213405
Mamidted, A. D., & Maulana, S. S. (2023). The teaching performance of the teachers in online classes: A sentiment analysis of the students in a state university in the Philippines. Randwick International of Education and Linguistics Science Journal, 4(1), 86–95. https://doi.org/10.47175/rielsj.v4i1.639
Melba Rosalind, J., & Suguna, S. (2022). Predicting students’ satisfaction towards online courses using aspect-based sentiment analysis. 20–35. https://doi.org/10.1007/978-3-031-11633-9_3ï
Nandakumar, R., Pallavi, M. S., Pramath, P. H., & Hegde, V. (2022). Sentimental analysis on student feedback using NLP & POS tagging. International Conference on Edge Computing and Applications, ICECAA 2022 - Proceedings, 309–313. https://doi.org/10.1109/ICECAA55415.2022.9936569
Nasim, Z., Rajput, Q., & Haider, S. (2017). Sentiment analysis of student feedback using machine learning and lexicon based approaches. International Conference on Research and Innovation in Information Systems, ICRIIS. https://doi.org/10.1109/ICRIIS.2017.8002475
Nawaz, R., Sun, Q., Shardlow, M., Kontonatsios, G., Aljohani, N. R., Visvizi, A., & Hassan, S. U. (2022). Leveraging AI and machine learning for national student survey: Actionable insights from textual feedback to enhance quality of teaching and learning in UK’s higher education. Applied Sciences (Switzerland), 12(1). https://doi.org/10.3390/app12010514
Neumann, M., & Linzmayer, R. (2021). Capturing student feedback and emotions in large computing courses: A sentiment analysis approach. SIGCSE 2021 - Proceedings of the 52nd ACM Technical Symposium on Computer Science Education, 541–547. https://doi.org/10.1145/3408877.3432403
Omran, T., Sharef, B. T., Hadjar, K., & Subramanian, S. (2020). Machine learning for improving teaching methods through sentiment analysis. Applied Mathematics and Information Sciences, 14(2), 309–317. https://doi.org/10.18576/amis/140215
Onan, A. (2020). Mining opinions from instructor evaluation reviews: A deep learning approach. Computer Applications in Engineering Education, 28(1), 117–138. https://doi.org/10.1002/cae.22179
Moreno-Marcos, P. M., Alario-Hoyos, C., Muñoz-Merino,P. J., Estévez-Ayres, I., & Kloos, C. D. (2018). Sentiment analysis in MOOCs: A case study. 2018 IEEE Global Engineering Education Conference (EDUCON), 1489–1496. https://doi.org/doi:10.1109/EDUCON.2018.8363409.
Papay, J. P. (2012). Refocusing the debate: Assessing the purposes and tools of teacher evaluation. In Harvard Educational Review (Vol. 82, Issue 1). https://doi.org/10.17763/haer.82.1.v40p0833345w6384
Peña-Torres, J. A. (2024). Towards an improved of teaching practice using sentiment analysis in student evaluation. Ingeniería y Competitividad, 26(2). https://doi.org/10.25100/iyc.v26i2.13759
Pramod, D., Vijayakumar Bharathi, S., & Raman, R. (2022). Faculty effectiveness prediction using machine learning and text analytics. 2022 IEEE Technology and Engineering Management Conference (TEMSCON EUROPE), 40–47. https://doi.org/10.1109/TEMSCONEUROPE54743.2022.9801997
Praveenkumar, T., Manorselvi, A., & Soundarapandiyan, K. (2020). Exploring the students feelings and emotion towards online teaching: Sentimental analysis approach. 137–146. https://doi.org/10.1007/978-3
Pyasi, S., Gottipati, S., & Shankararaman, V. (2018). SUFAT - An analytics tool for gaining insights from student feedback comments. 1–9. https://doi.org/10.1109/FIE.2018.8658457
Pyasi, S., Gottipati, S., & Shankararaman, V. (2019). SUFAT - An analytics tool for gaining insights from student feedback comments. Proceedings - Frontiers in Education Conference, FIE, 2018-October. https://doi.org/10.1109/FIE.2018.8658457
Qu, W., & Zhang, Z. (2020). An application of aspect-based sentiment analysis on teaching evaluation. 89–104. https://doi.org/10.35566/isdsa2019c6
Rafiq, S., Afzal, A., & Kamran, F. (2022). Exploring the problems in teacher evaluation process and its perceived impact on teacher performance. Gomal University Journal of Research, 38(04), 482–500. https://doi.org/10.51380/gujr-38-04-08
Rajput, Q., Haider, S., & Ghani, S. (2016). Lexicon-based sentiment analysis of teachers’ evaluation. Applied Computational Intelligence and Soft Computing, 2016, 1–12. https://doi.org/10.1155/2016/2385429
Rakhmanov, O. (2020). A comparative study on vectorization and classification techniques in sentiment analysis to classify student-lecturer comments. Procedia Computer Science, 178, 194–204. https://doi.org/10.1016/j.procs.2020.11.021
Ren, P., Yang, L., & Luo, F. (2023). Automatic scoring of student feedback for teaching evaluation based on aspect-level sentiment analysis. Education and Information Technologies, 28(1). https://doi.org/10.1007/s10639-022-11151-z
Katragadda, S., Ravi, V., Kumar, P., & Lakshmi, G. J. (2020). Performance analysis on student feedback using machine learning algorithms. 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS), 1161–1163. https://doi.org/doi:10.1109/ICACCS48705.2020.9074334
Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021). The impact of artificial intelligence on learner–instructor interaction in online learning. International Journal of Educational Technology in Higher Education, 18(1). https://doi.org/doi.org/10.1186/s41239-021-00292-9
Sindhu, I., Muhammad Daudpota, S., Badar, K., Bakhtyar, M., Baber, J., & Nurunnabi, M. (2019). Aspect-based opinion mining on student’s feedback for faculty teaching performance evaluation. IEEE Access, 7, 108729–108741. https://doi.org/10.1109/ACCESS.2019.2928872
Sivakumar, M., & Reddy, U. S. (2018). Aspect based sentiment analysis of students opinion using machine learning techniques. Proceedings of the International Conference on Inventive Computing and Informatics, ICICI 2017, 726–731. https://doi.org/10.1109/ICICI.2017.8365231
Sun, J., & Yan, L. (2023). Using topic modeling to understand comments in student evaluations of teaching. Discover Education, 2(1). https://doi.org/10.1007/s44217-023-00051-0
Sunar, A. S., & Khalid, M. S. (2024). Natural language processing of student’s feedback to instructors: A systematic review. IEEE Transactions on Learning Technologies, 17, 741–753. https://doi.org/10.1109/TLT.2023.3330531
Sutoyo, E., Almaarif, A., & Yanto, I. T. R. (2021). Sentiment analysis of student evaluations of teaching using deep learning approach. Lecture Notes in Networks and Systems, 254, 272–281. https://doi.org/10.1007/978-3-030-80216-5_20
Tian, X., Tang, S., Zhu, H., & Xia, D. (2022). Real‐time sentiment analysis of students based on mini‐xception architecture for wisdom classroom. Concurrency and Computation: Practice and Experience, 34(21). https://doi.org/https://doi.org/10.1002/cpe.7059
Tzacheva, A., & Easwaran, A. (2021). Emotion detection and opinion mining from student comments for teaching innovation assessment. International Journal of Education (IJE), 09(02), 21–32. https://doi.org/10.5121/IJE2021.9203
Unankard, S., & Nadee, W. (2020). Topic detection for online course feedback using LDA. Emerging Technologies for Education. SETE 2019. Lecture Notes in Computer Science, 11984, 133–144. https://doi.org/10.1007/978-3-030-38778-5_16
Wang, J. (2025). The impact of AI teaching on teaching quality. International Journal of Web-Based Learning and Teaching Technologies, 20(1), 1–22. https://doi.org/10.4018/IJWLTT.376489
Wook, M., Razali, N. A. M., Ramli, S., Wahab, N. A., Hasbullah, N. A., Zainudin, N. M., & Talib, M. L. (2020). Opinion mining technique for developing student feedback analysis system using lexicon-based approach (OMFeedback). Education and Information Technologies, 25(4), 2549–2560. https://doi.org/10.1007/s10639-019-10073-7
Zayed Alatwah, S. (2022). Using sentiment analysis to evaluate first-year engineering students teamwork textual feedback. 2022 ASEE Annual Conference & Exposition. https://doi.org/10.18260/1-2--41460
Zeng, J., Luo, K., Lu, Y., & Wang, M. (2023). An evaluation framework for online courses based on sentiment analysis using machine learning. International Journal of Emerging Technologies in Learning, 18(18), 4–22. https://doi.org/10.3991/ijet.v18i18.42521
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Journal of Interdisciplinary Perspectives
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
