Identifying and explaining the components of evaluating the quality of educational services in universities

Document Type : .

Authors

1 Ph.D. student of Higher Education Management, North Tehran Branch, Islamic Azad University, Tehran, Iran

2 Assistant Professor, Department of Educational Sciences, North Tehran Branch, Islamic Azad University, Tehran, Iran

3 Professor of Cultural Planning and Management Department, North Tehran Branch, Islamic Azad University, Tehran, Iran

Abstract

Quality in higher education is not about reaching a static point but rather a dynamic movement and flow. The current research aims to investigate and explain the effective components in evaluating the quality of education in universities. The research method is applied in nature and descriptive-survey in methodology. The data collection tool for the qualitative part was content analysis using Atlas.ti software, extraction of indicators, and the Delphi method. The statistical population for the Delphi part included 18 faculty members selected through a non-probability (snowball) and theoretical saturation method, and for the quantitative part, 92 faculty members and 357 students from the Islamic Azad University were selected using simple random sampling and Morgan’s table. Data were collected using a researcher-made questionnaire. Descriptive and inferential statistics and SPSS 26 software were used in data analysis. Organizational structure, faculty, students, educational courses, teaching-learning strategies, and equipment and facilities comprised 71 indicators and 29 criteria, among which faculty members had the highest priority. The results indicated a relatively desirable quality of education at the Islamic Azad University, with only a small gap remaining to reach an optimal state. 
Keywords: Evaluation, Quality, Educational Quality, Islamic Azad University, Delphi Method.
Introduction: The main goal is to identify and explain the components for evaluating the quality of educational services at the Islamic Azad University and to offer suggestions for improving the quality of educational services at the university and educational institution level. The following questions were raised based on this objective:

What are the factors, criteria, and indicators for evaluating the quality of educational services?
What is the current state of the quality of educational services at the Islamic Azad University based on the determined factors, criteria, and indicators, and what suggestions can be made to improve the quality of educational services at the university?

Materials and Methods: The current research method is applied in terms of purpose and mixed with an exploratory approach in terms of research method. The research method was qualitative and quantitative, where initially, for the implementation of the quality evaluation of educational services at the university, all data, information, theoretical foundations, regulations, instructions, and executive circulars of the Islamic Azad University regarding educational and research activities, as well as the research background in Iran and other countries, were collected and reviewed using the library study method. Subsequently, the components were presented to experts and faculty members using the Delphi method, and after two rounds of the Delphi stage, questionnaires were developed and made available to faculty members and students to depict the current situation. After data collection and analysis, findings were obtained, and then a comparison was made between the current and desired states of the university’s educational activities, and necessary suggestions were provided for improving the quality of education at the university to achieve the requirements for judging the desired state.
In the qualitative section, 18 members of the academic staff from both public and private universities in Tehran (experts specialized in higher education) were selected using a non-probabilistic snowball sampling method. Data collection tools (indicators) included document review and theoretical frameworks through content analysis and the use of Atlas.ti software. After extracting indicators, some were merged (open and axial coding) and validated through the Delphi method.
 To maintain and ensure this section’s reliability, two rounds of the Delphi method and the Kappa coefficient were used. A Kappa coefficient of 0.743 percent was obtained by comparing the responses of two experts in the Delphi section, indicating a good level of credibility.
For the quantitative section, according to Morgan’s table, 92 full-time faculty members employed at Islamic Azad University with contractual, probationary, and permanent employment statuses, and 357 students from Islamic Azad University were selected using simple random sampling based on Cochran’s method. A researcher-developed questionnaire was used for data collection. The questionnaires’ validity was ensured through theoretical saturation by higher education expert professors, and reliability was estimated using Cronbach’s alpha coefficient (faculty members’ questionnaire 0.93 percent and students’ questionnaire 0.82 percent).
Discussion and Results: The results indicated that accountability, defined goals and missions, teaching patterns and methods of the academic staff, services and facilities provided to instructors and students, the teaching-learning process, organizational structure, regulations and rules, budget, and equipment are important components in assessing the quality of university services at Islamic Azad University. Based on the findings, the current quality of education at Islamic Azad University is close to desirable, with only a small gap remaining to reach the optimal state.
Conclusion: Regarding question (1): In the first phase, factors, criteria, and indicators were extracted through library studies and note-taking methods, followed by expert opinions gathered via a questionnaire in two rounds using the Delphi technique. Ultimately, in the second Delphi iteration, 71 indicators were identified under 29 criteria and 6 factors. Question (2): Considering the necessity of evaluating the quality of educational services at Islamic Azad University, the results based on the determined factors, criteria, and indicators show that the current state in the faculties is relatively satisfactory in 3 factors (organizational structure factors (organization and management), faculty, and students) and satisfactory in 3 factors (educational courses, curricula, teaching-learning strategies, and educational and research facilities and equipment). The most important issue in identifying and explaining the components of educational service quality evaluation at the university is to examine the current situation, articulate issues and problems, and identify strengths in addressing existing deficiencies and enhancing strengths. Given the results obtained, the evaluated factors differ from the desired state and the mission and objectives of the university, which has been more significant in some criteria. Therefore, educational groups should aim to improve quality and achieve a desirable and ideal future in line with the set goals and missions, with the assistance and cooperation of all university members, to ultimately enhance the quality of educational services at the university and reduce the gap between the current and desired states

Keywords

Main Subjects


Aghaei, Mirhossein; Roshanzadeh, Mostafa; Tajabadi, Ali (2018). “Comparison of the Educational System and Curriculum of Master’s Degree in Pediatric Nursing in Iran and Canada,” Research in Medical Education Sciences, Volume 10, Issue 4, Pages 61-69. [in Persian]
Eskandari, Ahmadreza; Irannejad, Parisa; Mohammadi, Reza; Salimi, Mahtab; Jahanian, Ramezan (2021). “Design and Presentation of a Validation Model at the Educational Group Level (Case Study: Educational Groups of Higher Education Management and Educational Management at Islamic Azad University)” Educational Measurement and Evaluation Studies. Volume 11, Issue 33, Pages 46-68. [in Persian]
Baninsadi, Nazanin; Eshaghi, Fakhteh; Mohammadi, Reza (2015). “Internal Quality Assessment in the Business Management Educational Group at Islamic Azad University,” Behavioral Studies in Management Quarterly, Volume 6, Issue 11, Pages 13-33. [in Persian]
Paripour, Azam; Sarmadi, Mohammadreza; Nateghi, Faezeh; Mohammadinaeini, Mozhgan (2020). “Presenting a Quality Evaluation Model for Blended Learning in Higher Education Based on CIPP Evaluation Approach,” Research in Educational Systems Quarterly, Volume 14, Issue 51, Pages 7-22. [in Persian]
Dadras, Mohammad; Khoran, Zahra; Yousefi Afrashteh, Majid; Faraji Dehsorkhi, Hatem (2017). “Evaluation of University Service Quality from the Students’ Perspective: A Comparison of Engineering Faculties at a Comprehensive University and a Technical University in Tehran,” Iranian Engineering Education Quarterly, Volume 19, Issue 7, Pages 129-149. [in Persian]
Roudgarnajad, Kia Kajouri; Taheri (2019). “The Role of Islamic Azad University in Educational, Cultural, Social, and Economic Affairs of Women,” Women and Culture Scientific-Research Quarterly, Volume 3, Issue 9, Pages 33-44. [in Persian]
Zamani, Asghar (2017). “Identification, Analysis, and Prioritization of Factors Affecting Educational Quality in Higher Education,” Innovation and Value Creation Quarterly, Volume 6, Issue 11, Pages 23-35. [in Persian]
Zamanian, Sahar; Kalantari Dehaghi, Hanieh; Khakpour, Abbas; Mohammadi, Reza (2020). “Application of Internal Evaluation for Improving the Quality of Educational Groups (Case Study: Educational Sciences Group at Malayer University),” Higher Education Letter, Volume 13, Issue 52, Pages 35-69. [in Persian]
Seif, Ali Akbar (2018). Modern Educational Psychology. Tehran: Doran Publications. Volume 11, Issue 7. [in Persian]
Khadem-Mohtaram, Khalil; Salimi, Mahtab (2019). “Evaluation and Quality Assurance in Higher Education System,” Bi-monthly Scientific-Research Applied Studies in Management and Development Sciences, Volume 4, Issue 1, Pages 47-62. [in Persian]
Safaei, Maryam (2020). “Presenting a Model for Enhancing Nursing Education Evaluation in Units of Islamic Azad University,” Doctoral Dissertation, Iran University of Medical Sciences. [in Persian]
Talebi, Fahimeh; Hosseinali, Jahed and Sarikhani, Nahid (2021). Components and Indicators of Research Quality Improvement in the Iranian Higher Education System, Public Policy Management Quarterly, Issue 41, pp. 148-163.
 Lotfipoursabzevari, Peyman; Ghourchian, Nadergholi; Arasteh, Hamidreza and Siyari, Habibollah (2019). Proposing a Model for Evaluating Imam Khomeini Naval Sciences University, Marine Sciences Education Journal, Vol. 6 (1), pp. 31-12. [in Persian]
 Alibeygi, Amirhossein; Barani, Shahrzad and Karamidehkordi, Mehdi (2019). Designing and Developing a Comprehensive Model for Faculty Teaching Quality Assessment: A Case Study of Razi University, Research in Curriculum Planning Quarterly (Science and Research in Educational Sciences - Curriculum Planning), Vol. 16(36), pp. 34-21. [in Persian]
Gholamzadeh, Hojjat; Shahi, Sakineh; Farhadirad, Hamid and Razavi, Seyyed Abbas (2019). Presenting a Model for Internal Evaluation of Academic Departments in Iranian Public Universities with a Metaevaluation Approach, Scientific – Educational Marine Sciences Quarterly, Issue 19, pp. 67-52. [in Persian]
Mohammadi, Reza; Amin Bidokhti, Ali Akbar. Rahimi, Mohsen (2018). Designing a Quality Assurance Model for Entrepreneurial University in the Iranian University System. Educational Measurement and Evaluation Studies Quarterly, Vol. 8, No. 22. [in Persian]
Mohammadi, Reza and Eshaghi, Fakhteh (2019). Emphasizing Evaluation and Accreditation of Quality in the Iranian Higher Education System in Line with Higher-Level Documents (Actions, Challenges, and Strategies), Raheyaft Journal, Issue 79, pp. 27-13. [in Persian]
Mohammadi, Reza; Fathabadi, Jalil and Yadegarzadeh, Gholamreza (2016). Quality Evaluation in Higher Education (Concepts, Principles, Methods, and Criteria), Tehran, National Organization of Educational Testing. [in Persian]
Moazami, Mojtaba; Mohammadkhani, Kamran; Delavar, Ali and Mohammaddavoudi, Amirhossein (2018). Identifying the Dimensions and Components of Educational Quality Improvement in Sama Technical and Vocational Colleges of Islamic Azad University and Determining the Share of Each, New Approach in Educational Management Quarterly, Vol. 9 (1), pp. 125-105. [in Persian]
Nasirianthamarin, Karim; Samari, Isa; Namvar, Yousef; Soleymani, Touran (2019). Designing a Model for Educational Quality Evaluation at Technical and Vocational University Using a Mixed Method. New Thoughts on Education Quarterly, Vol. 15(3), pp. 229-199. [in Persian]
Hemmati, Zeinab; Irajpour, Alireza; Allahbakhshian, Maryam; Varzeshnejad, Maryam and Abdi Shahshahan, Mahshid (2018). Evaluation of the Master’s Degree in Neonatal Intensive Care Nursing Based on the CIPP Model at Isfahan University of Medical Sciences, Iranian Journal of Medical Education, Vol. 8 (36), pp. 332-324. [in Persian]
Alzafari, K., & Ursin, J. (2019). Implementation of quality assurance standards in European higher education: does context matter?. Quality in Higher Education, 25(1), 58-75.
Anikin, I. Y., Lapteva, S. V., & Kozlov, A. V. (2021). Methods For Evaluation Of The Education Quality In Higher Education Institutions. Journal of Contemporary Issues in Business and Government, 27(1), 1333-1343.
Kayyali, M. (2023). An Overview of Quality Assurance in Higher Education: Concepts and Frameworks. International Journal of Management, Sciences, Innovation, and Technology IJMSIT  Review Paper.  Vol.4, Issue.2, pp.01-04.
Dicker,R., Garcia, M., Kelly, A., & Mulrooney, H.(2018). What does ‘quality’ in higher education mean? Perceptions of staff, students and employers. Studies in Higher Education, 3(12), 144-154.
Dwaikat, N. Y. (2021). A comprehensive model for assessing the quality in higher education institutions. The TQM Journal, 33(4), 841-855.
Kalimullin, A. M., Khodyreva, E., & Koinova-Zoellner, J. (2016). Development of internal system of education quality assessment at a University. International Journal of Environmental and Science Education, 11(13), 6002-6013.
Khattab, F. (2018). Developing a service quality model for private higher education institutions in Lebanon. J. Mgt. Mkt. Review, 3(1), 24-33.
Kim, M. J., Lee, H., Kim, H. K., Ahn, Y. H., Kim, E., Yun, S. N., & Lee, K. J. (2010). Quality of faculty, students, curriculum and resources for nursing doctoral education in Korea: a focus group study. International Journal of Nursing Studies, 47(3), 295-306.
Kusumastuti, D., & Idrus, N. (2017). Nurturing quality of higher education through national ranking: a potential empowerment model for developing countries. Quality in Higher Education, 23(3), 230-248.
Pandey, S. R. (2023). Passion and Quest for Quality in Education. Journal of Social Work and Science Education, 4(3), 705-716.
Sarrico, C. S. (2022). Quality management, performance measurement and indicators in higher education institutions: between burden, inspiration and innovation. Quality in Higher Education, 28(1), 11-28.
Shalihin, R. R. (2023). Enhancing the Islamic education in Kurikulum Merdeka through international benchmarking: A transdisciplinary study. Tarbawi: Jurnal Keilmuan Manajemen Pendidikan, 9 (10), 1-16.
Vykydal, D., Folta, M., & Nenadál, J. (2020). A study of quality assessment in higher education within the context of sustainable development: A case study from Czech Republic. Sustainability, 12(11), 4769.