Self-regulation system of continual improvement of quality and efficiency in higher education: A case of Ukraine
-
Author(s)Oleksandr VelychkoLink to ORCID Index: http://orcid.org/0000-0003-2700-0329
,
Svitlana KhalaturLink to ORCID Index: https://orcid.org/0000-0001-8331-3341
,
Nataliia BondarchukLink to ORCID Index: https://orcid.org/0000-0002-0418-5239
,
Mariia BahorkaLink to ORCID Index: https://orcid.org/0000-0002-8500-0362
-
DOIhttp://dx.doi.org/10.21511/kpm.06(1).2022.02
-
Article InfoVolume 6 2022, Issue #1, pp. 11-26
- Cited by
- 667 Views
-
125 Downloads
This work is licensed under a
Creative Commons Attribution 4.0 International License
Nowadays, the procedures for stimulating the improvement of the quality of higher education in Ukraine are mainly based on periodic expert evaluations. Besides, existing metrics of university efficiency are usually imperfect due to the frequent negative effects of Campbell’s Law and Goodhart’s Law. In addition, the war significantly limited resources for external quality assurance of educational programs. Given this, the aim of this paper was to develop a methodology for an additional self-regulation system of continual improvement of the quality and efficiency of educational activities of Ukrainian universities. The study is based on the advantages of the quantitative approach, measurement methods, and algorithmization in the management system of higher education. As a result, key indicators for the formation of national rankings have been developed by different segments. Moreover, the study elaborated algorithms and mechanisms to constantly encourage higher education institutions to improve quality and efficiency. The paper proposes preventive procedures to reduce the negative effects of unfair achievement of key performance indicators. The result of applying the methodology is additionally acquired or partially lost by the university the volume of license rights for the training of specialists in the current year. This will help curb the process of mass education with a low level of quality. In addition, the proposed system will balance the weaknesses of the accreditation expertise procedure, as well as actively stimulate the independent striving of each educational program for sustainable development and continual progress.
Acknowledgment
To the Armed Forces of Ukraine (https://www.mil.gov.ua/) and the democratic world (https://bit.ly/3BLtuem) for the protection of the future of the Ukrainian State and its people. To the National Agency for Higher Education Quality Assurance for the possibility to take part in accreditation expertise and consulting evaluation of educational programs in universities of Ukraine (https://en.naqa.gov.ua/). Also, the appearance of this alternative idea was facilitated by the declared goal of the World Bank project “Ukraine Improving Higher Education for Results” (ID P171050), namely: to improve the efficiency, conditions for quality, and transparency in Ukraine’s higher education system (https://bit.ly/3vpx2iM).
view full abstract
-
JEL Classification (Paper profile tab)I23, I28, M12
-
References55
-
Tables4
-
Figures3
-
- Figure 1. Strengths and weaknesses of metrics and expertise procedures in the process of assessing the quality of educational activities
- Figure 2. Main differences in the self-regulation and accreditation system of external assurance and improving the quality of higher education in Ukraine
- Figure 3. Ishikawa diagram with essential indicators of national rating in the higher education system of Ukraine
-
- Table 1. Position of conditional universities of Ukraine in the system of national rating assessment
- Table 2. Conversion of dynamics of rating positions of conditional institutions of higher education of Ukraine in the consolidated coefficient
- Table 3. Licensed volumes of admission to the specialties of the university No. 3 in the current year (bachelor’s level)
- Table 4. Licensed volumes of admission to the specialties of the university No. 4 in the current year (master’s level)
-
- Anderson, C. G., McQuaid, R. W., & Wood, A. M. (2022). The effect of journal metrics on academic resume assessment. Studies in Higher Education, 1-13.
- Barandiaran-Galdós, M., Barrenetxea-Ayesta, M., Cardona-Rodríguez, A., Mijangos-Del-Campo, J. J., & Olaskoaga-Larrauri, J. (2012). Attitudes of Spanish university teaching staff to quality in education. Journal of Higher Education Policy and Management, 34(6), 647-658.
- Bloch, R., Hartl, J., O’Connell, C., & O’Siochru, C. (2022). English and German academics’ perspectives on metrics in higher education: evaluating dimensions of fairness and organisational justice. Higher Education, 83(4), 765-785.
- Boshuizen, H. P., Gruber, H., & Strasser, J. (2020). Knowledge restructuring through case processing: The key to generalise expertise development theory across domains? Educational Research Review, 29, 100310.
- Botti, L., Duraccio, V., Gnoni, M. G., & Mora, C. (2018). An integrated holistic approach to health and safety in confined spaces. Journal of loss prevention in the process industries, 55, 25-35.
- Brandser, G. C. (2022). Humboldt revisited: The institutional drama of academic identity. The Impact of the German University on American Higher Education. New York: Berghahn Books.
- Brauweiler, H. C., & Zhakshylykov, Z. (2020). Analysis of Current Kyrgyz Higher Education Based on Lean Principles. In H. C. Brauweiler, V. Kurchenkov, S. Abilov, & B. Zirkler (Eds.), Digitalization and Industry 4.0: Economic and Societal Development (pp. 373-380). Springer Gabler, Wiesbaden.
- Byrnes, J. P. (1998). The nature and development of decision-making: A self-regulation model (1st ed.). New York: Psychology Press.
- Cabinet of Ministers of Ukraine (CMU). (2015). Litsenziini umovy provadzhennia osvitnoi diialnosti, zatverdzheni Postanovoiu Kabinetu Ministriv Ukrainy vid 30.12.2015 No. 1187 (v redaktsii postanovy Kabinetu Ministriv Ukrainy vid 10.05.2018 No. 347)) [Licensing conditions of educational activity, approved by the Decree of the Cabinet of Ministers of Ukraine as of December 30, 2015, No. 1187 (amended by the Decree of the Cabinet of Ministers of Ukraine as of May 10, 2018, No. 347)]. (In Ukrainian).
- Cabinet of Ministers of Ukraine (CMU). (2019). Pro rozpodil vydatkiv derzhavnoho biudzhetu mizh zakladamy vyshchoi osvity na osnovi pokaznykiv yikh osvitnoi, naukovoi ta mizhnarodnoi diialnosti, zatverdzhenо Postanovoiu Kabinetu Ministriv Ukrainy vid 24.12.2019 No. 1146 [On the distribution of state budget expenditures between higher education institutions on the basis of indicators of their educational, scientific and international activities, approved by the Resolution of the Cabinet of Ministers of Ukraine of December 24, 2019, No. 1146]. (In Ukrainian).
- Campbell, D. T. (1979). Assessing the impact of planned social change. Evaluation and Program Planning, 2(1), 67-90.
- Carvalho, R., Lobo, M., Oliveira, M., Oliveira, A. R., Lopes, F., Souza, J., Ramalho, A., Viana, J., Alonso, V., Caballero, I., Santos, J. V., & Freitas, A. (2021). Analysis of root causes of problems affecting the quality of hospital administrative data: A systematic review and Ishikawa diagram. International journal of medical informatics, 156, 104584.
- Case, B. (2013). “Notions” and “Things” in John Henry Newman’s Grammar of Assent. Newman Studies Journal, 10(1), 15-27.
- Chen, I. S., Chen, J. K., & Padro, F. F. (2017). Critical quality indicators of higher education. Total Quality Management & Business Excellence, 28(1-2), 130-146.
- Derfus, P. J., Maggitti, P. G., Grimm, C. M., & Smith, K. G. (2008). The Red Queen effect: Competitive actions and firm performance. Academy of Management Journal, 51(1), 61-80.
- El-Adl, A., & Alkharusi, H. (2020). Relationships between self-regulated learning strategies, learning motivation and mathematics achievement. Cypriot Journal of Educational Sciences, 15(1), 104-111.
- Elken, M., & Stensaker, B. (2018). Conceptualising ‘quality work’ in higher education. Quality in Higher Education, 24(3), 189-202.
- Elton, L. (2004). Goodhart’s Law and Performance Indicators in Higher Education. Evaluation & Research in Education, 18(1-2), 120-128.
- Ergen, B., & Kanadli, S. (2017). The effect of self-regulated learning strategies on academic achievement: A meta-analysis study. Eurasian Journal of Educational Research, 17(69), 55-74.
- Etzkowitz, H. (2016). The entrepreneurial university: vision and metrics. Industry and Higher Education, 30(2), 83-97.
- Fernandes, N., & Buchan, J. R. (2021). RNAs as Regulators of Cellular Matchmaking. Frontiers in molecular biosciences, 8, 634146.
- Green, J. A., Henderson, C., & Ruys, T. (2022). Russia’s attack on Ukraine and the jus ad bellum. Journal on the Use of Force and International Law, 9(1), 4-30.
- Gümüsay, A. A., & Amis, J. M. (2021). Contextual expertise and the development of organization and management theory. European Management Review, 18(1), 9-24.
- Gunn, A. (2018). Metrics and methodologies for measuring teaching quality in higher education: developing the Teaching Excellence Framework (TEF). Educational Review, 70(2), 129-148.
- Heffernan, T. A., & Heffernan, A. (2018). Language games: University responses to ranking metrics. Higher Education Quarterly, 72(1), 29-39.
- Kahan, D. M., Peters, E., Dawson, E. C., & Slovic, P. (2017). Motivated numeracy and enlightened self-government. Behavioural Public Policy, 1(1), 54-86.
- Khalatur, S., Kuprina, N., & Kurbatska, L. (2021). New business strategies formation of enterprises and outsourcing development as a condition for increasing competitiveness in the markets of Europe and Ukraine: comparative analysis. Baltic Journal of Economic Studies, 7(4), 203-213
- Khurniawan, A. W., Sailah, I., Muljono, P., Indriyanto, B., & Maarif, M. S. (2020). An Analysis of Implementing Total Quality Management in Education: Succes and Challenging Factors. International Journal of Learning and Development, 10(2), 44-59.
- Kulczycki, E., Rozkosz, E. A., Szadkowski, K., Ciereszko, K., Hołowiecki, M., & Krawczyk, F. (2021). Local use of metrics for the research assessment of academics: The case of Poland. Journal of Higher Education Policy and Management, 43(4), 435-453.
- Kumar, V., & Venkatesan, R. (2021). Transformation of Metrics and Analytics in Retailing: The Way Forward. Journal of Retailing, 97(4), 496-506.
- Lockett, A., Wright, M., & Wild, A. (2015). The institutionalization of third stream activities in UK higher education: The role of discourse and metrics. British Journal of Management, 26(1), 78-92.
- Maldonado, S., Miranda, J., Olaya, D., Vásquez, J., & Verbeke, W. (2021). Redefining profit metrics for boosting student retention in higher education. Decision Support Systems, 143, 113493.
- Manatos, M. J., Sarrico, C. S., & Rosa, M. J. (2017). The integration of quality management in higher education institutions: a systematic literature review. Total Quality Management & Business Excellence, 28(1-2), 159-175.
- Mihai, M., Lota, A., & Staiculescu, O. (2014). Opportunities for Optimizing the Cost of Quality. Annals of University of Craiova-Economic Sciences Series, 42(1), 203-210.
- Ministry of Education and Science of Ukraine. (2017). Polozhennia pro kryterii rozmishchennia derzhavnoho zamovlennia na pidhotovku mahistriv dlia vyshchykh navchalnykh zakladiv, yaki znakhodiatsia u sferi upravlinnia MON. Zatverdzheno nakazom Ministerstva osvity i nauky Ukrainy No. 858 vid 14.06.2017) [Regulations on the criteria for placing a state order for the training of masters for higher education institutions under the management of the Ministry of Education and Science. Approved by the order of the Ministry of Education and Science of Ukraine No. 858 dated June 14, 2017]. (In Ukrainian).
- Ministry of Education and Science of Ukraine. (2019). Polozhennia pro akredytatsiiu osvitnikh prohram, za yakymy zdiisniuietsia pidhotovka zdobuvachiv vyshchoi osvity. Zatverdzheno nakazom Ministerstva osvity i nauky Ukrainy No. 977 vid 11.07.2019) [Provisions for Accreditation of Educational Programs, which are used for preparation of higher education applicants. Approved by the Order of Ministry of Education and Science of Ukraine No. 977 as of July 11, 2019]. (In Ukrainian).
- Ministry of Education and Science of Ukraine. (2021). Pro zatverdzhennia prymirnoho pereliku tsilovykh pokaznykiv, shcho navodiatsia u kontrakti z kerivnykom derzhavnoho zakladu vyshchoi osvity. Zatverdzheno nakazom Ministerstva osvity i nauky Ukrainy No. 299 vid 05.03.2021) [About the statement of the approximate list of the target indicators described in the contract with the head of the state institution of higher education. Approved by the order of the Ministry of Education and Science of Ukraine No. 299 dated March 05, 2021]. (In Ukrainian).
- Nasim, K., Sikander, A., & Tian, X. (2020). Twenty years of research on total quality management in Higher Education: A systematic literature review. Higher Education Quarterly, 74(1), 75-97.
- Oravec, J. A. (2019). The “dark side” of academics? Emerging issues in the gaming and manipulation of metrics in higher education. The Review of Higher Education, 42(3), 859-877.
- Pan, W., & Sun, L. Y. (2018). A self-regulation model of Zhong Yong thinking and employee adaptive performance. Management and Organization Review, 14(1), 135-159.
- Pearce, A., & Pons, D. (2019). Advancing lean management: The missing quantitative approach. Operations Research Perspectives, 6, 100114.
- Peters, M. A. (2019). Global university rankings: Metrics, performance, governance. Educational Philosophy and Theory, 51(1), 5-13.
- Pimentel, L., & Major, M. (2016). Key success factors for quality management implementation: evidence from the public sector. Total Quality Management & Business Excellence, 27(9-10), 997-1012.
- Prescott, B. T. (2019). Recent trends in several key metrics in higher education. Change: The Magazine of Higher Learning, 51(1), 22-27.
- Roth, A. E. (2015). Who gets what--and why: the new economics of matchmaking and market design. Boston, New York: Houghton Mifflin Harcourt.
- Seeber, M., Cattaneo, M., Meoli, M., & Malighetti, P. (2019). Self-citations as strategic response to the use of metrics for career decisions. Research Policy, 48(2), 478-491.
- Servet, A. T. İ. K., & Çelik, O. T. (2021). Analysis of the relationships between academic motivation, engagement, burnout and academic achievement with structural equation modelling. International Journal of Contemporary Educational Research, 8(2), 118-130.
- Spence, C. (2019). ‘Judgement’ versus ‘metrics’ in higher education management. Higher Education, 77(5), 761-775.
- The Verkhovna Rada of Ukraine. (2010). Konventsiia pro zakhyst osib u zviazku z avtomatyzovanoiu obrobkoiu personalnykh danykh. Data nabuttia chynnosti v Ukraini – 2011 r. [Convention for the Protection of Individuals with regard to Automatic Processing of Personal Data (1981). Date of entry into force in Ukraine – 2011]. (In Ukrainian).
- The Verkhovna Rada of Ukraine. (2019). Zakon Ukrainy “Pro vyshchu osvitu” (zminy vid 18.12.2019 r.) [Law of Ukraine “On Higher Education” (changes from December 18, 2019)]. (In Ukrainian).
- Vasylieva, N., & James, H. (2021). The effect of urbanization on food security and agricultural sustainability. Economics and Sociology, 14(1), 76-88.
- Velychko, O. (2014). Development of infrastructural objects of providing logistics in the system of storing plant cultivation produce. Economic Annals-XXI, 1-2(1), 110-113.
- Velychko, O., Velychko, L., & Kharytonov, M. (2018). Managing Efficiency in Higher Education: A Case of Ukrainian Universities. Social Sciences, 7(8), 138-152.
- Vican, S., Friedman, A., & Andreasen, R. (2020). Metrics, Money, and Managerialism: Faculty Experiences of Competing Logics in Higher Education. The Journal of Higher Education, 91(1), 139-164.
- Williamson, B. (2019). Policy networks, performance metrics and platform markets: Charting the expanding data infrastructure of higher education. British Journal of Educational Technology, 50(6), 2794-2809.
Close
Knowledge and Performance Management