Розробка системи рейтингів для закладів вищої освіти України
A system of determination of university ranking in Ukraine was developed based on the creation of the corresponding methods adequate to the structure, peculiarities and conditions of the Ukrainian universities functioning. A complex of organizational and program-technical means was proposed for coll...
Збережено в:
| Дата: | 2019 |
|---|---|
| Автори: | , , , |
| Формат: | Стаття |
| Мова: | Англійська |
| Опубліковано: |
The National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute"
2019
|
| Онлайн доступ: | https://journal.iasa.kpi.ua/article/view/154652 |
| Теги: |
Додати тег
Немає тегів, Будьте першим, хто поставить тег для цього запису!
|
| Назва журналу: | System research and information technologies |
| Завантажити файл: |  |
Репозитарії
System research and information technologies| _version_ | 1866302295193419776 |
|---|---|
| author | Zgurovsky, M. Pankratova, N. Bobovkin, V. Linovitskaya, O. |
| author_facet | Zgurovsky, M. Pankratova, N. Bobovkin, V. Linovitskaya, O. |
| author_sort | Zgurovsky, M. |
| baseUrl_str | http://journal.iasa.kpi.ua/oai |
| collection | OJS |
| datestamp_date | 2019-01-18T15:10:28Z |
| description | A system of determination of university ranking in Ukraine was developed based on the creation of the corresponding methods adequate to the structure, peculiarities and conditions of the Ukrainian universities functioning. A complex of organizational and program-technical means was proposed for collection of the necessary data and determination of university rankings. For specialists in the field of higher education management, those seeking for higher education and employers. |
| first_indexed | 2025-07-17T10:24:20Z |
| format | Article |
| fulltext |
© M. Zgurovsky, N. Pankratova, V. Bobovkin, O. Linovitskaya, 2006
Системні дослідження та інформаційні технології, 2006, № 4 7
TIДC
ТЕОРЕТИЧНІ ТА ПРИКЛАДНІ ПРОБЛЕМИ І
МЕТОДИ СИСТЕМНОГО АНАЛІЗУ
UDC 478.4:307.3+378.6:303.7
DEVELOPMENT OF RANKING SYSTEM FOR HIGHER
EDUCATION OF UKRAINE*
M. ZGUROVSKY, N. PANKRATOVA, V. BOBOVKIN, O. LINOVITSKAYA
A system of determination of university ranking in Ukraine was developed based on
the creation of the corresponding methods adequate to the structure, peculiarities and
conditions of the Ukrainian universities functioning. A complex of organizational
and program-technical means was proposed for collection of the necessary data and
determination of university rankings. For specialists in the field of higher education
management, those seeking for higher education and employers.
The society and labor market in Ukraine require distinct and objective informa-
tion on the quality and professional competence of graduates from different uni-
versities. For some years this work has been carried out by a number of non-
governmental institutions and the Ministry of Education and Science of Ukraine.
While positively assessing these first steps, at the same time one can see some
weak points in techniques and approaches being used. These are, first of all, in-
sufficient application of scientifically grounded methods of expert estimation,
unjustified comparison of different groups of universities which are difficult to
compare, non-systematic approach to the formation of independent, professional
groups of experts for carrying out such type of ranking estimation, and others.
In this connection it is very important for Ukraine to join the international
activities in the above mentioned field [1]. That is why the UNESCO Chair
«Higher technical education, applied system analysis and informatics» at National
Technical University of Ukraine «KPI» in collaboration with UNESCO-CEPES
has set the objective to work out a scientifically grounded methodology both for
internal and external ranking of Ukrainian universities.
The network of higher education institutions covers the total territory of
Ukraine and comprises 951 universities of all types and accreditation levels.
Today the number of students in the system of higher education is about 2
ml. 704 thou. During the years of independence the number of students per 10000
of the population has increased from 310 to 578 persons. The dynamics of the
number of students at higher education institutions during these years is shown in
fig. 1.
*Роботу виконано при підтримці Державного фонду фундаментальних досліджень
Міністерства освіти і науки України за проектом Ф15/004.
M. Zgurovsky, N. Pankratova, V. Bobovkin, O. Linovitskaya
ISSN 1681–6048 System Research & Information Technologies, 2006, № 4 8
The methodology of university ranking in Ukraine is based on two main
principles:
1. Comparison of universities by groups and accreditation levels, but not by
the places.
2. Criterial determination of university rankings.
Proceeding from the national classification of higher education institutions
all universities in Ukraine are divided in accordance with two groups of accredita-
tion levels and in eight groups in terms of types of universities. These types are:
classical; technological; technical; pedagogical; medical; agrarian; art and mili-
tary. Comparison is carried out for each type of universities within the two groups
of accreditation levels. So, theoretically such comparison can be made for 16 sub-
groups of universities, though not all of these sub-groups exist. For example, there
is no sub-group of classical universities of I-II accreditation levels.
In each sub-group universities are to be arranged not according to the place,
but be referred to one of four classes: high, average, low and lower than qualifi-
cation (fig. 2).
Similar to the German system [2] such comparison is based on the thesis that
universities can be comparable not by all indices. For example, a university
leading in research may be not strong enough in teaching pedagogical or
management disciplines.
To determine the qualitative and quantitative characteristics of the university
activities it is expedient to use the integral index of university ranking (Iur).
This index is synthetic and is defined by the group of seven criteria. Each of the
criteria is formed by means of the corresponding groups of indicators. The list of
criteria is:
1. Reputation of the university in the labor market (Rlm), which is esti-
mated by a group of experts. Each expert determines the estimate of the university
0
100
200
300
400
500
600
700
19
91
/9
2
19
92
/9
3
19
93
/9
4
19
94
/9
5
19
95
/9
6
19
96
/9
7
19
97
/9
8
19
98
/9
9
19
99
/0
0
20
00
/0
1
20
01
/0
2
20
02
/0
3
20
03
/0
4
20
04
/0
5
20
05
/0
6
I–II accreditation levels III–IV accreditation levels total
Fig.1. The dynamics of the students number at higher education Institution per 10 000 of
the population (by the beginning of 2005–2006 academic year)
Development of ranking system for higher education of Ukraine
Системні дослідження та інформаційні технології, 2006, № 4 9
reputation by the 10-point scale. Then the arithmetic average Rul is found for the
group of experts, which is in the interval from 0 to 10.
2. The university estimation by students (Se), which is done by question-
ing of the undergraduate students of the corresponding university regarding the
following indicators: correspondence of the acquired knowledge to the require-
ments of the society, the averaged estimate of the teaching quality, the level of
corruption students faced during their studies, estimation of the competitiveness
level of the acquired knowledge and skills, the level of equipment of laboratories
and libraries with computer and other teaching facilities. Each indicator is esti-
mated by the 10-point scale. Then the average arithmetic of Se is found for the
group of indicators, which is in the interval from 0 to 10.
3. The quality of the first year students contingent (Qsc) which is esti-
mated by 20-point scale. This criterion is determined quantitatively by using the
following indicators: the competition level by results of examinations, the compe-
tition level by the given applications for admittance, the percentage of medal
school leavers admitted to the first course, the percentage of winners of national
and international Olympiads in the specialties which are profile for the university.
4. The quality of teaching staff (Qts), which is estimated by the 20-point
scale and is determined by application of such indicators as the percentage of full-
staff teachers with the degree of Doctor of sciences , the percentage of full-staff
teachers with the degree of Candidate of sciences, the percentage of full-staff
teachers under the retirement age, the average salary of a university teacher, the
total expenditures for one teacher in the university (including social, bonuses and
others), the ratio of the number of teachers per one student, the ratio of the total
international projects and grants per one student.
5. Participation of the university in research (Ur), which is estimated by
the 20-point scale and is determined by application of the following indicators:
the ratio of the total fund allocated for research to the total fund of the university,
the ratio of the articles published by teachers and researchers in international and
national (according to the list of the Higher Attestation Commission of Ukraine)
scientific magazines to the number of teachers and researchers, the ratio of the
high
average
low
lower than
qualification
Fig 2. Ranking classes of universities
M. Zgurovsky, N. Pankratova, V. Bobovkin, O. Linovitskaya
ISSN 1681–6048 System Research & Information Technologies, 2006, № 4 10
number of articles published by students to the total number of students, the num-
ber of defended doctor thesis to the total number of teachers and researchers, the
ratio of defended candidate thesis to the total number of teachers and students.
6. Universities International cooperation (Uic), which is estimated by the
10 point scale and determined by the following indicators: the ratio of the number
of foreign students to the number of Ukrainian students, the ratio of funding com-
ing from the foreign research and educational contracts and grants to the funding
received from all sources in Ukraine, the ratio of the number of international or-
ganizations in which the university is an official member to the number of 100.
7. The level of the university provision (Lp), which is estimated by the 10-
point scale is determined by the following indicators: the volume of total expendi-
tures per one student, the quantity of issues of the university library fund per one
student, the number of accommodation places in the university hostels per one
student, the ratio of the university classrooms fund to the conditional fund re-
quired for organization of one-shift studies, the number of places with free Inter-
net access per one student.
30 indicators form the 7 criteria. Some of them have a qualitative character,
another are quantitative. The qualitative indicators are determined by the expert
analysis method. The quantitative — are measured by university monitoring
process.
Naturally, all indicators are measured in different units and have different in-
terpretations. That is why they are reduced to the normalized form in such a way
that their variations are in the range from 0 to the upper boundary of the corre-
sponding criteria variation. Thus, the worst meanings of the mentioned indicators
will correspond to the numerical values close to 0, and the best meanings ap-
proach these values to the upper boundary of the range of this or that criterion
variation. Such normalization allow to calculate each of the each criteria as the
arithmetic average of the indicators influencing it, and integral index Iur as a sum
of these criteria.
The university ranking system in Ukraine is based on the application of the
given methodology and a complex of organizational and program-technical means
used for collection of necessary data and determination of universities ranking.
In the given methodology for combining the quantitative and qualitative es-
timations of the main indicators (criteria) the following ratio is used:
• expert estimation of qualitative characteristics (estimation of criteria 1, 2)
is performing in the volume of 20 %;
• direct indicators measurement (quantitative estimation of criteria 3…7)
takes up 80 %.
The expert estimation of qualitative characteristics of universities is carried
out by means of the expert analysis methods. It is connected with the fact that
outputs of these methods are conclusions made by experts involved in this work.
To solve such types of problems it is very important to select a group of
most highly qualified experts, as well as to use the mathematical support and ap-
propriate information technologies. It is to ensure high accuracy and credibility of
the obtained estimates.
Let us give the mathematical statement of the problem. Let the system under
investigation consist of a finite set 0О of objects nО , { }NnOO n ,10 == . Each
Development of ranking system for higher education of Ukraine
Системні дослідження та інформаційні технології, 2006, № 4 11
object 0OOn ∈ is characterized by a finite set 0Q of indicators jQ , =0Q
{ }JjQ j ,1== . A group 0E of experts kE is formed, { }KkEE k ,10 == . Each
expert 0EEk ∈ performs expertise in the on-line mode on the basis of the infor-
mation submitted to him in the form of a scale of qualitative and quantitative es-
timation of indicators (see table). An expert is carrying out the expertise inde-
pendently and has no information about other experts’ estimates. The estimate of
j -th indicator of n -th object k -th expert determines for each level 0Ss∈
],1[0 SS = in the form of fuzzy variable k
njs
k
njs
k
njs QQ µ,~
= . The estimate of j -th
indicator for all Ss ,1= is formed by the computer system of expert questioning
in the following form:
{ }SsJjNnQQ k
njs
k
njs
k
nj ,1;;,~
00 =∈∈= µ , (1)
[ ]NN ,10 = , [ ]JJ ,10 = ,
where k
njsµ determines the results of estimation by k -th expert the degree of
possibility of realization of the estimate k
njsQ for Ss ,1= (see table).
№ Qualitative characteristics
of s-th level
Quantitative
characteristics
of s-th level
Expert’s estimation
of realization possi-
bility of s-th level
1 Extremely low [0 – 0,1] 0,05
2 Very low [0,1 – 0,25] 0,15
3 Low [0,25 – 0,4] 0,35
4 Average [0,4 – 0,6] 0,9
5 High [0,6 – 0,75] 0,45
6 Very high [0,75 – 0,9] 0,05
7 Extremely high [0,9 – 1] 0,01
Estimation of k
njsµ for each value 0Ss∈ ],1[0 SS = is done independently.
Each estimate is chosen from the total interval [0;1]. The final estimate of each
j -th indicator is found by normalization of all estimates for Ss ,1= .
The estimate by k -th expert of n -th object in general is formed by the sys-
tem of expert questioning as an array:
{ };;,1;~~
00 KkJjNnQQ k
nj
k
n ∈=∈= [ ]KK ,10 = . (2)
The results of expertise for n -th object by all experts is formed by the sys-
tem of expert questioning as an array:
{ }KkNnQQ k
nn ,1;~~
0 =∈= . (3)
It is required to determine estimates for all objects nО , Nn ,1= , of a set 0О
by all Kk ,1= experts.
M. Zgurovsky, N. Pankratova, V. Bobovkin, O. Linovitskaya
ISSN 1681–6048 System Research & Information Technologies, 2006, № 4 12
It should be noted that the number of gradations S of the expert estimation
scale (see table) is expedient to form in accordance with the Miller number which
is equal 27 ± .
The solving procedure of the expert estimation problem. To carry out real
expert estimation it is important rationally choose a metrics and criteria based on
which it is necessary to compare indicators of the objects under consideration. It
should be taken into account that the quality indicators of universities are usually
additive values. In such cases it is expedient to use the Chebyshev criterion and
metrics. Then the measure of difference of any pair of expert estimates for j -th
indicator of n -th object will be defined by the relationship:
{ } 000 ;;,,,~~~ NnSsqpKqpQQs q
njs
p
njsnjs ∈∈≠∈−=ρ .
Taking into consideration that according to the input information (see table)
the quantitative characteristics of s -th level of j -th quality indicator, for exam-
ple, competitiveness, for n -th type of product depends only on 0Jj∈ , 0Ss∈ .
That if why for all 0Nn∈ , 0, Kqp ∈ the condition q
njs
p
njs QQ = is fulfilled, where
p and q determine the order number of experts in the group 0K . Thus, the dif-
ference of any pair of expert estimates (1) is determined only by the difference of
estimates of experts and is characterized by the relationship:
q
njs
p
njsnjs µµρ −=~ .
Based on the Chebyshev criterion and metrics the problem solving can be
reduced to a sequence of the following procedures [3]:
1. To form the general estimate of j -th indicator of n -th object on the basis
of the results of expert estimation by all Kk ,1= experts.
2. To find the boundaries of the interval for j -th indicator of n -th object by
using the relationships:
⎭
⎬
⎫
⎩
⎨
⎧
∈−=
=∈
+
0
,1,
,maxmax~
0
Nnq
njs
p
njs
SsKqp
jn µµρ ,
⎭
⎬
⎫
⎩
⎨
⎧
∈−=
=∈
−
0
,1,
,minmin~
0
Nnq
njs
p
njs
SsKqpjn µµρ .
3. To find the center of the interval for j -th indicator of n -th object in the
form of a half sum of the interval limiting values:
2
~~
~̂
−+ +
= jnjn
jn
ρρ
ρ .
4. To find the boundaries regarding the interval center for j -th indicator of
n -th type of an object by the relationships:
,,~̂maxmax 0
,10 ⎭
⎬
⎫
⎩
⎨
⎧
∈−=
=∈
+ Nnp
njsnj
SsKpjn µρρ
Development of ranking system for higher education of Ukraine
Системні дослідження та інформаційні технології, 2006, № 4 13
⎭
⎬
⎫
⎩
⎨
⎧
∈−=
=∈
−
0
,1
,~̂minmin
0
Nnp
njsnj
SsKpjn µρρ .
5. To carry out procedures 1–4 for all other indicators 0Jj∈ for n -th ob-
ject.
6. To form the general estimate nQ~ in the form of the relationship (3) for
n -th object based on the results of its estimation (2) by all Kk ,1= experts.
7. To carry out procedures 1–6 for all other objects 0Nn∈ .
The direct measurement of quantitative indicators of criteria 3–7 is per-
formed by the so-called information-administrative system, named OSVITA.
This system has a widely distributed hierarchy infrastructure which covers all re-
gions of Ukraine and educational institutions (fig. 3).
The infrastructure of this system includes more than 5500 nodes of collec-
tion of the initial information from all 951 universities.
The main purpose of OSVITA system is collection and analysis of informa-
tion about educational programs and progress of every student of the university,
including assessment of his/her level of knowledge in all subjects, about the mate-
rial and technical facilities of universities, its research activities and others. The
scheme of operation of this segment of OSVITA system is given in fig. 4.
The presented results of the universities monitoring in a complex with the
opinion of independent experts will allow ranking university in the educational
space. The integral scheme of the universities ranking on the base on OSVITA
system is given in fig. 5.
Data bases
Internet
Universities Education
institution
Other
organization
Industrial complex
Regional
centre
District
administration
Рис. 3. AAddmmiinniissttrraattiivvee aanndd EEdduuccaattiioonnaall ssystem OSVITA
M. Zgurovsky, N. Pankratova, V. Bobovkin, O. Linovitskaya
ISSN 1681–6048 System Research & Information Technologies, 2006, № 4 14
For exchange and transfer of data in OSVITA system the Ukrainian re-
search and educational computer network, called URAN is used (fig. 6).
University Information System
(UIS)
Primary and
secondary
schools
The main server of data base
• Register of education institution in Ukraine
• Pupils
• School graduates applicants
• Students
• University graduates
Analytical research, analyses of data
on education quality.
Statistical processing of data
«Preliminary» ranking of universities
Fig. 4. Structural scheme of UIS
Student contingent Teaching
staff
Education
program
Research
Data about students
• progress;
• attendant;
• participation in social
activities;
• participation in scientific
conferences;
• number of masters;
• number of post-
graduates;
• number of sent down
students
Material and technical
basis of university
University
monitoring
University Ranking
Number of theses
(candidate,doctor);
monograph, articles
International
cooperation
Expert
estimation
Main server of data base
• register of universities;
• applicant;
• students;
• graduates;
• teachers;
•University resources
Fig.5. System of determination of universities ranking on the basis of UIS
Development of ranking system for higher education of Ukraine
Системні дослідження та інформаційні технології, 2006, № 4 15
The usage of these network makes possible to expand the sphere of applica-
tion of OSVITA system by means of its integration into international, first of all
European information space in the fields of education and science, which is de-
termined by Ukraine’s participation in Bologna process. The statistical data are
available on the site of OSVITA system.
REFERENCES
1. Nian Cai Liu. 2006 Academic Ranking of World Universities by Broad Subject
Fields. Proceedings of 2nd Meeting of the International Rankings Expert Group
(IREG): Methodology and Quality Standards of Rankings, 18–20 May 2006,
Berlin, Germany.
2. Sonja Berghoff, Gego Federkeil. Reputation Indicators and Research Performance.
Proceedings of 2nd Meeting of the International Rankings Expert Group (IREG):
Methodology and Quality Standards of Rankings, 18–20 May 2006, Berlin, Ger-
many.
3. Zgurovsky M.Z., Pankratova N.D. System Analysis. Theory, problems, applica-
tions. — K.: Naukova dumka, 2005. — 753p.
Received 14.03.2006
From the Editorial Board: The article corresponds completely to submitted manu-
script.
Fig. 6. URAN operators location
|
| id | journaliasakpiua-article-154652 |
| institution | System research and information technologies |
| keywords_txt_mv | keywords |
| language | English |
| last_indexed | 2025-07-17T10:24:20Z |
| publishDate | 2019 |
| publisher | The National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute" |
| record_format | ojs |
| resource_txt_mv | journaliasakpiua/ed/afbebad695cc8c9f4e66740451f0a5ed.pdf |
| spelling | journaliasakpiua-article-1546522019-01-18T15:10:28Z Development of ranking system for higher education of Ukraine Разработка системы рейтингов для заведений высшего образования Украины Розробка системи рейтингів для закладів вищої освіти України Zgurovsky, M. Pankratova, N. Bobovkin, V. Linovitskaya, O. A system of determination of university ranking in Ukraine was developed based on the creation of the corresponding methods adequate to the structure, peculiarities and conditions of the Ukrainian universities functioning. A complex of organizational and program-technical means was proposed for collection of the necessary data and determination of university rankings. For specialists in the field of higher education management, those seeking for higher education and employers. Разработана система определения рейтингов университетов Украины, которая основывается на создании определенной методики, адекватной структуре, особенностям и условиям функционирования отечественной высшей школы. Предложен комплекс организационных и программно-технических средств, который применяется при сборе данных и определении оценок рейтингов университетов для специалистов в области управления высшим образованием, а также желающих получить образование и работодателей. Розроблено систему визначення рейтингів університетів України, яка ґрунтується на створенні відповідної методики, адекватної до структури, особливостей та умов функціонування вітчизняної вищої школи. Запропоновано комплекс організаційних і програмно-технічних засобів, що застосовується при збиранні даних та визначенні оцінок рейтингів університетів для фахівців у галузі управління вищою освітою, а також бажаючих отримати освіту та роботодавців. The National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute" 2019-01-18 Article Article application/pdf https://journal.iasa.kpi.ua/article/view/154652 System research and information technologies; No. 4 (2006); 7-15 Системные исследования и информационные технологии; № 4 (2006); 7-15 Системні дослідження та інформаційні технології; № 4 (2006); 7-15 2308-8893 1681-6048 en https://journal.iasa.kpi.ua/article/view/154652/154256 Copyright (c) 2021 System research and information technologies |
| spellingShingle | Zgurovsky, M. Pankratova, N. Bobovkin, V. Linovitskaya, O. Розробка системи рейтингів для закладів вищої освіти України |
| title | Розробка системи рейтингів для закладів вищої освіти України |
| title_alt | Development of ranking system for higher education of Ukraine Разработка системы рейтингов для заведений высшего образования Украины |
| title_full | Розробка системи рейтингів для закладів вищої освіти України |
| title_fullStr | Розробка системи рейтингів для закладів вищої освіти України |
| title_full_unstemmed | Розробка системи рейтингів для закладів вищої освіти України |
| title_short | Розробка системи рейтингів для закладів вищої освіти України |
| title_sort | розробка системи рейтингів для закладів вищої освіти україни |
| url | https://journal.iasa.kpi.ua/article/view/154652 |
| work_keys_str_mv | AT zgurovskym developmentofrankingsystemforhighereducationofukraine AT pankratovan developmentofrankingsystemforhighereducationofukraine AT bobovkinv developmentofrankingsystemforhighereducationofukraine AT linovitskayao developmentofrankingsystemforhighereducationofukraine AT zgurovskym razrabotkasistemyrejtingovdlâzavedenijvysšegoobrazovaniâukrainy AT pankratovan razrabotkasistemyrejtingovdlâzavedenijvysšegoobrazovaniâukrainy AT bobovkinv razrabotkasistemyrejtingovdlâzavedenijvysšegoobrazovaniâukrainy AT linovitskayao razrabotkasistemyrejtingovdlâzavedenijvysšegoobrazovaniâukrainy AT zgurovskym rozrobkasistemirejtingívdlâzakladívviŝoíosvítiukraíni AT pankratovan rozrobkasistemirejtingívdlâzakladívviŝoíosvítiukraíni AT bobovkinv rozrobkasistemirejtingívdlâzakladívviŝoíosvítiukraíni AT linovitskayao rozrobkasistemirejtingívdlâzakladívviŝoíosvítiukraíni |