Abstract
The article evaluates the research output indicator of Uzbekistan’s national ranking of higher education institutions. The indicator combines Scopus papers in the Top 1% and Top 10% citation percentiles and in Q1-Q4 journals with weights of 12, 10, 8, 6, 4 and 1, divides the result by the number of academic staff and converts it into points relative to the category leader. Using official data for 105 institutions in 2025, the study shows that the overlapping weights give one Top 1% paper in a Q1 journal 30 weight units, while 18.6% of publications have no quartile. Alternative weights change institutional ranks little: the number of publications per staff member alone correlates with official scores at ρ = 0.935. The value of one additional Q1 paper differs by up to 89 times within a category, and in the Applied and Medical categories about nine out of ten institutions receive less than 10% of the maximum score. Under the logarithmic normalisation mentioned in the official report, the median score in the Applied category would be 0.730 instead of 0.072. The article proposes counting each paper only once, setting a minimum staff threshold, using normalisation that depends less on the leader, publishing the indicator components separately, and defining the numerator and denominator on the same basis.
References
1. Aagaard, K. (2015) ‘How incentives trickle down: local use of a national bibliometric indicator system’, Science and Public Policy, 42(5), pp. 725-737.
2. Abramo, G. and D’Angelo, C.A. (2014) ‘How do you define and measure research productivity?’, Scientometrics, 101(2), pp. 1129-1144.
3. Bornmann, L., Leydesdorff, L. and Mutz, R. (2013) ‘The use of percentiles and percentile rank classes in the analysis of bibliometric data: opportunities and limits’, Journal of Informetrics, 7(1), pp. 158-165.
4. Butler, L. (2003) ‘Explaining Australia’s increased share of ISI publications: the effects of a funding formula based on publication counts’, Research Policy, 32(1), pp. 143-155.
5. DORA (2013) San Francisco Declaration on Research Assessment. Available at: https://sfdora.org/read/ (Accessed: 21 October 2026).
6. Greco, S., Ishizaka, A., Tasiou, M. and Torrisi, G. (2019) ‘On the methodological framework of composite indices: a review of the issues of weighting, aggregation, and robustness’, Social Indicators Research, 141(1), pp. 61-94.
7. Hicks, D. (2012) ‘Performance-based university research funding systems’, Research Policy, 41(2), pp. 251-261.
8. Hicks, D., Wouters, P., Waltman, L., de Rijcke, S. and Rafols, I. (2015) ‘Bibliometrics: the Leiden Manifesto for research metrics’, Nature, 520(7548), pp. 429-431.
9. National Agency for Quality Assurance in Education (2026) Oliy taʼlim tashkilotlarining milliy reytingini yuritish toʻgʻrisidagi nizom [Regulation on maintaining the national ranking of higher education institutions], approved by Order No. 8 of 6 February 2026, registered by the Ministry of Justice of the Republic of Uzbekistan on 28 February 2026, No. 3783. Tashkent. Available at: https://lex.uz/docs/8067678 (Accessed: 21 October 2026).
10. OECD and JRC (2008) Handbook on Constructing Composite Indicators: Methodology and User Guide. Paris: OECD Publishing.
11. Paruolo, P., Saisana, M. and Saltelli, A. (2013) ‘Ratings and rankings: voodoo or science?’, Journal of the Royal Statistical Society: Series A (Statistics in Society), 176(3), pp. 609-634.
12. President of the Republic of Uzbekistan (2026) Oliy taʼlim, fan va innovatsiyalar tizimini takomillashtirishning qoʻshimcha chora-tadbirlari toʻgʻrisida [On additional measures to improve the system of higher education, science and innovation], Decree No. PF-58 of 10 April 2026. Tashkent. Available at: https://lex.uz/uz/docs/-8129755 (Accessed: 21 October 2026).
13. Saisana, M., d’Hombres, B. and Saltelli, A. (2011) ‘Rickety numbers: volatility of university rankings and policy implications’, Research Policy, 40(1), pp. 165-177.
14. Suleymanov, R., Mullaev, A. and Mahkamov, A. (2026) Oliy taʼlim tashkilotlarining ilmiy nashrlar faolligi va xalqaro iqtibos taʼsiri ("Scopus", 2025-yil): axborot-tahliliy sharh [Research publication activity and international citation impact of higher education institutions (Scopus, 2025): analytical review]. Tashkent: National Agency for Quality Assurance in Education.
15. Waltman, L. (2016) ‘A review of the literature on citation impact indicators’, Journal of Informetrics, 10(2), pp. 365-391.

This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) 2026 Mamajonova, M.M. (Muallif)