Annual light comedy

Imagine that a newspaper decided to create a table ranking the world’s cities. Is Moscow better than Sydney? Would Hong Kong squeeze in above Manchester? Or Bangkok above Brighton?

It would be a nonsensical exercise. Better in what respect? They are all vastly different types of human settlement, meeting different aspects of human need in different cultures and climates. True, there would be no shortage of data, though it would be of variable robustness and gathered on different bases in different countries. We could compare expenditure on public transport, or the area of open space, or unemployment. But to come to a single ranking, we would then have to manipulate the data: should a measure of the state of public health outweigh a measure of investment in public transport?

Exactly the same problems arise with world rankings of universities. Each time a new set is published, universities shoot up or down the league tables, and vice-chancellors the world over engage in their traditional exercise of deploy (if up) or deplore (otherwise).

But, in the real world, nothing has changed. The relative strengths of United Kingdom universities vis-à-vis their international peers vary only marginally and incrementally year on year. All that has changed is that the league-table compilers have adopted new metrics and applied new weightings to them, but they still fall miles short of capturing anything like the variety, the dynamism and the diversity of the modern university.

The basic problem is that there is no definition of the ideal university. Is it big or small? Is it better at research or at teaching? Is it a specialist science and technology institution with heavy research income, or does it focus primarily on the humanities and social sciences? Is it adventurous or risk averse?

Next, what are the data? On teaching, there are simply no robust data upon which global comparison can be made. Some tables rely on curious proxies, such as the number of PhDs awarded for each academic, the number of undergraduates admitted for each academic and the income raised by each academic. None of these say anything about the quality of teaching.

We might expect measures of research excellence to be robust, because top research is a globalised activity. Yet we would be disappointed. Take research income. There is a world of difference between scientific and medical institutions — where research is expensive and grants tend to be large — and other types of institution. This helps to explain why a world-class institution such as the London School of Economics can be ranked in one table no higher than 86th.

What’s more, research income is an input measure and will tend to be higher in countries investing seriously in research. It does not speak to the quality of output, where UK universities have consistently demonstrated an outstanding return on investment.
Research citations can be a measure of quality, but need to be intelligently applied. There are big cultural variations between disciplines, which citation indices are not well attuned to capturing.

This isn’t easy territory. Get it wrong and you end up with some truly bizarre results. For example, one of the recent sets of rankings concludes that Egypt’s Alexandria University trumps both Stanford and Harvard for its influential research measured by impact.

Global rankings have afforded annual light entertainment, but they are now overreaching themselves. They do a disservice if they influence student choice, or come to be treated as a performance measure by the leaders of hugely diverse institutions. — Guardian News & Media 2010

Malcolm Grant is president and provost of University College London, which in current world rankings is variously placed fourth (QS), 13th (Global Universities Ranking), 17th (Taiwan index), 21st (Shanghai Jiao Tong), 22nd (Times Higher Education) or 81st (4iCU)

We make it make sense

If this story helped you navigate your world, subscribe to the M&G today for just R30 for the first three months

Subscribers get access to all our best journalism, subscriber-only newsletters, events and a weekly cryptic crossword.”

Malcolm Grant
Malcolm Grant works from Barbados. I am a Family Physician. I'll be (mostly) publishing little known medical facts on my twitter page, this is a pilot project. Looking forward to your feedback. Malcolm Grant has over 102 followers on Twitter.

Related stories


Already a subscriber? Sign in here


Latest stories

Mkhwebane would not hear of Gupta links to Estina: witness

The suspended public protector told him she would pleased if the probe into the scam delivered no adverse findings, Reginald Ndou tells inquiry

Editorial: The ANC won’t listen to its own conscience, the...

The party’s top officials seem to have no real inclination to follow through with the integrity commission’s recommendations on corruption

Nxesi: The changing definition of work demands a review of...

The labour minister noted many informal workers had been excluded from the country’s Covid-19 relief scheme

Tazné van Wyk murder accused admits to absconding parole

Moyhdian Pangkaeker evaded the justice system for about four years during which time he twice absconded while on parole. He faces 27 charges, 24 of which he allegedly committed while on parole.

press releases

Loading latest Press Releases…