Annual light comedy

Imagine that a newspaper decided to create a table ranking the world’s cities. Is Moscow better than Sydney? Would Hong Kong squeeze in above Manchester? Or Bangkok above Brighton?

It would be a nonsensical exercise. Better in what respect? They are all vastly different types of human settlement, meeting different aspects of human need in different cultures and climates. True, there would be no shortage of data, though it would be of variable robustness and gathered on different bases in different countries. We could compare expenditure on public transport, or the area of open space, or unemployment. But to come to a single ranking, we would then have to manipulate the data: should a measure of the state of public health outweigh a measure of investment in public transport?

Exactly the same problems arise with world rankings of universities. Each time a new set is published, universities shoot up or down the league tables, and vice-chancellors the world over engage in their traditional exercise of deploy (if up) or deplore (otherwise).

But, in the real world, nothing has changed. The relative strengths of United Kingdom universities vis-à-vis their international peers vary only marginally and incrementally year on year. All that has changed is that the league-table compilers have adopted new metrics and applied new weightings to them, but they still fall miles short of capturing anything like the variety, the dynamism and the diversity of the modern university.

The basic problem is that there is no definition of the ideal university. Is it big or small? Is it better at research or at teaching? Is it a specialist science and technology institution with heavy research income, or does it focus primarily on the humanities and social sciences? Is it adventurous or risk averse?

Next, what are the data? On teaching, there are simply no robust data upon which global comparison can be made. Some tables rely on curious proxies, such as the number of PhDs awarded for each academic, the number of undergraduates admitted for each academic and the income raised by each academic. None of these say anything about the quality of teaching.

We might expect measures of research excellence to be robust, because top research is a globalised activity. Yet we would be disappointed. Take research income. There is a world of difference between scientific and medical institutions — where research is expensive and grants tend to be large — and other types of institution. This helps to explain why a world-class institution such as the London School of Economics can be ranked in one table no higher than 86th.

What’s more, research income is an input measure and will tend to be higher in countries investing seriously in research. It does not speak to the quality of output, where UK universities have consistently demonstrated an outstanding return on investment.
Research citations can be a measure of quality, but need to be intelligently applied. There are big cultural variations between disciplines, which citation indices are not well attuned to capturing.

This isn’t easy territory. Get it wrong and you end up with some truly bizarre results. For example, one of the recent sets of rankings concludes that Egypt’s Alexandria University trumps both Stanford and Harvard for its influential research measured by impact.

Global rankings have afforded annual light entertainment, but they are now overreaching themselves. They do a disservice if they influence student choice, or come to be treated as a performance measure by the leaders of hugely diverse institutions. — Guardian News & Media 2010

Malcolm Grant is president and provost of University College London, which in current world rankings is variously placed fourth (QS), 13th (Global Universities Ranking), 17th (Taiwan index), 21st (Shanghai Jiao Tong), 22nd (Times Higher Education) or 81st (4iCU)

Malcolm Grant
Malcolm Grant works from Barbados. I am a Family Physician. I'll be (mostly) publishing little known medical facts on my twitter page, this is a pilot project. Looking forward to your feedback. Malcolm Grant has over 102 followers on Twitter.
Advertisting

‘We’re satisfied with SA’s land reform policy’— US Ambassador

Top US official is lobbying multinational firms to invest in South Africa

Hosni Mubarak is dead, but the Egypt he built is...

Despite the efforts of the Arab Spring, Egypt is still led by a military dictatorship made in Mubarak’s image

Inside the Security Branch: Torture between brandy and boerewors

A former SB operative, Paul Erasmus, talks about the torture of a young trade unionist, Neil Aggett, and the machinations at John Vorster Square
Advertising

Press Releases

South Africa’s education system is broken and unequal, and must be fixed without further delay

The Amnesty International report found that the South African government continues to miss its own education upgrading targets

Business travel industry generates billions

Meetings Africa is ready to take advantage of this lucrative opportunity

Conferences connect people to ideas

The World Expo and Meetings Africa are all about stimulating innovation – and income

SAB Zenzele Kabili B-BBEE share scheme

New scheme to be launched following the biggest B-BBEE FMCG payout in South Africa’s history

TFSAs are the gymnasts of the retirement savings world

The idea is to get South Africans to save, but it's best to do your research first to find out if a TFSA is really suited to your needs

Achieving the litmus test of social relevance

The HSS Awards honours scholarly works based on their social relevance and contribution to the humanities and social sciences

Making sense of tax-free savings and investment

Have you made the most of your tax-free investment contributions?

Response to the report of the independent assessors

VUT welcomes the publishing of the report of the independent assessors to investigate concerns of poor governance, leadership, management, corruption and fraud at the university.