Criticism
College and university rankings often stimulate controversy (see Criticism of college and university rankings (North America) and Criticism of college and university rankings (2007 United States)) and the ARWU is no exception. A 2007 paper published in the journal Scientometrics found that the results from the Shanghai rankings could not be reproduced from raw data using the method described by Liu and Cheng.
In a report from April 2009, J-C. Billaut, D. Bouyssou and Ph. Vincke analyze how the ARWU works, using their insights as specialists of Multiple Criteria Decision Making (MCDM). Their main conclusions are that the criteria used are not relevant; that the aggregation methodology has a number of major problems; and that insufficient attention has been paid to fundamental choices of criteria.
The ARWU researchers themselves, N.C Liu and Y Cheng, think that the quality of universities cannot be precisely measured by mere numbers and any ranking must be controversial. They suggest that university and college rankings should be used with caution and their methodologies must be understood clearly before reporting or using the results.
Others have pointed out, the ARWU is known for "relying solely on research indicators", and "the ranking is heavily weighted toward institutions whose faculty or alumni have won Nobel Prizes": it does not measure "the quality of teaching or the quality of humanities."
Ioannides et al. suggested that (in common with all ranking systems they reviewed), the ranking lacked construct validity modest concordance between the Shanghai and Times rankings. They highlighted measurement precision, and transparent methodology as important issues.
Like the Times Higher Education's rankings, the ARWU has been criticized by the European Commission as well as some EU member states for "favour Anglo-Saxon higher education institutions".
Read more about this topic: Academic Ranking Of World Universities
Famous quotes containing the word criticism:
“However intense my experience, I am conscious of the presence and criticism of a part of me, which, as it were, is not a part of me, but a spectator, sharing no experience, but taking note of it, and that is no more I than it is you. When the play, it may be the tragedy, of life is over, the spectator goes his way. It was a kind of fiction, a work of the imagination only, so far as he was concerned.”
—Henry David Thoreau (1817–1862)
“The visual is sorely undervalued in modern scholarship. Art history has attained only a fraction of the conceptual sophistication of literary criticism.... Drunk with self-love, criticism has hugely overestimated the centrality of language to western culture. It has failed to see the electrifying sign language of images.”
—Camille Paglia (b. 1947)
“A bad short story or novel or poem leaves one comparatively calm because it does not exist, unless it gets a fake prestige through being mistaken for good work. It is essentially negative, it is something that has not come through. But over bad criticism one has a sense of real calamity.”
—Rebecca West (1892–1983)