Exploring and understanding citation-based scientific metrics

Mikalai Krapivin, Maurizio Marchese, Fabio Casati

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

This paper explores citation-based metrics, how they differ in ranking papers and authors, and why. We initially take as example three main metrics that we believe significant; the standard citation count, the more and more popular h-index, and a variation we propose of PageRank applied to papers (called PaperRank), that is appealing as it mirrors proven and successful algorithms for ranking web pages. As part of analyzing them, we develop generally applicable techniques and metrics for qualitatively and quantitatively analyzing indexes that evaluate content and people, as well as for understanding the causes of their different behaviors. Finally, we extend the analysis to other popular indexes, to show whether the choice of the index has a significant effect in how papers and authors are ranked. We put the techniques at work on a dataset of over 260 K ACM papers, and discovered that the difference in ranking results is indeed very significant (even when restricting to citation-based indexes), with half of the top-ranked papers differing in a typical 20-element long search result page for papers on a given topic, and with the top researcher being ranked differently over half of the times in an average job posting with 100 applicants.

Original languageEnglish
Pages (from-to)59-81
Number of pages23
JournalAdvances in Complex Systems
Volume13
Issue number1
DOIs
Publication statusPublished - Feb 2010
Externally publishedYes

Keywords

  • Citation analyses
  • PageRank
  • Scientometrics

ASJC Scopus subject areas

  • Control and Systems Engineering
  • General

Fingerprint Dive into the research topics of 'Exploring and understanding citation-based scientific metrics'. Together they form a unique fingerprint.

  • Cite this