Exploring and understanding scientific metrics in citation networks

Mikalai Krapivin, Maurizio Marchese, Fabio Casati

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

This paper explores scientific metrics in citation networks in scientific communities, how they differ in ranking papers and authors, and why. In particular we focus on network effects in scientific metrics and explore their meaning and impact. We initially take as example three main metrics that we believe significant; the standard citation count, the more and more popular hindex, and a variation we propose of PageRank applied to papers (called PaperRank) that is appealing as it mirrors proven and successful algorithms for ranking web pages and captures relevant information present in the whole citation network. As part of analyzing them, we develop generally applicable techniques and metrics for qualitatively and quantitatively analyzing such network-based indexes that evaluate content and people, as well as for understanding the causes of their different behaviors. We put the techniques at work on a dataset of over 260K ACM papers, and discovered that the difference in ranking results is indeed very significant (even when restricting to citationbased indexes), with half of the top-ranked papers differing in a typical 20-element long search result page for papers on a given topic, and with the top researcher being ranked differently over half of the times in an average job posting with 100 applicants.

Original languageEnglish
Title of host publicationComplex Sciences - First International Conference, Complex 2009, Revised Papers
Pages1550-1563
Number of pages14
Volume5 LNICST
EditionPART 2
DOIs
Publication statusPublished - 2009
Externally publishedYes
Event1st International Conference on Complex Sciences: Theory and Applications, Complex 2009 - Shanghai, China
Duration: 23 Feb 200925 Feb 2009

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering
NumberPART 2
Volume5 LNICST
ISSN (Print)1867-8211

Conference

Conference1st International Conference on Complex Sciences: Theory and Applications, Complex 2009
CountryChina
CityShanghai
Period23.2.0925.2.09

Fingerprint

Websites

Keywords

  • Divergence metric in ranking results
  • H-index
  • Page Rank Algorithm
  • Paper rank
  • Scientific metrics
  • Scientometric

ASJC Scopus subject areas

  • Computer Networks and Communications

Cite this

Krapivin, M., Marchese, M., & Casati, F. (2009). Exploring and understanding scientific metrics in citation networks. In Complex Sciences - First International Conference, Complex 2009, Revised Papers (PART 2 ed., Vol. 5 LNICST, pp. 1550-1563). (Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering; Vol. 5 LNICST, No. PART 2). https://doi.org/10.1007/978-3-642-02469-6_35

Exploring and understanding scientific metrics in citation networks. / Krapivin, Mikalai; Marchese, Maurizio; Casati, Fabio.

Complex Sciences - First International Conference, Complex 2009, Revised Papers. Vol. 5 LNICST PART 2. ed. 2009. p. 1550-1563 (Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering; Vol. 5 LNICST, No. PART 2).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Krapivin, M, Marchese, M & Casati, F 2009, Exploring and understanding scientific metrics in citation networks. in Complex Sciences - First International Conference, Complex 2009, Revised Papers. PART 2 edn, vol. 5 LNICST, Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, no. PART 2, vol. 5 LNICST, pp. 1550-1563, 1st International Conference on Complex Sciences: Theory and Applications, Complex 2009, Shanghai, China, 23.2.09. https://doi.org/10.1007/978-3-642-02469-6_35
Krapivin M, Marchese M, Casati F. Exploring and understanding scientific metrics in citation networks. In Complex Sciences - First International Conference, Complex 2009, Revised Papers. PART 2 ed. Vol. 5 LNICST. 2009. p. 1550-1563. (Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering; PART 2). https://doi.org/10.1007/978-3-642-02469-6_35
Krapivin, Mikalai ; Marchese, Maurizio ; Casati, Fabio. / Exploring and understanding scientific metrics in citation networks. Complex Sciences - First International Conference, Complex 2009, Revised Papers. Vol. 5 LNICST PART 2. ed. 2009. pp. 1550-1563 (Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering; PART 2).
@inproceedings{2a51cc7429dd4ef3a5ad8b6e356d3e7b,
title = "Exploring and understanding scientific metrics in citation networks",
abstract = "This paper explores scientific metrics in citation networks in scientific communities, how they differ in ranking papers and authors, and why. In particular we focus on network effects in scientific metrics and explore their meaning and impact. We initially take as example three main metrics that we believe significant; the standard citation count, the more and more popular hindex, and a variation we propose of PageRank applied to papers (called PaperRank) that is appealing as it mirrors proven and successful algorithms for ranking web pages and captures relevant information present in the whole citation network. As part of analyzing them, we develop generally applicable techniques and metrics for qualitatively and quantitatively analyzing such network-based indexes that evaluate content and people, as well as for understanding the causes of their different behaviors. We put the techniques at work on a dataset of over 260K ACM papers, and discovered that the difference in ranking results is indeed very significant (even when restricting to citationbased indexes), with half of the top-ranked papers differing in a typical 20-element long search result page for papers on a given topic, and with the top researcher being ranked differently over half of the times in an average job posting with 100 applicants.",
keywords = "Divergence metric in ranking results, H-index, Page Rank Algorithm, Paper rank, Scientific metrics, Scientometric",
author = "Mikalai Krapivin and Maurizio Marchese and Fabio Casati",
year = "2009",
doi = "10.1007/978-3-642-02469-6_35",
language = "English",
isbn = "3642024688",
volume = "5 LNICST",
series = "Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering",
number = "PART 2",
pages = "1550--1563",
booktitle = "Complex Sciences - First International Conference, Complex 2009, Revised Papers",
edition = "PART 2",

}

TY - GEN

T1 - Exploring and understanding scientific metrics in citation networks

AU - Krapivin, Mikalai

AU - Marchese, Maurizio

AU - Casati, Fabio

PY - 2009

Y1 - 2009

N2 - This paper explores scientific metrics in citation networks in scientific communities, how they differ in ranking papers and authors, and why. In particular we focus on network effects in scientific metrics and explore their meaning and impact. We initially take as example three main metrics that we believe significant; the standard citation count, the more and more popular hindex, and a variation we propose of PageRank applied to papers (called PaperRank) that is appealing as it mirrors proven and successful algorithms for ranking web pages and captures relevant information present in the whole citation network. As part of analyzing them, we develop generally applicable techniques and metrics for qualitatively and quantitatively analyzing such network-based indexes that evaluate content and people, as well as for understanding the causes of their different behaviors. We put the techniques at work on a dataset of over 260K ACM papers, and discovered that the difference in ranking results is indeed very significant (even when restricting to citationbased indexes), with half of the top-ranked papers differing in a typical 20-element long search result page for papers on a given topic, and with the top researcher being ranked differently over half of the times in an average job posting with 100 applicants.

AB - This paper explores scientific metrics in citation networks in scientific communities, how they differ in ranking papers and authors, and why. In particular we focus on network effects in scientific metrics and explore their meaning and impact. We initially take as example three main metrics that we believe significant; the standard citation count, the more and more popular hindex, and a variation we propose of PageRank applied to papers (called PaperRank) that is appealing as it mirrors proven and successful algorithms for ranking web pages and captures relevant information present in the whole citation network. As part of analyzing them, we develop generally applicable techniques and metrics for qualitatively and quantitatively analyzing such network-based indexes that evaluate content and people, as well as for understanding the causes of their different behaviors. We put the techniques at work on a dataset of over 260K ACM papers, and discovered that the difference in ranking results is indeed very significant (even when restricting to citationbased indexes), with half of the top-ranked papers differing in a typical 20-element long search result page for papers on a given topic, and with the top researcher being ranked differently over half of the times in an average job posting with 100 applicants.

KW - Divergence metric in ranking results

KW - H-index

KW - Page Rank Algorithm

KW - Paper rank

KW - Scientific metrics

KW - Scientometric

UR - http://www.scopus.com/inward/record.url?scp=84885893874&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84885893874&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-02469-6_35

DO - 10.1007/978-3-642-02469-6_35

M3 - Conference contribution

AN - SCOPUS:84885893874

SN - 3642024688

SN - 9783642024689

VL - 5 LNICST

T3 - Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering

SP - 1550

EP - 1563

BT - Complex Sciences - First International Conference, Complex 2009, Revised Papers

ER -