Evidence of methodologic bias in the derivation of the Science Citation Index impact factor

E. John Gallagher, Douglas P. Barnaby

Research output: Contribution to journalArticle

53 Citations (Scopus)

Abstract

Study objective: The 'impact factor' published in Science Citation Index (SCI) is widely used in the scientific community to measure the relative importance of a medical journal. In contrast to all other indicators of academic growth in emergency medicine, impact factors for emergency medicine journals have remained low and unchanged since the inception of the specialty. We wished to investigate this incongruity. Methods: We examined the methodology used to derive the SCI's journal impact factor. Results: The impact factor for journals is defined mathematically as the number of times a journal is cited over a period of time (the numerator) divided by the number of articles published by that journal during the same period (the denominator). Citation counts are derived from examination of all references contained in a subset of journals known as 'source' journals. No emergency medicine journals are included in this group. The only source of citations for emergency medicine journals is from journals outside of emergency medicine. This produces small numerators with relatively constant denominators, leading to low impact factors. Conclusion: The apparent failure of emergency medicine journals, as measured by the SCI impact factor, to keep pace with other indicators of academic development of the field is at least in part attributable to a methodologic bias inherent in the derivation of this factor.

Original languageEnglish (US)
Pages (from-to)83-86
Number of pages4
JournalAnnals of Emergency Medicine
Volume31
Issue number1
DOIs
StatePublished - 1998

Fingerprint

Emergency Medicine
Journal Impact Factor
Growth

ASJC Scopus subject areas

  • Emergency Medicine

Cite this

Evidence of methodologic bias in the derivation of the Science Citation Index impact factor. / Gallagher, E. John; Barnaby, Douglas P.

In: Annals of Emergency Medicine, Vol. 31, No. 1, 1998, p. 83-86.

Research output: Contribution to journalArticle

@article{2f84558df3a844c3baa46b398783cec8,
title = "Evidence of methodologic bias in the derivation of the Science Citation Index impact factor",
abstract = "Study objective: The 'impact factor' published in Science Citation Index (SCI) is widely used in the scientific community to measure the relative importance of a medical journal. In contrast to all other indicators of academic growth in emergency medicine, impact factors for emergency medicine journals have remained low and unchanged since the inception of the specialty. We wished to investigate this incongruity. Methods: We examined the methodology used to derive the SCI's journal impact factor. Results: The impact factor for journals is defined mathematically as the number of times a journal is cited over a period of time (the numerator) divided by the number of articles published by that journal during the same period (the denominator). Citation counts are derived from examination of all references contained in a subset of journals known as 'source' journals. No emergency medicine journals are included in this group. The only source of citations for emergency medicine journals is from journals outside of emergency medicine. This produces small numerators with relatively constant denominators, leading to low impact factors. Conclusion: The apparent failure of emergency medicine journals, as measured by the SCI impact factor, to keep pace with other indicators of academic development of the field is at least in part attributable to a methodologic bias inherent in the derivation of this factor.",
author = "Gallagher, {E. John} and Barnaby, {Douglas P.}",
year = "1998",
doi = "10.1016/S0196-0644(98)70286-0",
language = "English (US)",
volume = "31",
pages = "83--86",
journal = "Annals of Emergency Medicine",
issn = "0196-0644",
publisher = "Mosby Inc.",
number = "1",

}

TY - JOUR

T1 - Evidence of methodologic bias in the derivation of the Science Citation Index impact factor

AU - Gallagher, E. John

AU - Barnaby, Douglas P.

PY - 1998

Y1 - 1998

N2 - Study objective: The 'impact factor' published in Science Citation Index (SCI) is widely used in the scientific community to measure the relative importance of a medical journal. In contrast to all other indicators of academic growth in emergency medicine, impact factors for emergency medicine journals have remained low and unchanged since the inception of the specialty. We wished to investigate this incongruity. Methods: We examined the methodology used to derive the SCI's journal impact factor. Results: The impact factor for journals is defined mathematically as the number of times a journal is cited over a period of time (the numerator) divided by the number of articles published by that journal during the same period (the denominator). Citation counts are derived from examination of all references contained in a subset of journals known as 'source' journals. No emergency medicine journals are included in this group. The only source of citations for emergency medicine journals is from journals outside of emergency medicine. This produces small numerators with relatively constant denominators, leading to low impact factors. Conclusion: The apparent failure of emergency medicine journals, as measured by the SCI impact factor, to keep pace with other indicators of academic development of the field is at least in part attributable to a methodologic bias inherent in the derivation of this factor.

AB - Study objective: The 'impact factor' published in Science Citation Index (SCI) is widely used in the scientific community to measure the relative importance of a medical journal. In contrast to all other indicators of academic growth in emergency medicine, impact factors for emergency medicine journals have remained low and unchanged since the inception of the specialty. We wished to investigate this incongruity. Methods: We examined the methodology used to derive the SCI's journal impact factor. Results: The impact factor for journals is defined mathematically as the number of times a journal is cited over a period of time (the numerator) divided by the number of articles published by that journal during the same period (the denominator). Citation counts are derived from examination of all references contained in a subset of journals known as 'source' journals. No emergency medicine journals are included in this group. The only source of citations for emergency medicine journals is from journals outside of emergency medicine. This produces small numerators with relatively constant denominators, leading to low impact factors. Conclusion: The apparent failure of emergency medicine journals, as measured by the SCI impact factor, to keep pace with other indicators of academic development of the field is at least in part attributable to a methodologic bias inherent in the derivation of this factor.

UR - http://www.scopus.com/inward/record.url?scp=0031984698&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0031984698&partnerID=8YFLogxK

U2 - 10.1016/S0196-0644(98)70286-0

DO - 10.1016/S0196-0644(98)70286-0

M3 - Article

C2 - 9437347

AN - SCOPUS:0031984698

VL - 31

SP - 83

EP - 86

JO - Annals of Emergency Medicine

JF - Annals of Emergency Medicine

SN - 0196-0644

IS - 1

ER -