Using Citation Indexes


What Are Citation Indexes?

Citation indexes track references that authors put in the bibliographies of published papers. They provide a way to search for and analyze the literature in a way not possible through simple keyword/topical searching. It also enables users to gather data on the "impact" of journals, as well as assessing particular areas of research activity and publication. This field is called bibliometrics.

Citation indexing began in the 1950s, and has long been dominated by the Institute for Scientific Information (ISI, which was acquired by and is now renamed Thomson Reuters), the creator and publisher of the three citation indexes available today: Science Citation Index (SCI), Social Sciences Citation Index (SSCI), and Arts & Humanities Citation Index (AHCI). This page focuses on the use of SCI in the "hard" sciences, which have the longest track record in citation studies. SCI covers more than 6,000 journals across all science and engineering disciplines.

The ISI citation indexes, back to 1975, are available online to SIOC users via the Web of Science system.

 


Some Definitions

Terminology used in describing citation indexing can be kind of confusing. Terms are often used interchangeably.

Citation -- An entry in a bibliography or footnote that refers to an earlier work of some kind. Also frequently called a "reference".

Cited Reference -- The same as a citation. An entry in a bibliography or footnote describing an earlier work.

Citing Reference -- The work in which a cited reference appears. This is what you're really searching for when you use a citation index to look forward in the literature.

 


What Can I Do with Citation Indexes?

Find papers that cite earlier papers.
Citation indexing is a way to look forward in the literature from the starting point of a particular paper or group of papers. This is a different and complementary approach to ordinary word-based literature searching, which looks backward in the literature from the present time.

For example, if you have an excellent paper on a particular topic that was published in 1992, you can use Science Citation Index (via Web of Science) to find papers published after 1992 that cited that paper. Citation implies a direct subject relationship between the papers. So, by searching for later papers citing your known paper, you can find more documents on the same or similar topic without using any keywords or subject terms.

 

Find out how many times my papers have been cited. Determine my h-index.
This is easier said than done, and it can get quite complicated.

 

Determine which are the "best" journals in my field.
Citation data have long been used to rank journals within particular subject areas, usually based on the ISI Impact Factor. The impact factor is simply a numerical ratio of the total number of citations a journal receives in ISI Source Journals in one year to the total number of "citable" articles it published in the previous two years. It is a useful way to see how journals perform in relation to others in the same subject area. It is not particularly useful in comparing journals across subject areas, and the number taken out of this context is essentially meaningless.

For example, Journal A has an impact factor of 4.327, and Journal B has an impact factor of 1.045. Is Journal A "better" than Journal B? You could conceivably make that argument, if you first accept the notion that quality equates with citedness, AND if journals A and B are both in the same field, such as Analytical Chemistry or Spectroscopy. But if A is in Biochemistry, and B is in Clinical Pharmacy, no such judgment can be made. Citation behavior varies considerably from field to field. Thus, impact factors are only meaningful in context with other journals in the same field. An editor might say, "My journal has an impact factor of 3.254 this year." That means little by itself. He would rather say, "My journal ranked 2nd out of 38 journals in its subject category this year."

Impact factor can also vary based on the number and types of articles a journal publishes. Review articles tend to be more heavily cited than full papers or communications, so journals and annuals that publish mostly reviews will often have high impact factors. Journals that publish only a few articles in a given year may also have disproportionately high impact factors. Similarly, one very highly cited paper can skew a journal's impact factor significantly.

 

caution While Impact Factors are useful within certain limits, they are somewhat arbitrary and simplistic, and are subject to manipulation by editors and publishers. Lack of transparency and reproducibility has been cited as an ongoing problem with ISI's data (see readings below). Nor does a journal's IF relate in any way to the impact or quality of an individual author or paper. As a result, the use of journal impact factors in personnel and funding decisions is strongly discouraged.

Impact factors for journals covered by ISI are published annually in an electronic compilation called Journal Citation Reports. All ISI Source Journals are ranked within one or more relevant subject categories, such as CHEMISTRY, ORGANIC or SPECTROSCOPY. You can also compile customized lists. JCR also contains data on historical trends, immediacy index, cited half-life, etc.

A different journal ranking system based on citation data from Elsevier's Scopus database launched in 2007: SJR SCImago. Its methodology has yet to be thoroughly evaluated. Another project called Eigenfactor uses network theory to group journals and their citations and evaluate their relative importance.

 

Verify old and obscure references.
Sometimes you'll run across a mysterious reference, and you won't be able to determine what it's referring to. By searching that reference as a "cited reference" in Web of Science, you may find other, more complete citations that might solve the mystery. It doesn't matter how old the mystery item is -- if someone has cited it since SCI began it will show up in the Citation Index.

 


Further Reading

ISI publishes an online newsletter, In Cites, that contains articles and reports about current citation trends, "hot papers," and lists of highly cited scientists. ISI also maintains a site called ISI Highlycited.com that lists highly cited scientists in various fields, along with their biographies and publication lists.