Novel citation-based search method for scientific literature: a validation study

• Authors: A Cecile Janssens, Emory University; Marta Gwinn, Emory University; J. Elaine Brockman, Emory University; Kimberly Powell, Emory University; Michael Goodman, Emory University
• Journal Title: BMC Medical Research Methodology
• Volume: Volume 20, Number 1
• Publisher: BMC Publications | 2020-02-07, Pages 25-25
• Type of Work: Article | Final Publisher PDF
• Publisher DOI: http://doi.org/10.1186/s12874-020-0907-5
• Subjects: Health Sciences, Epidemiology; Health Sciences, Public Health; Health Sciences, Health Care Management
• Keywords: Science & Technology; Life Sciences & Biomedicine; Health Care Sciences & Services; Citation; Co-citation; Literature search; Meta-analysis; Systematic review; Keywords; Cocitation analysis

Abstract

Background: We recently developed CoCites, a citation-based search method that is designed to be more efficient than traditional keyword-based methods. The method begins with identification of one or more highly relevant publications (query articles) and consists of two searches: the co-citation search, which ranks publications on their co-citation frequency with the query articles, and the citation search, which ranks publications on frequency of all citations that cite or are cited by the query articles. Methods: We aimed to reproduce the literature searches of published systematic reviews and meta-analyses and assess whether CoCites retrieves all eligible articles while screening fewer titles. Results: A total of 250 reviews were included. CoCites retrieved a median of 75% of the articles that were included in the original reviews. The percentage of retrieved articles was higher (88%) when the query articles were cited more frequently and when they had more overlap in their citations. Applying CoCites to only the highest-cited article yielded similar results. The co-citation and citation searches combined were more efficient when the review authors had screened more than 500 titles, but not when they had screened less. Conclusions: CoCites is an efficient and accurate method for finding relevant related articles. The method uses the expert knowledge of authors to rank related articles, does not depend on keyword selection and requires no special expertise to build search queries. The method is transparent and reproducible.