A Method for Verifying Indicators of Journal Quality

Abstract

A recent search of the UlrichsWeb Global Serials Directory for active, digital, peer reviewed, scholarly journals shows that world’s academic articles are published in more than 58,500 journals. By one estimate the growth of new journal titles increases by 2.5% ever year (Ware & Mabe, 2015). At the same time, universities are adopting researcher information systems that provide administrators and other campus stakeholders with nearly complete bibliographic data for all articles published by their faculty authors. As campus leaders work to make sense of this data, they may turn to their library for help. Questions may include: Are all of these new or previously unencountered journal titles legitimate? Who are the main publishers of our articles? What are the emerging trends that promotion and tenure committees should consider? The most common way to address these questions involves significant shortcomings--proprietary subscription databases, like Scopus, Web of Science, and Academic Analytics, have limited coverage of the journal literature and, by design, are unlikely to include newer and lesser known journal titles. At the same time many universities publish thousands of articles per year, manually checking each article submitted to a faculty annual review database would prove to be a tedious and lengthy process. To reduce the labor involved in identifying indicators of journal quality, we have developed a method using open source software and open Application Programming Interfaces (APIs). In specific, our method reduces the labor in identifying the publishers for a long list of journals and in identifying the access model for these journals (subscription-only or open access). To do this we wrote an R script that uses the SHERPA RoMEO and the DOAJ APIs. Using this method permitted us to quickly identify the journals that needed closer inspection. This method will help others that are working to verify journal quality in large data sets without relying on problematic, journal blacklists.