Free scoping read. A written assessment of your manuscript in two business days, at no cost.

Start one
Contents

Academy · Research Publication · Journal evaluation systems

Journal Selection and Evaluation Systems: A Comparative Analysis of Impact Factor, CiteScore, SJR and DOAJ

The Impact Factor, CiteScore, SJR and DOAJ listing measure different properties and draw on different data; an understanding of what each counts determines how it should inform a journal-selection decision.

Pubrica AcademyWritten by a journal-selection and publication-strategy specialist Reviewed bya senior research publication consultant Published10 October 2026 Last checked10 October 2026 Reading time8 minutes Sources10 peer-reviewed

Researchers selecting a journal for a manuscript are commonly presented with several evaluation figures at once — a Journal Impact Factor, a CiteScore, an SJR quartile — together with the presence or absence of a DOAJ listing, and must determine what each indicates. These systems are not interchangeable: they draw on different citation databases, cover different sets of journals and measure different properties (raw citation averages, citation-network prestige and basic transparency criteria, respectively). Used together, and alongside a deliberate check for predatory-journal characteristics, they provide a considerably more reliable assessment than any single metric.

Learning objectives

  • What the Journal Impact Factor (Clarivate, via Web of Science) counts, and over how many years
  • How CiteScore (Elsevier/Scopus) differs in coverage, calculation window, and access from the Impact Factor
  • What SCImago Journal Rank (SJR) adds by weighting citations for the citing journal's own prestige, and what DOAJ listing checks instead of citation impact

Common misconceptions

  • “A higher Impact Factor and a higher CiteScore for the same journal should always roughly agree.” They can diverge because they draw on different citation databases (Web of Science versus Scopus) with different journal coverage, use different citation-window lengths, and count different item types in the denominator; a journal can rank well on one and middling on the other.
  • “DOAJ listing is a prestige ranking similar to Impact Factor or CiteScore.” DOAJ is not a citation-impact metric at all. It is a binary listing based on criteria such as peer-review practice, editorial board disclosure, and website transparency — a journal can be DOAJ-listed with no Impact Factor, or have a strong Impact Factor without being in DOAJ if it is not open access.

The Journal Impact Factor and Clarivate’s Journal Citation Reports

The Journal Impact Factor (JIF), published annually in Clarivate's Journal Citation Reports (JCR), estimates how often an average article in a journal is cited, using a fixed two-year citation window: the numerator is the number of citations in a given JCR year to items the journal published in the two preceding years, and the denominator is the number of citable items — articles and reviews only, excluding letters and editorial material — published in those same two years 1. The underlying citation data comes from the Web of Science Core Collection, and only journals that pass Clarivate's own editorial evaluation are included at all; JCR currently covers roughly 11,500-plus titles drawn mainly from the Science Citation Index-Expanded and Social Sciences Citation Index 1. A JIF therefore reflects both the journal’s recent citation activity and the fact that it met Clarivate’s selection criteria for Web of Science inclusion.

CiteScore as the Scopus alternative with a different citation window

CiteScore, Elsevier’s Scopus-based alternative, calculates the average citations per article but uses a wider window and a larger pool of titles: Elsevier describes it as covering more than 26,000 journal titles, over 13,000 more than receive a Journal Impact Factor, with the underlying data and calculation method verifiable without a Scopus subscription, unlike JCR 2. Only peer-reviewed content types — articles, reviews, conference papers, book chapters, and data papers — count in both the citation numerator and the publication-count denominator, and early-access "articles in press" are excluded from the count 2. Because CiteScore and JIF draw on different databases (Scopus versus Web of Science) with different journal coverage and different citation-window lengths, the same journal can score noticeably differently on each; neither figure is the single correct one, because each reports a different property.

SCImago Journal Rank and prestige-weighted citation

SCImago Journal Rank (SJR) also uses Scopus data but produces a prestige score rather than a raw citation average: SCImago describes it as weighting a journal's citations by the citing journal's own standing, so a citation from a highly cited source counts for more than one from a rarely cited source, before placing journals into subject-area quartiles for comparison 3. This network-weighting approach — adapted from the same family of algorithms used for ranking web pages by link prestige rather than raw link count — is what distinguishes SJR from a simple citations-per-article figure like CiteScore or Impact Factor, and it is published freely through the SCImago Journal & Country Rank portal rather than behind a subscription.

DOAJ listing and the identification of predatory journals

None of the three citation metrics above indicates whether a journal is a legitimate publication; that is a separate question, which the Directory of Open Access Journals (DOAJ) addresses for open-access titles with published, verifiable inclusion criteria: mandatory peer review with at least two independent reviewers for most fields, a named and institutionally-affiliated editorial board not drawn entirely from one institution, and an easily found statement of the journal’s open-access policy, review process, and any author fees 4. The Think. Check. Submit. initiative frames the same question as a three-step practice (think about the journal’s credibility, check its key quality indicators, then submit) to be followed before relying on any single metric 5. A 2017 peer-reviewed comparison in BMC Medicine extended this approach by testing which specific characteristics distinguished 93 potential predatory journals from presumed-legitimate ones, identifying thirteen evidence-based warning signs, including an unusually low or undisclosed processing fee (often under roughly US$150), promises of very rapid publication, no stated retraction policy, email-only manuscript submission, and a non-professional contact address not affiliated with the journal’s own domain 6. Checking a journal against DOAJ criteria and this evidence-based list is a necessary first step before any Impact Factor, CiteScore, or SJR value becomes relevant.

Eigenfactor and Article Influence Score as alternative weighting systems

A fourth citation-based system weights journals differently again from Impact Factor, CiteScore, or SJR. Eigenfactor measures a journal's overall importance to the scientific community using a five-year citation window, with scores scaled so that all journals' Eigenfactor scores sum to 100, which means it captures total scholarly output and reach rather than a per-article average7. Dividing a journal's Eigenfactor by its number of articles produces the Article Influence Score, a per-article figure scaled so that 1.00 represents the average across all journals, making a score above 1.00 indicate above-average per-article influence7. Because Eigenfactor rewards total volume and reach while Article Influence Score normalizes for it, a journal publishing many articles can show a high Eigenfactor and a comparatively modest Article Influence Score at the same time, a combination that may be misread as contradictory rather than recognized as two deliberately different measurements.

Database dependence of the h-index

The same database-dependency problem that affects journal-level metrics also affects the h-index, the author-level metric often used alongside journal metrics to judge a target journal’s editorial board or a collaborator’s standing. A 2017 comparative study retrieved h-index values for 20 researchers in the information-metrics field from Scopus, Web of Science, and Google Scholar, and found, using a Wilcoxon-Mann-Whitney test at the 5% significance level, no statistically significant difference between the Scopus and Web of Science values, but a significant difference between Google Scholar’s values and those of both other databases8. Google Scholar’s broader, less curated indexing, which includes preprints, theses, and non-peer-reviewed material that Scopus and Web of Science generally exclude, is the most likely explanation for that difference, and it illustrates why the general guidance to check an editorial board member’s h-index across more than one database is not redundant: the sources are measurably not interchangeable.

Altmetrics as a non-citation indicator

A separate class of metric, altmetrics, tracks something categorically different from any of the citation-based systems above. Whereas citations reflect how other researchers formally assess and build on a piece of work, altmetrics count web and social engagement (views, downloads, saves, mentions on social media, blog posts, and Wikipedia citations), capturing attention from a wider audience that includes practitioners, policymakers, and the public9. Altmetric data can be measured within days of publication rather than the years citation counts typically take to accumulate, and is often available through open web APIs rather than gated behind a subscription, but it is also more vulnerable to manipulation and carries no agreed normalization standard, and studies have found only a moderate correlation between altmetric attention and eventual citation counts9. The National Information Standards Organization formalized definitions and use cases for this category in its 2016 Recommended Practice on alternative assessment metrics, an effort to give institutions and funders a consistent vocabulary for a metric type that is still comparatively young and unstandardized relative to citation-based systems10. For journal selection specifically, altmetrics are best read as evidence of attention and reach rather than of quality or rigor, a distinct complement to, not a substitute for, the citation-based metrics discussed above.

Key points

Key points

The Impact Factor, CiteScore and SJR each use different data and formulas; a journal should therefore be compared across all three metrics available for it, and only after its legitimacy has been confirmed separately against DOAJ-style criteria.

Practical application

Practical application

  1. Every metric available for the journal should be obtained, rather than a single one. JCR (if indexed in Web of Science), CiteScore (if indexed in Scopus) and SJR quartile should be checked together; disagreement between them is informative rather than a sign that one is incorrect.
  2. Legitimacy checks should be kept separate from impact checks. Before citation metrics are weighed, DOAJ listing (for open-access journals) or equivalent transparency should be confirmed, and the journal screened against the documented predatory warning signs.
  3. The data source of the metric should be matched to the field. Web of Science (JIF) and Scopus (CiteScore, SJR) have different subject coverage; a journal missing from one may simply be outside that database's scope rather than low quality.

Frequently asked questions

None alone. Impact Factor, CiteScore, and SJR should be used as complementary signals from different databases, and DOAJ listing and predatory-journal screening treated as a separate legitimacy check that comes first.

They are built from different citation databases (Web of Science versus Scopus) with different journal coverage, different citation-window lengths, and different included item types, so the two numbers are not directly comparable.

No. Many legitimate, especially newer or regional, journals are not yet Web of Science or Scopus indexed. DOAJ listing and the documented predatory-journal warning signs are a more direct legitimacy check than the presence or absence of a citation metric.

Eigenfactor measures a journal's total importance using a five-year citation window and scales all journals to sum to 100, rewarding overall volume and reach, while Article Influence Score divides that by the journal's article count to give a per-article figure where 1.00 is average, so the two can move in different directions for a high-volume journal.

Yes. A 2017 study found Google Scholar h-index values differed significantly from Scopus and Web of Science values for the same researchers, mainly because Google Scholar indexes a much broader, less curated set of sources.

No. Altmetrics track attention and engagement (views, downloads, social media mentions) rather than formal scholarly assessment, and studies have found only a moderate correlation between altmetric scores and eventual citations, so they complement citation-based metrics rather than substitute for them.

References

  1. Clarivate. Journal Citation Reports: the basics (Impact Factor methodology). read 10 October 2026. View source
  2. Elsevier. What is CiteScore and why should you care about it? read 10 October 2026. View source
  3. SCImago Journal & Country Rank. SCImago Journal Rank (SJR) indicator. read 10 October 2026. View source
  4. Directory of Open Access Journals (DOAJ). Criteria for inclusion in DOAJ (application guide). read 10 October 2026. View source
  5. Think. Check. Submit. Journals checklist. read 10 October 2026. View source
  6. Shamseer L, Moher D, Maduekwe O, et al. Potential predatory and legitimate biomedical journals: can you tell the difference? A cross-sectional comparison. BMC Medicine. 2017;15:28. read 10 October 2026. View on PubMed Central
  7. Cornell University Library. Eigenfactor and Article Influence Score. read 10 October 2026. View source
  8. Silva DD, Grácio MCC. Hirsch's h-index: comparative analysis between Scopus, Web of Science and Google Scholar databases. Em Questão. 2017;23:196-212. read 10 October 2026. View source
  9. Bornmann L. Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics. Journal of Informetrics. 2014;8(4):895-903. read 10 October 2026. View on arXiv
  10. National Information Standards Organization (NISO). Outputs of the NISO Alternative Assessment Metrics Project (RP-25-2016). read 10 October 2026. View source

Every source above is a peer-reviewed article, a publisher’s record of one, or a standard issued by the body that owns it. Each carries the date it was last read. Where a standard moves, this article is revised rather than left up with a note.

How to cite this article

Pick your referencing style and copy it. Your university or target journal may vary the punctuation — check its guide if it has one.

Pubrica Academy. (2026, October 10). Journal Selection and Evaluation Systems: A Comparative Analysis of Impact Factor, CiteScore, SJR and DOAJ. Pubrica. https://pubrica.com/academy/concepts-definitions/a-comprehensive-analysis-of-the-journal-selection-and-evaluation-systems/

This article is written to be learned from. Cite it if you are referring to what it says; if you are using the evidence behind it, cite the sources listed above instead.

Journal-metric comparison checklist

For use when comparing shortlisted journals that report different evaluation metrics.

[ ] Journal Impact Factor (Web of Science / JCR), if indexed
[ ] CiteScore (Scopus), if indexed
[ ] SJR quartile (SCImago), if indexed
[ ] DOAJ listing confirmed (if open access)
[ ] Screened against documented predatory-journal warning signs
[ ] Noted which database(s) the journal is missing from, and why

Pubrica AcademyWritten and maintained by Pubrica’s subject matter experts. Articles are revised when the underlying standards change, and each article states the date on which it was last reviewed.

How Pubrica can help

Pubrica's journal-selection service compares a shortlisted journal's Impact Factor, CiteScore, and SJR together with DOAJ and predatory-screening checks before a manuscript is submitted.

Find something else

Search the Pubrica Academy

Access is free and requires no account. Enter a topic, or open the full library to filter by category, sub-topic or resource type.

Interpretation of conflicting journal metrics

A scoping assessment is free and takes two business days. It provides a written assessment of what the work requires and which specialist would undertake it.

Get a free quote

Regulations

Check your project against this rule

  1. 1Your work
  2. 2Your details
  3. 3Send
What do you need?

Material you send is held under signed confidentiality, with access limited to the assigned team and encrypted transfer. It is not used to train anything and is not passed to third-party tools. Ask for the agreement before you send anything you would rather cover first.