Critically evaluating journal articles

Start by identifying the article's purpose and what you need to judge about it.

Consider:

• Purpose: What question, problem or argument does the article address?

• Type of article: Does it report original research, review existing studies, develop a theoretical argument or offer another form of scholarly analysis?

• Relevance: How does the article relate to your research question, assessment or learning activity?

• Contribution: What does the article add to your understanding of the topic?

An article can be well researched without being particularly relevant to your task. Equally, an article may address your topic directly but provide weak evidence for its claims.

Choose appropriate evaluation questions

Different types of academic articles require different approaches.

For example, when evaluating an experimental study, you may need to examine how participants were selected, how outcomes were measured and whether the research design supports the conclusions.

When evaluating an interview-based study, you may need to consider how participants' experiences were investigated, how the material was analysed and whether the interpretations are supported.

For a theoretical article, you might concentrate on its assumptions, use of concepts, reasoning and engagement with alternative interpretations.

There is no single checklist that works equally well for every discipline or type of research. Choose questions appropriate to the article and the purpose for which you are using it.

A central part of evaluating research is deciding whether the approach is appropriate for the question being investigated.

Start by identifying what the researchers or authors were trying to establish and how they went about it.

For articles reporting original research

Consider questions such as:

• Is the research design appropriate for the question?

• How were participants, cases, documents or other sources of evidence selected?

• How was the information collected or produced?

• How was it analysed or interpreted?

• Are the methods explained clearly enough to understand how the findings were reached?

• What important limitations might affect the findings?

The questions you prioritise will depend on the research.

Quantitative research often involves numerical data. You might consider sample selection, measurements, comparisons, statistical analysis and whether other factors could explain an observed result.

Qualitative research may explore experiences, meanings, practices or processes. You might consider how participants or materials were selected, how interpretations were developed, whether they are supported by the evidence and how the researchers addressed their own assumptions or perspectives.

A smaller sample is not automatically a weakness in qualitative research. Its suitability depends on the research purpose, approach and claims being made.

For review articles

Review articles bring together existing research rather than necessarily reporting a new empirical study.

Consider:

• How were the sources identified and selected?

• Is the approach to reviewing the literature explained?

• Does the review engage with relevant research, including findings that differ?

• Where appropriate, has the quality of the included studies been considered?

• Do the conclusions reflect the range and limitations of the evidence reviewed?

A systematic review and a narrative review have different purposes and methods. Evaluate them according to the type of review they claim to provide.

For theoretical or interpretive articles

Some academic work develops arguments through concepts, texts, cases or existing scholarship rather than collecting new empirical data.

Consider whether the author's assumptions and reasoning are clear, whether interpretations are supported and whether relevant alternative arguments have been addressed.

The aim is not to impose experimental research criteria on every academic article.

Remember: You do not need to be an expert in every research method to recognise important questions. Where specialist methodological knowledge is needed, use relevant module materials and ask your tutor.

Once you understand the article's approach, examine what its evidence actually supports.

The key question is:

Do the conclusions follow reasonably from the evidence and analysis presented?

Examine the supporting evidence

Consider:

• What findings, observations, examples, sources or arguments support the main claims?

• Are the relevant findings or evidence explained clearly?

• Does the analysis address the original research question or purpose?

• Are there gaps, uncertainties or alternative explanations that matter?

• Is important evidence missing or insufficiently discussed?

In research using numerical data, examine relevant tables, graphs and reported results.

In qualitative or interpretive research, look at how examples, quotations, observations or other evidence support the author's interpretations.

The existence of data, references or detailed analysis does not by itself establish that a conclusion is justified. Consider how the evidence is being used.

Distinguish findings from interpretations

An article may report a finding and then explain what the authors believe it means.

For example, a study might find that two factors are associated. The authors may suggest a possible explanation for that relationship.

You should distinguish between the observed result and the explanation offered for it.

In particular, a relationship between two factors does not necessarily establish that one causes the other.

Consider limitations and uncertainty

Research can provide useful evidence without resolving every question.

Think about:

• Whether the findings apply beyond the people, materials or circumstances studied.

• Whether the authors have acknowledged important limitations.

• Whether other explanations remain plausible.

• Whether the strength of the conclusions matches the strength of the evidence.

An author acknowledging limitations is not automatically a sign of poor research. Recognising uncertainty and explaining what cannot be concluded can strengthen the credibility of an analysis.

Conversely, be cautious when conclusions extend beyond what the evidence can reasonably establish.

An academic article should engage with relevant research and scholarship. Its references help you understand how it relates to existing knowledge and investigate the evidence behind important claims.

Examine the references

Ask:

• Does the article engage with relevant research in its field?

• Are important claims supported by appropriate sources?

• Are the sources represented accurately?

• Does the article acknowledge research that challenges its argument?

• Are the references sufficiently current for the topic, while recognising the importance of older influential work?

You do not need to read every reference.

Instead, identify a few that are particularly important to the article's argument. Where necessary, consult the original source to see whether it supports the claim being made.

Look for other findings and perspectives

Compare the article with other relevant research.

For example, you might find that:

• Different studies report similar findings.

• Researchers reach different conclusions using different methods.

• Findings differ between settings, populations or circumstances.

• A later study challenges or develops an earlier explanation.

Disagreement does not automatically mean that one article is unreliable. It may reflect genuine uncertainty, different research questions or different approaches to the evidence.

Try to understand why the findings differ and what each study can reasonably contribute.

Use citation searching carefully

You can also investigate research published after an article by looking for later work that cites it.

Citation searching can help you discover subsequent findings, criticisms, developments or applications.

However, citation counts are not a measure of accuracy or research quality. Articles may be cited because they are influential, controversial, methodologically important or being challenged.

Use citation information to explore the wider research, not as a substitute for examining the article itself.

Information about the authors, journal and publication process can help you understand an article's context and identify matters that warrant closer examination.

However, these factors do not replace evaluating the article's evidence, methods and conclusions.

Authors and potential conflicts of interest

Consider:

• Do the authors have relevant expertise or experience?

• Are their affiliations and research context clear?

• Are funding sources or potential conflicts of interest disclosed?

• Could particular interests or assumptions have influenced the research question, approach or interpretation?

A funding relationship or declared conflict of interest does not automatically make research unreliable. It is a reason to examine the study and its interpretation carefully.

Similarly, an author's reputation or institutional affiliation is not proof that their conclusions are sound.

The journal and publisher

Consider whether the journal is relevant to the subject and whether its editorial and publishing practices are clear.

You may want to check its stated aims, editorial information and peer-review arrangements, particularly if you are unfamiliar with the publication.

Be cautious of journals that make misleading claims about their review process, publishing standards or editorial expertise.

However, open-access publishing is not itself a sign of poor quality. Many established academic journals publish open-access research.

A familiar publisher or prestigious journal may provide useful context, but neither guarantees the quality of an individual article.

What does peer review tell you?

Peer review involves assessment by other researchers or specialists before publication.

It can help identify weaknesses and improve research, but it does not guarantee that an article is accurate, free from bias or methodologically sound.

Even peer-reviewed articles can contain errors, limitations or findings that are later challenged.

For a fuller explanation, see Peer review.

Where relevant, also check whether an article has subsequently been corrected or retracted, and consider what any notice means for its use.

What about journal impact factors?

Journal impact factors and similar publication metrics describe aspects of citation activity at journal level.

They do not establish the quality or reliability of an individual article.

An article should be evaluated on its own merits, regardless of the journal's citation metrics.

Imagine you find an article investigating the experiences of students who commute to university.

The researchers interviewed 14 commuting students at one university. Several participants described difficulties attending social activities and developing a sense of belonging.

The authors conclude that commuting can create barriers to participation in university life.

How might you evaluate this article?

1. Identify the purpose

The study aims to understand the experiences of commuting students.

Interviews may be appropriate because they allow participants to explain their experiences in detail.

2. Examine the research approach

Consider how the 14 students were recruited, what questions they were asked and how their responses were analysed.

A relatively small group of participants does not automatically make the study unsuitable. The question is whether the research approach provides an appropriate basis for understanding the experiences investigated.

However, the participants may not represent all commuting students.

3. Evaluate the evidence

Look at how the authors developed their findings.

For example:

• Do quotations or other evidence support the themes identified?

• Are different experiences represented?

• Have the authors considered participants who did not report difficulties?

• Is the interpretation consistent with the evidence presented?

4. Consider the conclusions

The study may provide useful insight into barriers experienced by the participants.

However, it would not necessarily establish that all commuting students experience the same problems or that commuting itself causes a reduced sense of belonging.

The distinction matters because the evidence supports some conclusions more strongly than others.

5. Compare with other research

You might look for studies involving students at other universities or research examining different aspects of commuting and student engagement.

This could help you understand whether similar experiences have been reported elsewhere and what contextual factors may matter.

Your overall evaluation

A reasonable evaluation might be:

This study provides useful evidence about how some commuting students experience participation and belonging. Its interview-based approach is appropriate for exploring those experiences. However, its findings should not be treated as representative of all commuting students, and further evidence would be needed to establish how widely the identified barriers occur.

This is a reasoned judgement. It recognises both the study's contribution and the limits of what can be concluded.

This example is hypothetical. The appropriate evaluation questions will vary depending on the research design, discipline and purpose of the article.

For broader guidance on examining evidence, assumptions and arguments, see Critical Thinking and Analysis.