Why methods sections feel frustrating — and why that matters for scientific interpretation


Methods sections are often described as “hard to read”.
But the issue is rarely technical difficulty. More often, it’s that methods aren’t clearly communicating what the experimental design can — and cannot — support.

This post outlines a way of reading methods sections that treats them not as tutorials, but as constraint documents that define credibility.


The core idea

Methods sections are not educational texts.
They are not protocol manuals, and they are not meant to be memorised.

Their primary job is to define:

  • the unit of inference
  • the class of evidence being generated (observational, perturbational, mechanistic)
  • the error and replication structure

The results section tells you what happened.
The methods section tells you whether it had to happen, or whether alternative explanations remain plausible.

If that framing isn’t clear, readers are forced to reconstruct it themselves — often silently, under time pressure.


Why this causes problems in practice

When methods fail to make inference constraints explicit, several predictable issues arise:

  • non‑independent observations are treated as independent
  • technical replication is mistaken for biological replication
  • evidence classes are blurred, leading to over‑interpretation
  • credible uncertainty is replaced by rhetorical confidence

These are not rare or trivial problems. They sit underneath many reproducibility failures in the biomedical literature.

Crucially, this is as much a methods‑reading problem as a methods‑writing one.


A better reading question

Instead of asking:

“Do I understand every technique used here?”

A more productive question is:

“What does this experimental design rule out?”

You do not need to understand every experimental detail to assess credibility.
But you do need to understand what the methods make impossible to conclude.

Once that information is clear, weak claims tend to collapse early, while strong papers become much easier to recognise.


Educational note

This framework applies across career stages:

  • Students benefit by learning to identify the type of experiment before judging its significance.
  • Early‑career researchers learn to match claims to evidence class.
  • Reviewers and clinicians use methods as a credibility filter rather than a technical checklist.

The principles are the same; the depth of interrogation changes.


Further Reading

This post is part of a wider set of teaching materials on how to read the biomedical literature critically.

A video walkthrough using real examples — including observational studies, platform papers, and spatial multimodal cancer research — is available here:
https://youtu.be/NdLaJbV-0kM

Additional insight on the closed loop of ‘read well to write well’ can be found here:
https://furtherreadingacademy.substack.com/p/why-methods-sections-feel-so-frustrating?r=7is68c


This piece was adapted from a longer essay originally published on Substack. It has been edited for clarity and educational use.

Happy Reading!

Leave a Reply