Blog
Most Papers Add Very Little. That May Be Fine.
Most social-science papers add only a little. The problem is not small contributions; it is the performance that they are larger than they are.
“This paper adds very little.”
It is one of the harsher things one scholar can say about another scholar’s work. It may also be true surprisingly often.
That sounds worse than I mean it. Most social-science papers probably do add very little: a new case, a modest association, a boundary condition, a replication, a somewhat better measure, a useful distinction, a result from a population that has not been studied before, or a clarification of something researchers routinely get wrong.
Very little. But perhaps that is not the scandal. The stranger thing is how reluctant we are to admit that this is how much of social science actually works.
The Compromise Machine
Empirical social science is built from compromises. We rarely study exactly the population we care about. We study a sample, and that sample is often less representative than the broad language of the paper makes it sound. It may consist of college students, online panel participants, patients from one hospital, users of one platform, residents of one country, people willing to answer a survey, or whoever remains after exclusions and missing data.
Then comes the construct. We care about things such as trust, identity, culture, attention, persuasion, credibility, belonging, well-being, political hostility, or knowledge. None of these enters a spreadsheet by itself. We decide what the construct means, decide how to operationalize it, and then decide how to measure that operationalization.
A five-item scale becomes “trust.” Country becomes a proxy for culture. “Engagement” becomes clicks, likes, comments, or time on page. A self-report becomes attention. An intention becomes a behavioral outcome. A three-item scale becomes credibility. Sometimes these are excellent measures. They are still reductions.
Then come more decisions. Which observations count? What is an outlier? What do we do with missing data? Which variables belong in the model? Which controls are defensible? Which specification is primary? How much power is enough? What counts as an acceptable reliability coefficient? Which robustness checks matter? When is an effect too small to care about?
Every answer is partly methodological and partly practical. Research would be impossible otherwise. That is not an accusation. It is simply what happens when researchers try to turn complicated human life into analyzable evidence.
The published article often reads as though a clean theoretical question entered a clean method and produced a clean answer. The real process is usually closer to this:
important question → feasible question → measurable question → analyzable question → statistically supportable claim
Something is lost at every arrow. That is normal. It should also make us modest.
The Important Question and the Smaller Answer
A research question can be important while the answer produced by one study is not especially important. This distinction sounds obvious once stated, but it is surprisingly easy to forget.
Suppose the broad question concerns political polarization. That is important. The actual study, however, may establish only a small association between two self-reported variables in one sample at one point in time. Suppose the question concerns culture. That is important too, but the evidence may compare residents of two countries using a scale that captures only one limited dimension of what the authors call culture. A study about health communication may begin with an urgent public-health problem and end with a modest short-term difference on an attitude scale measured immediately after exposure.
The original problem remains important. The final claim has become much narrower.
That is exactly what empirical research is supposed to do. Evidence should constrain what we are allowed to say. But there is a consequence we rarely discuss: importance does not automatically survive the journey from research question to empirical claim.
The question may be large. The answer may be small. Sometimes very small.
Very Little Is a Normal Unit of Knowledge
Academic writing has developed a vocabulary that makes small contributions sound embarrassing. We “advance theory,” “extend the literature,” “offer a novel framework,” “fill a critical gap,” “deepen understanding,” and “provide important implications.”
Sometimes those phrases are accurate. Sometimes a paper really does change how a field thinks. Most papers do not.
Most papers add something smaller. They show that an effect also appears in another context, or fails to appear there. They separate two things that were previously treated as equivalent. They provide a cleaner description, reproduce a result, fail to reproduce one, identify a boundary condition, organize a scattered literature, provide better data, or show that a familiar interpretation goes farther than the evidence allows.
These are not intellectual revolutions. They can still be useful.
Knowledge does not have to advance by earthquake. Sometimes it advances by correcting one sentence. The problem is not that most contributions are small. The problem is that academic institutions often reward us for pretending they are larger than they are.
The Performance of Contribution
Read enough journal articles and a strange pattern appears. The Introduction explains why the problem is enormous. The literature review discovers an important gap. The Results identify something statistically defensible. The Discussion then works very hard to reconnect that modest finding to the enormous problem from the Introduction.
Sometimes that connection is justified. Sometimes several inferential kilometers quietly disappear.
A local finding becomes a theoretical advance. A difference becomes a mechanism. A new population becomes a major extension. A statistical interaction becomes a boundary condition. A reorganized set of existing ideas becomes a new framework. A reasonable clarification becomes a methodological contribution.
This is not always deception. Often it is simply the language scholars learn to use. Journals ask for contribution. Reviewers ask, “What is new?” Editors ask whether a paper advances the field. Authors respond rationally.
The result is a system in which modest knowledge is routinely described in immodest language.
Once every paper is expected to claim advancement, another problem appears: the system needs ways to rank whose advancement counts more. That is where contribution language starts to bleed into status language.
The experimentalist may distrust the survey researcher. The quantitative researcher may dismiss the qualitative researcher. The theorist may dismiss the empirical paper as atheoretical, while the empirical researcher dismisses the theorist for having no data. The computational researcher may treat scale as rigor; the interview researcher may treat depth as understanding. Everyone has a reason why somebody else’s evidence is less pure.
But these are not positions outside compromise. They are different locations inside it.
Contribution theater does not merely inflate claims. It also encourages scholars to convert methodological tradeoffs into status differences.
Dressing Like Hard Science
Social science has long borrowed tools and norms from fields that can often measure their objects with much greater precision. Much of this has been beneficial. Better measurement is good. Power analysis is good. Transparent methods are good. Replication is good. Preregistration can be useful. Formal modeling can be useful. Open data can be useful.
The problem begins when the appearance of precision is confused with the achievement of precision.
Human beings are not electrons. Culture is not temperature. Identity is not mass. Trust is not voltage. Political ideology does not sit inside a person waiting to be read by an instrument. Researchers construct ways of observing these things. Sometimes those constructions are excellent. They remain constructions.
A sophisticated statistical model cannot recover information that the design never captured. Three decimal places do not make an ambiguous construct less ambiguous. A large sample does not automatically repair poor operationalization. A preregistration does not make a weak question important. A tiny p value does not turn a trivial effect into a consequential one. Causal vocabulary does not create identification.
No amount of statistical machinery eliminates the basic fact that social researchers are turning complicated human life into analyzable representations.
This does not make social science useless. It makes social science difficult. But difficulty should produce humility, not swagger.
Everyone Pays Somewhere
Every study pays for feasibility somewhere. A laboratory experiment buys control by losing realism. A nationally representative survey buys population coverage while usually sacrificing depth. A qualitative interview buys depth while limiting generalizability. A computational study buys scale while often losing construct richness. An archival study gains access to actual historical behavior while inheriting whatever variables happened to survive.
A cross-sectional study gains practicality while giving up much of what would be needed for causal inference. A longitudinal study improves temporal information but introduces attrition, cost, and new selection problems. Even excellent designs move uncertainty around rather than eliminating it.
There is no methodological position outside tradeoffs. There are better and worse research designs for particular questions, but there is no design that escapes compromise altogether.
That should matter for how scholars judge one another. We are all trading something for feasibility somewhere. It is strange to construct an elaborate hierarchy of intellectual status around pretending otherwise.
Maybe “Very Little” Is Enough
None of this means every paper deserves publication. Some studies are poorly designed. Some arguments are wrong. Some findings are too weak to support the claims built on them. Some manuscripts really do add so little that the literature would lose nothing if they disappeared. Editors have every right to make those judgments.
But there is a difference between saying, “This contribution is not large enough for this journal,” and imagining that worthwhile scholarship must always amount to a large contribution.
Most knowledge is cumulative. If that is true, then most individual increments should be small. That is not a defect in the system. It may be the only way the system can work.
Perhaps the better questions are simpler. Is the claim true? Is the evidence adequate for it? Is the distinction real? Does the analysis tell us something we did not know quite as clearly before? Will somebody avoid an error because this paper exists? Will another researcher have a slightly better starting point?
If the answer is yes, perhaps “very little” is not a devastating description. Perhaps it is simply an honest unit of progress.
Social science might be healthier if we stopped requiring every brick to describe itself as a cathedral.
Most papers add very little. Fine. Add the little thing carefully, say exactly how little it is, and stop pretending everyone else’s compromises are somehow more embarrassing than our own.
Discussion
0 comments
Comments are reviewed before they appear. Email is optional and is never displayed publicly.

No approved comments yet.