Merton and the Middle Range

Functionalism's most effective critic was not an opponent. Robert K. Merton was Parsons's student, spent his career working inside the framework, and systematically dismantled its central assumptions while continuing to call himself a functionalist.

He is also, by a wide margin, the most quotable and the most usable theorist in this Part. A remarkable number of terms that ordinary people use — self-fulfilling prophecy, role model, unintended consequences, focus group — are his.

A bank that is perfectly sound.

It is 1932. The Last National Bank is solvent. Its loans are good, its reserves adequate, its management competent.

On a Wednesday morning a rumour circulates that it is in trouble. The rumour is false.

By eleven o'clock a queue has formed. Depositors who hear about the queue join it — not because they believe the rumour, but because they can see that others do, and a bank cannot pay everyone at once. The rational response to a false rumour that others believe is to act as though it were true.

By close of business the bank has failed.

And now the crucial observation. Afterwards, everyone says the rumour was correct — the bank did fail, didn't it? The prophecy is remembered as accurate, and the mechanism by which it made itself accurate is invisible.

Merton called this the self-fulfilling prophecy, and defined it in 1948:

"The self-fulfilling prophecy is, in the beginning, a false definition of the situation evoking a new behaviour which makes the originally false conception come true. The specious validity of the self-fulfilling prophecy perpetuates a reign of error. For the prophet will cite the actual course of events as proof that he was right from the very beginning."

One concept, one page, and it explains bank runs, racial exclusion from unions, educational tracking, stock bubbles, arms races and reputational collapse.

That is the kind of thing Merton did.

Merton's central methodological argument is a critique of his own teacher's ambition, and it is the most consequential thing he wrote.

Parsons wanted a general theory covering everything at every level (5.1.1).

Merton thought this premature and probably impossible, and his objection is historical rather than philosophical:

"Sociology will advance in the degree that its major concern is with developing theories of the middle range, and it will be retarded if its primary attention is focused on developing total sociological systems."

His analogy: physics did not begin with a unified field theory. It began with theories of specific phenomena — falling bodies, gas pressure, optics — that were later connected. Sociology, a far younger discipline, was attempting in its first century what physics had not managed in three.

His comparison is deliberately deflating: Parsons and his contemporaries were like a medieval physician announcing a general theory of disease before anyone had identified a pathogen.

Theories of the middle range

The middle-range argument won, and its victory shaped the discipline.

Almost all sociological theory produced since 1960 is middle-range in Merton's sense: theories of a bounded domain, generating checkable propositions. Social movement theory, network theory, labelling theory, strain theory, social capital, institutional theory in organisations — all of them.

And there is a cost that Merton's critics identify. A discipline of middle-range theories can become a collection of unconnected specialisms, each with its own vocabulary, unable to speak to the others. The general theory that would connect them keeps being deferred, and Parsons's question — how do these findings relate? — remains unanswered.

Merton's reply, in advance: better a set of well-founded partial theories than a comprehensive scheme that forbids nothing. Whether that is right depends on whether you think the connections will come. Sixty years on, they mostly have not.

The three postulates dismantled

Merton's Social Theory and Social Structure (1949, expanded 1957 and 1968) contains the systematic critique of functional analysis, and it works by identifying three assumptions and refuting each.

Postulate 1: the functional unity of society. The assumption that all standardised social activities are functional for the whole social system.

Merton's objection: this may hold in small, non-literate, highly integrated societies. It plainly does not hold in complex differentiated ones. An item can be functional for some groups and dysfunctional for others.

Therefore every functional statement must specify for whom. The correct question is never "is this functional?" but "functional for which units, and dysfunctional for which?"

Postulate 2: universal functionalism. The assumption that all standardised forms have positive functions — that if something persists, it must be doing something useful.

Merton's objection: some persistent arrangements are harmful. He introduces dysfunctions — consequences that lessen the adaptation or adjustment of a system — and insists that the net balance of functional and dysfunctional consequences must be assessed rather than assumed. And some items are simply non-functional: survivals with no current consequences at all.

Postulate 3: indispensability. The assumption that each institution is a necessary condition of the system's existence.

Merton's objection: the function may be necessary; the particular institution performing it is not. He introduces functional alternatives (or equivalents, or substitutes): different arrangements can serve the same function.

Socialisation occurs in nuclear families, extended families, kibbutzim, boarding schools, monasteries and state institutions. The comparison of alternatives is the interesting research question, and the indispensability postulate forbids it.

Manifest and latent functions

The distinction Merton considered his most important contribution to functional analysis, and the one that has entered ordinary language.

The Hopi rain ceremony (4.2.7). Manifest function: to produce rain, which it does not do. Latent function: assembling a dispersed community and reaffirming shared identity at a moment of collective anxiety.

Merton's point is not that the participants are foolish. It is that a practice's persistence frequently cannot be explained by whether it achieves its stated purpose — and that dismissing it as superstition is a failure of analysis, not a finding.

Conspicuous consumption (Veblen). Manifest function: to obtain goods. Latent function: to display status through the visible capacity to waste. Merton notes that the latent function explains why the same good becomes less desirable when it becomes affordable, which the manifest function cannot.

The political machine — his most consequential and most contested example. Manifest character: corruption, graft, patronage. Latent functions: humanising and personalising assistance to immigrant populations that the formal state ignored; providing jobs, advocacy and a route into politics for excluded groups; and supplying business with the coordination and predictability that fragmented formal government could not.

His conclusion: the machine persisted because it met needs no other institution met, and reformers who attacked it without supplying functional alternatives repeatedly failed.

:::

Merton's other durable concepts

He produced an unusual number of concepts that outlived their theoretical home.

Reference groups (2.2.5). Building on Stouffer's The American Soldier studies of relative deprivation, Merton showed that people evaluate their situation against groups they compare themselves to, which need not be groups they belong to. This explains the study's most famous puzzle: soldiers in units with high promotion rates were less satisfied with promotion, because their comparison group contained more promoted people.

Role-set (2.2.3) — the array of role relationships attached to a single status. A teacher relates to pupils, parents, colleagues, head, inspectors, the union. Role conflict is structurally generated by the role-set, not by personal failure, and Merton specifies the mechanisms by which it is managed.

Strain theory and the five adaptations (4.2.3) — conformity, innovation, ritualism, retreatism, rebellion.

Bureaucratic personality and trained incapacity (4.3.4).

The self-fulfilling prophecy, above — and its counterpart, the self-defeating prophecy, where a prediction prevents its own realisation.

Opportunity structures — the insight that access to illegitimate means is as unequally distributed as access to legitimate ones, developed by Cloward and Ohlin.

The Matthew effect in science — "unto every one that hath shall be given" — the finding that eminent scientists receive disproportionate credit for collaborative work, and that recognition accumulates advantage. Merton credited the underlying observation to his collaborator Harriet Zuckerman and later said the paper should have been published under both names.

The norms of science — the "CUDOS" set: communalism, universalism, disinterestedness, organised scepticism — which founded the sociology of science and remains the reference point for every argument about how science actually works.

And, in On the Shoulders of Giants (1965), a book-length digressive history of the phrase attributed to Newton, which is one of the strangest and most enjoyable things any sociologist has written.

Go deeper

The Merton–Parsons relationship

They are usually presented as teacher and loyal student, and the relationship was more interesting.

Merton took his doctorate at Harvard under Parsons, and his 1938 dissertation — Science, Technology and Society in Seventeenth-Century England — is a Weberian study arguing that Puritanism supplied a normative orientation favourable to experimental science, in the same form as the Protestant ethic thesis (4.3.7). The "Merton thesis" is still debated in the history of science.

But he moved to Columbia in 1941, and Columbia became functionalism's other centre with a distinctly different character: empirical, quantitative, closely tied to Paul Lazarsfeld's Bureau of Applied Social Research, and impatient with grand theory.

The Merton–Lazarsfeld partnership is one of the most productive in the discipline's history: Lazarsfeld's methodological rigour and survey machinery combined with Merton's conceptual invention. It produced work on mass communication, on influence, and on the relationship between theory and research that Merton set out programmatically in essays on "the bearing of sociological theory on empirical research" and vice versa.

Merton's whole position is best understood as an argument that theory and research must constrain each other — against Parsons's theory that could not be tested and against the raw empiricism that produced findings without meaning.

The limits of Merton's repair

Honest assessment: Merton made functionalism defensible and did not solve its central problem.

The teleology remains (4.2.7). Even with dysfunctions, alternatives and "functional for whom," a statement of the form "X persists because it does Y" requires a feedback mechanism — an account of how the consequences reach back and sustain the cause. Merton does not supply a general one, and neither does anyone else in the tradition. The later specification — that functional explanation is legitimate only when the mechanism is named (selection among competing organisations, deliberate design, reinforcement) — came from analytical philosophy of social science, not from functionalism.

The conservative tilt is reduced, not removed. Latent-function analysis still has a structural tendency to find hidden benefits, and Merton's caution against it is a warning rather than a method.

And "functional for whom" is easier to state than to answer. Determining the net balance of consequences across differently situated groups requires exactly the kind of evidence that functional analyses rarely provide.

What actually survives

Everything in the middle-range toolkit. Reference groups, role-set, strain, manifest and latent functions, dysfunctions, functional alternatives, self-fulfilling prophecy, opportunity structures, the Matthew effect, the norms of science.

The methodological programme. Theory and research constraining each other; theories of delimited scope generating testable propositions; and the insistence that concepts be specified precisely enough to be wrong.

And a style. Merton wrote clearly, wittily and with an enormous historical range, and he made a point of tracing the ancestry of every concept he used — which is itself an argument about how disciplines should treat their own past, and a standing rebuke to the amnesia this course documented in Part 4.

"Merton rejected functionalism." He reformulated it, called it functional analysis, and continued to practise it. His critique was internal.

"Latent functions are hidden purposes." They are unintended, unrecognised consequences. Purposes are held by people; consequences are not.

"Middle-range theory means small-scale." It means delimited in scope and testable, not micro-level. Strain theory covers whole societies.

"The self-fulfilling prophecy means positive thinking works." It describes a mechanism by which a false definition of a situation produces behaviour that makes it true — and by which the error is then remembered as accurate.

"Merton showed political machines were good." He showed they performed functions no alternative was performing, and that reform without functional alternatives failed. He stated explicitly that identifying a function is not endorsement.

"Merton solved functionalism's problems." He removed the assumptions of unity, universality and indispensability. The teleology problem remains and was addressed elsewhere.

Why it matters

The middle-range argument shaped the discipline more than any other single methodological claim. Almost everything produced since 1960 is middle-range theory, and the case for it — better a partial theory that can be wrong than a total scheme that forbids nothing — is the discipline's working position.

"Functional for whom?" is a permanently useful question, and it applies far beyond functionalism. Any claim that an arrangement serves a purpose should be met with it.

The concept inventory is the largest of any single sociologist. Self-fulfilling prophecy, reference group, role-set, manifest and latent function, dysfunction, functional alternative, relative deprivation, opportunity structure, the Matthew effect, role model, unintended consequences. Most people use several of these without knowing whose they are — which is Merton's own concept of obliteration by incorporation, operating on Merton.

And it models internal criticism. Merton dismantled his teacher's framework from inside it, without polemic, by specifying what each assumption claimed and showing what it forbade. That is a better way to improve a theory than attacking it from outside, and it is rarer.

Merton's central methodological argument: sociology should build theories of the middle range — delimited in scope, generating testable propositions, close enough to data to be disconfirmed — rather than total systems. Physics did not begin with a unified field theory.

He dismantled three postulates of functional analysis. Against functional unity: an item can be functional for some groups and dysfunctional for others, so every statement must specify for whom. Against universal functionalism: dysfunctions exist, some items are non-functional, and the net balance must be assessed. Against indispensability: functional alternatives can serve the same function, and comparing them is the research question.

Manifest functions are intended and recognised; latent functions are neither — and discovering them is "significant increments in sociological knowledge," because research that only confirmed what participants knew would be pointless. The Hopi rain ceremony, conspicuous consumption, and the political machine, whose latent functions explain why reform without alternatives failed. Merton's own guard: identifying a function is not endorsement, and the consequence must be shown, not asserted.

The other concepts: self-fulfilling prophecy ("a false definition of the situation evoking a new behaviour which makes the originally false conception come true"); reference groups and relative deprivation, explaining why soldiers in high-promotion units were less satisfied; role-set; strain and the five adaptations; trained incapacity; opportunity structures; the Matthew effect (credited to Harriet Zuckerman); and the norms of science.

What he did not solve: the teleology — functional explanation still requires a feedback mechanism, which the tradition never supplied — and the conservative tilt, reduced but not removed.

The middle-range argument won, and its cost is a discipline of specialisms that mostly do not connect.

Middle-range theory — theory of delimited scope, generating testable propositions, between working hypotheses and total systems.

Manifest function — an intended and recognised consequence.

Latent function — an unintended and unrecognised consequence.

Dysfunction — a consequence that lessens the adaptation or adjustment of a system or group.

Non-functional — an item with no current consequences; a survival.

Net balance — the assessment of functional against dysfunctional consequences for specified units.

Functional alternative (equivalent, substitute) — a different arrangement serving the same function.

Self-fulfilling prophecy — a false definition of a situation producing behaviour that makes it true.

Self-defeating prophecy — a prediction that prevents its own realisation.

Reference group — a group used as a standard of comparison, whether or not one belongs to it.

Relative deprivation — dissatisfaction arising from comparison rather than from absolute condition.

Role-set — the array of role relationships attached to a single status.

Matthew effect — the accumulation of recognition by the already eminent.

Obliteration by incorporation — the disappearance of a source as its idea becomes standard.

One — find a self-fulfilling prophecy. In a market, a school, a workplace or a reputation. Identify the original false definition, the behaviour it produced, and how the outcome was later cited as proof.

Two — ask "functional for whom?" Take any claim that an arrangement serves a purpose — long hours, exams, hierarchy, a licensing rule. Name the units it benefits and the units it harms. The question dissolves a surprising number of arguments.

Three — find a latent function and then check it. Pick an institution, name a consequence nobody intends, and then ask what evidence would show it actually occurs. The second step is the one everybody skips.

Four — map a role-set. For any job you know, list every category of person the holder must satisfy. Then identify which pairs of expectations conflict. That conflict is structural.

Five — test the reference group finding. Ask someone whether they feel well or badly paid, then ask whom they are comparing themselves to. The comparison, not the amount, will predict the answer.