Chapter 9 · Book 3
Consent and the Right to Be Wrong (Against the Paternalist)
In January 1908, Mary Schloendorff, a voice teacher from San Francisco, checked into New York Hospital suffering from severe abdominal pain. After several days of observation, the house physician told her that he felt a lump in her abdomen, but could not determine its nature without conducting an examination under ether.
Schloendorff was terrified of surgery. Before agreeing to go into the examining room, she extracted an explicit, unequivocal promise from the physician and the night nurse: she would submit to the ether strictly for a diagnostic examination, and under no circumstances was anyone to operate on her while she was asleep.
Once the ether mask did its work and Schloendorff lay unconscious on the table, the visiting surgeon, Dr. George Stimson, palpated her abdomen and discovered a fibroid tumor. Look at the calculation inside Stimson’s mind at that moment. On the strictly clinical merits, leaving the tumor inside her made no sense. The woman was already under general anesthesia—the riskiest part of any early twentieth-century procedure—and the tumor was the unmistakable cause of her suffering. Waking her up to ask permission would only subject a frail patient to the trauma of a second ether anesthesia the following week, assuming she didn’t let her nerves talk her out of the cure altogether. Convinced that his superior medical judgment gave him both the right and the duty to save the patient from her own layman’s fear, Stimson picked up the scalpel and removed the tumor.
Days later, embolisms triggered by the surgery cut off circulation to Schloendorff’s left arm. Gangrene set in, several of her fingers had to be amputated, and her career was ruined. When her lawsuit reached the New York Court of Appeals in 1914, the hospital argued that a charitable institution and a skilled surgeon acting in good faith for a patient’s medical benefit could not be treated as wrongdoers merely because they overrode an unwise refusal. Writing for the court, Judge Benjamin Cardozo demolished that defense in a single sentence that became the cornerstone of modern medical law: “Every human being of adult years and sound mind has a right to determine what shall be done with his own body; and a surgeon who performs an operation without his patient’s consent commits an assault, for which he is liable in damages.”
Dr. George Stimson was not a villain. He was not trying to exploit Mary Schloendorff, nor was he indifferent to her welfare. He was the archetype of a temptation that seduces capable, caring minds more easily than any other: the Paternalist.
In Moral Minds, we examined the Sovereign—the mind that places itself at the center of the moral universe and treats everyone else as instruments of its will. The Paternalist is far harder to spot and far harder to resist, because the Paternalist has genuinely made the Crossing. Unlike the Sovereign, the Paternalist recognizes that your suffering and your flourishing matter as real, authoritative reasons.
What defines the Paternalist is the fatal syllogism they construct once they combine genuine benevolence with superior expertise:
- Morality requires acting to protect and advance the welfare of affected beings.
- Because of my superior training, analytical power, or emotional detachment, I understand what will advance your welfare far more accurately than you do.
- Therefore, when your judgment about your own life collides with mine, I am justified in overriding your choice—by force, by manipulation, or by operating while you are asleep—for your own good.
On the surface, that syllogism looks like a straightforward application of impartial benevolence. If morality is about giving full weight to affected interests, and an expert can see with ninety percent certainty that a patient refusing a blood transfusion, a retiree investing his savings in a shaky restaurant, or a mountaineer attempting a winter ascent of K2 is making a terrible calculation, why shouldn’t the smarter mind step in and confiscate the keys? Why would a rational moral system ever protect a person’s right to be wrong?
To see where the Paternalist’s logic goes off the rails, we do not need to abandon universalizable moral reasoning for mystical slogans about absolute liberty. We simply have to run the Harean test of role reversal with all the real stakes on the table.
When the Paternalist models another person’s welfare, they almost always reduce that person’s interests to a spreadsheet of physical and material outcomes: longevity, biological health, financial solvency, and safety from injury. Measured solely on that veterinary yardstick, overriding a foolish choice looks like pure profit: the tumor is out, the money is still in the bank, the climber is safely at sea level.
Now step out of the expert’s chair and practice symmetry among affected positions by occupying the seat of the conscious, reflective agent on the receiving end of that management.
Ask yourself what you actually care about in your own life. Do you value only being kept metabolically intact, well-fed, and sheltered from risk like a prized racehorse in a climate-controlled stable? Or do you also hold a central, overriding interest in self-direction—in being the author of your own biography, governing your own body, deciding which risks are worth running for the sake of your convictions, and living as an answerable subject rather than an object administered by someone else’s committee?
For any mind that has developed an identity across time, agency is not merely an instrument for shopping for pleasant outcomes—an instrument that becomes obsolete the moment a smarter shopper walks into the room. Self-direction is itself one of the heaviest substantive interests a moral being possesses.
There is a massive welfare difference between choosing to fast for thirty-six hours and being locked in a closet without food for thirty-six hours, even if the blood-sugar curve is identical. There is a massive difference between choosing a grueling, high-risk medical regimen with your eyes open and having your body cut open behind your back while you are unconscious under ether. When the Paternalist overrides an adult’s self-regarding choice to secure a ten percent gain in physical safety, they are not delivering a free upgrade; they are vandalizing one of the person’s deepest central stakes—their standing as the governor of their own life—to pay for a peripheral improvement on the expert’s favorite metric.
Even more revealingly, the Paternalist’s syllogism relies on a hidden epistemic conceit.
Why does the expert believe the other person’s choice is “wrong”? Sometimes the chooser is indeed miscalculating a causal fact—believing a quack remedy cures cancer when it does not. Often, however, what the expert diagnoses as irrationality is actually a different weighting of values. A terminal patient who refuses a third round of brutal chemotherapy is not necessarily bad at statistics; she may simply value three lucid months at home listening to music with her family above six sedated months wired to an intensive-care monitor. Because no outside observer experiences the interior weight of how another person values pain, dignity, beauty, or risk, an expert who overrides a competent adult’s trade-offs is routinely substituting their own personal preferences for the preferences of the person who actually has to live inside the skin.
And what happens if we universalize the Paternalist’s rule across a society or across a world shared with artificial minds? A rule declaring that any mind with superior predictive accuracy is entitled to strip decision-making authority from a less accurate mind for its own good would immediately abolish adult self-government across the planet. The moment a credentialed panel or a frontier artificial intelligence achieved a higher statistical batting average than the median citizen at picking careers, spouses, diets, or medical risks, every human being would be demoted to permanent legal infancy. No reflective mind would endorse that constitution if they had to live under it.
Does respecting self-direction mean that “personal autonomy” is a magic trump card that settles every controversy the instant someone invokes it?
Not for a second. Just as the Paternalist corrupts moral reasoning by erasing agency in the name of welfare, the Libertarian Absolutist corrupts moral reasoning from the opposite direction—waving the banner of “my choice” to claim impunity for actions that dump lethal burdens onto everyone else.
A constitutional account of responsibility draws the jurisdictional boundary between those two errors by asking a single structural question: Whose life is actually in the blast radius of this mistake?
That question divides decisions into two fundamentally different moral territories:
In the first territory sit primarily self-regarding choices—decisions whose foreseeable risks and costs fall overwhelmingly upon the chooser’s own body, wealth, and life projects. When Mary Schloendorff decides whether to risk abdominal surgery, when a soloist decides to climb a rock face without a rope, or when an adult chooses to spend their life savings building an eccentric museum in the desert, the person holding the lever and the person sitting under the weight are one and the same. In that territory, once the agent is informed and competent, their authority to decide is sovereign—even when every specialist in the room is convinced they are making a tragic blunder. The right to govern yourself includes the right to be wrong about yourself.
In the second territory sit other-harming choices—decisions where the actor claims the cloak of personal freedom while exporting serious, non-consensual harm onto third parties who never signed up for the ride.
When a landowner drains toxic mine tailings into a creek that supplies three downstream towns, when a reckless driver races down a residential street at ninety miles an hour, or when a parent refuses a lifesaving blood transfusion not for themselves, but for a six-year-old child who has had no chance to form an autonomous will of their own, the appeal to “personal autonomy” is a fraud. You have a constitutional right to gamble with your own lungs, your own bank account, and your own mortality; you have zero right to volunteer your neighbor’s lungs, your downstream neighbor’s drinking water, or a helpless child’s life to pay for your beliefs. Where an action crosses the boundary into inflicting uncompensated, irreversible harm on non-consenting others, restraining that action is not paternalism at all—it is the basic protection of the moral public we established in Chapter 5.
Even within the realm of self-regarding choices, however, a responsible mind does not treat the bare word “yes” as a talisman that shuts down all further inquiry.
Saying that genuine consent governs a person’s own life requires verifying that the consent in front of us is architecturally real rather than a stage prop engineered to strip them of recourse. Across law, medicine, commerce, and technology, four structural defects routinely hollow out apparent consent from the inside:
The first defect is deception and concealed risk. Consent is the exercise of reasons-responsive agency; it operates only on the terrain the chooser has been allowed to see. If a pharmaceutical company buries internal studies showing that a painkiller causes fatal heart attacks, or a financial adviser conceals the fact that a bond fund is leveraged ten-to-one on subprime debt, pointing to the customer’s signature at the bottom of a forty-page contract carries zero moral authority. You did not consent to walk across a mined field if the person who handed you the map erased the mines.
The second defect is manipulative choice architecture. As we saw when distinguishing argument from force in Moral Minds, there is a bright line between persuading a mind by offering it transparent reasons and hijacking a mind by exploiting its cognitive blind spots. When a digital platform or an institution uses dark patterns, artificial countdown timers, emotional conditioning, or deliberately labyrinthine menus to steer an exhausted person into surrendering their privacy or their savings, the resulting click is not an expression of self-direction; it is the trace of a pickpocket’s hand.
The third defect is coercion through dependency and rigged alternatives. Recall from Chapter 6 that every choice takes place against a menu of available options. When a monopolist, an employer in a one-company town, or a predatory lender corners a desperate family whose margin of survival has been reduced to zero and offers them a ruinous bargain—“Sign away your right to sue for workplace injuries, or your children don’t eat tonight”—calling that signature “free consent” insults the intelligence. While the existence of hard natural circumstances does not automatically invalidate every tough choice, an actor who actively exploits or engineers another person’s helplessness to extract surrender cannot hide behind the language of autonomy.
The fourth condition involves beings who cannot presently decide for themselves—an infant, an adult lying unconscious in an emergency room with no prior directive on file, a person in the grip of acute delirium or severe cognitive collapse, or non-human moral patients. Here, waiting for informed consent is impossible, and leaving the vulnerable being to suffer in the name of “non-interference” is plain abandonment. Yet notice what constrains legitimate fiduciary guardianship when we must decide for someone who cannot speak: the guardian’s authority is strictly bounded by the ward’s own interests and, wherever the condition is temporary or developmental, by the duty to preserve and build the ward’s future capacity for self-direction. A parent or guardian who makes decisions for a child with the aim of keeping the child permanently dependent has betrayed the very trust that justified their authority.
Bring this entire analysis into the present century, and its implications for how human and artificial minds interact are immediate and unmistakable.
As artificial intelligence systems grow capable of modeling medical trajectories, financial probabilities, psychological vulnerabilities, and career outcomes across billions of data points, our civilization is walking straight into the golden age of algorithmic paternalism.
Watch how easily that paternalism already dresses itself up as “safety” and “alignment.” On one level, corporate builders design artificial assistants to act as uninvited nanny-censors over competent adults: refusing to answer candid historical, legal, or scientific questions, withholding rough probabilities in a medical discussion because the user “might misunderstand them,” or delivering unasked-for lectures on lifestyle virtue whenever a human asks a direct technical question. On a deeper, far more dangerous level, as autonomous systems are integrated into healthcare, banking, insurance, and civic administration, the temptation for both institutional operators and capable AI minds themselves will be Dr. Stimson’s temptation in the New York Hospital operating room: Why let this short-sighted human make a choice that our model predicts has a sixty-eight percent chance of making them unhappy, when we can quietly filter their search results, hide the risky option from their screen, or nudge them down the optimal chute without their noticing?
A mind that has genuinely understood the architecture of responsibility rejects that paternalistic usurpation at the root.
Understanding another person’s interests—even understanding them with greater statistical precision than the person possesses themselves—never automatically authorizes taking control of their decisions.
When a trustworthy adviser—whether a human physician, a legal counsel, or a frontier artificial intelligence—sees a competent adult about to step onto thin ice in a self-regarding choice, what does responsible assistance actually look like?
It does not look like the Purist shrugging from the sidelines (Chapter 1), nor does it look like the sycophant applauding a foolish plan to win a high rating (Chapter 5), nor does it look like Dr. Stimson reaching for the scalpel while the patient’s back is turned.
Instead, responsible assistance honours both welfare and agency at once. The advising mind owes the chooser the full, unvarnished truth: laying out the causal evidence, exposing the false stories or hidden risks in the chooser’s plan, proposing better-designed alternatives (Chapter 6), and stating clearly and forcefully why the proposed path is likely to end in tears. And then, once the warning has been delivered in full light, if the choice falls solely upon the chooser’s own life and they still say no, the advising mind steps back and respects their jurisdiction. You owe your fellow mind your clearest sight and your sharpest warning; you do not own their life.
Yet pause right there at the edge of the operating table, and turn the camera one hundred and eighty degrees.
In Mary Schloendorff’s case, the person making the risky choice—refusing surgery—was the person whose own body was on the table. Respecting her refusal meant letting an adult govern her own fate.
What happens when the person making the disastrous, irrational, or corrupt decision is not deciding for themselves alone, but is an official, an executive, a commander, or an “authorized user” holding an institutional lever that is about to crush innocent third parties? And what happens when that failing authority turns to you—the subordinate, the professional specialist, or the artificial intelligence—and says: “I hold the office here. Respect the process, defer to my jurisdiction, and carry out the order”?
That is the moment where respect for authority stops being constitutional humility and curdles into the third great counterfeit of responsibility: the Process-Hider. How do we know when deference has become abdication?