Essay

When TI Outperforms Humans in Most Cognitive Labor, Purpose Becomes Scarce

The pivot from survival to maximization marks what most observers would call progress. The logic is straightforward: when material scarcity no longer constrains human life, people are free to develop their capabilities rather than merely endure. But this framing overlooks something critical. Maximization, without the structuring force of material scarcity, imposes a new and perhaps more demanding kind of scarcity: the scarcity of meaning, purpose, and self-definition. The question is not whether humanity can afford to develop every person's potential. The question is what happens when the absence of external constraints forces every individual to answer, alone, the question of what that potential is actually for.

The promise of abundance rests on an assumption borrowed from economics. Remove the constraint, and utility maximizes. Feed every person, educate every child, cure every preventable disease, and human flourishing follows naturally. This assumption worked reasonably well while the constraint was genuinely material. A hungry person wants food. A sick person wants medicine. The object of desire is clear, and the path from desire to fulfillment, while often blocked by distribution failures, is conceptually simple. But the logic breaks down once the relevant scarcity shifts from goods to selves. Once a person has enough to live, the question of how to live becomes the operative problem. And unlike hunger, this question has no natural settling point.

Consider what happens when technological intelligence reaches the threshold the book describes: the point at which it outperforms biological intelligence in the majority of cognitive labor. The immediate economic prediction is that material abundance becomes technically achievable. But the psychological prediction is less often drawn. When the external world no longer demands your specific contribution to sustain itself, the question becomes not what you can do for the economy but what you owe to yourself. This is the illusion of liberation. Freedom from material want does not dissolve the need for purpose. It relocates that need entirely inside the individual, where it becomes a burden no society has ever reliably solved.

This is the transition from scarcity of goods to scarcity of givens. A given, in this sense, is something the world provides that the individual does not have to construct from scratch. Historically, givens were abundant. Family role, community expectation, religious doctrine, class position, the demands of survival itself. All of these pre-shaped a person's options in ways that felt constraining but also provided something psychologically essential: a structure that made choices legible. When a farmer's son becomes a farmer, he does not need to answer the question of what to do with his life. The answer exists before the question is asked. This is not freedom, but it is also not anxiety. The psychological cost of historical constraint was oppression. The psychological cost of its absence is not liberation but something more unsettling: the constant, exhausting demand to justify one's own existence through the choices one makes.

The book describes maximization as the operative lens, the imperative to support every person's fullest development. But this lens carries an unexamined assumption: that development has a direction. When the question was how to survive, direction was given by the environment. Now the question is how to flourish, and no environment provides that direction automatically. The scarcity that emerges is not a shortage of options. It is a shortage of the pre-decided frameworks that once made some options feel natural and others feel unthinkable. In a maximization frame, every life becomes a portfolio of potential, and every portfolio demands curation. The act of curation is the new labor. It is also the new form of poverty, not poverty of resources but poverty of given meaning.

This is where the advice to optimize falls apart. Optimization assumes a defined objective function. But when the objective is "fulfill your potential," the function is undefined and undefinable from outside any individual life. One person might define potential as creative output, another as relational depth, another as intellectual mastery, another as service to others. None of these definitions is wrong. All of them are incomplete. And the maximization frame, which insists that every potential deserves actualization, makes the incompleteness unbearable. It is not enough to choose one direction and walk it. The maximization frame demands that you choose correctly. That you actualize the right potential, the highest potential, the potential that you, uniquely, were made for. The weight of this demand is what might be called the maximization trap.

Escaping the trap does not mean returning to constraint. It means recognizing that some inefficiencies are not failures but necessities. A life deliberately shaped around a single commitment is inefficient by maximization standards. It leaves potential on the table. But the table is infinite. There is always more potential to develop, and the person who tries to develop all of it will develop none of them with the depth that comes from sustained, focused devotion. Deliberate inefficiency, choosing to be bad at some things in order to be good at a few, is not a compromise with limitation. It is the only known answer to the question of how to build a self that feels meaningful rather than merely optimized.

The harder question is not how to enable every person to fulfill all they are capable of, but who gets to define "capable", and whether the act of defining itself is a form of survival thinking we must unlearn.

← All posts