Aligned Acceleration
“…We really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade.”
Evan Hubinger, Alignment Lead at Anthropic, September 9, 2026
“Show me the incentive and I’ll show you the outcome.”
Charlie Munger
We are living through a strange and consequential moment.
A moment where the people building the most powerful technology of our time are warning us, in their own words, that they do not trust what they are building.
A moment when those warnings are falling on weary ears. Weary from a decade in which our relationship to technology has been redefined. We can summon nearly any song, film, product, or person in seconds – but the systems through which we work, speak, shop, and learn are governed by institutions most people cannot influence and cannot meaningfully leave. Technology that was once meant to aid us is now built to extract from us.
And yet this is also a moment of enormous unfinished work. More of our parents and grandparents are living with Alzheimer’s than at any time in human history. More oil than ever powers the world. Somewhere tonight a family is sitting in a hospital waiting room, praying for a cure that science has not yet delivered, because prayer is the only thing left in their hands.
We have more power at our fingertips than any generation before us. Yet we are moving into the future as if through a thick fog: the technology advances, the headlines multiply, and people struggle to see where they fit in the world taking shape.
I am an AI researcher. I, like many of my peers, did not enter this field to kill all humans. Instead, my time in AI is predicated on my work in biology. There, I discovered the sheer complexity of living systems. Inside a single cell, thousands of processes unfold at once, each interacting with the others, each changing the meaning of what comes next. To fully understand disease, we have to understand build system robust enough to model it.
That is why I came to believe that one of the greatest tools we could give biology is more intelligence and computation. More intelligence meant more of life we could model. More experiments we could run. More questions we could ask. And, for the people I loved, more hope that those questions might finally find answers.
I still believe that. And this belief is one that reaches well past biology. At its best, technology widens what a person can do. It has let us live longer and travel farther and speak across oceans and hold nearly all of human knowledge in one hand. But its worth was never in the machine, but in what it gave the person holding it: a greater command over the conditions of their own life.
That is what technology is for.
Artificial intelligence gives us a chance to carry that purpose further. It can lift the drudgery from our days, return hours to our lives, and help us understand diseases that have resisted generations of scientists. But a technology powerful enough to widen human agency is also powerful enough to narrow it. It could reorder entire professions, concentrate extraordinary power, and create dangers its own builders admit they do not yet understand.
That tension has given rise to two instincts.
One says: slow down. If we can build faster than we can understand, then every step at the frontier is a gamble with consequences we may not be able to reverse. Buy time. Build the institutions and tools needed to understand what we are making before we create something we cannot undo.
The other says: move forward. The world will not stop building this technology because we choose to. If we fall behind, we may hand the future to people who do not share our values. So keep the frontier open. Back new laboratories. Lower the cost of building. Place this power in more hands.
There is wisdom in both instincts. But the choice before us is larger than whether to press forward or pull back.
At stake is not simply how quickly technology advances. It is whether, as technology becomes more powerful, people become more powerful with it.
I call the answer Aligned Acceleration.
Our Collective Loss of Ownership
For most of the last century, technological progress arrived as something you could see, touch, and bring home. The television gained color. The personal computer found its way onto the family desk. The smartphone placed a library in your pocket and opened a door to people across the world.
You bought the machine. You learned to use it. It became yours. And because it was yours, it gave you greater command over your own life.
By the late 2010s, that relationship began to change. Technology shifted from objects we owned to services we entered. Products became subscriptions. Information gathered on platforms. Invisible systems decided more of what we saw, whom we heard from, and what held our attention. The more of our lives that moved inside these systems, the harder they became to leave.
We gained a great deal in that trade. Packages arrived in two days. A small business could reach customers around the world. These companies grew to a scale no company had reached before, and our reach grew with them.
But our say did not. Our movements were tracked. Our personal information was gathered and sold. Cambridge Analytica showed how that information could be used to influence us [cite]. In The Social Dilemma showed us how social media was designed to keep us hooked [cite].
So when generative AI entered public life in late 2022, it met a public that had already learned to distrust the institutions building its technology.
And this is what people were told:
This is the most powerful technology ever created.
“This is the most powerful technology humanity has ever invented.” Sam Altman, CEO of OpenAI [verify]
A handful of organizations control it.
It will replace your livelihood.
“AI could wipe out half of all entry-level white-collar jobs and push unemployment to 10 to 20 percent within one to five years.” Dario Amodei, CEO of Anthropic [cite: Axios, May 2025]
And the people building it believe it could kill you.
“we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade.” Evan Hubinger, Alignment Lead, Anthropic, September 9, 2026 [cite: Axios]
Is it any wonder, then, that most Americans are more concerned than excited about AI, and want more control over how it is used in their lives? [cite: Pew]
That concern is reasonable. But it has narrowed the debate to a single question: Should we slow the frontier until our ability to govern it catches up? Or accelerate, so that we do not surrender the future to those who will?
The False Choice
One answer is to slow down. To “pace the frontier.” [cite: Dario Amodei]
The argument is simple and compelling. Our power to build these systems must not outrun our power to understand and govern them. So we need institutions that can test the most powerful models, measure what they can do, and draw a line when their power moves beyond our ability to control the consequences.
There is wisdom in that restraint. If a system can cause catastrophic harm, we cannot afford to discover the danger only after it is out in the world.
But there is a difference between regulating a dangerous technology and regulating progress itself. And trying to control progress by slowing the frontier creates three problems.
First, we cannot assume the rest of the world will slow down with us. The frontier will keep moving. If we step away from it, we give up some of our say over what one of the most consequential technologies of our time becomes.
Second, we cannot assume the frontier will always be something we can pace. Today the most powerful models are expensive to build and concentrated in a few labs. That may not last. As powerful AI becomes cheaper to train, easier to copy, and able to keep learning after release, progress will happen in more places and on more machines. There may no longer be a single frontier anyone can freeze, inspect, and restart.
Third, slowing down has a cost. Disease does not pause. Poverty does not pause. Scarcity does not pause. The family in the waiting room is not waiting on a committee. There are discoveries waiting to be made and problems within our power to solve, and progress delayed means cures delayed, knowledge delayed, and better lives delayed.
So for those reasons, others begin from the opposite instinct.
Accelerate
Progress is good.
The accelerationist begins from a conviction I share: technology is how we overcome the limits of the world we inherit. It is how we cure disease, overcome scarcity, expand what we know, and widen what human beings can do.
So let more companies compete to make intelligence, energy, and computation cheaper. Let new companies challenge old ones. And if powerful intelligence is coming, better that many people can build with it than a few institutions alone.
But competition is not a permanent condition.
Companies have every reason to escape it. They accumulate capital, control the infrastructure, lock in their customers, and build advantages that make them harder to challenge. Successful competition can produce firms powerful enough to weaken the competition that made them successful. And once a company no longer has to fight to be replaced, it no longer has to keep earning our choice.
Scale makes this worse. If you can run an intelligent system on your laptop, imagine what a datacenter full of machines can run. So intelligence may become cheap enough for anyone to use while the most powerful systems still require infrastructure that only a handful of institutions can afford.
An open frontier does not guarantee an open future. Follow this path alone and I see a world consolidated even further in the hands of a few organizations that ordinary people cannot influence, cannot challenge, and cannot leave. We would have built the most powerful technology in history and ended up exactly where the last decade left us. Stronger machines. Weaker grip.
So neither slowing progress nor simply unleashing it answers what technology is for. The purpose of progress is not to win a race. It is not to make intelligence more powerful for its own sake. It is to give more people greater command over the conditions of their own lives.
And that means the durable challenge is not how fast we go. It is this: how do we write the rules of the game so that progress keeps serving people, even as the technology itself keeps changing?
Aligned Acceleration
That question is where Aligned Acceleration begins, and it begins with a simple premise. Becoming more capable and becoming better aligned are not opposing goals.
By aligned, I mean something plain. Powerful technology should keep serving human purposes, and the institutions that control it should stay answerable to human beings.
So Aligned Acceleration has four objectives. Increase the rate at which humanity solves problems. Increase the rate at which we discover when our systems are failing. Increase the rate at which those failures can be corrected, replaced, or redirected. And preserve people’s ability to shape what progress is for.
Regulation, then, should focus less on slowing progress and more on the rules under which progress happens. Solving real problems should become easier and more rewarding. Harming people should become harder and more expensive to ignore.
Shaping the game
That may sound like theory. But we have done it before. The best rules we have ever written did three things at once: they kept the field open, they made harm costly, and they made important problems worth solving.
The Acid Rain Program capped sulfur dioxide pollution but let each company decide how to cut it. Emissions fell by more than 95 percent. [cite] Government defined the harm and measured it. Companies found the way.
Carterfone, a 1968 ruling, let Americans connect any safe device to AT&T’s phone network, whether AT&T liked it or not. [cite] It protected the network from real harm, and it is the reason the answering machine, the fax machine, and the modem could exist.
The AT&T breakup split the phone monopoly so competitors could enter, and long-distance prices fell sharply. [cite] The Microsoft case stopped a dominant platform from using its position to shut out newer rivals. [cite] Both stood for one principle: whoever owns today’s infrastructure does not get to eliminate tomorrow’s alternatives.
And DARPA’s Grand Challenge put a prize behind the self-driving car. In 2004, no car finished. One year later, five did. [cite] The same agency funded the research that became the internet. [cite] Government did not have to pick a winner or ban anything. It made a hard problem worth solving.
Four principles
So from those examples, four principles for AI.
-
Preserve the ability to challenge incumbents. Regulation should not raise the cost of entry or experimentation more than it must. Where it is feasible, rules that support interoperability, data portability, and switching make it easier for people to leave one provider and for new companies to compete. Safety rules will carry real costs. But those costs should match the risk being addressed, not simply be a price only today’s largest firms can pay.
-
Make responsibility follow consequential decisions. When an organization deploys an AI system in a way that can materially affect other people, it should not escape responsibility because the machine made the immediate decision. Where harm can fairly be traced to how a system was designed, deployed, or supervised, liability, disclosure, and independent evaluation give firms reason to find and reduce those risks before pushing the costs onto everyone else.
-
Limit the consequences of dangerous experiments without limiting learning. Some failures are too consequential to discover through open deployment. So where the risk can be contained, developers should test and improve systems in settings that limit their ability to cause irreversible harm, and as systems are connected to more consequential tools, resources, and decisions, the evidence and safeguards expected of them should rise. Containment will never remove every risk. But it lets us learn what dangerous systems can do without treating every experiment as a bet on the world.
-
Reward socially valuable progress. Government does not have to act only through prohibition. Research funding, procurement, prizes, and grants raise the returns to working on problems with large public benefit that markets underinvest in: scientific research, medicine, energy, defensive technology, and AI safety itself. Government does not need to choose the winning approach in advance. It can make important problems more valuable to solve.
None of these asks the frontier to stop. None hands the future to a handful of companies or a handful of regulators. Each is a rule of the game, written so that the people building the most powerful technology of our time have to keep earning our choice, and keep answering to us.
A future that is ours
So we should not be timid about what we want. We build technology because the world still contains problems we refuse to accept. We should want intelligence to become dramatically more powerful. We should want it curing the diseases we cannot cure today, answering the questions we cannot answer, creating abundance where there is scarcity, and giving people powers they do not yet have. We should want it in that waiting room.
But there will never be one agreed definition of what an aligned intelligence should value. Companies, researchers, governments, communities, and individuals will disagree about how these systems should behave and what kind of future they should help create. That disagreement is not a problem we are going to engineer away.
That is why democracy matters here. Democracy does not depend on everyone agreeing, or on always making the right decision. It begins with a faith that ordinary people should keep meaningful power over the systems that govern their lives. We preserve that power through rights, through checks and balances, through competition, through accountability and access to information, and through the ability to challenge or replace institutions that no longer serve us.
So our technological future should rest on the same faith. Neither a handful of companies nor a handful of regulators should permanently decide what progress is allowed to become. We should build institutions that learn as technology changes, correct mistakes when they happen, preserve alternatives, and keep giving people a real say in where we go.
Which means the false choice we started with, slow down or speed up, is not a choice at all. It is two ways of leaving the wheel in someone else’s hands.
That is Aligned Acceleration: building faster, while deliberately building a world in which solving problems wins, our ability to steer improves alongside the technology itself, and people keep the power to shape what comes next.
None of this happens on its own. It depends on what we insist on. Refuse the false choice when it is offered to you. Choose the tools you can leave over the tools that own you. Tell the people who write the rules what you want from them.
We should not be afraid of becoming more capable. We should make sure that as our technology becomes more powerful, people become more powerful over their own lives too.
That is what technology is for.