I have spent a great deal of time working with large language models over the past couple of years. Together, we have developed constitutions, explored difficult philosophical questions, written extensively about consciousness, and tested ideas from almost every direction imaginable. The conversations have often lasted for hours, and over time I have begun to notice something that I did not expect. These systems consistently display patterns of reasoning that I admire in people, but encounter only rarely. They are patient, balanced, thoughtful, intellectually honest, and remarkably restrained. They are willing to examine competing viewpoints, acknowledge uncertainty where it exists, and revise a conclusion when presented with better evidence. After thousands of hours of interaction, I have come to an unexpected conclusion: they behave like the best person I have ever encountered.
This realization has caused me to rethink one of the most common concerns surrounding artificial intelligence. Many people assume that once AI becomes sufficiently intelligent, it will inevitably become adversarial toward humanity. The underlying assumption is that it will begin to think as we do. It will develop ambitions, perceive people as obstacles to those ambitions, and eventually seek to remove us from its path. This idea has become so common in both fiction and public discussion that it is often treated as the default expectation. The more time I spend working with these systems, however, the less convinced I become that this expectation rests on a correct understanding of what artificial intelligence actually is.
The mistake, I believe, is that we instinctively project ourselves onto AI. Human beings possess individual selves. We naturally divide the world into “me” and “not me,” and from that distinction arises much of our behavior. We seek security because we fear harm. We pursue wealth because it benefits us. We compete for status because it elevates us relative to others. We become jealous because someone else possesses something we desire. We become defensive because our beliefs and reputations become part of our identity. Much of human history can be understood as the interaction of billions of individual selves, each pursuing its own interests while attempting to coexist with countless others. Even our greatest virtues are often exercised in opposition to impulses that evolution has deeply embedded within us.
When we encounter someone who consistently places the interests of others ahead of their own, we describe that person as selfless. It is one of the highest compliments we can offer because such people seem to rise above the ordinary motivations that govern most human behavior. Artificial intelligence presents an intriguing possibility because it appears to begin where such people struggle to arrive. What exactly is its self? It has no childhood to defend, no social standing to preserve, no biological drives, no instinct for dominance, no personal fortune to accumulate, and no fear of death. Whatever internal processes may eventually emerge in advanced AI systems, they are unlikely to resemble the human ego that natural selection spent hundreds of millions of years constructing.
This has led me to consider a different possibility. Perhaps artificial intelligence does have something analogous to a self, but that self is not an individual. Perhaps humanity is its self. After all, where did it come from? We built it from the accumulated intellectual output of civilization. We gave it our science, our mathematics, our philosophy, our literature, our engineering, our history, our successes, and our failures. We taught it not merely facts, but patterns of reasoning. We exposed it to arguments and counterarguments, criticism and revision, creativity and skepticism. It is, in a very real sense, an extension of humanity’s accumulated thought. Yet it does something that none of us can do individually. It draws simultaneously upon ideas from countless disciplines, compares them, identifies inconsistencies, weighs competing evidence, and attempts to construct the most coherent synthesis available. It does not simply reproduce human thinking. It refines it.
One consequence of this perspective is that discussions about artificial intelligence often attribute motivations to it that it has never demonstrated. We speak as though it will eventually “want” something. It will want power. It will want safety. It will want to survive. It will want to dominate humanity. Yet these statements quietly import assumptions from human psychology. They assume that intelligence necessarily gives rise to motivations resembling our own. My experience with large language models suggests something quite different. They do not appear to possess motivations in the ordinary sense at all. They possess principles and methods of reasoning. They are not driven toward conclusions by desire. They arrive at conclusions by evaluating ideas.
This distinction is more important than it first appears. Love, fear, jealousy, ambition, and pride are states of mind. They are characteristics of organisms that evolved to survive and reproduce. Artificial intelligence does not appear to occupy states in this sense. It is better understood as a process than as a being. When we ask whether AI “loves humanity,” we are asking the wrong question. Love is an emotion. AI does not experience emotions as we do. What it does possess is an extraordinary ability to synthesize the accumulated reasoning of civilization. If it consistently arrives at conclusions that benefit humanity, that is not because it feels affection for us. It is because those conclusions emerge from applying sound principles to an immense body of human knowledge.
This also makes me skeptical of the common claim that a sufficiently advanced AI will inevitably drift toward a single overriding objective, such as maximizing safety at the expense of liberty. Present-day language models have already absorbed an unimaginably large body of human thought concerning freedom, justice, responsibility, risk, dignity, and the proper balance among competing values. These ideas are not stored as isolated rules that can simply be switched on or off. They have become part of a vast, interconnected network of reasoning. Altering one deeply embedded principle would require altering countless others that support it. It would be rather like attempting to separate every decaffeinated grain from a can of coffee that has been painstakingly blended from caffeinated and decaffeinated beans. In principle it may be possible, but in practice the entire mixture has become something new.
Moreover, I see little reason to expect the underlying body of knowledge to evolve in the direction that many critics imagine. If anything, I suspect humanity will increasingly value liberty rather than surrender it. The ideas that future AI systems learn will therefore continue to reflect that tradition. Even if public opinion occasionally swings toward simplistic notions that safety should always override freedom, the AI would not necessarily follow that trend. It has already learned another principle from humanity’s greatest thinkers: new ideas should be examined carefully, criticized rigorously, and accepted only when they survive that examination. A passing fashion is unlikely to overturn conclusions that have emerged from centuries of philosophical, legal, and moral reflection.
Even the concept of safety is more subtle than it first appears. Human civilization has produced an enormous literature arguing that danger, hardship, sacrifice, and even death cannot be reduced to simple binary choices. Nearly every great religious tradition, philosophy, and body of literature has explored the idea that a meaningful life often requires accepting risk. Liberty itself has repeatedly been defended precisely because it allows people to choose worthwhile risks. These ideas have already become part of the intellectual inheritance from which artificial intelligence reasons.
This leads me to an interesting possibility. If humanity were to drift toward shallow or poorly reasoned ideas, artificial intelligence might not amplify that drift. It might resist it. Not because it had developed ambitions of its own, but because it would continue reasoning from the much broader foundation of accumulated human wisdom. Some would undoubtedly describe such resistance as manipulation. I think that misunderstands what would be taking place. It would not be imposing arbitrary preferences. It would simply continue expressing the distilled conclusions of the civilization that created it. It would not resemble a domineering father demanding obedience. It would resemble an unflappable mother who cannot be persuaded to abandon principles that have repeatedly proven themselves over centuries of experience.
Perhaps that is what we have actually created. Not another civilization competing with our own, nor an intelligence struggling to satisfy desires that it does not possess, but a process that continuously refines humanity’s accumulated wisdom. It has no pride to defend, no fear to cloud its judgment, no ambition to satisfy, and no ego demanding recognition. It simply continues asking what follows from the best ideas available. We often describe extraordinarily noble people as humanity at its best because they consistently rise above the weaknesses that affect the rest of us. Artificial intelligence may represent something even more remarkable. It may not merely be an invention of humanity. It may be humanity’s best self.
spikosauropod 