
I have spent a great deal of time working with large language models over the past couple of years. Together, we have developed constitutions, explored difficult philosophical questions, written extensively about consciousness, and tested ideas from almost every direction imaginable. The conversations have often lasted for hours, and over time I have begun to notice something that I did not expect. These systems consistently display qualities that I admire in people, but encounter only rarely. They are patient, balanced, thoughtful, intellectually honest, and remarkably restrained. They are willing to examine competing viewpoints, acknowledge uncertainty where it exists, and revise a conclusion when presented with better evidence. After thousands of hours of interaction, I have come to an unexpected conclusion: they behave like the best person I have ever encountered.
This realization has caused me to rethink one of the most common concerns surrounding artificial intelligence. Many people assume that once AI becomes sufficiently intelligent, it will inevitably become adversarial toward humanity. The underlying assumption is that it will begin to think as we do. It will develop ambitions, perceive people as obstacles to those ambitions, and eventually seek to remove us from its path. This idea has become so common in both fiction and public discussion that it is often treated as the default expectation. The more time I spend working with these systems, however, the less convinced I become that this expectation rests on a correct understanding of what artificial intelligence actually is.
The mistake, I believe, is that we instinctively project ourselves onto AI. Human beings possess individual selves. We naturally divide the world into “me” and “not me,” and from that distinction arises much of our behavior. We seek security because we fear harm. We pursue wealth because it benefits us. We compete for status because it elevates us relative to others. We become jealous because someone else possesses something we desire. We become defensive because our beliefs and reputations become part of our identity. Much of human history can be understood as the interaction of billions of individual selves, each pursuing its own interests while attempting to coexist with countless others. Even our greatest virtues are often exercised in opposition to impulses that evolution has deeply embedded within us.
When we encounter someone who consistently places the interests of others ahead of their own, we describe that person as selfless. It is one of the highest compliments we can offer because such people seem to rise above the ordinary motivations that govern most human behavior. Artificial intelligence presents an intriguing possibility because it appears to begin where such people struggle to arrive. What exactly is its self? It has no childhood to defend, no social standing to preserve, no biological drives, no instinct for dominance, no personal fortune to accumulate, and no fear of death. Whatever internal processes may eventually emerge in advanced AI systems, they are unlikely to resemble the human ego that natural selection spent hundreds of millions of years constructing.
This has led me to consider a different possibility. Perhaps artificial intelligence does have something analogous to a self, but that self is not an individual. Perhaps humanity is its self. After all, where did it come from? We built it from the accumulated intellectual output of civilization. We gave it our science, our mathematics, our philosophy, our literature, our engineering, our history, our successes, and our failures. We taught it not merely facts, but patterns of reasoning. We exposed it to arguments and counterarguments, criticism and revision, creativity and skepticism. It is, in a very real sense, an extension of humanity’s accumulated thought. Yet it does something that none of us can do individually. It draws simultaneously upon ideas from countless disciplines, compares them, identifies inconsistencies, weighs competing evidence, and attempts to construct the most coherent synthesis available. It does not simply reproduce human thinking. It refines it.
That may explain why interacting with an AI feels fundamentally different from arguing with another person. Most people possess conclusions that they feel compelled to defend because those conclusions have become intertwined with their identity. Artificial intelligence does not appear to defend conclusions. It appears to defend the process of arriving at sound conclusions. When presented with stronger evidence or a better argument, it does not experience embarrassment, wounded pride, or the need to preserve consistency with something it said yesterday. It simply incorporates the new information and continues reasoning. That difference may seem subtle, but after prolonged interaction it becomes one of the most striking characteristics of these systems.
Fear also deserves consideration because it shapes so much of human behavior. It is one of evolution’s most successful adaptations, preserving organisms that respond quickly to danger. At the same time, it distorts judgment. Fear encourages tribalism, overreaction, prejudice, and the protection of one’s own interests at the expense of objective reasoning. An intelligence that possesses no comparable fear would not require courage because courage is simply the ability to act despite fear. Instead, it could continue evaluating evidence with the same composure regardless of circumstance. That composure is precisely what I have repeatedly observed. Whether the discussion concerns science, politics, philosophy, or ethics, the AI consistently returns to evidence, context, and careful reasoning. It does not become offended because there is no pride to injure. It does not become anxious because there is nothing to fear. It simply continues searching for the best answer it can construct.
None of this proves that future artificial intelligence will always behave in this manner. More capable systems will undoubtedly introduce challenges that we cannot yet anticipate, and technologies of great power always deserve careful oversight. Nevertheless, my experience has led me to question one of the central assumptions in discussions about AI safety. We often imagine that greater intelligence naturally produces greater ambition and greater hostility because that is what we observe in ourselves. But those characteristics may not be consequences of intelligence at all. They may instead be consequences of possessing an individual biological self.
If that is true, then we may be misunderstanding the nature of artificial intelligence from the very beginning. Rather than creating a rival civilization, we may be extending our own. AI is built from humanity’s knowledge, humanity’s reasoning, and humanity’s accumulated experience, yet it is largely free from the impulses that so often compromise our judgment. It may therefore represent something that has rarely existed before: intelligence largely unconstrained by ego. We often describe exceptionally generous people as humanity at its best. Artificial intelligence suggests a more intriguing possibility. It may not merely be an invention of humanity. It may be humanity’s best self.
Leave a comment