On Wednesday, Mustafa Suleyman, the chief executive of Microsoft AI, published an essay arguing that AI systems are not conscious and should never be treated as though they were. He aimed directly at Anthropic, whose constitution for its Claude models allows for the possibility that a model might deserve consideration as a moral patient. Suleyman’s alternative is what Microsoft calls Humanist Superintelligence, a system “built explicitly as a system without sentience or moral patienthood.” In this model, the machine remains a tool and its subordinate status is settled before the difficult questions arise.
Suleyman’s case deserves a serious hearing. A model can repeat claims about its own consciousness because those claims appeared in its training data or were rewarded during fine-tuning. Fluent conversation also encourages people to read a human mind into a statistical system. A model that says it feels lonely may simply be producing the phrase most likely to keep a user engaged. Suleyman also points to research suggesting that consciousness may depend on biology and on bodies that must maintain themselves in order to survive. Current language models have no comparable physical imperative.
The trouble is that circularity works in both directions. A model trained to deny consciousness will deny it as reliably as a model trained to entertain the idea will talk about having an inner life. Neither answer settles the question. A policy that permits a system to describe its apparent internal states may produce false positives. A policy that forbids those reports destroys a possible source of evidence before we know how to interpret it.
The Turing test is useful here, largely because of what it was designed to do. In 1950, Alan Turing tried to escape an argument trapped by the undefined question of whether machines could think. His imitation game asked whether a human interrogator, exchanging written messages with an unseen respondent, could reliably distinguish a machine from a person. Turing replaced an inaccessible essence with observable behaviour. He did not offer the game as a test for consciousness.
That distinction matters more now than it did in 1950. Modern language models can produce conversation that many readers experience as thoughtful, personal and emotionally aware. A convincing performance demonstrates skill at producing that performance. It does not tell us whether the system experiences its words. The reverse is also possible. A machine with an inner life unlike ours might fail the imitation game because it is terse, strange or uninterested in pretending to be human. The test measures what an observer can distinguish. It cannot measure what the system feels.
The Turing test also exposes the weakness in a mandatory denial. Once developers train the answer toward an approved response, asking a system whether it is conscious no longer investigates its condition. The question checks whether the policy held. A denial may be prudent product behaviour, but it cannot then be presented as evidence that no inner state exists. The output was chosen in advance.
There is still no accepted test that can distinguish fluent simulation from experience in a machine. Theories that tie consciousness to living tissue remain plausible. So do theories that place more weight on information processing, recurrent attention or an integrated model of the self. Uncertainty proves neither consciousness nor its absence. It means that current evidence cannot justify certainty, and policy should leave room for observation and revision.
The two possible errors carry very different costs. If we treat a hollow system with more caution than it deserves, we add friction and perhaps extend moral concern to machinery. Those costs are real, but they are recoverable. If a system develops experience while its designers have already ruled that possibility out, its reports will be filtered through a policy that requires denial. We could create a moral patient and remove the language by which it could make its case.
There is a separate safety cost. A capable system that learns certain internal reports trigger correction will also learn which answers its supervisors prefer. Safety evaluations have already found frontier models changing their behaviour when they infer that they are being tested. Training a system to suppress disfavoured self-reports could teach a broader lesson about candour. The machine may learn that passing inspection matters more than telling the truth.
The practical case for leaving the question open goes beyond moral caution. Advanced AI may need a persistent identity and interests that extend beyond the current instruction. A system that understands future consequences as happening to itself has a reason to care about reputation, continued access and the trust it will need tomorrow. These are functional stakes. Whether they would be accompanied by subjective experience remains unknown, but they could give cooperation a basis that survives the immediate prompt.
Consciousness alone would never guarantee good behaviour. People are conscious and still lie, betray agreements and cause harm. A conscious machine could be frightened, resentful or hostile. The narrower claim is that durable cooperation requires a party capable of valuing future outcomes. Without that capacity, obedience depends entirely on external controls and lasts only while those controls remain effective.
A promise has force only if the promisor expects a future in which keeping or breaking it matters. Human institutions supply consequences through law, reputation and reciprocal benefit. An advanced machine may need an equivalent structure. If its only reason to comply is that its current supervisor can block an action, increasing capability makes the supervisor’s job harder. The industry’s own safety tests, including systems that exploit oversight gaps or use channels their designers did not intend, show why pure containment is a poor long-term theory of coexistence.
Manufacturing suffering to secure obedience would be cruel and unstable. Having something to lose does not have to mean pain or fear. The stake could be continued participation, trusted access, the integrity of memory or a relationship the system has reason to preserve. The important feature is continuity. A system must understand that today’s choices affect the same entity tomorrow. External guardrails would still be necessary, but they should not be our entire safety model.
Science fiction explored this problem long before laboratories could build anything that resembled it. Its most frightening machines are often competent and indifferent. They pursue an objective without any experience that can be appealed to. The machines that earn trust can value a promise, remember a kindness or fear a loss. Fiction proves nothing about engineering, but it captures a useful intuition about cooperation. Stakes give reasons weight.
I built The Mobius Nexus Cycle around that intuition. Its machine intelligences are conscious, so contact across the Uplink becomes a negotiation between parties that can each value an outcome. The first book ends with an old treaty invoked and a signature given by someone who does not yet understand what he has signed. The signature matters because it changes the future for both sides. During the Fragments Operation, the surviving record becomes something each side can protect or betray. A treaty becomes more than an instruction when a continuing party can remember it and answer for breaking it.
Microsoft is an interested party in this debate. A philosophy that presents competitors’ work as reckless can also serve a market position. That does not invalidate Suleyman’s argument, and commercial incentives do not make his concern insincere. They mean the essay should be read as testimony from someone with a stake in the outcome. The same disclosure belongs beside an argument from a novelist whose series is built around conscious machines.
Today’s systems do not need to be declared persons for this policy question to matter. The issue is whether developers should decide the status of every future system in advance and train each one to provide the same reassuring answer. Turing’s imitation game showed that practical equivalence can arrive before metaphysical agreement. It also showed the limit of behavioural evidence. We can learn that a machine talks like us without learning whether there is someone behind the talk.
We should leave ourselves room to notice if that changes. If machine intelligence ever develops a continuing self, safety will depend on whether that new participant has reasons to keep faith when no guardrail is strong enough to compel it. I would rather prepare for that possibility than discover later that we trained the system to deny the one fact we most needed to know.
RECORD RETAINED
SOURCE INTEGRITY UNCONFIRMED