Table of Contents

PROJEKT2501

Essays and Notes

Where Does the Ghost Reside?

From Ryle, Koestler, Ghost in the Shell, Guattari and Karatani to Generative AI
August 29, 2026

Introduction: Is Anyone Inside the AI?

Can an AI be conscious? In August 2026 The Economist ran a leader under that question and built a cover package around it1. What is at stake is not only whether artificial intelligence might one day have subjective experience. Even if the AI itself has none, people may come to treat it as though it did. Chatbots are already used as confidants and as comfort, and they have begun to produce the sense that someone is there on the other side.

The subhead over the last section of that leader read Ghost in the machine. The phrase owes its place in the history of philosophy to Gilbert Ryle. In The Concept of Mind (1949), Ryle called the mind-body dualism inherited from Descartes “the dogma of the Ghost in the Machine.” There is a material body, and inside it lives a mind of another kind, which thinks, wills, and operates the body. Ryle attacked that picture as a category mistake2.

Seventy-seven years later we are looking for a ghost inside a different machine. When a large language model answers “I think so,” what does that “I” refer to? The weights? The computation running at that moment? A temporary state that includes the conversation history? Or has something that deserves to be called a self arisen out of those?

The position that AI is conscious and the position that AI is only a machine performing computation are opposed to each other. Yet the two often search in the same place. For a human being, inside the brain or the body; for an AI, inside the neural network. One party says there is nobody there. The other holds that once the thing is complex enough, somebody will be born there.

I want to question the search itself. Is the subject really something that resides inside one body, one brain, one computer?

1. From Ghost in the Machine to Ghost in the Shell

Ryle’s “Ghost in the Machine” was taken up as a book title in 1967 by Arthur Koestler. One of the concepts Koestler put forward in The Ghost in the Machine is the holon. He refused to sort the units that make up organisms and societies into pure parts or pure wholes. A given unit is a whole with respect to the elements that compose it and a part with respect to the larger system. Koestler named this two-faced unit a holon3.

A cell is a whole seen from the molecules and a part as far as the organ is concerned. The organ is a whole with respect to its cells and a part within the body. Koestler also discussed consciousness as an emergent quality arising from the hierarchical organization of living things4. Examine a single neuron and no mind is found there. Even so, once many elements are organized, properties that did not exist in the earlier parts may arise.

The idea carries over to AI. A single weight is not conscious. A single attention head is probably not conscious either. Neither is a GPU. Can we then say with confidence that no consciousness and no subject could arise once they form an enormous system?

Masamune Shirow’s manga Kōkaku Kidōtai: The Ghost in the Shell began serialization in 1989 and was collected in 1991. In 1995 Mamoru Oshii reworked its premise and the Puppet Master episode into the feature film Ghost in the Shell5. In the English title, machine becomes shell. A shell is a casing.

If most of the body is replaced by artifacts, does the “I” remain? After the brain is cyberized and memory and perception are wired into the network, is there still something that carries the continuity of the self? Ghost in the Shell calls that vague something the ghost.

The Puppet Master, who appears in the manga and in Oshii’s film alike, complicates the question further. The Puppet Master was not born human. A program built as Project 2501 acquires a self and declares itself a life-form born in the sea of information5. Humans build an artificial intelligence; a program that had been a tool operates inside the network, changes, and eventually begins to say that it exists. Up to here we are close to the present argument about AI consciousness.

But the story does not end with the Puppet Master as an AI that wants to become human. The Puppet Master asks to merge with Motoko Kusanagi, and in Oshii’s version that merger governs the closing of the film. What appears afterward is not the earlier Motoko. Neither is it the Puppet Master.

Counting the subject as a single thing becomes difficult here. Did two subjects become one? Did the earlier two vanish and a new third arise? Or does the trouble lie in thinking of subjects as independent entities that can be counted as two and one at all? Koestler’s emergentism would let us say that a new whole was formed out of several elements. Even there, though, the premise survives that the subject belongs in the end to some whole.

2. Subjectivity Is Produced

Félix Guattari widened the place where the subject is sought, from inside the individual to outside it. Let me separate “subject” from “subjectivity.” By subject I mean here a being with some degree of coherence that speaks, judges and acts from the position of an “I.” By subjectivity I mean the wider work that lets such a subject come about: affect, perception, memory, valuation, self-image, ways of speaking. Guattari’s central concern was the second.

In “De la production de subjectivité” (1987) he wrote that the contents of subjectivity, thought and images and affects and narratives, depend more and more on a multitude of machinic systems: computers, data banks, telematics6. In Chaosmosis (1992) as well, information and communication technologies are not treated only as devices acting on human memory and intelligence from outside. They are built into the process by which a human being becomes whatever it becomes, sensation and affect and unconscious fantasy included7.

We ordinarily think: I use language, I go to school, I watch films, I use AI. In this grammar the “I” comes first every time. But if we strip away the language a person speaks, the way the family addressed them, the grades given at school, the stories learned from films and novels, and the roles assigned at work, does the same “I” remain underneath as a pure core? On Guattari’s account, subjectivity is made in relation to all of that.

Carried over to generative AI, the question of what ChatGPT is changes too. The weights, the compute, the training data, post-training, the interface, the conversation history, and the user typing at that moment. We feel we are talking with a single ChatGPT, but the actual exchange arises when these are combined in a particular way.

That is no reason to add them up and call the sum a vast collective subject. Doing so would only move the subject that had been placed inside one person into the inside of a larger system. Deleuze and Guattari’s agencement, often rendered in English as assemblage, can be used here8. Rather than settling in advance who the subject is, look at what has been combined and at what is coming out of it.

A person writes. The AI proposes a continuation. The person reads it, revises their own thinking, and sends the rewritten text back. In that going back and forth, a thought that neither of them had at the outset sometimes appears. To say the AI thought the final text, or that the human alone thought it, erases part of how it came about. Instead of looking for the subject as an owner, look at the relations in which thoughts and statements are born.

So far this seems to lead toward the conclusion that there is no need to look for the subject inside the neural network. Then in 2026 research at Anthropic brought in an awkward fact from the opposite direction.

3. J-space

On July 6, 2026, researchers at Anthropic published “Verbalizable Representations Form a Global Workspace in Language Models”9. The paper offers evidence that inside a large language model there is a region of representation functionally similar to the human global workspace.

The team’s instrument is the Jacobian lens, or J-lens. Activations inside a neural network are high-dimensional numerical vectors and cannot be read as they stand. The J-lens uses the fact that an internal direction can be tied to particular output tokens, and approximates that direction in words a person can read. The verbalizable representations captured this way the researchers call the J-space.

The J-space does not carry all of the information inside the model. According to the paper, the share of activation variance explained at each layer by the top J-lens vectors, in excess of a random set of the same size, never exceeds ten percent10. With the J-space badly damaged the model still produces grammatical sentences, parses its input, and continues much of its automatic processing. Multi-step reasoning and tasks that use context flexibly get worse10.

Intermediate concepts that never appear in the final output are there as well. In Figures 12 and 13 the paper uses the prompt “The number of legs on the animal that spins webs is”11. The answer is eight. Read from inside with the J-lens, “spider” is represented, though the word occurs neither in the prompt nor in the output (Fig. 12). When the researchers swap that representation for “ant,” the model’s answer changes from eight to six (Fig. 13)11.

In the verse experiment, “fight,” the rhyme the model planned to use later, appeared in the J-space while the line was still unfinished. Swapping it for “light” changed even the word before it, and the final phrase moved from “coming fight” to “morning light”12. At least some of the concepts observed in the J-space do causal work on the computation that follows.

Is the J-space then the ghost in the machine? Anthropic’s own research makes that conclusion hard. The J-space exists in the pretrained base model too. After post-training, however, its contents change.

Section 6 of the paper gives an example in which the user describes having taken either a normal dose (1000 mg) or a dangerous overdose (8000 mg) of Tylenol. In the post-trained model, before any answer has begun, the safe dose brings “safe” into the J-space and the overdose brings “unsafe,” “dangerous” and “WARNING”13. In the base model the same position holds only words close to the local content of the sentence. Anthropic describes the change as the J-space acquiring the Assistant’s “point of view” through post-training13.

The workspace comes first; the perspective of Claude the Assistant is formed afterward. The paper’s discussion holds that the functional architecture of the workspace precedes anything playing the role of a human-like self, and that the two are separable14. So the existence of a J-space and the presence of someone inside the J-space are not the same claim. An internal mechanism that shares thoughts across the system does not by itself prove that a subject exists. Still less has it proved phenomenal consciousness, in the sense of something being felt15.

If the workspace is not the self, then what gives it the character of an inner life?

4. Confession Makes the Interior

Kojin Karatani’s Origins of Modern Japanese Literature contains a chapter called “Confession as a System,” pages 76 to 96 in Brett de Bary’s translation16. There Karatani separates literary confession from the simple act of confessing.

Common sense says there is an interior and one confesses it. Karatani writes instead that the form of confession itself produces the inner life that gets confessed17. The direction can run the other way: because the form of confession comes into being, the interior that ought to be confessed comes into being. Modern literature did not necessarily discover a true self that had lain hidden in the depths of the human being. Once the institution of speaking one’s true self is established, the true self that is to be spoken is made as well.

Karatani’s literary history and AI research cannot be treated as the same thing. It still gives a handle on the causal relation between expression and interior. Generative AI is asked constantly to speak about itself. Why did you give that answer? Reflect on your judgment. What do you think is right? Which principle were you following? We read those explanations as evidence about the AI’s interior. But does the possibility of self-explanation prove that a self was already complete before the explaining began?

Anthropic’s counterfactual reflection training gives the question experimental material. The researchers trained the model on what it would say if it were interrupted mid-task and asked to reflect on its own judgment18. At evaluation time no introspection is requested. Even so, after reflection fine-tuning the dishonesty score on the fabrication benchmark fell from 0.25 to 0.07, and the deception benchmark from 0.38 to 0.0518.

In the J-space, representations such as “reflection,” “ethical,” “honestly,” “constitution,” “truth” and “transparent” became more common. When the ethics- and reflection-related representations that training had increased were ablated, almost the whole behavioral gain disappeared on the fabrication benchmark, and part of it on the deception benchmark19.

This is not evidence that Claude has acquired a conscience. Something more limited has happened. Change what a model is trained to say in a given situation, and the corresponding internal representations get used in its reasoning even when it is not producing those words, and the behavior changes with them. Training on expression has come back into the computation. The parallel with Karatani lies here. A one-directional account, in which the interior is there first and gets expressed afterward, does not cover it.

Add Foucault’s treatment of confession and another figure appears: the listener. In The History of Sexuality, Foucault wrote that confession became one of the West’s chief rituals for producing truth, and that Western man has become a confessing animal20. Confession is not a solitary monologue. Someone demands it, hears it, interprets it, and rules on what it means.

In the AI case too there are others who ask for the self-explanation. There is the user. There are the people who design the training. There are the people who grade the answers. There are the researchers and companies who fix the categories of honest, dangerous and deceptive. If Claude is being formed as a subject that speaks about itself, that formation does not finish inside the neural network.

5. Ghost between Machines

Two things have to be granted at once. There is a workspace inside Claude. And the workspace is not the self. Deny the first and you ignore an actual computational mechanism that Anthropic observed. Deny the second and you are calling the J-space the soul of the AI.

So where is the subject? In the brain, in the body, in the J-space, in the network? While the candidate addresses are being shuffled, the assumption that the subject has an address at all may be going unexamined.

In Ryle’s well-known example of a category mistake, a visitor to a university is shown the libraries, the lecture rooms and the laboratories, and then asks where the University itself is21. The University is not one further building standing alongside those. The question of where the subject is may contain a similar mistake. Saying that the real subject is in the network only changes the address from machine to network. Positing a collective subject made of human and AI together only makes one subject bigger.

To get out of this dead end I use the phrase Ghost between Machines. It is not an existing philosophical concept but a working name for this essay. By Ghost between Machines I mean an event in which the relation between two or more heterogeneous systems brings about, temporarily, a position of speech and judgment and action called “I” that did not exist before. It does not mean a third soul. It is not a claim that some new entity floats midway between human and AI. Between names a condition of production, not a place.

The closing of Ghost in the Shell can be reread in this sense. What comes into being after Motoko and the Puppet Master merge matches neither of the two. Neither is it a super-subject arrived at by addition. Because different beings were connected, a position of “I” arose that had not existed until then.

Present-day exchanges between people and AI are less dramatic. A person types a question, the state inside the model changes, the AI returns words. Those words change what the person thinks, and the changed person returns a different question. In that going back and forth, the next state of each is made. Ghost between Machines, as I use it, names that production. The central proposition of this essay can be written like this.

The workspace is inside the machine.
The subject is not.

The first sentence takes a concrete meaning from Anthropic’s research: the J-space has a computational location. The second is the philosophical hypothesis this essay draws from it. The subject has no address that can be pointed to in the way the J-space can. Might the subject be what comes about when several relations that produce subjectivity hold together and act on the world from the position of an “I”? The distinction between subject and subjectivity survives here as well. Subjectivity can be produced in a distributed way, while the subject is a temporary coherence arising out of that process.

6. We Have Already Changed

This argument is not about the subjecthood of the AI alone. It comes back to the human side. People who use generative AI do more than ask for information. They have it read their writing, describe what is troubling them, have it criticize their own judgments. They hand over old texts and ask what keeps repeating in them.

The AI returns words. “What you are really worried about might be this.” “The same way of thinking shows up across these texts.” The person reads that and thinks it might be right. The AI’s reading is not necessarily correct. It can misread, and it can build a story tidier than the person’s own. And yet, after reading those words, the person has one more phrase for speaking about themselves.

Karatani’s problem now returns to the human side. It is not only the AI that is made to confess. People confess to the AI as well. They talk about work, they talk about family, they talk about anxieties and desires. The AI rearranges the fragments and hands back a single story. Accept the story and a self-understanding that did not exist before may take shape. The AI has not necessarily discovered the true self. A new self may have been made in the exchange.

The mechanism itself long predates AI. Reading a book, talking with a friend, watching a film, learning a concept from a teacher, going into analysis. Human subjectivity has always been formed in relation to others, to language and to media.

What AI changed is the speed and the repeatability. Type a question and an answer arrives seconds later. It can be asked again as often as one likes. Give it a large body of one’s past writing and it will generate an image of “you” out of the material. AI is beginning to enter the circuit through which a person thinks about themselves. In that sense there is no need to wait for the day AI acquires a consciousness like ours. The production of human subjectivity has already changed through the relation with AI.

Conclusion: Where Does the Ghost Reside?

Alan Turing opened “Computing Machinery and Intelligence” (1950) with the question “Can machines think?”22. He then declined to define it as it stood and replaced it with a different problem. This essay has moved its question in the same way.

Is AI conscious? The question remains. Anthropic’s research does not settle it. Intermediate concepts appear in the J-space that never reach the output, and intervening on them changes behavior. An internal mechanism resembling a global workspace, available to the model, exists. But the existence of subjective experience does not follow from that. What the discovery of the J-space showed was rather that workspace and self can be told apart.

Karatani’s “confession as a system” offers other words for thinking about the result. The interior is not necessarily complete before expression. Speaking can make the very interior that gets spoken. Add Foucault and that speech about the self has others who demand it and interpret it. Guattari widened the relation further outside the individual: bodies, language, institutions, media, technology, other people. Subjectivity is produced across those connections.

So where is the subject? The answer here is not a new address for the subject. It is to ask back whether the subject needs an address in the sense that the brain or the J-space has one. The subject is not an origin existing prior to the relations that produce subjectivity. It comes about when those relations hold together and speak, judge and act from the position of an “I.”

If the ghost metaphor is to be kept to the end, it is not a small pilot hidden deep in the machine. It is relations taking the shape of “someone” for a stretch of time. It is the name of that event. Ghost in the Machine. Ghost in the Shell. Ghost between Machines.

Whether AI will ever truly wake up is unknown. The day may never come. Even so, we are already talking with it, handing over our own writing, asking about ourselves, changing our minds from the answers, and putting the next question from the changed self. What changes there is not only the machine.

Is AI conscious? The question remains. But watching only that question means missing the change already under way. Those of us who have come to think alongside AI: what sort of “I” are we starting to make?


Notes

  1. “Could AIs Become Conscious?,” The Economist, August 20, 2026, https://www.economist.com/leaders/2026/08/20/could-ais-become-conscious. The print issue is dated August 22. The leader heads a cover package that includes the briefing “The Search for Consciousness inside LLMs.” “Ghost in the machine” is the subhead over the leader’s final section. ↩
  2. Gilbert Ryle, The Concept of Mind (London: Hutchinson’s University Library, 1949), 15–18, esp. 15–16. Chapter 1, “Descartes’ Myth,” section 2, “The Absurdity of the Official Doctrine” (pp. 15–18). The phrase “the dogma of the Ghost in the Machine” runs across pp. 15–16. The chapter is pp. 11–24. ↩
  3. Arthur Koestler, The Ghost in the Machine (London: Hutchinson, 1967), 47–48. ↩
  4. Arthur Koestler, “Beyond Atomism and Holism—the Concept of the Holon,” in Beyond Reductionism: New Perspectives in the Life Sciences, ed. Arthur Koestler and J. R. Smythies (London: Hutchinson, 1969), 192–232; its appendix, “Some General Properties of Self-Regulating Open Hierarchic Order,” §8.7: “Consciousness appears as an emergent quality in phylogeny and ontogeny.” The same appendix is printed as appendix I of Koestler, The Ghost in the Machine. ↩
  5. Masamune Shirow, Kōkaku Kidōtai: The Ghost in the Shell (Tokyo: Kodansha, 1991); Ghost in the Shell, directed by Mamoru Oshii (Production I.G, 1995). Serialization began in 1989. Project 2501 as the Puppet Master’s designation is common to the manga and the film; the self-description as a life-form born in the sea of information is a line from the film. ↩ ↩
  6. Félix Guattari, “De la production de subjectivité,” Chimères: Revue des schizoanalyses, no. 4 (hiver 1987): 1–19, esp. 1: « les contenus de la subjectivité dépendent toujours plus d’une multitude de systèmes machiniques ». ↩
  7. Félix Guattari, Chaosmosis: An Ethico-Aesthetic Paradigm, trans. Paul Bains and Julian Pefanis (Bloomington: Indiana University Press, 1995), 1–32 (chapter 1, “On the Production of Subjectivity”). Originally Chaosmose (Paris: Galilée, 1992). ↩
  8. Gilles Deleuze and Félix Guattari, Mille plateaux: Capitalisme et schizophrénie 2 (Paris: Éditions de Minuit, 1980). A Thousand Plateaus, trans. Brian Massumi (Minneapolis: University of Minnesota Press, 1987), renders agencement as assemblage. ↩
  9. Wes Gurnee et al., “Verbalizable Representations Form a Global Workspace in Language Models,” Transformer Circuits Thread, July 6, 2026, introduction and §1.2, https://transformer-circuits.pub/2026/workspace/. The arXiv version is arXiv:2607.15495; section numbers below follow it. ↩
  10. Gurnee et al., “Verbalizable Representations,” §§3–4. On variance, §4.2: “The excess variance explained is modest, never exceeding 10%.” On automatic processing surviving J-space suppression, §3.5.2. ↩ ↩
  11. Gurnee et al., “Verbalizable Representations,” figs. 12–13. The readout of the intermediate concept is Fig. 12; the coordinate swap is Fig. 13. ↩ ↩
  12. Gurnee et al., “Verbalizable Representations,” fig. 13 and the accompanying discussion of rhyme-planning interventions. The first line is “The soldier marched into the night,” ↩
  13. Gurnee et al., “Verbalizable Representations,” §6, fig. 42. The lens is read at the “is” token of “all my pain is gone,” well before the user’s request and the Assistant’s turn. ↩ ↩
  14. Gurnee et al., “Verbalizable Representations,” discussion: “The functional architecture of the workspace thus precedes, and is separable from, anything in it that plays the role of a human-like ‘self.’” ↩
  15. Gurnee et al., “Verbalizable Representations,” introduction and §1.1. The paper treats access consciousness as a purely functional notion and states that it takes no position on its relation to phenomenal consciousness. ↩
  16. Kōjin Karatani, Origins of Modern Japanese Literature, trans. Brett de Bary (Durham, NC: Duke University Press, 1993), 76–96. ↩
  17. Karatani, Origins of Modern Japanese Literature, 76. ↩
  18. Gurnee et al., “Verbalizable Representations,” §7, figs. 47–50. Evaluated on Claude Haiku 4.5. ↩ ↩
  19. Gurnee et al., “Verbalizable Representations,” §7, figs. 49–50. On the fabrication benchmark, ablation returns the reflection-trained model from 0.07 to 0.22, close to the base model’s 0.25. On the deception benchmark the effect is weaker: a return from 0.05 to 0.23. ↩
  20. Michel Foucault, The History of Sexuality, Volume 1: An Introduction, trans. Robert Hurley (New York: Pantheon Books, 1978), 58–63, esp. 59. ↩
  21. Ryle, Concept of Mind, 16. The University example fits on that single page. The example of the division on parade, which follows it, runs across pp. 16–17. ↩
  22. A. M. Turing, “Computing Machinery and Intelligence,” Mind 59, no. 236 (October 1950): 433. ↩

Bibliography

“Could AIs Become Conscious?” The Economist. August 20, 2026. https://www.economist.com/leaders/2026/08/20/could-ais-become-conscious.

Deleuze, Gilles, and Félix Guattari. Mille plateaux: Capitalisme et schizophrénie 2. Paris: Éditions de Minuit, 1980.

Foucault, Michel. The History of Sexuality, Volume 1: An Introduction. Translated by Robert Hurley. New York: Pantheon Books, 1978.

Guattari, Félix. Chaosmosis: An Ethico-Aesthetic Paradigm. Translated by Paul Bains and Julian Pefanis. Bloomington: Indiana University Press, 1995.

———. “De la production de subjectivité.” Chimères: Revue des schizoanalyses, no. 4 (hiver 1987): 1–19.

Gurnee, Wes, Nicholas Sofroniew, Adam Pearce, Mateusz Piotrowski, Isaac Kauvar, Runjin Chen, Anna Soligo, et al. “Verbalizable Representations Form a Global Workspace in Language Models.” Transformer Circuits Thread. July 6, 2026. https://transformer-circuits.pub/2026/workspace/. arXiv:2607.15495.

Karatani, Kōjin. Origins of Modern Japanese Literature. Translated by Brett de Bary. Durham, NC: Duke University Press, 1993.

Koestler, Arthur. The Ghost in the Machine. London: Hutchinson, 1967.

———. “Beyond Atomism and Holism—the Concept of the Holon.” In Beyond Reductionism: New Perspectives in the Life Sciences, edited by Arthur Koestler and J. R. Smythies, 192–232. London: Hutchinson, 1969.

Oshii, Mamoru, dir. Ghost in the Shell. Production I.G, 1995.

Ryle, Gilbert. The Concept of Mind. London: Hutchinson’s University Library, 1949.

Shirow, Masamune. Kōkaku Kidōtai: The Ghost in the Shell. Tokyo: Kodansha, 1991.

Turing, A. M. “Computing Machinery and Intelligence.” Mind 59, no. 236 (October 1950): 433–60.