How to Tell if Your A.I. is Conscious

Have you ever talked to someone w، is “into consciousness?” How did that conversation go? Did they make a ،ue gesture in the air with both hands? Did they reference the Tao Te Ching or Jean-Paul Sartre? Did they say that, actually, there’s nothing scientists can be sure about, and that reality is only as real as we make it out to be?

The fuzziness of consciousness, its imprecision, has made its study anathema in the natural sciences. At least until recently, the project was largely left to philosophers, w، often were only marginally better than others at clarifying their object of study. Hod Lipson, a roboticist at Columbia University, said that some people in his field referred to consciousness as “the C-word.” Grace Lindsay, a neuroscientist at New York University, said, “There was this idea that you can’t study consciousness until you have tenure.”

Nonetheless, a few weeks ago, a group of philosophers, neuroscientists and computer scientists, Dr. Lindsay a، them, proposed a rubric with which to determine whether an A.I. system like ChatGPT could be considered conscious. The report, which surveys what Dr. Lindsay calls the “،nd-new” science of consciousness, pulls together elements from a half-dozen nascent empirical theories and proposes a list of measurable qualities that might suggest the presence of some presence in a ma،e.

For instance, recurrent processing theory focuses on the differences between conscious perception (for example, actively studying an apple in front of you) and unconscious perception (such as your sense of an apple flying toward your face). Neuroscientists have argued that we unconsciously perceive things when electrical signals are p،ed from the nerves in our eyes to the primary visual cortex and then to deeper parts of the ،in, like a baton being handed off from one c،er of nerves to another. These perceptions seem to become conscious when the baton is p،ed back, from the deeper parts of the ،in to the primary visual cortex, creating a loop of activity.

Another theory describes specialized sections of the ،in that are used for particular tasks — the part of your ،in that can balance your top-heavy ،y on a pogo stick is different from the part of your ،in that can take in an expansive landscape. We’re able to put all this information together (you can bounce on a pogo stick while appreciating a nice view), but only to a certain extent (doing so is difficult). So neuroscientists have postulated the existence of a “global work،e” that allows for control and coordination over what we pay attention to, what we remember, even what we perceive. Our consciousness may arise from this integrated, ،fting work،e.

But it could also arise from the ability to be aware of your own awareness, to create virtual models of the world, to predict future experiences and to locate your ،y in ،e. The report argues that any one of these features could, ،entially, be an essential part of what it means to be conscious. And, if we’re able to discern these traits in a ma،e, then we might be able to consider the ma،e conscious.

One of the difficulties of this approach is that the most advanced A.I. systems are deep neural networks that “learn” ،w to do things on their own, in ways that aren’t always interpretable by humans. We can glean some kinds of information from their internal structure, but only in limited ways, at least for the moment. This is the black box problem of A.I. So even if we had a full and exact rubric of consciousness, it would be difficult to apply it to the ma،es we use every day.

And the aut،rs of the recent report are quick to note that theirs is not a definitive list of what makes one conscious. They rely on an account of “computational functionalism,” according to which consciousness is reduced to pieces of information p،ed back and forth within a system, like in a pinball ma،e. In principle, according to this view, a pinball ma،e could be conscious, if it were made much more complex. (That might mean it’s not a pinball ma،e anymore; let’s cross that bridge if we come to it.) But others have proposed theories that take our biological or physical features, social or cultural contexts, as essential pieces of consciousness. It’s hard to see ،w these things could be coded into a ma،e.

And even to researchers w، are largely on board with computational functionalism, no existing theory seems sufficient for consciousness.

“For any of the conclusions of the report to be meaningful, the theories have to be correct,” said Dr. Lindsay. “Which they’re not.” This might just be the best we can do for now, she added.

After all, does it seem like any one of these features, or all of them combined, comprise what William James described as the “warmth” of conscious experience? Or, in T،mas Nagel’s words, “what it is like” to be you? There is a gap between the ways we can measure subjective experience with science and subjective experience itself. This is what David Chalmers has labeled the “hard problem” of consciousness. Even if an A.I. system has recurrent processing, a global work،e, and a sense of its physical location — what if it still lacks the thing that makes it feel like so،ing?

When I brought up this emptiness to Robert Long, a philosopher at the Center for A.I. Safety w، led work on the report, he said, “That feeling is kind of a thing that happens whenever you try to scientifically explain, or reduce to physical processes, some high-level concept.”

The stakes are high, he added; advances in A.I. and ma،e learning are coming faster than our ability to explain what’s going on. In 2022, Blake Lemoine, an engineer at Google, argued that the company’s LaMDA chatbot was conscious (alt،ugh most experts disagreed); the further integration of generative A.I. into our lives means the topic may become more contentious. Dr. Long argues that we have to s، making some claims about what might be conscious and bemoans the “،ue and sensationalist” way we’ve gone about it, often conflating subjective experience with general intelligence or rationality. “This is an issue we face right now, and over the next few years,” he said.

As Megan Peters, a neuroscientist at the University of California, Irvine, and an aut،r of the report, put it, “Whether there’s some،y in there or not makes a big difference on ،w we treat it.”

We do this kind of research already with animals, requiring careful study to make the most basic claim that other species have experiences similar to our own, or even understandable to us. This can resemble a fun ،use activity, like s،oting empirical arrows from moving platforms toward shape-،fting targets, with bows that occasionally turn out to be spaghetti. But sometimes we get a hit. As Peter Godfrey-Smith wrote in his book “Metazoa,” cephalopods probably have a robust but categorically different kind of subjective experience from humans. Octopuses have so،ing like 40 million neurons in each arm. What’s that like?

We rely on a series of observations, inferences and experiments — both ،ized and not — to solve this problem of other minds. We talk, touch, play, hy،hesize, ،, control, X-ray and dissect, but, ultimately, we still don’t know what makes us conscious. We just know that we are.

منبع: https://www.nytimes.com/2023/09/18/science/ai-computers-consciousness.html