Will AI become God? That’s the wrong question.
Its hard to know what to think about AI.Its easy to imagine a future in which chatbots and research assistants make almost everything we do faster and smarter. Its equally easy to imagine a world in which those same tools take our jobs and upend society. Which is why, depending on who you ask, AI is either going to save the world or destroy it. What are we to make of that uncertainty?Jaron Lanier is a digital philosopher and the author of several bestselling books on technology. Among the many voices in this space, Lanier stands out. Hes been writing about AI for decades and hes argued, somewhat controversially, that the way we talk about AI is both wrong and intentionally misleading.Jaron Lanier at the Music + Health Summit in 2023, in West Hollywood, California. Michael Buckner/Billboard via Getty ImagesI invited him onto The Gray Area for a series on AI because hes uniquely positioned to speak both to the technological side of AI and to the human side. Lanier is a computer scientist who loves technology. But at his core, hes a humanist whos always thinking about what technologies are doing to us and how our understanding of these tools will inevitably determine how theyre used.We talk about the questions we ought to be asking about AI at this moment, why we need a new business model for the internet, and how descriptive language can change how we think about these technologies especially when that language treats AI as some kind of god-like entity.As always, theres much more in the full podcast, so listen and follow The Gray Area on Apple Podcasts, Spotify, Pandora, or wherever you find podcasts. New episodes drop every Monday.This interview has been edited for length and clarity.What do you mean when you say that the whole technical field of AI is defined by an almost metaphysical assertion?The metaphysical assertion is that we are creating intelligence. Well, what is intelligence? Something human. The whole field was founded by Alan Turings thought experiment called the Turing test, where if you can fool a human into thinking youve made a human, then you might as well have made a human because what other tests could there be? Which is fair enough. On the other hand, what other scientific field other than maybe supporting stage magicians is entirely based on being able to fool people? I mean, its stupid. Fooling people in itself accomplishes nothing. Theres no productivity, theres no insight unless youre studying the cognition of being fooled of course.Theres an alternative way to think about what we do with what we call AI, which is that theres no new entity, theres nothing intelligent there. What there is a new, and in my opinion, sometimes quite useful, form of collaboration between people. Whats the harm if we do?Thats a fair question. Who cares if somebody wants to think of it as a new type of person or even a new type of God or whatever? Whats wrong with that? Potentially nothing. People believe all kinds of things all the time. But in the case of our technology, let me put it this way, if you are a mathematician or a scientist, you can do what you do in a kind of an abstract way. You can say, Im furthering math. And in a way thatll be true even if nobody else ever even perceives that Ive done it. Ive written down this proof. But thats not true for technologists. Technologists only make sense if theres a designated beneficiary. You have to make technology for someone, and as soon as you say the technology itself is a new someone, you stop making sense as a technologist.If we make the mistake, which is now common, and insist that AI is in fact some kind of god or creature or entity or oracle, instead of a tool, as you define it, the implication is that would be a very consequential mistake, right? Thats right. When you treat the technology as its own beneficiary, you miss a lot of opportunities to make it better. I see this in AI all the time. I see people saying, Well, if we did this, it would pass the Turing test better, and if we did that, it would seem more like it was an independent mind. But those are all goals that are different from it being economically useful. Theyre different from it being useful to any particular user. Theyre just these weird, almost religious, ritual goals. So every time youre devoting yourself to that, it means youre not devoting yourself to making it better.One example is that weve deliberately designed large-model AI to obscure the original human sources of the data that the AI is trained on to help create this illusion of the new entity. But when we do that, we make it harder to do quality control. We make it harder to do authentication and to detect malicious uses of the model because we cant tell what the intent is, what data its drawing upon. Were sort of willfully making ourselves blind in a way that we probably dont really need to.I really want to emphasize, from a metaphysical point of view, I cant prove, and neither can anyone else, that a computer is alive or not, or conscious or not, or whatever. All that stuff is always going to be a matter of faith. Thats just the way it is. But what I can say is that this emphasis on trying to make the models seem like theyre freestanding new entities does blind us to some ways we could make them better. So does all the anxiety, including from serious people in the world of AI, about human extinction feel like religious hysteria to you? What drives me crazy about this is that this is my world. I talk to the people who believe that stuff all the time, and increasingly, a lot of them believe that it would be good to wipe out people and that the AI future would be a better one, and that we should wear a disposable temporary container for the birth of AI. I hear that opinion quite a lot.Wait, thats a real opinion held by real people?Many, many people. Just the other day I was at a lunch in Palo Alto and there were some young AI scientists there who were saying that they would never have a bio baby because as soon as you have a bio baby, you get the mind virus of the [biological] world. And when you have the mind virus, you become committed to your human baby. But its much more important to be committed to the AI of the future. And so to have human babies is fundamentally unethical. Now, in this particular case, this was a young man with a female partner who wanted a kid. And what Im thinking is this is just another variation of the very, very old story of young men attempting to put off the baby thing with their sexual partner as long as possible. So in a way I think its not anything new and its just the old thing. But its a very common attitude, not the dominant one. I would say the dominant one is that the super AI will turn into this God thing thatll save us and will either upload us to be immortal or solve all our problems and create superabundance at the very least. I have to say theres a bit of an inverse proportion here between the people who directly work in making AI systems and then the people who are adjacent to them who have these various beliefs. My own opinion is that the people who are able to be skeptical and a little bored and dismissive of the technology theyre working on tend to improve it more than the people who worship it too much. Ive seen that a lot in a lot of different things, not just computer science. One thing I worry about is AI accelerating a trend that digital tech in general and social media in particular has already started, which is to pull us away from the physical world and encourage us to constantly perform versions of ourselves in the virtual world. And because of how its designed, it has this habit of reducing other people to crude avatars, which is why its so easy to be cruel and vicious online and why people who are on social media too much start to become mutually unintelligible to each other. Do you worry about AI supercharging this stuff? Am I right to be thinking of AI as a potential accelerant of these trends?Its arguable and actually consistent with the way the [AI] community speaks internally to say that the algorithms that have been driving social media up to now are a form of AI, if thats the term you wish to use. And what the algorithms do is they attempt to predict human behavior based on the stimulus given to the human. By putting that in an adaptive loop, they hope to drive attention and an obsessive attachment to a platform. Because these algorithms cant tell whether somethings being driven because of things that we might think are positive or things that we might think are negative. I call this the life of the parity, this notion that you cant tell if a bit is one or zero, it doesnt matter because its an arbitrary designation in a digital system. So if somebodys getting attention by being a dick, that works just as well as if theyre offering lifesaving information or helping people improve themselves. But then the peaks that are good are really good, and I dont want to deny that. I love dance culture on TikTok. Science bloggers on YouTube have achieved a level thats astonishingly good and so on. Theres all these really, really positive good spots. But then overall, theres this loss of truth and political paranoia and unnecessary confrontation between arbitrarily created cultural groups and so on and thats really doing damage.So yeah, could better AI algorithms make that worse? Plausibly. Its possible that its already bottomed out and if the algorithms themselves get more sophisticated, it wont really push it that much further. But I actually think it can and Im worried about it because we so much want to pass the Turing test and make people think our programs are people. Were moving to this so-called agentic era where its not just that you have a chat interface with the thing, but the chat interface gets to know you through years at a time and gets a so-called personality and all this. And then the idea is that people then fall in love with these. And were already seeing examples of this here and there, and this notion of a whole generation of young people falling in love with fake avatars. I mean, people talk about AI as if its just like this yeast in the air. Its like, oh, AI will appear and people will fall in love with AI avatars, but its not. AI is always run by companies, so theyre going to be falling in love with something from Google or Meta or whatever. The advertising model was sort of the original sin of the internet in lots of ways. Im wondering how we avoid repeating those mistakes with AI. How do we get it right this time? Whats a better model?This question is the central question of our time in my view. The central question of our time isnt, how are we able to scale AI more? Thats an important question and I get that. And most people are focused on that. And dealing with the climate is an important question. But in terms of our own survival, coming up with a business model for civilization that isnt self-destructive is, in a way, our most primary problem and challenge right now. Because the way were doing it, we went through this thing in the earlier phase of the internet of information should be free, and then the only business model thats left is paying for influence. And so then all of the platforms look free or very cheap to the user, but then actually the real customer is trying to influence the user. And you end up with whats essentially a stealthy form of manipulation being the central project of civilization.We can only get away with that for so long. At some point, that bites us and we become too crazy to survive. So we must change the business model of civilization. How to get from here to there is a bit of a mystery, but I continue to work on it. I think we should incentivize people to put great data into the AI programs of the future. And Id like people to be paid for data used by AI models and also to be celebrated and made visible and known. I think its just a big collaboration and our collaborators should be valued.How easy would it be to do that? Do you think we can or will?Theres still some unsolved technical questions about how to do it. Im very actively working on those and I believe its doable. Theres a whole research community devoted to exactly that distributed around the world. And I think itll make better models. Better data makes better models, and theres a lot of people who dispute that and they say, No, its just better algorithms. We already have enough data for the rest of all time. But I disagree with that. I dont think were the smartest people who will ever live, and there might be new creative things that happen in the future that we dont foresee and the models weve currently built might not extend into those things. Having some open system where people can contribute to new models and new ways is a more expansive and just kind of a spiritually optimistic way of thinking about the deep future.Is there a fear of yours, something you think we could get terribly wrong, thats not currently something we hear much about?God, I dont even know where to start. One of the things I worry about is were gradually moving education into an AI model, and the motivations for that are often very good because in a lot of places on earth, its just been impossible to come up with an economics of supporting and training enough human teachers. And a lot of cultural issues in changing societies make it very, very hard to make schools that work and so on. Theres a lot of issues, and in theory, a self-adapting AI tutor could solve a lot of problems at a low cost.But then the issue with that is, once again, creativity. How do you keep people who learn in a system like that, how do you train them so that theyre able to step outside of what the system was trained on? Theres this funny way that youre always retreading and recombining the training data in any AI system, and you can address that to a degree with constant fresh input and this and that. But I am a little worried about people being trained in a closed system that makes them a little less than they might otherwise have been and have a little less faith in themselves.Listen to the rest of the conversation and be sure to follow The Gray Area on Apple Podcasts, Spotify, Pandora, or wherever you listen to podcasts.Youve read 1 article in the last monthHere at Vox, we're unwavering in our commitment to covering the issues that matter most to you threats to democracy, immigration, reproductive rights, the environment, and the rising polarization across this country.Our mission is to provide clear, accessible journalism that empowers you to stay informed and engaged in shaping our world. By becoming a Vox Member, you directly strengthen our ability to deliver in-depth, independent reporting that drives meaningful change.We rely on readers like you join us.Swati SharmaVox Editor-in-ChiefSee More:
English
Arabic
French
Spanish
Portuguese
Deutsch
Turkish
Dutch
Italiano
Russian
Portuguese (Brazil)
Greek