gotta catch 'em all Niantic uses Pokmon Go player data to build AI navigation system Visual scans of the world have helped Niantic build what it calls a "Large Geospatial Model." Benj Edwards Nov 19, 2024 3:34 pm | 10 Story textSizeSmallStandardLargeWidth *StandardWideLinksStandardOrange* Subscribers only Learn moreLast week, Niantic announced plans to create an AI model for navigating the physical world using scans collected from players of its mobile games, such as Pokmon Go, and from users of its Scaniverse app, reports 404 Media.All AI models require training data. So far, companies have collected data from websites, YouTube videos, books, audio sources, and more, but this is perhaps the first we've heard of AI training data collected through a mobile gaming app."Over the past five years, Niantic has focused on building our Visual Positioning System (VPS), which uses a single image from a phone to determine its position and orientation using a 3D map built from people scanning interesting locations in our games and Scaniverse," wrote Niantic in a company blog post.The company calls its creation a "Large Geospatial Model" (LGM), drawing parallels to large language models (LLMs) like the kind that power ChatGPT. Where language models process text, Niantic's model will process physical spaces using geolocated images collected through its apps.The scale of Niantic's data collection reveals the company's sizable presence in the AR space. The model draws from over 10 million scanned locations worldwide, with users capturing roughly 1 million new scans weekly through Pokmon Go and Scaniverse. These scans come from a pedestrian perspective, capturing areas inaccessible to cars and street-view cameras.First-person scansThe company reports it has trained more than 50 million neural networks, each one representing a specific location or viewing angle. These networks compress thousands of mapping images into digital representations of physical spaces. Together, they contain over 150 trillion parametersadjustable values that help the networks recognize and understand locations. Multiple networks can contribute to mapping a single location, and Niantic plans to combine its knowledge into one comprehensive model that can understand any location, even from unfamiliar angles."Imagine yourself standing behind a church," Niantic wrote in its blog post. "The closest local model has seen only the front entrance of that church, and thus, it will not be able to tell you where you are. But on a global scale, we have seen thousands of churches captured by local models worldwide. No church is the same, but many share common characteristics. An LGM accesses that distributed knowledge."The technology builds on Niantic's existing Lightship Visual Positioning System, which lets players place virtual items in real-world locations with centimeter-level precision. A recent Pokmon Go feature called Pokmon Playgrounds demonstrates this capability, allowing users to leave Pokmon at specific spots for others to find.Niantic suggests the technology could support augmented reality products, robotics, and autonomous systems, with additional applications in spatial planning, logistics, and remote collaboration.Did Niantic's millions of players have any idea their scans would be fed into an AI system? Judging from this Reddit thread reacting to the 404 Media article, it seems that many are not surprised. "Definitely wasn't unwittingly," wrote one Redditor. "Most of us knew their business model didn't revolve around supporting the actual players."No doubt the process was covered by Pokmon Go's data collection terms of service, but the larger reaction to this news will likely be a developing story over time.Benj EdwardsSenior AI ReporterBenj EdwardsSenior AI Reporter Benj Edwards is Ars Technica's Senior AI Reporter and founder of the site's dedicated AI beat in 2022. He's also a widely-cited tech historian. In his free time, he writes and records music, collects vintage computers, and enjoys nature. He lives in Raleigh, NC. 10 Comments Prev story