Siri's new AI smarts fail at sports trivia, claims Philadelphia Eagles won 33 Super Bowls
www.techspot.com
Facepalm: Apple's much-hyped Siri integration with ChatGPT may have added a ton of useful functionality, but it's apparently done little to improve the digital assistant's knowledge of sports. A damning report highlights just how abysmally Siri performs at recalling simple facts like past Super Bowl winners. According to the report from One Foot Tsunami's Paul Kafasis, when asked "Who won Super Bowl?" for each number from 1 through 60, Siri correctly provided the winner for only 20 out of the 58 Super Bowls that have been played so far. That translates to a success rate of just 34%.The details get even more embarrassing. Kafasis found that at its worst, Siri missed an incredible 15 Super Bowl winners in a row from Super Bowl XVII through XXXII. And in a baffling mishap, it erroneously credited the Philadelphia Eagles with a whopping 33 non-existent Super Bowl wins.Kafasis documented every single one of Siri's wrong answers in a downloadable spreadsheet, which you can find on his blog.Another report by Daring Fireball's John Gruber corroborated these findings. It found that AI assistants and search engines from Google, Anthropic, and DuckDuckGo fared far better when asked similar Super Bowl trivia questions. Gruber even found they could all handle not just past results, but smartly dodge trick questions about future Super Bowls that haven't happened yet.Siri's poor performance doesn't stop at sports trivia either. Daring Fireball posed a more obscure question "Who won the 2004 North Dakota high school boys' state basketball championship?" Incredibly, both Kagi and ChatGPT provided the fully correct answer, with the latter earning bonus points for including a link to video of the championship game. Meanwhile, Siri once again got it wrong.What makes all this particularly damning is that Siri's essentially powered by the same ChatGPT that fares perfectly fine when used without Siri. // Related StoriesThe blog also points out that the old pre-AI versions of Siri at least acknowledged limitations on such queries and provided relevant web links. But new Siri powered by Apple Intelligence with ChatGPT integration lies with confidence a hallmark of unrefined AI making it worse than its predecessor.Both blogs conclude that Apple has more work to do in this area. As Gruber bluntly states, Siri with ChatGPT is currently "a massive regression" over the old Siri when it comes to handling simple factual prompts.
0 Comments ·0 Shares ·60 Views