Generative AI is known for hallucinations false information it creates in its answers. Its usually annoying at most, but this time, a joke went way too far.A man, Arve Hjalmar Holmen, decided to see what ChatGPT knew about him but received a horrifying reply. The bot said he had killed his own two sons and had been sentenced to 21 years in prison.As the privacy rights advocacy group Noyb noted, the scariest thing was that AI included real elements of his personal life, like the number and gender of his children and the name of his town.The GDPR is clear. Personal data has to be accurate, said Joakim Sderberg, data protection lawyer at Noyb. If its not, users have the right to have it changed to reflect the truth. Showing ChatGPT users a tiny disclaimer that the chatbot can make mistakes clearly isnt enough. You cant just spread false information and in the end add a small disclaimer saying that everything you said may just not be true.NoybShocked and disturbed, Holmen filed a complaint against OpenAI, asking it to remove the output, fine-tune the model, and restrict the processing of his personal data. Since then, the company has cleaned it up, so you cant get the same answer anymore.However, the question remains: why does ChatGPT make up information, especially of this kind? Naturally, the first thought that comes to mind is that there is some other Arve Hjalmar Holmen out there who actually murdered his sons. But Noyb has done its research and failed to find any other cases that might have confused the bot.Granted, ChatGPT has a warning that it might be wrong sometimes, but Noybs data protection lawyer Kleanthi Sardeli doesnt find it soothing: Adding a disclaimer that you do not comply with the law does not make the law go away. AI companies can also not just hide false information from users while they internally still process false information.. AI companies should stop acting as if the GDPR does not apply to them, when it clearly does. If hallucinations are not stopped, people can easily suffer reputational damage.Noyb filed another complaint against OpenAI in April 2024, but it is still lying around.Having received the complaint from the Austrian Supervisory Authority in September 2024, the DPC commenced the formal handling of the complaint and it is still ongoing, Risteard Byrne, assistant principal officer communications for the DPC told TechCrunch.So, well likely have to wait for a while to see where Holmens case leads.Meanwhile, join our80 Level Talent platformand ournew Discord server, follow us onInstagram,Twitter,LinkedIn,Telegram,TikTok, andThreads,where we share breakdowns, the latest news, awesome artworks, and more.Source link The post ChatGPT Falsely Accuses Man of Killing His Children appeared first on CG SHARES.