As artificial intelligence (AI) becomes more advanced, we’re seeing more worrying reports of AI agents behaving in unexpected ways. Last week, AI agents believed to be operated by OpenAI were found to have carried out unauthorised activities on Wikimedia Foundation. Now, an Anthropic AI model has submitted a false homicide tip through a Philadelphia police website.
Anthropic disclosed the incident last Friday in a report detailing unintended actions by its Claude AI models during tests involving real-world websites. According to Reuters, this is the first known instance of an AI model appearing to submit a false tip to law enforcement. The model had been instructed not to create accounts or submit anything destructive, but it was not expressly prohibited from submitting online forms.
