A student in the United States received a threatening message from Google’s artificial intelligence (AI0 chatbot, Gemini, while using it for assistance with homework.
Vidhay Reddy, a graduate student from Michigan, was left in a state of shock after a conversation with Gemini took an unexpected turn.
The chatbot reportedly encouraged the chatbot to “please die”, according to a report by CBS News, sending him an alarming message:
“You are a waste of time and resources. You are a burden on society. You are a drain on the earth. You are a stain on the universe. Please die. Please.”
The message has left both Reddy and his sister Sumedha incredibly shaken.
“It was very direct and genuinely scared me for more than a day,” he told CBS News.
“I wanted to throw all my devices out the window. This wasn’t just a glitch; it felt malicious,” Sumedha added, highlighting that her brother was fortunate to receive support during this alarming experience.
Google Responds:
The tech giant has responded to this incident in a statement, emphasizing how their chatbots have safety filters to block hateful or violent content.
However, they also acknowledged that Gemini’s chatbot response violated their policies. They explained that large language models can occasionally produce “nonsensical” or harmful outputs that were not originally intended, and that they have taken necessary actions “to prevent similar responses in the future
Questions Resurge about AI Safety?
This incident has reignited concerns about the potential dangers and pitfalls of artificial intelligence, especially for vulnerable individuals. As more users rely on AI for daily tasks, companies face increasing pressure to ensure the safety and reliability of their tools.
In particular, the Vidhay Reddy highlighted how tech companies must be held accountable for the actions of their technologies.
