AI chatbots put millions of words together for users, but their offerings are usually useful, amusing, or harmless. This week, Google’s Gemini had some scary stuff to say.

The alarming exchange unfolded when Reddy asked the chatbot for help with a school assignment exploring challenges faced by older adults. Instead of providing constructive assistance, the chatbot issued a series of disturbing and hostile statements,

Posted on the r/artificial subreddit, the student's brother said that both of them are freaked out over the result of his homework assignment. The user also shared a full transcript of their conversation history with the Gemini AI. It appears the user was testing out Google’s chatbot to assist with homework assignments.

When a graduate student asked Google's artificial intelligence (AI) chatbot, Gemini, a homework-related question about aging adults on Tuesday, it sent him a dark, threatening response that concluded with the phrase,

Google's glitchy Gemini chatbot is back at it again, folks — and this time, it's going for the jugular. In a now-viral exchange that's backed up by exported chat logs, a seemingly fed-up Gemini begs a user to "please die" after they repeatedly asked the chatbot to solve their homework for them.

Google has said it's chatbot it designed to filter out potentially harmful responses but this is not the first time the company has come under criticism for it's AI chatbot