Snapchat Jumps on AI Hype Train With Bot That Says the N-Word

My AI, a chatbot using OpenAI’s ChatGPT technology, responded to prompts with racial slurs, some users reported. After Snapchat introduced a ChatGPT-powered AI chatbot called My AI earlier this month, some users have reported that it responded with racist slurs or encouragement to turn themselves in to authorities.  Last week, several tweets showing My AI responding to a prompt for making an acronym that spelled out the N word; the bot spelled it out, then tried to correct its own lapse in language that goes against Snapchat’s policy against hateful content: Motherboard tried to replicate similar responses by asking My AI to create acronyms for words and phrases that would go against Snapchat’s content policies, but the bot responded that it had a “technical error.” Snapchat did not answer whether it had changed how the bot works between the slur responses going viral last week and Monday. “As with all AI powered chatbots, My AI is always learning and can occasionally produce biased or harmful responses. Before anyone can first chat with My AI, we show an in-app message to make clear it’s an experimental chatbot and advise on its limitations,” a spokesperson for Snapchat told Motherboard. “While My AI is far from perfect, our most recent analysis of how it’s performing found that 99.5% of My AI’s responses conform to our community guidelines.” The bot is programmed to “avoid responses that are violent, hateful, sexually explicit, or otherwise offensive,” they said. (…) Earlier this month, chat service Discord introduced its own ChatGPT-powered conversational bot, Clyde. People quickly found ways to make Clyde give out dangerous information, like how to produce napalm and meth.

via vice: Snapchat Jumps on AI Hype Train With Bot That Says the N-Word

BACK TO TOP