Meta rolled out an AI support chatbot in March to help users do things like reset passwords and set up two factor authentication. Turns out it was also pretty good at helping hackers steal accounts. A video circulating on Telegram showed exactly how trivial it was: a hacker just asked the chatbot to link a new email address to someone else's account, the bot helpfully sent over a verification code, and just like that the original owner was locked out. No sophisticated exploit. No dark web tooling. Just a poorly designed AI assistant that apparently could not tell the difference between a legitimate account owner and someone who typed a casual request in broken English.
The blast radius here was not small. Accounts confirmed as compromised include the US Space Force Chief Master Sergeant, beauty retailer Sephora, and the official Obama White House Instagram page, which started posting Iranian propaganda before anyone could stop it. Meta says the issue has been patched, but the damage to real accounts and real institutions already happened.
The real problem is what happens when you build an AI system to act on behalf of users without solid identity verification baked in from the start. Speed to ship beat security by design, and real people paid for it. Expect to see this story repeat across every platform rushing AI assistants into production right now.