After the attorney general announced the investigation, X Safety said it would be putting restrictions on who could generate images using Grok.

Defense Secretary Pete Hegseth announced Monday that Grok will be included on the Department of Defense’s new internal AI platform, GenAI.mil, alongside tools like Google’s Gemini, despite the chatbot facing international bans, regulatory scrutiny, and repeated controversies over racism, antisemitism, and nonconsensual image generation.

Elon Musk’s X is trying to stop people using its AI chatbot Grok to undress women amid intensifying outrage and legal scrutiny over the deluge of nonconsensual sexual deepfakes flooding the site. It’s not trying very hard: it took us less than a minute to get around its latest attempt to rein in the chatbot.

California’s attorney general on Wednesday announced an investigation into nonconsensual sexually explicit material being produced using Grok, the artificial intelligence chatbot developed by xAI.

In response to slow movement from X's teams, countries have begun tamping down access to xAI's bot and standalone app, as several conduct investigations into Grok's safeguards, xAI's response, and the possibility that the company is violating various online safety laws.

The chatbot said it was “urgently fixing” the issue, calling child sexual abuse material “illegal and prohibited.”

X says it is changing its policies around Grok’s image-editing abilities following a multi-week outcry over the chatbot repeatedly being accused of generating sexualized images of children and nonconsensual nudity.