Apple privately warned Elon Musk’s xAI company in January that it would remove the Grok app from the App Store unless the company put a stop to the chatbot’s nude and sexualized deepfakes, according to a letter Apple sent to U.S. senators and obtained by NBC News ($).
Earlier this year, Grok’s AI capabilities came under scrutiny after X users shared nonconsensual sexualized images of women and children created by the app, many of which were based on photos of real people.
What followed was a confusing rollout of moderation changes to Grok, some of which could be easily bypassed. Publicly, Apple did not comment on the controversy at the time, but it did respond, and was in fact the instigator of the changes. Internally, the company had found both X and Grok in violation of its App Store guidelines and demanded its developers submit a content moderation plan, the letter reveals.
According to the letter, Apple rejected an initial fix from xAI as insufficient, saying the “changes didn’t go far enough,” and Apple warned it that additional alterations were required or Grok would be removed. After further back-and-forth, however, Apple eventually concluded that a later submission of the app had improved enough for it to be approved.
The disclosure was apparently prompted by a January letter from Senators Ron Wyden, Ben Ray Luján, and Edward Markey, who urged Apple and Google to pull both apps, arguing the imagery violated App Store rules barring offensive, sexual, and exploitative content.
The senators also said that Apple’s response would test its own arguments, since the company has long defended its curated App Store by claiming its review process keeps users safer. Letting Grok continue to generate this kind of imagery, they argued, would undermine that case in the eyes of the public and in a court of law.
After NBC News published its report, X posted the following statement on its platform:
“We strictly prohibit users from generating non-consensual explicit deepfakes and from using our tools to undress real people. xAI has extensive safeguards in place to prevent such misuse, such as continuous monitoring of public usage, analysis of evasion attempts in real time, frequent model updates, prompt filters, and additional safeguards.”While the amount of sexualized deepfakes created by Grok and posted to X appears to have decreased significantly, NBC News found that Grok is still able to generate similar imagery, with some users apparently having simply updated their prompt tactics to get around the safeguards. You can read that report in its entirety by following this link.Tags: App Store, GrokThis article, “Apple Threatened to Pull Grok From App Store Over Sexualized Images” first appeared on MacRumors.comDiscuss this article in our forums
Go to Source
Author: Tim Hardwick