Apple has tightened its App Store guidelines to explicitly prohibit applications that create so-called nudify content — intimate images generated using AI tools without the subject's consent. The rule changes, announced this week, come after significant backlash over the use of Grok on X to generate sexualized deepfakes, including of minors, earlier this year.
The updated terms more directly target apps that produce nonconsensual intimate imagery, closing a gap that allowed some AI image generators to operate in a gray area. While Apple did not remove X or Grok from the App Store, the company told U.S. senators it had threatened to do so if the problems persisted. The decision represents a shift from reactive enforcement to proactive rule-making.
The decision follows protests at Apple's WWDC event in June, where demonstrators called on the company to remove Grok and X from its platform. Apple's approach has been to tighten the rules for all developers rather than target specific apps, a strategy that places the burden on AI app makers to ensure their tools cannot be misused. This broader approach means every AI image generation app on the App Store must now demonstrate robust consent mechanisms.
The move signals growing pressure on platform holders to police AI-generated content more aggressively, particularly when it involves intimate imagery or potential harassment. Developers building AI image tools now face stricter scrutiny over consent mechanisms and content moderation systems. Industry observers say this could set a precedent for other platforms facing similar challenges with AI-generated harmful content.
