Apple has updated its App Store developer guidelines with significantly stricter regulations targeting AI-generated offensive material and deceptive applications. The policy changes, rolled out over the weekend, aim to close persistent security loopholes that malicious developers have exploited to bypass the platform’s review process and introduce harmful or non-consensual sexualized imagery to users.
Under the updated rules, Apple is taking a hardline stance against applications that leverage artificial intelligence to create offensive content. The policy also targets deceptive software that disguises itself as harmless utility or productivity tools during the initial App Store review phase, only to morph into "nudify" applications—software that uses AI to digitally strip clothing from photographs of real people—or heavily promote those objectionable features once approved.
The revised guidelines incorporate much stronger language regarding both artificial intelligence and user-generated content. Apple is now explicitly requiring developers to implement robust preventative measures and proactive safety checks to effectively moderate and filter out objectionable or offensive material before it reaches the broader public.
"Apps that host user-generated content are required to filter objectionable material, give users a way to report offensive content, and let users block abusive accounts. Apps containing hidden or undocumented features are also prohibited on the App Store, including apps that misrepresent their purpose during review and only reveal harmful capabilities — such as ‘nudification’ — after approval, a tactic commonly known as bait-and-switch," the company explained in a detailed blog post outlining the changes.
To enforce these policies, Apple stated that it will swiftly remove any applications that add unauthorized features or capabilities that were noticeably absent from the version originally submitted and evaluated during the App Store review process.
Alongside the new AI and content moderation mandates, Apple has updated the legal phrasing within its developer agreement to reinforce its zero-tolerance policy toward severe harms. The reinforced language explicitly emphasizes that the platform will permanently bar any applications that promote human trafficking or the exploitation of children.
These newly tightened guidelines arrive as Apple and other major technology firms face mounting external pressure from lawmakers, legal authorities, and digital safety advocates regarding the proliferation of unregulated AI tools on their marketplaces.
In previous disclosures, Apple reported that its stringent review infrastructure successfully blocked more than 150,000 applications from reaching consumers, while concurrently purging 193,000 developer accounts over systemic issues related to fraud and abuse. Despite these defensive mechanisms, bad actors have continually sought out innovative ways to slip malicious or unauthorized features past human and automated screeners.
The urgency surrounding the moderation of AI-driven image manipulation apps intensified earlier this year. In July, the city of San Francisco took formal legal and administrative action, ordering both Apple and Google to clean up their respective digital marketplaces and purge all nudification applications from their app stores. During that regulatory push, City Attorney David Chiu publicly criticized the major tech companies, accusing them of actively profiting from the distribution of such applications through standard store commission fees collected on in-app purchases and subscriptions.
Pressure on the tech giants had also mounted earlier in the spring. In April, an investigative report published by the Tech Transparency Project revealed that both Apple and Google digital storefronts were actively hosting multiple nudification applications. Troublingly, the report noted that some of these explicit programs were even rated by developers or categorized in ways that made them appear suitable for minors, sparking widespread public outcry and demands for more accountable oversight.
By raising the compliance bar, explicitly banning bait-and-switch tactics, and enforcing strict content filtering requirements for user-generated AI features, Apple’s latest policy shift represents an effort to stem the flow of non-consensual deepfakes and restore consumer trust in the safety and integrity of the App Store ecosystem.