An AI app listed in a major app store has passed a policy review, but that review does not measure whether the app improves any industry. Apple's App Review Guidelines require disclosure and explicit permission before personal data goes to third-party AI, and Google Play requires apps that generate content with AI to include in-app reporting, so those two rulebooks are the documented checks behind the word "innovative" on a store page.
Key takeaways
- Apple's guideline 5.1.2(i) requires clear disclosure, and explicit permission, before personal data is shared with third parties, including third-party AI.
- Apple's guideline 1.2 names AI content creation apps among those that carry risks such as intellectual property infringement and nonconsensual intimate imagery.
- Google Play requires apps that generate content using AI to contain in-app user reporting or flagging, a rule announced in October 2023 and restated on June 6, 2024.
- On August 25, 2026, Google said review teams may ask for full access to AI features and proof that underlying models reject requests for explicit image edits or deepfakes.
- Store approval concerns safety and conduct. Claims about industry impact still need outside evidence.
What the Apple guidelines say about AI
Apple's App Review Guidelines do not contain a separate AI chapter. Two passages apply directly. Guideline 5.1.2(i) says: "You must clearly disclose where personal data will be shared with third parties, including with third-party AI, and obtain explicit permission before doing so." Guideline 1.2 covers user-generated content and states that apps which let people create, generate, upload, or share content raise particular challenges, including intellectual property infringement, nonconsensual intimate imagery, and anonymous bullying. The text lists "AI content creation apps" next to social media and user-generated content platforms.
The practical consequence for a reader is limited but concrete. An app that sends a user's text or photos to an outside AI service must say so and ask first, and an app that generates content must meet the user-generated content expectations. The page showed a last-updated date of October 16, 2026 when checked on October 27, 2026.
What Google Play requires
Google's AI-Generated Content policy states that apps generating content using AI must contain in-app user reporting or flagging features, and that developers should use those reports to inform content filtering and moderation. The policy says such apps must prohibit and prevent the generation of Restricted Content, and its examples include content that facilitates the exploitation or abuse of children and content that enables deceptive behavior.
The requirement was first announced on the Android Developers Blog in October 2023. A post dated June 6, 2024 by Prabhat Sharma, Google's Director of Trust and Safety for Play, Android, and Chrome, repeated that all generative AI apps must give users a way to report or flag offensive content without leaving the app. It also advised developers to test across user scenarios and document the testing, since Play may request it.
The August 2026 reminder on intimate imagery
An Android Developers Blog post dated August 25, 2026 focused on non-consensual intimate imagery and "nudify" media. It tells developers to give reviewers full access to AI features, with no paywall or geo-fence blocking review, and to supply proof that the models their app calls reject requests for explicit image edits or deepfakes. It also says developers should not rely only on a model's built-in protections, and should add their own input and output moderation. The post adds that apps suspended or removed for generating or monetizing such content are blocked from monetization and advertising across Google's platforms.
Side-by-side view of the two rulebooks
| Topic | Apple App Review Guidelines | Google Play policy |
|---|---|---|
| Personal data sent to outside AI | Disclosure and explicit permission required (5.1.2(i)) | Not addressed on the AI-Generated Content page |
| Reporting harmful output | User-generated content rules apply to AI content creation apps (1.2) | In-app reporting or flagging required |
| Named harms | Intellectual property infringement, nonconsensual intimate imagery, bullying | Restricted Content, including child exploitation and deceptive behavior |
| Evidence from developer | Not specified for AI | Testing documentation may be requested; model-rejection proof for image apps (August 2026) |
Checking an AI app before relying on it
- Does the app say which outside AI services receive user data, and does it ask first?
- Can output be reported from inside the app?
- Does the developer name its testing, or only describe benefits?
- Are industry impact claims backed by a study, a customer count, or a regulator's decision, or only by marketing copy?
- For regulated uses such as health or finance, is there a separate clearance that the store listing does not replace?
FAQ
Does an app store listing prove an AI app works?
No. The policies above concern disclosure, content safety, and developer conduct. Neither rulebook promises accuracy, savings, or industry results.
Do the stores rank AI apps by innovation?
The policy pages reviewed here contain no innovation ranking. Any "most innovative" list comes from a publisher or a seller, and its method needs to be read before it is trusted.
Does Google Play have a rule on sharing data with third-party AI?
The AI-Generated Content policy page does not address it. Other Google Play policies may cover user data, and they were not part of this review.
Do these rules apply in Canada?
Both rulebooks are written by the store operators and apply to app submissions globally. Canadian privacy law is a separate layer and was not examined here.
Related reading
- Everyday AI apps and what they do
- AI apps used by students
- What the Deloitte AI Institute publishes
- Ten AI technologies used across industries
More in AI Tools and Industry.
Last verified: October 2026
Sources
- App Review Guidelines, Apple, page last updated October 16, 2026
- AI-Generated Content policy, Google Play Console Help, Google, 2026
- Enabling safe AI experiences on Google Play, Android Developers Blog, Google, June 6, 2024
- Announcing Policy Updates To Support App Quality on Google Play, Android Developers Blog, Google, October 2023
- Ensuring Safety in the Generative AI Ecosystem: Protecting Users from Non-Consensual Intimate Content, Android Developers Blog, Google, August 25, 2026