On-device language model (Foundation Models, Gemini Nano Prompt API)
Runs a small language model on the phone with no cloud call.
In one line
Can use a small AI model on your phone, with no internet needed
Runs a small language model on the phone with no cloud call.
Apps can prompt a system model for text, structured output and tool calls. Both are free and offline but only on eligible devices, and the models are small.
What it can and can't do
What the user does: You tap an AI feature like Summarize or Rewrite
It can
- Answer, summarize or rewrite text on the phone
- Work offline and for free on iPhones with Apple Intelligence (iOS 26)
- Use guided answers and tools on iPhone, or Gemini Nano on some newer Android phones
It cannot
- Run on older phones; only some flagship Android phones and Apple Intelligence iPhones qualify
- Match the power of big cloud models
- Run forever in the background; Android limits it by quota and foreground use
How it differs between platforms: iPhone needs Apple Intelligence and iOS 26. Android uses Gemini Nano on some phones, like Pixel 9 and 10 and Galaxy S24 and newer.
On Android and iPhone
| Android | iPhone | |
|---|---|---|
| Status | Partial | Supported |
| First version | Android 14 (API 34) | iOS 26.0 |
| Permission or entitlement | None; AICore system service; Prompt API beta in ML Kit GenAI (nano-v2 devices, per app quota) | None; requires Apple Intelligence enabled |
| Protection level | none | none |
| How access is granted | none | none |
| What the user sees | Model download by system; quota and foreground limits | Check SystemLanguageModel.availability; Apple Intelligence setting |
| How long it lasts | Per request | Per session |
| How to take it back | Settings > Google > AICore | Settings > Apple Intelligence & Siri |
| Store policy | Gemini Nano usage policy | Apple acceptable use requirements for the model |
| API | ML Kit GenAI Prompt API, AICore, Google AI Edge SDK (experimental) | FoundationModels LanguageModelSession, @Generable, Tool, SystemLanguageModel |
| Notes | Only some flagship phones (Pixel 9 and 10, Galaxy S24 and up and others); availability varies by device. | About 3B parameter model; free, offline; guided generation and tool calling; iOS 26 on Apple Intelligence devices. |
Data you get
What comes back: Model response
Shape: object
How often: per request
| Field | Type | Unit | Range | Precision |
|---|---|---|---|---|
text | string | tokens | context window about 4k | n/a |
Technical limits
- Small context window; device eligibility; not for world knowledge
The story
What it is
A small AI language model that runs on the phone with no internet call.
For you
You ask an app to summarize, rewrite or answer, and it works with no signal. Your text stays on the phone. It is smaller and less clever than the big chat models.
For makers
Makers get an AI feature with no server cost and a privacy story. The model is small and only on newer phones, so features must work without it.
Where you see it
| Type | Example | Apps |
|---|---|---|
| productivity | A notes app summarizes a long page on a plane with no signal. | Notes, Bear |
| games | A role playing game uses the model to write live non player chat. | None named |
| messaging | A chat app suggests short replies privately. | Messages |
| education | A study app builds quiz questions from your notes with no upload. | None named |
| health | A journal app summarizes entries without sending them to the cloud. | Day One |
| accessibility | An app rephrases text in simpler words for a reader. | None named |
| shopping | A store app summarizes long reviews on the phone. | None named |
Risks
- Prompt injection when tools are linked
- Only on newer phones
Android and iPhone in short
- Android: Gemini Nano runs on some flagship phones like Pixel 9 and 10 and Galaxy S24 and later.
- iPhone: A roughly 3B model on Apple Intelligence devices, with guided output and tool calls.
What the platform says
- Apple: Foundation Models. Apple lets apps use the on device model behind Apple Intelligence, free and offline.
- Google: ML Kit GenAI. Google offers on device generative AI tasks through ML Kit using Gemini Nano.
Good uses and abuse
Legitimate uses
- Private summarisation
- Offline assistants
Known abuse
- Prompt injection when tools are connected
Scores
| Score | Value | Meaning |
|---|---|---|
| Sensitivity | 2 of 5 | How revealing the data is |
| Utility | 5 of 5 | How useful it is to honest apps |
| Friction | 1 of 5 | How much the user has to do |
| Fingerprint bits | 1 | Rough identifying entropy, when known |
History
- 2025-05, Android ML Kit GenAI: GenAI APIs on Gemini Nano
- 2025-06, iPhone iOS 26: Foundation Models framework
- 2025-10, Android Prompt API: Prompt API beta
Related capabilities
Related
- System writing tools (Writing Tools, ML Kit Summarization and Rewriting). Can offer rewrite, proofread and summarize inside text boxes, if Apple Intelligence is on
- On-device ML runtime (Core ML, LiteRT). Can run trained AI models on your phone's own chip
Sources
How well checked: Checked against real behavior.