Skip to Content
Platform.Ontology

On-device language model (Foundation Models, Gemini Nano Prompt API)

Runs a small language model on the phone with no cloud call.

Works without askingOn-device AIGenerative AIAndroid and iPhoneWhile you use it

In one line

Can use a small AI model on your phone, with no internet needed

Runs a small language model on the phone with no cloud call.

Apps can prompt a system model for text, structured output and tool calls. Both are free and offline but only on eligible devices, and the models are small.

What it can and can't do

What the user does: You tap an AI feature like Summarize or Rewrite

It can

  • Answer, summarize or rewrite text on the phone
  • Work offline and for free on iPhones with Apple Intelligence (iOS 26)
  • Use guided answers and tools on iPhone, or Gemini Nano on some newer Android phones

It cannot

  • Run on older phones; only some flagship Android phones and Apple Intelligence iPhones qualify
  • Match the power of big cloud models
  • Run forever in the background; Android limits it by quota and foreground use

How it differs between platforms: iPhone needs Apple Intelligence and iOS 26. Android uses Gemini Nano on some phones, like Pixel 9 and 10 and Galaxy S24 and newer.

On Android and iPhone

AndroidiPhone
StatusPartialSupported
First versionAndroid 14 (API 34)iOS 26.0
Permission or entitlementNone; AICore system service; Prompt API beta in ML Kit GenAI (nano-v2 devices, per app quota)None; requires Apple Intelligence enabled
Protection levelnonenone
How access is grantednonenone
What the user seesModel download by system; quota and foreground limitsCheck SystemLanguageModel.availability; Apple Intelligence setting
How long it lastsPer requestPer session
How to take it backSettings > Google > AICoreSettings > Apple Intelligence & Siri
Store policyGemini Nano usage policyApple acceptable use requirements for the model
APIML Kit GenAI Prompt API, AICore, Google AI Edge SDK (experimental)FoundationModels LanguageModelSession, @Generable, Tool, SystemLanguageModel
NotesOnly some flagship phones (Pixel 9 and 10, Galaxy S24 and up and others); availability varies by device.About 3B parameter model; free, offline; guided generation and tool calling; iOS 26 on Apple Intelligence devices.

Data you get

What comes back: Model response
Shape: object
How often: per request

FieldTypeUnitRangePrecision
textstringtokenscontext window about 4kn/a

Technical limits

  • Small context window; device eligibility; not for world knowledge

The story

What it is

A small AI language model that runs on the phone with no internet call.

For you

You ask an app to summarize, rewrite or answer, and it works with no signal. Your text stays on the phone. It is smaller and less clever than the big chat models.

For makers

Makers get an AI feature with no server cost and a privacy story. The model is small and only on newer phones, so features must work without it.

Where you see it

TypeExampleApps
productivityA notes app summarizes a long page on a plane with no signal.Notes, Bear
gamesA role playing game uses the model to write live non player chat.None named
messagingA chat app suggests short replies privately.Messages
educationA study app builds quiz questions from your notes with no upload.None named
healthA journal app summarizes entries without sending them to the cloud.Day One
accessibilityAn app rephrases text in simpler words for a reader.None named
shoppingA store app summarizes long reviews on the phone.None named

Risks

  • Prompt injection when tools are linked
  • Only on newer phones

Android and iPhone in short

  • Android: Gemini Nano runs on some flagship phones like Pixel 9 and 10 and Galaxy S24 and later.
  • iPhone: A roughly 3B model on Apple Intelligence devices, with guided output and tool calls.

What the platform says

Good uses and abuse

Legitimate uses

  • Private summarisation
  • Offline assistants

Known abuse

  • Prompt injection when tools are connected

Scores

ScoreValueMeaning
Sensitivity2 of 5How revealing the data is
Utility5 of 5How useful it is to honest apps
Friction1 of 5How much the user has to do
Fingerprint bits1Rough identifying entropy, when known

History

  • 2025-05, Android ML Kit GenAI: GenAI APIs on Gemini Nano
  • 2025-06, iPhone iOS 26: Foundation Models framework
  • 2025-10, Android Prompt API: Prompt API beta

Sources

How well checked: Checked against real behavior.

On this page