On-device AI
AI that runs right on your device. 7 capabilities.
AI that runs right on your device. 7 capabilities in this group.
| Capability | Kind | In one line |
|---|---|---|
| Assistant screen context | Works without asking | Can see your screen when you call the assistant, if it is your chosen one |
| Image generation (Image Playground) | Works without asking | Can offer picture creation through Apple's Image Playground sheet, and sees only the result |
| On-device language model (Foundation Models, Gemini Nano Prompt API) | Works without asking | Can use a small AI model on your phone, with no internet needed |
| On-device ML runtime (Core ML, LiteRT) | Works without asking | Can run trained AI models on your phone's own chip |
| On-device translation | Works without asking | Can translate text on your phone, after you download a language pack |
| System writing tools (Writing Tools, ML Kit Summarization and Rewriting) | Works without asking | Can offer rewrite, proofread and summarize inside text boxes, if Apple Intelligence is on |
| Text recognition and visual look up (Live Text, Visual Look Up, ML Kit) | Works without asking | Can pick out text in pictures and scan documents on your phone |