Siri and voice shortcuts
Lets Siri send the app voice requests and read the app's shortcuts.
In one line
Can accept your Siri voice requests and show shortcuts, after you allow Siri
Lets Siri send the app voice requests and read the app's shortcuts.
Siri forwards what was spoken and learned patterns; apps expose actions to the assistant.
What it can and can't do
What the user does: You say a command to Siri, or tap Allow for Siri and Dictation
It can
- Run an action when you ask Siri by voice
- Suggest shortcuts to you based on how you use the app
- Receive the words you said to carry out the request
It cannot
- Hear you when you did not call Siri
- Use Siri features after you tap Don't Allow
How it differs between platforms: iPhone shows an Allow prompt for Siri and Dictation. On Android, voice requests go through the assistant with no per app prompt.
On Android and iPhone
| Android | iPhone | |
|---|---|---|
| Status | Partial | Supported |
| First version | Android 8 (API 26) | iOS 10 |
| Permission or entitlement | No runtime permission; App Actions declared in shortcuts.xml | NSSiriUsageDescription |
| Protection level | none | prompt |
| How access is granted | install | prompt |
| What the user sees | None | Allow or Don't Allow Siri and Dictation for the app |
| How long it lasts | Per request | Until revoked |
| How to take it back | Google Assistant settings | Settings > Siri > Apps |
| Store policy | None listed | App Review 5.1.1 |
| API | App Actions, Shortcuts, Assistant built-in intents | INPreferences.requestSiriAuthorization, App Intents (iOS 16) |
| Notes | Voice requests handled via intents | App Intents shortcuts need no authorization |
Data you get
What comes back: Intent request
Shape: event
How often: per utterance
| Field | Type | Unit | Range | Precision |
|---|---|---|---|---|
intent | string | None | app declared | Not listed |
Technical limits
- Only declared intents are handled
The story
What it is
Lets Siri talk to an app, so you can use it by voice.
For you
You say 'Hey Siri, send money to Sam' or tap a suggestion on your lock screen. The phone learns your habits and offers actions at the right moment.
For makers
Voice and suggestions keep an app one phrase away from the user, even when the icon is buried. Makers gain more daily opens and a way into cars, watches and speakers.
Where you see it
| Type | Example | Apps |
|---|---|---|
| music | 'Hey Siri, play my workout playlist' starts the right playlist in your music app. | Spotify, Apple Music |
| messaging | You tell Siri to text a friend on WhatsApp and she reads your message back before sending. | WhatsApp, Telegram |
| fitness | A shortcut starts a ten minute stretch routine when you get to the gym. | Peloton, Nike Training Club |
| delivery | You say 'Order my usual coffee' and the app builds the order from your last pickup. | Starbucks, DoorDash |
| productivity | Say 'Add milk to my list' and the item lands in the shopping app without opening it. | Things, Todoist, Reminders |
| smart-home | Lights and locks respond to a voice command from the phone, watch or car. | Apple Home |
Risks
- Voice requests go to servers
- Learned habits reveal routines
Android and iPhone in short
- Android: Android uses Google Assistant and App Actions, which need no extra permission prompt.
- iPhone: iOS shows a Siri permission pop up and shares learned patterns with the app.
What the platform says
- Apple: Siri and Shortcuts. Use your voice to get things done in apps, and teach Siri your routines.
- Google: App Actions. Let people open and use app features with Google Assistant voice commands.
Good uses and abuse
Legitimate uses
- Voice commands
Known abuse
- Intent spoofing
Scores
| Score | Value | Meaning |
|---|---|---|
| Sensitivity | 3 of 5 | How revealing the data is |
| Utility | 3 of 5 | How useful it is to honest apps |
| Friction | 2 of 5 | How much the user has to do |
| Fingerprint bits | Not rated | Rough identifying entropy, when known |
History
- 2016-09, iPhone iOS 10: SiriKit and NSSiriUsageDescription
- 2022-09, iPhone iOS 16: App Intents framework
Related capabilities
Related
- Speech recognition. Can turn your speech into text, sometimes on Apple's servers
Sources
How well checked: Based on official documentation.