Motion sensors as a side channel
Motion sensors can pick up nearby speech and typing taps.
In one line
Can maybe pick up nearby speech or typing taps from motion sensors, in research
Motion sensors can pick up nearby speech and typing taps.
Gyroscope and accelerometer pick up speaker vibrations and taps, letting a research app recover digits or speech with no mic permission. This is why Android 12 capped the rate.
What it can and can't do
What the user does: Nothing. It happens when an app or page collects fast motion data
It can
- Collect motion data at a high rate
- Look for patterns that match taps or nearby speech
- Guess a few spoken words or tapped keys in lab tests
It cannot
- Collect above 200 times a second on Android 12 and newer without declaring it
- Get Safari motion data on iPhone without a permission since iOS 12.2
- Match a real microphone for quality
- Work well in noisy daily use; it is mostly a lab result
How it differs between platforms: Android 12 caps the rate at 200 Hz unless declared. Safari on iPhone asks for a motion permission.
On Android and iPhone
| Android | iPhone | |
|---|---|---|
| Status | Partial | Partial |
| First version | Android 1.5 (API 3) | iOS 4.0 |
| Permission or entitlement | Not listed | none |
| Protection level | none | none |
| How access is granted | none | none |
| What the user sees | Not listed | Not listed |
| How long it lasts | Not listed | Not listed |
| How to take it back | Not listed | Not listed |
| Store policy | None listed | None listed |
| API | Raw sensor streams above 200 Hz | Safari asks for a motion permission since iOS 12.2. |
| Notes | Rate cap 200 Hz since 12 (API 31) unless declared | None |
Data you get
What comes back: Vibration signal
Shape: stream
How often: 200 Hz and above
| Field | Type | Unit | Range | Precision |
|---|---|---|---|---|
sample_rate | float | Hz | 50 to 500 | device dependent |
Technical limits
- Accuracy limited by the sample rate cap
The story
What it is
Researchers showed that motion sensors can pick up nearby speech and typing taps.
For you
You would not notice it. Your phone sits on a table and its motion chip feels tiny shakes from your voice or your typing. A rogue app could guess some words or digits without ever asking for the microphone.
For makers
Honest makers have no use for it. It matters because it shows a side door around the mic permission. Android 12 limited how fast sensors can be read, and iPhone prompts for motion on websites.
Where you see it
| Type | Example | Apps |
|---|---|---|
| security | A research app guessed spoken digits from the gyroscope on a phone lying on a desk (the Gyrophone work). | None named |
| security | Researchers recovered PIN taps from motion data while the person typed on a banking app. | None named |
| games | A game that must read motion at high speed could in theory pick up speech, which is why speed is capped. | None named |
| enterprise | A company bans unknown apps on phones used in sensitive meetings, in case sensors pick up speech. | None named |
| accessibility | Voice control tools prefer the mic, since the sensor is too weak and noisy for real use. | None named |
| developer | A platform engineer tests a rate cap to see how far it cuts the leakage. | None named |
Risks
- Speech or PIN inference without the mic
- Sensor access has no prompt
Android and iPhone in short
- Android: Android 12 caps motion sensor speed to 200 Hz unless an app gets a special permission.
- iPhone: iPhone limits raw motion on web pages and asks the person for permission on Safari.
Good uses and abuse
Legitimate uses
- None
Known abuse
- Speech or PIN inference without mic
Scores
| Score | Value | Meaning |
|---|---|---|
| Sensitivity | 4 of 5 | How revealing the data is |
| Utility | 1 of 5 | How useful it is to honest apps |
| Friction | 1 of 5 | How much the user has to do |
| Fingerprint bits | Not rated | Rough identifying entropy, when known |
History
- 2021-10, Android 12 (API 31): 200 Hz cap added to limit eavesdropping
Related capabilities
Related
- Raw accelerometer and gyroscope. Can see how your phone moves and tilts, with no prompt
Sources
How well checked: Based on official documentation.