Skip to Content
Platform.Ontology

Media codec and capability probing

Asks which audio and video codecs, containers and DRM systems the browser supports.

Used to track youGraphics and fingerprintingMediaWeb browsersWhen the page loads

In one line

Can ask which video, audio and copy protection formats your device supports

Asks which audio and video codecs, containers and DRM systems the browser supports.

Hardware decoders for HEVC, AV1 and DRM (Widevine, FairPlay, PlayReady) differ by OS and chip, so the map reveals device class and licensing.

What it can and can't do

What the user does: Nothing. It happens when the page loads

It can

  • Ask if your device plays formats such as HEVC and AV1
  • Check for copy protection systems such as Widevine, FairPlay and PlayReady
  • Guess your system, chip and device type from the answers

It cannot

  • Play or record anything
  • Ask permission first
  • See what you watch on other sites
  • Know who you are by itself

Browser support

BrowserStatusFirst versionReleasedNote
ChromeSupported232012-11-06None
EdgeSupported122015-07-29None
FirefoxSupported422015-11-03None
SafariSupported82014-10-16macOS first, iPhone MSE from 17.1 via ManagedMediaSource
Safari on iPhoneSupported132019-09-19None
Chrome on AndroidSupported252013-02-27None
Samsung InternetSupported1.52013-09-25None

How a site asks for it

APIMediaSource.isTypeSupported(); canPlayType(); navigator.mediaCapabilities.decodingInfo(); requestMediaKeySystemAccess(); RTCRtpSender.getCapabilities()
Browser compat keysapi.MediaSource.isTypeSupported_static
api.MediaCapabilities.decodingInfo
How access is grantednone
What the user seesNot listed
Needs a secure context (HTTPS)No
Needs a user gestureNo
How long it lastsNot listed
How to take it backNot listed
Inside an iframeNot listed

Typical flow

  1. Test 50 to 200 MIME and codec strings
  2. Query MediaCapabilities for smooth and powerEfficient flags
  3. Probe key systems

Data you get

What comes back: Bit vector plus power efficiency flags
Shape: list

FieldTypeUnitRangePrecision
supportedbooleanNonetrue or falseexact
powerEfficientbooleanNonetrue or falsehardware decode hint

Technical limits

  • No codec data for media the person plays
  • Entropy is mostly browser and OS

The story

What it is

A page asks which audio and video formats and copy protection systems your browser can play.

For you

You never see it. When you press play, the site first asks your browser which formats it can handle, then picks the best one. You get smoother video and fewer stalls.

For makers

Streaming and cloud gaming services need it to send the right stream, such as H.264, HEVC or AV1, without wasting data or battery. The same answers also work as a device clue for fraud and tracking tools.

Where you see it

TypeExampleApps
videoNetflix checks which video formats and copy protection your browser supports, then streams you the best picture it can.Netflix, Disney+
gamesXbox Cloud Gaming and GeForce NOW in a browser check which video formats your device can decode, so the game stream is sharp and has low delay.Xbox Cloud Gaming, GeForce NOW, Amazon Luna
liveA live sports or concert stream picks a format your phone decodes in hardware, to save battery.Twitch, YouTube Live
videoA video call site checks codecs before it starts, to use the one your device runs best.Google Meet, Zoom web client
securityA fraud tool compares the format list to the device's claimed model, to catch emulators.None named
adsA tracker adds the format list to a device ID, since it differs by browser, chip and system.None named
educationA web class platform picks smaller video for older laptops so lessons still play.Khan Academy

Risks

  • Reveals your hardware and OS
  • Adds to a device ID

What the platform says

  • MDN: Media Capabilities API. Lets a site ask whether the device can decode a video smoothly and efficiently before it picks a stream.

Good uses and abuse

Legitimate uses

  • Pick best stream format

Known abuse

  • Device and hardware decoder inference

Scores

ScoreValueMeaning
Sensitivity2 of 5How revealing the data is
Utility3 of 5How useful it is to honest apps
Friction0 of 5How much the user has to do
Fingerprint bits3Rough identifying entropy, when known

History

  • 2018-04, Chrome 66: MediaCapabilities decodingInfo ships; exposes hardware decode hints
  • 2023-10, Safari 17.1: ManagedMediaSource on iPhone

Sources

How well checked: Based on official documentation.

On this page