Skip to Content
Platform.Ontology

Shape Detection: FaceDetector and TextDetector

Finds faces and printed text in an image (experimental flag only).

Works without askingHardware and accessoriesShape detectionWeb browsersWhile you use it

In one line

Can find faces and printed text in a picture, but only with a special setting on

Finds faces and printed text in an image (experimental flag only).

Face boxes and text blocks from images without server calls. Experimental and off by default; not a stable surface.

What it can and can't do

What the user does: You turn on a flag in Chrome, then pick or load a picture.

It can

  • Find where faces are in a picture, without naming them
  • Find where printed text sits in a picture
  • Work on a photo or a camera frame the page already has

It cannot

  • Work in normal Chrome, Edge, Firefox or Safari without the flag turned on
  • Tell who a person is
  • Work on Android or iPhone browsers
  • Work on pictures the page does not have

How it differs between platforms: Only desktop Chrome and Edge with a flag turned on. No phone browsers.

Browser support

BrowserStatusFirst versionNote
ChromeBehind a flagNot availableExperimental flag only
EdgeBehind a flagNot availableExperimental flag only
FirefoxNot supportedNot availableNone
SafariNot supportedNot availableNone
Safari on iPhoneNot supportedNot availableNone
Chrome on AndroidNot supportedNot availableNone
Samsung InternetNot supportedNot availableNone

How a site asks for it

APInew FaceDetector().detect(img), new TextDetector().detect(img)
How access is grantedsettings
What the user seesFlag chrome://flags/#enable-experimental-web-platform-features
Needs a secure context (HTTPS)Yes
Needs a user gestureNo
How long it lastsPer origin
How to take it backSite settings
Inside an iframeSame as top level; cross-origin iframes need a permissions policy where listed

Typical flow

  1. Call the API
  2. Browser applies its access rules
  3. Page receives the result

Data you get

What comes back: Finds faces and printed text in an image (experimental flag only).
Shape: object
How often: on demand

FieldTypeUnitRangePrecision
boundingBoxobjectpixelsimage rectNot listed
landmarks[]listpixelseyes, nose, mouthNot listed
text (TextDetector)stringNonerecognised textNot listed

Technical limits

  • No stable release in any browser
  • No BCD entry

The story

What it is

A page can find faces and printed words in a picture, but only in a test mode.

For you

You will not meet it on normal sites. It is behind a flag, so only people who turn it on see it.

For makers

Makers would use it for photo tags, camera filters and reading text from pictures. It is not on by default because face finding raises privacy worries.

Where you see it

TypeExampleApps
creativeA photo editor crops a picture around the faces it finds.None named
socialA camera filter app places stickers on faces.None named
educationA tool reads text on a worksheet photo for a translator.Google Translate
accessibilityA page reads out the text in a picture to a blind user.None named
securityA bad site could count faces in a photo you upload.None named
gamesA browser game moves a character as you turn your head.None named

Risks

  • Face scanning
  • Not widely supported

What the platform says

  • Google: Shape Detection API. Chrome's docs describe detecting faces, barcodes and text in images, with faces and text still behind a flag.

Good uses and abuse

Legitimate uses

  • Photo tagging
  • Accessibility

Known abuse

  • Face detection without consent

Scores

ScoreValueMeaning
Sensitivity3 of 5How revealing the data is
Utility2 of 5How useful it is to honest apps
Friction3 of 5How much the user has to do
Fingerprint bitsNot ratedRough identifying entropy, when known

History

  • 2018, Chrome: Introduced behind experimental flag; no stable release since

Sources

How well checked: Inferred from related behavior.

On this page