AI-generated Key Takeaways
-
ML Kit's Face Mesh Detection API generates a real-time, high-accuracy mesh of 468 3D points for selfie-like images, ideal for AR filters and video chat, with faces within ~2 meters of the camera.
-
This API provides key capabilities such as recognizing and locating faces, getting face mesh information, and processing video frames in real time.
-
For detecting faces further than ~2 meters away or requiring face classification features like smiling, the ML Kit Face Detection API is recommended.
-
This API is currently in beta and subject to change.
With ML Kit's face mesh detection API, you can generate in real-timea high accuracy meshof 468 3D points for selfie-like images. Faces should be within ~2 meters (~7 feet) of the camera.
If you want to detect faces further than ~2 meters (~7 feet) away from the camera, please see ML Kit's face detection SDK .
Here are some of the terms used regarding the face mesh detection feature:
- The bounding boxis a rectangular area for a detected face.
- Face mesh infois a group of 468 3D points and edges that can be used to draw the geometry mesh for a detected face.
The face mesh detection API generates a face mesh for detected faces, each containing 468 3D points and edges. With face mesh detection, you can perform more accurate operations on faces real-time, such as AR filters, selfie capture, and video chat.
Key capabilities
- Recognize and locate facesGet the bounding box for detected faces in a selfie-like picture.
- Get face mesh informationGet the 468 3D points and triangle info for each detected face.
- Process video frames in real timeFace mesh detection is performed on-device, and is fast enough for real-time applications, such as video manipulation.
Example results
| Input | Output ("Bounding box only" mode) | Output ("Face mesh" mode) |
|---|---|---|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
Comparison with ML Kit face detection SDK
- Generate AR effects on faces in video streaming
- Real-time face detection in selfie-like pictures (face within ~2 meters)
- Detect how many faces are present in a picture
- Detect faces far away from the camera
Recommended for real-time
- "Bounding box only" mode:>=1 bounding box(es) as long as faces are close to camera (<= ~2 meters or ~7 feet away)
- "Face mesh" mode:max 2 bounding boxes and meshes, as long as faces are close to camera (within ~2 meters away)
- "Bounding box" mode:>=1; faces can be far from camera, but minimum size of 100x100 pixels per face
- Face contours: max 1, as long as faces are close to camera
Unbundled: not available yet
Unbundled: ~0.6Mb
