/plushcap/analysis/vonage/vonage-auto-zoom-and-center-published-video-calls-with-vonage-video-api

Auto Zoom and Center Published Video Calls with Vonage Video API

What's this blog post about?

The Vonage Video API with the ml-transformers and media-processor libraries can be used to create a video call that automatically zooms and centers the publisher's face, allowing for a deeper diagnosis by clearly monitoring patients' facial reactions during a medical consultation session. To achieve this, developers need to initialize and connect to a generated session ID, JWT, and API key, then use the mediaPipeHelper library to detect the publisher's face and send the webcam image periodically. The detected result is passed to the web worker for post-processing, where it is used to calculate the cropped dimension applied to zoom the video. Additionally, the media-processor library is used to generate a new video stream with the desired dimensions, which can be published to the session.

Company
Vonage

Date published
July 14, 2022

Author(s)
Iu Jie Lim

Word count
1005

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.