/plushcap/analysis/vonage/vonage-attention-detection-with-vonage-video-api

Attention Detection with Vonage Video API

What's this blog post about?

This article discusses the implementation of an attention detection system for online meetings and video conferencing using face landmark detection technology. The system calculates a participant's attention score based on their facial pose, specifically yaw and pitch angles, and assigns a score from 0 to 2 to indicate low to high attention levels. The system is integrated with the Vonage Video API to enable real-time attention scoring for all participants in a call. The article provides a step-by-step guide on how to set up and implement the system, including cloning the repository, installing packages, setting up the environment variables, and running the application. The system can be further improved by incorporating additional data sources, such as iris movement or multiple face recognition.

Company
Vonage

Date published
Nov. 30, 2022

Author(s)
Hamza Nasir

Word count
1410

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.