Attention Detection with Vonage Video API
This article discusses the implementation of an attention detection system for online meetings and video conferencing using face landmark detection technology. The system calculates a participant's attention score based on their facial pose, specifically yaw and pitch angles, and assigns a score from 0 to 2 to indicate low to high attention levels. The system is integrated with the Vonage Video API to enable real-time attention scoring for all participants in a call. The article provides a step-by-step guide on how to set up and implement the system, including cloning the repository, installing packages, setting up the environment variables, and running the application. The system can be further improved by incorporating additional data sources, such as iris movement or multiple face recognition.
Company
Vonage
Date published
Nov. 30, 2022
Author(s)
Hamza Nasir
Word count
1410
Language
English
Hacker News points
None found.