/plushcap/analysis/vonage/vonage-video-ai-configurable-audio-processing-or-video-applications

Video + AI: Configurable Audio Processing for Video Applications

What's this blog post about?

The author of the article has updated their Node application that uses the Vonage Video API's Audio Connector feature to demonstrate additional use-cases beyond transcription. The new features include extracting questions, action items, and topics from audio data during a video call. These features are implemented using Symbl.ai's Streaming API and allow for configurable options for which parts of the audio to process. The application flow has been updated to provide checkboxes for selecting processing options, and a `SymblProcessor` class has been created to manage the configuration, handlers, and data storage for these new features. The article also highlights the importance of considering how to implement an application using Audio Connector when determining whether to send individual or combined streams.

Company
Vonage

Date published
Sept. 26, 2023

Author(s)
Karl Lingiah

Word count
1499

Language
English

Hacker News points
None found.


By Matt Makai. 2021-2024.