Video + AI: Configurable Audio Processing for Video Applications
The author of the article has updated their Node application that uses the Vonage Video API's Audio Connector feature to demonstrate additional use-cases beyond transcription. The new features include extracting questions, action items, and topics from audio data during a video call. These features are implemented using Symbl.ai's Streaming API and allow for configurable options for which parts of the audio to process. The application flow has been updated to provide checkboxes for selecting processing options, and a `SymblProcessor` class has been created to manage the configuration, handlers, and data storage for these new features. The article also highlights the importance of considering how to implement an application using Audio Connector when determining whether to send individual or combined streams.
Company
Vonage
Date published
Sept. 26, 2023
Author(s)
Karl Lingiah
Word count
1499
Language
English
Hacker News points
None found.