Voxel51 Filtered Views Newsletter – May 10, 2024

Voxel51's bi-weekly digest highlights various advancements in the field of artificial intelligence (AI), machine learning, and computer vision. OpenAI's Sora was commissioned to create a music video for The Hardest Part by Washed Out, marking the first AI-generated music video. A mysterious new AI chatbot named "gpt2-chatbot" appeared on LMSYS Chatbot Arena, sparking intense speculation among AI experts. MIT's Jonathan Ragan-Kelley is developing specialized programming languages for efficient visual AI applications like graphics and image processing. StoryDiffusion can generate consistent, long-range image sequences and videos using consistent self-attention to maintain character styles and attires across multiple frames. Simone Scardapane's "Alice's Adventures in a Differentiable Wonderland: A Primer on Designing Neural Networks" delves into the core concepts and components of neural networks, offering a balanced blend of theory and practical application. Voxel51 co-founders Brian Moore and Prof. Jason Corso share their journey from professor and student to co-founders in a special episode featuring them on the How I Met My Co-founder podcast. MM-LLMs: Recent Advances in MultiModal Large Language Models survey paper covers the general model architecture of MM-LLMs, consisting of five components: the Modality Encoder, Input Projector, LLM Backbone, Output Projector, and Modality Generator. The open source FiftyOne computer vision toolkit has crossed 2 Million downloads.