SAM 2 Is Now Available in FiftyOne!

Segment Anything 2 (SAM 2) is a major leap forward in segmentation technology, offering cutting-edge performance in both images and videos. It builds on the foundation of the original Segment Anything, which Meta released in April 2023, enhancing image segmentation while introducing advanced video capabilities. SAM 2 enables precise segmentation and tracking in video sequences using simple prompts like bounding boxes or points from a single frame, opening up exciting possibilities for various video applications. FiftyOne makes it easy to work with visual data by seamlessly generating segmentation labels and visualizing them on datasets. Users can download SAM 2 models and run inference on their FiftyOne datasets directly from the FiftyOne Model Zoo using simple commands. The tutorial demonstrates how to load a dataset, provide bounding box prompts to generate segmentations, use keypoints instead of bounding boxes, and even automatically generate masks for whole images without any prompts. For videos, SAM 2's segmentation and tracking capabilities can be used to propagate masks from one frame to another seamlessly. The tutorial concludes with the available models in the FiftyOne Model Zoo and suggestions for getting started with FiftyOne and its Visual AI features.