Company
Date Published
Author
Together AI
Word count
1145
Language
English
Hacker News points
None

Summary

At NVIDIA GTC, Together AI announced its collaboration with NVIDIA to accelerate AI workloads on the Blackwell platform. Salesforce leverages Together AI for the entire AI journey, including training, fine-tuning, and inference of their models, and saw a 2x improvement in training speeds when upgrading from HGX H200 to HGX B200. Zoom experienced a 1.9X improvement in training speeds over previous generation NVIDIA Hopper GPUs. InVideo immediately saw a 25% improvement when running a training job on the NVIDIA HGX B200, and then doubled this improvement with optimizations made in partnership with Together AI researchers. The Together Training Stack includes custom-built containers for debugging and running diagnostics at scale, comprehensive MFU benchmarks, full bandwidth benchmarking toolkits, and collective communication diagnostics toolkits. Price-performance is widely considered the most important metric when it comes to GPU cloud infrastructure, and Together AI specializes in delivering higher tokens/sec/node and overall MFU than other providers on the same hardware. The platform offers strong price-performance, infrastructure and security features, technical expertise and support, and flexible consumption models.