Company
Date Published
April 22, 2024
Author
Together AI
Word count
361
Language
English
Hacker News points
None

Summary

The Together AI Python SDK has been officially released with version v1, providing improved OpenAI compatible APIs for inference, fine-tuning, and other applications. The new API is more intuitive, supports async operations, and includes better error handling. Users can now stream responses from chat models, run completions on code and language models, use image models, generate embeddings, and fine-tune models with their own data. Fine-tuning is supported through the SDK or CLI, including the Llama 3 models, and users are encouraged to filter out low-quality data when using the RedPajama-V2 Dataset. The Python library is available on GitHub, and a similar TypeScript SDK is expected to be released in the coming weeks.