Claude 3.5 Haiku on AWS Trainium2 and model distillation in Amazon Bedrock

Anthropic has collaborated with AWS to optimize Claude models to run on AWS Trainium2, their most advanced AI chip. Claude 3.5 Haiku now supports latency-optimized inference in Amazon Bedrock, making the model significantly faster without compromising accuracy. The company is also adding support for model distillation in Amazon Bedrock, bringing the intelligence of larger Claude models to its faster and more cost-effective models. They are working on Project Rainier, an EC2 UltraCluster of Trn2 UltraServers containing hundreds of thousands of Trainium2 chips, which will deliver over five times the computing power used to train current AI models.