Foobot is an AI-based solution that optimizes building energy efficiency by training fully autonomous control agents for Heating, Ventilation and Air Conditioning (HVAC) systems, reducing energy consumption and greenhouse gas emissions. The solution is versatile, scalable, and proven to bring large energy savings in small to large office buildings, hospitals, or schools. Foobot uses software and AI to address the challenges of energy cost crisis and environmental reduction by creating digital twins of buildings and using reinforcement learning (RL) agents to optimize HVAC controls. The company's training platform was significantly improved with the use of Ray Tune and RLlib, which enabled distributed parallel training across multiple CPUs and machines, reducing training time by 70% and accelerating time-to-market by 2x.