Making AI charts go brrrr

Hex has significantly improved the response time of its AI charts feature, reducing it from an average of 10.3 seconds to just 1.3 seconds. The initial version of the tool took longer than expected due to the complexity of generating visualizations using natural language processing and SQL queries. To address this issue, Hex simplified its chart specification by focusing on commonly used features and reducing the number of tokens required for generation. This led to a smaller "chart stub" that could be accurately represented with just 35 configuration keys. By testing different models and configurations, Hex was able to achieve an 80% accuracy rate while maintaining fast response times. The company plans to continue optimizing its AI features and exploring new technologies like GPT-4o for further improvements.