Deepening Our Snowpark Integration

Hex has introduced new enhancements to its Snowpark integration, allowing users to switch between SQL, Python, and visual cells while leveraging a Snowpark dataframe. The integration supports Snowpark for Python, providing enhanced security and an easy setup process. With the Easy Button feature, users can create a Snowpark session without exposing their credentials in plain text or managing hidden files. Hex also allows users to use a first-class SQL cell while returning a Snowpark dataframe, offering auto-complete, syntax highlighting, and formatting in SQL. The integration supports lazy evaluation, making it ideal for working with big data by translating Snowpark code into SQL to leverage Snowflake's SQL engine. Users can now perform traditional analyses without worrying about memory consumption in the kernel. Advanced use cases of Snowpark include developing comprehensive data pipelines, exploring Snowflake Streams for Change Data Capture (CDC) pipeline, scheduling pipelines using Hex's built-in scheduling or integrating with orchestration tools like Airflow or Dagster through their integrations, and leveraging Snowpark ML for machine learning in Snowflake.