Company
Date Published
Author
Wesley Du, Junwei Deng, Kai Huang, Shan Yu, Shane Huang
Word count
1594
Language
English
Hacker News points
None

Summary

The authors from Intel's AI and Analytics Team introduce BigDL, an open-source framework for building scalable end-to-end AI applications on distributed big data using Ray. BigDL seamlessly integrates Ray into big data preprocessing pipelines through RayOnSpark, allowing users to run AI applications directly on their existing big data clusters in a production environment. The authors also showcase the AutoML capability built on top of Ray Tune, which enables users to automate hyperparameter tuning and model selection for various AI applications. Additionally, they introduce Project Chronos, a framework for building large-scale time series analysis applications using BigDL, RayOnSpark, and AutoML capabilities.