BigDL DocumentationΒΆ

BigDL makes it easy for data scientists and data engineers to build end-to-end, distributed AI applications. The BigDL 2.0 release combines the original BigDL and Analytics Zoo projects, providing the following features:

  • DLlib: distributed deep learning library for Apache Spark

  • Orca: seamlessly scale out TensorFlow and PyTorch pipelines for distributed Big Data

  • RayOnSpark: run Ray programs directly on Big Data clusters

  • Chronos: scalable time series analysis using AutoML

  • PPML: privacy preserving big data analysis and machine learning (experimental)

  • Nano: automatically accelerate TensorFlow and PyTorch pipelines by applying modern CPU optimizations