BigDL-LLM Key Features

You may run the LLMs using bigdl-llm through one of the following APIs:

• PyTorch API

• transformers-style API

  • Hugging Face transformers Format

  • Native Format

• LangChain API

• GPU Supports

  • Inference on GPU

  • Finetune (QLoRA)

  • Multi GPUs selection