GPU Supports

BigDL-LLM not only supports running large language models for inference, but also supports QLoRA finetuning on Intel GPUs.

• Inference on GPU

• Finetune (QLoRA)

• Multi GPUs selection