Windows User Guide#
Prerequisite#
Confirm your windows version#
To use BigDL on Windows, we recommend using Windows Subsystem for Linux 2 (WSL2). The recommended Windows versions are Windows 10 version 2004 or higher (Build 19041 and higher), or Windows 11.
Install WSL2#
To install WSL2, simply open a PowerShell or Windows Command Prompt as administrator and enter the below command. Restart your machine and wait until WSL2 is successfully installed.
wsl --install
Note
By default, the above command installs the latest required components for WSL2 and Ubuntu as default Linux distribution, and it requires Windows 10 version 2004 or higher. If you’re using older versions of Windows or need customization, please refer to WSL installation guide.
Installation Guide#
You can treat WSL2 shell as a normal Linux shell and run normal bash commands in it. If you’re using WSL2 shell for the first time, it may require you to set up some user information. Using WSL2, you can install BigDL the same way as you do on a Linux system.
Install Conda#
Conda is the recommend way to manage the BigDL environment. Download and install conda using below commands.
wget https://repo.continuum.io/miniconda/Miniconda3-4.5.4-Linux-x86_64.sh
chmod +x Miniconda3-4.5.4-Linux-x86_64.sh
./Miniconda3-4.5.4-Linux-x86_64.sh
Note
On WSL2, you need to use a Linux version of Conda intead of a Windows version. For other available conda versions, refer to conda install, or miniconda install.
Install BigDL#
After installing conda, use conda to create and activate an environment for bigdl.
conda create -n bigdl-env
conda activate bigdl-env
Then install BigDL as a whole, or specific bigdl library the same way as you do on a Linux system. For example,
pip install bigdl
Related Readings
Setup Jupyter Notebook Environment#
Fist, install JupyterLab using pip:
pip install jupyterlab
Then start JupyterLab using:
jupyter lab
Note
Once you started Juypterlab, it will open automatically in your browser. If it does not open automatically, you can manually enter the notebook server’s URL into the browser (The URL is shown on the terminal where you run the command). The default workspace of jupyter is located at the directory where you start the jupyterlab. For more information about JupyterLab installation and usage, refer to JupyterLab User Guide.
Tips and Known Issues#
2. ERROR: Could not build wheels for pycocotools, which is required to install pyproject.toml-based projects#
pycocotools is a dependency of Intel neural-compressor which is used for inference quantization in BigDL-Nano. This error is usually caused by GCC library not installed in system. Just install gcc to resolve it:
sudo apt-get install gcc
3. ValueError: After taking into account object store and redis memory usage, the amount of memory on this node available for tasks and actors is less than -75% of total.#
When running ray applications, you need to set the memory and object_store_memory properly according to your system memory capacity. This error indicates you have used too large memory configurations and you need to decrease them. For example on a laptop with 8G memory, you may set the memory configurations as below:
python yoloV3.py --memory 2g --object_store_memory 1g