Skip to content
xLLM xLLM PR preview
EN

Hardware Platforms

Choose the guide for your accelerator to prepare the container, install xLLM, select devices, and verify the service.

PlatformBuild targetDevice selectionContainer image
Ascend NPU--device npuASCEND_RT_VISIBLE_DEVICESListed in the guide
Cambricon MLU--device mluMLU_VISIBLE_DEVICESVendor-provided
Hygon DCU--device dcuHIP_VISIBLE_DEVICESListed in the guide
MetaX MACA--device macaCUDA_VISIBLE_DEVICESListed in the guide
Mthreads MUSA--device musaMUSA_VISIBLE_DEVICESListed in the guide
NVIDIA GPU--device cudaCUDA_VISIBLE_DEVICESListed in the guide

Image availability and CPU architectures differ by platform; the Quick Start selector lists the available combinations.

Report issue