Container Images
CoreWeave provides containers for machine learning applications that are tuned specifically for use on the CoreWeave platform. Below is an overview on the available container images, as well as how to access them. For up-to-date version information and more details, refer to the the
ml-containers repository.The
ml-containers repository contains multiple Dockerfiles, each with their own folders that contain all other files that are required for building container images using Docker.A few special PyTorch images are available in that repository:
Note
The container
ml-containers/torch provided by CoreWeave contains custom builds of PyTorch, torchvision, and torchaudio, each specifically tuned for use on our platform.There are two variants available in the
ml-containers repository, respectively named base and nccl. Both base and nccl variants are available for ml-containers/torch-extras, whose versions match those provided for ml-containers/torch.This image only includes essentials (CUDA,
torch, torchvision, torchaudio). Because of this, it has a small image size, making it fast to launch.This image includes development libraries and build tools, such as
nvcc, which are necessary for compiling other PyTorch extensions. Because of this, it has a slightly larger image size.Note
nccl variant builds are built on component libraries optimized for the CoreWeave Cloud; see coreweave/nccl-tests. The image
ml-containers/torch-extras extends the ml-containers/torch images with a set of common PyTorch extensions:Note
The
base edition retains a small size due to using a multi-stage build in order to avoid including CUDA development libraries in it, despite those libraries being required to build the extensions themselves.
ml-containers/nightly-torch is an experimental, nightly release channel of the PyTorch Base Images in the style of PyTorch's own nightly preview builds, featuring the latest development versions of torch, torchvision, and torchaudio pulled daily from GitHub and compiled from source.Important
PyTorch Nightly containers are based on unstable, experimental preview builds of PyTorch, and should be expected to contain bugs and other issues. For more stable containers, use the PyTorch base and PyTorch extras containers.
ml-containers/nightly-torch-extras is a version of PyTorch Extras built on top of the ml-containers/nightly-torch container images. These are not nightly versions of the extensions themselves; they match the extension versions in the regular PyTorch Extras containers.For up-to-date version information and more details on all images discussed here, please refer to the the
ml-containers repository.