Skip to main content
AI models with trillions of parameters are increasingly common, and the demand for computational power is surging. Traditional GPU solutions struggle to meet these demands, which leads to development bottlenecks, high energy consumption, and escalating costs. CoreWeave’s GB200 and GB300 NVL72-powered instances address these challenges by harnessing the architecture of NVIDIA’s Grace Blackwell Superchip and NVLink Switch System. Liquid cooling improves efficiency by consuming less energy than traditional air-cooled systems. Choose these instances when you need high performance for large-scale AI training and inference, large memory capacity for massive datasets, and fast GPU-to-GPU communication for distributed computing.

​
GB200 instances

CoreWeave’s GB200 instances are powered by 4x NVIDIA GB200 GPUs and connected with 400 Gb/s NDR InfiniBand, built on the NVIDIA Quantum-2 InfiniBand fabric.

​
GB300 instances

CoreWeave’s GB300 instances are offered in two specialized networking configurations that deliver 800 Gbps of bandwidth:

​
Deploy NVL72-powered instances as full racks

NVL72-powered instances must be deployed as full racks of 18 Nodes to ensure optimal performance. CKS enforces full-rack deployment and won’t allow requesting partial racks. When deploying Node Pools for rack-based instances, use targetRacks to request Nodes at the rack level. You can still use targetNodes, but the value must be a multiple of 18, such as 36 or 54. Use targetRacks to specify the number of racks directly, where each rack contains 18 Nodes:
NodePool using targetRacks
apiVersion: compute.coreweave.com/v1alpha1
kind: NodePool
metadata:
  name: example-nodepool
spec:
  computeClass: default
  instanceType: gb200-4x
  targetRacks: 1
Alternatively, use targetNodes set to a multiple of 18, such as 18, 36, or 54:
NodePool using targetNodes
apiVersion: compute.coreweave.com/v1alpha1
kind: NodePool
metadata:
  name: example-nodepool
spec:
  computeClass: default
  instanceType: gb200-4x
  targetNodes: 18
Autoscaling is not supported for rack-based instance types. Setting autoscaling: true on a Node Pool with a GB200 or GB300 instance type is rejected by CKS.
Because NVL72-powered instances must be deployed as full racks, CoreWeave’s Day 2+ automation can’t automatically replace a malfunctioning Node with one from a different rack. Instead, NVL72-powered Nodes must be physically exchanged within the same rack. As a best practice, workloads should tolerate up to two unavailable Nodes per rack for maintenance purposes. If a rack has more than two unavailable Nodes, the entire rack is cordoned and drained for service.

​
Manage Pod affinity

To take full advantage of the NVL72 architecture’s shared NVLink fabric, all Nodes from the same job must be scheduled onto the same rack with the same NVLink domain for optimal performance. This is especially important for large-scale distributed computing tasks, where efficient communication between GPUs reduces processing times.
Slurm users should use the Topology/Block Plugin for Slurm to control job placement.
The following sections describe how to control Pod placement using NVLink domain labels and, when needed, InfiniBand or RoCE network labels. Kubernetes controls Pod placement with affinity rules that steer Pods toward Nodes with specific labels. In CKS, all Nodes are labeled with their NVLink domain, allowing precise control over Pod placement. To ensure multiple Pods are scheduled onto the same NVL72 rack, set their affinity toward Nodes within the same NVLink domain. In the NVL72 architecture, all Nodes within the same rack share the same unique ds.coreweave.com/nvlink.domain label. If a Node Pool spans multiple racks, Pods can reference multiple NVLink domains in matchExpressions.values. For example, this Pod affinity rule targets a single NVLink domain: 
affinity:
  nodeAffinity:
    requiredDuringSchedulingIgnoredDuringExecution:
      nodeSelectorTerms:
      - matchExpressions:
        - key: ds.coreweave.com/nvlink.domain
          operator: In
          values:
          - [NVLINK-DOMAIN] # Your NVLink domain

​
Control placement with InfiniBand labels

In some cases, it’s useful to deploy Pods on Nodes in different NVLink domains while controlling the InfiniBand or RoCE network location. See InfiniBand and RoCE labels for more information.

​
More resources

To learn more about our platform, see the following resources:
Last modified on June 12, 2026