Node Pool
Node Pool is the schema for the Node Pools API.Node Pool spec
Node PoolSpec defines the desired state of Node Pool.
Node configuration update strategies
Image
Image defines what boot image theNode PoolSpec uses.
NVSHMEM + GDRCopy supportIf you need an image with NVSHMEM and GDRCopy support, you can request to use ncore-image v2.10.1 by contacting support. You must apply a patch to
ibgda in your container, enable GDRCopy, then contact support to get access to this new image.GPU
Thegpu field defines the GPU driver configuration for Nodes in the Node PoolSpec.
Prefill
Theprefill spec defines Node Pool Prefill behavior: proactive provisioning of replacement Nodes before Nodes marked for triage are drained and removed. See Node Pool prefill for an overview.
Node Pool status
Node Pool status is the observed state of aNode Pool.
RackStatus
RackStatus is the observed rack state for a Node Pool. This field is only populated for rack-based instance types.
Pending Node configuration
ThependingNodeConfiguration contains information about the configuration that is pending adoption on the NodePool. This configuration is not set as the active configuration without an explicit upgrade.
This field is only present if there are configuration updates available for your NodePool and your nodeConfigurationUpdateStrategy.type is set to Manual or OnSpecUpdate.
For example, if a new GPU driver or Kubernetes version is available, CKS creates a new configuration and sets it as pending on the Node Pool. The summary field provides more information about the available updates. See Manage Node Pool Configuration to promote a pending configuration.
Node configuration revisions
The revisions list holds history of the Node configurations that were applied to the NodePool. That is, configurations that were at one point thestatus.nodeProfile.
The list is sorted by creation timestamp, and can be used as a reference to roll back to a previous Node configuration if desired. See Manage Node Pool Configuration to roll back to a previous configuration.
Conditions
Node Pools and the Nodes within them report status through conditions.Node conditions
CoreWeave sets the following conditions on Nodes in a Node Pool.Prefill condition reasons
When Node Pool Prefill is enabled, thePrefill condition on a Node uses the following reasons:
Node Pool conditions
CoreWeave sets the following conditions on a Node Pool after the Node Pool resource has been created.Condition: Validated
This condition answers the question: “Is the Node Pool configuration valid?” It has three possible statuses:
Condition: AtTarget
This condition shows whether the Node Pool has the expected number of active Nodes. The AtTarget condition has five possible values:
Condition: NodesRemoved
The condition NodesRemoved is applied to a Node Pool when it is pending deletion and Nodes are in the process of being removed. Once all Nodes are removed, the Node Pool is deleted. This response indicates one of the following conditions:
Condition: Capacity
The Capacity condition indicates whether there is enough capacity available for the requested number of Nodes in the requested instance type. This response indicates one of the following conditions:
Condition: Quota
Quota has four statuses.
Condition: NodeReconfigurationRequired
This condition answers the question: “Do any of my Nodes need to be reconfigured to boot into the active config (status.nodeProfile)?” It has three possible statuses:
Healthy Node Pools
A new Node Pool in a healthy state looks like this when described:new node pool, showing new conditions with 'describe'
Example output