What every ticket needs
Include this for every ticket, regardless of domain:- Your organization name and the namespace where the issue occurs.
- The cluster name and the Region or Availability Zone, if relevant.
- A one-line summary of the symptom, then the exact error string you see.
- When it started, and whether it is constant or intermittent.
- What changed recently, for example a deploy, a config change, or a scale-up.
- The priority: Low, Medium, High, or Urgent.
Example ticket body
Diagnose before you file
Run the following read-only commands first. Often they pinpoint the cause so you can fix it without a ticket. When they don’t, their output is exactly the evidence to attach. Replace any[PLACEHOLDER] with your own value.
For a Pending Pod, read its events and confirm Node Pool capacity:
Events, a line like 0/12 nodes are available: 12 Insufficient nvidia.com/gpu means no Node has a free GPU, node(s) had untolerated taint(s) means a taint is blocking the Pod, and didn't match Pod's node affinity/selector means your nodeSelector matches no Node. On the Node Pool, CURRENT should equal TARGET. A QueuedAwaitingCapacity state means CoreWeave is waiting on capacity, and an over-quota state means you are at your ceiling. See Node Pool status.
For a Node’s health and cordon status:
Unschedulable: true means the Node is cordoned. A CoreWeave cordon reason such as NLCCPendingExitProduction is an expected planned lifecycle action, while NeedsTriage is a health signal. An empty result means a plain kubectl cordon likely set it. See Node cordoning.
For a crashing or restarting Pod:
--previous returns the logs from the instance that just crashed, which usually contains the actual error. For an OOMKilled Pod, the container exceeded its memory limit, so raise the limit or reduce memory use.
For a storage mount problem, confirm the volume is bound and has space:
Status: Bound means the volume is attached to the claim. In df -h, Use% near 100% causes ENOSPC errors, and a missing mount path means the volume isn’t mounted where the workload expects.
For CoreWeave AI Object Storage access, confirm credentials and endpoint:
AccessDenied means the credentials lack permission or a policy blocks them, and a connection error means the endpoint URL is wrong or unreachable.
CKS tickets
For CKS scheduling, Node, and cluster problems, include the following:- The Pod or workload manifest, with secrets redacted.
-
The output of describing the failing Pod:
-
Recent events in the namespace:
-
For scheduling or capacity problems, the Node Pool status:
-
For a Node problem, the Node description, with conditions and taints:
SUNK tickets
For Slurm job and Node problems on SUNK, include the following:- The job submission command or the batch script, with secrets redacted.
-
The job ID and the reason shown in the queue:
-
The detailed job record for a failed or stuck job:
-
The state of the Nodes the job targeted:
-
For a drained or down Node, the reason string from
sinfoorscontrol show node.
Storage tickets
For file storage, PVC, and object storage problems, include the following:- The storage product involved: Distributed File Storage, a PVC, AI Object Storage, or Local Storage.
- The exact error string from the client or the mount.
-
For a PVC or mount problem, the PVC and Pod state:
- For an object storage problem, the failing client command with the bucket name, the endpoint, and the addressing style. Redact access keys.
- A timestamp for when the failed request occurred, so the team can correlate it.
Networking tickets
For connectivity, DNS, and LoadBalancer problems, include the following:- The source and destination: Pod to Pod, Pod to Service, Pod to external host, or external to LoadBalancer.
-
The exact error string, for example
connection refused,i/o timeout, or a DNS failure. -
The Service and any network policy involved:
-
A reproduction from inside a Pod, for example a
curlor a DNS lookup against the target, with the full output. - For an external connectivity problem, the public IP or DNS name involved and the direction of the traffic.
Training tickets
For distributed training problems such as NCCL failures, GPU errors, or slow throughput, include the following:- The instance type, the number of Nodes and GPUs, and the framework and version.
- The exact error string, for example a NCCL error code, an XID number, or a collective timeout message.
- The per-rank logs around the first failure, not just rank 0. The first rank to fail usually identifies the cause.
- For a suspected GPU fault, the XID messages from
dmesgand the Node name. - For a performance problem, the observed throughput and the baseline you expected, so the team can quantify the gap.
- For a job that uses the high-performance fabric, confirmation that RDMA is requested and active in the Pod.
Share evidence safely
Sharing the right evidence safely is as important as sharing it at all. Support doesn’t need your credentials to help.- Never share live credentials. A kubeconfig that contains a token, client certificate, or client key is a credential. Share the cluster name and Region instead of the kubeconfig.
- Redact secrets from manifests and
-o yamloutput. Before attaching, scan the output for anydata:block under aSecret, anytoken,password,key, orcertificatefield, and any environment variable that holds a credential. Replace each value with[REDACTED]. - Strip credentials from scripts and command history. Remove access keys, secret keys, and bearer tokens from
sbatchscripts,awscommands, and shell history before attaching them.