Install Traefik ingress controller and cert-manager for your vLLM inference deployment
Overview
Before you deploy vLLM, set up the infrastructure components that handle external traffic routing and TLS certificate management. This step installs Traefik (for ingress) and cert-manager (for automatic SSL certificates), so that the vLLM service you deploy in later steps is reachable from outside the cluster over HTTPS.This page is for cluster operators who have already provisioned a CKS cluster and have helm and kubectl configured to target it.
Step 1: Add CoreWeave Helm repository
The CoreWeave Helm repository hosts the Traefik and cert-manager charts used throughout this tutorial. Add it to your local Helm configuration so that subsequent helm install commands can resolve those charts:
Hang tight while we grab the latest from your chart repositories......Successfully got an update from the "kedacore" chart repository...Successfully got an update from the "coreweave" chart repository...Successfully got an update from the "grafana" chart repository...Successfully got an update from the "prometheus-community" chart repositoryUpdate Complete. ⎈Happy Helming!⎈
Step 2: Install Traefik ingress controller
Deploy Traefik to handle external traffic routing and TLS termination:
Release "cert-manager" has been upgraded. Happy Helming!NAME: cert-managerLAST DEPLOYED: Mon 16:25:47NAMESPACE: cert-managerSTATUS: deployedREVISION: 2TEST SUITE: None
To verify that cert-manager is running, use the following command:
kubectl get pods -n cert-manager
You should see output similar to the following:
NAME READY STATUS RESTARTS AGEcert-manager-6b7c8d9f4b-def34 1/1 Running 0 1mcert-manager-cainjector-6b7c8d9f4b-ghi56 1/1 Running 0 1mcert-manager-webhook-6b7c8d9f4b-jkl78 1/1 Running 0 1m
Step 4: Verify infrastructure setup
Before you move on to monitoring setup, confirm that Traefik and cert-manager are both healthy and that the expected cluster issuers are available. Check that all components are installed and running:
kubectl get svc -n traefik
You should see output similar to the following:
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGEtraefik LoadBalancer 10.16.3.150 166.00.0.00 80:37187/TCP,443:33016/TCP,443:33016/UDP 12mtraefik-k8s LoadBalancer 10.16.2.181 10.16.4.0 443:36556/TCP 12m
To check cert-manager services, run the following command:
To verify that certificate issuers are available, run the following command:
kubectl get clusterissuer
You should see output similar to the following:
NAME READY AGEletsencrypt-prod True 7h4mletsencrypt-staging True 7h4mselfsigned-cluster-issuer True 7h4m
What’s next
Your cluster now has Traefik handling ingress and TLS termination, and cert-manager issuing certificates through the letsencrypt-prod, letsencrypt-staging, and selfsigned-cluster-issuer cluster issuers. With these infrastructure dependencies in place, you can expose the vLLM service securely after you deploy it.In the next step, you configure monitoring and observability for your vLLM deployment.
If you encounter issues with the installation, check the Pod logs for troubleshooting information.