Serverless

Deploying applications as serverless services is a good alternative to a regular Deployment / Service model when the applications purpose is to serve HTTP or gRPC requests, either internal or from the Internet. CoreWeave uses the KNative runtime to support deploying a serverless application with a single manifest. No installation necessary.
Serverless Benefits
Automatic public HTTPS endpoints
Auto-scaling, including scale to zero
No public IP charges
​Canary deployments and other advanced deployment strategies
One Step Example
helloworld-ksvc.yaml
1
apiVersion: serving.knative.dev/v1 # Current version of Knative
2
kind: Service
3
metadata:
4
  name: helloworld # The name of the app
5
  annotations:
6
    autoscaling.knative.dev/minScale: "0" # Allow scale to Zero
7
    autoscaling.knative.dev/maxScale: "10" # Maximum number of Pods allowed to auto-scale to
8
spec:
9
  template:
10
    spec:
11
      containerConcurrency: 10 # Container can handle 10 concurrent requests
12
      containers:
13
        - image: gcr.io/knative-samples/helloworld-go # The URL to the image of the app
14
          resources:
15
            limits:
16
              cpu: 2
17
              memory: 4Gi
18
          env:
19
            - name: TARGET # The environment variable printed out by the sample app
20
              value: "Go Sample v1"
21
          
Copied!
After applying the manifest, get the public URL of the service. The service will be scaled up and down based on demand, and scaled to zero consuming no resources and incurring no billable charges when idle.
1
$ kubectl get ksvc
2
NAME            URL                                                       LATESTCREATED         LATESTREADY           READY   REASON
3
helloworld      https://helloworld.default.knative.chi.coreweave.com      helloworld-ngzsn      helloworld-ngzsn      True
Copied!
Monitoring
Managed Grafana provides monitoring of requests, success rates, response times and auto-scaling metrics transparently. No metrics specific code needs to be added to the serverless application.

CoreWeave Kubernetes - Previous

Exposing Applications

Next - CoreWeave Kubernetes

Metrics

Last modified 1yr ago

Copy link

Contents

Monitoring