Skip to main content

Create Buckets

Create CoreWeave AI Object Storage buckets with Cloud Console or CLI clients.

Buckets are the primary organizational unit used to store object data in CoreWeave AI Object Storage. They are similar to folders in a file system.

This guide explains how to create a bucket with the CoreWeave Cloud Console or CLI clients such as S3cmd, AWS CLI, and Boto3.

Prerequisites​

Create a bucket with Cloud Console​

Info
  • To create a bucket with the Cloud Console, you must have admin permissions.
  • Bucket names must be globally-unique and not begin with cw- or vip-, which are reserved for internal use.

To create a bucket with the CoreWeave Cloud Console, follow these steps:

  1. In the Cloud Console, navigate to Object Storage > Buckets.
  2. Click Create Bucket.
  3. In the dialog, enter a Bucket Name.
  4. Chose a Zone.
  5. Click Create.
  6. Click More options to view information in Grafana, or to delete the bucket.

Create a bucket with CLI clients​

CoreWeave AI Object Storage is compatible with S3-compatible clients, including S3cmd, the AWS CLI, and Boto3.

S5cmd is not supported

S5cmd is not compatible with AI Object Storage because it uses path-style addressing with a custom endpoint URL. AI Object Storage requires virtual-hosted style URLs with custom endpoints.

Any other third-party tool that does not support virtual-hosted style URLs with custom endpoints is also incompatible with AI Object Storage.

Before creating a bucket, configure S3cmd, AWS CLI, or Boto3. Note that the primary endpoint, https://cwobject.com, requires TLS v1.3. Ensure your S3-compatible tools and OpenSSL use TLS v1.3.

In the sections that follow:

  • Replace AVAILABILITY_ZONE with a supported Availability Zone code.
  • Replace BUCKET_NAME with a globally unique name that does not begin with cw- or vip-, as these prefixes are reserved for internal use.
Bucket creation delay

When a bucket is created using an S3-compatible client, it takes approximately one minute before the bucket becomes available due to DNS caching. You may see the following error immediately after bucket creation: An error occurred (InvalidRegion) when calling the ListObjects operation: Region does not match. Wait one minute, then try again.

This delay does not occur when creating buckets via the Cloud Console UI.

Use S3cmd​

To create a bucket with S3cmd, use the mb (make bucket) subcommand. The --bucket-location parameter is required.

Make a bucket with S3cmd
$
s3cmd mb --bucket-location=AVAILABILITY_ZONE s3://BUCKET_NAME

If you need to configure S3cmd for AI Object storage, see Manage buckets with S3cmd.

Use AWS CLI​

To create a bucket with AWS CLI, use the aws s3api command. The LocationConstraint parameter is required.

Create a bucket with AWS CLI
$
aws s3api create-bucket \

    --bucket BUCKET_NAME \

    --region AVAILABILITY_ZONE \

    --create-bucket-configuration LocationConstraint=AVAILABILITY_ZONE

If you need to install or configure AWS CLI for AI Object Storage, see Manage buckets with AWS CLI.

Use Boto3​

To create a bucket with Boto3, use the create_bucket method. The LocationConstraint parameter is required.

Create a bucket with Boto3
 response = client.create_bucket(

    Bucket='BUCKET_NAME',

    CreateBucketConfiguration={

        'LocationConstraint': 'AVAILABILITY_ZONE',

    },

)



print(response)

If you need to configure Boto3 for AI Object Storage, see Manage buckets with Boto3.

Next steps​

After creating a bucket, set policies to control access, lifecycle, and auditing.

Last updated on