CoreWeave AI Object Storage
Highly reliable, performant Object Storage designed for AI workloads
CoreWeave AI Object Storage is purpose-built for storing and loading training code, checkpoints, and model weights. It efficiently serves data directly to GPU Nodes through an S3-compatible API, and via model serializers such as CoreWeave Tensorizer. It works in conjunction with CoreWeave's Local Object Transfer Accelerator (LOTA) is a first-of-its-kind, Node-local connection to Object Storage, enabling a hyper-efficient path for object data to the GPU that also caches data on GPU Nodes to reduce load times.
Security and availability
CoreWeave AI Object Storage is designed to safeguard information that requires secure, reliable containment for long periods of time. AI Object Storage offers superior reliability by providing high redundancy, versioning, and bucket security policies.
- Versioning for backups and archiving: CoreWeave AI Object Storage supports versioning, allowing multiple versions of data to be stored. This is useful for data recovery, and is an effective method for tracking changes over time. If required, clients can also revert to previous versions of data. AI Object Storage is ideal for archiving, backups, and use cases where data requires long-term, low-risk resiliency.
- Bucket and lifecycle policies: AI Object Storage mitigates the risk of unauthorized access and misuse via bucket and lifecycle policies. These policies can maintain efficient access control, consistent retention scheduling, and secure data management.
- Platform independent: Clients can use CoreWeave AI Object Storage independently of Cloud provider infrastructure. As such, it's a flexible option for various use cases and environments. CoreWeave AI Object Storage can also be connected to multiple storage backends across Cloud providers, offering a high degree of availability.
High performance
- Immediately accessible data: CoreWeave AI Object Storage makes data extremely accessible as soon as it has been stored: after writing data to CoreWeave AI Object Storage, clients can re-access and read that data immediately.
- "Read-after-write": CoreWeave AI Object Storage provides a "read-after-write" function, meaning any
read
operation after awrite
operation will retrieve updated data. This allows for secure parallel access, higher performance, and improved scalability.
Metrics and logging
CoreWeave plans to offer audit logging and other metrics in the near future, but they are currently unavailable for this release. If you have specific questions about observability, please contact CoreWeave support.
Get started
- See How-To: Get Started with AI Object Storage to learn how to create Access Keys, buckets, and policies, and how to use objects and buckets to store and retrieve data.
- Explore the Concept, Reference, and Hot-To guides in this section to learn more about specific areas of CoreWeave AI Object Storage.