Skip to main content

What is a DS3 Gateway?

A DS3 Gateway is the access point to the DS3 storage system. It exposes an S3-compatible API to external applications and services, enabling seamless integration with standard tools like:

  • AWS CLI
  • rclone
  • Backup software with S3 support

DS3 Gateways act as the bridge between your apps and the DS3 geo-distributed backend, offering secure, efficient, and scalable access to object storage.

info

In Composer, each Tenant requires a domain and a private DS3 Gateway to complete creation. Public gateways are not used in Composer.

DS3 Gateway Architecture Overview

Core Components​

A DS3 Gateway includes the following components:

  • S3 Server Exposes the S3-compatible API, handles request authentication, performs client-side encryption, and manages secure interaction with the storage backend.

  • Offloader Processes Handle the core DS3 logic:

    • Fragment and encrypt objects
    • Apply redundancy policies (e.g., erasure coding)
    • Transfer fragments to and from Swarm nodes
  • Optional Cache Accelerates frequent reads and write bursts. When deployed on shared storage, the cache improves performance across multiple gateway instances.

DS3 Gateway Internal Architecture

Deployment Options​

DS3 Gateways are infrastructure-agnostic and can run on:

  • Physical servers (on-prem or edge)
  • Virtual machines (e.g., VMware, KVM, Proxmox)
  • Cloud instances (e.g., AWS EC2, Azure VMs)

You can deploy gateways across sites to optimize access latency and locality.

Private DS3 Gateway​

Composer Tenants are served by a private DS3 Gateway deployed in your organization's infrastructure. The gateway is not managed by Cubbit: it runs in your environment and exposes the S3-compatible endpoint for the Tenant.

Tenant creation requires both a custom domain and a private gateway. A Tenant is ready only after the domain and the gateway are configured.

To create a gateway, see Create a Gateway. For the full Tenant creation flow, including domain and gateway setup, see Create a Tenant.

note

If you already run a Gateway installed with the legacy installer, see Migrate a legacy Gateway to move it to a Kubernetes cluster managed by Composer.

Summary​

DS3 Gateways simplify integration with Cubbit’s geo-distributed storage while preserving performance, security, and flexibility.

They are:

  • S3-compatible
  • Secure by design
  • Deployable anywhere

Composer uses private DS3 Gateways: every Tenant is served by a gateway deployed in your organization's infrastructure and requires both a custom domain and a private gateway to be complete.

Need help designing your deployment? Contact our support or solution engineering team.