What is the Coordinator?
The Coordinator is the control plane of the DS3 Composer platform. It orchestrates metadata-related operations, including shard placement, system health monitoring, authentication, and recovery workflows. The Coordinator exposes a set of APIs and a graphical dashboard, enabling operators to configure and monitor distributed storage environments at scale. While the DS3 architecture is fully distributed, the Coordinator provides a lightweight, centralized layer for managing critical orchestration tasks across a Swarm. It does not store user data and is compatible with zero-knowledge encryption modes. By centralizing this function within the Coordinator, DS3 Composer ensures predictable growth, operational scalability, and consistent enforcement of platform-wide policies.
Why the Coordinator Matters
- Metadata Management: Coordinates object lifecycle metadata such as shard placement, health status, and policy enforcement.
- Resilient by Design: Can be deployed across multiple sites or clouds to maximize uptime and eliminate single points of failure.
- Zero-Knowledge Capable: Fully compatible with DS3's privacy-preserving encryption model.
- Multi-Tenant Friendly: Designed to orchestrate multiple Swarm installations simultaneously, making it ideal for service providers and large-scale enterprise setups.
Deployment Options
The Coordinator can be deployed in two main modes:
1. Managed (SaaS) by Cubbit
- Default option for most users
- High availability and fault-tolerance
- Operated by Cubbit with predefined SLAs
- Ideal for users who prefer hands-off orchestration
2. Self-Hosted (On-Premises)
- Recommended for air-gapped environments
- Requires a license
- A full installation guide is currently under preparation and is not yet available publicly
- Supports:
- Active-Passive clustering for high availability (HA)
- Master-slave architecture across one or two sites
- Stretch clustering to a third site for advanced business continuity
- Backup via DB dumpfor disaster recovery (asynchronous, non-zero RPO)
All deployment scenarios are engineered to avoid reliance on proprietary third-party tools, enabling portability and simplifying long-term maintenance.
Shared Coordinator Model
The Coordinator is designed to support multi-tenant orchestration, meaning:
- A single instance can serve multiple Swarm deployments and multiple Tenants
- Operational costs (e.g., replication, backup, monitoring) can be amortized across installations
This model enables highly cost-effective coordination in multi-cluster or service-provider scenarios, requiring centralized governance over many isolated storage environments.