OpenEBS is a opensource Stateful Persistent block-mode Data Storage platform for Kubernetes. We are CNCF member project. We are a large global community of K8s Data storage users.
Our project team was an early pioneering inventor of K8s Container Native Storage services. We concieved the vision of a Stateful Persistent data platform for K8s that is tightly integrated and natively embeded into the core of K8s.
We have built an innovative ultra High-performance Enterprise grade Block-mode Hyper-converged Data Storage Fabric that augments the core storage services of K8s with Stateful Persistence, Enterprise Data mgmt, SSD/NVMe optimized I/O services, Replicated Data volumes, Thin Provisioning, Snapshot and Clones; and many other critical data storage services that don't come in K8s out-of-the-box.
OpenEBS is very popular : Live OpenEBS systems actively report back product metrics every day, to our Global Anaytics metrics engine (unless disabled by the user). Here are our key project popularity metrics as of: 01 Feb 2024
🚀 OpenEBS is the #1 deployed Storage Platform for Kubernetes
⭐ We are the #1 GitHub Star ranked K8s Data Storage platform
💾 We have +49 Million Volumes deployed globally
📺 We have +8 Million Global installations
⚡ 1 Million OpenEBS K8s Containers are spawned per week
😎 1.1 Million global users
Building a K8s Enterprise Data Storage platform is complex, and areas of the Data & I/O stack could be considerd 'Storage Rocket science'. Our global team comes from many areas of the data storage industry. Companies like... Microsoft Azure, VMware, DELL/EMC, Brocade/Broadcom, Hitachi Vantara, INTEL, Nvidia/Mellanox, IBM, RedHat and DataCore. |
---|
Important
We are grateful for the above innovative Data Storage companies and their amazing engineering contributors. Our orignal founding team continues to guide the project as custodial Maintainers. Major sponsorship is provided by DataCore, who donates a large team of dedicated Product Dev/Engineers, Product Mgmt and operational rescources. (Our founding team was acquired by DataCore, Inc). OpenEBS has 100's of amazing individuals, contributors and storage engineers who provide brainstorming ideas, feedback, code reviews and high-quality code to the project. - All who are passionate about storage and Data are welcome here.
OpenEBS is a K8s Software Defined Storage platform that aspires to constantly be aligned with the overall evolution, concepts, technologies and principles of Kubernetes. As a storage platform, we also have to keep pace with changing state of the Storage Industry. This is a complex Matrix product problem
to solve. How we do that is to develop a number of differnt Storage Engines
that solve differnt use-cases in optomized & efficent ways. - Rather than build 1 large bloated, inefficent monolithic application stack.
Our project currently has 2 main Editions:
1. OSS STANDARD
2. Legacy
There are 2 Tytpe of Storage Services provided within the OSS STANDARD:
ID | Storage Engine | Type of data services | Status |
---|---|---|---|
1 | Replicated Mayastor |
Replicated data volumes (a Cluster wide Data fabric) | Stable, deployable in PROD. Very active development |
2 | Local Local PV services |
Non-replicated node local data volumes | (Local-PV has multiple variants. See below) |
Local PV HostPath | for integration with local node hostpath (e.g. /mnt/fs1) | Stable, deployable in PROD, undergoing integration | |
Local PV ZFS | for integration with local ZFS storage deployments | Stable, deployable in PROD, undergoing integration | |
Local PV LVM | for integration with local LVM2 storage deployments | Stable, deployable in PROD, undergoing integration | |
Local PV Raw-device-File | for integration with Loop mounted Raw device-file filesystem | Stable, deployable in PROD, undergoing integration |
STANDARD (Open Source Software Standard)is our Ultra modern Datastore stack that is strongly aligned with the cutting edge direction of storage use-cases in the K8s industry. It is designed to faciliate modern K8s datastore archiectures, key K8s I/O patterns, K8s data access methods, K8s data use-cases and where K8s Datastore applications are heading.
STANDARD is optimized for NVMe and SSD Flash storage media, and integrates ultra modern cutting-edge high performance storage technologies at its core...
☑️ It uses the High performance SPDK storage stack - (SPDK is an opensource NVMe project initiated by INTEL)
☑️ The hyper modern IO_Uring Linux Kernel Async polling-mode I/O Interface - (fastest kernel I/O mode possible)
☑️ Native abilties for RDMA and Zero-Copy I/O
☑️ NVMe-oF TCP Block storage Hyper-converged data fabric
☑️ Block layer volume replication
☑️ Logical volumes and Diskpool based data managment
☑️ a Native high peformance Blobstore
☑️ Native Block layer Thin provisoning
☑️ Native Block layer Snapshots and Clones
LEGACY consists of Data-Engines that we experimented with early on. These Data-Engines have a number of opensoruce
techologies embeded inside them, and are a great intro into the world of simple K8s storage services. LEGACY helped
us learn, iterate and develop our core storage K8s strategy, as well as decern how users want & need to interact with
K8s storage services. LEGACY also helped to reveal key areas within K8s that are lacking in storage/datastore services,
what areas of K8s we could optimize; and how we can provide the best value into the various K8s storage layers.
There are multiple Data-Engines within LEGACY:
ID | Data-Eegines | Embeded tech stack | Status | Action date |
---|---|---|---|---|
1 | Jiva | iSCSI | deprecated & has been Migrated to OpenEBS Archive org |
29 Aug, 2024 |
2 | cStor | Open ZFS | deprecated & has been Migrated to OpenEBS Archive org |
29 Aug, 2024 |
3 | NFS Provisioner | NFS userspace server | deprecated & has been Migrated to OpenEBS Archive org |
29 Aug, 2024 |
4 | Device LocalPV | Node Local storage | deprecated & has been Migrated to OpenEBS Archive org |
29 Aug, 2024 |
5 | LocalPV Device | Node Local storage | deprecated & has been Migrated to OpenEBS Archive org |
29 Aug, 2024 |
6 | NDM | Node Local storage | deprecated & has been Migrated to OpenEBS Archive org |
29 Aug, 2024 |
7 | Many other tools | Node Local storage | deprecated & has been Migrated to OpenEBS Archive org |
29 Aug, 2024 |
Our 2024 Roadmap is here It defines a rich set of new featrues that are planned for 2024.
Please review this roadmp and feel free to pass back any feedback on it, as well as recommend and suggest new ideas. We welcome all your feedback.
OpenEBS is the most successful Stateful Persistent Contianer Native Storage platform in the CNCF landscape. It has allways held the #1 position and continues to as of today.