Skip to content
@openebs

OpenEBS

High-Performance Container Native Stateful Persistent Block-mode and Filesystem storage platform for K8s // A CNCF Member project

Welcome to openEBS

OpenEBS Social Banner

OpenEBS is a opensource Stateful Persistent block-mode Data Storage platform for Kubernetes. We are CNCF member project. We are a large global community of K8s Data storage users.

Our project team was an early pioneering inventor of K8s Container Native Storage services. We concieved the vision of a Stateful Persistent data platform for K8s that is tightly integrated and natively embeded into the core of K8s.

We have built an innovative ultra High-performance Enterprise grade Block-mode Hyper-converged Data Storage Fabric that augments the core storage services of K8s with Stateful Persistence, Enterprise Data mgmt, SSD/NVMe optimized I/O services, Replicated Data volumes, Thin Provisioning, Snapshot and Clones; and many other critical data storage services that don't come in K8s out-of-the-box.

OpenEBS is very popular : Live OpenEBS systems actively report back product metrics every day, to our Global Anaytics metrics engine (unless disabled by the user). Here are our key project popularity metrics as of: 01 Feb 2024

🚀   OpenEBS is the #1 deployed Storage Platform for Kubernetes
⭐   We are the #1 GitHub Star ranked K8s Data Storage platform
💾   We have +49 Million Volumes deployed globally
📺   We have +8 Million Global installations
⚡   1 Million OpenEBS K8s Containers are spawned per week
😎   1.1 Million global users

coders Building a K8s Enterprise Data Storage platform is complex, and areas of the Data & I/O stack could be considerd 'Storage Rocket science'. Our global team comes from many areas of the data storage industry. Companies like... Microsoft Azure, VMware, DELL/EMC, Brocade/Broadcom, Hitachi Vantara, INTEL, Nvidia/Mellanox, IBM, RedHat and DataCore.

Important

We are grateful for the above innovative Data Storage companies and their amazing engineering contributors. Our orignal founding team continues to guide the project as custodial Maintainers. Major sponsorship is provided by DataCore, who donates a large team of dedicated Product Dev/Engineers, Product Mgmt and operational rescources. (Our founding team was acquired by DataCore, Inc). OpenEBS has 100's of amazing individuals, contributors and storage engineers who provide brainstorming ideas, feedback, code reviews and high-quality code to the project. - All who are passionate about storage and Data are welcome here.

Project structure

Project Structure

Deployable Data-Engines

OpenEBS has maintained a steady pace of development & evolution in order to keep in alignment with K8s advancment overall and with the rapid changing pace of technologies, hardware and software innovations in the data stroage industry. The proejct is divided into 2 main deployable Editions :

ID Edition name Data-Engine Release
1 Legacy cStor Releases
Jiva Releases
NFS
2 Standard Mayastor Releases

LEGACY Edition

Note

LEGACY consists of Data-Engines that we experimented with early on. These Data-Engines have a number of opensoruce
techologies embeded inside them, and are a great intro into the world of simple K8s storage services. LEGACY helped
us learn, iterate and develop our core storage K8s strategy, as well as decern how users want & need to interact with
K8s storage services. LEGACY also helped to reveal key areas within K8s that are lacking in storage/datastore services,
what areas of K8s we could optimize; and how we can provide the best value into the various K8s storage layers.

There are multiple Data-Engines within LEGACY:

ID Data-Eegines Embeded tech stack Status
1 Jiva iSCSI Has been deprecated. Will be migrating out of org soon
2 cStor Open ZFS Has been deprecated. Will be migrating out of org soon
3 NFS Provisioner NFS userspace server Has been deprecated. Will be migrating out of org soon
4 Device LocalPV Node Local storage Has been deprecated. Will be migrating out of org soon
5 LocalPV Device Node Local storage Has been deprecated. Will be migrating out of org soon
6 NDM Node Local storage Has been deprecated. Will be migrating out of org soon
7 Many other tools Node Local storage Has been deprecated. Will be migrating out of org soon

STANDARD Edition

STANDARD is our Ultra modern Datastore stack that is strongly aligned with the cutting edge direction of storage use-cases in the K8s industry. It is designed to faciliate modern K8s datastore archiectures, key K8s I/O patterns, K8s data access methods, K8s data use-cases and where K8s Datastore applications are heading.

STANDARD is optimized for NVMe and SSD Flash storage media, and integrates ultra modern cutting-edge high performance storage technologies at its core...

☑️   It uses the High performance SPDK storage stack - (SPDK is an opensource NVMe project initiated by INTEL)
☑️   The hyper modern IO_Uring Linux Kernel Async polling-mode I/O Interface - (fastest kernel I/O mode possible)
☑️   Native abilties for RDMA and Zero-Copy I/O
☑️   NVMe-oF TCP Block storage Hyper-converged data fabric
☑️   Block layer volume replication
☑️   Logical volumes and Diskpool based data managment
☑️   a Native high peformance Blobstore
☑️   Native Block layer Thin provisoning
☑️   Native Block layer Snapshots and Clones


There are 2 Data-Engines within the STANDARD Edition:

ID Data-Eegines Type of data services Status
1 Replciated
Mayastor
Replicated data volumes (a Cluster wide Data fabric) Stable, deployable in PROD. Very active development
 
2 Local
LocalPV-xxx
Non-replicated node local data volumes (Local-PV has multiple variants. See below)
LocalPV-HostPath for integration with local node hostpath (e.g. /mnt/fs1) Stable, deployable in PROD, undergoing integration
LocalPV-ZFS for integration with local ZFS storage deployments Stable, deployable in PROD, undergoing integration
LocalPV-LVM for integration with local LVM2 storage deployments Stable, deployable in PROD, undergoing integration
LocalPV-Raw-device-File for integration with Loop mounted Raw device-file filesystem Stable, deployable in PROD, undergoing integration

🌎 ROADMAP

Our 2024 Roadmap is here It defines a rich set of new featrues that are planned for 2024.
Please review this roadmp and feel free to pass back any feedback on it, as well as recommend and suggest new ideas. We welcome all your feedback.

⭐ GitHub Star Chart

OpenEBS is the most successful Stateful Persistent Contianer Native Storage platform in the CNCF landscape. It has allways held the #1 position and continues to as of today.

XXXXXXXX

Pinned

  1. openebs openebs Public

    Most popular & widely deployed Open Source Container Native Storage platform for Stateful Persistent Applications on Kubernetes.

    8.7k 926

  2. mayastor mayastor Public

    Dynamically provision Stateful Persistent Replicated Cluster-wide Fabric Volumes & Filesystems for Kubernetes that is provisioned from an optimized NVME SPDK backend data storage stack.

    Rust 641 102

  3. dynamic-localpv-provisioner dynamic-localpv-provisioner Public

    Dynamically deploy Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is provisioned from simple Local-Hostpath /root storage.

    Go 128 57

  4. zfs-localpv zfs-localpv Public

    Dynamically provision Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is integrated with a backend ZFS data storage stack.

    Go 372 92

  5. lvm-localpv lvm-localpv Public

    Dynamically provision Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is integrated with a backend LVM2 data storage stack.

    Go 226 89

  6. rawfile-localpv rawfile-localpv Public

    Dynamically deploy Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is provisioned from RAW-device file loop mounted Local-Hostpath storage.

    Python 61 25

Repositories

Showing 10 of 33 repositories