# Kubernetes Storage. Cloud Native Storage !!! info "Architectural Context" Detailed reference for Kubernetes Storage. Cloud Native Storage in the context of The Container Stack. ## Standard Reference - [Monitoring jenkins using instana](https://www.ibm.com/think) [COMMUNITY-TOOL] - [Red Hat Ceph Storage](https://ceph.io/en) [COMMUNITY-TOOL] β€” - [Noobaa](https://github.com/noobaa/noobaa-core): - Red Hat Multi Cloud Gateway (AWS, Azure, GCP, etc) - Asynchronous replication of data between my local ceph and my cloud provider - Deduplication - Compression - Encryption - [State of OpenShift Container Storage](https://www.redhat.com/en/blog/state-of-openshift-container-storage-eran-tamir-and-duncan-hardie-red-hat) [COMMUNITY-TOOL] - [redbooks.ibm.com: IBM Storage for Red Hat OpenShift. IBM block storage & IBM Spectrum Scale](http://www.redbooks.ibm.com/abstracts/redp5565.html) [COMMUNITY-TOOL] - [blog.min.io: Kubernetes, Consistency and Commoditization - The Way of the Cloud](https://www.min.io/blog) [COMMUNITY-TOOL] - [thenewstack.io: The most popular cloud native solutions 🌟](https://thenewstack.io/cloud-native/the-most-popular-cloud-native-storage-solutions) [COMMUNITY-TOOL] - [blocksandfiles.com: geless storage is the β€˜answer’ to Kubernetes data challenges](https://www.blocksandfiles.com/container-storage/2020/12/22/storageless-storage-is-the-answer-to-kubernetes-data-challenges/1611647) [COMMUNITY-TOOL] - [rancher.com: What is Cloud-Native Storage?](https://www.suse.com/c/rancher_blog/what-is-cloud-native-storage) [COMMUNITY-TOOL] - [storj.io: Integrating Decentralized Cloud Storage with Duplicati](https://www.storj.io/cloud-object-storage) [COMMUNITY-TOOL] - [infoworld.com: Kubernetes object storage best practices](https://www.infoworld.com/article/2269961/kubernetes-object-storage-best-practices.html) [COMMUNITY-TOOL] - [blog.flant.com: Comparing Ceph, LINSTOR, Mayastor, and Vitastor storage performance in Kubernetes](https://palark.com/blog/kubernetes-storage-performance-linstor-ceph-mayastor-vitastor) [COMMUNITY-TOOL] - [blog.newrelic.com: Kubernetes Fundamentals, Part 5: Working with Kubernetes Volumes](https://newrelic.com/blog/infrastructure-monitoring/how-to-use-kubernetes-volumes) [COMMUNITY-TOOL] - [blocksandfiles.com: Lightbits Labs adds Kubernetes table stakes: CSI support](https://www.blocksandfiles.com/block/2020/06/23/lightbits-labs-adds-kubernetes-table-stakes-csi-support/1598623) [COMMUNITY-TOOL] - [Longhorn Simplifies Distributed Block Storage in Kubernetes](https://www.suse.com/c/rancher_blog/longhorn-simplifies-distributed-block-storage-in-kubernetes) [COMMUNITY-TOOL] - [containerjournal.com: Rancher Labs Adds Support for Longhorn Storage on Kubernetes Clusters](https://cloudnativenow.com/topics/cloudnativeplatforms/rancher-labs-adds-support-for-longhorn-storage-on-kubernetes-clusters) [COMMUNITY-TOOL] - [searchstorage.techtarget.com: IBM Spectrum](https://www.techtarget.com/searchitchannel/definition/IBM-International-Business-Machines) [COMMUNITY-TOOL] - [blocksandfiles.com: Kubernetes storage: SmartX’s IOMesh beats Portworx, Longhorn and OpenEBS](https://www.blocksandfiles.com/block/2021/08/05/kubernetes-storage-smartxs-iomesh-beats-portworx-longhorn-and-openebs/1617691) [COMMUNITY-TOOL] - [min.io](https://www.min.io) [COMMUNITY-TOOL] - [dok.community: Data on Kubernetes 2021 Report](https://dok.community/dokc-2021-report) [COMMUNITY-TOOL] - [Rook-Ceph](https://operatorhub.io/operator/rook-ceph) [COMMUNITY-TOOL] - [Rook](https://rook.io) [COMMUNITY-TOOL] - [kubestr.io](https://kubestr.io) [COMMUNITY-TOOL] - [Kadalu](https://github.com/kadalu/kadalu) ⭐ 749 [COMMUNITY-TOOL] - [VolSync 🌟](https://github.com/backube/volsync) ⭐ 973 [COMMUNITY-TOOL] - [thenewstack.io: How Kubernetes provides networking and storage to applications](https://thenewstack.io/how-kubernetes-provides-networking-and-storage-to-applications) [COMMUNITY-TOOL] - [medium: Kubernetes Storage Explained 🌟](https://medium.com/swlh/kubernetes-storage-explained-558e85596d0c) [COMMUNITY-TOOL] - [thenewstack.io: A Guide to Running Stateful Applications in Kubernetes](https://thenewstack.io/a-guide-to-running-stateful-applications-in-kubernetes) [COMMUNITY-TOOL] - [forbes.com: 5 Cloud Native Storage Startups To Watch Out For In 2019](https://www.forbes.com/sites/janakirammsv/2019/06/28/5-cloud-native-storage-startups-to-watch-out-for-in-2019) [COMMUNITY-TOOL] - [medium: Solution architect’s guide to Kubernetes persistent storage](https://medium.com/weareservian/solution-architects-guide-to-kubernetes-persistant-storage-3c9660187e8f) [COMMUNITY-TOOL] - [howtoforge.com: Storage in Kubernetes 🌟](https://www.howtoforge.com/storage-in-kubernetes) [COMMUNITY-TOOL] - [cncf.io: Container Attached Storage is Cloud Native Storage (CAS)](https://www.cncf.io/blog/2020/09/22/container-attached-storage-is-cloud-native-storage-cas) [COMMUNITY-TOOL] - [medium: Kubernetes Storage Performance Comparison v2 (2020 Updated) 🌟](https://medium.com/volterra-io/kubernetes-storage-performance-comparison-v2-2020-updated-1c0b69f0dcf4) [COMMUNITY-TOOL] - [softwareengineeringdaily.com: Why Is Storage On Kubernetes So Hard? 🌟](https://softwareengineeringdaily.com/2019/01/11/why-is-storage-on-kubernetes-is-so-hard) [COMMUNITY-TOOL] - [thenewstack.io: Compute and Storage Should Be Decoupled for Log Management' at Scale](https://thenewstack.io/why-compute-and-storage-should-be-decoupled-for-log-management-at-scale) [COMMUNITY-TOOL] - [gitlab.com: Kubernetes storage provider benchmarks](https://gitlab.com/mrman/k8s-storage-provider-benchmarks) [COMMUNITY-TOOL] - [thenewstack.io: Beyond Block and File: COSI Enables Object Storage in Kubernetes' 🌟](https://thenewstack.io/beyond-block-and-file-cosi-enables-object-storage-in-kubernetes) [COMMUNITY-TOOL] - [thenewstack.io: When Is Decentralized Storage the Right Choice?](https://thenewstack.io/when-is-decentralized-storage-the-right-choice) [COMMUNITY-TOOL] - [thenewstack.io: The Biggest Gap in Kubernetes Storage Architecture?](https://thenewstack.io/whats-the-biggest-gap-in-kubernetes-storage-architecture) [COMMUNITY-TOOL] - [medium: Provisioning storage in Kubernetes](https://medium.com/avmconsulting-blog/provisioning-storage-in-kubernetes-e1dc5610318d) [COMMUNITY-TOOL] - [kylezsembery.com: Persistent Storage in Kubernetes](https://www.kylezsembery.com/persistent-storage-kubernetes) [COMMUNITY-TOOL] - [blog.mayadata.io: Container Attached Storage (CAS) vs. Software-Defined' Storage - Which One to Choose?](https://blog.mayadata.io/container-attached-storage-cas-vs.-software-defined-storage-which-one-to-choose) [COMMUNITY-TOOL] - [thenewstack.io: Stateful Workloads on Kubernetes with Container Attached' Storage 🌟](https://thenewstack.io/stateful-workloads-on-kubernetes-with-container-attached-storage) [COMMUNITY-TOOL] - [developers.redhat.com: How to maximize data storage for microservices and' Kubernetes, Part 1: An introduction 🌟](https://developers.redhat.com/articles/2021/08/11/how-maximize-data-storage-microservices-and-kubernetes-part-1-introduction) [COMMUNITY-TOOL] - [blog.mayadata.io: Kubernetes storage basics: PV, PVC and StorageClass 🌟](https://blog.mayadata.io/kubernetes-storage-basics-pv-pvc-and-storageclass) [COMMUNITY-TOOL] - [ondat.io: Stateful Apps in Kubernetes are a big deal](https://www.ondat.io/blog/stateful-apps-in-kubernetes-are-a-big-deal) [COMMUNITY-TOOL] - [techgenix.com: Data Storage Management for Kubernetes - 5 movers and shakers](https://techgenix.com/data-storage-management-for-kubernetes) [COMMUNITY-TOOL] - [thenewstack.io: The Growth of State in Kubernetes](https://thenewstack.io/the-growth-of-state-in-kubernetes) [COMMUNITY-TOOL] - [itnext.io: Highly Available NFS cluster in Kubernetes, a cloud vendor independent' storage solution](https://itnext.io/highly-available-nfs-cluster-in-kubernetes-a-cloud-vendor-independent-storage-solution-f9a314cfdfcc) [COMMUNITY-TOOL] - [armosec.io: Data Storage in Kubernetes](https://www.armosec.io/blog/kubernetes-data-storage) [COMMUNITY-TOOL] - [infoq.com: Best Practices for Running Stateful Applications on Kubernetes](https://www.infoq.com/articles/kubernetes-stateful-applications) [COMMUNITY-TOOL] - [medium.com/@amir.ilw: Kubernetes Storage Migration 🌟](https://medium.com/@amir.ilw/kubernetes-storage-migration-ac48f6f9f5a5) [COMMUNITY-TOOL] - [discoblocks.io 🌟](https://discoblocks.io) [COMMUNITY-TOOL] - [medium.com/geekculture: Storage | Kubernetes](https://medium.com/geekculture/storage-kubernetes-92eb3d027282) [COMMUNITY-TOOL] - [itnext.io: Temporary Storage for Kubernetes Pods](https://itnext.io/temporary-storage-for-kubernetes-pods-f8330ad8db88) [COMMUNITY-TOOL] - [medium.com/nerd-for-tech: Persistence with Kubernetes](https://medium.com/nerd-for-tech/persistence-with-kubernetes-46f039d9a2ad) [COMMUNITY-TOOL] - [cncf.io: Kubernetes storage is complex, but it’s getting better](https://www.cncf.io/blog/2023/03/28/kubernetes-storage-is-complex-but-its-getting-better) [COMMUNITY-TOOL] - [yuminlee2.medium.com: Kubernetes: Storage](https://yuminlee2.medium.com/kubernetes-storage-fe5363d88d42) [COMMUNITY-TOOL] - [medium.com/kubernetes-deveops: Kubernetes β€” Deploying Application with Persistent' Storage](https://medium.com/kubernetes-deveops/kubernetes-deploying-application-with-persistent-storage-5068767e25f3) [COMMUNITY-TOOL] - [danielmangum.com: K8s ASA: The Storage Interface](https://danielmangum.com/posts/k8s-asa-the-storage-interface) [COMMUNITY-TOOL] - [kubermatic.com: Keeping the State of Apps 5: Introduction to Storage Classes](https://www.kubermatic.com/blog/keeping-the-state-of-apps-5-introduction-to-storage-classes) [COMMUNITY-TOOL] - [itnext.io: Kubernetes: PersistentVolume and PersistentVolumeClaim β€” an overview' with examples](https://itnext.io/kubernetes-persistentvolume-and-persistentvolumeclaim-an-overview-with-examples-3c5688222f99) [COMMUNITY-TOOL] - [thenewstack.io: Persistent Volumes: Separating Compute and Storage](https://thenewstack.io/persistent-volumes-separating-compute-and-storage) [COMMUNITY-TOOL] - [developers.redhat.com: Persistent storage in action: Understanding Red Hat' OpenShift’s persistent volume framework 🌟](https://developers.redhat.com/blog/2020/10/22/persistent-storage-in-action-understanding-red-hat-openshifts-persistent-volume-framework) [COMMUNITY-TOOL] - [itnext.io: Resizing StatefulSet Persistent Volumes with zero downtime 🌟](https://itnext.io/resizing-statefulset-persistent-volumes-with-zero-downtime-916ebc65b1d4) [COMMUNITY-TOOL] - [github.com/kubernetes-sigs: Local Persistence Volume Static Provisioner' 🌟](https://github.com/kubernetes-sigs/sig-storage-local-static-provisioner) ⭐ 1198 [COMMUNITY-TOOL] - [shuanglu1993.medium.com: What happens when volumeManager in the kubelet' starts?](https://shuanglu1993.medium.com/what-happens-when-volumemanager-in-the-kubelet-starts-1fea623ac6ce) [COMMUNITY-TOOL] - [linkedin.com/pulse: What are Kubernetes Persistent Volumes?](https://www.linkedin.com/pulse/what-kubernetes-persistent-volumes-gyan-prakash-1f) [COMMUNITY-TOOL] - [medium.com/codex: Kubernetes Persistent Volume Explained](https://medium.com/codex/kubernetes-persistent-volume-explained-fb27df29c393) [COMMUNITY-TOOL] - [giffgaff.io: Resizing StatefulSet Persistent Volumes with zero downtime' 🌟](https://www.giffgaff.io/tech/resizing-statefulset-persistent-volumes-with-zero-downtime) [COMMUNITY-TOOL] - [kubermatic.com: Keeping the State of Apps 1: Introduction to Volume and' volumeMounts](https://www.kubermatic.com/blog/keeping-the-state-of-apps-1-introduction-to-volume-and-volumemounts) [COMMUNITY-TOOL] - [blog.cloudnloud.com: Kubernetes Volume](https://blog.cloudnloud.com/kubernetes-volume) [COMMUNITY-TOOL] - [adamtheautomator.com: Effortless Storage Management With Kubernetes PVC' 🌟](https://adamtheautomator.com/kubernetes-pvc) [COMMUNITY-TOOL] - [portworx.com: Kubernetes Persistent Volume Tutorial by Portworx](https://portworx.com/tutorial-kubernetes-persistent-volumes) [COMMUNITY-TOOL] - [openebs/zfs-localpv](https://github.com/openebs/zfs-localpv) ⭐ 561 [COMMUNITY-TOOL] - [devineer.medium.com: Get to Grips with Kubernetes Volumes: A Practical Tutorial](https://devineer.medium.com/get-to-grips-with-kubernetes-volumes-a-practical-tutorial-c41853c64f02) [COMMUNITY-TOOL] - [airplane.dev: How to use Kubernetes ephemeral volumes & storage 🌟](https://www.airplane.dev/blog/kubernetes-ephemeral-storage) [COMMUNITY-TOOL] - [blog.devgenius.io: When K8s pods are stuck mounting large volumes](https://blog.devgenius.io/when-k8s-pods-are-stuck-mounting-large-volumes-2915e6656cb8) [COMMUNITY-TOOL] - [spacelift.io: Kubernetes Persistent Volumes – Tutorial and Examples](https://spacelift.io/blog/kubernetes-persistent-volumes) [COMMUNITY-TOOL] - [matthewpalmer.net: Filesystem vs Volume vs Persistent Volume 🌟](https://matthewpalmer.net/kubernetes-app-developer/articles/kubernetes-volumes-example-nfs-persistent-volume.html) [COMMUNITY-TOOL] - [dok.community: DoKC Data on Kubernetes](https://dok.community) [COMMUNITY-TOOL] - [Create ReadWriteMany PersistentVolumeClaims on your Kubernetes Cluster 🌟](https://medium.com/asl19-developers/create-readwritemany-persistentvolumeclaims-on-your-kubernetes-cluster-3a8db51f98e3) [COMMUNITY-TOOL] - [Digital Ocean: Kuberntes PVC ReadWriteMany access mode alternative](https://www.digitalocean.com/community/questions/kuberntes-pvc-readwritemany-access-mode-alternative) [COMMUNITY-TOOL] - [itnext.io: State of Persistent Storage in K8s β€” A Benchmark](https://itnext.io/state-of-persistent-storage-in-k8s-a-benchmark-77a96bb1ac29) [COMMUNITY-TOOL] - [itnext.io: Using Rook On A K3s Cluster](https://itnext.io/using-rook-on-a-k3s-cluster-8a97a75ba25e) [COMMUNITY-TOOL] - [medium.com/@abdulfayis: storage Orchestration for Kubernetes](https://medium.com/@abdulfayis/storage-orchestration-for-kubernetes-c6370f943e23) [COMMUNITY-TOOL] - [Robin](https://robin.io) [COMMUNITY-TOOL] - [Reduxio](https://www.reduxio.com) [COMMUNITY-TOOL] - [Portworx](https://portworx.com) [COMMUNITY-TOOL] - [OpenEBS](https://openebs.io) [COMMUNITY-TOOL] - [MayaData](https://mayadata.io) [COMMUNITY-TOOL] - [goglides.io: Running OpenEBS in Kubernetes](https://goglides.io/running-openebs-in-kubernetes/371) [COMMUNITY-TOOL] - [openebs/dynamic-localpv-provisioner: Dynamic Kubernetes Local Persistent' Volumes](https://github.com/openebs/dynamic-localpv-provisioner) ⭐ 207 [COMMUNITY-TOOL] - [openebs/lvm-localpv](https://github.com/openebs/lvm-localpv) ⭐ 341 [COMMUNITY-TOOL] - [LightOS](https://www.lightbitslabs.com/product) [COMMUNITY-TOOL] - [Longhorn](https://longhorn.io) [COMMUNITY-TOOL] - [thenewstack.io: Rancher Donates its β€˜Longhorn’ Kubernetes Persistent Storage' Software to CNCF](https://thenewstack.io/rancher-donates-its-longhorn-kubernetes-persistent-storage-software-to-cncf) [COMMUNITY-TOOL] - [aesher9o1.medium.com: Autoscale large images faster using Longhorn (distributed' storage)](https://aesher9o1.medium.com/autoscale-large-images-faster-using-longhorn-distributed-storage-618d0cf01ba2) [COMMUNITY-TOOL] - [medium.com/@abdelrhmanahmed131: Longhorn β€” Distributed Block Storage for' K8s](https://medium.com/@abdelrhmanahmed131/longhorn-distributed-block-storage-for-k8s-2ea11df400d1) [COMMUNITY-TOOL] - [linbit.com: LINSTOR - kubernetes persistent container storage](https://linbit.com/kubernetes) [COMMUNITY-TOOL] - [iomesh.com](https://www.iomesh.com) [COMMUNITY-TOOL] - [iomesh.com: Outperforming Peer Products, IOMesh Takes Cloud Native Storage' to the Next Level](https://www.iomesh.com/blog/announcing_iomesh_preview) [COMMUNITY-TOOL] - [docs.netapp.com: Intro to Astra Data Store preview](https://docs.netapp.com/us-en/astra-data-store/concepts/intro.html) [COMMUNITY-TOOL] - [libopenstorage/stork: Stork - Storage Operator Runtime for Kubernetes](https://github.com/libopenstorage/stork) ⭐ 401 [COMMUNITY-TOOL] - [Curve: opencurve.io](https://opencurve.io) [COMMUNITY-TOOL] - [simplyblock: simplyblock.io](https://simplyblock.io) [COMMUNITY-TOOL] - [kubernetes-csi.github.io](https://kubernetes-csi.github.io) [COMMUNITY-TOOL] - [github.com/kubernetes-csi](https://github.com/kubernetes-csi) [COMMUNITY-TOOL] - [SMB CSI Driver for Kubernetes](https://github.com/kubernetes-csi/csi-driver-smb) ⭐ 639 [COMMUNITY-TOOL] - [github.com/yandex-cloud: CSI for S3](https://github.com/yandex-cloud/k8s-csi-s3) ⭐ 855 [COMMUNITY-TOOL] - [sklar.rocks: How the CSI (Container Storage Interface) Works](https://sklar.rocks/how-container-storage-interface-works) [COMMUNITY-TOOL] - [blog.kasten.io: Benchmarking and Evaluating Your Kubernetes Storage with' Kubestr](https://blog.kasten.io/benchmarking-kubernetes-storage-with-kubestr) [COMMUNITY-TOOL] - [next.redhat.com: Introducing VolSync: your data, anywhere](https://next.redhat.com/2021/08/23/introducing-volsync-your-data-anywhere) [COMMUNITY-TOOL] - [Discoblocks: ondat.io/discoblocks](https://www.ondat.io/discoblocks) [COMMUNITY-TOOL] ## Cloud Infrastructure ### Storage #### Distributed Filesystems - [Ceph: A Distributed Object, Block, and File Storage Platform](https://github.com/ceph/ceph) ⭐ 16621 [ADVANCED LEVEL] [DE FACTO STANDARD] β€” The industry-standard unified, distributed storage system designed to provide excellent performance, reliability, and scalability. * Provides object, block, and file storage within a single cluster. * Acts as a foundational storage engine for large-scale Kubernetes PV platforms (Rook-Ceph) and private clouds. --- πŸ’‘ **Explore Related:** [Container Managers](./container-managers.md) | [Kubernetes Monitoring](./kubernetes-monitoring.md) | [Kubernetes Troubleshooting](./kubernetes-troubleshooting.md)