mirror of
https://github.com/nubenetes/awesome-kubernetes.git
synced 2026-07-12 18:00:37 +00:00
53 KiB
53 KiB
Databases on Kubernetes. Database DevOps
!!! info "Architectural Context" Detailed reference for Databases on Kubernetes. Database DevOps in the context of Data & Advanced Analytics.
Standard Reference
- itnext.io: Operator Lifecycle Manager [COMMUNITY-TOOL]
- thenewstack.io: How Database Load Balancing Completes the 3-Tiered Architecture' 🌟 [COMMUNITY-TOOL]
- sqlshack.com: SQL Database on Kubernetes: Considerations and Best Practices' 🌟 [COMMUNITY-TOOL]
- thenewstack.io: What Is Data Management in the Kubernetes Age? [COMMUNITY-TOOL]
- thenewstack.io: A Case for Databases on Kubernetes from a Former Skeptic [COMMUNITY-TOOL]
- hackernoon.com: Database Vs Data Warehouse Vs Data Lake: A Simple Explanation [COMMUNITY-TOOL]
- thenewstack.io: Databases — Finally — Get Containerized [COMMUNITY-TOOL]
- levelup.gitconnected.com: How to design a system to scale to your first' 100 million users [COMMUNITY-TOOL]
- magalix.com: Kubernetes And Databases 🌟 [COMMUNITY-TOOL]
- towardsdatascience.com: SQL vs. NoSQL: How to Select from 12 Database Types' 🌟🌟 [COMMUNITY-TOOL]
- andrewlock.net: Running database migrations when deploying to Kubernetes' 🌟 [COMMUNITY-TOOL]
- red-gate.com: Designing Highly Scalable Database Architectures [COMMUNITY-TOOL]
- medium: Not using trendy technologies is the best thing for your Startup! [COMMUNITY-TOOL]
- thenewstack.io: Database-as-a-Service: A Key Technology for Agile Growth [COMMUNITY-TOOL]
- hackernoon.com: Practical Transaction Handling in Microservice Architecture [COMMUNITY-TOOL]
- thenewstack.io: Data on Kubernetes: Operators, Tools Need Standardization [COMMUNITY-TOOL]
- thenewstack.io: Kubernetes Will Revolutionize Enterprise Database Management [COMMUNITY-TOOL]
- dok.community: Data on Kubernetes 2021 Report [COMMUNITY-TOOL]
- venturebeat.com: The rise of Kubernetes and its impact on enterprise databases [COMMUNITY-TOOL]
- vladmihalcea.com: Single-Primary Database Replication [COMMUNITY-TOOL]
- treblle.com: How does Treblle scale on AWS without breaking the bank? [COMMUNITY-TOOL]
- intellipaat.com: Difference between DBMS and RDBMS [COMMUNITY-TOOL]
- betterprogramming.pub: Multi-Tenancy Support With Spring Boot, Liquibase,' and PostgreSQL [COMMUNITY-TOOL]
- thenewstack.io: How Kubernetes and Database Operators Drive the Data Revolution [COMMUNITY-TOOL]
- thenewstack.io: How Radical API Design Changed the Way We Access Databases [COMMUNITY-TOOL]
- vladmihalcea.com: A beginner’s guide to database multitenancy [COMMUNITY-TOOL]
- itnext.io: How to Run Databases in Kubernetes [COMMUNITY-TOOL]
- thenewstack.io: More Database, Analytics Workloads Ran on Kubernetes in' 2022 [COMMUNITY-TOOL]
- medium.com/@bijit211987: Kubernetes ready for stateful workloads and to' Revolutionize Enterprise Database Management [COMMUNITY-TOOL]
- medium.com/javarevisited: Top Performance issues every developer/architect' must know — part 1-Database [COMMUNITY-TOOL]
- infoq.com: Create Your Distributed Database on Kubernetes with Existing' Monolithic Databases [COMMUNITY-TOOL]
- dineshchandgr.medium.com: Why do we need a Database Connection Pool? -every' programmer must know [COMMUNITY-TOOL]
- medium.com/fintechexplained: What Is Database Sharding? [COMMUNITY-TOOL]
- blog.equationlabs.io: Managing database migrations safely in high replicated' k8s deployment 🌟 [COMMUNITY-TOOL]
- thenewstack.io: Distributed Database Architecture: What Is It? [COMMUNITY-TOOL]
- medium.com/@mkremer_75412: Why Postgres RDS didn’t work for us (and why' it won’t work for you if you’re implementing a big data solution) [COMMUNITY-TOOL]
- medium.com/@fengruohang: Database in Kubernetes: Is that a good idea? [COMMUNITY-TOOL]
- medium.com: How to choose the right database for your service 🌟 [COMMUNITY-TOOL]
- digitalocean.com: How To Use WHERE Clauses in SQL [COMMUNITY-TOOL]
- intellipaat.com: SQL vs MySQL - Key Differences Between SQL and MySQL [COMMUNITY-TOOL]
- towardsdatascience.com: How to Use SQL Cross Joins [COMMUNITY-TOOL]
- vladmihalcea.com: SQL EXISTS and NOT EXISTS [COMMUNITY-TOOL]
- vladmihalcea.com: Default Database Primary, Foreign, and Unique Key Indexing [COMMUNITY-TOOL]
- blog.jooq.org [COMMUNITY-TOOL]
- vladmihalcea.com: SQL LEFT JOIN – A Beginner’s Guide [COMMUNITY-TOOL]
- vladmihalcea.com: SQL JOIN USING – A Beginner’s Guide [COMMUNITY-TOOL]
- gcreddy.com: SQL Step by Step Videos [COMMUNITY-TOOL]
- freecodecamp.org: SQL Joins Tutorial: Cross Join, Full Outer Join, Inner' Join, Left Join, and Right Join [COMMUNITY-TOOL]
- freecodecamp.org: SQL Join Types – Inner Join VS Outer Join Example [COMMUNITY-TOOL]
- freecodecamp.org: The SQL Inner Join Command: Example Syntax [COMMUNITY-TOOL]
- freecodecamp.org: SQL Inner Join – How to Join 3 Tables in SQL and MySQL [COMMUNITY-TOOL]
- towardsdatascience.com: You Should Use This to Visualize SQL Joins Instead' of Venn Diagrams [COMMUNITY-TOOL]
- vladmihalcea.com: MySQL JSON_TABLE – Map a JSON object to a relational database' table [COMMUNITY-TOOL]
- blog.yugabyte.com: Are Stored Procedures and Triggers Anti-Patterns in the' Cloud Native World? [COMMUNITY-TOOL]
- stackoverflow.com: Is the usage of stored procedures a bad practice? [COMMUNITY-TOOL]
- softwareengineering.stackexchange.com: What is the best practice about microservice' architecture for consuming many stored procedures in the same database? [COMMUNITY-TOOL]
- betterprogramming.pub: 8 Techniques To Speed up Your Database [COMMUNITY-TOOL]
- xenonstack.com: Stateful and Stateless Applications Best Practices and Advantages [COMMUNITY-TOOL]
- threadreaderapp.com: Kelsey Hightower: "Kubernetes has made huge improvements' in the ability to run stateful workloads including databases and message queues, but I still prefer not to run them on Kubernetes" 🌟 [COMMUNITY-TOOL]
- thenewstack.io: Data on Kubernetes: The Next Frontier [COMMUNITY-TOOL]
- sixfold.medium.com: Reducing database queries to a minimum with DataLoaders [COMMUNITY-TOOL]
- thenewstack.io: How to Ensure Your Serverless Database Stays Serverless [COMMUNITY-TOOL]
- thenewstack.io: The Benefits and Drawbacks of DataOps in Practice [COMMUNITY-TOOL]
- cloud.google.com: To run or not to run a database on Kubernetes - What to' consider [COMMUNITY-TOOL]
- reddit.com: What's the best, proper way of running a database cluster on' top of Kubernetes? [COMMUNITY-TOOL]
- cloudsavvyit.com: Should You Run a Database in Docker? [COMMUNITY-TOOL]
- medium: DevOps and Databases — The forgotten automation [COMMUNITY-TOOL]
- medium.com/@database-mesh: Database Mesh 2.0: Database Governance in a Cloud' Native Environment [COMMUNITY-TOOL]
- kubedb.com [COMMUNITY-TOOL]
- Wikipedia: CockroachDB [COMMUNITY-TOOL]
- cockroachlabs.com: Automated database operations with Terraform [COMMUNITY-TOOL]
- blog.cloudneutral.se: Running CockroachDB TPC-C benchmark on GKE [COMMUNITY-TOOL]
- Spilo: HA PostgreSQL Clusters with Docker ⭐ 1829 [COMMUNITY-TOOL]
- How I've Set Up HA PostgreSQL on Kubernetes (powered by Patroni, a template for PostgreSQL HA) [COMMUNITY-TOOL]
- Zalando Postgres Operator ⭐ 5166 [ENTERPRISE-STABLE]
- medium: Running Oracle 12c on OpenShift Container Platform [COMMUNITY-TOOL]
- Automate SQL Server Backups with PowerShell [COMMUNITY-TOOL]
- Expanding SQL Server Big Data Clusters capabilities, now on Red Hat OpenShift [COMMUNITY-TOOL]
- devblogs.microsoft.com: DevOps for Azure SQL 🌟 [COMMUNITY-TOOL]
- khalidabuhakmeh.com: Running SQL Server Queries In Docker [COMMUNITY-TOOL]
- twindb.com: Verify MySQL Backups With TwinDB Backup Tool [COMMUNITY-TOOL]
- blog.eduguru.in: mysql create index on table [COMMUNITY-TOOL]
- pub.towardsai.net: Step-by-Step Design of Enhanced Entity-Relationship (EER)' in MySQL [COMMUNITY-TOOL]
- dbasecenter.com: The top 5 MySQL performance variables [COMMUNITY-TOOL]
- opensource.com [COMMUNITY-TOOL]
- Moco [COMMUNITY-TOOL]
- cloudsavvyit.com: How to Run PHPMyAdmin in a Docker Container [COMMUNITY-TOOL]
- dzone: PostgreSQL vs MySQL Performance [COMMUNITY-TOOL]
- thenewstack.io: Deploy MySQL and phpMyAdmin with Docker [COMMUNITY-TOOL]
- thenewstack.io: Maria DB Gets Reactive with a Non-Blocking Connector for' Java [COMMUNITY-TOOL]
- 9 High-Performance Tips when using PostgreSQL with JPA and Hibernate [COMMUNITY-TOOL]
- migops.com: pgBackRest – The Best Postgres Backup Tool with a very active' community [COMMUNITY-TOOL]
- towardsdatascience.com: Practical Introduction to PostgreSQL [COMMUNITY-TOOL]
- Postgres.app [COMMUNITY-TOOL]
- devopscube.com: How to Deploy PostgreSQL Statefulset in Kubernetes With' High Availability [COMMUNITY-TOOL]
- percona.com: Should I Create an Index on Foreign Keys in PostgreSQL? [COMMUNITY-TOOL]
- percona.com: PostgreSQL 14 Database Monitoring and Logging Enhancements [COMMUNITY-TOOL]
- wanago.io: Creating views with PostgreSQL [COMMUNITY-TOOL]
- percona/pg_stat_monitor ⭐ 577 [COMMUNITY-TOOL]
- dev.to: REST Data Service on YugabyteDB / PostgreSQL [COMMUNITY-TOOL]
- orgrim/pg_back: Simple backup tool for PostgreSQL ⭐ 563 [COMMUNITY-TOOL]
- adamtheautomator.com: How to Deploy Postgres to Kubernetes 🌟 [COMMUNITY-TOOL]
- purnapoudel.blogspot.com: How to Configure PostgreSQL with SSL/TLS support' on Kubernetes [COMMUNITY-TOOL]
- medium: Upgrading MySQL (Percona Server) from 5.7 to 8.0 [COMMUNITY-TOOL]
- percona.com: Migration of a MySQL Database to a Kubernetes Cluster Using' Asynchronous Replication [COMMUNITY-TOOL]
- percona.com: Migrating PostgreSQL to Kubernetes [COMMUNITY-TOOL]
- RedisLabs/redis-enterprise-k8s-docs: Deploying Redis Enterprise on Kubernetes [COMMUNITY-TOOL]
- tech.trell.co: Redis Cluster Creation Automation [COMMUNITY-TOOL]
- blog.devgenius.io: How to use Redis Pub/Sub in your Python Application 🌟 [COMMUNITY-TOOL]
- rockset.com: Sequoia Capital: Why We Moved from Elasticsearch to Rockset [COMMUNITY-TOOL]
- freecodecamp.org: How to Get Started with PysonDB [COMMUNITY-TOOL]
- clickhouse.com [COMMUNITY-TOOL]
- Altinity/clickhouse-operator ⭐ 2506 [COMMUNITY-TOOL]
- radondb/radondb-clickhouse-kubernetes ⭐ 86 [COMMUNITY-TOOL]
- tech.marksblogg.com: Monitor ClickHouse column oriented database with Prometheus' & Grafana [COMMUNITY-TOOL]
- Apache Ignite [COMMUNITY-TOOL]
- dzone: Stateful Microservices With Apache Ignite [COMMUNITY-TOOL]
- Apache Druid [COMMUNITY-TOOL]
- dev.to: Apache Druid: overview, running in Kubernetes and monitoring with' Prometheus [COMMUNITY-TOOL]
- github.com/dolthub/dolt ⭐ 22792 [DE FACTO STANDARD]
- victoriametrics.com [COMMUNITY-TOOL]
- SHMIG ⭐ 474 [COMMUNITY-TOOL]
- DATA-DOG/go-sqlmock ⭐ 6550 [ENTERPRISE-STABLE]
- datafold/data-diff ⭐ 2987 [COMMUNITY-TOOL]
- medium.com/@nomulex: How to create an ssh tunnel to a remote database in' Kubernetes 🌟 [COMMUNITY-TOOL]
- thenewstack.io: You Don’t Need a Blockchain, You Need a Time-Series Database [COMMUNITY-TOOL]
- opensource.com: Make your data boss-friendly with EDA - Enterprise Data' Analytics [COMMUNITY-TOOL]
- thenewstack.io: Kubernetes-Run Analytics at the Edge: Postgres, Kafka, Debezium [COMMUNITY-TOOL]
- unifieddatascience.com: Data lake design patterns on Azure (Microsoft) cloud [COMMUNITY-TOOL]
- unifieddatascience.com: Data lake design patterns on AWS (Amazon) cloud [COMMUNITY-TOOL]
- unifieddatascience.com: Data lake design patterns on google (GCP) cloud [COMMUNITY-TOOL]
- SQErzo: Tiny ORM for Graph databases ⭐ 35 [COMMUNITY-TOOL]
- towardsdatascience.com: At Its Core: How Is a Graph Database Different from' a Relational One? [COMMUNITY-TOOL]
- xataka.com: El Excel se ha usado en la Fórmula 1 hasta que se han dado cuenta' que no es la mejor forma de controlar las 20.000 piezas del coche [COMMUNITY-TOOL]
Cluster Management
Infrastructure Provisioning
Kubernetes Operators
- (2023) learnk8s.io: Provisioning cloud resources (AWS, GCP, Azure) in Kubernetes [EN CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] — Comparative analysis of Kubernetes Operators for cloud infrastructure provisioning (such as Crossplane, AWS ACK, Google KCC, and Azure ASO). Critiques the shift from Terraform toward declarative reconciliation loops.
Data Architecture
Cloud Native Databases
OpenShift Integration
- (2021) openshift.com: OpenShift, Databases and You: When to Put Containerized Database Workloads on OpenShift 🌟 [N/A CONTENT] 🌟🌟🌟 [COMMUNITY-TOOL] — Formulates the technical decision matrix for running containerized database engines on Red Hat OpenShift. Evaluates the benefits of integrated storage management (OpenShift Data Foundation), centralized lifecycle management via Operators, and consistent security postures. Provides clarity on identifying workloads suitable for containerization versus those suited for bare metal or external VM environments.
Stateful Workloads
- (2022) blog.crunchydata.com: Using Kubernetes? Chances Are You Need a Database 🌟 [N/A CONTENT] 🌟🌟🌟 [COMMUNITY-TOOL] — Analyzes the shifting industry paradigm of running databases directly on Kubernetes platforms. Historically discouraged due to ephemeral container design, modern CSI-compliant persistent storage and operator frameworks have made containerized databases highly viable. This architectural guide assists engineering leaders in evaluating whether to leverage cloud-managed database services or orchestrate self-managed database operators within their clusters.
Cloud Services
Service Binding
- (2022) cloud.redhat.com: Simplifying Database Cloud Service Access [N/A CONTENT] 🌟🌟🌟 [COMMUNITY-TOOL] — Examines the Service Binding Specification for Kubernetes, designed to simplify database and cloud service consumption for application workloads. By standardizing secret mounting and connection variables, this mechanism reduces boilerplates and decouples application code from infrastructure bindings. Essential reading for architects designing clean, platform-agnostic cloud-native microservices.
Database Comparison
Industry Analysis
- (2021) theregister.com: MySQL a 'pretty poor database' says departing Oracle engineer [N/A CONTENT] 🌟🌟 [COMMUNITY-TOOL] — Highlights a controversial critique of MySQL's architectural limitations and historical engineering baggage from a former Oracle database engineer. Contemplates codebase complexities, optimizer parser decisions, and transactional limitations of InnoDB compared to PostgreSQL. This serves as historical and conceptual context for RDBMS engine selection.
Relational Models
- (2022) sqlrevisited.blogspot.com: MySQL vs PostgreSQL? Pros and Cons [N/A CONTENT] 🌟🌟 [COMMUNITY-TOOL] — Presents a balanced technical comparison of MySQL and PostgreSQL. Analyzes functional capabilities such as rich data types support (JSONB), compliance standards, procedural execution, ecosystem licensing, and community extensions. Aids developers in choosing the correct engine based on specific operational and write requirements.
Database Internals
Fundamentals
- (2023) ==architecturenotes.co: Things You Should Know About Databases== [N/A CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — An exhaustive, highly visual compendium detailing core database systems theory and mechanical sympathy. Covers indexes, transaction isolation levels (ACID), write-ahead logging (WAL), page storage, replication Topologies, and execution planners. It serves as an indispensable reference for backend architects seeking to write high-performance queries and design scalable schema topologies.
Sharding and Partitioning
- (2023) percona.com: An Overview of Sharding in PostgreSQL and How it Relates to MongoDB’s [N/A CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — A comparative technical analysis of database sharding architectures, contrasting native MongoDB horizontal partitioning with Postgres-based sharding methodologies. Details the mechanical trade-offs between hash, range, and zone-based partition routing. Explains how shard key selection affects query latency, transaction atomicity, and parallel execution paths.
Database Operations
Autoscaling
- (2023) percona.com: Autoscaling Databases in Kubernetes for MongoDB, MySQL, and PostgreSQL [N/A CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — Explores the technical intricacies of horizontal and vertical autoscaling for stateful database engines within Kubernetes. Leveraging Custom Resource Definitions (CRDs) and specialized operators, the guide analyzes scaling mechanics for MongoDB, MySQL, and PostgreSQL. It warns of critical pitfalls such as race conditions during simultaneous CPU and storage scaling, highlighting the architectural care required to prevent split-brain issues.
CICD Protocols
- (2022) cloudbees.com: Introductory Handbook for Database Continuous Integration [N/A CONTENT] 🌟🌟🌟 [COMMUNITY-TOOL] — A foundational handbook focused on extending continuous integration (CI) and continuous delivery (CD) practices to database schemas and migrations. Explores state-based and migration-based schema management strategies using popular tools (e.g., Liquibase, Flyway) alongside Kubernetes GitOps pipelines to eliminate deployment drift and synchronize application-database releases safely.
Disaster Recovery
OpenShift Integration (1)
- (2021) cloud.redhat.com: OpenShift Commons Briefing: Database Disaster Recovery Made Easy with Annette Clewett (Red Hat) and Andrew L'Ecuyer (Crunchy Data) [N/A CONTENT] [ADVANCED LEVEL] 🌟🌟🌟 [COMMUNITY-TOOL] — A deep-dive technical briefing presenting strategies for enterprise database disaster recovery (DR) on Red Hat OpenShift, co-authored by Red Hat and Crunchy Data. Focuses on orchestrating multi-region replication topologies, active-passive failovers, and storage-level replication. Highlights the integration of PostgreSQL operators with advanced storage substrates to achieve minimal Recovery Point Objectives (RPO) and Recovery Time Objectives (RTO).
Distributed SQL
CockroachDB
- (2024) ==Cockroach== [GO CONTENT] [ADVANCED LEVEL] [DOCUMENTATION] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — Comprehensive architecture guide detailing CockroachDB deployments on Kubernetes. Evaluates how CockroachDB's cloud-native, distributed design scales horizontally and guarantees strict serializable transaction isolation. Focuses on the integration of CockroachDB's Operator with Kubernetes stateful constructs, detailing volume provisioning, network routing, and multi-region resilience.
Load Balancing
Database Proxy
- (2022) severalnines.com: How Does a Database Load Balancer Work? [N/A CONTENT] 🌟🌟🌟 [COMMUNITY-TOOL] — Demystifies the operational mechanics of database load balancers and intermediate proxies (e.g., HAProxy, ProxySQL, PgBouncer). Explores connection pooling, query routing (read/write splitting), and failover handling. Essential reading for ensuring uninterrupted service during database maintenance cycles or active-passive transitions in stateful topologies.
MongoDB
GitOps Security
- (2023) percona.com: Storing Kubernetes Operator for Percona Server for MongoDB Secrets in Github [YAML CONTENT] 🌟🌟🌟 [COMMUNITY-TOOL] — Focuses on securing the Percona Operator for MongoDB when using GitOps declarative pipelines. Walks through implementing external secret storage engines (e.g., HashiCorp Vault) and avoiding cleartext commit leaks of database administrator credentials inside GitHub. Essential reference for securing database access controls in enterprise Kubernetes pipelines.
MySQL
GitOps Orchestration
- (2023) percona.com: MySQL on Kubernetes with GitOps 🌟 [N/A CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — Details the architecture for deploying and managing MySQL database instances on Kubernetes using GitOps principles. Evaluates the combination of Percona's Kubernetes Operator with GitOps controllers like ArgoCD. Demonstrates declarative management of database configurations, automated backups, and version upgrades via unified Git repositories.
Kubernetes Deployments
- (2021) tusacentral.com: MySQL on Kubernetes demystified [N/A CONTENT] 🌟🌟 [COMMUNITY-TOOL] — A simplified walk-through detailing the containerization and deployment of MySQL within Kubernetes. Analyzes StatefulSet configurations, headless services for pod-to-pod discovery, and the essential binding of PersistentVolumeClaims (PVCs). Serves as an introductory educational guide to deconstructing the operational complexities of MySQL on Kubernetes.
Operator Orchestration
- (2024) Percona.com: Percona Kubernetes Operator for Percona XtraDB Cluster [GO CONTENT] [ADVANCED LEVEL] [DOCUMENTATION] 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — Comprehensive documentation for the Percona Operator for MySQL based on Percona XtraDB Cluster (PXC). Outlines deployment paths for highly available, multi-primary master-replica topologies. Detailing built-in continuous security scans, integrated backups, proxy routing integration, and live cluster expansion algorithms.
Performance Tuning
- (2022) percona.com: MySQL 101: Parameters to Tune for MySQL Performance [N/A CONTENT] 🌟🌟🌟 [COMMUNITY-TOOL] — A fundamental tuning guide for optimizing MySQL performance in high-throughput workloads. Analyzes the role of critical system parameters, including innodb_buffer_pool_size, innodb_log_file_size, and max_connections. Explains how allocating resources appropriately prevents memory thrashing and optimizes disk write performance.
- (2022) percona.com: MySQL 101: How to Find and Tune a Slow SQL Query [SQL CONTENT] 🌟🌟🌟 [COMMUNITY-TOOL] — A troubleshooting guide focused on tracking down and optimizing slow queries inside MySQL. Demonstrates setting up and interpreting the Slow Query Log, working with EXPLAIN and EXPLAIN ANALYZE statements, and performing targeted schema adjustments to optimize high latency queries. Helps teams maintain low application-tier response thresholds.
PostgreSQL
Architectural Patterns
- (2023) blog.crunchydata.com: Devious SQL: Message Queuing Using Native PostgreSQL [SQL CONTENT] [ADVANCED LEVEL] 🌟🌟🌟 [COMMUNITY-TOOL] — Explores building high-throughput message queuing systems directly inside PostgreSQL using native relational primitives. Leverages FOR UPDATE SKIP LOCKED and LISTEN/NOTIFY mechanics to bypass common transactional blocking bottlenecks. A highly practical architectural design pattern that allows small-to-medium systems to delay or avoid adopting heavy middleware brokers.
Database Migration
- (2022) blog.crunchydata.com: A Postgres Primer for Oracle DBAs [SQL CONTENT] 🌟🌟🌟 [COMMUNITY-TOOL] — A comparative guide targeting Oracle database administrators transitioning to PostgreSQL. Compares procedural language engines (PL/SQL vs PL/pgSQL), transaction isolation models, dialect mappings, and process-vs-thread handling differences. Facilitates a smooth migration strategy for enterprise teams modernizing monolithic enterprise workloads.
High Availability
- (2024) ==Patroni== ⭐ 8445 [PYTHON CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — Patroni is the industry-standard, template-driven Python framework for orchestrating highly available PostgreSQL clusters. Utilizing Distributed Consensus Stores (DCS) such as etcd, Consul, or ZooKeeper, Patroni automates dynamic master election, failovers, and streaming replication. It serves as the mechanical core for most enterprise PostgreSQL operators.
Indexing Strategy
- (2022) blog.crunchydata.com: Postgres Indexes for Newbies [SQL CONTENT] 🌟🌟🌟 [COMMUNITY-TOOL] — An introductory, yet technically precise primer on index designs and lookup behaviors inside PostgreSQL. Explains the operational differences between B-Tree, GIST, GIN, and BRIN index variants. Demonstrates how queries hit indexes, how to evaluate query plans, and highlights common anti-patterns like indexing columns with low selectivity.
Kernel Tuning
- (2022) percona.com: How to Adjust Linux Out-Of-Memory Killer Settings for PostgreSQL [SHELL CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — A deep system engineering look at configuring the Linux Out-Of-Memory (OOM) killer settings specifically for PostgreSQL workloads. Details how Linux overcommits memory and explains how to adjust oom_score_adj to protect the postmaster daemon while allowing ephemeral worker processes to safely cycle under extreme memory pressure.
Operators
- (2023) blog.flant.com: Comparing Kubernetes operators for PostgreSQL [N/A CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — A technical head-to-head comparison of major PostgreSQL Kubernetes operators, including those from CloudNativePG, Zalando, Crunchy Data, and Percona. Evaluates operators on key criteria: high availability implementation (Patroni vs native), backup management (pgBackRest vs Barman), ease of rolling upgrades, and declarative custom resource options.
Performance Optimization
- (2022) blog.crunchydata.com: Cut Out the Middle Tier: Generating JSON Directly from Postgres [SQL CONTENT] [ADVANCED LEVEL] 🌟🌟🌟 [COMMUNITY-TOOL] — Details advanced SQL techniques to generate formatted JSON payloads directly inside PostgreSQL, eliminating the computation overhead of intermediate application-tier formatting (middle-tier data mapping). Benchmarks JSON extraction functions (e.g., jsonb_build_object, json_agg) to showcase significant throughput improvements for microservice APIs.
Query Languages
Alternative Formats
- (2023) infoworld.com: Beyond SQL: 8 new languages for data querying [N/A CONTENT] 🌟🌟🌟 [COMMUNITY-TOOL] — Surveys the landscape of alternative data querying paradigms extending beyond traditional SQL. Analyzes the syntactic and performance characteristics of modern alternatives like GraphQL, EdgeQL, PRQL, and Cypher. Explains their application domains, including graph querying, relational-object modeling, and analytical data pipeline processing.
Query Optimization
Anti-Patterns
- (2023) vettabase.com: How slow is SELECT * ? [SQL CONTENT] 🌟🌟🌟 [COMMUNITY-TOOL] — A performance analysis exposing the architectural and mechanical cost of utilizing the wildcard 'SELECT *' query anti-pattern. Detail-oriented execution plans show the compounding overhead of disk I/O, cache pollution, network bandwidth consumption, and query planning limitations. Practical benchmarks emphasize building explicit, lean query projections.
SQL Tuning
- (2023) geeksforgeeks.org: Best Practices for SQL Query Optimization [SQL CONTENT] 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — A structured repository of industry-standard SQL query optimization practices. Outlines best practices for index utilization, avoiding wildcards, analyzing execution plans, optimizing JOIN sequences, and managing transaction scopes. Designed to assist software engineers in scaling database-backed APIs under high concurrency workloads.
Data and Databases
Database Administration
AI and MCP Clients
- Tabularis: Open Source Desktop Client for Modern Databases with AI and MCP' Integration ⭐ 2151 [SPANISH CONTENT] [ADVANCED LEVEL] [ENTERPRISE-STABLE] — An innovative, open-source cross-platform database client featuring deep AI integration and Model Context Protocol (MCP) compliance. This configuration enables language models to securely inspect, query, and mutate structured schemas under strict guardrails. Live grounding confirms the project provides localized Spanish documentation as its primary onboarding interface while keeping global compliance.
Developer Experience
Database Tooling
SQL Utilities
- SQL Studio: A Unified SQL Database Explorer ⭐ 3539 [EN CONTENT] [ENTERPRISE-STABLE] — A single-binary SQL database administrator interface written in Rust. It streamlines querying, schema inspection, and data visualization across multiple RDBMS engines (including SQLite, PostgreSQL, and MySQL) in resource-constrained containerized runtimes.
Observability
Standards and Engines
VictoriaMetrics Updates
- (2024) victoriametrics.com: Q2 2024 Round Up: VictoriaMetrics & VictoriaLogs Updates [EN CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] — Synthesizes high-capacity enhancements of VictoriaMetrics and VictoriaLogs in mid-2024. Emphasizes advanced cluster scaling, compression efficiency improvements, and Prometheus compatibility metrics.
PostgreSQL (1)
CLI and Tooling
- (2021) info.crunchydata.com: Quickly Document Your Postgres Database Using psql Meta-Commands [SQL CONTENT] [COMMUNITY-TOOL] — Quick operational guide focusing on using psql meta-commands (like \d, \dt, and \di) to parse, discover, and document active database schemas, tables, and relationships via standard terminal interactions.
Database Observability
- (2022) info.crunchydata.com: How to Setup PostgreSQL Monitoring in Kubernetes [YAML CONTENT] [COMMUNITY-TOOL] — Technical orchestration walkthrough detailing Prometheus and Grafana instrumentation configurations optimized for monitoring multi-tenant Kubernetes PostgreSQL StatefulSet resources.
Storage and Database
DBaaS
Kubernetes Operators (1)
- (2021) percona.com: DBaaS on Kubernetes: Under the Hood 🌟 [ADVANCED LEVEL] [COMMUNITY-TOOL] — An in-depth technical dive from Percona explaining database-as-a-service (DBaaS) mechanics on Kubernetes. Evaluates custom operator reconciliation loops, persistent volume provisioning strategies, database backup triggers, and multi-node replication setups.
Market Analysis
Cloud Database Trends
- (2020) theregister.com: 75% of databases to be cloud-hosted by 2022, says Gartner while dishing on the weak points of each provider [COMMUNITY-TOOL] — Analyzes cloud migration projections for enterprise database services. Reviews technical challenges of hosting databases on multi-cloud infrastructure, warning engineers about vendor lock-in risks, dynamic cost variations, and localized performance degradation.
Stateful Workloads (1)
Architectural Challenges
- (2021) thenewstack.io: Just How Challenging Is State in Kubernetes? 🌟 [ADVANCED LEVEL] [COMMUNITY-TOOL] — A comprehensive analysis of running stateful workloads inside ephemeral Kubernetes nodes. Evaluates the persistent volume subsystem, discusses when to use custom operators versus cloud-native managed databases, and examines the overhead of local database orchestration.
💡 Explore Related: Crunchydata | Yaml | Message Queue