Files
awesome-kubernetes/v2-docs/message-queue.md
2026-05-19 07:44:52 +00:00

213 lines
41 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# Message Queue
!!! info "Architectural Context"
Detailed reference for Message Queue in the context of Data & Advanced Analytics.
- [infoq.com: From Monolith to Event-Driven: Finding Seams in Your Future Architecture](https://www.infoq.com/articles/event-driven-finding-seams) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: The Rise of the Event Streaming Database 🌟](https://thenewstack.io/the-rise-of-the-event-streaming-database) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [ibm.com: Event-driven cloud-native applications (microservices)](https://www.ibm.com/think/topics/cloud-native) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [stackoverflow.blog: How event-driven architecture solves modern web app problems 🌟](https://stackoverflow.blog/2020/03/16/how-event-driven-architecture-solves-modern-web-app-problems) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [confluent.io: Event-Driven Microservices Architecture (white paper) 🌟](https://www.confluent.io/resources/white-paper/event-driven-microservices) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [redhat.com: Event-driven architecture: Understanding the essential benefits 🌟](https://www.redhat.com/en/blog/event-driven-architecture-essentials) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [engineering.atspotify.com: Spotifys Event Delivery The Road to the Cloud (Part I)](https://engineering.atspotify.com/2016/2/spotifys-event-delivery-the-road-to-the-cloud-part-i) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [infoq.com: Turning Microservices Inside-Out](https://www.infoq.com/articles/microservices-inside-out) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [towardsdatascience.com: Architecture for High-Throughput Low-Latency Big Data Pipeline on Cloud 🌟](https://towardsdatascience.com/scalable-efficient-big-data-analytics-machine-learning-pipeline-architecture-on-cloud-4d59efc092b5) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Distributed transaction patterns for microservices compared](https://developers.redhat.com/articles/2021/09/21/distributed-transaction-patterns-microservices-compared) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: The Rise of Event-Driven Architecture](https://thenewstack.io/the-rise-of-event-driven-architecture) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: Streaming Data and the Modern Real-Time Data Stack](https://thenewstack.io/streaming-data-and-the-modern-real-time-data-stack) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [codeopinion.com: Event Sourcing vs Event Driven Architecture](https://codeopinion.com/event-sourcing-vs-event-driven-architecture) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: The Path to Getting the Full Data Stack on Kubernetes](https://thenewstack.io/the-path-to-getting-the-full-data-stack-on-kubernetes) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [blog.bitsrc.io: Why Microservices Should use Event Sourcing 🌟](https://blog.bitsrc.io/why-microservices-should-use-event-sourcing-9755a54ebfb4) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [verraes.net: DDD and Messaging Architectures 🌟](https://verraes.net/2019/05/ddd-msg-arch) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: How to Get Started with Data Streaming](https://thenewstack.io/how-to-get-started-with-data-streaming) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [linkedin.com: How to Move From a “Wait for it...” Batch-Processing Culture to a “Get It Now” Real-Time Data Culture](https://www.linkedin.com/pulse/how-move-from-wait-batch-processing-culture-get-now-tomsen-bukovec) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [particular.net: RPC vs. Messaging which is faster?](https://particular.net/blog/rpc-vs-messaging-which-is-faster) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Apache ActiveMQ](https://activemq.apache.org) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Choosing the right asynchronous-messaging infrastructure for the job](https://developers.redhat.com/blog/2020/07/31/choosing-the-right-asynchronous-messaging-infrastructure-for-the-job) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [kai-waehner.de: When to use Apache Camel vs. Apache Kafka? 🌟](https://www.kai-waehner.de/blog/2022/01/28/when-to-use-apache-camel-vs-apache-kafka-for-etl-application-integration-event-streaming) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [ActiveMQ 5.x "classic"](https://activemq.apache.org/components/classic) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [ActiveMQ Artemis](https://artemis.apache.org/components/artemis) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Apache Artemis JMeter](https://github.com/apache/artemis) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Implementing Apache ActiveMQ-style broker meshes with Apache Artemis](https://developers.redhat.com/articles/2021/06/30/implementing-apache-activemq-style-broker-meshes-apache-artemis) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [K8s prevent queue worker Pod from being killed during deployment](https://itnext.io/k8s-prevent-queue-worker-pod-from-being-killed-during-deployment-4252ea7c13f6) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [blog.rabbitmq.com: First Application With RabbitMQ Streams](https://www.rabbitmq.com/blog/2021/07/19/rabbitmq-streams-first-application) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [geshan.com.np: How to use RabbitMQ and Node.js with Docker and Docker-compose](https://geshan.com.np/blog/2021/07/rabbitmq-docker-nodejs) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [salaboy.com: Event-Driven applications with CloudEvents on Kubernetes](https://www.salaboy.com/2022/01/29/event-driven-applications-with-cloudevents-on-kubernetes) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Redis](https://redis.io) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Redis Pub/sub](https://redis.io/docs/latest/develop) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Integrating systems with Apache Camel and Quarkus on Red Hat OpenShift](https://developers.redhat.com/articles/2021/05/17/integrating-systems-apache-camel-and-quarkus-red-hat-openshift) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Apache Camel K](https://camel.apache.org/camel-k/2.10.x) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Six reasons to love Camel K](https://developers.redhat.com/blog/2020/05/12/six-reasons-to-love-camel-k) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Extending Kafka connectivity with Apache Camel Kafka connectors](https://developers.redhat.com/blog/2020/05/19/extending-kafka-connectivity-with-apache-camel-kafka-connectors) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Design event-driven integrations with Kamelets and Camel K](https://developers.redhat.com/blog/2021/04/02/design-event-driven-integrations-with-kamelets-and-camel-k) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: Camel K Brings Apache Camel to Kubernetes for Event-Driven Architectures](https://thenewstack.io/camel-k-brings-apache-camel-to-kubernetes-for-event-driven-architectures) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [github.com/osa-ora/camel-k-samples](https://github.com/osa-ora/camel-k-samples) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [KubeMQ.io: Kubernetes Native Message Queue Broker](https://kubemq.io) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [devops.com: Best of 2019: Implementing Message Queue in Kubernetes](https://devops.com/implementing-message-queue-in-kubernetes) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [kubemq.io: Kafka VS KubeMQ 🌟](https://kubemq.io/kafka-vs-kubemq) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [github.com/kubemq-io/kubemq-community 🌟](https://github.com/kubemq-io/kubemq-community) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Google Cloud Platform Pub/Sub](https://docs.cloud.google.com/pubsub/docs/overview) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [kai-waehner.de: Comparison: JMS Message Queue vs. Apache Kafka](https://www.kai-waehner.de/blog/2022/05/12/comparison-jms-api-message-broker-mq-vs-apache-kafka) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [ibm.com: iPaaS (Integration-Platform-as-a-Service)](https://www.ibm.com/think/topics/ipaas) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [**Red Hat Fuse**](https://www.redhat.com/en/products/application-foundations) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [**Syndesis** open source integration platform](https://syndesis.io) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Low-code microservices orchestration with Syndesis](https://developers.redhat.com/blog/2020/03/25/low-code-microservices-orchestration-with-syndesis) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [**Debezium**:](https://debezium.io) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Decoupling microservices with Apache Camel and Debezium](https://developers.redhat.com/blog/2019/11/19/decoupling-microservices-with-apache-camel-and-debezium) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Capture database changes with Debezium Apache Kafka connectors](https://developers.redhat.com/blog/2020/04/14/capture-database-changes-with-debezium-apache-kafka-connectors) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Change data capture for microservices without writing any code](https://developers.redhat.com/blog/2020/05/15/change-data-capture-for-microservices-without-writing-any-code) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [debezium.io: Lessons Learned from Running Debezium with PostgreSQL on Amazon RDS](https://debezium.io/blog/2020/02/25/lessons-learned-running-debezium-with-postgresql-on-rds) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [info.crunchydata.com: PostgreSQL Change Data Capture With Debezium](https://www.crunchydata.com/blog/postgresql-change-data-capture-with-debezium) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [noti.st: Change Data Capture with Flink SQL and Debezium 🌟](https://noti.st/morsapaes/liQzgs/change-data-capture-with-flink-sql-and-debezium) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [vladmihalcea.com: A beginners guide to CDC (Change Data Capture)](https://vladmihalcea.com/a-beginners-guide-to-cdc-change-data-capture) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [shopify.engineering: Capturing Every Change From Shopifys Sharded Monolith](https://shopify.engineering/capturing-every-change-shopify-sharded-monolith) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Db2 and Oracle connectors coming to Debezium 1.4 GA](https://developers.redhat.com/blog/2021/03/25/db2-and-oracle-connectors-coming-to-debezium-1-4-ga) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [daily.dev: Building a fault-tolerant event-driven architecture with Google Cloud, Pulumi and Debezium](https://daily.dev/blog/building-a-fault-tolerant-event-driven-architecture-with-google-cloud-pulumi-and-debezium) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [debezium.io: Using Debezium to Create a Data Lake with Apache Iceberg](https://debezium.io/blog/2021/10/20/using-debezium-create-data-lake-with-apache-iceberg) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Improve your Kafka Connect builds of Debezium.](https://developers.redhat.com/articles/2021/12/06/improve-your-kafka-connect-builds-debezium#build_a_debezium_kafka_connect_image_with_a_custom_resource) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Red Hat Integration service registry](https://developers.redhat.com/blog/2019/12/16/getting-started-with-red-hat-integration-service-registry) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [**Apicurio** Registry](https://github.com/apicurio/apicurio-registry) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Event streaming and data federation: A citizen integrators story](https://developers.redhat.com/blog/2020/06/12/event-streaming-and-data-federation-a-citizen-integrators-story) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [redhat.com: Using a schema registry to ensure data consistency between microservices](https://www.redhat.com/en/blog/schema-registry) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [martinfowler.com: Data Mesh Principles and Logical Architecture](https://martinfowler.com/articles/data-mesh-principles.html) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [infoq.com: Data Mesh Principles and Logical Architecture Defined](https://www.infoq.com/news/2020/12/data-mesh-architecture) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [martinfowler.com: How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh](https://martinfowler.com/articles/data-monolith-to-mesh.html) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [towardsdatascience.com: Data Domains and Data Products](https://towardsdatascience.com/data-domains-and-data-products-64cc9d28283e) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [mrpaulandrew.com: BUILDING A DATA MESH ARCHITECTURE IN AZURE PART 2](https://mrpaulandrew.com/2021/12/22/building-a-data-mesh-architecture-in-azure-part-2) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Awesome Streaming](https://github.com/manuzhang/awesome-streaming) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [cloudblog.withgoogle.com: Turn any Dataflow pipeline into a reusable template](https://cloud.google.com/blog/products/data-analytics/create-templates-from-any-dataflow-pipeline) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: Part 1: The Evolution of Data Pipeline Architecture](https://thenewstack.io/part-1-the-evolution-of-data-pipeline-architecture) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [openshift.com: How to Orchestrate Data Pipelines with Applications Deployed on OpenShift](https://www.redhat.com/en/blog/how-to-orchestrate-data-pipelines-with-applications-deployed-on-openshift) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Apache Kafka](https://kafka.apache.org) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Using secrets in Kafka Connect configuration](https://developers.redhat.com/blog/2020/02/14/using-secrets-in-apache-kafka-connect-configuration) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Awesome Kafka](https://github.com/monksy/awesome-kafka/blob/master/tools.md) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Single Message Transformations - The Swiss Army Knife of Kafka Connect](https://www.morling.dev/blog/single-message-transforms-swiss-army-knife-of-kafka-connect) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [containerjournal.com: Red Hat Platform Brings Kafka Closer to Kubernetes](https://cloudnativenow.com/topics/cloudnativeplatforms/red-hat-platform-brings-kafka-closer-to-kubernetes) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [AKHQ (previously known as KafkaHQ) 🌟](https://github.com/tchiotludo/akhq) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Build a simple cloud-native change data capture pipeline](https://developers.redhat.com/blog/2020/07/02/build-a-simple-cloud-native-change-data-capture-pipeline) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [confluent.fr: Infrastructure Modernization with Google Anthos and Apache Kafka](https://www.confluent.io/fr-fr/blog/modernize-apps-and-infrastructure-with-anthos-confluent-kafka) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [confluent.io: Apache Kafka DevOps with Kubernetes and GitOps](https://www.confluent.io/blog/devops-for-apache-kafka-with-kubernetes-and-gitops) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Build a data streaming pipeline using Kafka Streams and Quarkus](https://developers.redhat.com/blog/2020/09/28/build-a-data-streaming-pipeline-using-kafka-streams-and-quarkus) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [confluent.io: How to Build and Deploy Scalable Machine Learning in Production with Apache Kafka](https://www.confluent.io/blog/build-deploy-scalable-machine-learning-production-apache-kafka) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [softwareengineeringdaily.com: Kafka Applications with Tim Berglund (podcast) 🌟](https://softwareengineeringdaily.com/2020/12/16/kafka-applications-with-tim-berglund-repeat) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [infoq.com: Building a SQL Database Audit System using Kafka, MongoDB and Maxwell's Daemon](https://www.infoq.com/articles/database-audit-system-kafka) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [tecmint: How to Install Apache Kafka in CentOS/RHEL 7](https://www.tecmint.com/install-apache-kafka-in-centos-rhel) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [davidxiang.com: Kafka As A Database? Yes Or No](https://davidxiang.com/2021/01/10/kafka-as-a-database) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Confluent.io: Intro to Apache Kafka: How Kafka Works 🌟](https://developer.confluent.io/what-is-apache-kafka) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [confluent.io: Simplifying Apache Kafka Multi-Cluster Management Using Control Center and Cluster Registry](https://www.confluent.io/blog/simplify-multiple-kafka-cluster-management-monitoring-using-confluent) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [kai-waehner.de: App Modernization and Hybrid Cloud Architectures with Apache Kafka](https://www.kai-waehner.de/blog/2021/03/10/apache-kafka-app-modernization-legacy-hybrid-cloud-native-architecture) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [kai-waehner.de: Apache Kafka and MQTT (Part 1 of 5) Overview and Comparison](https://www.kai-waehner.de/blog/2021/03/15/apache-kafka-mqtt-sparkplug-iot-blog-series-part-1-of-5-overview-comparison) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [kafka-tutorials.confluent.io 🌟](https://developer.confluent.io/tutorials) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [kafka-tutorials.confluent.io: How to count messages in a Kafka topic](https://developer.confluent.io/confluent-tutorials/count-messages/ksql) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [confluent.io: Apache Kafka Made Simple: A First Glimpse of a Kafka Without ZooKeeper 🌟](https://www.confluent.io/blog/latest-apache-kafka-release) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [piotrminkowski.com: Knative Eventing with Kafka and Quarkus](https://piotrminkowski.com/2021/03/31/knative-eventing-with-kafka-and-quarkus) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [blog.cloudera.com: Scalability of Kafka Messaging using Consumer Groups](https://www.cloudera.com/blog.html) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: Beyond the Quickstart: Running Apache Kafka as a Service on Kubernetes](https://thenewstack.io/beyond-the-quickstart-running-apache-kafka-as-a-service-on-kubernetes) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [devclass.com: Apache Kafka 2.8.0 previews life without ZooKeeper](https://www.devclass.com/databases/2021/04/20/apache-kafka-280-previews-life-without-zookeeper/1627009) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [youtube playlist: Kafka Connect Tutorials | Kafka Connect 101: REST API 🌟](https://www.youtube.com/watch?v=9wu-j9gIlBY&list=PLa7VYi0yPIH1MB2n2w8pMZguffCDu2L4Y&index=8&ab_channel=Confluent) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Event-driven APIs and schema governance for Apache Kafka: Get ready for Kafka Summit Europe 2021](https://developers.redhat.com/blog/2021/05/04/event-driven-apis-and-schema-governance-for-apache-kafka-get-ready-for-kafka-summit-europe-2021) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Building resilient event-driven architectures with Apache Kafka](https://developers.redhat.com/blog/2021/05/05/building-resilient-event-driven-architectures-with-apache-kafka) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [tech.ebayinc.com: Resiliency and Disaster Recovery with Kafka](https://innovation.ebayinc.com/stories/resiliency-and-disaster-recovery-with-kafka) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [newrelic.com: Effective Strategies for Kafka Topic Partitioning 🌟](https://newrelic.com/blog/observability/effective-strategies-kafka-topic-partitioning) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [gentlydownthe.stream](https://www.gentlydownthe.stream) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [phoenixnap.com: How to Set Up and Run Kafka on Kubernetes 🌟](https://phoenixnap.com/kb/kafka-on-kubernetes) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [piotrminkowski.com: Knative Eventing with Quarkus, Kafka and Camel](https://piotrminkowski.com/2021/06/14/knative-eventing-with-quarkus-kafka-and-camel) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [itnext.io: Configuring Kafka Sources and Sinks declaratively in Kubernetes using Knative](https://itnext.io/configuring-kafka-sources-and-sinks-in-kubernetes-271e3757b208) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [strimzi.io: Kafka upgrade improvements](https://strimzi.io/blog/2021/07/05/upgrade-improvements) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Getting started with Red Hat OpenShift Streams for Apache Kafka](https://developers.redhat.com) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Managing the API life cycle in an event-driven architecture: A practical approach 🌟](https://developers.redhat.com/articles/2021/07/07/managing-api-life-cycle-event-driven-architecture-practical-approach) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: How to secure Apache Kafka schemas with Red Hat Integration Service Registry 2.0](https://developers.redhat.com/articles/2021/07/16/how-secure-apache-kafka-schemas-red-hat-integration-service-registry-20) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [grafana.com: Get comprehensive monitoring for your Apache Kafka ecosystem instances quickly with Grafana Cloud](https://grafana.com/blog/2021/07/26/get-comprehensive-monitoring-for-your-apache-kafka-ecosystem-instances-quickly-with-grafana-cloud) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [confluent.io: Making Apache Kafka Serverless: Lessons From Confluent Cloud](https://www.confluent.io/blog/designing-an-elastic-apache-kafka-for-the-cloud) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developer.confluent.io 🌟🌟](https://developer.confluent.io) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [itnext.io: Sending Messages to Kafka in Kubernetes](https://itnext.io/sending-messages-to-kafka-cfb5a246f5eb) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: The outbox pattern with Apache Kafka and Debezium 🌟](https://developers.redhat.com/articles/2021/09/01/outbox-pattern-apache-kafka-and-debezium) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [towardsdatascience.com: Overview of UI Tools for Monitoring and Management of Apache Kafka Clusters](https://towardsdatascience.com/overview-of-ui-tools-for-monitoring-and-management-of-apache-kafka-clusters-8c383f897e80) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [analyticsindiamag.com: How Uber is Leveraging Apache Kafka For More Than 300 Micro Services](https://analyticsindiamag.com/how-uber-is-leveraging-apache-kafka-for-more-than-300-micro-services) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [itnext.io: Securely Decoupling Kubernetes-based Applications on Amazon EKS using Kafka with SASL/SCRAM](https://itnext.io/securely-decoupling-applications-on-amazon-eks-using-kafka-with-sasl-scram-48c340e1ffe9) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [datadoghq.com: Monitoring Kafka performance metrics](https://www.datadoghq.com/blog/monitoring-kafka-performance-metrics) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [slack.engineering: Building Self-driving Kafka clusters using open source components](https://slack.engineering/building-self-driving-kafka-clusters-using-open-source-components) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [conduktor.io: What is Apache Kafka?](https://docs.conduktor.io/learn) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [redhat.com: How we use Apache Kafka to improve event-driven architecture performance](https://www.redhat.com/en/blog/apache-kafka-EDA-performance) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [dev.to: Running Kafka on kubernetes for local development](https://dev.to/thegroo/running-kafka-on-kubernetes-for-local-development-2a54) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Which is better: A single Kafka cluster to rule them all, or many?](https://developers.redhat.com/articles/2022/03/10/which-better-single-kafka-cluster-rule-them-all-or-many#) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [kai-waehner.de: When NOT to use Apache Kafka?](https://www.kai-waehner.de/blog/2022/01/04/when-not-to-use-apache-kafka) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [learnk8s.io/kafka-ha-kubernetes: Designing and testing a highly available Kafka cluster on Kubernetes 🌟](https://learnkube.com/kafka-ha-kubernetes) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: LinkedIn Layered Architecture Minimizes Kafka Scaling Issues](https://thenewstack.io/linkedin-layered-architecture-minimizes-kafka-scaling-issues) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: End-to-end field-level encryption for Apache Kafka Connect](https://developers.redhat.com/articles/2022/09/27/end-end-field-level-encryption-apache-kafka-connect) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [linkedin.com: Kafka Cluster Setup on Kubernetes](https://www.linkedin.com/pulse/kaka-cluster-setup-kubernetes-avinash-kumar-chandran) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [engineering.grab.com: Zero trust with Kafka](https://engineering.grab.com/zero-trust-with-kafka) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [freecodecamp.org: The Apache Kafka Handbook How to Get Started Using Kafka 🌟](https://www.freecodecamp.org/news/apache-kafka-handbook) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [rogulski.it: Consume Kafka events with Knative service and FastAPI on kubernetes 🌟](https://rogulski.it/blog/kafka-consumer-knative-fastapi) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [piotrminkowski.com: Concurrency with Kafka and Spring Boot](https://piotrminkowski.com/2023/04/30/concurrency-with-kafka-and-spring-boot) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thenewstack.io: Kafka on Kubernetes: Should You Adopt a Managed Solution?](https://thenewstack.io/kafka-on-kubernetes-should-you-adopt-a-managed-solution) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [thelinuxnotes.com: How to deploy Kafka in Kubernetes with Helm chart + kafdrop](https://thelinuxnotes.com/how-to-deploy-kafka-in-kubernetes-with-helm-chart-kafdrop-commander) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Kafdrop Kafka Web UI 🌟](https://github.com/obsidiandynamics/kafdrop) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [redpanda-data/kowl](https://github.com/redpanda-data/console) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [KLoadGen - Kafka + (Avro/Json Schema) Load Generator 🌟](https://github.com/sngular/kloadgen) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [dev.to: Learn how to use Kafkacat the most versatile Kafka CLI client 🌟](https://dev.to/de_maric/learn-how-to-use-kafkacat-the-most-versatile-kafka-cli-client-1kb4) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [github.com/lensesio/fast-data-dev (Lenses Box)](https://github.com/lensesio/fast-data-dev) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [github.com/sauljabin/kaskade](https://github.com/sauljabin/kaskade) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [strimzi.io](https://strimzi.io) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Introduction to Strimzi: Apache Kafka on Kubernetes (KubeCon Europe 2020) 🌟](https://developers.redhat.com/blog/2020/08/14/introduction-to-strimzi-apache-kafka-on-kubernetes-kubecon-europe-2020) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [strimzi.io: Optimizing Kafka producers](https://strimzi.io/blog/2020/10/15/producer-tuning) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [strimzi.io: Optimizing Kafka consumers 🌟](https://strimzi.io/blog/2021/01/07/consumer-tuning) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [pepy.tech/project/strimzi-kafka-cli 🌟](https://pepy.tech/projects/strimzi-kafka-cli) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [strimzi/kafka-kubernetes-config-provider: Kubernetes Configuration Provider for Apache Kafka](https://github.com/strimzi/kafka-kubernetes-config-provider) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [strimzi.io: Using Kubernetes Configuration Provider to load data from Secrets and Config Maps](https://strimzi.io/blog/2021/07/22/using-kubernetes-config-provider-to-load-data-from-secrets-and-config-maps) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [strimzi.io: Using HTTP Bridge as a Kubernetes sidecar](https://strimzi.io/blog/2021/08/18/using-http-bridge-as-a-kubernetes-sidecar) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [strimzi.io: Using Open Policy Agent with Strimzi and Apache Kafka](https://strimzi.io/blog/2020/08/05/using-open-policy-agent-with-strimzi-and-apache-kafka) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [strimzi/strimzi-canary](https://github.com/strimzi/strimzi-canary) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [conduktor.io 🌟](https://www.conduktor.io) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [AWS Kinesis](https://docs.aws.amazon.com/kinesis) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [softkraft.co: WS Kinesis vs Kafka comparison: Which is right for you? 🌟](https://www.softkraft.co/aws-kinesis-vs-kafka-comparison) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [mqtt.org](https://mqtt.org) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Deploying the Mosquitto MQTT message broker on Red Hat OpenShift, Part 1](https://developers.redhat.com/blog/2021/04/16/deploying-the-mosquitto-mqtt-message-broker-on-red-hat-openshift-part-1) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Banzai Kafka Operator](https://github.com/banzaicloud/koperator) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [confluent.io](https://www.confluent.io) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [mongodb.com: DaaS with MongoDB and Confluent](https://www.mongodb.com/company/blog/technical/daa-s-with-mongo-db-and-confluent) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [confluent.io: Confluent and Microsoft Announce Strategic Alliance](https://www.confluent.io/blog/latest-partner-ecosystem) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [confluent.io: Monitoring Your Event Streams: Integrating Confluent with Prometheus and Grafana](https://www.confluent.io/blog/monitor-kafka-clusters-with-prometheus-grafana-and-confluent) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Redpanda 🌟](https://www.redpanda.com) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Redpanda is now Free & Source Available](https://www.redpanda.com/blog/bsl-source-available-license) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [softwareengineeringdaily.com: Redpanda: Kafka Alternative with Alexander Gallego 🌟](https://softwareengineeringdaily.com/2021/01/22/redpanda-kafka-alternative-with-alexander-gallego) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [ksqlDB](https://www.confluent.io/product/ksqldb) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Kafka Streams and ksqlDB Compared How to Choose](https://docs.confluent.io/platform/current/streams/overview.html) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Apache Pulsar](https://pulsar.apache.org) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Pulsar vs Kafka Comparison and Myths Explored](https://www.kai-waehner.de/blog/2020/06/09/apache-kafka-versus-apache-pulsar-event-streaming-comparison-features-myths-explored) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Apache Flink](https://flink.apache.org) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [flink.apache.org: How to natively deploy Flink on Kubernetes with High-Availability (HA)](https://flink.apache.org/2021/02/10/native-k8s-with-ha.html) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [devops.com: Hazelcast Simplifies Streaming for Extremely Fast Event Processing in IoT, Edge and Cloud Environments](https://devops.com/hazelcast-simplifies-streaming-for-extremely-fast-event-processing-in-iot-edge-and-cloud-environments) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [dagster.io: Postgres: a better message queue than Kafka?](https://dagster.io/blog/skip-kafka-use-postgres-message-queue) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Zeebe workflow engine](https://camunda.com/platform/zeebe) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [infoq.com: Event Streams and Workflow Engines Kafka and Zeebe 🌟](https://www.infoq.com/news/2019/05/kafka-zeebe-streams-workflows) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [redhat.com: Monitoring Apache Airflow using Prometheus](https://www.redhat.com/en/blog/monitoring-apache-airflow-using-prometheus) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [towardsdatascience.com: Apache Airflow for containerized data-pipelines](https://towardsdatascience.com/apache-airflow-for-containerized-data-pipelines-4d7a3c385bd) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Apache Airflow official helm chart 🌟](https://airflow.apache.org/docs/helm-chart) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [youtube: Airflow Helm Chart : Quick Start For Beginners in 10mins](https://www.youtube.com/watch?v=GDOw8ByzMyY&ab_channel=MarcLamberti) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [dev.to: Get started with Apache Airflow](https://dev.to/arunkc/get-started-with-apache-airflow-1218) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [towardsdatascience.com: Apache Airflow Architecture 🌟](https://towardsdatascience.com/apache-airflow-architecture-496b9cb28288) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [airflow.apache.org: KubernetesPodOperator 🌟🌟🌟](https://airflow.apache.org/docs/apache-airflow-providers-cncf-kubernetes/stable/operators.html) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [airflow.apache.org: Add Owner Links to DAG](https://airflow.apache.org/docs/apache-airflow/stable/howto/add-owner-links.html) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [docs.astronomer.io: Dynamically generating DAGs in Airflow](https://www.astronomer.io/docs/learn/dynamically-generating-dags) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Couler](https://github.com/couler-proj/couler) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [**Red Hat AMQ overview**](https://developers.redhat.com/products/streams-for-apache-kafka) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Red Hat AMQ](https://www.redhat.com/en/technologies/jboss-middleware/amq) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: JDBC Master-Slave Persistence setup with Activemq using Postgresql database](https://developers.redhat.com/blog/2017/10/05/jdbc-master-slave-persistence-setup-activemq-using-postgresql-database) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [developers.redhat.com: Connecting external clients to Red Hat AMQ Broker on Red Hat OpenShift](https://developers.redhat.com/blog/2020/08/26/connecting-external-clients-to-red-hat-amq-broker-on-red-hat-openshift) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Understanding Red Hat AMQ Streams components for OpenShift and Kubernetes 🌟](https://developers.redhat.com/blog/2019/12/04/understanding-red-hat-amq-streams-components-for-openshift-and-kubernetes-part-1) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Set up **Red Hat AMQ Streams** custom certificates on OpenShift](https://developers.redhat.com/blog/2020/04/01/set-up-red-hat-amq-streams-custom-certificates-on-openshift-update) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [speakerdeck.com: Apache Kafka with Red Hat AMQ Streams 🌟](https://speakerdeck.com/mabulgu/apache-kafka-with-red-hat-amq-streams) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [HTTP-based Kafka messaging with Red Hat AMQ Streams](https://developers.redhat.com/blog/2020/08/04/http-based-kafka-messaging-with-red-hat-amq-streams/#more-720187) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [blog.jromanmartin.io: How to upgrade Strimzi Operator using the CLI](https://blog.jromanmartin.io/2020/09/25/how-upgrade-strimzi-operator.html) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Open Data Hub](https://opendatahub.io) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Open Data Hub 0.6 brings component updates and Kubeflow architecture](https://developers.redhat.com/blog/2020/05/07/open-data-hub-0-6-brings-component-updates-and-kubeflow-architecture) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [A development roadmap for Open Data Hub](https://developers.redhat.com/blog/2020/06/22/a-development-roadmap-for-open-data-hub) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [quandarycg.com: Everything You Need To Know About System Integration (And IPaaS) 🌟](https://www.quandarycg.com/everything-you-need-to-know-about-integrations) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [blog.hubspot.com: The 22 Best iPaaS Vendors for Any Budget](https://blog.hubspot.com/marketing/ipaas-vendors) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [rudderstack.com iPaaS](https://www.rudderstack.com) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Mulesoft](https://www.mulesoft.com) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [O'Really: Streaming data](http://streamingsystems.net) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [Service meshes to the rescue: Load balancing and scaling long-lived connections in Kubernetes 🌟](https://learnkube.com/kubernetes-long-lived-connections) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>
- [adambien.blog - 75th **airhacks.tv** Questions and Answers: Kafka, JAX-RS, MicroProfile, JSON-B, GSON, JWT, VSC, NetBeans, Java Fullstack](https://adambien.blog/roller/abien/entry/kafka_jax_rs_microprofile_json) <span class='md-tag md-tag--info'>[COMMUNITY-TOOL]</span>