Message Queue

Architectural Context

Detailed reference for Message Queue in the context of Data & Advanced Analytics.

• infoq.com: From Monolith to Event-Driven: Finding Seams in Your Future Architecture [COMMUNITY-TOOL]
• thenewstack.io: The Rise of the Event Streaming Database 🌟 [COMMUNITY-TOOL]
• ibm.com: Event-driven cloud-native applications (microservices) [COMMUNITY-TOOL]
• stackoverflow.blog: How event-driven architecture solves modern web app problems 🌟 [COMMUNITY-TOOL]
• confluent.io: Event-Driven Microservices Architecture (white paper) 🌟 [COMMUNITY-TOOL]
• redhat.com: Event-driven architecture: Understanding the essential benefits 🌟 [COMMUNITY-TOOL]
• engineering.atspotify.com: Spotify’s Event Delivery – The Road to the Cloud (Part I) [COMMUNITY-TOOL]
• infoq.com: Turning Microservices Inside-Out [COMMUNITY-TOOL]
• towardsdatascience.com: Architecture for High-Throughput Low-Latency Big Data Pipeline on Cloud 🌟 [COMMUNITY-TOOL]
• developers.redhat.com: Distributed transaction patterns for microservices compared [COMMUNITY-TOOL]
• thenewstack.io: The Rise of Event-Driven Architecture [COMMUNITY-TOOL]
• thenewstack.io: Streaming Data and the Modern Real-Time Data Stack [COMMUNITY-TOOL]
• codeopinion.com: Event Sourcing vs Event Driven Architecture [COMMUNITY-TOOL]
• thenewstack.io: The Path to Getting the Full Data Stack on Kubernetes [COMMUNITY-TOOL]
• blog.bitsrc.io: Why Microservices Should use Event Sourcing 🌟 [COMMUNITY-TOOL]
• verraes.net: DDD and Messaging Architectures 🌟 [COMMUNITY-TOOL]
• thenewstack.io: How to Get Started with Data Streaming [COMMUNITY-TOOL]
• linkedin.com: How to Move From a “Wait for it...” Batch-Processing Culture to a “Get It Now” Real-Time Data Culture [COMMUNITY-TOOL]
• particular.net: RPC vs. Messaging – which is faster? [COMMUNITY-TOOL]
• Apache ActiveMQ [COMMUNITY-TOOL]
• developers.redhat.com: Choosing the right asynchronous-messaging infrastructure for the job [COMMUNITY-TOOL]
• kai-waehner.de: When to use Apache Camel vs. Apache Kafka? 🌟 [COMMUNITY-TOOL]
• ActiveMQ 5.x "classic" [COMMUNITY-TOOL]
• ActiveMQ Artemis [COMMUNITY-TOOL]
• Apache Artemis JMeter [COMMUNITY-TOOL]
• developers.redhat.com: Implementing Apache ActiveMQ-style broker meshes with Apache Artemis [COMMUNITY-TOOL]
• K8s prevent queue worker Pod from being killed during deployment [COMMUNITY-TOOL]
• blog.rabbitmq.com: First Application With RabbitMQ Streams [COMMUNITY-TOOL]
• geshan.com.np: How to use RabbitMQ and Node.js with Docker and Docker-compose [COMMUNITY-TOOL]
• salaboy.com: Event-Driven applications with CloudEvents on Kubernetes [COMMUNITY-TOOL]
• Redis [COMMUNITY-TOOL]
• Redis Pub/sub [COMMUNITY-TOOL]
• developers.redhat.com: Integrating systems with Apache Camel and Quarkus on Red Hat OpenShift [COMMUNITY-TOOL]
• Apache Camel K [COMMUNITY-TOOL]
• developers.redhat.com: Six reasons to love Camel K [COMMUNITY-TOOL]
• developers.redhat.com: Extending Kafka connectivity with Apache Camel Kafka connectors [COMMUNITY-TOOL]
• developers.redhat.com: Design event-driven integrations with Kamelets and Camel K [COMMUNITY-TOOL]
• thenewstack.io: Camel K Brings Apache Camel to Kubernetes for Event-Driven Architectures [COMMUNITY-TOOL]
• github.com/osa-ora/camel-k-samples [COMMUNITY-TOOL]
• KubeMQ.io: Kubernetes Native Message Queue Broker [COMMUNITY-TOOL]
• devops.com: Best of 2019: Implementing Message Queue in Kubernetes [COMMUNITY-TOOL]
• kubemq.io: Kafka VS KubeMQ 🌟 [COMMUNITY-TOOL]
• github.com/kubemq-io/kubemq-community 🌟 [COMMUNITY-TOOL]
• Google Cloud Platform Pub/Sub [COMMUNITY-TOOL]
• kai-waehner.de: Comparison: JMS Message Queue vs. Apache Kafka [COMMUNITY-TOOL]
• ibm.com: iPaaS (Integration-Platform-as-a-Service) [COMMUNITY-TOOL]
• Red Hat Fuse [COMMUNITY-TOOL]
• Syndesis open source integration platform [COMMUNITY-TOOL]
• developers.redhat.com: Low-code microservices orchestration with Syndesis [COMMUNITY-TOOL]
• Debezium: [COMMUNITY-TOOL]
• developers.redhat.com: Decoupling microservices with Apache Camel and Debezium [COMMUNITY-TOOL]
• developers.redhat.com: Capture database changes with Debezium Apache Kafka connectors [COMMUNITY-TOOL]
• developers.redhat.com: Change data capture for microservices without writing any code [COMMUNITY-TOOL]
• debezium.io: Lessons Learned from Running Debezium with PostgreSQL on Amazon RDS [COMMUNITY-TOOL]
• info.crunchydata.com: PostgreSQL Change Data Capture With Debezium [COMMUNITY-TOOL]
• noti.st: Change Data Capture with Flink SQL and Debezium 🌟 [COMMUNITY-TOOL]
• vladmihalcea.com: A beginner’s guide to CDC (Change Data Capture) [COMMUNITY-TOOL]
• shopify.engineering: Capturing Every Change From Shopify’s Sharded Monolith [COMMUNITY-TOOL]
• developers.redhat.com: Db2 and Oracle connectors coming to Debezium 1.4 GA [COMMUNITY-TOOL]
• daily.dev: Building a fault-tolerant event-driven architecture with Google Cloud, Pulumi and Debezium [COMMUNITY-TOOL]
• debezium.io: Using Debezium to Create a Data Lake with Apache Iceberg [COMMUNITY-TOOL]
• developers.redhat.com: Improve your Kafka Connect builds of Debezium. [COMMUNITY-TOOL]
• Red Hat Integration service registry [COMMUNITY-TOOL]
• Apicurio Registry [COMMUNITY-TOOL]
• Event streaming and data federation: A citizen integrator’s story [COMMUNITY-TOOL]
• redhat.com: Using a schema registry to ensure data consistency between microservices [COMMUNITY-TOOL]
• martinfowler.com: Data Mesh Principles and Logical Architecture [COMMUNITY-TOOL]
• infoq.com: Data Mesh Principles and Logical Architecture Defined [COMMUNITY-TOOL]
• martinfowler.com: How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh [COMMUNITY-TOOL]
• towardsdatascience.com: Data Domains and Data Products [COMMUNITY-TOOL]
• mrpaulandrew.com: BUILDING A DATA MESH ARCHITECTURE IN AZURE – PART 2 [COMMUNITY-TOOL]
• Awesome Streaming [COMMUNITY-TOOL]
• cloudblog.withgoogle.com: Turn any Dataflow pipeline into a reusable template [COMMUNITY-TOOL]
• thenewstack.io: Part 1: The Evolution of Data Pipeline Architecture [COMMUNITY-TOOL]
• openshift.com: How to Orchestrate Data Pipelines with Applications Deployed on OpenShift [COMMUNITY-TOOL]
• Apache Kafka [COMMUNITY-TOOL]
• developers.redhat.com: Using secrets in Kafka Connect configuration [COMMUNITY-TOOL]
• Awesome Kafka [COMMUNITY-TOOL]
• Single Message Transformations - The Swiss Army Knife of Kafka Connect [COMMUNITY-TOOL]
• containerjournal.com: Red Hat Platform Brings Kafka Closer to Kubernetes [COMMUNITY-TOOL]
• AKHQ (previously known as KafkaHQ) 🌟 [COMMUNITY-TOOL]
• Build a simple cloud-native change data capture pipeline [COMMUNITY-TOOL]
• confluent.fr: Infrastructure Modernization with Google Anthos and Apache Kafka [COMMUNITY-TOOL]
• confluent.io: Apache Kafka DevOps with Kubernetes and GitOps [COMMUNITY-TOOL]
• Build a data streaming pipeline using Kafka Streams and Quarkus [COMMUNITY-TOOL]
• confluent.io: How to Build and Deploy Scalable Machine Learning in Production with Apache Kafka [COMMUNITY-TOOL]
• softwareengineeringdaily.com: Kafka Applications with Tim Berglund (podcast) 🌟 [COMMUNITY-TOOL]
• infoq.com: Building a SQL Database Audit System using Kafka, MongoDB and Maxwell's Daemon [COMMUNITY-TOOL]
• tecmint: How to Install Apache Kafka in CentOS/RHEL 7 [COMMUNITY-TOOL]
• davidxiang.com: Kafka As A Database? Yes Or No [COMMUNITY-TOOL]
• Confluent.io: Intro to Apache Kafka: How Kafka Works 🌟 [COMMUNITY-TOOL]
• confluent.io: Simplifying Apache Kafka Multi-Cluster Management Using Control Center and Cluster Registry [COMMUNITY-TOOL]
• kai-waehner.de: App Modernization and Hybrid Cloud Architectures with Apache Kafka [COMMUNITY-TOOL]
• kai-waehner.de: Apache Kafka and MQTT (Part 1 of 5) – Overview and Comparison [COMMUNITY-TOOL]
• kafka-tutorials.confluent.io 🌟 [COMMUNITY-TOOL]
• kafka-tutorials.confluent.io: How to count messages in a Kafka topic [COMMUNITY-TOOL]
• confluent.io: Apache Kafka Made Simple: A First Glimpse of a Kafka Without ZooKeeper 🌟 [COMMUNITY-TOOL]
• piotrminkowski.com: Knative Eventing with Kafka and Quarkus [COMMUNITY-TOOL]
• blog.cloudera.com: Scalability of Kafka Messaging using Consumer Groups [COMMUNITY-TOOL]
• thenewstack.io: Beyond the Quickstart: Running Apache Kafka as a Service on Kubernetes [COMMUNITY-TOOL]
• devclass.com: Apache Kafka 2.8.0 previews life without ZooKeeper [COMMUNITY-TOOL]
• youtube playlist: Kafka Connect Tutorials | Kafka Connect 101: REST API 🌟 [COMMUNITY-TOOL]
• developers.redhat.com: Event-driven APIs and schema governance for Apache Kafka: Get ready for Kafka Summit Europe 2021 [COMMUNITY-TOOL]
• developers.redhat.com: Building resilient event-driven architectures with Apache Kafka [COMMUNITY-TOOL]
• tech.ebayinc.com: Resiliency and Disaster Recovery with Kafka [COMMUNITY-TOOL]
• newrelic.com: Effective Strategies for Kafka Topic Partitioning 🌟 [COMMUNITY-TOOL]
• gentlydownthe.stream [COMMUNITY-TOOL]
• phoenixnap.com: How to Set Up and Run Kafka on Kubernetes 🌟 [COMMUNITY-TOOL]
• piotrminkowski.com: Knative Eventing with Quarkus, Kafka and Camel [COMMUNITY-TOOL]
• itnext.io: Configuring Kafka Sources and Sinks declaratively in Kubernetes using Knative [COMMUNITY-TOOL]
• strimzi.io: Kafka upgrade improvements [COMMUNITY-TOOL]
• developers.redhat.com: Getting started with Red Hat OpenShift Streams for Apache Kafka [COMMUNITY-TOOL]
• developers.redhat.com: Managing the API life cycle in an event-driven architecture: A practical approach 🌟 [COMMUNITY-TOOL]
• developers.redhat.com: How to secure Apache Kafka schemas with Red Hat Integration Service Registry 2.0 [COMMUNITY-TOOL]
• grafana.com: Get comprehensive monitoring for your Apache Kafka ecosystem instances quickly with Grafana Cloud [COMMUNITY-TOOL]
• confluent.io: Making Apache Kafka Serverless: Lessons From Confluent Cloud [COMMUNITY-TOOL]
• developer.confluent.io 🌟🌟 [COMMUNITY-TOOL]
• itnext.io: Sending Messages to Kafka in Kubernetes [COMMUNITY-TOOL]
• developers.redhat.com: The outbox pattern with Apache Kafka and Debezium 🌟 [COMMUNITY-TOOL]
• towardsdatascience.com: Overview of UI Tools for Monitoring and Management of Apache Kafka Clusters [COMMUNITY-TOOL]
• analyticsindiamag.com: How Uber is Leveraging Apache Kafka For More Than 300 Micro Services [COMMUNITY-TOOL]
• itnext.io: Securely Decoupling Kubernetes-based Applications on Amazon EKS using Kafka with SASL/SCRAM [COMMUNITY-TOOL]
• datadoghq.com: Monitoring Kafka performance metrics [COMMUNITY-TOOL]
• slack.engineering: Building Self-driving Kafka clusters using open source components [COMMUNITY-TOOL]
• conduktor.io: What is Apache Kafka? [COMMUNITY-TOOL]
• redhat.com: How we use Apache Kafka to improve event-driven architecture performance [COMMUNITY-TOOL]
• dev.to: Running Kafka on kubernetes for local development [COMMUNITY-TOOL]
• developers.redhat.com: Which is better: A single Kafka cluster to rule them all, or many? [COMMUNITY-TOOL]
• kai-waehner.de: When NOT to use Apache Kafka? [COMMUNITY-TOOL]
• learnk8s.io/kafka-ha-kubernetes: Designing and testing a highly available Kafka cluster on Kubernetes 🌟 [COMMUNITY-TOOL]
• thenewstack.io: LinkedIn Layered Architecture Minimizes Kafka Scaling Issues [COMMUNITY-TOOL]
• developers.redhat.com: End-to-end field-level encryption for Apache Kafka Connect [COMMUNITY-TOOL]
• linkedin.com: Kafka Cluster Setup on Kubernetes [COMMUNITY-TOOL]
• engineering.grab.com: Zero trust with Kafka [COMMUNITY-TOOL]
• freecodecamp.org: The Apache Kafka Handbook – How to Get Started Using Kafka 🌟 [COMMUNITY-TOOL]
• rogulski.it: Consume Kafka events with Knative service and FastAPI on kubernetes 🌟 [COMMUNITY-TOOL]
• piotrminkowski.com: Concurrency with Kafka and Spring Boot [COMMUNITY-TOOL]
• thenewstack.io: Kafka on Kubernetes: Should You Adopt a Managed Solution? [COMMUNITY-TOOL]
• thelinuxnotes.com: How to deploy Kafka in Kubernetes with Helm chart + kafdrop [COMMUNITY-TOOL]
• Kafdrop – Kafka Web UI 🌟 [COMMUNITY-TOOL]
• redpanda-data/kowl [COMMUNITY-TOOL]
• KLoadGen - Kafka + (Avro/Json Schema) Load Generator 🌟 [COMMUNITY-TOOL]
• dev.to: Learn how to use Kafkacat – the most versatile Kafka CLI client 🌟 [COMMUNITY-TOOL]
• github.com/lensesio/fast-data-dev (Lenses Box) [COMMUNITY-TOOL]
• github.com/sauljabin/kaskade [COMMUNITY-TOOL]
• strimzi.io [COMMUNITY-TOOL]
• developers.redhat.com: Introduction to Strimzi: Apache Kafka on Kubernetes (KubeCon Europe 2020) 🌟 [COMMUNITY-TOOL]
• strimzi.io: Optimizing Kafka producers [COMMUNITY-TOOL]
• strimzi.io: Optimizing Kafka consumers 🌟 [COMMUNITY-TOOL]
• pepy.tech/project/strimzi-kafka-cli 🌟 [COMMUNITY-TOOL]
• strimzi/kafka-kubernetes-config-provider: Kubernetes Configuration Provider for Apache Kafka [COMMUNITY-TOOL]
• strimzi.io: Using Kubernetes Configuration Provider to load data from Secrets and Config Maps [COMMUNITY-TOOL]
• strimzi.io: Using HTTP Bridge as a Kubernetes sidecar [COMMUNITY-TOOL]
• strimzi.io: Using Open Policy Agent with Strimzi and Apache Kafka [COMMUNITY-TOOL]
• strimzi/strimzi-canary [COMMUNITY-TOOL]
• conduktor.io 🌟 [COMMUNITY-TOOL]
• AWS Kinesis [COMMUNITY-TOOL]
• softkraft.co: WS Kinesis vs Kafka comparison: Which is right for you? 🌟 [COMMUNITY-TOOL]
• mqtt.org [COMMUNITY-TOOL]
• developers.redhat.com: Deploying the Mosquitto MQTT message broker on Red Hat OpenShift, Part 1 [COMMUNITY-TOOL]
• Banzai Kafka Operator [COMMUNITY-TOOL]
• confluent.io [COMMUNITY-TOOL]
• mongodb.com: DaaS with MongoDB and Confluent [COMMUNITY-TOOL]
• confluent.io: Confluent and Microsoft Announce Strategic Alliance [COMMUNITY-TOOL]
• confluent.io: Monitoring Your Event Streams: Integrating Confluent with Prometheus and Grafana [COMMUNITY-TOOL]
• Redpanda 🌟 [COMMUNITY-TOOL]
• Redpanda is now Free & Source Available [COMMUNITY-TOOL]
• softwareengineeringdaily.com: Redpanda: Kafka Alternative with Alexander Gallego 🌟 [COMMUNITY-TOOL]
• ksqlDB [COMMUNITY-TOOL]
• Kafka Streams and ksqlDB Compared – How to Choose [COMMUNITY-TOOL]
• Apache Pulsar [COMMUNITY-TOOL]
• Pulsar vs Kafka – Comparison and Myths Explored [COMMUNITY-TOOL]
• Apache Flink [COMMUNITY-TOOL]
• flink.apache.org: How to natively deploy Flink on Kubernetes with High-Availability (HA) [COMMUNITY-TOOL]
• devops.com: Hazelcast Simplifies Streaming for Extremely Fast Event Processing in IoT, Edge and Cloud Environments [COMMUNITY-TOOL]
• dagster.io: Postgres: a better message queue than Kafka? [COMMUNITY-TOOL]
• Zeebe workflow engine [COMMUNITY-TOOL]
• infoq.com: Event Streams and Workflow Engines – Kafka and Zeebe 🌟 [COMMUNITY-TOOL]
• redhat.com: Monitoring Apache Airflow using Prometheus [COMMUNITY-TOOL]
• towardsdatascience.com: Apache Airflow for containerized data-pipelines [COMMUNITY-TOOL]
• Apache Airflow official helm chart 🌟 [COMMUNITY-TOOL]
• youtube: Airflow Helm Chart : Quick Start For Beginners in 10mins [COMMUNITY-TOOL]
• dev.to: Get started with Apache Airflow [COMMUNITY-TOOL]
• towardsdatascience.com: Apache Airflow Architecture 🌟 [COMMUNITY-TOOL]
• airflow.apache.org: KubernetesPodOperator 🌟🌟🌟 [COMMUNITY-TOOL]
• airflow.apache.org: Add Owner Links to DAG [COMMUNITY-TOOL]
• docs.astronomer.io: Dynamically generating DAGs in Airflow [COMMUNITY-TOOL]
• Couler [COMMUNITY-TOOL]
• Red Hat AMQ overview [COMMUNITY-TOOL]
• Red Hat AMQ [COMMUNITY-TOOL]
• developers.redhat.com: JDBC Master-Slave Persistence setup with Activemq using Postgresql database [COMMUNITY-TOOL]
• developers.redhat.com: Connecting external clients to Red Hat AMQ Broker on Red Hat OpenShift [COMMUNITY-TOOL]
• Understanding Red Hat AMQ Streams components for OpenShift and Kubernetes 🌟 [COMMUNITY-TOOL]
• Set up Red Hat AMQ Streams custom certificates on OpenShift [COMMUNITY-TOOL]
• speakerdeck.com: Apache Kafka with Red Hat AMQ Streams 🌟 [COMMUNITY-TOOL]
• HTTP-based Kafka messaging with Red Hat AMQ Streams [COMMUNITY-TOOL]
• blog.jromanmartin.io: How to upgrade Strimzi Operator using the CLI [COMMUNITY-TOOL]
• Open Data Hub [COMMUNITY-TOOL]
• Open Data Hub 0.6 brings component updates and Kubeflow architecture [COMMUNITY-TOOL]
• A development roadmap for Open Data Hub [COMMUNITY-TOOL]
• quandarycg.com: Everything You Need To Know About System Integration (And IPaaS) 🌟 [COMMUNITY-TOOL]
• blog.hubspot.com: The 22 Best iPaaS Vendors for Any Budget [COMMUNITY-TOOL]
• rudderstack.com iPaaS [COMMUNITY-TOOL]
• Mulesoft [COMMUNITY-TOOL]
• O'Really: Streaming data [COMMUNITY-TOOL]
• Service meshes to the rescue: Load balancing and scaling long-lived connections in Kubernetes 🌟 [COMMUNITY-TOOL]
• adambien.blog - 75th airhacks.tv Questions and Answers: Kafka, JAX-RS, MicroProfile, JSON-B, GSON, JWT, VSC, NetBeans, Java Fullstack [COMMUNITY-TOOL]

---

💡 Explore Related: Yaml | Newsql | Nosql