Files
awesome-kubernetes/v2-docs/monitoring.md

63 KiB
Raw Blame History

Monitoring and Performance. Prometheus, Grafana, APMs and more

!!! info "Architectural Context" Detailed reference for Monitoring and Performance. Prometheus, Grafana, APMs and more in the context of Architectural Foundations.

Standard Reference

Cloud Infrastructure

Service Mesh

Istio Mesh

  • Istio.io [EN CONTENT] [ADVANCED LEVEL] [DE FACTO STANDARD] — The premier open-source service mesh providing advanced traffic management, end-to-end security, and granular observability. Uses Envoy proxies (via sidecars or Ambient mode) to secure and manage microservice fabrics.

Cloud Native Infrastructure

Observability

Distributed Tracing

Jaeger Platform
  • jaegertracing.io [DOCUMENTATION] [DE FACTO STANDARD] [ENTERPRISE-STABLE] — The official gateway for Jaeger, a CNCF-graduated distributed tracing platform. Essential for microservice architectures to monitor transactions, perform root-cause analysis, optimize performance bottlenecks, and visualize complex request propagation paths.

Log Analysis

Visualization Tools
  • Kibana [DOCUMENTATION] [DE FACTO STANDARD] [ENTERPRISE-STABLE] — The foundational visualization and management interface for the Elastic Stack. Enables operators to search, index, analyze, and construct real-time security dashboards and log analysis patterns for high-throughput microservice applications.

Cloud Native Languages

Java

Performance Tuning

  • tier1app.com [EN CONTENT] [ENTERPRISE-STABLE] — A dedicated APM tool for analyzing Java thread dumps and performance. Provides automated diagnostics for thread contention and deadlocks to optimize JVM application responsiveness.
  • fastthread.io [EN CONTENT] [DE FACTO STANDARD] [ENTERPRISE-STABLE] — Industrial-grade online Java thread dump analyzer that uses AI diagnostics to identify CPU spikes, thread leaks, and deadlock patterns. Essential for post-mortem analysis of containerized JVM workloads.
  • gceasy.io [EN CONTENT] [ADVANCED LEVEL] [DE FACTO STANDARD] [ENTERPRISE-STABLE] — Machine-learning powered JVM Garbage Collection log analyzer. Automates the detection of memory leaks, GC pauses, and heap sizing misconfigurations, offering actionable recommendations for optimization.
  • heaphero.io [EN CONTENT] [ADVANCED LEVEL] [ENTERPRISE-STABLE] — An automated cloud-based JVM heap dump analyzer built to parse large memory dumps quickly. Detects memory leaks and optimizes data structure footprints to resolve OutOfMemoryError crashes.

DevOps

CICD Pipelines

Performance Metrics

  • (2023) harness.io: Metrics to Improve Continuous Integration Performance [EN CONTENT] [COMMUNITY-TOOL] [GUIDE] — Formulates continuous integration performance indicators including pipeline execution speed, failure rates, queue times, and feedback loops. Explains how telemetry analytics can identify bottlenecks within containerized build nodes and testing environments.

Development

Java Development

Debugging and Profiling

  • (2023) Remote Debugging of Java Applications on OpenShift [EN CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] [GUIDE] — Outlines security and networking strategies for executing remote Java debugger connections on containerized environments inside OpenShift. Details JDWP agent configuration and port forwarding techniques.

Event-Driven Architecture

Apache Kafka

Tooling and UI

  • Kafdrop Kafka Web UI 🌟 6135 [DE FACTO STANDARD] [ENTERPRISE-STABLE] — Curator Insight: Highly popular, lightweight web UI for monitoring and managing Apache Kafka. Live Grounding: Renders cluster info, brokers, topics, partition offsets, consumer group lag, and allows active JSON/protobuf message payload inspection.

FinOps

Fundamentals

Kubernetes

  • (2021) replex.io: An Introduction to Kubernetes FinOps [NONE CONTENT] [DOCUMENTATION] 🌟🌟🌟 [COMMUNITY-TOOL] — An introductory foundational guide explaining how Kubernetes abstract resource consumption complicates traditional IT billing. Explores concepts like container resource requests, limits, idle capacity, and cost allocation models across teams. Illustrates how integrating observability tools helps teams isolate exact microservice costs within shared networks.

Infrastructure Operations

Sysadmin Toolsets

Resource Curation

Awesome Lists
  • Awesome Sysadmin 33981 [DE FACTO STANDARD] — An incredibly rich curation containing production-grade open source utilities, control planes, networking layers, and security mechanisms used daily by systems architects and site reliability engineers.

Networking

CNI

Calico

  • (2020) thenewstack.io: Tigera's Calico Aims to Ease Connectivity Pain with Kubernetes [GO CONTENT] 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — Covers Tigera Calico's core value proposition of delivering flexible, secure CNI capabilities for Kubernetes environments. It contrasts Calico's IP-in-IP and BGP routing modes with standard encapsulation overlays, providing optimal performance. Integrates advanced security policy engines capable of running in both Kubernetes and hybrid virtualized clusters.

Observability (1)

APM and Logging

Application Performance Monitoring

  • (2024) sentry.io [EN CONTENT] [DOCUMENTATION] [COMMUNITY-TOOL] — Technical framework for real-time application error tracking and performance profiling. Offers native SDK integrations across key stacks, trace stitching, and code-level context detailing for distributed microservices.

Dynatrace APM

Dynatrace PoC

  • (2023) ==My Dynatrace proof of concept 🌟== 661 [EN CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — A comprehensive architectural evaluation report and proof of concept depicting Dynatrace deployment inside complex Kubernetes topologies. Discusses performance impact, instrumentation automation, and alerting configurations.

Elastic APM

  • (2024) Elastic APM [EN CONTENT] [DOCUMENTATION] [COMMUNITY-TOOL] — An extensible APM engine integrated natively into the Elastic ecosystem. Provides distributed tracing, application-level error capturing, system metrics logging, and auto-instrumentation capabilities for modern software stacks.

Elastic APM Infrastructure

  • (2024) Elastic APM Server [EN CONTENT] [ADVANCED LEVEL] [DOCUMENTATION] [COMMUNITY-TOOL] — The architectural pipeline middleware component that receives telemetry from Elastic APM agents, validates schemas, processes events, and indexes performance metrics into Elasticsearch.

Elastic Stack

  • (2023) acloudguru.com: Getting started with the Elastic Stack [EN CONTENT] [COMMUNITY-TOOL] [GUIDE] — Technical introduction to the ELK (Elasticsearch, Logstash, Kibana) stack. Explains data ingestion pipelines, cluster architecture, storage indices, and log analysis visualization engines.

Log Aggregation

  • (2023) skilledfield.com.au: Monitoring Kubernetes and Docker Container Logs [EN CONTENT] [COMMUNITY-TOOL] [GUIDE] — Details the collection and sanitization of stdout/stderr logs from Docker runtimes and Kubernetes CRI engines. Contrasts daemonset-based log forwarding with sidecar collector patterns to maximize ingestion efficiency and security isolation.

Managed OpenSearch

Cost Optimization

Data Storage

  • (2023) instana.com: The Hidden Cost of Observability: Data Volume [EN CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] — Analyzes the economic and architectural implications of high-cardinality and high-volume observability data. Provides strategies for dynamic rate limiting, smart sampling, and metric deduplication to prevent telemetry storage costs from scaling linearly with microservices growth.

Distributed Tracing (1)

Data Pipelines

  • (2020) A Distributed Tracing Adventure in Apache Beam [EN CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] [GUIDE] — A technical retrospective of tracing asynchronous distributed execution paths in Apache Beam data processing pipelines. Addresses transaction correlation across multi-hop distributed transformations and dynamic worker scale-outs.

Tracing Architecture

  • (2010) Dapper [EN CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] — Google's foundational research paper on Dapper, the design baseline for almost all modern distributed tracing platforms. Illustrates trace tree models, span propagation, low-overhead out-of-band collection, and application-level transparent instrumentation.

Infrastructure Monitoring

Zabbix and OpenShift

Zabbix and Prometheus

Kubernetes Core

Network Control Plane

  • (2023) sysdig.com: How to monitor kube-proxy 🌟 [EN CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] [GUIDE] — A targeted guide on monitoring the network proxy service of Kubernetes (kube-proxy). Explains how to expose and scrape IPVS and iptables sync performance metrics, track latency anomalies, and diagnose network routing degradation.

Methodology

Microservice Patterns

  • (2022) infoworld.com: The RED method: A new strategy for monitoring microservices [EN CONTENT] [COMMUNITY-TOOL] — Elaborates on the RED (Rate, Errors, Duration) framework specifically designed for request-driven microservices architectures. Complements traditional USE (Utilization, Saturation, Errors) infrastructure monitoring by tracking user-facing performance bottlenecks.

Metrics Library

Micrometer

  • (2026) Micrometer Collector [JAVA CONTENT] [COMMUNITY-TOOL] — A developer-focused metrics instrumentation library for JVM-based applications. Acts as a facade over various monitoring frameworks, including Prometheus, Datadog, and New Relic.

OSS Monitoring Stack

Custom Architectures

Data Flow

Platform Monitoring

Dynatrace Agent Deployment

  • (2023) dynatrace.com: Deploy OneAgent on OpenShift Container Platform [EN CONTENT] [ADVANCED LEVEL] [DOCUMENTATION] [COMMUNITY-TOOL] — Technical deployment specification for deploying the Dynatrace OneAgent operator onto OpenShift Container Platforms. Detailing daemonset deployments, security context constraints (SCCs), and privileged execution requirements.

Dynatrace OpenShift

  • (2024) dynatrace.com: openshift monitoring [EN CONTENT] [ADVANCED LEVEL] [DOCUMENTATION] [COMMUNITY-TOOL] — Outlines native integration capabilities of the Dynatrace Operator inside Red Hat OpenShift, securing auto-discovery and telemetry indexing for containerized control planes, nodes, and applications.

Dynatrace OpenShift Integration

Kubernetes Day 2

Prometheus

Cluster Core Telemetry

  • (2023) rancher.com: Monitor Etcd with Prometheus and Grafana using Rancher [EN CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] [GUIDE] — Walkthrough of configuring Prometheus and Grafana alerts to monitor ETCD state stability inside Rancher-managed Kubernetes setups. Explores key ETCD metrics like DB physical size, commit latencies, and leader election frequency.

Clustering and Scalability

Kubernetes Native

  • (2024) sysdig.com: Kubernetes Monitoring with Prometheus, the ultimate guide 🌟 [EN CONTENT] [ADVANCED LEVEL] [DOCUMENTATION] [COMMUNITY-TOOL] — A comprehensive technical deep-dive into configuring the Prometheus Operator, Service Discovery patterns, and Alertmanager inside Kubernetes clusters. Demonstrates the implementation of node-exporter, kube-state-metrics, and custom metric scrapers for holistic cluster health monitoring.

Standards and Engines

Metrics Comparison

  • (2024) timescale.com: Prometheus vs. OpenTelemetry Metrics: A Complete Guide [EN CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] [GUIDE] — A systematic comparison between Prometheus pull-based metrics and OpenTelemetry's push-oriented push-receiver unified protocol. Analyzes wire formats, collector architecture, and ecosystem interoperability for modern telemetry backends.

OpenTelemetry History

VictoriaMetrics Updates

Telemetry Standards

OpenTelemetry vs Prometheus

  • Prometheus and OpenTelemetry Compatibility Issues [ADVANCED LEVEL] [COMMUNITY-TOOL] — An informative look at the historical data model incompatibilities between Prometheus and OpenTelemetry (OTel). It details the industry efforts to reconcile standard Prometheus structures with the broader OTel landscape.

Observability and Performance

Kubernetes Internals

Resource Management

  • The Hidden CPU Throttling Crisis in Kubernetes Clusters [EN CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] — An in-depth analysis exposing the silent threat of CPU throttling inside Kubernetes clusters caused by rigid CFS quota management. Demonstrates how microservices suffer latency spikes even with low aggregate CPU consumption.

Performance Testing

HTTP Benchmarking

  • blog.cloud-mercato.com: New HTTP benchmark tool pycurlb [EN CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] — A deep-dive introducing pycurlb, a fast performance tool wrapping libcurl for rapid HTTP request benchmarking in Python. Explores real-world performance results and technical comparisons.

Operations and Reliability

Observability and Monitoring

Foundations

  • Monitoring Distributed Systems - Google SRE Book [ADVANCED LEVEL] [DOCUMENTATION] [DE FACTO STANDARD] — The industry-standard chapter from Google's SRE book detailing the implementation of distributed systems monitoring. It defines the 'Four Golden Signals'—latency, traffic, errors, and saturation—providing practical blueprints to prevent alert fatigue and build actionable dashboard designs.

Organizational Dynamics

DevOps Culture

Business Telemetry

Roles and Responsibilities

  • (2021) forbes.com: Who Should Own The Job Of Observability In DevOps? [EN CONTENT] [COMMUNITY-TOOL] — Explores organizational ownership paradigms of observability pipelines between Site Reliability Engineering (SRE) and Application Development squads. Assesses the shared-responsibility model for maintaining telemetry instrumentation standards.

Management

KPI Frameworks

  • (2023) KPIs [EN CONTENT] [DOCUMENTATION] [COMMUNITY-TOOL] — Core reference documentation on the design, deployment, and auditing of Key Performance Indicators (KPIs). Useful for mapping cloud infrastructure metrics to quantitative operational and organizational success.

💡 Explore Related: About | Demos | Cheatsheets