Files
awesome-kubernetes/docs/ai-agents-mcp.md
2026-05-10 13:38:43 +00:00

2.5 KiB

AI Agents and Model Context Protocol (MCP) for Kubernetes

Resources, tools, and projects related to autonomous AI agents, Model Context Protocol (MCP) implementations, and LLM orchestration within Kubernetes environments.

  1. Introduction
  2. AI Agents
  3. Model Context Protocol (MCP)
  4. LLM Operators and Infrastructure

Introduction

AI Agents

  • HolmesGPT (Robusta) - An open-source AI agent for investigating Prometheus alerts and Kubernetes incidents. It uses LLMs to triage issues and provide recommended fixes.
  • Skyvern - Automate browser-based workflows using LLMs and Computer Vision.

Model Context Protocol (MCP)

LLM Operators and Infrastructure

  • Kube-Ray - A toolkit to run Ray applications on Kubernetes.
  • vLLM on Kubernetes - High-throughput LLM serving with PagedAttention.
  • NVIDIA GPU Operator - Automates the management of all NVIDIA software components needed to provision GPU.
  • LocalAI - Self-hosted, community-driven, local OpenAI-compatible API.