Files
awesome-kubernetes/docs/ai-agents-mcp.md

2.8 KiB

AI Agents and Model Context Protocol (MCP) for Kubernetes

Resources, tools, and projects related to autonomous AI agents, Model Context Protocol (MCP) implementations, and LLM orchestration within Kubernetes environments.

  1. Introduction
  2. AI Agents
  3. Model Context Protocol (MCP)
  4. LLM Operators and Infrastructure

Introduction

AI Agents

Model Context Protocol (MCP)

LLM Operators and Infrastructure

  • Kube-Ray - A toolkit to run Ray applications on Kubernetes.
  • vLLM on Kubernetes - High-throughput LLM serving with PagedAttention.
  • NVIDIA GPU Operator - Automates the management of all NVIDIA software components needed to provision GPU.
  • LocalAI - Self-hosted, community-driven, local OpenAI-compatible API.