github/awesome-kubernetes
1
0
Fork 0
mirror of https://github.com/nubenetes/awesome-kubernetes.git synced 2026-07-12 18:00:37 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
f9e994778aacea0aed51d4f7ccded9c643a72121
awesome-kubernetes/v2-docs/ai.md

62 KiB
Raw Blame History

Artificial Intelligence

!!! info "Architectural Context" Detailed reference for Artificial Intelligence in the context of AI.

Table of Contents

  1. AI and Orchestration
  1. AI Engineering
  1. Architectural Foundations
  1. Artificial Intelligence
  1. Artificial Intelligence and LLMs
  1. CICD Pipelines
  1. Cloud Infrastructure
  1. Cloud Native Operations
  1. Computer Vision
  1. Container Orchestration
  1. DevOps
  1. Developer Experience
  1. Developer Tooling
  1. Emerging Technology
  1. Enterprise Architecture
  1. FinOps and Cloud Cost
  1. Infrastructure as Code
  1. Kubernetes and Platform Engineering
  1. Software Architecture and .NET Development
  1. Software Engineering

AI and Orchestration

Agentic Workflows

Command-Line Tools

  • (2025) Google Agents CLI ⭐ 2853 [TYPESCRIPT CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — An official command-line tool from Google built to design, test, and deploy agentic AI workflows. Leveraging the Model Context Protocol (MCP) and Google LLM APIs, it facilitates automated task orchestration across local filesystems and remote cloud APIs.

AI Engineering

Model Context Protocol

Awesome Lists

  • (2025) ==Awesome MCP Servers== ⭐ 89112 [MARKDOWN CONTENT] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] [GUIDE] — Curator Insight: A community-curated collection of servers implementing the Model Context Protocol. Live Grounding: Aggregates verified integrations linking AI models to tools like relational databases, enterprise APIs, version control providers, and local execution runtimes.

Architectural Foundations

Kubernetes Tools

General Reference

Artificial Intelligence (1)

AI Strategy

Business Alignment

Ecosystem Landscapes

  • (2024) mad.firstmark.com: The MAD (ML/AI/Data) Landscape [COMMUNITY-TOOL] — The definitive interactive map outlining the modern Machine Learning, AI, and Big Data landscape (MAD). Built and updated regularly, this portal segments thousands of open-source packages and cloud vendors. It is an indispensable dashboard for architects analyzing toolchain consolidation and technology selection.

Ecosystem Partnerships

Hybrid Cloud Infrastructure

  • (2020) cio.com: Make Better AI Infrastructure Decisions: Why Hybrid Cloud is a Solid Fit 🌟 [COMMUNITY-TOOL] — This article evaluates hybrid cloud configurations as the optimal topology for running complex AI and ML workloads. By pairing on-premises GPU compute resources (minimizing high data transfer costs) with public cloud scalability for distributed inference, enterprises optimize their infrastructure spending. It acts as an essential decision framework for infrastructure architects.

Socio-Technical Impact

Deep Learning

Large Language Models

  • (2024) ==LLMs-from-scratch== ⭐ 97134 [PYTHON CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — Curator Insight highlights this acclaimed resource for building a fully functional PyTorch Transformer from scratch. Live Grounding verifies it is an indispensable textbook for AI engineers, laying bare tokenization, self-attention calculations, optimization loops, and model loading mechanics without library abstractions.

Generative AI Engineering

API Integration Patterns

  • (2023) ==github.com/openai/openai-cookbook: OpenAI Cookbook== ⭐ 74150 [PYTHON CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — The official, highly detailed cookbook of integration patterns and code recipes from OpenAI. Live Grounding and Curator Insight rate this as the definitive reference for engineering structured JSON model outputs, semantic embedding databases, low-latency streaming endpoints, and high-throughput bulk operations.

Architecture Patterns

  • (2023) youtube: AWS re:Invent 2023 - From hype to impact: Building a generative AI architecture (ARC217) [ADVANCED LEVEL] [EMERGING] — An advanced AWS architecture session detailing patterns to transition generative AI from experimental concepts to secure, cost-optimized, and low-latency production applications. It covers vector search performance, model endpoint caching, and distributed multi-tenant API routing. This reference is crucial for system engineers designing robust enterprise AI portals.

Audio and Speech Synthesis

  • (2024) amazon.science/base-tts-samples [ADVANCED LEVEL] [COMMUNITY-TOOL] — Examines Amazon's advanced research in large-scale text-to-speech (TTS) foundation models, presenting audio samples and technical parameters. The system demonstrates emergent properties in synthetic voice naturalness, prosody control, and emotive expression. It outlines the state of the art in developing hyper-realistic speech interfaces.

Transformer Implementations

  • (2023) github.com/NielsRogge/Transformers-Tutorials ⭐ 11638 [PYTHON CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — A robust repository of detailed Jupyter notebooks demonstrating how to fine-tune, optimize, and deploy Hugging Face Transformers. Spanning multiple sensory modalities, it includes code for computer vision, natural language processing, and multimodal tasks. It serves as a go-to code library for enterprise machine learning engineers.

LLMOps and MLOps

Curated Ecosystems

  • (2023) github.com/tensorchord/Awesome-LLMOps: Awesome LLMOps ⭐ 5843 [MARKDOWN CONTENT] 🌟🌟🌟 [ENTERPRISE-STABLE] — An expansive, curated catalog of leading open-source LLMOps tooling, libraries, and frameworks. Curator Insight and Live Grounding validate this repository as a comprehensive roadmap for configuring production vector databases, distributed training trackers, model testing beds, and low-latency inference gateways.

Strategy and Pipelines

  • (2023) valohai.com/blog/llmops/ [EMERGING] — A detailed structural analysis mapping out the critical differences between classical MLOps pipelines and the emerging LLMOps domain. It addresses unique lifecycle challenges such as prompt versioning, parameter-efficient fine-tuning (PEFT), and the RAG validation triad. It helps platform teams adapt CI/CD tools to AI lifecycles.

Large Language Models (1)

Evaluation and Safety

  • (2024) Ignore Prior Instructions: AI Still Befuddled by Basic Reasoning [COMMUNITY-TOOL] — Analyses the logical and mathematical limitations of current autoregressive transformers, exploring why basic reasoning and prompt injection vulnerability remain major hurdles. It advises deploying robust system-level validation checks and structured orchestration frameworks (e.g., semantic gateways) to mitigate risk in user-facing production systems.

Industry Use Cases

LLM Primers

  • (2023) aman.ai/primers/ai/LLM: Primers - Overview of Large Language Models [ADVANCED LEVEL] [DOCUMENTATION] [COMMUNITY-TOOL] — A structured primer exploring the foundational architectures, training phases, and evaluation cycles of Large Language Models (LLMs). It maps out causal language modeling, masking methodologies, and reinforcement learning from human feedback (RLHF). This overview equips engineers with deep insights into how massive neural networks interpret context.

Structured Curriculums

  • (2023) ==github.com/mlabonne/llm-course== ⭐ 80120 [PYTHON CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — Maxime Labonne's stellar curriculum for mastering Large Language Model engineering. Curator Insight and Live Grounding confirm its value, providing code-driven notebooks covering quantization (bitsandbytes, AWQ, GGUF), LoRA fine-tuning, direct preference optimization (DPO), and advanced retrieval-augmented generation (RAG) paradigms.

Transformer Architecture

  • (2023) aman.ai: Transformers [ADVANCED LEVEL] [DOCUMENTATION] [COMMUNITY-TOOL] — An elegant architectural blueprint dissecting the mathematical design of the Attention is All You Need transformer model. It provides clear examinations of multi-head attention blocks, residual connections, feed-forward sublayers, and positional embeddings. Reading this is necessary for developers seeking to optimize model inference latency.
  • (2023) aman.ai: Primers • Bidirectional Encoder Representations from Transformers (BERT) [ADVANCED LEVEL] [DOCUMENTATION] [COMMUNITY-TOOL] — Dissects BERT (Bidirectional Encoder Representations from Transformers), detailing its bidirectional training paradigm via Masked Language Modeling (MLM). By processing left and right contexts simultaneously, BERT excels at semantic search, sentence classification, and named entity recognition. This guide is ideal for engineers deploying advanced information extraction models.
  • (2023) aman.ai: Primers • Generative Pre-trained Transformer (GPT) [ADVANCED LEVEL] [DOCUMENTATION] [COMMUNITY-TOOL] — A technical overview of the Generative Pre-trained Transformer (GPT) lineage, explaining decoder-only autoregressive pre-training. It highlights how next-token prediction and casual masking techniques scale predictably over billions of parameters. This documentation helps platform engineers understand parameter scaling trends and memory requirements.

Machine Learning and Deep Learning Fundamentals

AI Primer

  • (2023) aman.ai/primers/ai: Distilled AI [DOCUMENTATION] [COMMUNITY-TOOL] — An elite reference manual summarizing core concepts in modern machine learning and deep learning architectures. It distills deep neural net mechanics, loss functions, optimizer designs, and regularization frameworks into actionable technical digests. Ideal for software architects who require high-density cheat sheets on machine learning theory.

Career Strategy

  • (2021) freecodecamp.org: Ace Your Deep Learning Job Interview [COMMUNITY-TOOL] — A practical preparation handbook mapping out the essential mathematical and conceptual pillars required for deep learning technical interviews. It covers topics ranging from linear algebra, neural network architectures (like CNNs and RNNs), activation functions, to hyperparameter optimization. This guide is highly effective for engineers targeting deep-tech infrastructure roles.

Foundational Handbook

Neural Network Architectures

  • (2020) poloclub.github.io: What is a Convolutional Neural Network? [JAVASCRIPT CONTENT] [COMMUNITY-TOOL] — An interactive, visual demonstration of Convolutional Neural Networks (CNNs) designed to demystify mathematical operations like convolution, pooling, and activation functions. The tool lets engineers inspect intermediate layers of active models, mapping visual inputs to numerical transformations. This is a vital resource for platform engineers seeking a deep conceptual understanding of computer vision workloads.

Structured Curriculums (1)

  • (2023) ==github.com/microsoft/ML-For-Beginners: Machine Learning for Beginners' - A Curriculum== ⭐ 86821 [PYTHON CONTENT] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — Microsoft's 12-week, 26-lesson classical machine learning curriculum focused heavily on hands-on project-based execution using Scikit-learn. It purposely isolates foundational ML patterns—such as regression, clustering, and basic NLP—from deep learning complexities. It is a premier learning journey for developers seeking to deploy robust predictive systems.

Artificial Intelligence and LLMs

Prompt Engineering

Developer Productivity

  • (2024) Awesome NotebookLM Slide Prompts ⭐ 3761 [MARKDOWN CONTENT] 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — A master curation of system-level prompt templates specifically optimized for Google NotebookLM. It accelerates complex source material ingestions, contextual extractions, and structured summarizing processes for technical architects. (Live Grounding: Highlights the 2026 intersection of AI workflow orchestration and engineering documentation maintenance).

CICD Pipelines

AI and Automation

AI PR Automation

Model Context Protocol (1)

  • (2025) Azure DevOps MCP Server Public Preview [NONE CONTENT] [COMMUNITY-TOOL] — Official Microsoft announcement outlining the preview release of the Azure DevOps MCP Server. Details how developer agents leverage safe API contexts to build and deploy complex assets.

Cloud Infrastructure

CICD and DevOps

DevSecOps

  • (2023) infoworld.com: 5 best practices for securing CI/CD pipelines [COMMUNITY-TOOL] — Synthesizes five critical best practices for hardening modern deployment pipelines. Covers automated static analysis (SAST), software bill-of-materials (SBOM) generation, container signing, secrets management, and least-privilege runtimes.

Infrastructure as Code

Compliance Auditing

  • (2026) AWS Well-Architected IaC Analyzer ⭐ 483 [PYTHON CONTENT] [ADVANCED LEVEL] 🌟🌟 [COMMUNITY-TOOL] — An AWS-backed auditing analyzer designed to inspect CloudFormation and Terraform designs against the AWS Well-Architected standard. Evaluates infrastructure-as-code deployments for security vulnerabilities and reliability issues before runtime provisioning.

Cloud Native Operations

AI AIOps

Kubernetes Troubleshooting

  • (2025) HolmesGPT (Robusta) ⭐ 2623 [PYTHON CONTENT] [ADVANCED LEVEL] 🌟🌟 [COMMUNITY-TOOL] — Curator Insight: An AI-driven troubleshooting assistant for Kubernetes clusters by Robusta. Live Grounding: Utilizes LLM agents to autonomously parse Prometheus alerts, collect pod logs, inspect live status, and deliver actionable remediation steps for infrastructure incidents.

AI-Powered Operations AIOps

Kubernetes Troubleshooting (1)

  • (2023) collabnix.com: The Rise of Kubernetes and AI – Kubectl OpenAI plugin [GO CONTENT] [COMMUNITY-TOOL] — Focuses on the Kubectl OpenAI plugin, showing how natural language commands can be compiled directly into active Kubernetes cluster API calls. It simplifies YAML definition generation and debugging workflows, lowering barrier-to-entry. A great case study in operations-focused developer tooling.

Infrastructure as Code (1)

AI-Assisted IaC

Kubernetes Orchestration

AI Workloads on K8s

  • (2024) itnext.io: Deploy Flexible and Custom Setups with Anything LLM on Kubernetes [YAML CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] — Details the architectural deployment of AnythingLLM on top of a Kubernetes cluster, covering PV provisioning, ingress configurations, and resource limits. Deploying private RAG environments on Kubernetes gives enterprise teams localized, secured multi-user document search. This tutorial bridges raw AI services with cloud-native hosting stability.

Computer Vision

Deep Learning Research

CVPR

  • (2023) ==github.com/SkalskiP/top-cvpr-2023-papers== ⭐ 647 [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — A curated reference hub detailing top-performing papers and breakthroughs from CVPR 2023. Synthesizes vital engineering advancements across object detection, visual language models, zero-shot segmentation libraries, and advanced neural representations.

Generative AI

  • (2023) ==github.com/XingangPan/DragGAN== ⭐ 35825 [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — An interactive GAN-based image manipulation system. Users drag specific control points of an image to dynamically alter object dimensions, poses, and facial structures.

ML Notebooks

  • (2023) ==github.com/jupyterlab/jupyter-ai== ⭐ 4272 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — An official JupyterLab extension that brings generative AI capabilities to interactive notebooks. It supports inline code synthesis, explanation, and error correction across multiple model APIs.

Container Orchestration

Azure Kubernetes Service

AKS Fleet Manager

  • (2025) Limitless Kubernetes Scaling for AI and Data-intensive Workloads: The AKS Fleet Strategy [NONE CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] — Focuses on utilizing Azure Kubernetes Service (AKS) Fleet Manager to coordinate multi-cluster scaling for modern AI and data-heavy services. It details multi-cluster updates, global load balancing, and orchestration patterns that bypass single-cluster scaling bottlenecks, supporting highly distributed deep learning and large-scale analytical runtimes.

DevOps

Automation

Education Tooling

  • (2023) Quiz Grader [PYTHON CONTENT] [COMMUNITY-TOOL] — A lightweight utility engineered to automate the grading and feedback of quizzes and programming assignments. Processes markdown-based inputs to generate structured performance assessments, supporting classroom and self-assessment operations.

Infrastructure as Code (2)

AI Integration

Terraform

Developer Experience

AI-Assisted Coding

Claude Code

  • (2025) ==Claude Code Best Practice== ⭐ 57660 [MARKDOWN CONTENT] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] [GUIDE] — Curator Insight: Curated collection of best practices, system prompts, and architecture layouts for Claude Code. Live Grounding: Explores advanced CLI-driven agent workflows, highlighting configuration optimizations, shell integration strategies, and secure execution configurations in local and remote environments.

Developer Tooling

AI Code Assistants

Effort Frameworks

  • (2026) Cursor Bugbot Effort Levels Documentation [N/A CONTENT] [DOCUMENTATION] [COMMUNITY-TOOL] — This reference document outlines the effort metrics and execution paradigms utilized by Cursor's Bugbot tool inside the editor context. It guides development teams in managing priority levels for automated debugging routines across repositories.

Prompt Templates

  • (2026) ==Claude Code Templates== ⭐ 28036 [MARKDOWN CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — Claude Code Templates is an extensive community library containing structured system designs, context guidelines, and prompt schemas optimized for Anthropic's Claude Code and CLI. It helps teams configure context-aware coding agents that integrate smoothly into microservice development cycles.

Emerging Technology

Machine Learning

Course

  • (2024) Machine Learning Crash Course [SPANISH CONTENT] [COMMUNITY-TOOL] [GUIDE] — Google's structured technical course on ML foundations. Covers gradient descent, model loss, deep neural networks, and scalable tensor processing, serving as an entry point for engineers integrating ML systems into modern APIs.

Enterprise Architecture

AIOps and Observability

Incident Response

Site Reliability Engineering

  • (2023) infoq.com: AIOps: Site Reliability Engineering at Scale [ADVANCED LEVEL] [COMMUNITY-TOOL] — An operational guide illustrating how AIOps can scale Site Reliability Engineering. Demonstrates how machine learning helps teams prioritize incidents, predict SLO failures, and handle large-scale alert volume.

Strategic IT Ops

  • (2023) apmdigest.com: What Can AIOps Do For IT Ops? - Part 1 [COMMUNITY-TOOL] — A comprehensive five-part industry series highlighting how AIOps restructures modern IT Operations. Explores the migration from reactive monitoring to predictive modeling, showing how cognitive analytics can prevent systemic downtime.
  • (2023) thenewstack.io: The Urgency Driving AIOps into Your Enterprise [COMMUNITY-TOOL] — Analyzes the business and technology drivers forcing rapid enterprise integration of AIOps platforms. Addresses the challenge of telemetry overload and details how automated correlation engines optimize modern cloud networks.

FinOps and Cloud Cost

Azure Optimization

AI Cost Management

IaC FinOps

AI Optimization

  • (2024) OpenOps: No-Code FinOps Automation Platform with AI ⭐ 1035 [GO CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — An open-source, no-code platform utilizing AI to identify and automate cloud cost optimizations. Connects directly with Kubernetes metrics to suggest sizing adjustments and automatically remove unused resources.

Kubernetes FinOps

Automated Optimization

  • (2025) ==CAST AI== [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — Introduces CAST AI, an automated cost-reduction system for EKS, AKS, and GKE. Highlights how its real-time algorithms adjust cluster sizing, configure spot instances, and scale down resources without manual developer effort.

Infrastructure as Code (3)

AI Integrations

Validation and Testing

  • (2024) AI Meets Terraform: Prompt Strategies for Test Generation [NONE CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] — Explores LLM prompting strategies designed to automatically generate high-quality integration testing assertions for Terraform infrastructure codebases. Outlines systematic framework specifications to minimize manual testing overhead.

Kubernetes and Platform Engineering

Platform Engineering Trends

AI Integration (1)

Software Architecture and .NET Development

Artificial Intelligence (2)

Agent Integration

  • (2024) Extend your coding agent with .NET Skills [C# CONTENT] [ADVANCED LEVEL] [COMMUNITY-TOOL] — Examines methods for extending autonomous AI coding agents with direct .NET skill injection. Uses Semantic Kernel to build tools enabling LLMs to execute C# compilations, format files, and interact natively with code bases.

Software Engineering

AI Tools

Developer Productivity (1)

  • (2024) Programming with GitHub Copilot Agent Mode 🌟🌟🌟🌟 [ENTERPRISE-STABLE] — A deep dive into the engineering capabilities of GitHub Copilot's 'Agent Mode.' It details how the agent acts autonomously to analyze workspace dependencies, generate multi-file modifications, run localized compilations, and iterate on test suites based on natural language prompts.

AI-Assisted Development

CLI Tools

  • (2026) GitHub Copilot CLI for Beginners: Getting Started [COMMUNITY-TOOL] [GUIDE] — Highlights setup and early integration techniques for GitHub Copilot CLI, translating natural language prompts into executable terminal and shell scripts. Enhances sysadmin and shell workflow automation while maintaining a human-in-the-loop review step for safety and correctness.

GitHub Copilot

  • (2026) Best Practices for Using GitHub Copilot [DOCUMENTATION] [COMMUNITY-TOOL] — Authoritative guidelines from GitHub designed to optimize interaction with Copilot. Covers prompt engineering tactics (such as context-setting files and comments), managing AI security and license compliance, and verifying generated output.

Industry Impact

Multi-Repository Architecture

  • (2025) Using Workspaces for AI Changes Across Multiple Repos [ADVANCED LEVEL] [COMMUNITY-TOOL] — Details advanced patterns for orchestrating automated codebase modifications across distributed multi-repository environments using AI workspaces. Evaluates dependency resolution, unified context indexing, and coordinate git-commit strategies during systemic API breaking updates.

Next-Gen Platforms

Command-Line Utilities

Terminal Emulators

  • (2026) Warp: The Agentic Development Environment [COMMUNITY-TOOL] — A modern, Rust-based terminal emulator incorporating AI agent assistance directly into the command-line interface. Reimagines input fields like text editors, supports real-time workspace collaboration, and native context-sharing for accelerated platform ops troubleshooting.

Database Management

Model Context Protocol (2)

Professional Development

Core Architectures

  • (2025) ==Skills for Real Engineers== ⭐ 128202 [MARKDOWN CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — An exceptionally popular repository detailing the foundational principles, design philosophies, and architectural protocols required for master-level software delivery. While the curator focuses on career advancement, live engineering practice indicates that mastering these fundamentals is vital to surviving rapid AI development shifts. It represents an elite reference for engineering standardizations.

💡 Explore Related: ChatGPT | AI Agents MCP | MLOps

Reference in New Issue View Git Blame Copy Permalink