github/awesome-kubernetes
1
0
Fork 0
mirror of https://github.com/nubenetes/awesome-kubernetes.git synced 2026-07-14 19:05:53 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
bee2b2fdbb669b71893de33b6f5eaecfdb6058ff
awesome-kubernetes/v2-docs/mlops.md

31 KiB
Raw Blame History

Machine Learning Ops (MLOps) and Data Science

!!! info "Architectural Context" Detailed reference for Machine Learning Ops (MLOps) and Data Science in the context of AI.

Standard Reference

Data Engineering

CI-CD for ML

  • (2022) semaphoreci.com: Why Do We Need DevOps for ML Data? [N/A CONTENT] [COMMUNITY-TOOL] — Connects classic CI/CD DevOps approaches to data-centric ML development (DataOps). Emphasizes raw data version control, schema drift verification, and deterministic pipeline stages to prevent silent model failures.

Data Labeling

Argilla

  • (2026) ==rubrix== ⭐ 4981 [PYTHON CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — Formerly Rubrix, Argilla is an open-source data curation platform designed for AI and LLM workflows. Enables continuous human-in-the-loop (HITL) fine-tuning cycles. Integrates seamlessly with Hugging Face and SpaCy pipelines.

Data Science and ML

Computer Vision

Segment Anything

  • (2023) ==github.com/CASIA-IVA-Lab/FastSAM== ⭐ 8342 [PYTHON CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — Fast Segment Anything Model (FastSAM) is a highly efficient, CNN-based real-time alternative to the original SAM. It achieves comparable zero-shot instance segmentation quality at a significantly lower computational footprint, making it ideal for edge computing and low-latency production pipelines.

Document AI

OCR and Layout Analysis

  • (2024) ==github.com/VikParuchuri/surya== ⭐ 19766 [PYTHON CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] [LEGACY] — Surya provides robust, multi-lingual document OCR and highly accurate layout analysis. It leverages advanced deep learning architectures to process dense, complex documents (such as academic papers and financial statements) with structural precision, presenting a lighter alternative to legacy commercial engines.

ML Systems Design

Real-Time RAG

  • (2024) ==github.com/decodingml: Real-time news search engine using Upstash Kafka and Vector DB== ⭐ 139 [PYTHON CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — A practical system architecture blueprint for building a real-time news search engine. Utilizing Upstash managed Kafka for streaming ingest and a Vector DB for semantic indexing, this reference demonstrates how to construct serverless, high-throughput event-driven retrieval-augmented generation (RAG) pipelines.

MLOps

Model Versioning

  • (2024) docs.microsoft.com: Machine Learning Experimentation in VS Code with DVC Extension [PYTHON CONTENT] [DOCUMENTATION] [COMMUNITY-TOOL] — An official guide demonstrating the integration of Data Version Control (DVC) within VS Code to manage datasets, track experiments, and version models natively. This approach bridges software engineering standards with data science pipelines, ensuring reproducibility of complex ML assets directly from the developer's workspace.

GPU Management

Nix

Generative AI

LLM Fine-tuning

Llama recipes

  • (2026) ==github.com/meta-llama/llama-recipes== ⭐ 18334 [PYTHON CONTENT] [ADVANCED LEVEL] 🌟🌟🌟🌟🌟 [DE FACTO STANDARD] — Meta's primary cookbook for deploying and fine-tuning Llama models. Features scalable recipes for parameter-efficient tuning (PEFT, LoRA), Quantization, and deployment templates inside microservices frameworks.

Infrastructure Abstraction

Flyte

Infrastructure-As-Code

Dependency Management

Nix Packages

  • (2026) Nix [NIX CONTENT] [ADVANCED LEVEL] [DOCUMENTATION] [COMMUNITY-TOOL] — Reference manual for Nix package manager and dependency architectures. Discusses underlying system interactions, specifically comparing standard Docker host volumes with Nix's deterministic sandboxed build environments.

Model Serving

Microservices

Model Tracking

Azure Integration

  • (2024) docs.microsoft.com: MLflow and Azure Machine Learning [PYTHON CONTENT] [DOCUMENTATION] [COMMUNITY-TOOL] — Deep technical reference on integrating MLflow telemetry inside Microsoft Azure's cloud infrastructure. Standardizes metrics tracking, hyperparameter recording, and artifact storage across hybrid deployments.

Open Source AI

Industry Analysis

Orchestration

Flyte (1)

💡 Explore Related: AI Agents MCP | AI | ChatGPT

Reference in New Issue View Git Blame Copy Permalink