Files

LeaderWorkerSet API Example

This example is dedicated to LeaderWorkerSet API.

Instructions

Generate the Kubernetes architecture diagrams for LeaderWorkerSet API and its examples:

$ ./generate.sh

Generated architecture diagrams

Architecture diagram for the vLLM example with GPU:

examples/vllm_GPU.png

Architecture diagram for the vLLM example with TPU:

examples/vllm_TPU.png

Architecture diagram for the TensorRT-LLM example:

examples/tensorrt-llm.png

Architecture diagram for the llama.cpp example:

examples/llamacpp.png

Architecture diagram for the SGLang example:

examples/sglang.png

Architecture diagram for the Saxml example:

examples/saxml.png

Architecture diagram for LeaderWorkerSet operator: lws.png