container.training/slides/k8s/setup-selfhosted.md

Kubernetes distributions and installers

• Sometimes, we need to run Kubernetes ourselves

  (as opposed to "use a managed offering")

• Beware: it takes a lot of work to set up and maintain Kubernetes

• It might be necessary if you have specific security or compliance requirements

  (e.g. national security for states that don't have a suitable domestic cloud)

• There are countless distributions available

• We can't review them all

• We're just going to explore a few options

---

kops

• Deploys Kubernetes using cloud infrastructure

  (supports AWS, GCE, Digital Ocean ...)

• Leverages special cloud features when possible

  (e.g. Auto Scaling Groups ...)

---

kubeadm

• Provisions Kubernetes nodes on top of existing machines

• kubeadm init to provision a single-node control plane

• kubeadm join to join a node to the cluster

• Supports HA control plane with some extra steps

---

kubespray

• Based on Ansible

• Works on bare metal and cloud infrastructure

  (good for hybrid deployments)

• The expert says: ultra flexible; slow; complex

---

RKE (Rancher Kubernetes Engine)

• Opinionated installer with low requirements

• Requires a set of machines with Docker + SSH access

• Supports highly available etcd and control plane

• The expert says: fast; maintenance can be tricky

---

Terraform + kubeadm

• Sometimes it is necessary to build a custom solution

• Example use case:

  • deploying Kubernetes on OpenStack

  • ... with highly available control plane

  • ... and Cloud Controller Manager integration

• Solution: Terraform + kubeadm (kubeadm driven by remote-exec)

  • GitHub repository

  • Blog post (in French)

---

And many more ...

• AKS Engine

• Docker Enterprise Edition

• Lokomotive, leveraging Terraform and Flatcar Linux

• Pivotal Container Service (PKS)

• Tarmak, leveraging Puppet and Terraform

• Tectonic by CoreOS (now being integrated into Red Hat OpenShift)

• Typhoon, leveraging Terraform

• VMware Tanzu Kubernetes Grid (TKG)

---

Bottom line

• Each distribution / installer has pros and cons

• Before picking one, we should sort out our priorities:

  • cloud, on-premises, hybrid?

  • integration with existing network/storage architecture or equipment?

  • are we storing very sensitive data, like finance, health, military?

  • how many clusters are we deploying (and maintaining): 2, 10, 50?

  • which team will be responsible for deployment and maintenance?
    (do they need training?)

  • etc.

???

:EN:- Kubernetes distributions and installers :FR:- L'offre Kubernetes "on premises"