Add Fluentd > cloudwatch log forwarder (#952)

* fluentd cloudwatch incubator * rename deployment -> daemonset * annotations as value * reorder values * use helm namespace * address code review * move td-agent.conf into values.yaml * Updated fluentd-cloudwatch code from PR 211 The configuration is now inside the container (from PR comment: https://github.com/kubernetes/charts/pull/211#issuecomment-286643280), I then removed the configMap holding the config. The AWS keys are added as secrets from files, using Files.Glob (from PR comment https://github.com/kubernetes/charts/pull/211#issuecomment-286662756) * Add configMap for fluentd config Copied the config from what's in /fluentd/etc in image: fluent/fluentd-kubernetes-daemonset:v0.12-cloudwatch * Update to use namespaces * Add appVersion * Add fluentd icon * Using github usernames instead of real names * Update label for configmap
2026-08-23 22:37:45 +00:00 · 2017-10-12 21:24:11 +02:00
parent db6f07443b
commit 1b086f941f
10 changed files with 356 additions and 0 deletions
@@ -0,0 +1,20 @@
+name: fluentd-cloudwatch
+version: 0.1.1
+appVersion: 0.1.1
+description: A Fluentd CloudWatch Helm chart for Kubernetes.
+icon: https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_square.png
+keywords:
+- fluentd
+- cloudwatch
+- logging
+sources:
+- https://github.com/kubernetes/charts
+- https://github.com/fluent/fluentd-kubernetes-daemonset
+maintainers:
+- name: jmcarp
+  email: jm.carp@gmail.com
+- name: icereval
+  email: michael.haselton@gmail.com
+- name: kenden
+  email: quentin.nerden@stylight.com
+engine: gotpl
@@ -0,0 +1,71 @@
+# Fluentd CloudWatch
+
+* Installs [Fluentd](https://www.fluentd.org/) [Cloudwatch](https://aws.amazon.com/cloudwatch/) log forwarder.
+
+## TL;DR;
+
+```console
+$ helm install incubator/fluentd-cloudwatch
+```
+
+## Introduction
+
+This chart bootstraps a [Fluentd](https://www.fluentd.org/) [Cloudwatch](https://aws.amazon.com/cloudwatch/) deployment on a [Kubernetes](http://kubernetes.io) cluster using the [Helm](https://helm.sh) package manager.
+
+## Prerequisites
+
+- Kubernetes 1.4+ with Beta APIs enabled
+
+## Installing the Chart
+
+To install the chart with the release name `my-release`:
+
+```console
+$ # edit secrets/aws_access_key_id and secrets/aws_access_key_id with the key/password of a AWS user with a policy to access  Cloudwatch
+$ helm install --name my-release incubator/fluentd-cloudwatch
+```
+
+The command deploys Fluentd Cloudwatch on the Kubernetes cluster in the default configuration. The [configuration](#configuration) section lists the parameters that can be configured during installation.
+
+## Uninstalling the Chart
+
+To uninstall/delete the `my-release` deployment:
+
+```console
+$ helm delete my-release
+```
+
+The command removes all the Kubernetes components associated with the chart and deletes the release.
+
+## Configuration
+
+The following tables lists the configurable parameters of the Fluentd Cloudwatch chart and their default values.
+
+| Parameter                       | Description                                | Default                                                    |
+| ------------------------------- | ------------------------------------------ | ---------------------------------------------------------- |
+| `image`                         | Image                                      | `fluent/fluentd-kubernetes-daemonset`                      |
+| `imageTag`                      | Image tag                                  | `v0.12.33-cloudwatch`                                      |
+| `imagePullPolicy`               | Image pull policy                          | `Always` if `imageTag` is `imagePullPolicy`                |
+| `resources.limits.cpu`          | CPU limit                                  | `100m`                                                     |
+| `resources.limits.memory`       | Memory limit                               | `200Mi`                                                    |
+| `resources.requests.cpu`        | CPU request                                | `100m`                                                     |
+| `resources.requests.memory`     | Memory request                             | `200Mi`                                                    |
+| `hostNetwork`                   | Host network                               | `false`                                                    |
+| `annotations` (removed for now) | Annotations                                | `nil`                                                      |
+| `awsRegion`                     | AWS Cloudwatch region                      | `us-east-1`                                                |
+| `fluentdConfig`                 | Fluentd configuration                      | `example configuration`                                    |
+| `logGroupName`                  | AWS Cloudwatch log group                   | `kubernetes`                                               |
+
+Specify each parameter using the `--set key=value[,key=value]` argument to `helm install`. For example,
+
+```console
+$ helm install --name my-release \
+  --set awsRegion=us-east-1 \
+    incubator/fluentd-cloudwatch
+```
+
+Alternatively, a YAML file that specifies the values for the above parameters can be provided while installing the chart. For example,
+
+```console
+$ helm install --name my-release -f values.yaml stable/fluentd-cloudwatch
+```
@@ -0,0 +1 @@
+<AWS_ACCESS_KEY_ID>
@@ -0,0 +1 @@
+<AWS_SECRET_ACCESS_KEY>
@@ -0,0 +1,6 @@
+To verify that Fluentd Cloudwatch has started, run:
+
+  kubectl --namespace={{ .Release.Namespace }} get pods -l "app={{ template "fluentd-cloudwatch.name" . }},release={{ .Release.Name }}"
+
+THIS APPLICATION CAPTURES ALL CONSOLE OUTPUT AND FORWARDS IT TO AWS CLOUDWATCH. Anything that might be identifying,
+including things like IP addresses, container images, and object names will NOT be anonymized.
@@ -0,0 +1,16 @@
+{{/* vim: set filetype=mustache: */}}
+{{/*
+Expand the name of the chart.
+*/}}
+{{- define "fluentd-cloudwatch.name" -}}
+{{- default .Chart.Name .Values.nameOverride | trunc 24 -}}
+{{- end -}}
+
+{{/*
+Create a default fully qualified app name.
+We truncate at 24 chars because some Kubernetes name fields are limited to this (by the DNS naming spec).
+*/}}
+{{- define "fluentd-cloudwatch.fullname" -}}
+{{- $name := default .Chart.Name .Values.nameOverride -}}
+{{- printf "%s-%s" .Release.Name $name | trunc 24 -}}
+{{- end -}}
@@ -0,0 +1,11 @@
+apiVersion: v1
+kind: ConfigMap
+metadata:
+  name: {{ template "fluentd-cloudwatch.fullname" . }}
+  labels:
+    app: {{ template "fluentd-cloudwatch.name" . }}
+    chart: "{{ .Chart.Name }}-{{ .Chart.Version }}"
+    heritage: {{ .Release.Service | quote }}
+    release: {{ .Release.Name | quote }}
+data:
+  fluent.conf: {{ toYaml .Values.fluentdConfig | indent 2 }}
@@ -0,0 +1,61 @@
+apiVersion: extensions/v1beta1
+kind: DaemonSet
+metadata:
+  name: {{ template "fluentd-cloudwatch.fullname" . }}
+  labels:
+    app: {{ template "fluentd-cloudwatch.name" . }}
+    chart: "{{ .Chart.Name }}-{{ .Chart.Version }}"
+    heritage: "{{ .Release.Service }}"
+    release: "{{ .Release.Name }}"
+spec:
+  template:
+    metadata:
+      labels:
+        app: {{ template "fluentd-cloudwatch.name" . }}
+        release: "{{ .Release.Name }}"
+      annotations:
+{{ toYaml .Values.annotations | indent 8 }}
+    spec:
+      containers:
+      - name: {{ template "fluentd-cloudwatch.fullname" . }}
+        image: "{{ .Values.image }}:{{ .Values.imageTag }}"
+        imagePullPolicy: {{ .Values.imagePullPolicy | quote }}
+        #hostNetwork: {{ default false .Values.hostNetwork }}
+        env:
+        - name: AWS_REGION
+          value: {{ .Values.awsRegion }}
+        - name: LOG_GROUP_NAME
+          value: {{ .Values.logGroupName }}
+
+        - name: AWS_ACCESS_KEY_ID
+          valueFrom:
+            secretKeyRef:
+              key: aws_access_key_id
+              name: {{ template "fluentd-cloudwatch.fullname" . }}
+        - name: AWS_SECRET_ACCESS_KEY
+          valueFrom:
+            secretKeyRef:
+              key: aws_secret_access_key
+              name: {{ template "fluentd-cloudwatch.fullname" . }}
+
+        resources:
+{{ toYaml .Values.resources | indent 10 }}
+        volumeMounts:
+        - name: varlog
+          mountPath: /var/log
+        - name: varlibdockercontainers
+          mountPath: /var/lib/docker/containers
+          readOnly: true
+        - name: config-volume
+          mountPath: /fluentd/etc
+      terminationGracePeriodSeconds: 30
+      volumes:
+      - name: varlog
+        hostPath:
+          path: /var/log
+      - name: varlibdockercontainers
+        hostPath:
+          path: /var/lib/docker/containers
+      - name: config-volume
+        configMap:
+          name: {{ template "fluentd-cloudwatch.fullname" . }}
@@ -0,0 +1,12 @@
+apiVersion: v1
+kind: Secret
+metadata:
+  name: {{ template "fluentd-cloudwatch.fullname" . }}
+  labels:
+    app: {{ template "fluentd-cloudwatch.name" . }}
+    chart: {{ .Chart.Name }}-{{ .Chart.Version }}
+    heritage: {{ .Release.Service }}
+    release: {{ .Release.Name }}
+type: Opaque
+data:
+{{ (.Files.Glob "secrets/*").AsSecrets | indent 2 }}
@@ -0,0 +1,157 @@
+image: fluent/fluentd-kubernetes-daemonset
+imageTag: v0.12.33-cloudwatch
+
+## Specify an imagePullPolicy (Required)
+## It's recommended to change this to 'Always' if the image tag is 'latest'
+## ref: http://kubernetes.io/docs/user-guide/images/#updating-images
+imagePullPolicy: IfNotPresent
+
+
+## Configure resource requests and limits
+## ref: http://kubernetes.io/docs/user-guide/compute-resources/
+##
+resources:
+  limits:
+    cpu: 100m
+    memory: 200Mi
+  requests:
+    cpu: 100m
+    memory: 200Mi
+
+#hostNetwork: false
+
+annotations: {}
+
+awsRegion: us-east-1
+logGroupName: kubernetes
+
+fluentdConfig: |
+  <match fluent.**>
+    type null
+  </match>
+
+  <source>
+    type tail
+    path /var/log/containers/*.log
+    pos_file /var/log/fluentd-containers.log.pos
+    time_format %Y-%m-%dT%H:%M:%S.%NZ
+    tag kubernetes.*
+    format json
+    read_from_head true
+  </source>
+
+  <source>
+    type tail
+    format /^(?<time>[^ ]* [^ ,]*)[^\[]*\[[^\]]*\]\[(?<severity>[^ \]]*) *\] (?<message>.*)$/
+    time_format %Y-%m-%d %H:%M:%S
+    path /var/log/salt/minion
+    pos_file /var/log/fluentd-salt.pos
+    tag salt
+  </source>
+
+  <source>
+    type tail
+    format syslog
+    path /var/log/startupscript.log
+    pos_file /var/log/fluentd-startupscript.log.pos
+    tag startupscript
+  </source>
+
+  <source>
+    type tail
+    format /^time="(?<time>[^)]*)" level=(?<severity>[^ ]*) msg="(?<message>[^"]*)"( err="(?<error>[^"]*)")?( statusCode=($<status_code>\d+))?/
+    path /var/log/docker.log
+    pos_file /var/log/fluentd-docker.log.pos
+    tag docker
+  </source>
+
+  <source>
+    type tail
+    format none
+    path /var/log/etcd.log
+    pos_file /var/log/fluentd-etcd.log.pos
+    tag etcd
+  </source>
+
+  <source>
+    type tail
+    format kubernetes
+    multiline_flush_interval 5s
+    path /var/log/kubelet.log
+    pos_file /var/log/fluentd-kubelet.log.pos
+    tag kubelet
+  </source>
+
+  <source>
+    type tail
+    format kubernetes
+    multiline_flush_interval 5s
+    path /var/log/kube-proxy.log
+    pos_file /var/log/fluentd-kube-proxy.log.pos
+    tag kube-proxy
+  </source>
+
+  <source>
+    type tail
+    format kubernetes
+    multiline_flush_interval 5s
+    path /var/log/kube-apiserver.log
+    pos_file /var/log/fluentd-kube-apiserver.log.pos
+    tag kube-apiserver
+  </source>
+
+  <source>
+    type tail
+    format kubernetes
+    multiline_flush_interval 5s
+    path /var/log/kube-controller-manager.log
+    pos_file /var/log/fluentd-kube-controller-manager.log.pos
+    tag kube-controller-manager
+  </source>
+
+  <source>
+    type tail
+    format kubernetes
+    multiline_flush_interval 5s
+    path /var/log/kube-scheduler.log
+    pos_file /var/log/fluentd-kube-scheduler.log.pos
+    tag kube-scheduler
+  </source>
+
+  <source>
+    type tail
+    format kubernetes
+    multiline_flush_interval 5s
+    path /var/log/rescheduler.log
+    pos_file /var/log/fluentd-rescheduler.log.pos
+    tag rescheduler
+  </source>
+
+  <source>
+    type tail
+    format kubernetes
+    multiline_flush_interval 5s
+    path /var/log/glbc.log
+    pos_file /var/log/fluentd-glbc.log.pos
+    tag glbc
+  </source>
+
+  <source>
+    type tail
+    format kubernetes
+    multiline_flush_interval 5s
+    path /var/log/cluster-autoscaler.log
+    pos_file /var/log/fluentd-cluster-autoscaler.log.pos
+    tag cluster-autoscaler
+  </source>
+
+  <filter kubernetes.**>
+    type kubernetes_metadata
+  </filter>
+
+  <match **>
+    type cloudwatch_logs
+    log_group_name "#{ENV['LOG_GROUP_NAME']}"
+    auto_create_stream true
+    use_tag_as_stream true
+  </match>