Overview:

Centralized logging allows you to collect and analyze logs from all cluster components.

Fluentd:

1. What is Fluentd?

   • An open-source log processor that aggregates logs from various sources.

2. Deploy Fluentd:

   • Example DaemonSet for Fluentd:

     apiVersion: apps/v1
     kind: DaemonSet
     metadata:
       name: fluentd
       namespace: kube-system
     spec:
       selector:
         matchLabels:
           name: fluentd
       template:
         metadata:
           labels:
             name: fluentd
         spec:
           containers:
           - name: fluentd
             image: fluent/fluentd:v1.14.2
             env:
             - name: FLUENT_ELASTICSEARCH_HOST
               value: "elasticsearch"
             - name: FLUENT_ELASTICSEARCH_PORT
               value: "9200"

   • Apply the DaemonSet:

     kubectl apply -f fluentd-daemonset.yaml

Elasticsearch:

1. What is Elasticsearch?

   • A distributed search and analytics engine.

2. Deploy Elasticsearch:

   • Use Helm to install Elasticsearch:

     helm repo add elastic https://helm.elastic.co
     helm install elasticsearch elastic/elasticsearch

Activity:

Deploy Fluentd and Elasticsearch to your cluster. Generate logs and visualize them in Elasticsearch.