Stack Monitoring
editStack Monitoring
editYou can enable Stack Monitoring on Elasticsearch, Kibana, Beats and Logstash to collect and ship their metrics and logs to a dedicated monitoring cluster.
To enable Stack Monitoring, simply reference the monitoring Elasticsearch cluster in the spec.monitoring
section of their specification.
apiVersion: elasticsearch.k8s.elastic.co/v1 kind: Elasticsearch metadata: name: monitored-sample namespace: production spec: version: 8.15.3 monitoring: metrics: elasticsearchRefs: - name: monitoring namespace: observability logs: elasticsearchRefs: - name: monitoring namespace: observability nodeSets: - name: default count: 1 config: node.store.allow_mmap: false --- apiVersion: kibana.k8s.elastic.co/v1 kind: Kibana metadata: name: monitored-sample namespace: production spec: version: 8.15.3 elasticsearchRef: name: monitored-sample namespace: production monitoring: metrics: elasticsearchRefs: - name: monitoring namespace: observability logs: elasticsearchRefs: - name: monitoring namespace: observability count: 1 --- apiVersion: beat.k8s.elastic.co/v1beta1 kind: Beat metadata: name: monitored-sample spec: type: filebeat version: 8.15.3 monitoring: metrics: elasticsearchRefs: - name: monitoring namespace: observability logs: elasticsearchRefs: - name: monitoring namespace: observability --- apiVersion: logstash.k8s.elastic.co/v1alpha1 kind: Logstash metadata: name: monitored-sample spec: version: 8.15.3 monitoring: metrics: elasticsearchRefs: - name: monitoring namespace: observability logs: elasticsearchRefs: - name: monitoring namespace: observability
The use of |
You can configure an Elasticsearch cluster to monitor itself.
If Stack Monitoring is configured for a Beat, but the corresponding Elasticsearch cluster is not monitored, the Kibana Stack Monitoring page will not show the Beats data.
If Logs Stack Monitoring is configured for a Beat, and custom container arguments (podTemplate.spec.containers[].args
) include -e
, which enables logging to stderr and disables log file output, this argument will be removed from the Pod to allow the Filebeat sidecar to consume the Beat’s log files.
Stack Monitoring for Logstash on ECK is only available for Logstash versions 8.7.0 and later.
The monitoring cluster must be managed by ECK in the same Kubernetes cluster as the monitored one.
You can send metrics and logs to two different Elasticsearch monitoring clusters.
You can also enable Stack Monitoring on Elasticsearch only or on Kibana only. In the latter case, Kibana will not be available on the Stack Monitoring Kibana page (check View monitoring data in Kibana).