Kafka partition metricset

edit

This functionality is in beta and is subject to change. The design and code is less mature than official GA features and is being provided as-is with no warranties. Beta features are not subject to the support SLA of official GA features.

This is the partition metricset of the Kafka module.

Configuration

edit

As the partition metricset fetches the data from the complete Kafka cluster, only one connection host has to be defined. Currently if multiple hosts are defined, the data is fetched multiple times. Support for multiple initial connections host is planned to be added in future releases.

Metricset

edit

The current implementation of the partition metricset fetches the data for all leader partitions. Data for the replicas is not available yet.

Fields

edit

For a description of each field in the metricset, see the exported fields section.

Here is an example document generated by this metricset:

{
    "@timestamp": "2016-05-23T08:05:34.853Z",
    "beat": {
        "hostname": "host.example.com",
        "name": "host.example.com"
    },
    "kafka": {
        "partition": {
            "broker": {
                "address": "kafka:9092",
                "id": 0
            },
            "offset": {
                "newest": 11,
                "oldest": 0
            },
            "partition": {
                "id": 0,
                "insync_replica": true,
                "leader": 0,
                "replica": 0
            },
            "topic": {
                "name": "test-metricbeat-70692474374989458"
            }
        }
    },
    "metricset": {
        "host": "kafka:9092",
        "module": "kafka",
        "name": "partition",
        "rtt": 115
    },
    "type": "metricsets"
}