AWS rds metricset

edit

The rds metricset of aws module allows you to monitor your AWS RDS service. rds metricset fetches a set of metrics from Amazon RDS and Amazon Aurora DB. with Amazon RDS, users can monitor network throughput, I/O for read, write, and/or metadata operations, client connections, and burst credit balances for their DB instances. Amazon RDS sends metrics and dimensions to Amazon CloudWatch every minute. Amazon Aurora provides a variety of Amazon CloudWatch metrics that users can use to monitor health and performance of their Aurora DB cluster. This metricset by default collects all tags from AWS RDS.

AWS Permissions

edit

Some specific AWS permissions are required for IAM user to collect AWS RDS metrics.

cloudwatch:GetMetricData
ec2:DescribeRegions
rds:DescribeDBInstances
rds:ListTagsForResource
sts:GetCallerIdentity
iam:ListAccountAliases

Dashboard

edit

The aws rds metricset comes with a predefined dashboard.

metricbeat aws rds overview

Configuration example

edit
- module: aws
  period: 60s
  metricsets:
    - rds
  access_key_id: '<access_key_id>'
  secret_access_key: '<secret_access_key>'
  session_token: '<session_token>'

This is a default metricset. If the host module is unconfigured, this metricset is enabled by default.

Fields

edit

For a description of each field in the metricset, see the exported fields section.

Here is an example document generated by this metricset:

{
    "@timestamp": "2017-10-12T08:05:34.853Z",
    "aws": {
        "cloudwatch": {
            "namespace": "AWS/RDS"
        },
        "dimensions": {
            "DBClusterIdentifier": "database-1",
            "Role": "WRITER"
        },
        "rds": {
            "aurora_bin_log_replica_lag": 0,
            "aurora_replica": {
                "lag_max": {
                    "ms": 13.449000358581543
                },
                "lag_min": {
                    "ms": 13.449000358581543
                }
            },
            "aurora_volume_left_total": {
                "bytes": 70007366615040
            },
            "cache_hit_ratio": {
                "buffer": 100,
                "result_set": 0
            },
            "cpu": {
                "total": {
                    "pct": 6.975116251937533
                }
            },
            "database_connections": 0,
            "deadlocks": 0,
            "engine_uptime": {
                "sec": 20413803
            },
            "free_local_storage": {
                "bytes": 25608523776
            },
            "freeable_memory": {
                "bytes": 4695093248
            },
            "latency": {
                "commit": 5.198533333333333,
                "ddl": 0,
                "delete": 0,
                "dml": 0.19726666666666667,
                "insert": 0.19726666666666667,
                "read": 0,
                "select": 0.21317204301075268,
                "update": 0,
                "write": 0.0013534145331858408
            },
            "login_failures": 0,
            "queries": 8.830095631601747,
            "throughput": {
                "commit": 0.49980840677740196,
                "ddl": 0,
                "delete": 0,
                "dml": 0.49980840677740196,
                "insert": 0.49980840677740196,
                "network": 1.3998600139986002,
                "network_receive": 0.6999300069993001,
                "network_transmit": 0.6999300069993001,
                "select": 3.098812122019892,
                "update": 0
            },
            "transactions": {
                "active": 0,
                "blocked": 0
            }
        },
        "tags": {
            "cluster": "database-1",
            "created-by": "ks",
            "dept": "eng"
        }
    },
    "cloud": {
        "account": {
            "id": "428152502467",
            "name": "elastic-beats"
        },
        "provider": "aws",
        "region": "us-east-1"
    },
    "event": {
        "dataset": "aws.rds",
        "duration": 115000,
        "module": "aws"
    },
    "metricset": {
        "name": "rds",
        "period": 10000
    },
    "service": {
        "type": "aws"
    }
}