Full disk on multiple-nodes deployment

edit

Health check

  1. Log in to the Elasticsearch Add-On for Heroku console.
  2. From the Elasticsearch Service panel, click the Quick link icon corresponding to the deployment that you want to manage.

    Quick link to the deployment page
  3. On your deployment page, scroll down to Instances and check if the disk allocation for any of your Elasticsearch instances is over 90%.

    Full disk on multiple-nodes deployment

Possible cause

  • The available storage is insufficient for the amount of ingested data.

Resolution

If your Elasticsearch cluster is unhealthy and reports a status of red, the scale up configuration change to increasing disk size on the affected data tiers may fail. You might need to delete some data so the configuration can be edited. If you want to increase your disk size without deleting data, then reach out to Elastic support and we will assist you with scaling up.

Preventions

  • Increase the disk size (scale up).

    1. On your deployment page, scroll down to Instances and identify the node attribute of the instances that are running out of disk space.

      Instance node attribute
    2. Use the node types identified at step 1 to find out the corresponding data tier.

      Node type and corresponding attribute
    3. From your deployment menu, go to the Edit page and increase the Size per zone for the data tiers identified at step 2.

      Increase size per zone
  • Enable autoscaling to grow your cluster automatically when it runs out of space.
  • Configure (ILM) policies to automatically delete unused data.
  • Enable data tiers to move older data that you don’t query often to more cost-effective storage.