IMPORTANT: No additional bug fixes or documentation updates will be released for this version. For the latest information, see the current release documentation.
« Installing the Elastic Stack Highlights »
Elastic Docs ›Installation and Upgrade Guide [7.16]

Upgrading the Elastic Stack

edit

Upgrading the Elastic Stack

edit

When upgrading to a new version of Elasticsearch, you need to upgrade each of the products in your Elastic Stack. Beats and Logstash 6.7 are compatible with Elasticsearch 7.16.3 to give you flexibility in scheduling the upgrade.

Elasticsearch supports rolling upgrades between minor versions, from Elasticsearch 5.6 to 6.8, and from 6.8 to 7.16.3.

5.x indices are not compatible with 7.16.3. You must remove or reindex them to upgrade to 7.16.3. The default Beats and Logstash mapping templates also need to be updated to work with 7.16.3.

Preparing to upgrade

edit

Before upgrading the Elastic Stack to 7.16.3:

  1. Check the Elasticsearch deprecation log to see if you’re using any deprecated features and update your code accordingly. By default, deprecation warnings are logged when the log level is set to WARN.
  2. Review the Breaking changes and upgrade your code to work with 7.16.3.
  3. Upgrade to 6.8 and use the Kibana Upgrade Assistant to reindex any indices that are not compatible with 7.16.3.
  4. Use the Upgrade Assistant to identify any changes you need to make to your cluster configuration.

Upgrade process

edit

When you’ve made the necessary changes and are ready to upgrade from 6.8 to 7.16.3:

  1. Test the upgrade in a dev environment before upgrading your production cluster.
  2. Back up your data. You cannot roll back to an earlier version unless you have a snapshot of your data. For information about creating snapshots, see Snapshot and restore.
  3. Consider closing machine learning jobs before you start the upgrade process. While machine learning jobs can continue to run during a rolling upgrade, it increases the overhead on the cluster during the upgrade process. For more information, see Rolling upgrades.

  4. Upgrade the components of your Elastic Stack in the following order:

    1. Elasticsearch Hadoop: install instructions
    2. Elasticsearch: upgrade instructions
    3. Kibana: upgrade instructions
    4. Java API Client: dependency configuration
    5. Logstash: upgrade instructions
    6. Beats: upgrade instructions
    7. APM: upgrade instructions
    8. Elastic Agent: upgrade instructions

If using Elastic Agent in 7.12 or lower, your Elastic Agents will automatically be unenrolled from Fleet and will stop sending data when you upgrade to 7.13. You will need to uninstall your previous Elastic Agents before installing and enrolling Elastic Agents with Fleet Server. To learn more, see Upgrade Elastic Agent.

Logstash 6.8 and Beats 6.8 are compatible with all 7.x versions of Elasticsearch. This provides flexibility in when you schedule the upgrades for your Logstash instances and Beats agents, but we recommend upgrading as soon as possible to take advantage of performance improvements and other enhancements.

The Java High Level REST Client can communicate with any Elasticsearch node running the same major version and greater or equal minor version. When you upgrade to the next major version, the client should be updated after all of the nodes in the cluster have been updated.

Upgrading from 6.6 or earlier

edit

To upgrade directly to Elasticsearch 7.16.3 from versions 6.0-6.6, you must manually reindex any 5.x indices you need to carry forward, and perform a full cluster restart. This includes any internal indices created in 5.x, such as the .kibana and .security* indices.

Make sure all 5.x indices have been deleted before upgrading to 7.16.3. Elasticsearch 7.16.3 will fail to start if any 5.x indices are present.

If you are running a version prior to 6.0, upgrade to 6.8 and reindex your old indices or bring up a new 7.16.3 cluster and reindex from remote.

The recommended path is to upgrade to 6.8 before upgrading to 7.16.3. This makes it easier to identify the changes you need to make to upgrade and enables you to perform a rolling upgrade with no downtime.

Upgrading on Elastic Cloud

edit

A single click in the Elastic Cloud console can upgrade a cluster to a newer version, add more processing capacity, change plugins, and enable or disable high availability, all at the same time. During the upgrade process, Elasticsearch, Kibana, X-Pack and the officially included plugins are upgraded simultaneously.

Although upgrading your Elastic Cloud clusters is easy, you still need to address breaking changes that affect your application. Minor version upgrades, upgrades from 6.8 to 7.16.3, and all other cluster configuration changes can be performed with no downtime.

To avoid downtime when a full cluster restart is required:

  1. Provision an additional cluster with the new Elasticsearch version, reindex your data, and send index requests to both clusters temporarily.
  2. Verify that the new cluster performs as expected, fix any problems, and then permanently swap in the new cluster.
  3. Delete the old cluster to stop incurring additional costs. You are billed only for the time that the new cluster runs in parallel with your old cluster. Usage is billed on an hourly basis.

To learn more about the upgrade process on Elastic Cloud, see Upgrade versions.

Elastic Cloud only supports upgrades to released versions. Preview releases and master snapshots are not supported.

« Installing the Elastic Stack Highlights »