Elasticsearch version 7.10.0
editElasticsearch version 7.10.0
editAlso see Breaking changes in 7.10.
Security updates
edit-
Elasticsearch versions before 7.10.0 and 6.8.14 have an information
disclosure issue when audit logging and the
emit_request_body
option are enabled. The Elasticsearch audit log could contain sensitive information, such as password hashes or authentication tokens. This could allow an Elasticsearch administrator to view these details. You must upgrade to Elasticsearch version 7.10.0 to obtain the fix. CVE-2020-7021
Known issues
edit-
SQL: If a
WHERE
clause contains at least two relational operators joined byAND
, of which one is a comparison (<=
,<
,>=
,>
) and another one is an inequality (!=
,<>
), both against literals or foldable expressions, the inequality will be ignored. The workaround is to substitute the inequality with aNOT IN
operator.We have fixed this issue in Elasticsearch 7.10.1 and later versions. For more details, see #65488.
-
There were several regressions around loading nested documents. These have been addressed in Elasticsearch 7.10.2.
-
Snapshot and restore: If an index is deleted while the cluster is concurrently taking more than one snapshot then there is a risk that one of the snapshots may never complete and also that some shard data may be lost from the repository, causing future restore operations to fail. To mitigate this problem, set
snapshot.max_concurrent_operations: 1
to prevent concurrent snapshot operations:PUT _cluster/settings { "persistent" : { "snapshot.max_concurrent_operations" : 1 } }
This issue is fixed in Elasticsearch versions 7.13.1 and later. It is not possible to repair a repository once it is affected by this issue, so you must restore the repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*
, or move to a fresh repository. For more details, see #73456. -
Parsing a request when the last element in an array is filtered out
(for instance using
_source_includes
) fails. This is due to a bug in Jackson parser. Fixed in Elasticsearch 8.6.1 (#91456) -
The deprecated
index.mapper.dynamic
setting can break your cluster. It can only be set using the Update index settings API. Symptoms include nodes failing to start or shards failing to allocate. Do not use this setting in versions prior to 7.17.22. The bug is fixed in 7.17.22. (issue: #109160)
Breaking changes
edit- Authentication
- Network
-
- Set specific keepalive options by default on supported platforms #59278
Breaking Java changes
edit- Machine Learning
- Mapping
Deprecations
edit- Cluster Coordination
- Machine learning
-
- Renames */inference* APIs to */trained_models* #63097
New features
edit- Aggregations
- Features/Features
- Features/ILM+SLM
- Machine Learning
- Mapping
- Search
Enhancements
edit- Aggregations
- Analysis
- Authentication
- Authorization
- CRUD
- Cluster Coordination
- Distributed
- Features/CAT APIs
- Features/Features
- Features/ILM+SLM
-
- Move internal index templates to composable templates #61457
- Features/Ingest
-
- Add network from MaxMind Geo ASN database #61676
- Allow_duplicates option for append processor #61916 (issue: #57543)
- Configurable output format for date processor #61324 (issue: #42523)
- Enhance the ingest node simulate verbose output #60433 (issue: #56004)
- Per processor description for verbose simulate #58207 (issue: #57906)
- Preserve grok pattern ordering and add sort option #61671 (issue: #40819)
- Features/Java High Level REST Client
- Infra/Core
- Infra/Logging
- Infra/Packaging
- Infra/Resiliency
- Infra/Scripting
- Machine Learning
-
- Add a "verbose" option to the data frame analytics stats endpoint #59589 (issue: #59125)
- Add new include flag to get trained models API for model training metadata #61922
- Add new feature_processors field for data frame analytics #60528 (issue: #59327)
- Add new n_gram_encoding custom processor #61578
- During nightly maintenance delete jobs whose original deletion tasks were lost #60121 (issue: #42840)
- Suspend persistence of trained model stats when ML upgrade mode is enabled #61143
- Calculate total feature importance to store with model metadata #1387
- Change outlier detection feature_influence format to array with nested objects #1475, #62068
- Add timeouts to named pipe connections #1514, #62993 (issue: #1504)
- Mapping
- Network
- Performance
-
- Speed up empty highlighting many fields #61860
- SQL
- Search
-
- Avoid reloading _source for every inner hit #60494 (issue: #32818)
- Cancel multisearch when http connection closed #61399
- Enable cancellation for msearch requests #61337
- Executes incremental reduce in the search thread pool #58461 (issues: #51857, #53411)
- Introduce point in time APIs in x-pack basic #61062 (issues: #26472, #46523)
- ParametrizedFieldMapper to run validators against default value #60042 (issue: #59332)
- Add case insensitive flag for "term" family of queries #61596 (issue: #61546)
- Add case insensitive support for regex queries #59441
- Tweak toXContent implementation of ParametrizedFieldMapper #59968
-
Implement fields value fetching for the
text
,search_as_you_type
andtoken_count
field types #63515 -
Make term/prefix/wildcard/regex query parsing more lenient, with respect to the
case_insensitive
flag #63926 (issue: #63893)
- Snapshot/Restore
- Store
- Transform
Bug fixes
edit- Aggregations
- Allocation
-
- Fix scheduling of ClusterInfoService#refresh #59880
- Authorization
- CRUD
- Cluster Coordination
-
- Reduce allocations when persisting cluster state #61159
- Distributed
- Engine
-
- Fix estimate size of translog operations #59206
- Features/ILM+SLM
- Features/Java Low Level REST Client
-
- Handle non-default port in Cloud-Id #61581
- Features/Stats
-
- Remove sporadic min/max usage estimates from stats #59755
- Features/Watcher
- Geo
- Infra/Core
- Infra/Packaging
- Machine Learning
-
- Adjusting inference processor to support foreach usage #60915 (issue: #60867)
- Get data frame analytics jobs stats API can return multiple responses if more than one error #60900 (issue: #60876)
- Do not mark the data frame analytics job as FAILED when a failure occurs after the node is shutdown #61331 (issue: #60596)
- Improve handling of exception while starting data frame analytics process #61838 (issue: #61704)
- Fix progress on resume after final training has completed for classification and regression. Previously, progress was shown stuck at zero for final training. #1443
- Avoid potential "Failed to compute quantile" and "No values added to quantile sketch" log errors training regression and classification models if there are features with mostly missing values #1500
-
Correct the anomaly detection job model state
min_version
#1546
- Mapping
- Network
- Search
-
- Allows nanosecond resolution in search_after #60328 (issue: #52424)
- Consolidate validation for docvalue_fields #59473
- Correct how field retrieval handles multifields and copy_to #61309 (issue: #61033)
- Apply boost only once for distance_feature query #63767
-
Fixed NullPointerException in
significant_text
aggregation when field does not exist #64144 (issue: #64045) - Fix async search to retry updates on version conflict #63652 (issue: #63213)
- Fix sorted query when date_nanos is used as the numeric_type #64183 (issue: #63719)
- Snapshot/Restore
-
- Avoid listener call under SparseFileTracker#mutex #61626 (issue: #61520)
- Ensure repo not in use for wildcard repo deletes #60947
- Fix Test Failure in testCorrectCountsForDoneShards #60254 (issue: #60247)
- Minimize cache file locking during prewarming #61837 (issue: #58658)
- Prevent snapshots to be mounted as system indices #61517 (issue: #60522)
- Make Searchable Snapshot’s CacheFile Lock less #63911 (issue: #63586)
- Don’t Generate an Index Setting History UUID unless it’s supported #64213 (issue: #64152)
- SQL