Elasticsearch version 8.6.0
editElasticsearch version 8.6.0
editAlso see Breaking changes in 8.6.
Known issues
edit-
Orchestrators which use a
settings.json
file to configure Elasticsearch may encounter deadlocks during master elections (issue: #92812)To resolve the deadlock, remove the
settings.json
file and restart the affected node. -
Parsing a request when the last element in an array is filtered out
(for instance using
_source_includes
) fails. This is due to a bug in Jackson parser. Fixed in Elasticsearch 8.6.1 (#91456)
-
Shard rebalancing may temporarily unbalance cluster
From 8.6.0 onwards the default shard rebalancing algorithm will compute the final desired balance and then make shard movements to reconcile the current state of the cluster with the desired state. However the order in which the shard movements take place may be skewed towards certain nodes, causing the cluster to become temporarily unbalanced while the reconciliation is ongoing. As always, once a node reaches a disk watermark it will not accept any additional shards, but this skew may result in nodes reaching their disk watermarks more often than expected in normal operation. Once the reconciliation process completes, the cluster will be balanced again.
To avoid this problem, upgrade to 8.8.0 or later.
Bug fixes
edit- Aggregations
- Allocation
- Authentication
- Authorization
- Cluster Coordination
- EQL
-
- EQL sequences: support join on multi-values #89965
- Graph
-
- Fix potential issue with graph api’s timed out field in response #91006
- Health
- Indices APIs
- Infra/Core
-
- Check reserved state in Metadata.isGlobalStateEquals #92124
- Datastream unavailable exception metadata #91461
-
Fix
BytesRefArray
on append emptyBytesRef
#91364 - Fix index expression options for requests with a single name or pattern #91231
- Force init of Unbox in log4j #92377 (issue: #91964)
- In file based settings, wait until security index is ready for role mappings #92173 (issue: #91939)
- Index expression exclusions never trigger "not found" #90902
- Update error states from inside the main state executor #90346 (issue: #90337)
- Infra/Scripting
- Ingest Node
- Machine Learning
-
- Copy more settings when creating DF analytics destination index #91546 (issue: #89795)
- Fix for No statistics error message #2410
- Fix for No counts available error message #2414
- Guard against input sequences that are too long for Question Answering models #91924
- Improve performance of closing files before spawning #2424
- Skip remote clusters when performing up front privileges validation for datafeeds #91895 (issue: #87832)
-
Support fields with commas in data frame analytics
analyzed_fields
#91710 (issue: #72541) - Validate rule filters are present on open anomaly detection api #92207
- Mapping
- Monitoring
- Network
- SQL
-
- Fix NPE on logging when not tracking total hits #92425
- Search
- Snapshot/Restore
- Store
- Transform
-
- Skip remote clusters when performing up front privileges validation #91788
- Vector Search
-
-
Make
knn
search requests fully cancellable #90612
-
Make
Deprecations
edit- Allocation
- Ingest Node
-
- Deprecate remove_binary default of false for ingest attachment processor #90460
- Mapping
Enhancements
edit- Allocation
-
- Clear up forecasted write load and shard size from previous write index during rollovers #91590
- Forecast average shard size during rollovers #91561
- Forecast write load during rollovers #91425
- Improve shard balancing #91603
- Introduce desired-balance allocator #91343
- Limit shard realocation retries #90296
- Prevalidate node removal API #88952
-
Set default
cluster.routing.allocation.balance.disk_usage
#91951 -
Store write load in the
IndexMetadata
during data streams rollovers #91019 -
Update the default
cluster.routing.allocation.balance.disk_usage
#92065 -
DesiredBalance:
expose it via _internal/desired_balance #91038 (issue: #90583)
- Authorization
-
-
[Fleet] Added logs-elastic_agent* read privileges to
kibana_system
#91701
-
[Fleet] Added logs-elastic_agent* read privileges to
- CRUD
- Geo
-
- Centroid aggregation for cartesian points and shapes #89216 (issue: #90156)
- Improve H3#hexRing logic and add H3#areNeighborCells method #91140
- Move SpatialUtils to geo library #88088 (issue: #86607)
- Reduce number of object allocations in H3#geoToH3 and speed up computations #91492
-
Support
cartesian_bounds
aggregation on point and shape #91298 (issue: #90157)
- ILM+SLM
-
- ILM: Get policy support wildcard name #89238
- Infra/Core
-
- Handle APM global labels as affix setting #91438 (issue: #91278)
- Improve date math exclusions in expressions #90298
- Introduce a phase to use String.equals on constant strings, rather than def equality #91362 (issue: #91235)
- More actionable error for ancient indices #91243
- Operator/index templates #90143
- Operator/ingest #89735
-
Transport threads and
_hot_threads
#90482 (issue: #90334) - Upgrade XContent to Jackson 2.14.0 and enable Fast Double Parser #90553
- Infra/Plugins
- Infra/Scripting
- Machine Learning
-
- Add a filter parameter to frequent items #91137
-
Add a regex to the output of the
categorize_text
aggregation #90723 -
Add ability to filter and sort buckets by
change_point
numeric values #91299 -
Add api to update trained model deployment
number_of_allocations
#90728 - Alias timestamp to @timestamp in anomaly detection results index #90812
-
Allow
model_aliases
to be used with Pytorch trained models #91296 - Allow overriding timestamp field to null in file structure finder #90764
- Audit a message every day the datafeed has seen no data #91774
- Low priority trained model deployments #91234 (issue: #91024)
- Provide additional information about anomaly score factors #90675
- Mapping
- Recovery
- Rollup
-
- Test downsample runtime fields and security #90593
- Search
-
- Add LimitedOffsetsEnum to Limited offset token #86110 (issue: #86109)
- Add profiling and documentation for dfs phase #90536 (issue: #89713)
- Bulk merge field-caps responses using mapping hash #86323
- Enhance nested depth tracking when parsing queries #90425
- Expose telemetry about search usage #91528
- Return docs when using nested mappings in archive indices #90585 (issue: #90523)
-
Use
IndexOrDocValues
query for IP range queries #90303 (issue: #83658)
- Snapshot/Restore
- Store
-
-
Allow plugins to wrap Lucene directories created by the
IndexModule
#91556
-
Allow plugins to wrap Lucene directories created by the
- TLS
-
- Add certificate start/expiry dates to SSL Diagnostic message #89461
- TSDB
-
- Generate index.routing_path from dynamic mapping templates #90552 (issue: #90528)
-
Support malformed numbers in synthetic
_source
#90428 -
Support synthetic
_source
for_doc_count
field #91465 -
Synthetic _source: support
field
in many cases #89950 -
Synthetic
_source
:ignore_malformed
forip
#90038 -
Synthetic
_source
: supportwildcard
field #90196
- Transform
- Vector Search
-
- Add profiling information for knn vector queries #90200
New features
editRegressions
edit- Infra/Core
-
-
Revert "Remove
ImmutableOpenMap
from snapshot services" #90287
-
Revert "Remove