IMPORTANT: No additional bug fixes or documentation updates
will be released for this version. For the latest information, see the
current release documentation.
Elasticsearch version 8.4.0
editElasticsearch version 8.4.0
editAlso see Breaking changes in 8.4.
Known issues
edit-
Machine learning datafeeds cannot be listed if any are not modified since version 6.x
If you have a datafeed that was created in version 5.x or 6.x and has not been updated since 7.0, it is not possible to list datafeeds in 8.4 and 8.5. This means that anomaly detection jobs cannot be managed using Kibana. This issue is fixed in 8.6.0.
If you upgrade to 8.4 or 8.5 with such a datafeed, you need to work around the problem by updating each datafeed’s authorization information using these steps.
-
Orchestrators which use a
settings.json
file to configure Elasticsearch may encounter deadlocks during master elections (issue: #92812)To resolve the deadlock, remove the
settings.json
file and restart the affected node. -
Parsing a request when the last element in an array is filtered out
(for instance using
_source_includes
) fails. This is due to a bug in Jackson parser. Fixed in Elasticsearch 8.6.1 (#91456)
Bug fixes
edit- Aggregations
- Allocation
-
- Clamp auto-expand replicas to the closest value #87505 (issue: #84788)
- Prevent re-balancing using outdated node weights in some cases #88385 (issue: #88384)
-
Remove any existing
read_only_allow_delete
index blocks whencluster.routing.allocation.disk.threshold_enabled
is set tofalse
#87841 (issue: #86383) - Replace health request with a state observer #88641
- Authentication
-
- Fix unique realm name check to cover default realms #87999
- Authorization
- Autoscaling
- Cluster Coordination
-
- Improve rejection of ambiguous voting config name #89239
- Data streams
- Distributed
-
- Fixed NullPointerException on bulk request #88385
- EQL
- Geo
- Health
- Highlighting
- ILM+SLM
-
- Batch ILM move to retry step task update #86759
- Infra/CLI
- Infra/Core
- Infra/Node Lifecycle
-
- Fix message for stalled shutdown #89254
- Infra/Plugins
- Infra/Scripting
-
-
Script:
UpdateByQuery
can read doc version if requested #88740
-
Script:
- Machine Learning
-
- Address potential bug where trained models get stuck in starting after being allocated to node #88945
- Fix BERT and MPNet tokenization bug when handling unicode accents #88907 (issue: #88900)
-
Fix NLP
question_answering
task when best answer is only one token #88347 -
Include start params in
_stats
for non-started model deployments #89091 - Fix minor tokenization bug when using fill_mask task with roberta tokenizer #88825
- Fix potential cause of classification and regression job failures #2385
- Mapping
- Network
- SQL
- Search
- Security
-
-
Ensure
secureString
remain open when reloading secure settings #88922
-
Ensure
- Snapshot/Restore
- Transform
-
- Handle update error correctly #88619
Deprecations
edit- Vector Search
-
-
Deprecate the
_knn_search
endpoint #88828
-
Deprecate the
Enhancements
edit- Aggregations
- Allocation
- Audit
- Authentication
-
- If signature validation fails, reload JWKs and retry if new JWKs are found #88023
- Authorization
-
- App permissions with action patterns do not retrieve privileges #85455
- Cancellable Profile Has Privilege check #87224
-
Return action denied error when user with insufficient privileges (
manage_own_api_key
) attempts a grant API key request #87461 (issue: #87438) - Update indices permissions to Enterprise Search service account #88703
- Autoscaling
- Cluster Coordination
- Data streams
-
- Give doc-value-only mappings to numeric fields on metrics templates #87100
- Distributed
- FIPS
- Geo
- Health
-
- Add health user action for unhealthy SLM policy failure counts #88523
- Adding a transport action to get cluster formation info #87306
-
Adding additional capability to the
master_is_stable
health indicator service #87482 -
Creating a transport action for the
CoordinationDiagnosticsService
#87984 -
Move the master stability logic into its own service separate from the
HealthIndicatorService
#87672 - Polling cluster formation state for master-is-stable health indicator #88397
- Remove cluster block preflight check from health api #87520 (issue: #87464)
- ILM+SLM
- Infra/Core
-
- Improve console exception messages #87942
- Print full exception when console is non-interactive #88297
- Stop making index read-only when executing force merge index lifecycle management action #81162 (issue: #81162)
- Stream input and output support for optional collections #88127
- Update version of internal http client #87491
- Infra/Logging
-
- Catch an exception when formatting a string fails #87132
- Infra/Scripting
- Infra/Settings
-
- Convert disk watermarks to RelativeByteSizeValues #88719
- Ingest
- Machine Learning
-
- Add authorization info to ML config listings #87884
-
Add deployed native models to
inference_stats
in trained model stats response #88187 - Add inference cache hit count to inference node stats #88807
-
Add new
cache_size
parameter totrained_model
deployments API #88450 - Expand allowed NER labels to be any I-O-B tagged labels #87091
- Improve scalability of NLP models #87366
- Indicate overall deployment failure if all node routes are failed #88378
-
New
frequent_items
aggregation #83055 - Fairer application of size penalty for model selection for training classification and regression models #2291
- Accelerate training for data frame analytics by skipping fine parameter tuning if it is unnecessary #2298
- Address some causes of high runtimes training regression and classification models on large data sets with many features #2332
- Add caching for PyTorch inference #2305
- Improve accuracy of anomaly detection median estimation #2367 (issue: #2364)
- Mapping
- Monitoring
-
- JvmService use SingleObjectCache #87236
- Network
- Query Languages
- Rollup
-
- [TSDB] Add Kahan support to downsampling summation #87554
- SQL
- Search
- Security
- Snapshot/Restore
-
- INFO logging of snapshot restore and completion #88257 (issue: #86610)
- Make snapshot deletes not block the repository during data blob deletes #86514
- Retry after all S3 get failures that made progress #88015 (issue: #87243)
-
Speed up creating new
IndexMetaDataGenerations
without removed snapshots #88344 - Update HDFS Repository to HDFS 3.3.3 #88039
- Stats
-
- Sort ingest pipeline stats by use #88035
- TLS
-
- Add issuer to GET _ssl/certificates #88445
- Transform
New features
edit- Authentication
-
- Support updates of API key attributes (single operation route) #88186
- Health
- Infra/Core
-
- File Settings Service #88329
- Infra/Logging
-
- Stable logging API - the basic use case #86612
- Machine Learning
-
- Make composite aggs in datafeeds Generally Available #88589
- Search
-
-
Add mode option to
_source
field mapper #88211
-
Add mode option to
- TSDB
- Vector Search