This documentation contains work-in-progress information for future Elastic Stack and Cloud releases. Use the version selector to view supported release docs. It also contains some Elastic Cloud serverless information. Check out our serverless docs for more details.
« Elasticsearch version 8.8.1 Elasticsearch version 8.7.1 »
Elastic Docs ›Elasticsearch Guide [8.16] ›Release notes

Elasticsearch version 8.8.0

edit

Elasticsearch version 8.8.0

edit

Also see Breaking changes in 8.8.

Bug fixes

edit
Aggregations
  • Merge two histograms using the higher number of digits among all histograms #93704 (issue: #92822)
Allocation
  • Avoid copying during iteration of all shards in routing table #94417
  • Avoid duplicate application of RoutingTable diff #94379
  • Balance priorities during reconciliation #95454
  • Fix RebalanceOnlyWhenActiveAllocationDecider #96025
  • Streamline AsyncShardFetch#getNumberOfInFlightFetches #93632 (issue: #93631)
Application
  • Check if an analytics event data stream exists before installing pipeline #95621
  • [Behavioral Analytics] Use a client with ent-search origin in the BulkProcessorFactory #95614
Authorization
  • Fix role transformation to include missing properties #94714
  • [Fleet] Add read privileges to profiling-* for symbolization support #95596
CRUD
  • Avoid null Location in post write refresh #95229
Cluster Coordination
  • Read register current term asynchronously in StoreHeartbeatService #95351
DLM
  • Remove rollover cluster setting validator #94447
  • [DLM] Fix the new endpoint rest-api specification #95665
Data streams
  • Allow deletion of component templates that are specified in the ignore_missing_component_templates array #95527
  • Fix searching a filtered and unfiltered data stream alias #95865 (issue: #95786)
Distributed
  • Check shard availability before including in stats #96015 (issues: #96000, #87001)
  • Fix GetPipelineResponse equality #93695
Engine
  • Ensure refresh to return the latest commit generation #94249
Geo
  • Adjust BoundedGeoHexGridTiler#FACTOR to prevent missing hits #96088 (issue: #96057)
  • Fix bug where geo_line does not respect sort_order #94734 (issue: #94733)
ILM+SLM
  • Retry downsample ILM action using a new target index #94965 (issue: #93580)
  • Strip disallowed chars from generated snapshot name #95767 (issue: #95593)
  • [ILM] Fix the migrate to tiers service and migrate action tiers configuration #95934
Infra/Core
  • Fix race condition in NodeEnvironment.close() #94677 (issue: #94672)
  • Use double wildcards for filtered excludes properly #94195 (issue: #92632)
Infra/REST API
  • Add level parameter validation in REST layer #94136 (issue: #93981)
Infra/Scripting
  • Allow low level paging in LeafDocLookup #93711
  • Revert usage of SafeMustacheFactory in CustomMustacheFactory #95557
Ingest Node
  • Fix Grok.match() with offset and suffix pattern #95003 (issue: #95002)
  • Fix bug in verbose simulations of the ingest pipeline API #95232
Machine Learning
  • Avoid expensive source parsing by using doc values when querying model definition meta fields #95590
Mapping
  • Longer timeout for mapping update during resize #95221
Network
  • Fix RecyclerBytesStreamOutput corrupting when ending write on page boundary #95114
  • Fix maximum seek limit RecyclerBytesStreamOutput #95133
Ranking
  • Fix versioning for tests cases using a randomly generated rank builder #95514
Search
  • Fix _terms_enum display values #94080 (issue: #94041)
  • Support ignore malformed in boolean fields #93239 (issue: #89542)
  • Support search template api explain query string argument #94832 (issue: #83363)
Snapshot/Restore
  • Cancel cold cache prewarming tasks if store is closing #95891 (issue: #95504)
  • Fix 0 default value for repo snapshot speed #95854 (issue: #95561)
  • Fix Azure InputStream#read method #96034
  • Stop sorting indices in get-snapshots API #94890
Transform
  • Call listener in order to prevent the request from hanging #96221
  • Do not fail upon ResourceAlreadyExistsException during destination index creation #96274 (issue: #95310)
  • Fix privileges check failures by adding allow_restricted_indices flag #95187
  • Secondary credentials used with transforms should only require source and destination index privileges, not transform privileges #94420
  • Use monotonic time in TransformScheduler #95456 (issue: #95445)

Deprecations

edit
Allocation
  • Deprecate cluster.routing.allocation.type #94066

Enhancements

edit
Aggregations
  • Add keyed parameter to filters agg, allowing the user to get non-keyed buckets of named filters agg #89256 (issue: #83957)
  • Add global ordinal info to stats APIs #94500
  • Don’t create many Rounding.Prepared instances when checking for empty buckets in date_histogram aggregator. #94649
Analysis
  • Add origin of synonym rules to exception message #93702
Application
  • Behavioral Analytics event ingest tuning #95405
  • [Behavioral Analytics] Add geo ip and user agent to events #95433
  • [Behavioral analytics] Implement search filters into events #95212
Authentication
  • Do not fail node if SAML HTTP metadata is unavailable #92810 (issue: #37608)
  • Finer control over authentication metadata serialization #93726
Authorization
  • Add permissions to kibana_system for TI package transforms to support IOC expiration #94506 (issue: #94505)
  • Ensure checking indices privileges works with nested-limited-role #95170
Cluster Coordination
  • Improve master service batching queues #92021 (issue: #81626)
DLM
  • Adding origination date to DLM #95113
Engine
  • Increase the merge factor to 32 for time-based data #94134
  • Reduce the likelihood of writing small segments due to an oversize translog #93524 (issue: #75611)
  • Sort segments on timestamp in read only engine #93576
  • Use LogByteSizeMergePolicy instead of TieredMergePolicy for time-based data #92684
  • Use mmap for temporary files #93595
Geo
  • Allow docvalues-only search on geo_shape #94396
  • Support for store parameter in geo_shape field #94418 (issue: #83655)
Highlighting
  • Use storedFieldsSpec to load stored fields for highlighting #91841
ILM+SLM
  • Implicitly rollover data streams / aliases based on max_primary_shard_docs #94065 (issue: #87246)
  • Sort ILM explain output by natural index name #94879 (issue: #94768)
Indices APIs
  • Adding initial public and internal serverless scopes to data management rest handlers #93990
  • Servlerless API protection with annotations #93607
Infra/Core
  • Allow preserving specific headers on thread context stash #94680
Infra/Plugins
  • Improve module/plugin loading logging message. #93952 (issue: #93881)
Infra/Transport API
  • Add transport_version to node info JSON #94669
Ingest Node
  • Add reroute processor #76511
  • Introduce redirect method on IngestDocument #94000 (issue: #83653)
  • [Ingest Processor] Add ignore_missing param to the uri_parts ingest processor #95068
Machine Learning
  • Add _meta field to data frame analytics config #94529
  • Add embedding_size to text embedding config #95176
  • Include model definition install status for Pytorch models #95271
  • Integrate ELSER model download into put trained model API #95281
  • Start, stop and infer of a trained model can now optionally use a deployment ID that is different to the model ID #95168
  • [ML] Get trained model stats by deployment id or model id #95440
Mapping
  • Cut over from Field to StringField when applicable #94540
  • Enable _terms_enum on ip fields #94322 (issue: #89933)
  • Enable synthetic source for malformed booleans #94121
  • Index sequence numbers via a single Lucene field #94504
  • Use a combined field to index terms and doc values on keyword fields #93579
Monitoring
  • Add event_loop_utilization Kibana stats to the monitoring index templates #95388
Network
  • Add request/response body logging to HTTP tracer #93133
  • Avoid deserializing responses in proxy node #93799
  • Report transport message size per action #94543 (issue: #88151)
  • Retain underlying error on proxy mode connection failure #94998
SQL
  • Add WildcardLike/Pattern to QL #95357
Search
  • Adding initial public and internal serverless scopes to Search team REST handlers #94035
  • Enable _terms_enum on version fields #93839 (issue: #83403)
  • Introduce DocumentParsingException #92646 (issue: #85083)
  • Leverage Weight#count when size is set to 0 #94858
  • Make SourceProvider using stored fields segment-thread-safe #95082
  • Shortcut total hit count when terminate_after is used #94889
  • [Profiling] Map stack frames more efficiently #94327
  • [Profiling] Parallelize response handling #93960
Security
  • Fleet: Add new mappings for .fleet-actions signing #93802
Snapshot/Restore
  • Add register analysis to repo analysis API #93955
  • Add snapshot activity in cluster stats #93680
  • Add support for custom endpoints in the Azure repository #94576 (issue: #94537)
  • Failed tasks proactively cancel children tasks #92588 (issue: #90353)
TSDB
  • Support position time_series_metric on geo_point fields #93946
Transform
  • Add delete_destination_index parameter to the Delete Transform API #94162
  • Allow specifying destination index aliases in the Transform’s dest config #94943
  • Expose authorization failure as transform health issue #94724
Vector Search
  • Increase max number of vector dims to 2048 #95257
Watcher
  • Add Watcher APIs for updating/retrieving settings #95342 (issue: #92991)
  • Porting watcher over to BulkProcessor2 #94133

New features

edit
Application
  • Initial Search Application Search API with templates #95026
  • [Behavioral Analytics] Add a final_pipeline to event data streams #95198
Authentication
  • GA release of the JWT realm #95398
CRUD
  • New TransportBroadcastUnpromotableAction action #93600
DLM
  • Add new endpoints to configure data lifecycle on a data stream level #94590
  • Dlm add auto rollover condition max age #94950
  • Initial implementation for DataLifecycleService #94012
  • Introduce a _lifecycle/explain API for data stream backing indices #94621
  • Introduce the index.lifecycle.prefer_ilm setting #95423
  • [DLM] Extend the template to simulate api to support include defaults #94861
  • [DLM] Introduce default rollover cluster setting & expose it via APIs #94240
Health
  • Add new ShardsCapacity Health Indicator Service #94552
  • Add to HealthMetadata information about ShardLimits #94116
Ingest Node
  • Add license checking to the redact processor #95477
Machine Learning
Ranking
  • Add support for Reciprocal Rank Fusion to the search API #93396
Search
  • Add Enterprise Search Module #94381
  • Add new similarity field to knn clause in _search #94828
  • Add the ability to return the score of the named queries #94564 (issue: #29606)
  • Implements behavioral analytics events ingest API #95027
TSDB
  • Encode using 40, 48 and 56 bits per value #93371
  • Flattened field synthetic support #94842
  • Support flattened fields as time series dimension fields #95273

Upgrades

edit
Engine
  • Upgrade to lucene-9.6-snapshot-dcc2154a1d3 #94955
Infra/Core
  • Upgrade Jackson xml to 2.15.0 #95641
Ingest Node
  • Upgrading tika to 2.7.0 #93759
Network
  • Upgrade to Netty 4.1.89 #94179
Packaging
  • Bump bundled JDK to Java 20.0.1 #95359
Search
  • Upgrade Lucene to the final 9.6.0 release #95967
  • Upgrade to lucene-9.6.0-snapshot-8a815153fbe #94635
  • Upgrade to lucene-9.6.0-snapshot-f5d1e1c787c #94494
« Elasticsearch version 8.8.1 Elasticsearch version 8.7.1 »