This documentation contains work-in-progress information for future Elastic Stack and Cloud releases. Use the version selector to view supported release docs. It also contains some Elastic Cloud serverless information. Check out our serverless docs for more details.
« Elasticsearch version 8.11.1 Elasticsearch version 8.10.4 »
Elastic Docs ›Elasticsearch Guide [8.16] ›Release notes

Elasticsearch version 8.11.0

edit

Elasticsearch version 8.11.0

edit

Also see Breaking changes in 8.11.

Breaking changes

edit
Infra/Core
  • Remove transport_versions from cluster state API #99223

Known issues

edit

Bug fixes

edit
Aggregations
  • Adjust DateHistogram's bucket accounting to be iteratively #101012
  • Allow parsing on non-string routing fields #97729
  • Support runtime fields in synthetic source #99796 (issue: #98287)
Allocation
  • Consider node shutdown in DataTierAllocationDecider #98824 (issue: #97207)
Application
  • Align look-back with client-side cache #101264
  • Increase K/V look-back time interval #101205
  • Provide stable resampling #101255
  • [Profiling] Tighten resource creation check #99873
Authorization
  • Allow enrich_user to read/view enrich indices #100707
  • Grant editor and viewer access to profiling #100594
CCR
  • CCR: Use local cluster state request #100323
CRUD
  • Change GetFromTranslog to indices action #99300
  • Wait for cluster to recover before resolving index template #99797
Cluster Coordination
  • Reset GatewayService flags before reroute #98653 (issue: #98606)
Data streams
  • DSL waits for the tsdb time boundaries to lapse #100470 (issue: #99696)
  • Propagate cancellation in DataTiersUsageTransportAction #100253
  • [DSL] skip deleting indices that have in-progress downsampling operations #101495
Downsampling
  • Make downsample target index replicas configurable #99712
ES|QL
  • "params" correctly parses the values including an optional "type" #99310 (issue: #99294)
  • Account for an exception being thrown when building a BytesRefArrayBlock #99726 (issue: #99472)
  • Add arithmetic operators #98628
  • Add identity check in Block equality #100377 (issue: #100374)
  • Adds Enrich implicit match_fields to field_caps call #101456 (issue: #101328)
  • Better management of not stored TEXT fiels with synthetic source #99695
  • Continue resolving attributes for Eval #99601 (issue: #99576)
  • Create a Vector when needed for IN #99382 (issue: #99347)
  • ESQL: Fix unreleased block in topn #101648 (issue: #101588)
  • ESQL: check type before casting #101492 (issue: #101489)
  • Fix NPE when aggregating literals #99827
  • Fix escaping of backslash in LIKE operator #101120 (issue: #101106)
  • Fix eval of functions on foldable literals #101438 (issue: #101425)
  • Fix non-null value being returned for unsupported data types in ValueSources #100656 (issue: #100048)
  • Graceful handling of non-bool condition in the filter #100645 (issues: #100049, #100409)
  • Handle queries with non-existing enrich policies and no field #100647 (issue: #100593)
  • Implement serialization of InvalidMappedField #98972 (issue: #98851)
  • Improve verifier error for incorrect agg declaration #100650 (issue: #100641)
  • Limit how many bytes concat() can process #100360
  • Make DISSECT parameter append_separator case insensitive #101358 (issue: #101138)
  • Page shouldn’t close a block twice #100370 (issues: #100356, #100365)
  • Preserve intermediate aggregation output in local relation #100866 (issue: #100807)
  • Properly handle multi-values in fold() and date math #100766 (issue: #100497)
  • Remove aliasing inside Eval #100238 (issue: #100174)
  • Resilience to non-indexed fields #99588 (issue: #99506)
  • Skip synthetic attributes when planning the physical fragment #99188 (issue: #99170)
  • Support date and time intervals as input params #101001 (issue: #99570)
  • Support queries that don’t return underlying fields #98759 (issue: #98404)
  • Use exact attributes for data source extraction #99874 (issue: #99183)
  • mv_expand pushes down limit and project and keep the limit after it untouched #100782 (issues: #99971, #100774)
  • support metric tsdb fields while querying index patterns #100351 (issue: #100144)
Geo
  • Use NamedWritable to enable GeoBoundingBox serialisation #99163 (issue: #99089)
Health
  • Fix NPE in StableMasterHealthIndicatorService #98635
  • Health report infrastructure doesn’t trip the circuit breakers #101629
  • Propagate cancellation in GetHealthAction #100273
Highlighting
  • Correctly handle ScriptScoreQuery in plain highlighter #99804 (issue: #99700)
  • Disable weight_matches when kNN query is present #101713
ILM+SLM
  • Compute SLM retention from RepositoryData #100092 (issue: #99953)
  • WaitForSnapshotStep verifies if the index belongs to the latest snapshot of that SLM policy #100911
Infra/Core
  • Add java.net.NetPermission to APM module’s permissions #99474
  • Don’t update system index mappings in mixed clusters #101778 (issues: #101331, #99778)
  • Revert "Kibana system index does not allow user templates to affect it" #98888
  • Specify correct current IndexVersion after 8.10 release #98574 (issue: #98555)
  • Tracing: Use doPriv when working with spans, use SpanId #100232
Infra/Scripting
  • Improve painless error wrapping #100872
Ingest Node
  • Improving tika handling #101486
  • Update enrich execution to only set index false on fields that support it #98038 (issue: #98019)
Machine Learning
  • Avoid risk of OOM in datafeeds when memory is constrained #98915 (issue: #89769)
  • Fix for inference requests being sent to every node with a model allocation. If there are more nodes than items in the original request then empty requests were sent. #100388 (issue: #100180)
  • Preserve order of inference results when calling the _infer API with multiple inputs on a model deployment with more than one allocation the output results order was not guaranteed to match the input order. The fix ensures the output order matches the input order. #100143
  • Remove noisy Could not find trained model message #100760
  • Safely drain deployment request queues before allowing node to shutdown #98406
  • Use the correct writable name for model assignment metadata in mixed version clusters. Prevents a node failure due to IllegalArgumentException Unknown NamedWriteable [trained_model_assignment] #100886
  • Wait to gracefully stop deployments until alternative allocation exists #99107
Mapping
  • Automatically disable ignore_malformed on datastream @timestamp fields #99346
  • Correct behaviour of ContentPath::remove() #98332 (issue: #98327)
  • Fix merges of mappings with subobjects: false for composable index templates #97317 (issue: #96768)
  • Percolator to support parsing script score query with params #101051 (issue: #97377)
Network
  • Do not report failure after connections are made #99117
Percolator
  • Fix percolator query for stored queries that expand on wildcard field names #98878
Query Languages
Recovery
Search
  • Consistent scores for multi-term SourceConfirmedTestQuery #100846 (issue: #98712)
  • Fix UnsignedLong field range query gt "0" can get the result equal to 0 #98843
  • Fix advanceExact for doc values from sources #99685
  • Fork response-sending in OpenPointInTimeAction #99222
  • [CI] SearchResponseTests#testSerialization failing resolved #100020 (issue: #100005)
  • fix fuzzy query rewrite parameter not work #97642
Security
  • Fix NullPointerException in RotableSecret #100779 (issue: #99759)
Snapshot/Restore
  • Fix race condition in SnapshotsService #101652
  • Fix snapshot double finalization #101497
  • Fix thread context in getRepositoryData #99627
  • Frozen index input clone copy cache file #98930
  • Make S3 anti-contention delay configurable #101245
  • More robust timeout for repo analysis #101184 (issue: #101182)
  • Register repository_s3 settings #101344
  • Reinstate RepositoryData BwC #100447
TSDB
  • Don’t ignore empty index template that have no template definition #98840 (issue: #98834)
  • Fix painless execute api and tsdb issue #101212 (issue: #101072)
  • Make tsdb settings public in Serverless #99567 (issue: #99563)
Transform
  • Fix possible NPE when getting transform stats for failed transforms #98061 (issue: #98052)
  • Ignore IndexNotFound error when refreshing destination index #101627
  • Make Transform Feature Reset really wait for all the tasks #100624
  • Make tasks that calculate checkpoints cancellable #100808
Watcher
  • Treating watcher webhook response header names as case-insensitive #99717

Deprecations

edit
Rollup
  • Rollup functionality is now deprecated #101265

Enhancements

edit
Aggregations
  • Disable FilterByFilterAggregator through ClusterSettings #99417 (issue: #99335)
  • Represent histogram value count as long #99912 (issue: #99820)
  • Skip DisiPriorityQueue on single filter agg #99215 (issue: #99202)
  • Use a competitive iterator in FiltersAggregator #98360 (issue: #97544)
Allocation
  • Report a node’s "roles" setting in the /_cluster/allocation/explain response #98550 (issue: #97859)
Application
  • Add flamegraph API #99091
  • [Profiling] Allow to customize the ILM policy #99909
  • [Profiling] Allow to wait until resources created #99655
Audit
  • Reduce verbosity of the bulk indexing audit log #98470
Authentication
  • Allow native users/roles to be disabled via setting #98654
CAT APIs
  • Add dataset size to cat indices and cat shards #98622 (issue: #95092)
Data streams
  • Allow explain data stream lifecycle to accept a data stream #98811
ES|QL
  • Add CEIL function #98847
  • Add ability to perform date math #98870 (issue: #98402)
  • Add support for TEXT fields in comparison operators and SORT #98528 (issue: #98642)
  • Compact topn #99316
  • Date math for negatives #99711
  • Enable arithmetics for durations and periods #99432 (issue: #99293)
  • Enhance SHOW FUNCTIONS command #99736 (issue: #99507)
  • Improve log messages #99470
  • Log execution time consistently #99286
  • Log query and execution time #99058
  • Log start and end of queries #99746
  • Lower the implicit limit, if none is user-provided #99816 (issue: #99458)
  • Make settings dynamic #101516
  • Mark counter fields as unsupported #99054
  • Remove the swapped-args check for date_xxx() #101362 (issue: #99562)
  • Serialize the source in expressions #99956
  • Simple check if all blocks get released #100199
  • Support unsigned long in sqrt and log10 #98711
  • Use DEBUG log level to report execution steps #99303
Engine
  • Use IndexWriter.flushNextBuffer() to reclaim memory from indexing buffers #94607
Health
  • Avoiding the use of nodes that are no longer in the cluster when computing master stability #98809 (issue: #98636)
  • When a primary is inactive but this is considered expected, the same applies for the replica of this shard. #99995 (issue: #99951)
Infra/Core
  • APM Metering API #99832
  • Update the elastic-apm-agent version #100064
  • Use mappings version to retrieve system index mappings at creation time #99555
Infra/Node Lifecycle
  • Add links to docs from failing bootstrap checks #99644 (issue: #99614)
  • Chunk SingleNodeShutdownStatus and ShutdownShardMigrationStatus (and related action) response #99798 (issue: #99678)
Infra/REST API
  • Add IndexVersion to node info #99515
  • Add component info versions to node info in a pluggable way #99631
  • Return a 410 (Gone) status code for unavailable API endpoints #97397
Machine Learning
  • Add new _inference API #99224
  • Adding an option for trained models to be platform specific #99584
  • Log warnings for jobs unassigned for a long time #100154
  • Simplify the Inference Ingest Processor configuration #100205
Mapping
  • Automatically flatten objects when subobjects:false #97972 (issue: #88934)
  • Explicit parsing object capabilities of FieldMappers #98684 (issue: #98537)
  • Reintroduce sparse_vector mapping #98996
Network
  • Chunk the cluster allocation explain response #99641 (issue: #97803)
Recovery
  • Wait for cluster state in recovery #99193
Search
  • Add additional counters to _clusters response for all Cluster search states #99566 (issue: #98927)
  • Adding support for exist queries to sparse_vector fields #99775 (issue: #99319)
  • Make _index optional for pinned query docs #97450
  • Reduce copying when creating scroll/PIT ids #99219
  • Refactor SearchResponseClusters to use CHM #100129 (issue: #99101)
  • Support cluster/details for CCS minimize_roundtrips=false #98457
Security
  • Support rotatating the JWT shared secret #99278
Snapshot/Restore
  • Remove shard data files when they fail to write for snapshot #99694
Stats
  • Prune unnecessary information from TransportNodesInfoAction.NodeInfoRequest #99938 (issue: #99744)
TSDB
  • Add index.look_back_time setting for tsdb data streams #98518 (issue: #98463)
  • Improve time-series error and documentation #100018
  • Trim stored fields for _id field in tsdb #97409
Transform
  • Add accessors required to recreate TransformStats object from the fields #98844
Vector Search
  • Add new max_inner_product vector similarity function #99527
  • Adds nested support for indexed dense_vector fields #99763
  • Dense vector field types are indexed by default #98268
  • Increase the max vector dims to 4096 #99682

New features

edit
Analysis
  • Add support for Persian language stemmer #99106 (issue: #98911)
Application
  • Automatically map float arrays of lengths 128 - 2048 as dense_vector #98512 (issue: #97532)
Data streams
  • GA the data stream lifecycle #100187
  • GET _data_stream displays both ILM and DSL information #99947
ES|QL
  • Integrate Elasticsearch Query Language, ES|QL #98309
  • LEAST and GREATEST functions #98630
  • LEFT function #98942
  • LTRIM, RTRIM and fix unicode whitespace #98590
  • RIGHT function #98974
  • TopN sorting with min and max for multi-value fields #98337

Upgrades

edit
Packaging
  • Update bundled JDK to 21.0.1 #101133
Search
  • Upgrade main to Lucene 9.8.0 #100138
« Elasticsearch version 8.11.1 Elasticsearch version 8.10.4 »