New

The executive guide to generative AI

Read more
About usPartnersSupport|Login

WARNING: Version 5.4 of Elasticsearch has passed its EOL date.

This documentation is no longer being maintained and may be removed. If you are running this version, we strongly advise you to upgrade. For the latest information, see the current release documentation.

« 5.3.1 Release Notes 5.2.2 Release Notes »
Elastic Docs ›Elasticsearch Reference [5.4] ›Release Notes

5.3.0 Release Notes

edit

5.3.0 Release Notes

edit

See Multi data path bug in Elasticsearch 5.3.0.

Also see Breaking changes in 5.3.

Breaking changes

edit
Query DSL
  • Fix name of enabled_position_increments #22895
Search
  • Remove DFS_QUERY_AND_FETCH as a search type #22787

Breaking Java changes

edit
CRUD
  • Make index and delete operation execute as single bulk item (backport of #21964) #22812 (issue: #21964)
Internal
  • Replace SearchExtRegistry with namedObject #22492
  • Replace Suggesters with namedObject #22491
Network
  • Remove HttpServer and HttpServerAdapter in favor of a simple dispatch method #22636 (issue: #18482)
Plugins
  • Deguice rest handlers #22575
Search
  • Remove QUERY_AND_FETCH search type #22996

Deprecations

edit
Core
Geo
  • Geo distance range deprecation #22835
Java API
  • Add BulkProcessor methods with XContentType parameter #23078 (issue: #22691)
Mapping
  • Deprecate the include_in_all mapping parameter #22972 (issue: #22970)
Network
Plugin Repository Azure
  • Deprecate auto creation of container for azure repository #22857 (issues: #22843, #22856)
Plugin Repository S3
  • S3 Repository: Deprecate specifying region #22848 (issue: #22758)
  • S3 Repository: Deprecate auto creation of s3 bucket for repository #22843 (issue: #22761)
  • Deprecate specifying credentials through env vars, sys props, and remove profile files #22567 (issues: #21041, #22479)
REST
  • Deprecate ldjson support and document ndjson for bulk/msearch #23051 (issues: #23025, #23049)
  • Optionally require a valid content type for all rest requests with content #22691 (issue: #19388)
Scripting
  • Change Namespace for Stored Script to Only Use Id #22206

New features

edit
Aggregations
  • Initial version of an adjacency matrix using the Filters aggregation #22239 (issue: #22169)
CRUD
  • Allow an index to be partitioned with custom routing #22274 (issue: #21585)
Highlighting
Search
  • Add federated cross cluster search capabilities #22502 (issue: #21473)
  • Add field collapsing for search request #22337 (issue: #21833)
Settings
  • Add infrastructure for elasticsearch keystore #22335

Enhancements

edit
Allocation
  • Include stale replica shard info when explaining an unassigned primary #22826
Analysis
  • Analyze API Position Length Support #22574
CRUD
  • Make index and delete operation execute as a single bulk item #21964
Circuit Breakers
  • Add used memory amount to CircuitBreakingException message (#22521) #22693 (issue: #22521)
Cluster
Core
  • Simplify write failure handling (backport of #19105) #22778 (issue: #19105)
  • Simplify ElasticsearchException rendering as a XContent #22611
  • Remove setLocalNode from ClusterService and TransportService #22608
Engine
  • Replace EngineClosedException with AlreadyClosedExcpetion #22631
Index APIs
  • Indexing: Add shard id to indexing operation listener #22606
  • Better error when can’t auto create index #22488 (issues: #21448, #22435)
Ingest
  • Lazy load the geoip databases #23337
Internal
  • Improve connection closing in RemoteClusterConnection #22804 (issue: #22803)
  • Remove some more usages of ParseFieldMatcher #22437 (issues: #19552, #22130)
  • Introduce ToXContentObject interface #22387 (issue: #16347)
Java API
  • prevent NPE when trying to uncompress a null BytesReference #22386
Java High Level REST Client
  • Add parsing from xContent to MainResponse #22934
  • Parse elasticsearch exception’s root causes #22924
  • Add parsing method to BytesRestResponse’s error #22873
  • Add parsing method for ElasticsearchException.generateThrowableXContent() #22783
  • Add fromxcontent methods to delete response #22712 (issue: #22680)
  • Add parsing methods for UpdateResponse #22586
  • Add parsing from xContent to InternalSearchHit and InternalSearchHits #22429
  • Add fromxcontent methods to index response #22229
Java REST Client
  • move ignore parameter support from yaml test client to low level rest client #22637
  • Support Preemptive Authentication with RestClient #21336
Logging
  • Expose logs base path #22625
Mapping
  • Improve error message for ipv6 on legacy ip fields #23136 (issue: #23126)
Network
  • Keep the pipeline handler queue small initially #23335
Packaging
Plugin Discovery EC2
Plugin Lang Painless
  • Generate reference links for painless API #22775
  • Painless: Add augmentation to String for base 64 #22665 (issue: #22648)
Plugin Repository S3
Plugins
  • Add the ability to define search response listeners in search plugin #22682
Query DSL
  • QueryString and SimpleQueryString Graph Support #22541
  • Additional Graph Support in Match Query #22503 (issue: #22490)
  • RangeQuery WITHIN case now normalises query #22431 (issue: #22412)
Reindex API
  • Increase visibility of doExecute so it can be used directly #22614
  • Improve error message when reindex-from-remote gets bad json #22536 (issue: #22330)
Scripting
  • Expose multi-valued dates to scripts and document painless’s date functions #22875 (issue: #22162)
Search
  • Add a setting to disable remote cluster connections on a node #23005
  • First step towards separating individual search phases #22802
  • Add parsing from xContent to SearchProfileShardResults and nested classes #22649
  • ProfileResult and CollectorResult should print machine readable timing information #22638
Settings
  • Improve setting deprecation message #23156 (issue: #22849)
  • Add secure settings validation on startup #22894
  • Allow comma delimited array settings to have a space after each entry #22591 (issue: #22297)
  • Allow affix settings to be dynamic / updatable #22526
  • Allow affix settings to delegate to actual settings #22523
  • Make s3 repository sensitive settings use secure settings #22479
Snapshot/Restore
  • Duplicate snapshot name throws InvalidSnapshotNameException #22921 (issue: #18228)
  • Use general cluster state batching mechanism for snapshot state updates #22528 (issue: #14899)
Stats

Bug fixes

edit
CRUD
Cache
  • Invalidate cached query results if query timed out #22807 (issue: #22789)
Cluster
  • Don’t set local node on cluster state used for node join validation #23311 (issues: #21830, #3, #4, #6, #9)
  • Allow a cluster state applier to create an observer and wait for a better state #23132 (issue: #21817)
  • Cluster allocation explain to never return empty response body #23054
Exceptions
  • Stop returning "es." internal exception headers as http response headers #22703 (issue: #17593)
Ingest
  • Improve missing ingest processor error #23379 (issue: #23392)
  • fix date-processor to a new default year for every new pipeline execution #22601 (issue: #22547)
Internal
  • Always restore the ThreadContext for operations delayed due to a block #23349
  • Fix handling of document failure exception in InternalEngine (backport #22718) #22910
Java REST Client
  • RestClient asynchronous execution should not throw exceptions #23307
Mapping
  • Switch include_in_all in multifield to warning #23656 (issues: #21971, #23654)
  • Fix MapperService StackOverflowError #23605 (issue: #23604)
  • Range types causing GetFieldMappingsIndexRequest to fail due to NullPointerException in RangeFieldMapper.doXContentBody when include_defaults=true is on the query string #22925
  • Disallow introducing illegal object mappings (double ..) #22891 (issue: #22794)
Network
  • Respect promises on pipelined responses #23317 (issues: #23310, #23322)
  • Ensure that releasing listener is called #23310
Packaging
  • Fall back to non-atomic move when removing plugins #23548 (issue: #35)
Parent/Child
  • Add null check in case of orphan child document #22772 (issue: #22770)
Plugin Ingest Attachment
Plugin Lang Painless
  • Fix Bad Casts In Painless #23282 (issue: #23238)
  • Don’t allow casting from void to def in painless #22969 (issue: #22908)
  • Fix def invoked qualified method refs #22918
Plugins
  • Add check for null pluginName in remove command #22930 (issue: #22922)
Query DSL
  • Fix parsing for max_determinized_states #22749 (issue: #22722)
REST
  • [API] change wait_for_completion default according to docs #23672
  • HTTP transport stashes the ThreadContext instead of the RestController #23456
  • Ensure we try to autodetect content type for handlers that support plain text #23452
  • Fix date format in warning headers #23418 (issue: #23275)
  • Correct warning header to be compliant #23275 (issue: #22986)
  • Fix search scroll request with a plain text body #23183 (issue: #22691)
  • Handle bad HTTP requests #23153 (issue: #23034)
  • Properly encode location header #23133 (issues: #21057, #23115)
Reindex API
  • Reindex: do not log when can’t clear old scroll #22942 (issue: #22937)
  • Fix reindex-from-remote from <2.0 #22931 (issue: #22893)
Scripting
  • Remove unnecessary Groovy deprecation logging #23410 (issue: #23401)
  • Script: Fix value of ctx._now to be current epoch time in milliseconds #23175 (issue: #23169)
Search
  • Honor max concurrent searches in multi-search #23538 (issue: #23527)
  • Avoid stack overflow in multi-search #23527 (issue: #23523)
  • Replace blocking calls in ExpandCollapseSearchResponseListener by asynchronous requests #23053 (issue: #23048)
  • Ensure fixed serialization order of InnerHitBuilder #22820 (issue: #22808)
Settings
  • Fix merge scheduler config settings #23391
  • Settings: Fix keystore cli prompting for yes/no to handle console returning null #23320
  • Expose search.highlight.term_vector_multi_value as a node level setting #22999
  • NPE when no setting name passed to elasticsearch-keystore #22609
Similarities
  • Fix similarity upgrade when "default" similarity is overridden #23163
Stats
  • Avoid overflow when computing total FS stats #23641
  • Handle long overflow when adding paths' totals #23293 (issue: #23093)
  • Fix control group pattern #23219 (issue: #23218)
  • Fix total disk bytes returning negative value #23093
Task Manager
  • Fix hanging cancelling task with no children #22796
  • Fix broken TaskInfo.toString() #22698 (issue: #22387)

Regressions

edit
Core
  • Source filtering: only accept array items if the previous include pattern matches #22593 (issue: #22557)

Upgrades

edit
Internal
  • Upgrade to Lucene 6.4.1. #22978
« 5.3.1 Release Notes 5.2.2 Release Notes »