IMPORTANT: No additional bug fixes or documentation updates
will be released for this version. For the latest information, see the
current release documentation.
Elasticsearch version 6.0.0-beta1
editElasticsearch version 6.0.0-beta1
editBreaking Changes
edit- Aggregations
- Aliases
- Highlighting
-
- Remove the postings highlighter and make unified the default highlighter choice #25028
- Index APIs
- Indexed Scripts/Templates
-
- Scripting: Remove search template actions #25717
- Ingest
- Java REST Client
- Packaging
-
- Remove support for ES_INCLUDE #25804
- Setup: Change default heap to 1G #25695
- Use config directory to find jvm.options #25679 (issue: #23004)
- Remove implicit 32-bit support #25435
- Remove default path settings #25408 (issue: #25357)
- Remove path.conf setting #25392 (issue: #25357)
- Honor masking of systemd-sysctl.service #24234 (issues: #21899, #806)
- Plugin Analysis ICU
- Plugin Discovery Azure Classic
- Plugin Repository GCS
-
- GCS Repository: Remove specifying credential file on disk #24727
- Plugins
-
- Make plugin loading stricter #25405
- Query DSL
- REST
- Scripting
- Search
- Security
-
- A new bootstrap check enforces that TLS/SSL is required for inter-node communication when running in production mode. See Encrypting Communications.
-
A new bootstrap check enforces that HTTPS is used by the built-in token
service when running in
production mode.
To disable the token service, set
xpack.security.authc.token.enabled
tofalse
in yourelasticsearch.yml
. See Token service settings.
- Settings
- Similarities
Breaking Java Changes
edit- Aggregations
- Internal
- Java API
- Java High Level REST Client
- Java REST Client
- Plugin Delete By Query
-
- Move DeleteByQuery and Reindex requests into core #24578
- Query DSL
- REST
Deprecations
edit- Index APIs
- Indexed Scripts/Templates
- Percolator
-
- Deprecate percolate query’s document_type parameter. #25199
- Scripting
-
- Scripting: Change keys for inline/stored scripts to source/id #25127
- Scripting: Deprecate native scripts #24692 (issue: #19966)
- Scripting: Deprecate index lookup #24691 (issue: #19359)
- Deprecate Fine Grain Settings for Scripts #24573 (issue: #24532)
- Scripting: Deprecate file script settings #24555 (issue: #21798)
- Scripting: Deprecate file scripts #24552 (issue: #21798)
- Settings
- Tribe Node
New Features
editEnhancements
edit- Aggregations
-
- Add strict parsing of aggregation ranges #25769
- Adds rewrite phase to aggregations #25495 (issue: #17676)
- Tweak AggregatorBase.addRequestCircuitBreakerBytes #25162 (issue: #24511)
- Add superset size to Significant Term REST response #24865
- Add document count to Matrix Stats aggregation response #24776
- Adds an implementation of LogLogBeta for the cardinality aggregation #22323 (issue: #22230)
- Allocation
- Analysis
- CAT API
- Cluster
- Core
-
- Add max file size bootstrap check #25974
- Add compatibility versions to main action response #25799
- Index ids in binary form. #25352 (issues: #18154, #24615)
- Explicitly reject duplicate data paths #25178
- Use SPI in High Level Rest Client to load XContent parsers #25097
- Upgrade to lucene-7.0.0-snapshot-a0aef2f #24775
- Speed up PK lookups at index time. #19856
- Engine
- Exceptions
-
- IllegalStateException: Only duplicated jar instead of classpath #24953
- Highlighting
- Index APIs
- Ingest
-
- Add Ingest-Processor specific Rest Endpoints & Add Grok endpoint #25059 (issue: #24725)
- Port support for commercial GeoIP2 databases from Logstash. #24889
-
add
exclude_keys
option to KeyValueProcessor #24876 (issue: #23856) - Allow removing multiple fields in ingest processor #24750 (issue: #24622)
- Add target_field parameter to ingest processors #24133 (issues: #23228, #23682)
- Inner Hits
- Internal
-
- Cleanup IndexFieldData visibility #25900
- Bump the min compat version to 5.6.0 #25805
- "shard started" should show index and shard ID #25157
- Break out clear scroll logic from TransportClearScrollAction #25125 (issue: #25094)
- Add helper methods to TransportActionProxy to identify proxy actions and requests #25124
- Add remote cluster infrastructure to fetch discovery nodes. #25123 (issue: #25094)
- Add the ability to set eager_global_ordinals in the new parent-join field #25019
- Disallow multiple parent-join fields per mapping #25002
- Remove the need for _UNRELEASED suffix in versions #24798 (issue: #24768)
- Optimize the order of bytes in uuids for better compression. #24615 (issue: #18209)
- Java API
- Java High Level REST Client
-
- [DOCS] restructure java clients docs pages #25517
- Use SPI in High Level Rest Client to load XContent parsers #25098 (issues: #25024, #25097)
- Add support for clear scroll to high level REST client #25038
- Add search scroll method to high level REST client #24938 (issue: #23331)
- Add search method to high level REST client #24796 (issues: #24794, #24795)
- Java REST Client
- Logging
- Mapping
- Network
- Packaging
-
- Remove memlock suggestion from systemd service #25979
- Set address space limit in systemd service file #25975
- Version option should display if snapshot #25970
- Ignore JVM options before checking Java version #25969
- Also skip JAVA_TOOL_OPTIONS on Windows #25968
- Introduce elasticsearch-env for Windows #25958
- Introduce elasticsearch-env #25815 (issue: #20286)
- Stop exporting HOSTNAME from scripts #25807
- Parent/Child
- Plugin Lang Painless
-
- Allow Custom Whitelists in Painless #25557
- Update Painless to Allow Augmentation from Any Class #25360
- Add Needs Methods to Painless Script Context Factories #25267
- Support Script Context Stateful Factory in Painless #25233
- Generate Painless Factory for Creating Script Instances #25120
- Update Painless to Use New Script Contexts #25015
- Optimize instance creation in LambdaBootstrap #24618
- Plugin Repository GCS
-
- GCS Repository: Add secure storage of credentials #24697
- Plugin Repository S3
-
- S3 Repository: Add back repository level credentials #24609
- Plugins
-
- Move tribe to a module #25778
- Plugins can register pre-configured char filters #25000 (issue: #23658)
- Add purge option to remove plugin CLI #24981
- Allow plugins to register pre-configured tokenizers #24751 (issues: #24223, #24572)
- Move ReindexAction class to core #24684 (issue: #24578)
- Make PreConfiguredTokenFilter harder to misuse #24572 (issue: #23658)
- Query DSL
- REST
- Recovery
- Scripting
- Search
-
- Rewrite search requests on the coordinating nodes #25814 (issue: #25791)
- Ensure query resources are fetched asynchronously during rewrite #25791
- Introduce a new Rewriteable interface to streamline rewriting #25788
-
Reduce the scope of
QueryRewriteContext
#25787 - Reduce the overhead of timeouts and low-level search cancellation. #25776
- Reduce profiling overhead. #25772 (issue: #24799)
-
Prevent
can_match
requests from sending to incompatible nodes #25705 (issue: #25704) - Add a shard filter search phase to pre-filter shards based on query rewriting #25658
-
Ensure we rewrite common queries to
match_none
if possible #25650 - Limit the number of concurrent shard requests per search request #25632
- Add cluster name validation to RemoteClusterConnection #25568
- Speed up sorted scroll when the index sort matches the search sort #25138 (issue: #6720)
- Leverage scorerSupplier when applicable. #25109
- Add cross-cluster search support for scroll searches #25094
- Track EWMA[1] of task execution time in search threadpool executor #24989 (issue: #24915)
- Query range fields by doc values when they are expected to be more efficient than points #24823 (issue: #24314)
- Search: Fairer balancing when routing searches by session ID #24671 (issue: #24642)
- Sequence IDs
-
- Move primary term from ReplicationRequest to ConcreteShardRequest #25822
- Add reason to global checkpoint updates on replica #25612 (issue: #10708)
- Introduce primary/replica mode for GlobalCheckPointTracker #25468
- Throw back replica local checkpoint on new primary #25452 (issues: #10708, #25355)
- Update global checkpoint when increasing primary term on replica #25422 (issues: #10708, #25355)
- Enable a long translog retention policy by default #25294 (issues: #10708, #25147)
- Introduce primary context #25122 (issues: #10708, #25355)
- Block older operations on primary term transition #24779 (issue: #10708)
- Settings
-
- Add disk threshold settings validation #25600 (issue: #25560)
- Enable cross-setting validation #25560 (issue: #25541)
-
Validate
transport.profiles.*
settings #25508 - Cleanup network / transport related settings #25489
- Emit settings deprecation logging at most once #25457
- IndexMetaData: Introduce internal format index setting #25292
- Snapshot/Restore
-
- Improves snapshot logging and snapshot deletion error handling #25264
- Stats
- Translog
Bug Fixes
edit- Aggregations
- Aliases
- Analysis
- Circuit Breakers
- Core
- Discovery
- Engine
- Geo
-
- Fix typo in GeoUtils#isValidLongitude #25121
- Highlighting
- Index APIs
- Ingest
- Inner Hits
- Internal
-
- Fix BytesReferenceStreamInput#skip with offset #25634
- Fix race condition in RemoteClusterConnection node supplier #25432
- Initialise empty lists in BaseTaskResponse constructor #25290
- Extract a common base class for scroll executions #24979 (issue: #16555)
- Obey lock order if working with store to get metadata snapshots #24787 (issue: #24481)
- Fix Version based BWC and set correct minCompatVersion #24732
-
Fix
_field_caps
serialization in order to support cross-cluster search #24722 - Avoid race when shutting down controller processes #24579
- Mapping
-
- Fix parsing of ip range queries. #25768 (issue: #25636)
- Disable date field mapping changing #25285 (issue: #25271)
- Correctly enable _all for older 5.x indices #25087 (issue: #25068)
- token_count datatype should handle null value #25046 (issue: #24928)
- keep _parent field while updating child type mapping #24407 (issue: #23381)
- More Like This
- Nested Docs
-
- In case of a single type the _id field should be added to the nested document instead of _uid field #25149
- Network
- Packaging
-
- Exit Windows scripts promptly on failure #25959
- Pass config path as a system property #25943
- ES_HOME needs to be made absolute before attempt at traversal #25865
- Fix elasticsearch-keystore handling of path.conf #25811
- Stop disabling explicit GC #25759
- Avoid failing install if system-sysctl is masked #25657 (issue: #24234)
- Get short path name for native controllers #25344
- When stopping via systemd only kill the JVM, not its control group #25195
- remove remaining references to scripts directory #24771
- Handle parentheses in batch file path #24731 (issue: #24712)
- Parent/Child
- Percolator
- Plugin Lang Painless
-
- Painless: allow doubles to be casted to longs. #25936
- Plugin Repository Azure
- Plugin Repository GCS
- Plugin Repository HDFS
- Plugin Repository S3
- Plugins
-
- X-Pack plugin download fails on Windows desktop #24570
- Query DSL
- REST
- Recovery
- Reindex API
- Search
-
- Caching a MinDocQuery can lead to wrong results. #25909
- Fix random score generation when no seed is provided. #25908
- Merge FunctionScoreQuery and FiltersFunctionScoreQuery #25889 (issues: #15709, #23628)
-
Respect cluster alias in
_index
aggs and queries #25885 (issue: #25606) - First increment shard stats before notifying and potentially sending response #25818
- Remove assertion about deviation when casting to a float. #25806 (issue: #25330)
- Prevent skipping shards if a suggest builder is present #25739 (issue: #25658)
- Ensure remote cluster alias is preserved in inner hits aggs #25627 (issue: #25606)
- Do not search locally if remote index pattern resolves to no indices #25436 (issue: #25426)
- Adds check for negative search request size #25397 (issue: #22530)
- Make sure range queries are correctly profiled. #25108
- Fix RangeFieldMapper rangeQuery to properly handle relations #24808 (issue: #24744)
- Fix ExpandSearchPhase when response contains no hits #24688 (issue: #24672)
- Sequence IDs
-
- Fix pre-6.0 response to unknown replication actions #25744 (issue: #10708)
- Track local checkpoint on primary immediately #25434 (issues: #10708, #25355, #25415)
- Initialize max unsafe auto ID timestamp on shrink #25356 (issues: #10708, #25355)
- Use correct primary term for replicating NOOPs #25128
- Handle already closed while filling gaps #25021 (issue: #24925)
- Settings
- Snapshot/Restore
-
- Snapshot/Restore: Ensure that shard failure reasons are correctly stored in CS #25941 (issue: #25878)
- Output all empty snapshot info fields if in verbose mode #25455 (issue: #24477)
- Remove redundant and broken MD5 checksum from repository-s3 #25270 (issue: #25269)
- Consolidates the logic for cleaning up snapshots on master election #24894 (issue: #24605)
- Removes completed snapshot from cluster state on master change #24605 (issue: #24452)
- Stats
- Suggesters
Regressions
edit- Highlighting
- Search