- Elasticsearch Guide: other versions:
- Getting Started
- Set up Elasticsearch
- Installing Elasticsearch
- Configuring Elasticsearch
- Important Elasticsearch configuration
- Important System Configuration
- Bootstrap Checks
- Heap size check
- File descriptor check
- Memory lock check
- Maximum number of threads check
- Max file size check
- Maximum size virtual memory check
- Maximum map count check
- Client JVM check
- Use serial collector check
- System call filter check
- OnError and OnOutOfMemoryError checks
- Early-access check
- G1GC check
- All permission check
- Starting Elasticsearch
- Stopping Elasticsearch
- Adding nodes to your cluster
- Installing X-Pack
- Set up X-Pack
- Configuring X-Pack Java Clients
- X-Pack Settings
- Bootstrap Checks for X-Pack
- Upgrade Elasticsearch
- API Conventions
- Document APIs
- Search APIs
- Aggregations
- Metrics Aggregations
- Avg Aggregation
- Weighted Avg Aggregation
- Cardinality Aggregation
- Extended Stats Aggregation
- Geo Bounds Aggregation
- Geo Centroid Aggregation
- Max Aggregation
- Min Aggregation
- Percentiles Aggregation
- Percentile Ranks Aggregation
- Scripted Metric Aggregation
- Stats Aggregation
- Sum Aggregation
- Top Hits Aggregation
- Value Count Aggregation
- Bucket Aggregations
- Adjacency Matrix Aggregation
- Auto-interval Date Histogram Aggregation
- Intervals
- Children Aggregation
- Composite Aggregation
- Date Histogram Aggregation
- Date Range Aggregation
- Diversified Sampler Aggregation
- Filter Aggregation
- Filters Aggregation
- Geo Distance Aggregation
- GeoHash grid Aggregation
- Global Aggregation
- Histogram Aggregation
- IP Range Aggregation
- Missing Aggregation
- Nested Aggregation
- Range Aggregation
- Reverse nested Aggregation
- Sampler Aggregation
- Significant Terms Aggregation
- Significant Text Aggregation
- Terms Aggregation
- Pipeline Aggregations
- Avg Bucket Aggregation
- Derivative Aggregation
- Max Bucket Aggregation
- Min Bucket Aggregation
- Sum Bucket Aggregation
- Stats Bucket Aggregation
- Extended Stats Bucket Aggregation
- Percentiles Bucket Aggregation
- Moving Average Aggregation
- Moving Function Aggregation
- Cumulative Sum Aggregation
- Bucket Script Aggregation
- Bucket Selector Aggregation
- Bucket Sort Aggregation
- Serial Differencing Aggregation
- Matrix Aggregations
- Caching heavy aggregations
- Returning only aggregation results
- Aggregation Metadata
- Returning the type of the aggregation
- Metrics Aggregations
- Indices APIs
- Create Index
- Delete Index
- Get Index
- Indices Exists
- Open / Close Index API
- Shrink Index
- Split Index
- Rollover Index
- Put Mapping
- Get Mapping
- Get Field Mapping
- Types Exists
- Index Aliases
- Update Indices Settings
- Get Settings
- Analyze
- Index Templates
- Indices Stats
- Indices Segments
- Indices Recovery
- Indices Shard Stores
- Clear Cache
- Flush
- Refresh
- Force Merge
- cat APIs
- Cluster APIs
- Query DSL
- Mapping
- Analysis
- Anatomy of an analyzer
- Testing analyzers
- Analyzers
- Normalizers
- Tokenizers
- Standard Tokenizer
- Letter Tokenizer
- Lowercase Tokenizer
- Whitespace Tokenizer
- UAX URL Email Tokenizer
- Classic Tokenizer
- Thai Tokenizer
- NGram Tokenizer
- Edge NGram Tokenizer
- Keyword Tokenizer
- Pattern Tokenizer
- Char Group Tokenizer
- Simple Pattern Tokenizer
- Simple Pattern Split Tokenizer
- Path Hierarchy Tokenizer
- Path Hierarchy Tokenizer Examples
- Token Filters
- Standard Token Filter
- ASCII Folding Token Filter
- Flatten Graph Token Filter
- Length Token Filter
- Lowercase Token Filter
- Uppercase Token Filter
- NGram Token Filter
- Edge NGram Token Filter
- Porter Stem Token Filter
- Shingle Token Filter
- Stop Token Filter
- Word Delimiter Token Filter
- Word Delimiter Graph Token Filter
- Multiplexer Token Filter
- Conditional Token Filter
- Predicate Token Filter Script
- Stemmer Token Filter
- Stemmer Override Token Filter
- Keyword Marker Token Filter
- Keyword Repeat Token Filter
- KStem Token Filter
- Snowball Token Filter
- Phonetic Token Filter
- Synonym Token Filter
- Synonym Graph Token Filter
- Compound Word Token Filters
- Reverse Token Filter
- Elision Token Filter
- Truncate Token Filter
- Unique Token Filter
- Pattern Capture Token Filter
- Pattern Replace Token Filter
- Trim Token Filter
- Limit Token Count Token Filter
- Hunspell Token Filter
- Common Grams Token Filter
- Normalization Token Filter
- CJK Width Token Filter
- CJK Bigram Token Filter
- Delimited Payload Token Filter
- Keep Words Token Filter
- Keep Types Token Filter
- Exclude mode settings example
- Classic Token Filter
- Apostrophe Token Filter
- Decimal Digit Token Filter
- Fingerprint Token Filter
- Minhash Token Filter
- Remove Duplicates Token Filter
- Character Filters
- Modules
- Index Modules
- Ingest Node
- Pipeline Definition
- Ingest APIs
- Accessing Data in Pipelines
- Conditional Execution in Pipelines
- Handling Failures in Pipelines
- Processors
- Append Processor
- Bytes Processor
- Convert Processor
- Date Processor
- Date Index Name Processor
- Dissect Processor
- Drop Processor
- Dot Expander Processor
- Fail Processor
- Foreach Processor
- Grok Processor
- Gsub Processor
- Join Processor
- JSON Processor
- KV Processor
- Lowercase Processor
- Pipeline Processor
- Remove Processor
- Rename Processor
- Script Processor
- Set Processor
- Set Security User Processor
- Split Processor
- Sort Processor
- Trim Processor
- Uppercase Processor
- URL Decode Processor
- SQL Access
- Monitor a cluster
- Rolling up historical data
- Set up a cluster for high availability
- Secure a cluster
- Overview
- Configuring security
- Encrypting communications in Elasticsearch
- Encrypting communications in an Elasticsearch Docker Container
- Enabling cipher suites for stronger encryption
- Separating node-to-node and client traffic
- Configuring an Active Directory realm
- Configuring a file realm
- Configuring an LDAP realm
- Configuring a native realm
- Configuring a PKI realm
- Configuring a SAML realm
- Configuring a Kerberos realm
- FIPS 140-2
- Security settings
- Security files
- Auditing settings
- How security works
- User authentication
- Built-in users
- Internal users
- Realms
- Realm chains
- Active Directory user authentication
- File-based user authentication
- LDAP user authentication
- Native user authentication
- PKI user authentication
- SAML authentication
- Kerberos authentication
- Integrating with other authentication systems
- Enabling anonymous access
- Controlling the user cache
- Configuring SAML single-sign-on on the Elastic Stack
- User authorization
- Auditing security events
- Encrypting communications
- Restricting connections with IP filtering
- Cross cluster search, tribe, clients, and integrations
- Tutorial: Getting started with security
- Tutorial: Encrypting communications
- Troubleshooting
- Can’t log in after upgrading to 6.5.4
- Some settings are not returned via the nodes settings API
- Authorization exceptions
- Users command fails due to extra arguments
- Users are frequently locked out of Active Directory
- Certificate verification fails for curl on Mac
- SSLHandshakeException causes connections to fail
- Common SSL/TLS exceptions
- Common Kerberos exceptions
- Common SAML issues
- Internal Server Error in Kibana
- Setup-passwords command fails due to connection failure
- Failures due to relocation of the configuration files
- Limitations
- Alerting on Cluster and Index Events
- Command line tools
- How To
- Testing
- Glossary of terms
- X-Pack APIs
- Info API
- Cross-cluster replication APIs
- Explore API
- Licensing APIs
- Migration APIs
- Machine learning APIs
- Add events to calendar
- Add jobs to calendar
- Close jobs
- Create calendar
- Create datafeeds
- Create filter
- Create jobs
- Delete calendar
- Delete datafeeds
- Delete events from calendar
- Delete filter
- Delete forecast
- Delete jobs
- Delete jobs from calendar
- Delete model snapshots
- Find file structure
- Flush jobs
- Forecast jobs
- Get calendars
- Get buckets
- Get overall buckets
- Get categories
- Get datafeeds
- Get datafeed statistics
- Get influencers
- Get jobs
- Get job statistics
- Get machine learning info
- Get model snapshots
- Get scheduled events
- Get filters
- Get records
- Open jobs
- Post data to jobs
- Preview datafeeds
- Revert model snapshots
- Start datafeeds
- Stop datafeeds
- Update datafeeds
- Update filter
- Update jobs
- Update model snapshots
- Rollup APIs
- Security APIs
- Authenticate
- Change passwords
- Clear cache
- Clear roles cache
- Create or update application privileges
- Create or update role mappings
- Create or update roles
- Create or update users
- Delete application privileges
- Delete role mappings
- Delete roles
- Delete users
- Disable users
- Enable users
- Get application privileges
- Get role mappings
- Get roles
- Get token
- Get users
- Has privileges
- Invalidate token
- SSL certificate
- Watcher APIs
- Definitions
- Release Highlights
- Breaking changes
- Release Notes
- Elasticsearch version 6.5.4
- Elasticsearch version 6.5.3
- Elasticsearch version 6.5.2
- Elasticsearch version 6.5.1
- Elasticsearch version 6.5.0
- Elasticsearch version 6.4.3
- Elasticsearch version 6.4.2
- Elasticsearch version 6.4.1
- Elasticsearch version 6.4.0
- Elasticsearch version 6.3.2
- Elasticsearch version 6.3.1
- Elasticsearch version 6.3.0
- Elasticsearch version 6.2.4
- Elasticsearch version 6.2.3
- Elasticsearch version 6.2.2
- Elasticsearch version 6.2.1
- Elasticsearch version 6.2.0
- Elasticsearch version 6.1.4
- Elasticsearch version 6.1.3
- Elasticsearch version 6.1.2
- Elasticsearch version 6.1.1
- Elasticsearch version 6.1.0
- Elasticsearch version 6.0.1
- Elasticsearch version 6.0.0
- Elasticsearch version 6.0.0-rc2
- Elasticsearch version 6.0.0-rc1
- Elasticsearch version 6.0.0-beta2
- Elasticsearch version 6.0.0-beta1
- Elasticsearch version 6.0.0-alpha2
- Elasticsearch version 6.0.0-alpha1
- Elasticsearch version 6.0.0-alpha1 (Changes previously released in 5.x)
IMPORTANT: No additional bug fixes or documentation updates
will be released for this version. For the latest information, see the
current release documentation.
Elasticsearch version 6.0.0-alpha1
editElasticsearch version 6.0.0-alpha1
editBreaking Changes
edit- Allocation
-
-
Remove
cluster.routing.allocation.snapshot.relocation_enabled
setting #20994
-
Remove
- Analysis
- CAT API
- CRUD
- Cluster
- Core
- Geo
- Index APIs
- Index Templates
- Java API
- Mapping
- Network
- Packaging
- Percolator
-
- Remove deprecated percolate and mpercolate apis #22331
- Plugin Delete By Query
- Plugin Discovery EC2
- Plugin Lang JS
- Plugin Mapper Attachment
- Plugin Repository Azure
- Plugin Repository S3
- Query DSL
-
-
Remove deprecated
minimum_number_should_match
in BoolQueryBuilder #22416 - Remove support for empty queries #22092 (issue: #17624)
- Remove deprecated query names: in, geo_bbox, mlt, fuzzy_match and match_fuzzy #21852
-
The
terms
query should always map to a LuceneTermsQuery
. #21786 - Be strict when parsing values searching for booleans #21555 (issue: #21545)
- Remove collect payloads parameter #20385
-
Remove deprecated
- REST
-
- Remove ldjson support and document ndjson for bulk/msearch #23049 (issue: #23025)
- Enable strict duplicate checks for all XContent types #22225 (issues: #19614, #22073)
- Enable strict duplicate checks for JSON content #22073 (issue: #19614)
- Remove lenient stats parsing #21417 (issues: #20722, #21410)
- Remove allow unquoted JSON #20388 (issues: #17674, #17801)
- Remove FORCE version_type #20377 (issue: #19769)
- Scripting
- Search
- Security
-
-
A new bootstrap check enforces that default passwords are disabled for the
built-in users when running in
production mode.
You must set
xpack.security.authc.accept_default_password
tofalse
in yourelasticsearch.yml
. For more information, see Security settings and User authentication. - A new configuration setting is available to disable support for the default password ("changeme"). For more information, see Disable default password functionality.
-
A new bootstrap check enforces that default passwords are disabled for the
built-in users when running in
production mode.
You must set
- Sequence IDs
- Shadow Replicas
- Watcher
-
- The built-in HTTP client used in webhooks, the http input and the http email attachment has been replaced. This results in the need to always escape all parts of an URL.
- The new built-in HTTP client also enforces a maximum request size, which defaults to 10mb.
Breaking Java Changes
edit- Java API
- Network
-
- Simplify TransportAddress #20798
Deprecations
edit- Index Templates
-
- Restore deprecation warning for invalid match_mapping_type values #22304
- Internal
New Features
editEnhancements
edit- Aggregations
- Analysis
- Bulk
-
- Simplify bulk request execution #20109
- CRUD
- Cluster
- Core
-
- Remove connect SocketPermissions from core #22797
- Add repository-url module and move URLRepository #22752 (issue: #22116)
- Remove accept SocketPermissions from core #22622 (issue: #22116)
- Move IfConfig.logIfNecessary call into bootstrap #22455 (issue: #22116)
- Remove artificial default processors limit #20874 (issue: #20828)
- Simplify write failure handling #19105 (issue: #20109)
- Engine
-
- Fill missing sequence IDs up to max sequence ID when recovering from store #24238 (issue: #10708)
- Use sequence numbers to identify out of order delivery in replicas & recovery #24060 (issue: #10708)
- Add replica ops with version conflict to translog #22626
- Clarify global checkpoint recovery #21934 (issue: #21254)
- Internal
- Java High Level REST Client
-
- Add info method to High Level Rest client #23350
- Add support for named xcontent parsers to high level REST client #23328
- Add BulkRequest support to High Level Rest client #23312
- Add UpdateRequest support to High Level Rest client #23266
- Add delete API to the High Level Rest Client #23187
- Add Index API to High Level Rest Client #23040
- Add get/exists method to RestHighLevelClient #22706
- Add fromxcontent methods to delete response #22680 (issue: #22229)
- Add REST high level client gradle submodule and first simple method #22371
- Java REST Client
- Mapping
- Network
- Plugin Discovery EC2
- Plugin Repository HDFS
- Plugins
- Recovery
- Search
- Sequence IDs
-
- Block global checkpoint advances when recovering #24404 (issue: #10708)
- Add primary term to doc write response #24171 (issue: #10708)
- Preserve multiple translog generations #24015 (issue: #10708)
- Introduce translog generation rolling #23606 (issue: #10708)
- Replicate write failures #23314
- Introduce sequence-number-aware translog #22822 (issue: #10708)
- Introduce translog no-op #22291 (issue: #10708)
- Tighten sequence numbers recovery #22212 (issue: #10708)
- Add BWC layer to seq no infra and enable BWC tests #22185 (issue: #21670)
- Add internal _primary_term doc values field, fix _seq_no indexing #21637 (issues: #10708, #21480)
- Add global checkpoint to translog checkpoints #21254
- Sequence numbers commit data for Lucene uses Iterable interface #20793 (issue: #10708)
- Simplify GlobalCheckpointService and properly hook it for cluster state updates #20720
- Stats
- Store
-
- Remote support for lucene versions without checksums #24021
- Suggesters
- Task Manager
Bug Fixes
edit- Ingest
- Inner Hits
- Internal
-
- Fix handling of document failure exception in InternalEngine #22718
- Plugin Ingest Attachment
- Plugin Repository S3
- Sequence IDs
- Snapshot/Restore
- Translog
-
- Fix Translog.Delete serialization for sequence numbers #22543
- Watcher
-
- The HTTP client respects timeouts now and does not get stuck leading to stuck watches.
Regressions
editUpgrades
editOn this page
Was this helpful?
Thank you for your feedback.