What is the OpenSearch project?
The OpenSearch project, created by Amazon, is a forked search project based on old versions of Elasticsearch and Kibana. These projects were created primarily to support Amazon OpenSearch Service (formerly Amazon Elasticsearch Service). Amazon OpenSearch Service will not deliver current or future releases of Elasticsearch and Kibana.
While the forked project was not production-ready at the time of initial announcement, a generally available (GA) release of OpenSearch is now available.
Performance testing
Elasticsearch outperforms OpenSearch by 40%–140% while using fewer resources and is 2x–12x faster when using vector search. With synthetic _source, we see a drastic reduction in metrics and logs storage footprint of up to 65%. Dive into our article comparing them across crucial areas. Make the right decision for your search, observability, or security use cases.
Our findings were validated by a third party. An assessment was made of Elasticsearch's superior performance in speed, scale, resource optimization, and cost efficiency.
Are Elasticsearch and Kibana open source?
Yes, Elasticsearch and Kibana are open source. Open source is more than a way to distribute software — it's key to building the best product possible. Each download helps improve and secure Elasticsearch as users scrutinize, test, and extend the code across diverse environments. Our shift to an AGPL license reinforces our commitment to open source, a principle that has driven us from the start. Built on Apache Lucene, we contribute to OpenTelemetry and offer open source ingest with Logstash and Beats. This fosters a community of innovation and collaboration, ensuring Elasticsearch continues to evolve in new and exciting ways.
While the previous change from the Apache License to the Elastic License v2 was a necessary response to the continued non-collaborative engagement AWS pursued with Elasticsearch, our commitment to the open source community never wavered. Now, by adopting the AGPL, we can proudly return to our roots, removing any doubts about our dedication to open source.
Find out more about why Elastic believes in open source.
Why was the OpenSearch project fork created from Elasticsearch and Kibana?
As of release 7.11 (in February 2021), Elastic changed the license of our products to the Elastic License v2 (ELv2) and SSPL. This was a response to Amazon’s non-collaborative behavior and misuse of our trademark.
Are Elasticsearch and Kibana better than OpenSearch?
Elasticsearch outperforms in speed, scale, and efficiency, achieving the following results across standard customer use cases:
- 76% faster simple text queries
- 140% faster sorting
- 81% faster date histogram aggregations
- 108% faster terms queries
- 37% less resource utilization
For vector search, Elasticsearch outperforms even more, offering 2x–12x faster performance on average.
Elasticsearch was named a Leader in the 2022 Gartner® Magic Quadrant™ for Insight Engines report. A study by Forrester Consulting revealed that Elasticsearch customers realize a 293% return on investment improvement within three years including increased profitability, employee and IT productivity gains, and license and recruiting cost savings.
Elasticsearch and Kibana also deliver superior product capabilities and maturity, a cloud agnostic product that is deeply integrated into multiple clouds, and technology expertise built on a decade of working on these products.
Elasticsearch and Kibana offer superior product capabilities and maturity
Search and data analytics are rapidly evolving technology domains, and products in this space reflect this pace of technology progress. Elasticsearch keeps up with this momentum and delivers multiple architectural and functionality enhancements to its search experience with every release.
In 2018, Elastic made an intentional decision to release new feature developments under the Elastic License. These new features include:
- Drag-and-drop data visualization with Elastic Maps and Kibana Lens
- Security analytics and threat hunting with Elastic Security for SIEM and endpoint security
- Elastic web crawler
- A full observability suite with an integrated experience including APM, logging, and analysis
- A powerful and proven correlation language (EQL) which powers our ready to use detection engine
- Broad architectural enhancements like data tiers and machine learning-based anomaly detection, built on years of research and iterations against real world use cases
These, as well as other major features introduced over the last three years, were built and delivered under the Elastic License and are not available for Amazon or the OpenSearch project.
Elasticsearch and Kibana are cloud-neutral by design
Elastic developed Elasticsearch, Kibana, and the ELK Stack under strict pillars of cloud and location neutrality. All major capabilities are built into Elastic (ELK) Stack, and available to all customers, without taking on any proprietary dependencies. A key example of this is machine learning, built into Elasticsearch and readily available to all customers, without dependencies on any specific proprietary external services. We do not believe this to be the case with the new forks, which are primarily built for and governed by AWS.
In contrast, Elastic offers Elastic Cloud in over 40 regions across multiple cloud providers — including Microsoft, Google, and AWS — with built-in integrations for multiple cloud and on premises environments.
Elasticsearch and Kibana are enabled by Elastic’s decade-long search technology experience and investment
The momentum of innovations in Elasticsearch is enabled by the decade-long experience and expertise Elastic has developed and invested into building and operating Elasticsearch and Kibana. Elastic created these products, and we have over 800 engineers who are dedicated to innovating on these products. We make these products available to customers on premises and on major clouds, offering a consistent and integrated experience across these deployment choices. Elastic engineers have been the technical leaders on Elasticsearch and have represented the overwhelming majority of contributions to the product (over 96% based on this estimate). To put this in perspective, GitHub statistics show that out of the tens of thousands of commits to Elasticsearch between 2010 and 2021, AWS contributed only a handful.
AWS and Amazon OpenSearch Service, like all other members in the community, have benefited from the momentum of Elasticsearch and Kibana innovations. But Amazon does not have the deep technology expertise around search that enables Elastic to innovate on these products. As a notable technology leader said, “there is no compression algorithm for experience.” The OpenSearch project will not have access to the expertise and experience that have powered Elasticsearch for the last 10 years, and this will be felt in the pace of innovation seen in these projects.
How is OpenSearch good for AWS customers?
To put it bluntly, for a company that puts customers above all, this move clearly hurts Amazon customers by inflicting on them avoidable changes and subpar products rather than collaborating with Elastic to create a better user experience. Other cloud providers around the world, including Google and Microsoft, collaborate with Elastic to bring a complete, consistent, and unified Elasticsearch experience to their customers.
How is the OpenSearch project related to Amazon Elasticsearch Service (now Amazon OpenSearch Service)? Are these the same?
AWS has replaced Amazon Elasticsearch Service with its "successor," Amazon OpenSearch Service. Amazon Elasticsearch Service was launched in 2015, based on Elasticsearch version 1.5.2. This was not a collaboration with Elastic, as we have highlighted in previous blogs, despite Amazon's suggestions misrepresenting the engagement. With the change of name to Amazon OpenSearch Service, the service will no longer offer current or future versions of Elasticsearch, and will instead offer older versions of open source Elasticsearch (releases prior to 7.10.2) and OpenSearch.
Today, Amazon OpenSearch Service includes several proprietary features that are not available in open source. These include recent announcements like AWS UltraWarm and Auto-Tune, which are proprietary features not available in the forked open source projects. We expect this to be the case moving forward as well, and that the Amazon service will not be the same as the OpenSearch project.
Migrate from Amazon OpenSearch Service
Migrate to Elastic Cloud on AWS, the official Elasticsearch service on AWS from Elastic.
Get started with Elastic Cloud today
Start your free Elastic Cloud on AWS trial today. No credit card required.
Amazon, AWS, OpenSearch and other related marks are trademarks of Amazon.com, Inc. or its affiliates. All other brand names, product names, or trademarks belong to their respective owners.