Elasticsearch Hadoop breaking changes
editElasticsearch Hadoop breaking changes
editThis list summarizes the most important breaking changes in Elasticsearch Hadoop 8.0.1. For the complete list, go to Elasticsearch Hadoop breaking changes.
The default scroll size is now 1000
editWe’ve increased the es.scroll.size default from 50 to 1000. If you deploy
ES-hadoop in a low memory environment, consider lowering es.scroll.size to
avoid issues.
Spark 1.x support is deprecated
editSpark 1.x is no longer maintained. Spark 2 and Spark 3 are still supported.
Scala 2.10 support for Spark 2.x is deprecated
editSpark deprecated support for Scala 2.10 in the Spark 2.0.0 release and removed it in the 2.3.0 release. Scala 2.11 and 2.12 are supported for Spark 2.x.
Hadoop 1.x support is deprecated
editHadoop 1.x is no longer maintained. Support for it has not been tested since {eh} 6.0. Support is now formally deprecated. Hadoop 2 and Hadoop 3 are supported.
Apache Pig support is deprecated
editApache Pig is no longer maintained.
Apache Storm support is deprecated
editApache Storm has not been a popular Elasticsearch integration.