Elasticsearch for Apache Hadoop version 8.0.0-rc1

edit

Elasticsearch for Apache Hadoop version 8.0.0-rc1

edit

Enhancements

edit
Build
  • Setting Java boot classpath so that Scala 2.10 works on Gradle 7.2 #1800
  • Build Hadoop with Java 17 #1808
  • Update Gradle wrapper to 7.3 #1809
  • Update log4j version #1828
Serialization
  • Add support for the date_nanos field type #1803
Spark
  • Add support for Spark 3.1 and 3.2 #1807

Bug fixes

edit
Spark
  • Resolve saveToEs saves case classes fields with NULL values #1478
  • Correctly reading empty fields in as null rather than throwing exception #1816
  • Setting es.read.fields.include could throw a NullPointerException in older spark version #1822