Aerospike Connect for Spark 2.8.1 (January 3, 2022)

Announcements Releases (Server, Client & Tools)
1

Aerospike Connect for Spark version 2.8.1 was released on January 3, 2022.

  • Apache Spark 2.4.8 is the last release in Spark’s 2.x.y branch. No more 2.x.y releases of Spark are expected, even for bug fixes. Therefore, 2.8.0 is the last version of Aerospike Connect for Spark 2.8 that will be compatible with that Spark branch. Aerospike has ceased developing new features to support Spark 2.x.y. However, bug fixes will be available until October 14, 2022. If you are using Apache Spark 2.4.x and Aerospike Connect for Spark 2.8.0 or earlier, please plan to move to Apache Spark 3.0.x and use Aerospike Connect for Spark version 3.x.y.
  • Supported until April 2, 2023.
  • Tested with Apache Spark 3.0.3, Scala 2.12.11 & Python 3.7.
  • Minimum supported Aerospike Server version 5.0.

Bug Fixes

  • [CONNECTOR-312] - Update spark connectors with latest java clients to address CLIENT-1637 (“partition unavailable” errors occur).

Known Issues

  • DataSource v2 API does not support the SQL statement INSERT INTO a temp view. Use DataFrame syntax for equivalent functionality.
  • aerospike.write.mode flag overrides Apache Spark write mode.
  • Spark connector stores spark DateType and TimestampType as long. In Aerojoin API calls convert these types to long.