# Aerospike Connect for Spark 3.1.0 (July 21, 2021)

**URL:** <https://discuss.aerospike.com/t/aerospike-connect-for-spark-3-1-0-july-21-2021/8653>\
**Category:** Releases (Server, Client & Tools)\
**Created:** [July 22, 2021, 5:09am UTC](https://discuss.aerospike.com/t/aerospike-connect-for-spark-3-1-0-july-21-2021/8653 "2021-07-22T05:09:05Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![mcoberly](https://sea1.discourse-cdn.com/flex019/user_avatar/discuss.aerospike.com/mcoberly/32/637_2.png) [@mcoberly](https://discuss.aerospike.com/u/mcoberly)\
**Post date:** [July 22, 2021, 5:09am UTC](https://discuss.aerospike.com/t/aerospike-connect-for-spark-3-1-0-july-21-2021/8653/1 "2021-07-22T05:09:06Z")

</div>

[Aerospike Connect for Spark version 3.1.0](https://www.aerospike.com/enterprise/download/connectors/aerospike-spark/notes.html#3.1.0)was released on July 21, 2021.

- Supported until October 21, 2022.
- Tested with Apache Spark 3.0.3, Scala 2.12.11 & Python 3.7.
- Minimum supported Aerospike Server version 5.0.

#### New Features

- [CONNECTOR-247] - Spark connector should persist Map bins as K-Ordered.
- [CONNECTOR-166] - Support batchget queries with digests in Spark Connector.
- [CONNECTOR-142] - Data Sampling using the Spark Connector using [`aerospike.sample.size`](https://download.aerospike.com/docs/connect/processing/spark/configuration.html#properties-related-to-performance) flag.
- [CONNECTOR-142] - Support boolean bins in the Spark Connector (refer to [`aerospike.booleanbin`](https://download.aerospike.com/docs/connect/processing/spark/configuration.html#properties-that-are-optional) in the documentation).

#### Improvements

- This library is an uber shaded jar.
- Migrated from queryPartiton() call to ScanPartitions().
- Update Client version to 5.1.5.
- Migrated to Expressions for scans.
- Pushdown support for Float & Double datatypes.

#### Bug Fixes

- [CONNECTOR-215] - Writes are slower in the Spark Connector v2 version. Introduced a new flag [`aerospike.write.batchsize`](https://download.aerospike.com/docs/connect/processing/spark/configuration.html#properties-related-to-performance) to control write throughput.

#### Known Issues

- This connector release shades all internal libraries. Please update application build files accordingly.
- Spark connector stores spark DateType and TimestampType as long. In Aerojoin API calls convert aforementioned types to Longtype.
- DataSource v2 API does not support the SQL statement `INSERT INTO` a temp view. Use DataFrame syntax for equivalent functionality.
- [CONNECTOR-312] - Update spark connectors with latest java clients to address CLIENT-1637 (“partition unavailable” errors occur). **Fixed in version [3.1.1](https://download.aerospike.com/enterprise/download/connectors/aerospike-spark/notes.html#3.1.1)**.

#### Updates

- The default value of flag [`aerospike.partition.factor`](https://download.aerospike.com/docs/connect/processing/spark/configuration.html#properties-related-to-performance) have changed from 12 to 8. Please update your application accordingly.