# \#spark

**URL:** https://discuss.aerospike.com/tag/spark/56.md

[Latest](https://discuss.aerospike.com/latest.md) · [Categories](https://discuss.aerospike.com/categories.md) · [Tags](https://discuss.aerospike.com/tags.md)

---

## [Spark aerospike connector support for opensource aerospike](https://discuss.aerospike.com/t/spark-aerospike-connector-support-for-opensource-aerospike/11443)

<div class="topic-metadata">

**Author:** [@nitin12388](https://discuss.aerospike.com/u/nitin12388)\
**Replies:** 0\
**Last updated:** [September 4, 2024, 7:36pm UTC](https://discuss.aerospike.com/t/spark-aerospike-connector-support-for-opensource-aerospike/11443 "2024-09-04T19:36:46Z")

</div>

Can anyone tell me if i can use spark aerospike connector for opensource aerospike ?

---

## [Loading Data from Aerospike Failing with Spark Connector](https://discuss.aerospike.com/t/loading-data-from-aerospike-failing-with-spark-connector/11230)

<div class="topic-metadata">

**Author:** [@prithu2212](https://discuss.aerospike.com/u/prithu2212)\
**Replies:** 8\
**Last updated:** [June 28, 2024, 11:09am UTC](https://discuss.aerospike.com/t/loading-data-from-aerospike-failing-with-spark-connector/11230 "2024-06-28T11:09:31Z")

</div>

I’m using Spark to load data from an Aerospike cluster in to dataframe, process it, and write it to another Aerospike cluster. The data has two bins: one with a List of Strings and another with a Map where the keys are S…

---

## [TLS Configuration in Aerospike Connect Spark Connector](https://discuss.aerospike.com/t/tls-configuration-in-aerospike-connect-spark-connector/10840)

<div class="topic-metadata">

**Author:** [@amanjain08](https://discuss.aerospike.com/u/amanjain08)\
**Replies:** 1\
**Last updated:** [February 22, 2024, 4:14am UTC](https://discuss.aerospike.com/t/tls-configuration-in-aerospike-connect-spark-connector/10840 "2024-02-22T04:14:00Z")

</div>

I am using version 2.8.1 of the Aerospike Spark connector to read data from the Aerospike server. Although our Aerospike server does not require client certificate validation and only needs the tlsName parameter to estab…

---

## [Does Aerospike spark connector (version 3.5.2/3.5.5) supports delete operation?](https://discuss.aerospike.com/t/does-aerospike-spark-connector-version-3-5-2-3-5-5-supports-delete-operation/10293)

<div class="topic-metadata">

**Author:** [@Sumit\_Khaitan](https://discuss.aerospike.com/u/Sumit_Khaitan)\
**Replies:** 2\
**Last updated:** [July 8, 2023, 5:22pm UTC](https://discuss.aerospike.com/t/does-aerospike-spark-connector-version-3-5-2-3-5-5-supports-delete-operation/10293 "2023-07-08T17:22:53Z")

</div>

Does Aerospike spark connector (version 3.5.2/3.5.5) supports delete operation ?

---

## [How to append a object or item to a existing list bin with spark aerospike connector](https://discuss.aerospike.com/t/how-to-append-a-object-or-item-to-a-existing-list-bin-with-spark-aerospike-connector/9762)

<div class="topic-metadata">

**Author:** [@Bali\_Dheeraj\_kumar](https://discuss.aerospike.com/u/Bali_Dheeraj_kumar)\
**Replies:** 3\
**Last updated:** [September 26, 2022, 4:45pm UTC](https://discuss.aerospike.com/t/how-to-append-a-object-or-item-to-a-existing-list-bin-with-spark-aerospike-connector/9762 "2022-09-26T16:45:33Z")

</div>

Hi, I am new to aerospike and I have few doubts. Is there anyway I can append to existing list bin using spark aerospike connector? Can we access the data of objects being written as blobs using java client api with th…

---

## [Recommendations for integrating AS 3.x server with Spark 2.x](https://discuss.aerospike.com/t/recommendations-for-integrating-as-3-x-server-with-spark-2-x/8740)

<div class="topic-metadata">

**Author:** [@Ritesh\_Kumar\_Singh](https://discuss.aerospike.com/u/Ritesh_Kumar_Singh)\
**Replies:** 3\
**Last updated:** [August 24, 2021, 1:01am UTC](https://discuss.aerospike.com/t/recommendations-for-integrating-as-3-x-server-with-spark-2-x/8740 "2021-08-24T01:01:30Z")

</div>

We are currently exploring possible ingestion options using Spark to AS community edition. AS per my understanding, the connectors available are for enterprise edition. And so are there any community accepted ways to go …

---

## [Spark Streaming join with Aerospark RDD](https://discuss.aerospike.com/t/spark-streaming-join-with-aerospark-rdd/4004)

<div class="topic-metadata">

**Author:** [@Gagan\_Agrawal1](https://discuss.aerospike.com/u/Gagan_Agrawal1)\
**Replies:** 10\
**Last updated:** [August 30, 2019, 2:56pm UTC](https://discuss.aerospike.com/t/spark-streaming-join-with-aerospark-rdd/4004 "2019-08-30T14:56:24Z")

</div>

I just came across Aerospike Spark Connector “Aerospark” and thought of using it in our current project for real time stream joins with spark rdd. So my question is can I join streaming rdd with from kafka with Aerospike…

---

## [PredExp Class Serialized](https://discuss.aerospike.com/t/predexp-class-serialized/4985)

<div class="topic-metadata">

**Author:** [@amanmangal](https://discuss.aerospike.com/u/amanmangal)\
**Replies:** 0\
**Last updated:** [March 1, 2018, 4:03pm UTC](https://discuss.aerospike.com/t/predexp-class-serialized/4985 "2018-03-01T16:03:47Z")

</div>

Hi, I am wondering if it makes sense to have PredExp class serialized. I have seen other threads \[1\] and pull requests \[2\] trying to make the Java Client serialized. I understand why that won’t make sense. But having a …

---

## [Set TTL in AeroSpike with Spark](https://discuss.aerospike.com/t/set-ttl-in-aerospike-with-spark/4491)

<div class="topic-metadata">

**Author:** [@tuancoltech](https://discuss.aerospike.com/u/tuancoltech)\
**Replies:** 1\
**Last updated:** [August 14, 2017, 10:23am UTC](https://discuss.aerospike.com/t/set-ttl-in-aerospike-with-spark/4491 "2017-08-14T10:23:06Z")

</div>

Hi guys, I’m new to Aerospike. We are using Aerospike with Spark (Java) for our system. I want to set TTL for a dataframe everytime the data is written to Aerospike. However, I could not find a way to do that even from…

---

## [Using Spark connector for pyspark inside Apache Zeppellin](https://discuss.aerospike.com/t/using-spark-connector-for-pyspark-inside-apache-zeppellin/4079)

<div class="topic-metadata">

**Author:** [@ser0t0nin](https://discuss.aerospike.com/u/ser0t0nin)\
**Replies:** 2\
**Last updated:** [May 10, 2017, 8:21am UTC](https://discuss.aerospike.com/t/using-spark-connector-for-pyspark-inside-apache-zeppellin/4079 "2017-05-10T08:21:34Z")

</div>

Hello everyone! I want to use the aerospark connector for some advanced data science tasks in Apache Zeppelin notebooks with the pyspark interpreter. It seems like finally everything is working, at least i can import th…

---

## [NullPointerException when reading via aerospark](https://discuss.aerospike.com/t/nullpointerexception-when-reading-via-aerospark/3188)

<div class="topic-metadata">

**Author:** [@totalslacker](https://discuss.aerospike.com/u/totalslacker)\
**Replies:** 5\
**Last updated:** [April 10, 2017, 5:45pm UTC](https://discuss.aerospike.com/t/nullpointerexception-when-reading-via-aerospark/3188 "2017-04-10T17:45:01Z")

</div>

I’m very new to aerospike (and fairly new to spark) and am trying to get the two working together, but having some issues… Since I was originally building the aerospark jar away from the db server I built with tests dis…

---

## [How to access Aerospike Set from Hive Query](https://discuss.aerospike.com/t/how-to-access-aerospike-set-from-hive-query/3997)

<div class="topic-metadata">

**Author:** [@prabhu1984](https://discuss.aerospike.com/u/prabhu1984)\
**Replies:** 0\
**Last updated:** [March 26, 2017, 6:07pm UTC](https://discuss.aerospike.com/t/how-to-access-aerospike-set-from-hive-query/3997 "2017-03-26T18:07:14Z")

</div>

Hi, I’m able to read aerospike set using spark-sql and I’m looking a similar way to read from Hive QL. Can you please let me know how to do it? Spark-sql Working: CREATE TEMPORARY TABLE aero USING com.aerospike.spark…

---

## [AeroSpark read performance](https://discuss.aerospike.com/t/aerospark-read-performance/3264)

<div class="topic-metadata">

**Author:** [@Vadim\_Dobroskok](https://discuss.aerospike.com/u/Vadim_Dobroskok)\
**Replies:** 0\
**Last updated:** [August 10, 2016, 7:38am UTC](https://discuss.aerospike.com/t/aerospark-read-performance/3264 "2016-08-10T07:38:13Z")

</div>

I am using latest AeroSpark connector to work with Spark ML. But when i have inserted round 60M records to AeroSpike, i got too big time amount in read operations. For example for fetch round 500K records from set that c…

---

## [Storing tabular/PSV data in Aerospike](https://discuss.aerospike.com/t/storing-tabular-psv-data-in-aerospike/1913)

<div class="topic-metadata">

**Author:** [@Edmon\_Begoli](https://discuss.aerospike.com/u/Edmon_Begoli)\
**Replies:** 2\
**Last updated:** [September 30, 2015, 12:47am UTC](https://discuss.aerospike.com/t/storing-tabular-psv-data-in-aerospike/1913 "2015-09-30T00:47:56Z")

</div>

We are generating medical statistics that show number of medical visits per practice and location. These are psv (pipe separated) files that have: location, practice,physician,num\_visits, charges, date\_of\_service Each …

---

## [Distributed version control system?](https://discuss.aerospike.com/t/distributed-version-control-system/1021)

<div class="topic-metadata">

**Author:** [@skan](https://discuss.aerospike.com/u/skan)\
**Replies:** 15\
**Last updated:** [March 17, 2015, 11:13pm UTC](https://discuss.aerospike.com/t/distributed-version-control-system/1021 "2015-03-17T23:13:52Z")

</div>

Hello. Do you know of any “version control system” or sync tool able to work transparently on files and folders stored on a distributed file system or databases (such as Aerospike)? (or any function already included wit…
