# Issue: record-too-big error not cascading to aerospike-spark connector

**URL:** https://discuss.aerospike.com/t/issue-record-too-big-error-not-cascading-to-aerospike-spark-connector/12040
**Category:** Spark
**Created:** [January 21, 2025, 12:58pm UTC](https://discuss.aerospike.com/t/issue-record-too-big-error-not-cascading-to-aerospike-spark-connector/12040 "2025-01-21T12:58:53Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![Abhishek\_Singla](https://sea1.discourse-cdn.com/flex019/user_avatar/discuss.aerospike.com/abhishek_singla/32/2299_2.png) [@Abhishek\_Singla](https://discuss.aerospike.com/u/Abhishek_Singla)
#### Post date: [January 21, 2025, 12:58pm UTC](https://discuss.aerospike.com/t/issue-record-too-big-error-not-cascading-to-aerospike-spark-connector/12040/1 "2025-01-21T12:58:53Z")

</div>

Server Version: 6.3

Spark Version: 3.1.2

Writing records via Spark using aerospike-spark connector. Writes are not getting reflected on Aerospike server but no errors observed in Spark job.

```auto
        <dependency>
            <groupId>com.aerospike</groupId>
            <artifactId>aerospike-spark_2.12</artifactId>
            <version>4.5.1-spark3.1-scala2.12-allshaded</version>
        </dependency>

```

I can see `record-too-big` error in Aerospike Server logs but nothing on client side. How could this error be cascaded to spark connector which could eventually fail Spark Job?

```auto
INFO (info): (ticker.c:1051) {test} special-errors: key-busy 0 record-too-big 1 lost-conflict (0,0)

```

Config:

```auto
namespace test {
  default-ttl 30d # use 0 to never expire/evict.
  memory-size 1G
  nsup-period 120
  replication-factor 1
  storage-engine device {
    data-in-memory false # if true, in-memory, persisted to the filesystem
    file /opt/aerospike/data/test.dat
    filesize 4G
    read-page-cache true
  }
}

```

```auto
{
  "aerospike.seedhost": "localhost",
  "aerospike.port": "3000",
  "aerospike.namespace": "test",
  "aerospike.set": "test_set",
  "aerospike.updateByKey": "pk",
  "aerospike.keyColumn": "pk",
  "aerospike.write.mode": "REPLACE",
  "aerospike.sendKey": "true",
  "aerospike.commitLevel": "CommitLevel.COMMIT_ALL"
}

```

Thanks

---

<div class="post-metadata">

### Author: ![Abhishek\_Singla](https://sea1.discourse-cdn.com/flex019/user_avatar/discuss.aerospike.com/abhishek_singla/32/2299_2.png) [@Abhishek\_Singla](https://discuss.aerospike.com/u/Abhishek_Singla)
#### Post date: [January 21, 2025, 7:44pm UTC](https://discuss.aerospike.com/t/issue-record-too-big-error-not-cascading-to-aerospike-spark-connector/12040/2 "2025-01-21T19:44:31Z")

</div>

@mcoberly I believe it might be related to [this](https://discuss.aerospike.com/t/aerospike-connect-for-spark-2-8-0-july-14-2021/8633#bug-fixes-3)

> - [CONNECTOR-205] - Filter out records that breach write block size in Aerospike via Spark Connector.

Where could I find more on `CONNECTOR-205`?

Thanks

---

<div class="post-metadata">

### Author: ![Joe\_Martin](https://sea1.discourse-cdn.com/flex019/user_avatar/discuss.aerospike.com/joe_martin/32/1013_2.png) [@Joe\_Martin](https://discuss.aerospike.com/u/Joe_Martin)
#### Post date: [January 27, 2025, 3:12am UTC](https://discuss.aerospike.com/t/issue-record-too-big-error-not-cascading-to-aerospike-spark-connector/12040/3 "2025-01-27T03:12:56Z")

</div>

Hi Abhishek, Are you able to file a support case?

---

<div class="post-metadata">

### Author: ![Abhishek\_Singla](https://sea1.discourse-cdn.com/flex019/user_avatar/discuss.aerospike.com/abhishek_singla/32/2299_2.png) [@Abhishek\_Singla](https://discuss.aerospike.com/u/Abhishek_Singla)
#### Post date: [January 27, 2025, 7:56pm UTC](https://discuss.aerospike.com/t/issue-record-too-big-error-not-cascading-to-aerospike-spark-connector/12040/4 "2025-01-27T19:56:24Z")

</div>

@Joe_Martin Have filed a support case. Will update here once it’s resolved.

Thanks

---

<div class="post-metadata">

### Author: ![system](https://sea1.discourse-cdn.com/flex019/user_avatar/discuss.aerospike.com/system/32/2274_2.png) [@system](https://discuss.aerospike.com/u/system)
#### Post date: [January 27, 2026, 7:57pm UTC](https://discuss.aerospike.com/t/issue-record-too-big-error-not-cascading-to-aerospike-spark-connector/12040/5 "2026-01-27T19:57:22Z")

</div>

This topic was automatically closed 365 days after the last reply. New replies are no longer allowed.