What can i do if both write and read operations are in the same Kafka topic

Connectors Kafka
1

Is it possible to dynamically set operation type? https://www.aerospike.com/docs/connectors/enterprise/kafka/inbound/configuration/topics.html#aerospike-operation-config

2

I guess you meant write and delete operations (rather than write and read operations). I am not an expert, and not sure actually. It seems that it may require 2 configs for the same topic, one for writes and one for deletes. Did you try that?

3

You’r right i was talking about writes and deletes. I can also split the topic to two topics but the reason I’m using one topic (with one partition) is that the order is import For example if I’ve two operations

  1. write 1 → "one
  2. delete key 1

if the order is 1) and then 2) the end result will be no record. and if the order is 2) and than 1) the end result will be 1->“one”

4

Seems like indeed, at this point, one would have to use 2 topics. But I guess even with 1 topic, the ordering can be altered… but probably less likely than with 2 topics. This is something that may be improved in a future version, though, from what I understood when checking internally…

1 Like