FAQ - Should parameters be set on the fly with the Aerospike Spark Connector?
There are certain Aerospike parameters that can be passed to a Spark session at any stage of session lifecycle, as long as it happens before using an Aerospike specific call. Examples of these parameters would be
aerospike.namespace. Should these be treated as parameters that can be set on the fly?
While it is possible to set these parameters during runtime, the pool of clients is instantiated from the settings and keyed by the hosts. When these settings are changed the pool will keep filling with more clients, which may not be desirable. For this reason, setting these parameters on the fly, while possible, is not recommended.
SPARK CONNECTOR PARAMETER RUNTIME