This my java client configuration
maxCommandsInProcess = 70 maxCommandsInQueue = 5000 maxConnsPerNode = 300 (default) NioEventLoops with size 4
Number of nodes is
1. With this configuration I am making 20 concurrent requests with each request doing
50,000 updates (Write policy REPLACE). Throttling on the code is done the following way
for each request (with 50,000 update commands) batch the update commands in batches of 900 process these 900 update commands asynchronously(using async methods provided by the java client) wait for all the 900 to complete repeat
Note that the above logic is applied concurrently to 20 such requests.
This process takes about
~ 55 seconds for each request (50,000 updates) to complete. Is there anything I can do better (in terms of client library configuration, concurrency etc) with everything else remaining the same.