I have a set that will contain 15 Million to 20 Million records. My keys are also stored in a bin.
I have to get all the keys at once in my application. So, I fetch the bin with all the keys stored in it. Then fetch the records in a batched manner using sets of the keys returned.
The problem is that my keys are huge - of the order of 50-64 bytes each. Fetching all of them at once causes my application to crash.
Is there any API to get all the 160 bit digests instead of the actual keys(the bin, in my case)?