Let’s say we have a records with thousands of bins and stored in persistence mode only (record size < 1MB). Set size (~20GB). And the query (TPS ~100/sec) is made by selecting 50 bins at a time for the given record key ie select bin1, bin5, bin 12, …, binX from set where key = ‘’.
Does Aerosike load entire record (fat) in memory and return filtered data?
Yes. Stored in persistence mode → on disk or SSD - its going to first read the entire record in RAM and then return to the client the selected bins - so you save on network bandwidth only.