Benchmarking Aerospike on my MacBook [Getting very poor results]


#1

Hi

I have followed this link to install Aerospike on my macbook, using Vagrant and VirtualBox.

I am running benchmarks following this link.

But I am getting very poor results.

ashishbhutani|benchmarks$ ./run_benchmarks   -n test -k 10000000 -S 1 -o S:50 -w RU,90 -z 40
Benchmark: 127.0.0.1:3000, namespace: test, set: testset, threads: 40, workload: READ_UPDATE
read: 90% (all bins: 100%, single bin: 0%), write: 10% (all bins: 100%, single bin: 0%)
keys: 10000000, start key: 1, transactions: 0, bins: 1, random values: false, throughput: unlimited
read policy: timeout: 0, maxRetries: 1, sleepBetweenRetries: 500, consistencyLevel: CONSISTENCY_ONE, reportNotFound: false
write policy: timeout: 0, maxRetries: 1, sleepBetweenRetries: 500, commitLevel: COMMIT_ALL
bin[0]: string[50]
debug: false
2015-03-23 21:53:55.655 INFO Thread 1 Add node BB94D6CD6270008 127.0.0.1:3000
2015-03-23 21:53:55.701 write(tps=1 timeouts=0 errors=0) read(tps=9 timeouts=0 errors=0) total(tps=10 timeouts=0 errors=0)
2015-03-23 21:53:56.713 write(tps=396 timeouts=0 errors=0) read(tps=3628 timeouts=0 errors=0) total(tps=4024 timeouts=0 errors=0)
2015-03-23 21:53:57.717 write(tps=617 timeouts=0 errors=0) read(tps=5386 timeouts=0 errors=0) total(tps=6003 timeouts=0 errors=0)
2015-03-23 21:53:58.718 write(tps=353 timeouts=0 errors=0) read(tps=3224 timeouts=0 errors=0) total(tps=3577 timeouts=0 errors=0)
2015-03-23 21:53:59.718 write(tps=678 timeouts=0 errors=0) read(tps=5896 timeouts=0 errors=0) total(tps=6574 timeouts=0 errors=0)
2015-03-23 21:54:00.719 write(tps=698 timeouts=0 errors=0) read(tps=6477 timeouts=0 errors=0) total(tps=7175 timeouts=0 errors=0)
2015-03-23 21:54:01.720 write(tps=738 timeouts=0 errors=0) read(tps=6045 timeouts=0 errors=0) total(tps=6783 timeouts=0 errors=0)
2015-03-23 21:54:02.721 write(tps=616 timeouts=0 errors=0) read(tps=6019 timeouts=0 errors=0) total(tps=6635 timeouts=0 errors=0)
2015-03-23 21:54:03.722 write(tps=731 timeouts=0 errors=0) read(tps=6411 timeouts=0 errors=0) total(tps=7142 timeouts=0 errors=0)
2015-03-23 21:54:04.723 write(tps=779 timeouts=0 errors=0) read(tps=6640 timeouts=0 errors=0) total(tps=7419 timeouts=0 errors=0)
2015-03-23 21:54:05.723 write(tps=723 timeouts=0 errors=0) read(tps=6366 timeouts=0 errors=0) total(tps=7089 timeouts=0 errors=0)
2015-03-23 21:54:06.725 write(tps=772 timeouts=0 errors=0) read(tps=6643 timeouts=0 errors=0) total(tps=7415 timeouts=0 errors=0)

Read tps is only reaching 7K. Benchmark link suggests much higher numbers. My macbook config:

Processor  2.5 GHz Intel Core i5
Memory  8 GB 1600 MHz DDR3
Available flash storage is 14GB (out of total 120GB)

Can someone please suggest me what wrong I am doing? I have just followed the steps given on Aerospike site on installation and benchmarking.


#2

This question was also posed here:

My response here would be about the same:

I cannot speak to whether or not this is expected since this is not a configuration that we actively performance test. A quick search for VM benchmarks yields VirtualBox being the least performant option.

Would it be possible to POC on EC2’s infrastructure? We also provide AWS Tuning Docs to help get you started.


#3

Thanks @kporter for your reply. Sorry, I couldn’t find that similar thread earlier.

I was also thinking that VM could be the problem. It’s now confirmed by your reply.

I have now benchmarked on more capable machines. But still not getting desired results. Have posted that Question here. Can you please have a look and provide suggestions :smile: . Thanks!