How to speed up asrestore


#1

FAQ How to speed up asrestore

Context

You want to run asrestore as fast as possible to recover data.

Method

The following option can be used to tune the restore:

        -t <threads> or --threads <threads>     20 is the default
                                                The number of client threads to spawn for writing to the cluster.
                                                Higher numbers mean faster restores, which may, however, have a negative impact on server performance.

If you have multiple backup files in the backup directory, you could run asrestore in parallel using this option:

        -i <path> or --input-file <path>        The single file from which to read the backup. - means stdin. Mandatory, unless --directory is given.

e.g.

 asrestore -h 10.0.100.199 --threads 32 --input-file BB9375FFD005452_00000.asb
 .
 .
 .
2018-06-29 21:44:38 GMT [INF] [13830] 0 UDF file(s), 0 secondary index(es), 248779 record(s) (22296 KiB/s, 248779 rec/s, 91 B/rec, backed off: 0)
2018-06-29 21:44:38 GMT [INF] [13830] Expired 248779 : skipped 0 : inserted 0 : failed 0 (existed 0, fresher 0)
2018-06-29 21:44:38 GMT [INF] [13830] 100% complete, ~0s remaining

Notes

  • Tools version 3.15.3.2 is actually by default slower to restore as the /etc/aerospike/astools has the following entries:
#—————-Performance and throttling———————
nice-list = "1,10000"
threads = 32

Therefore, the output is like this which is throttled (10000 rec/s):

2018-06-29 21:49:02 GMT [INF] [14202] 0 UDF file(s), 0 secondary index(es), 209980 record(s) (896 KiB/s, 10000 rec/s, 91 B/rec, backed off: 0)
2018-06-29 21:49:02 GMT [INF] [14202] Expired 209980 : skipped 0 : inserted 0 : failed 0 (existed 0, fresher 0)
2018-06-29 21:49:02 GMT [INF] [14202] 84% complete, ~3s remaining

This issue was addressed in the subsequent release (tracked under TOOLS-1135). Upgrade to the latest tools or use the “–no-configure” option to workaround it.

Keywords

ASRESTORE SPEED SLOW RESTORE

Timestamp

06/29/2018