Error when restore aerospike from backup file


#1

I encounter following error when restore database from backup file, and the restore process crashed.

2017-06-30 12:41:05 GMT [ERR] [44534] Error while reading backup block (line 1933265, col 92515)
2017-06-30 12:41:10 GMT [ERR] [44534] Unexpected end of file in base-64 data
2017-06-30 12:41:10 GMT [ERR] [44534] Error while reading encoded data
2017-06-30 12:41:10 GMT [ERR] [44534] Error while reading encoded data bin value
2017-06-30 12:41:10 GMT [ERR] [44534] Error while parsing record
2017-06-30 12:41:10 GMT [ERR] [44534] Error while restoring backup file ./production

/BB9043AA2D317E2_00009.asb (line 1933265)

And there is no error in log file when I backup aerospike.

My question is, does that mean there is some issue on writing backup files which cause this error? What is your advice? Backup and restore again?


#2

What version of Aerospike server, asbackup, and asrestore are you using?


#3

In addition to what @kporter asked, could you run “wc -l” on the backup file real quick?

I’m interested in how many lines the backup file contains. If it contains 1,933,265 lines, then one reason for this issue could be that the backup file was truncated somehow, and we’d know that we should investigate in this direction.

If this turns out to be a problem with asbackup or asrestore, then a possible workaround could be to use the “–compact” option of asbackup when backing up. The option selects a more compact representation of data in the backup file. (A representation that doesn’t use base-64 encoding, which seems to be a part of the problem.)

But even if the workaround helps, I’d be very interested to get to the bottom of this.


#4

Thanks, Kevin and tlo. When I backup aerospike, since the disk is not big enough, I directly backup all files into a NFS disk. It should be the issue. It seems there was some error when writing backup files though there was no error message. When I changed to local disk, it worked well. Each backup file was 100GB