A couple of SIGSEGV crashes while running lua udfs

,
1

Hello, I’ve encountered a few crashes over the last few weeks. Has anyone seen this before?

Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::161) SIGSEGV received, aborting Aerospike Community Edition build 3.7.1 os debian7
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::161) SIGSEGV received, aborting Aerospike Community Edition build 3.7.1 os debian7
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: found 14 frames
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: found 29 frames
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 0: /usr/bin/asd(as_sig_handle_segv+0x5d) [0x4978e8]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 1: /lib/x86_64-linux-gnu/libc.so.6(+0x321e0) [0x7f2bcbbd01e0]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 2: /usr/bin/asd(mod_lua_pushval+0x11) [0x54b354]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 3: /usr/bin/asd() [0x549454]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 4: /usr/bin/asd() [0x56e638]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 5: /usr/bin/asd(lua_pcall+0x30) [0x55e2e0]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 6: /usr/bin/asd() [0x5455e5]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 7: /usr/bin/asd() [0x54609b]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 8: /usr/bin/asd(as_aggr_process+0x1ab) [0x46d143]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 9: /usr/bin/asd() [0x4cceb7]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 10: /usr/bin/asd() [0x4ce32b]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 11: /usr/bin/asd(query_th+0x55) [0x4ceb9f]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 12: /lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7f2bcccf1b50]
Feb 23 2016 01:48:04 GMT: WARNING (as): (signal.c::163) stacktrace: frame 13: /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f2bcbc7995d]


Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::161) SIGSEGV received, aborting Aerospike Community Edition build 3.7.1 os debian7
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: found 30 frames
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 0: /usr/bin/asd(as_sig_handle_segv+0x5d) [0x4978e8]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 1: /lib/x86_64-linux-gnu/libc.so.6(+0x321e0) [0x7f1abc9731e0]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 2: /usr/bin/asd(free+0x1df) [0x5adf1f]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 3: /usr/bin/asd(cf_free_at+0x7f) [0x52577e]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 4: /usr/bin/asd(as_val_val_destroy+0x5b) [0x5521ec]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 5: /usr/bin/asd(as_arraylist_release+0x32) [0x54ba08]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 6: /usr/bin/asd(as_val_val_destroy+0x35) [0x5521c6]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 7: /usr/bin/asd(mod_lua_freebox+0x22) [0x54b56e]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 8: /usr/bin/asd() [0x548555]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 9: /usr/bin/asd() [0x56e638]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 10: /usr/bin/asd() [0x5709f9]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 11: /usr/bin/asd() [0x570ae6]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 12: /usr/bin/asd() [0x571678]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 13: /usr/bin/asd() [0x571b74]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 14: /usr/bin/asd(lua_newuserdata+0x8c) [0x55d73c]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 15: /usr/bin/asd(mod_lua_newbox+0x15) [0x54b45f]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 16: /usr/bin/asd(mod_lua_pushbox+0xf) [0x54b47b]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 17: /usr/bin/asd(mod_lua_pushlist+0x15) [0x548ba6]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 18: /usr/bin/asd(mod_lua_pushval+0xc9) [0x54b40c]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 19: /usr/bin/asd() [0x549460]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 20: /usr/bin/asd() [0x56e638]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 21: /usr/bin/asd(lua_pcall+0x30) [0x55e2e0]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 22: /usr/bin/asd() [0x5455e5]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 23: /usr/bin/asd() [0x54609b]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 24: /usr/bin/asd(as_aggr_process+0x1ab) [0x46d143]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 25: /usr/bin/asd() [0x4cceb7]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 26: /usr/bin/asd() [0x4ce32b]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 27: /usr/bin/asd(query_th+0x55) [0x4ceb9f]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 28: /lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7f1abda94b50]
Feb 23 2016 01:46:44 GMT: WARNING (as): (signal.c::163) stacktrace: frame 29: /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f1abca1c95d]
2

Do you mind providing more information, like how often it happens, what seems to trigger it, and mainly, some code that reproduces it?

3

Gladly, it seems to happen about once a week, there doesn’t seem to be anything unusual happening at the time with Aerospike or the client system. We have two UDFs, one for updating and adding new data and one for an aggregate query. They are both running constantly so I can’t really be certain which might be related from the client code side. We’re using the Java client and Aerospike is running on AWS, with two m4.large instances with io1 volumes.

local function counters_merge(a, b)
    -- add counters and take larger of times
    local r = list {
        math.max(a[1], b[1]),
        a[2] + b[2],
        math.max(a[3], b[3]),
        a[4] + b[4],
        math.max(a[5], b[5]),
        a[6] +  b[6] }
    return r
end

local function merge_maps(a, b)
    local r = map.merge(a, b, counters_merge)
    return r
end

local function extract_counters(r)
    return r['counters']
end

function sum(stream, s, e)
    local filter = filter_user_and_day(s, e)
    return stream:filter(filter):map(extract_counters):aggregate(map(), merge_maps):reduce(merge_maps)
end

local function counters_merge(a, b)
    -- add counters and take larger of times
    local r = list {
        math.max(a[1], b[1]),
        a[2] + b[2],
        math.max(a[3], b[3]),
        a[4] + b[4],
        math.max(a[5], b[5]),
        a[6] +  b[6] }
    return r
end

function update(record, i, day, x, wt, wc, ct, cc, c1t, c1c)
    local param_list = list { wt, wc, ct, cc, c1t, c1c }
    if aerospike:exists(record) == false then
        record['i'] = user
        record['day'] = day
        record['counters'] = map()
        aerospike:create(record)
    end

    if record.counters[x] == nil then
        trace("x was null")
        record.counters[x] = param_list
    else
        record.counters[x] = counters_merge(record.counters[x], param_list)
    end

    -- you need to "touch" then counters recored otherwise aerospike doesn't know it was updated
    record.counters = record.counters

    aerospike:update(record)

    return 1
end
4

I also am facing a similiar problem. On execution of lua the server crashes Lua scripts. I am using Node js client.

   function app(rec, a, b, new_record, isodate)
        local c = rec["c"]
        if (not c)
        then
            c = map.create(1)
        end
        local f = c[a]
        local to_add = 1
        if (f)
        then
            to_add = 0
        end
        rec['m.e'] = rec['m.e'] + to_add
        rec['m.updated_on'] = isodate
        c[a] = new_record
        rec["c"] = c
        aerospike:update(rec)
        return 0
    end
    
    function cdd(rec, a, isodate)
        local c = rec["c"]
        local d = c[a]
        if(not d)
        then
            return 0
        end
    
        rec['m.e'] = rec['m.e'] - 1
        rec['m.updated_on'] = isodate
        c[a] = nil
        map.remove(c, a)
        rec["c"] = c
        aerospike:update(rec)
        return 0
    end
    
    function eff(rec, a, b, isodate)
        local c = rec["c"]
        if (not c)
        then
            return 0
        end
        rec['m.updated_on'] = isodate
        local g = c[a]
        g['b'] = b
        g['updated_on'] = isodate
        c[a] = g
        rec["c"] = c
        aerospike:update(rec)
        return 0
    end

Logs From aerospike

Dec 05 2016 04:14:05 GMT: INFO (info): (thr_info.c:4860) {inmemoryNameSpace} memory bytes used 5209148 (index 15552 : sindex 0 : data 5193596) : used pct 0.12
Dec 05 2016 04:14:05 GMT: INFO (info): (thr_info.c:4908) {inmemoryNameSpace} migrations - complete
Dec 05 2016 04:14:05 GMT: INFO (info): (thr_info.c:4915)    partitions: actual 8192 sync 0 desync 0 zombie 0 absent 0
Dec 05 2016 04:14:05 GMT: INFO (info): (hist.c:137) histogram dump: reads (10827 total) msec
Dec 05 2016 04:14:05 GMT: INFO (info): (hist.c:154)  (00: 0000010808) (01: 0000000016) (02: 0000000002) (03: 0000000001)
Dec 05 2016 04:14:05 GMT: INFO (info): (hist.c:137) histogram dump: writes_master (5447 total) msec
Dec 05 2016 04:14:05 GMT: INFO (info): (hist.c:163)  (00: 0000005440) (01: 0000000005) (02: 0000000002)
Dec 05 2016 04:14:05 GMT: INFO (info): (hist.c:137) histogram dump: proxy (0 total) msec
Dec 05 2016 04:14:05 GMT: INFO (info): (hist.c:137) histogram dump: udf (20 total) msec
Dec 05 2016 04:14:05 GMT: INFO (info): (hist.c:163)  (00: 0000000020)
Dec 05 2016 04:14:05 GMT: INFO (info): (hist.c:137) histogram dump: query (0 total) msec
Dec 05 2016 04:14:05 GMT: INFO (info): (hist.c:137) histogram dump: query_rec_count (0 total) count
Dec 05 2016 04:14:07 GMT: INFO (drv_ssd): (drv_ssd.c:2088) device /opt/aerospike/data/persistentNamespace3.dat: used 8359040, contig-free 15347M (122780 wblocks), swb-free 1, w-q 0 w-tot 10 (0.0/s), defrag-q 0 defrag-tot 11 (0.0/s) defrag-w-tot 4 (0.0/s)
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4797)  system memory: free 11986368kb ( 76 percent free )
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4803)  ClusterSize 1 ::: objects 4378 ::: sub_objects 0
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4810)  rec refs 4378 ::: rec locks 0 ::: trees 0 ::: wr reqs 0
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4816)  replica errs :: null 0 non-null 0 ::: sync copy errs :: master 0
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4826)    trans_in_progress: wr 0 prox 0 wait 0 ::: q 0 ::: iq 0 ::: dq 0 : fds - proto (14, 352, 338) : hb (0, 0, 0) : fab (16, 16, 0)
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4828)    heartbeat_received: self 1568881 : foreign 0
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4829)    heartbeat_stats: bt 0 bf 0 nt 0 ni 0 nn 0 nnir 0 nal 0 sf1 0 sf2 0 sf3 0 sf4 0 sf5 0 sf6 0 mrf 0 eh 0 efd 0 efa 0 um 0 mcf 0 rc 0
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4841)    tree_counts: nsup 0 scan 0 dup 0 wprocess 0 migrx 0 migtx 0 ssdr 0 ssdw 0 rw 0
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4858) {persistentNamespace} disk bytes used 8373760 : avail pct 99
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4860) {persistentNamespace} memory bytes used 5580933 (index 262272 : sindex 148922 : data 5169739) : used pct 0.26
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4908) {persistentNamespace} migrations - complete
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4858) {inmemoryNameSpace} disk bytes used 0 : avail pct 100
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4860) {inmemoryNameSpace} memory bytes used 5283525 (index 17920 : sindex 0 : data 5265605) : used pct 0.12
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4908) {inmemoryNameSpace} migrations - complete
Dec 05 2016 04:14:15 GMT: INFO (info): (thr_info.c:4915)    partitions: actual 8192 sync 0 desync 0 zombie 0 absent 0
Dec 05 2016 04:14:15 GMT: INFO (info): (hist.c:137) histogram dump: reads (11005 total) msec
Dec 05 2016 04:14:15 GMT: INFO (info): (hist.c:154)  (00: 0000010986) (01: 0000000016) (02: 0000000002) (03: 0000000001)
Dec 05 2016 04:14:15 GMT: INFO (info): (hist.c:137) histogram dump: writes_master (5501 total) msec
Dec 05 2016 04:14:15 GMT: INFO (info): (hist.c:163)  (00: 0000005494) (01: 0000000005) (02: 0000000002)
Dec 05 2016 04:14:15 GMT: INFO (info): (hist.c:137) histogram dump: proxy (0 total) msec
Dec 05 2016 04:14:15 GMT: INFO (info): (hist.c:137) histogram dump: udf (20 total) msec
Dec 05 2016 04:14:15 GMT: INFO (info): (hist.c:163)  (00: 0000000020)
Dec 05 2016 04:14:15 GMT: INFO (info): (hist.c:137) histogram dump: query (0 total) msec
Dec 05 2016 04:14:15 GMT: INFO (info): (hist.c:137) histogram dump: query_rec_count (0 total) count
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4797)  system memory: free 11923104kb ( 76 percent free )
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4803)  ClusterSize 1 ::: objects 4398 ::: sub_objects 0
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4810)  rec refs 4398 ::: rec locks 0 ::: trees 0 ::: wr reqs 0
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4816)  replica errs :: null 0 non-null 0 ::: sync copy errs :: master 0
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4826)    trans_in_progress: wr 0 prox 0 wait 0 ::: q 0 ::: iq 0 ::: dq 0 : fds - proto (16, 354, 338) : hb (0, 0, 0) : fab (16, 16, 0)
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4828)    heartbeat_received: self 1568948 : foreign 0
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4829)    heartbeat_stats: bt 0 bf 0 nt 0 ni 0 nn 0 nnir 0 nal 0 sf1 0 sf2 0 sf3 0 sf4 0 sf5 0 sf6 0 mrf 0 eh 0 efd 0 efa 0 um 0 mcf 0 rc 0
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4841)    tree_counts: nsup 0 scan 0 dup 0 wprocess 0 migrx 0 migtx 0 ssdr 0 ssdw 0 rw 0
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4858) {persistentNamespace} disk bytes used 8381440 : avail pct 99
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4860) {persistentNamespace} memory bytes used 5587102 (index 263104 : sindex 148922 : data 5175076) : used pct 0.26
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4908) {persistentNamespace} migrations - complete
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4858) {inmemoryNameSpace} disk bytes used 0 : avail pct 100
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4860) {inmemoryNameSpace} memory bytes used 5290102 (index 18368 : sindex 0 : data 5271734) : used pct 0.12
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4908) {inmemoryNameSpace} migrations - complete
Dec 05 2016 04:14:25 GMT: INFO (info): (thr_info.c:4915)    partitions: actual 8192 sync 0 desync 0 zombie 0 absent 0
Dec 05 2016 04:14:25 GMT: INFO (info): (hist.c:137) histogram dump: reads (11183 total) msec
Dec 05 2016 04:14:25 GMT: INFO (info): (hist.c:154)  (00: 0000011164) (01: 0000000016) (02: 0000000002) (03: 0000000001)
Dec 05 2016 04:14:25 GMT: INFO (info): (hist.c:137) histogram dump: writes_master (5532 total) msec
Dec 05 2016 04:14:25 GMT: INFO (info): (hist.c:163)  (00: 0000005525) (01: 0000000005) (02: 0000000002)
Dec 05 2016 04:14:25 GMT: INFO (info): (hist.c:137) histogram dump: proxy (0 total) msec
Dec 05 2016 04:14:25 GMT: INFO (info): (hist.c:137) histogram dump: udf (20 total) msec
Dec 05 2016 04:14:25 GMT: INFO (info): (hist.c:163)  (00: 0000000020)
Dec 05 2016 04:14:25 GMT: INFO (info): (hist.c:137) histogram dump: query (0 total) msec
Dec 05 2016 04:14:25 GMT: INFO (info): (hist.c:137) histogram dump: query_rec_count (0 total) count
Dec 05 2016 04:14:27 GMT: INFO (drv_ssd): (drv_ssd.c:2088) device /opt/aerospike/data/persistentNamespace3.dat: used 8381440, contig-free 15347M (122780 wblocks), swb-free 1, w-q 0 w-tot 10 (0.0/s), defrag-q 0 defrag-tot 11 (0.0/s) defrag-w-tot 4 (0.0/s)
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4797)  system memory: free 11923180kb ( 76 percent free )
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4803)  ClusterSize 1 ::: objects 4398 ::: sub_objects 0
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4810)  rec refs 4398 ::: rec locks 0 ::: trees 0 ::: wr reqs 0
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4816)  replica errs :: null 0 non-null 0 ::: sync copy errs :: master 0
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4826)    trans_in_progress: wr 0 prox 0 wait 0 ::: q 0 ::: iq 0 ::: dq 0 : fds - proto (16, 354, 338) : hb (0, 0, 0) : fab (16, 16, 0)
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4828)    heartbeat_received: self 1569014 : foreign 0
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4829)    heartbeat_stats: bt 0 bf 0 nt 0 ni 0 nn 0 nnir 0 nal 0 sf1 0 sf2 0 sf3 0 sf4 0 sf5 0 sf6 0 mrf 0 eh 0 efd 0 efa 0 um 0 mcf 0 rc 0
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4841)    tree_counts: nsup 0 scan 0 dup 0 wprocess 0 migrx 0 migtx 0 ssdr 0 ssdw 0 rw 0
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4858) {persistentNamespace} disk bytes used 8381440 : avail pct 99
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4860) {persistentNamespace} memory bytes used 5587102 (index 263104 : sindex 148922 : data 5175076) : used pct 0.26
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4908) {persistentNamespace} migrations - complete
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4858) {inmemoryNameSpace} disk bytes used 0 : avail pct 100
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4860) {inmemoryNameSpace} memory bytes used 5290102 (index 18368 : sindex 0 : data 5271734) : used pct 0.12
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4908) {inmemoryNameSpace} migrations - complete
Dec 05 2016 04:14:35 GMT: INFO (info): (thr_info.c:4915)    partitions: actual 8192 sync 0 desync 0 zombie 0 absent 0
Dec 05 2016 04:14:35 GMT: INFO (info): (hist.c:137) histogram dump: reads (11183 total) msec
Dec 05 2016 04:14:35 GMT: INFO (info): (hist.c:154)  (00: 0000011164) (01: 0000000016) (02: 0000000002) (03: 0000000001)
Dec 05 2016 04:14:35 GMT: INFO (info): (hist.c:137) histogram dump: writes_master (5532 total) msec
Dec 05 2016 04:14:35 GMT: INFO (info): (hist.c:163)  (00: 0000005525) (01: 0000000005) (02: 0000000002)
Dec 05 2016 04:14:35 GMT: INFO (info): (hist.c:137) histogram dump: proxy (0 total) msec
Dec 05 2016 04:14:35 GMT: INFO (info): (hist.c:137) histogram dump: udf (20 total) msec
Dec 05 2016 04:14:35 GMT: INFO (info): (hist.c:163)  (00: 0000000020)
Dec 05 2016 04:14:35 GMT: INFO (info): (hist.c:137) histogram dump: query (0 total) msec
Dec 05 2016 04:14:35 GMT: INFO (info): (hist.c:137) histogram dump: query_rec_count (0 total) count
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:181) SIGSEGV received, aborting Aerospike Enterprise Edition build 3.8.4 os ubuntu14.04
Dec 05 2016 04:14:39 GMT: INFO (xdr): (xdr.c:5023) XDR is not running.
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:185) stacktrace: found 11 frames
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:185) stacktrace: frame 0: /usr/bin/asd(as_sig_handle_segv+0x35) [0x4bd861]
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:185) stacktrace: frame 1: /lib/x86_64-linux-gnu/libc.so.6(+0x36c30) [0x7f3a3fca3c30]
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:185) stacktrace: frame 2: /usr/bin/asd(as_bin_particle_client_value_size+0x52) [0x49cf5b]
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:185) stacktrace: frame 3: /usr/bin/asd(as_msg_make_response_msg+0x408) [0x4b6223]
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:185) stacktrace: frame 4: /usr/bin/asd(read_local+0x8aa) [0x509919]
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:185) stacktrace: frame 5: /usr/bin/asd(as_read_start+0x2e7) [0x50ce2c]
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:185) stacktrace: frame 6: /usr/bin/asd(process_transaction+0x973) [0x51160d]
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:185) stacktrace: frame 7: /usr/bin/asd(thr_tsvc_process_or_enqueue+0xb1) [0x5118a2]
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:185) stacktrace: frame 8: /usr/bin/asd(thr_demarshal+0x107a) [0x4d8a6a]
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:185) stacktrace: frame 9: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8182) [0x7f3a40e80182]
Dec 05 2016 04:14:39 GMT: WARNING (as): (signal.c:185) stacktrace: frame 10: /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f3a3fd67fbd]
5

Since you’re using Aerospike Enterprise Edition, you should open this as a support issue by emailing support@aerospike.com