Setting up Environment. Please Wait!


#1

after upgrade my cluster to 3.8.3 AMC stopped to work. in the AMC log i see exceptions:

args:()
kwargs:{'cluster': <models.cluster.Cluster object at 0x7fe6da2ff690>}Traceback (most recent call last):
  File "/opt/amc/server/utilities/cluster_manager.py", line 131, in f
    return fn(*args, **kwargs)
  File "/opt/amc/server/helpers/debugger.py", line 270, in decorator
    response = fn(*args, **kwargs)
  File "/opt/amc/server/flaskapp.py", line 89, in get_cluster_info
    response = cluster_controller.get_info(cluster)
  File "/opt/amc/server/controllers/cluster_controller.py", line 27, in get_info
    cluster_obj.get_updates()
  File "/opt/amc/server/models/cluster.py", line 206, in get_updates
    for alternate_address in alternate_node_list:
UnboundLocalError: local variable 'alternate_node_list' referenced before assignment
2016-06-08 11:14:45 [7829] [ERROR] Error handling request
Traceback (most recent call last):
  File "/opt/amc/server/site-packages/gunicorn/workers/async.py", line 45, in handle
    self.handle_request(listener, req, client, addr)
  File "/opt/amc/server/site-packages/gunicorn/workers/async.py", line 93, in handle_request
    respiter = self.wsgi(environ, resp.start_response)
  File "/opt/amc/server//site-packages/flask/app.py", line 1701, in __call__
    return self.wsgi_app(environ, start_response)
  File "/opt/amc/server//site-packages/flask/app.py", line 1689, in wsgi_app
    response = self.make_response(self.handle_exception(e))
  File "/opt/amc/server//site-packages/flask/app.py", line 1687, in wsgi_app
    response = self.full_dispatch_request()
  File "/opt/amc/server//site-packages/flask/app.py", line 1360, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/opt/amc/server//site-packages/flask/app.py", line 1358, in full_dispatch_request
    rv = self.dispatch_request()
  File "/opt/amc/server//site-packages/flask/app.py", line 1344, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/opt/amc/server/utilities/cluster_manager.py", line 135, in f
    raise Exception("Internal server error!")
Exception: Internal server error!
args:()
kwargs:{'cluster': <models.cluster.Cluster object at 0x7fe6da2ff690>}Traceback (most recent call last):
  File "/opt/amc/server/utilities/cluster_manager.py", line 131, in f
    return fn(*args, **kwargs)
  File "/opt/amc/server/helpers/debugger.py", line 270, in decorator
    response = fn(*args, **kwargs)
  File "/opt/amc/server/flaskapp.py", line 98, in get_cluster_basic_info
    response = cluster_controller.get_basic_info(cluster)
  File "/opt/amc/server/controllers/cluster_controller.py", line 42, in get_basic_info
    cluster_obj.get_updates()
  File "/opt/amc/server/models/cluster.py", line 206, in get_updates
    for alternate_address in alternate_node_list:
UnboundLocalError: local variable 'alternate_node_list' referenced before assignment
2016-06-08 11:14:45 [7829] [ERROR] Error handling request
Traceback (most recent call last):
  File "/opt/amc/server/site-packages/gunicorn/workers/async.py", line 45, in handle
    self.handle_request(listener, req, client, addr)
  File "/opt/amc/server/site-packages/gunicorn/workers/async.py", line 93, in handle_request
    respiter = self.wsgi(environ, resp.start_response)
  File "/opt/amc/server//site-packages/flask/app.py", line 1701, in __call__
    return self.wsgi_app(environ, start_response)
  File "/opt/amc/server//site-packages/flask/app.py", line 1689, in wsgi_app
    response = self.make_response(self.handle_exception(e))
  File "/opt/amc/server//site-packages/flask/app.py", line 1687, in wsgi_app
    response = self.full_dispatch_request()
  File "/opt/amc/server//site-packages/flask/app.py", line 1360, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/opt/amc/server//site-packages/flask/app.py", line 1358, in full_dispatch_request
    rv = self.dispatch_request()
  File "/opt/amc/server//site-packages/flask/app.py", line 1344, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/opt/amc/server/utilities/cluster_manager.py", line 135, in f
    raise Exception("Internal server error!")
Exception: Internal server error!
args:()
kwargs:{'cluster': <models.cluster.Cluster object at 0x7fe6da2ff690>}Traceback (most recent call last):
  File "/opt/amc/server/utilities/cluster_manager.py", line 131, in f
    return fn(*args, **kwargs)
  File "/opt/amc/server/helpers/debugger.py", line 270, in decorator
    response = fn(*args, **kwargs)
  File "/opt/amc/server/flaskapp.py", line 98, in get_cluster_basic_info
    response = cluster_controller.get_basic_info(cluster)
  File "/opt/amc/server/controllers/cluster_controller.py", line 42, in get_basic_info
    cluster_obj.get_updates()
  File "/opt/amc/server/models/cluster.py", line 206, in get_updates
    for alternate_address in alternate_node_list:
UnboundLocalError: local variable 'alternate_node_list' referenced before assignment
2016-06-08 11:14:45 [7829] [ERROR] Error handling request
Traceback (most recent call last):
  File "/opt/amc/server/site-packages/gunicorn/workers/async.py", line 45, in handle
    self.handle_request(listener, req, client, addr)
  File "/opt/amc/server/site-packages/gunicorn/workers/async.py", line 93, in handle_request
    respiter = self.wsgi(environ, resp.start_response)
  File "/opt/amc/server//site-packages/flask/app.py", line 1701, in __call__
    return self.wsgi_app(environ, start_response)
  File "/opt/amc/server//site-packages/flask/app.py", line 1689, in wsgi_app
    response = self.make_response(self.handle_exception(e))
  File "/opt/amc/server//site-packages/flask/app.py", line 1687, in wsgi_app
    response = self.full_dispatch_request()
  File "/opt/amc/server//site-packages/flask/app.py", line 1360, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/opt/amc/server//site-packages/flask/app.py", line 1358, in full_dispatch_request
    rv = self.dispatch_request()
  File "/opt/amc/server//site-packages/flask/app.py", line 1344, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/opt/amc/server/utilities/cluster_manager.py", line 135, in f
    raise Exception("Internal server error!")
Exception: Internal server error!

#6

I had thought this may have been related to some recent stat moves, but it doesn’t seem to be.

This appears to be a bug where alternate_node_list isn’t set potentially when all node are down.

Is this issue persistent (i.e. will it work if you restart AMC)?


#7

Still the same. I tryed do downgrade back to the old version but the same problem.


#8

Appears the bug was introduced in AMC 3.6.8, I suspect you won’t need the “TOOLS-557 - Support private to public IP mapping.”

Recommend downgrading to 3.6.6 till this issue can be resolved, you can find a link to the download here:

http://www.aerospike.com/download/amc/notes.html#3.6.6.