# One of Three Nodes went down abruptly and writes are not happening

**URL:** <https://discuss.aerospike.com/t/one-of-three-nodes-went-down-abruptly-and-writes-are-not-happening/5869>\
**Category:** General Discussion\
**Created:** [January 23, 2019, 11:27am UTC](https://discuss.aerospike.com/t/one-of-three-nodes-went-down-abruptly-and-writes-are-not-happening/5869 "2019-01-23T11:27:23Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![dhanasekaran1980](https://avatars.discourse-cdn.com/v4/letter/d/d78d45/32.png) [@dhanasekaran1980](https://discuss.aerospike.com/u/dhanasekaran1980)\
**Post date:** [January 23, 2019, 11:27am UTC](https://discuss.aerospike.com/t/one-of-three-nodes-went-down-abruptly-and-writes-are-not-happening/5869/1 "2019-01-23T11:27:23Z")

</div>

We are running 3 Node Cluster, data in memory on version 4.2.0.4 CE. We recently noticed writes are not happening and found one down. Ideally write should happen. Once we start the node which was down, the writes resumed.

Found below INFO Logs being printed continuosly on two nodes.  
INFO (hb): (hb.c:4319) found redundant connections to same node, fds 101 31 - choosing at random

On the other node, no logs being printed and no read/writes happening on adadm stats. Also we have observed that the records are unevenly distributed across the nodes.

Please help.

---

<div class="post-metadata">

**Author:** ![pgupta](https://sea1.discourse-cdn.com/flex019/user_avatar/discuss.aerospike.com/pgupta/32/2351_2.png) [@pgupta](https://discuss.aerospike.com/u/pgupta)\
**Post date:** [January 23, 2019, 7:01pm UTC](https://discuss.aerospike.com/t/one-of-three-nodes-went-down-abruptly-and-writes-are-not-happening/5869/2 "2019-01-23T19:01:52Z")

</div>

check if the other two nodes are publishing a private ip address not accessible to client and only one node (that went down) is publishing an accessible ip address. (network stanza, service sub-context)

---

<div class="post-metadata">

**Author:** ![dhanasekaran1980](https://avatars.discourse-cdn.com/v4/letter/d/d78d45/32.png) [@dhanasekaran1980](https://discuss.aerospike.com/u/dhanasekaran1980)\
**Post date:** [January 24, 2019, 10:13am UTC](https://discuss.aerospike.com/t/one-of-three-nodes-went-down-abruptly-and-writes-are-not-happening/5869/3 "2019-01-24T10:13:26Z")

</div>

Gupta, Thanks for your apt reply. Yes this is what is happening. But in the configuration file I have provided the public IP addresses. These three nodes are on AWS.

Please help.

---

<div class="post-metadata">

**Author:** ![pgupta](https://sea1.discourse-cdn.com/flex019/user_avatar/discuss.aerospike.com/pgupta/32/2351_2.png) [@pgupta](https://discuss.aerospike.com/u/pgupta)\
**Post date:** [January 24, 2019, 4:15pm UTC](https://discuss.aerospike.com/t/one-of-three-nodes-went-down-abruptly-and-writes-are-not-happening/5869/4 "2019-01-24T16:15:17Z")

</div>

Discussion continuing here: [Aerospike: One of Three Nodes went down abruptly and writes are not happening - Stack Overflow](https://stackoverflow.com/questions/54326222/aerospike-one-of-three-nodes-went-down-abruptly-and-writes-are-not-happening)