Errors when nodes are being shutdown / not leaving the cluster correctly #2754
Description
I get lots of these errors daily, mostly when nodes are restarted, but some when there are actual connection errors:
I noticed that when this happens, this is all I see in the log:
12 Jun 2017 05:00:01.025 Marked address [akka.tcp://SICluster@10.0.0.50:10007] as [Leaving]
In contrast to other times the node was restarted and no errors appear:
12 Jun 2017 09:00:08.023 Remoting shut down.
12 Jun 2017 09:00:07.944 Remote daemon shut down; proceeding with flushing remote transports.
12 Jun 2017 09:00:07.942 Shutting down remote daemon.
12 Jun 2017 09:00:07.920 Cluster Node [akka.tcp://SICluster@10.0.0.50:10007] - Successfully shut down
12 Jun 2017 09:00:07.920 Cluster Node [akka.tcp://SICluster@10.0.0.50:10007] - Shutting down...
12 Jun 2017 09:00:07.915 Exiting completed.
12 Jun 2017 09:00:07.913 Exiting, starting coordinated shutdown.
12 Jun 2017 09:00:01.025 Marked address [akka.tcp://SICluster@10.0.0.50:10007] as [Leaving]
I'm trying to diagnose some network issues between some VMs, and I want to rule out any issues with the library, but currently they look mixed up.
Any idea on what may be going on here?