12:28:02,997 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 12:28:03,521 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://ClusterSystem@127.0.0.1:2550] with UID [-6747608796921370120] 12:28:03,539 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Starting up, Akka version [2.6.21] ... 12:28:03,665 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Registered cluster JMX MBean [akka:type=Cluster] 12:28:03,665 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Started up successfully 12:28:03,780 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] SplitBrainResolver - SBR started. Config: strategy [KeepMajority], stable-after [7 seconds], down-all-when-unstable [5250 milliseconds], selfUniqueAddress [akka://ClusterSystem@127.0.0.1:2550#-6747608796921370120], selfDc [dc-primary]. 12:28:04,253 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistryInit - member-1 : CandidateRegistry syncing behavior started. 12:28:04,255 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:04,320 PM [ClusterSystem-akka.actor.default-dispatcher-18] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2552], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2552,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:04,322 PM [ClusterSystem-akka.actor.default-dispatcher-18] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2552], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2552,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:04,325 PM [ClusterSystem-akka.actor.default-dispatcher-18] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2553], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2553,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:04,326 PM [ClusterSystem-akka.actor.default-dispatcher-18] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2553], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2553,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:04,327 PM [ClusterSystem-akka.actor.default-dispatcher-18] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2551], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2551,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:04,333 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 12:28:04,359 PM [ClusterSystem-akka.actor.default-dispatcher-18] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2551], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2551,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:04,382 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://ClusterSystem@127.0.0.1:2551] with UID [2685234194522523776] 12:28:04,382 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Starting up, Akka version [2.6.21] ... 12:28:04,404 PM [ClusterSystem-akka.actor.default-dispatcher-5] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config 12:28:04,405 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Started up successfully 12:28:04,414 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] SplitBrainResolver - SBR started. Config: strategy [KeepMajority], stable-after [7 seconds], down-all-when-unstable [5250 milliseconds], selfUniqueAddress [akka://ClusterSystem@127.0.0.1:2551#2685234194522523776], selfDc [dc-primary]. 12:28:04,421 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] CandidateRegistryInit - member-2 : CandidateRegistry syncing behavior started. 12:28:04,421 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:04,545 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 12:28:04,557 PM [ClusterSystem-akka.actor.default-dispatcher-15] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2552], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2552,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:04,557 PM [ClusterSystem-akka.actor.default-dispatcher-15] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2553], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2553,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:04,557 PM [ClusterSystem-akka.actor.default-dispatcher-15] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2553], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2553,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:04,558 PM [ClusterSystem-akka.actor.default-dispatcher-15] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2552], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2552,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:04,640 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://ClusterSystem@127.0.0.1:2552] with UID [6348249461844014393] 12:28:04,640 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Starting up, Akka version [2.6.21] ... 12:28:04,640 PM [ClusterSystem-akka.actor.default-dispatcher-5] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config 12:28:04,641 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Started up successfully 12:28:04,662 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] SplitBrainResolver - SBR started. Config: strategy [KeepMajority], stable-after [7 seconds], down-all-when-unstable [5250 milliseconds], selfUniqueAddress [akka://ClusterSystem@127.0.0.1:2552#6348249461844014393], selfDc [dc-backup]. 12:28:04,674 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistryInit - member-3 : CandidateRegistry syncing behavior started. 12:28:04,674 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:04,789 PM [ClusterSystem-akka.actor.default-dispatcher-14] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2553], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2553,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:04,790 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 12:28:04,807 PM [ClusterSystem-akka.actor.default-dispatcher-14] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2553], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2553,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:04,834 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://ClusterSystem@127.0.0.1:2553] with UID [302646241836180570] 12:28:04,835 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Starting up, Akka version [2.6.21] ... 12:28:04,883 PM [ClusterSystem-akka.actor.default-dispatcher-13] [DEBUG] CandidateRegistryInit - member-4 : CandidateRegistry syncing behavior started. 12:28:04,884 PM [ClusterSystem-akka.actor.default-dispatcher-13] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:04,889 PM [ClusterSystem-akka.actor.default-dispatcher-5] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config 12:28:04,889 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Started up successfully 12:28:04,889 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] SplitBrainResolver - SBR started. Config: strategy [KeepMajority], stable-after [7 seconds], down-all-when-unstable [5250 milliseconds], selfUniqueAddress [akka://ClusterSystem@127.0.0.1:2553#302646241836180570], selfDc [dc-backup]. 12:28:05,376 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon/firstSeedNodeProcess-1#833766488]], but this node is not initialized yet 12:28:05,377 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon/firstSeedNodeProcess-1#833766488]], but this node is not initialized yet 12:28:05,382 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#-1157183616]], but this node is not initialized yet 12:28:05,387 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon/firstSeedNodeProcess-1#833766488]], but this node is not initialized yet 12:28:05,408 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoinNack message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon#-1117209346]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:05,408 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoinNack message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon#-1117209346]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:05,414 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#1840069118]], but this node is not initialized yet 12:28:05,414 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon/joinSeedNodeProcess-1#-642382099]], but this node is not initialized yet 12:28:05,418 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoinNack message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon#1871339795]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:05,446 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon/firstSeedNodeProcess-1#833766488]], but this node is not initialized yet 12:28:05,454 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon/firstSeedNodeProcess-1#833766488]], but this node is not initialized yet 12:28:05,456 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoinNack message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon#-858474766]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:05,475 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Node [akka://ClusterSystem@127.0.0.1:2550] is JOINING itself (with roles [member-1, dc-dc-primary], version [0.0.0]) and forming new cluster 12:28:05,475 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - is the new leader among reachable nodes (more leaders may exist) 12:28:05,492 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2550] to [Up] 12:28:05,505 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] SplitBrainResolver - This node is now the leader responsible for taking SBR decisions among the reachable nodes (more leaders may exist). 12:28:05,515 PM [ClusterSystem-akka.actor.default-dispatcher-26] [INFO] ClusterSingletonManager - Singleton manager starting singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:05,515 PM [ClusterSystem-akka.actor.default-dispatcher-26] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest] 12:28:05,518 PM [ClusterSystem-akka.actor.default-dispatcher-18] [DEBUG] IdleSupervisor - Idle supervisor started on Member(akka://ClusterSystem@127.0.0.1:2550, Up, dc-primary). 12:28:05,627 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon/joinSeedNodeProcess-1#-642382099]], but this node is not initialized yet 12:28:05,632 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#-1157183616]], but this node is not initialized yet 12:28:05,700 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#1840069118]], but this node is not initialized yet 12:28:05,916 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#1840069118]], but this node is not initialized yet 12:28:06,494 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] ClusterSingletonProxy - Singleton identified at [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:06,503 PM [ClusterSystem-akka.actor.default-dispatcher-18] [DEBUG] IdleSupervisor - Clearing candidates for member: member-1 12:28:06,514 PM [ClusterSystem-akka.actor.default-dispatcher-18] [DEBUG] IdleSupervisor - Unable to retrieve candidate data for member-1, no candidates present sending empty reply 12:28:06,515 PM [ClusterSystem-akka.actor.default-dispatcher-18] [DEBUG] CandidateRegistryInit - member-1 : Clearing of candidates from previous instance done, switching to CandidateRegistry. 12:28:06,517 PM [ClusterSystem-akka.actor.default-dispatcher-18] [DEBUG] CandidateRegistry - member-1 : Candidate registry started 12:28:09,433 PM [ClusterSystem-akka.actor.default-dispatcher-15] [WARN] CandidateRegistryInit - member-2 : Initial removal of candidates from previous iteration failed. Rescheduling. java.util.concurrent.TimeoutException: Ask timed out on [Actor[akka://ClusterSystem/system/singletonProxyOwnerSupervisor-no-dc#1111159339]] after [5000 ms]. Message of type [org.opendaylight.controller.eos.akka.owner.supervisor.command.ClearCandidatesForMember]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply. at akka.actor.typed.scaladsl.AskPattern$.$anonfun$onTimeout$1(AskPattern.scala:131) at akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:730) at akka.actor.Scheduler$$anon$7.run(Scheduler.scala:479) at scala.concurrent.ExecutionContext$parasitic$.execute(ExecutionContext.scala:222) at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:365) at akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:314) at akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:318) at akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:270) at java.base/java.lang.Thread.run(Thread.java:833) 12:28:09,435 PM [ClusterSystem-akka.actor.default-dispatcher-15] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:09,694 PM [ClusterSystem-akka.actor.default-dispatcher-14] [WARN] CandidateRegistryInit - member-3 : Initial removal of candidates from previous iteration failed. Rescheduling. java.util.concurrent.TimeoutException: Ask timed out on [Actor[akka://ClusterSystem/system/singletonProxyOwnerSupervisor-no-dc#2085868139]] after [5000 ms]. Message of type [org.opendaylight.controller.eos.akka.owner.supervisor.command.ClearCandidatesForMember]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply. at akka.actor.typed.scaladsl.AskPattern$.$anonfun$onTimeout$1(AskPattern.scala:131) at akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:730) at akka.actor.Scheduler$$anon$7.run(Scheduler.scala:479) at scala.concurrent.ExecutionContext$parasitic$.execute(ExecutionContext.scala:222) at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:365) at akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:314) at akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:318) at akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:270) at java.base/java.lang.Thread.run(Thread.java:833) 12:28:09,695 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:09,896 PM [ClusterSystem-akka.actor.default-dispatcher-5] [WARN] CandidateRegistryInit - member-4 : Initial removal of candidates from previous iteration failed. Rescheduling. java.util.concurrent.TimeoutException: Ask timed out on [Actor[akka://ClusterSystem/system/singletonProxyOwnerSupervisor-no-dc#453976074]] after [5000 ms]. Message of type [org.opendaylight.controller.eos.akka.owner.supervisor.command.ClearCandidatesForMember]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply. at akka.actor.typed.scaladsl.AskPattern$.$anonfun$onTimeout$1(AskPattern.scala:131) at akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:730) at akka.actor.Scheduler$$anon$7.run(Scheduler.scala:479) at scala.concurrent.ExecutionContext$parasitic$.execute(ExecutionContext.scala:222) at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:365) at akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:314) at akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:318) at akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:270) at java.base/java.lang.Thread.run(Thread.java:833) 12:28:09,897 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:10,655 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#-1157183616]], but this node is not initialized yet 12:28:10,656 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon/joinSeedNodeProcess-1#-642382099]], but this node is not initialized yet 12:28:10,659 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#-1157183616]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:10,660 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Sending InitJoinAck message from node [akka://ClusterSystem@127.0.0.1:2550] to [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#-1157183616]] (version [2.6.21]) 12:28:10,661 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#-1157183616]], but this node is not initialized yet 12:28:10,670 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon/joinSeedNodeProcess-1#-642382099]], but this node is not initialized yet 12:28:10,728 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon/joinSeedNodeProcess-1#-642382099]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:10,728 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Sending InitJoinAck message from node [akka://ClusterSystem@127.0.0.1:2550] to [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon/joinSeedNodeProcess-1#-642382099]] (version [2.6.21]) 12:28:10,758 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoinAck message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon#-897030710]] to [akka://ClusterSystem@127.0.0.1:2551] 12:28:10,770 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoinAck message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon#-897030710]] to [akka://ClusterSystem@127.0.0.1:2552] 12:28:10,782 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Node [akka://ClusterSystem@127.0.0.1:2551] is JOINING, roles [member-2, dc-dc-primary], version [0.0.0] 12:28:10,790 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Node [akka://ClusterSystem@127.0.0.1:2552] is JOINING, roles [member-3, dc-dc-backup], version [0.0.0] 12:28:10,817 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Welcome from [akka://ClusterSystem@127.0.0.1:2550] 12:28:10,832 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Welcome from [akka://ClusterSystem@127.0.0.1:2550] 12:28:10,879 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2551] to [Up] 12:28:10,903 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonProxy - Singleton identified at [akka://ClusterSystem@127.0.0.1:2550/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:10,944 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] IdleSupervisor - Clearing candidates for member: member-2 12:28:10,945 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] IdleSupervisor - Clearing candidates for member: member-2 12:28:10,945 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#1840069118]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:10,945 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Sending InitJoinAck message from node [akka://ClusterSystem@127.0.0.1:2550] to [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#1840069118]] (version [2.6.21]) 12:28:10,951 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#1840069118]] to [akka://ClusterSystem@127.0.0.1:2552] 12:28:10,951 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Sending InitJoinAck message from node [akka://ClusterSystem@127.0.0.1:2552] to [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#1840069118]] (version [2.6.21]) 12:28:10,986 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Start -> Younger] 12:28:11,0 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#1840069118]] to [akka://ClusterSystem@127.0.0.1:2551] 12:28:11,0 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Sending InitJoinAck message from node [akka://ClusterSystem@127.0.0.1:2551] to [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#1840069118]] (version [2.6.21]) 12:28:11,2 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Received InitJoinAck message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon#-897030710]] to [akka://ClusterSystem@127.0.0.1:2553] 12:28:11,10 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Node [akka://ClusterSystem@127.0.0.1:2553] is JOINING, roles [member-4, dc-dc-backup], version [0.0.0] 12:28:11,15 PM [ClusterSystem-akka.actor.default-dispatcher-18] [DEBUG] IdleSupervisor - Unable to retrieve candidate data for member-2, no candidates present sending empty reply 12:28:11,15 PM [ClusterSystem-akka.actor.default-dispatcher-18] [DEBUG] IdleSupervisor - Unable to retrieve candidate data for member-2, no candidates present sending empty reply 12:28:11,18 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Welcome from [akka://ClusterSystem@127.0.0.1:2550] 12:28:11,24 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistryInit - member-2 : Clearing of candidates from previous instance done, switching to CandidateRegistry. 12:28:11,24 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistry - member-2 : Candidate registry started 12:28:11,25 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.eos.akka.owner.supervisor.command.ClearCandidatesResponse] to Actor[akka://ClusterSystem/temp/$a] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/temp/$a] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:11,785 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - is the new leader among reachable nodes (more leaders may exist) 12:28:12,809 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2552] to [Up] 12:28:12,810 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2553] to [Up] 12:28:12,814 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterHeartbeat - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Cross DC heartbeat becoming ACTIVE on this node (for DC: dc-backup), monitoring other DCs oldest nodes 12:28:12,814 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] SplitBrainResolver - This node is now the leader responsible for taking SBR decisions among the reachable nodes (more leaders may exist). 12:28:12,815 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - Singleton manager starting singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:12,816 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest] 12:28:12,816 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] IdleSupervisor - Idle supervisor started on Member(akka://ClusterSystem@127.0.0.1:2552, Up, dc-backup). 12:28:13,180 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterHeartbeat - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Cross DC heartbeat becoming ACTIVE on this node (for DC: dc-primary), monitoring other DCs oldest nodes 12:28:13,261 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterHeartbeat - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Cross DC heartbeat becoming ACTIVE on this node (for DC: dc-backup), monitoring other DCs oldest nodes 12:28:13,261 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Start -> Younger] 12:28:13,268 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonProxy - Singleton identified at [akka://ClusterSystem@127.0.0.1:2552/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:13,272 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] IdleSupervisor - Clearing candidates for member: member-4 12:28:13,272 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] IdleSupervisor - Clearing candidates for member: member-4 12:28:13,275 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] ClusterHeartbeat - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Cross DC heartbeat becoming ACTIVE on this node (for DC: dc-primary), monitoring other DCs oldest nodes 12:28:13,285 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] IdleSupervisor - Unable to retrieve candidate data for member-4, no candidates present sending empty reply 12:28:13,286 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] IdleSupervisor - Unable to retrieve candidate data for member-4, no candidates present sending empty reply 12:28:13,290 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] CandidateRegistryInit - member-4 : Clearing of candidates from previous instance done, switching to CandidateRegistry. 12:28:13,290 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] CandidateRegistry - member-4 : Candidate registry started 12:28:13,290 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.eos.akka.owner.supervisor.command.ClearCandidatesResponse] to Actor[akka://ClusterSystem/temp/$a] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/temp/$a] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:13,315 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] CandidateRegistry - member-1 - Registering candidate(member-1) for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:13,315 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] CandidateRegistry - member-4 - Registering candidate(member-4) for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:13,316 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] CandidateRegistryInit - Stashing RegisterCandidate{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], candidate=member-3} 12:28:13,336 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] CandidateRegistry - member-1 : Received update response: UpdateSuccess(candidateRegistry) 12:28:13,337 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] CandidateRegistry - member-4 : Received update response: UpdateSuccess(candidateRegistry) 12:28:13,824 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonProxy - Singleton identified at [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:13,825 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] IdleSupervisor - Clearing candidates for member: member-3 12:28:13,825 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] IdleSupervisor - Clearing candidates for member: member-3 12:28:13,846 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] IdleSupervisor - Retrieved candidate data, clearing candidates for member-3 12:28:13,849 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] IdleSupervisor - Retrieved candidate data, clearing candidates for member-3 12:28:13,849 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateCleaner - Clearing candidates for member: member-3 12:28:13,850 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateCleaner - Did not clear any candidates for member-3 12:28:13,850 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemoteDeadLetterActorRef - Message [org.opendaylight.controller.eos.akka.owner.supervisor.command.ClearCandidatesResponse] to Actor[akka://ClusterSystem/deadLetters] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/deadLetters] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:13,851 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateCleaner - Clearing candidates for member: member-3 12:28:13,852 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateCleaner - Did not clear any candidates for member-3 12:28:13,852 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistryInit - member-3 : Clearing of candidates from previous instance done, switching to CandidateRegistry. 12:28:13,854 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistry - member-3 : Candidate registry started 12:28:13,854 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistry - member-3 - Registering candidate(member-3) for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:13,856 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistry - member-3 : Received update response: UpdateSuccess(candidateRegistry) 12:28:14,54 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] IdleSupervisor - Received ActivateDataCenter command switching to syncer behavior, 12:28:14,56 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSyncer - Starting candidate and owner sync 12:28:14,66 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSyncer - Owner not found. NotFound(DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]) 12:28:14,67 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSyncer - Initial sync done, switching to supervisor. candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=[member-1, member-3, member-4]}, owners: {} 12:28:14,76 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Entity DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] new owner: member-1 12:28:14,80 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Owner Supervisor started 12:28:14,83 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Owner has changed for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:14,83 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2550, roles=[dc-dc-primary, member-1]} 12:28:14,83 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2551, roles=[dc-dc-primary, member-2]} 12:28:14,84 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2552, roles=[member-3, dc-dc-backup]} 12:28:14,84 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Received reachable event from a foreign datacenter, Ignoring... Roles: [member-3, dc-dc-backup] 12:28:14,84 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2553, roles=[member-4, dc-dc-backup]} 12:28:14,84 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Received reachable event from a foreign datacenter, Ignoring... Roles: [member-4, dc-dc-backup] 12:28:14,96 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - onCandidatesChanged Changed(candidateRegistry) 12:28:14,96 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Processing candidates for : DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], new value: Set(member-1, member-3, member-4) 12:28:14,100 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - currently present candidates: [member-1, member-3, member-4] 12:28:14,100 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - difference: [] 12:28:14,100 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Current state for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : [member-1, member-3, member-4] 12:28:14,267 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] EntityTypeListenerRegistry - Spawning entity type listener actor for: test-type 12:28:14,298 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-1, member-3, member-4)} 12:28:14,299 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] EntityTypeListenerActor - Starting listener for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:14,306 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] SingleEntityListenerActor - OwnerListenerActor for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] started 12:28:14,307 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] SingleEntityListenerActor - Received initial sync response for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], response: GetSuccess(DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]) 12:28:14,307 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] SingleEntityListenerActor - Owner present for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] at the time of initial sync. 12:28:14,334 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: , newOwner: member-1 12:28:14,335 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: , wasOwner: false, isOwner: true, hasOwner:true 12:28:14,364 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] EntityTypeListenerActor - member-1 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_GRANTED [wasOwner=false, isOwner=true, hasOwner=true], inJeopardy=false} 12:28:14,365 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] EOS-listener-member-1 - member-1 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_GRANTED [wasOwner=false, isOwner=true, hasOwner=true], inJeopardy=false} 12:28:14,365 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] EOS-listener-member-1 - member-1 changes: 0 12:28:14,472 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] EntityTypeListenerRegistry - Spawning entity type listener actor for: test-type 12:28:14,495 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-1, member-3, member-4)} 12:28:14,495 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] EntityTypeListenerActor - Starting listener for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:14,496 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] SingleEntityListenerActor - OwnerListenerActor for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] started 12:28:14,497 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] SingleEntityListenerActor - Received initial sync response for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], response: GetSuccess(DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]) 12:28:14,497 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] SingleEntityListenerActor - Owner present for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] at the time of initial sync. 12:28:14,534 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: , newOwner: member-1 12:28:14,534 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: , wasOwner: false, isOwner: false, hasOwner:true 12:28:14,535 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] EntityTypeListenerActor - member-3 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=REMOTE_OWNERSHIP_CHANGED [wasOwner=false, isOwner=false, hasOwner=true], inJeopardy=false} 12:28:14,535 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] EOS-listener-member-3 - member-3 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=REMOTE_OWNERSHIP_CHANGED [wasOwner=false, isOwner=false, hasOwner=true], inJeopardy=false} 12:28:14,535 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] EOS-listener-member-3 - member-3 changes: 0 12:28:14,675 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] CandidateRegistry - member-1 - Removing candidate(member-1) from entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:14,681 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] CandidateRegistry - member-1 : Received update response: UpdateSuccess(candidateRegistry) 12:28:14,695 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - onCandidatesChanged Changed(candidateRegistry) 12:28:14,695 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Processing candidates for : DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], new value: Set(member-3, member-4) 12:28:14,695 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-3, member-4)} 12:28:14,695 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - currently present candidates: [member-1, member-3, member-4] 12:28:14,695 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - difference: [member-1] 12:28:14,695 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Removing candidate from entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] - member-1 12:28:14,696 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Reassigning owners for [DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]] 12:28:14,696 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - No candidate is reachable for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], activeMembers: [member-1, member-2], currentCandidates: [member-3, member-4] 12:28:14,696 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Current state for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : [member-3, member-4] 12:28:14,699 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Owner has changed for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:14,736 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: member-1, newOwner: 12:28:14,737 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: member-1, wasOwner: true, isOwner: false, hasOwner:false 12:28:14,738 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] EntityTypeListenerActor - member-1 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_LOST_NO_OWNER [wasOwner=true, isOwner=false, hasOwner=false], inJeopardy=false} 12:28:14,738 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] EOS-listener-member-1 - member-1 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_LOST_NO_OWNER [wasOwner=true, isOwner=false, hasOwner=false], inJeopardy=false} 12:28:14,738 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] EOS-listener-member-1 - member-1 changes: 1 12:28:14,855 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-3, member-4)} 12:28:14,895 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: member-1, newOwner: 12:28:14,895 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-3, member-4)} 12:28:14,895 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: member-1, wasOwner: false, isOwner: false, hasOwner:false 12:28:14,896 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] EntityTypeListenerActor - member-3 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=REMOTE_OWNERSHIP_LOST_NO_OWNER [wasOwner=false, isOwner=false, hasOwner=false], inJeopardy=false} 12:28:14,896 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] EOS-listener-member-3 - member-3 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=REMOTE_OWNERSHIP_LOST_NO_OWNER [wasOwner=false, isOwner=false, hasOwner=false], inJeopardy=false} 12:28:14,896 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] EOS-listener-member-3 - member-3 changes: 1 12:28:15,90 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 12:28:15,98 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Marked address [akka://ClusterSystem@127.0.0.1:2550] as [Leaving] 12:28:15,100 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2550, roles=[dc-dc-primary, member-1]} 12:28:15,104 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterSingletonManager - Exited [akka://ClusterSystem@127.0.0.1:2550]. 12:28:15,104 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterSingletonManager - Oldest observed OldestChanged: [akka://ClusterSystem@127.0.0.1:2550 -> Some(akka://ClusterSystem@127.0.0.1:2551)] 12:28:15,106 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Oldest -> WasOldest] 12:28:15,976 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2550] to [Exiting] 12:28:15,983 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2550, roles=[dc-dc-primary, member-1]} 12:28:15,984 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] SplitBrainResolver - This node is not the leader any more and not responsible for taking SBR decisions. 12:28:15,988 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - Younger observed OldestChanged: [Some(akka://ClusterSystem@127.0.0.1:2550) -> myself] 12:28:15,988 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] SplitBrainResolver - This node is now the leader responsible for taking SBR decisions among the reachable nodes (more leaders may exist). 12:28:15,993 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Younger -> BecomingOldest] 12:28:15,997 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - Singleton manager stopping singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:15,997 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [WasOldest -> HandingOver] 12:28:16,0 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterSingletonManager - Singleton terminated, hand-over done [akka://ClusterSystem@127.0.0.1:2550 -> Some(akka://ClusterSystem@127.0.0.1:2551)] 12:28:16,0 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [HandingOver -> End] 12:28:16,1 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Exiting completed 12:28:16,2 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - Hand-over in progress at [akka://ClusterSystem@127.0.0.1:2550] 12:28:16,2 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - Singleton manager starting singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:16,2 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [BecomingOldest -> Oldest] 12:28:16,2 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] IdleSupervisor - Idle supervisor started on Member(akka://ClusterSystem@127.0.0.1:2551, Up, dc-primary). 12:28:16,4 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Shutting down... 12:28:16,8 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Successfully shut down 12:28:16,14 PM [ClusterSystem-akka.actor.default-dispatcher-18] [INFO] ClusterSingletonManager - Self removed, stopping ClusterSingletonManager 12:28:16,27 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Exiting confirmed [akka://ClusterSystem@127.0.0.1:2550] 12:28:16,28 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] LocalActorRef - Message [akka.cluster.GossipEnvelope] from Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon#-1117209346] to Actor[akka://ClusterSystem/system/cluster/core/daemon#-897030710] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/system/cluster/core/daemon#-897030710] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:16,38 PM [ClusterSystem-akka.actor.default-dispatcher-28] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 12:28:16,39 PM [ClusterSystem-akka.actor.default-dispatcher-28] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. 12:28:16,98 PM [ClusterSystem-akka.actor.default-dispatcher-28] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. 12:28:16,122 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 12:28:16,125 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Marked address [akka://ClusterSystem@127.0.0.1:2551] as [Leaving] 12:28:16,128 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - Exited [akka://ClusterSystem@127.0.0.1:2551]. 12:28:16,129 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - Oldest observed OldestChanged: [akka://ClusterSystem@127.0.0.1:2551 -> None] 12:28:16,129 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Oldest -> WasOldest] 12:28:16,634 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - is the new leader among reachable nodes (more leaders may exist) 12:28:16,636 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2551] to [Exiting] 12:28:16,637 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Leader is removing confirmed Exiting node [akka://ClusterSystem@127.0.0.1:2550] 12:28:16,886 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Leader is removing Exiting node [akka://ClusterSystem@127.0.0.1:2550] in DC [dc-primary] 12:28:17,73 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Association - Association to [akka://ClusterSystem@127.0.0.1:2550] having UID [-6747608796921370120] has been stopped. All messages to this UID will be delivered to dead letters. Reason: ActorSystem terminated 12:28:17,75 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Association - Association to [akka://ClusterSystem@127.0.0.1:2550] having UID [-6747608796921370120] has been stopped. All messages to this UID will be delivered to dead letters. Reason: ActorSystem terminated 12:28:17,76 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Association - Association to [akka://ClusterSystem@127.0.0.1:2550] having UID [-6747608796921370120] has been stopped. All messages to this UID will be delivered to dead letters. Reason: ActorSystem terminated 12:28:17,143 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] ClusterSingletonManager - Singleton manager stopping singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:17,144 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [WasOldest -> Stopping] 12:28:17,144 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] ClusterSingletonManager - Singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] was terminated 12:28:17,145 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Exiting completed 12:28:17,146 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Shutting down... 12:28:17,146 PM [ClusterSystem-akka.actor.default-dispatcher-12] [WARN] Cluster - Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config 12:28:17,146 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Successfully shut down 12:28:17,150 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] LocalActorRef - Message [akka.cluster.InternalClusterAction$PublishChanges] from Actor[akka://ClusterSystem/system/cluster/core/daemon#-858474766] to Actor[akka://ClusterSystem/system/cluster/core/publisher#1850843485] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/system/cluster/core/publisher#1850843485] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:17,151 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] LocalActorRef - Message [akka.cluster.ddata.Replicator$Internal$Status] from Actor[akka://ClusterSystem@127.0.0.1:2552/system/clusterReceptionist/replicator#1713887114] to Actor[akka://ClusterSystem/system/clusterReceptionist/replicator#-2008433989] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/system/clusterReceptionist/replicator#-2008433989] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:17,157 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 12:28:17,158 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. 12:28:17,906 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Leader is removing Exiting node [akka://ClusterSystem@127.0.0.1:2551] in DC [dc-primary] 12:28:18,176 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Association - Association to [akka://ClusterSystem@127.0.0.1:2551] having UID [2685234194522523776] has been stopped. All messages to this UID will be delivered to dead letters. Reason: ActorSystem terminated 12:28:18,182 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. 12:28:18,186 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Association - Association to [akka://ClusterSystem@127.0.0.1:2551] having UID [2685234194522523776] has been stopped. All messages to this UID will be delivered to dead letters. Reason: ActorSystem terminated 12:28:18,204 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] IdleSupervisor - Received ActivateDataCenter command switching to syncer behavior, 12:28:18,204 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] OwnerSyncer - Starting candidate and owner sync 12:28:18,210 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] OwnerSyncer - Initial sync done, switching to supervisor. candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=[member-3, member-4]}, owners: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=} 12:28:18,211 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] OwnerSupervisor - Reassigning owners for [DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]] 12:28:18,211 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] OwnerSupervisor - Entity DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] new owner: member-3 12:28:18,211 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] OwnerSupervisor - Owner Supervisor started 12:28:18,213 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2552, roles=[member-3, dc-dc-backup]} 12:28:18,213 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2553, roles=[member-4, dc-dc-backup]} 12:28:18,213 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] OwnerSupervisor - Owner has changed for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:18,214 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] OwnerSupervisor - onCandidatesChanged Changed(candidateRegistry) 12:28:18,214 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: , newOwner: member-3 12:28:18,214 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: , wasOwner: false, isOwner: true, hasOwner:true 12:28:18,214 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] OwnerSupervisor - Processing candidates for : DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], new value: Set(member-3, member-4) 12:28:18,214 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] OwnerSupervisor - currently present candidates: [member-3, member-4] 12:28:18,215 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] OwnerSupervisor - difference: [] 12:28:18,215 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] EntityTypeListenerActor - member-3 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_GRANTED [wasOwner=false, isOwner=true, hasOwner=true], inJeopardy=false} 12:28:18,215 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] OwnerSupervisor - Current state for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : [member-3, member-4] 12:28:18,215 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] EOS-listener-member-3 - member-3 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_GRANTED [wasOwner=false, isOwner=true, hasOwner=true], inJeopardy=false} 12:28:18,215 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] EOS-listener-member-3 - member-3 changes: 2 12:28:18,509 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] CandidateRegistry - member-3 - Removing candidate(member-3) from entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:18,513 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] CandidateRegistry - member-3 : Received update response: UpdateSuccess(candidateRegistry) 12:28:18,534 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - onCandidatesChanged Changed(candidateRegistry) 12:28:18,534 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Processing candidates for : DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], new value: Set(member-4) 12:28:18,535 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - currently present candidates: [member-3, member-4] 12:28:18,535 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - difference: [member-3] 12:28:18,535 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Removing candidate from entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] - member-3 12:28:18,535 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-4)} 12:28:18,535 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Reassigning owners for [DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]] 12:28:18,535 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Entity DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] new owner: member-4 12:28:18,536 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Current state for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : [member-4] 12:28:18,537 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Owner has changed for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:18,573 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: member-3, newOwner: member-4 12:28:18,574 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: member-3, wasOwner: true, isOwner: false, hasOwner:true 12:28:18,574 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] EntityTypeListenerActor - member-3 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_LOST_NEW_OWNER [wasOwner=true, isOwner=false, hasOwner=true], inJeopardy=false} 12:28:18,574 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] EOS-listener-member-3 - member-3 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_LOST_NEW_OWNER [wasOwner=true, isOwner=false, hasOwner=true], inJeopardy=false} 12:28:18,574 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] EOS-listener-member-3 - member-3 changes: 3 12:28:18,713 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 12:28:18,714 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Marked address [akka://ClusterSystem@127.0.0.1:2552] as [Leaving] 12:28:18,715 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2552, roles=[member-3, dc-dc-backup]} 12:28:18,716 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - Exited [akka://ClusterSystem@127.0.0.1:2552]. 12:28:18,717 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - Oldest observed OldestChanged: [akka://ClusterSystem@127.0.0.1:2552 -> Some(akka://ClusterSystem@127.0.0.1:2553)] 12:28:18,717 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Oldest -> WasOldest] 12:28:18,925 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2552] to [Exiting] 12:28:18,927 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] SplitBrainResolver - This node is not the leader any more and not responsible for taking SBR decisions. 12:28:18,927 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2552, roles=[member-3, dc-dc-backup]} 12:28:18,937 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] ClusterSingletonManager - Younger observed OldestChanged: [Some(akka://ClusterSystem@127.0.0.1:2552) -> myself] 12:28:18,937 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Younger -> BecomingOldest] 12:28:18,937 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] SplitBrainResolver - This node is now the leader responsible for taking SBR decisions among the reachable nodes (more leaders may exist). 12:28:18,940 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - Singleton manager stopping singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:18,940 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - Hand-over in progress at [akka://ClusterSystem@127.0.0.1:2552] 12:28:18,940 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [WasOldest -> HandingOver] 12:28:18,941 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] ClusterSingletonManager - Singleton terminated, hand-over done [akka://ClusterSystem@127.0.0.1:2552 -> Some(akka://ClusterSystem@127.0.0.1:2553)] 12:28:18,941 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [HandingOver -> End] 12:28:18,942 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Exiting completed 12:28:18,943 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Shutting down... 12:28:18,945 PM [ClusterSystem-akka.actor.default-dispatcher-13] [WARN] Cluster - Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config 12:28:18,946 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Successfully shut down 12:28:18,946 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] ClusterSingletonManager - Self removed, stopping ClusterSingletonManager 12:28:18,949 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 12:28:18,949 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. 12:28:18,951 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - Singleton manager starting singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:18,951 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [BecomingOldest -> Oldest] 12:28:18,951 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Exiting confirmed [akka://ClusterSystem@127.0.0.1:2552] 12:28:18,952 PM [ClusterSystem-akka.actor.default-dispatcher-15] [DEBUG] IdleSupervisor - Idle supervisor started on Member(akka://ClusterSystem@127.0.0.1:2553, Up, dc-backup). 12:28:19,127 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - is the new leader among reachable nodes (more leaders may exist) 12:28:19,128 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Leader is removing confirmed Exiting node [akka://ClusterSystem@127.0.0.1:2552] 12:28:19,957 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonProxy - Singleton identified at [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:19,970 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Association - Association to [akka://ClusterSystem@127.0.0.1:2552] having UID [6348249461844014393] has been stopped. All messages to this UID will be delivered to dead letters. Reason: ActorSystem terminated 12:28:19,986 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 12:28:19,990 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Marked address [akka://ClusterSystem@127.0.0.1:2553] as [Leaving] 12:28:19,990 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - Exited [akka://ClusterSystem@127.0.0.1:2553]. 12:28:19,990 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - Oldest observed OldestChanged: [akka://ClusterSystem@127.0.0.1:2553 -> None] 12:28:19,991 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Oldest -> WasOldest] 12:28:20,146 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2553] to [Exiting] 12:28:20,378 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemoteDeadLetterActorRef - Message [akka.cluster.GossipStatus] from Actor[akka://ClusterSystem/system/cluster/core/daemon#1871339795] to Actor[akka://ClusterSystem/deadLetters] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/deadLetters] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:20,379 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemoteDeadLetterActorRef - Message [akka.cluster.ddata.Replicator$Internal$Status] from Actor[akka://ClusterSystem/system/ddataReplicator#1770734207] to Actor[akka://ClusterSystem/deadLetters] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/deadLetters] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:20,379 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemoteDeadLetterActorRef - Message [akka.cluster.ddata.Replicator$Internal$Status] from Actor[akka://ClusterSystem/system/ddataReplicator#1770734207] to Actor[akka://ClusterSystem/deadLetters] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/deadLetters] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:20,379 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemoteDeadLetterActorRef - Message [akka.cluster.ddata.Replicator$Internal$Status] from Actor[akka://ClusterSystem/system/clusterReceptionist/replicator#-376524446] to Actor[akka://ClusterSystem/deadLetters] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/deadLetters] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:21,6 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - Singleton manager stopping singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:21,6 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [WasOldest -> Stopping] 12:28:21,7 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - Singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] was terminated 12:28:21,8 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Exiting completed 12:28:21,9 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Shutting down... 12:28:21,9 PM [ClusterSystem-akka.actor.default-dispatcher-14] [WARN] Cluster - Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config 12:28:21,10 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Successfully shut down 12:28:21,17 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 12:28:21,17 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. 12:28:21,61 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 12:28:21,85 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://ClusterSystem@127.0.0.1:2550] with UID [-3476622026299198726] 12:28:21,85 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Starting up, Akka version [2.6.21] ... 12:28:21,85 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Registered cluster JMX MBean [akka:type=Cluster] 12:28:21,85 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Started up successfully 12:28:21,97 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] SplitBrainResolver - SBR started. Config: strategy [KeepMajority], stable-after [7 seconds], down-all-when-unstable [5250 milliseconds], selfUniqueAddress [akka://ClusterSystem@127.0.0.1:2550#-3476622026299198726], selfDc [dc-primary]. 12:28:21,123 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistryInit - member-1 : CandidateRegistry syncing behavior started. 12:28:21,123 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:21,155 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started 12:28:21,176 PM [ClusterSystem-akka.actor.default-dispatcher-5] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2551], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2551,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:21,176 PM [ClusterSystem-akka.actor.default-dispatcher-5] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2552], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2552,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:21,176 PM [ClusterSystem-akka.actor.default-dispatcher-5] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2552], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2552,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:21,177 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://ClusterSystem@127.0.0.1:2551] with UID [-7909535992712766502] 12:28:21,178 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Starting up, Akka version [2.6.21] ... 12:28:21,181 PM [ClusterSystem-akka.actor.default-dispatcher-6] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config 12:28:21,181 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Started up successfully 12:28:21,209 PM [ClusterSystem-akka.actor.default-dispatcher-5] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2553], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2553,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:21,214 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] SplitBrainResolver - SBR started. Config: strategy [KeepMajority], stable-after [7 seconds], down-all-when-unstable [5250 milliseconds], selfUniqueAddress [akka://ClusterSystem@127.0.0.1:2551#-7909535992712766502], selfDc [dc-primary]. 12:28:21,224 PM [ClusterSystem-akka.actor.default-dispatcher-5] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2553], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2553,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:21,234 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistryInit - member-2 : CandidateRegistry syncing behavior started. 12:28:21,234 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:21,267 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started 12:28:21,272 PM [ClusterSystem-akka.actor.default-dispatcher-17] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2552], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2552,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:21,273 PM [ClusterSystem-akka.actor.default-dispatcher-17] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2552], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2552,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:21,275 PM [ClusterSystem-akka.actor.default-dispatcher-17] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2553], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2553,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:21,281 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon/joinSeedNodeProcess-1#-847531069]], but this node is not initialized yet 12:28:21,280 PM [ClusterSystem-akka.actor.default-dispatcher-17] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2553], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2553,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 12:28:21,289 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://ClusterSystem@127.0.0.1:2552] with UID [-3169229466353648859] 12:28:21,289 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Starting up, Akka version [2.6.21] ... 12:28:21,294 PM [ClusterSystem-akka.actor.default-dispatcher-6] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config 12:28:21,295 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Started up successfully 12:28:21,310 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] SplitBrainResolver - SBR started. Config: strategy [KeepMajority], stable-after [7 seconds], down-all-when-unstable [5250 milliseconds], selfUniqueAddress [akka://ClusterSystem@127.0.0.1:2552#-3169229466353648859], selfDc [dc-backup]. 12:28:21,313 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] CandidateRegistryInit - member-3 : CandidateRegistry syncing behavior started. 12:28:21,313 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:21,337 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started 12:28:21,364 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://ClusterSystem@127.0.0.1:2553] with UID [283754386703385489] 12:28:21,364 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Starting up, Akka version [2.6.21] ... 12:28:21,368 PM [ClusterSystem-akka.actor.default-dispatcher-10] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config 12:28:21,368 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Started up successfully 12:28:21,377 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] SplitBrainResolver - SBR started. Config: strategy [KeepMajority], stable-after [7 seconds], down-all-when-unstable [5250 milliseconds], selfUniqueAddress [akka://ClusterSystem@127.0.0.1:2553#283754386703385489], selfDc [dc-backup]. 12:28:21,404 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] CandidateRegistryInit - member-4 : CandidateRegistry syncing behavior started. 12:28:21,404 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:21,462 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#1143097416]], but this node is not initialized yet 12:28:21,466 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#-1530117219]], but this node is not initialized yet 12:28:22,214 PM [ClusterSystem-akka.actor.default-dispatcher-17] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon/firstSeedNodeProcess-1#850754193]], but this node is not initialized yet 12:28:22,214 PM [ClusterSystem-akka.actor.default-dispatcher-17] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon/firstSeedNodeProcess-1#850754193]], but this node is not initialized yet 12:28:22,221 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoinNack message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon#-979596865]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:22,221 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoinNack message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon#-979596865]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:22,257 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon/firstSeedNodeProcess-1#850754193]], but this node is not initialized yet 12:28:22,257 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon/firstSeedNodeProcess-1#850754193]], but this node is not initialized yet 12:28:22,270 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#1143097416]], but this node is not initialized yet 12:28:22,270 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoinNack message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon#-1923455031]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:22,270 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoinNack message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon#-1923455031]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:22,291 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon/firstSeedNodeProcess-1#850754193]], but this node is not initialized yet 12:28:22,292 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon/firstSeedNodeProcess-1#850754193]], but this node is not initialized yet 12:28:22,298 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoinNack message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon#698944379]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:22,298 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#-1530117219]], but this node is not initialized yet 12:28:22,299 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Node [akka://ClusterSystem@127.0.0.1:2550] is JOINING itself (with roles [member-1, dc-dc-primary], version [0.0.0]) and forming new cluster 12:28:22,299 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - is the new leader among reachable nodes (more leaders may exist) 12:28:22,299 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2550] to [Up] 12:28:22,300 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] SplitBrainResolver - This node is now the leader responsible for taking SBR decisions among the reachable nodes (more leaders may exist). 12:28:22,302 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - Singleton manager starting singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:22,302 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] IdleSupervisor - Idle supervisor started on Member(akka://ClusterSystem@127.0.0.1:2550, Up, dc-primary). 12:28:22,302 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest] 12:28:22,307 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#1143097416]], but this node is not initialized yet 12:28:22,383 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon/joinSeedNodeProcess-1#-847531069]], but this node is not initialized yet 12:28:22,395 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#-1530117219]], but this node is not initialized yet 12:28:23,312 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterSingletonProxy - Singleton identified at [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:23,312 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] IdleSupervisor - Clearing candidates for member: member-1 12:28:23,313 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] IdleSupervisor - Unable to retrieve candidate data for member-1, no candidates present sending empty reply 12:28:23,313 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistryInit - member-1 : Clearing of candidates from previous instance done, switching to CandidateRegistry. 12:28:23,314 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistry - member-1 : Candidate registry started 12:28:26,252 PM [ClusterSystem-akka.actor.default-dispatcher-14] [WARN] CandidateRegistryInit - member-2 : Initial removal of candidates from previous iteration failed. Rescheduling. java.util.concurrent.TimeoutException: Ask timed out on [Actor[akka://ClusterSystem/system/singletonProxyOwnerSupervisor-no-dc#-518777095]] after [5000 ms]. Message of type [org.opendaylight.controller.eos.akka.owner.supervisor.command.ClearCandidatesForMember]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply. at akka.actor.typed.scaladsl.AskPattern$.$anonfun$onTimeout$1(AskPattern.scala:131) at akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:730) at akka.actor.Scheduler$$anon$7.run(Scheduler.scala:479) at scala.concurrent.ExecutionContext$parasitic$.execute(ExecutionContext.scala:222) at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:365) at akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:314) at akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:318) at akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:270) at java.base/java.lang.Thread.run(Thread.java:833) 12:28:26,252 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:26,331 PM [ClusterSystem-akka.actor.default-dispatcher-10] [WARN] CandidateRegistryInit - member-3 : Initial removal of candidates from previous iteration failed. Rescheduling. java.util.concurrent.TimeoutException: Ask timed out on [Actor[akka://ClusterSystem/system/singletonProxyOwnerSupervisor-no-dc#-731068429]] after [5000 ms]. Message of type [org.opendaylight.controller.eos.akka.owner.supervisor.command.ClearCandidatesForMember]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply. at akka.actor.typed.scaladsl.AskPattern$.$anonfun$onTimeout$1(AskPattern.scala:131) at akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:730) at akka.actor.Scheduler$$anon$7.run(Scheduler.scala:479) at scala.concurrent.ExecutionContext$parasitic$.execute(ExecutionContext.scala:222) at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:365) at akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:314) at akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:318) at akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:270) at java.base/java.lang.Thread.run(Thread.java:833) 12:28:26,332 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:26,420 PM [ClusterSystem-akka.actor.default-dispatcher-13] [WARN] CandidateRegistryInit - member-4 : Initial removal of candidates from previous iteration failed. Rescheduling. java.util.concurrent.TimeoutException: Ask timed out on [Actor[akka://ClusterSystem/system/singletonProxyOwnerSupervisor-no-dc#265044545]] after [5000 ms]. Message of type [org.opendaylight.controller.eos.akka.owner.supervisor.command.ClearCandidatesForMember]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply. at akka.actor.typed.scaladsl.AskPattern$.$anonfun$onTimeout$1(AskPattern.scala:131) at akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:730) at akka.actor.Scheduler$$anon$7.run(Scheduler.scala:479) at scala.concurrent.ExecutionContext$parasitic$.execute(ExecutionContext.scala:222) at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:365) at akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:314) at akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:318) at akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:270) at java.base/java.lang.Thread.run(Thread.java:833) 12:28:26,420 PM [ClusterSystem-akka.actor.default-dispatcher-13] [DEBUG] CandidateRegistryInit - Sending RemovePreviousCandidates. 12:28:27,405 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#1143097416]], but this node is not initialized yet 12:28:27,406 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#1143097416]], but this node is not initialized yet 12:28:27,409 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#1143097416]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:27,409 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Sending InitJoinAck message from node [akka://ClusterSystem@127.0.0.1:2550] to [Actor[akka://ClusterSystem@127.0.0.1:2552/system/cluster/core/daemon/joinSeedNodeProcess-1#1143097416]] (version [2.6.21]) 12:28:27,435 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon/joinSeedNodeProcess-1#-847531069]], but this node is not initialized yet 12:28:27,435 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#-1530117219]], but this node is not initialized yet 12:28:27,435 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon/joinSeedNodeProcess-1#-847531069]], but this node is not initialized yet 12:28:27,440 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon/joinSeedNodeProcess-1#-847531069]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:27,440 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Sending InitJoinAck message from node [akka://ClusterSystem@127.0.0.1:2550] to [Actor[akka://ClusterSystem@127.0.0.1:2551/system/cluster/core/daemon/joinSeedNodeProcess-1#-847531069]] (version [2.6.21]) 12:28:27,443 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#-1530117219]], but this node is not initialized yet 12:28:27,445 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Received InitJoinAck message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon#1636592621]] to [akka://ClusterSystem@127.0.0.1:2552] 12:28:27,456 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Received InitJoin message from [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#-1530117219]] to [akka://ClusterSystem@127.0.0.1:2550] 12:28:27,456 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Sending InitJoinAck message from node [akka://ClusterSystem@127.0.0.1:2550] to [Actor[akka://ClusterSystem@127.0.0.1:2553/system/cluster/core/daemon/joinSeedNodeProcess-1#-1530117219]] (version [2.6.21]) 12:28:27,465 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Received InitJoinAck message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon#1636592621]] to [akka://ClusterSystem@127.0.0.1:2551] 12:28:27,470 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Node [akka://ClusterSystem@127.0.0.1:2552] is JOINING, roles [member-3, dc-dc-backup], version [0.0.0] 12:28:27,471 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Node [akka://ClusterSystem@127.0.0.1:2551] is JOINING, roles [member-2, dc-dc-primary], version [0.0.0] 12:28:27,473 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Welcome from [akka://ClusterSystem@127.0.0.1:2550] 12:28:27,475 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Received InitJoinAck message from [Actor[akka://ClusterSystem@127.0.0.1:2550/system/cluster/core/daemon#1636592621]] to [akka://ClusterSystem@127.0.0.1:2553] 12:28:27,477 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Node [akka://ClusterSystem@127.0.0.1:2553] is JOINING, roles [member-4, dc-dc-backup], version [0.0.0] 12:28:27,481 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Welcome from [akka://ClusterSystem@127.0.0.1:2550] 12:28:27,492 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Welcome from [akka://ClusterSystem@127.0.0.1:2550] 12:28:27,509 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] ClusterSingletonProxy - Singleton identified at [akka://ClusterSystem@127.0.0.1:2550/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:27,512 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] IdleSupervisor - Clearing candidates for member: member-2 12:28:27,512 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] IdleSupervisor - Clearing candidates for member: member-2 12:28:27,519 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] IdleSupervisor - Unable to retrieve candidate data for member-2, no candidates present sending empty reply 12:28:27,519 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] IdleSupervisor - Unable to retrieve candidate data for member-2, no candidates present sending empty reply 12:28:27,530 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.eos.akka.owner.supervisor.command.ClearCandidatesResponse] to Actor[akka://ClusterSystem/temp/$a] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/temp/$a] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:27,531 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] CandidateRegistryInit - member-2 : Clearing of candidates from previous instance done, switching to CandidateRegistry. 12:28:27,531 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] CandidateRegistry - member-2 : Candidate registry started 12:28:28,233 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2551] to [Up] 12:28:28,320 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Start -> Younger] 12:28:28,441 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - is the new leader among reachable nodes (more leaders may exist) 12:28:29,470 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2552] to [Up] 12:28:29,470 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2553] to [Up] 12:28:29,470 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] ClusterHeartbeat - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Cross DC heartbeat becoming ACTIVE on this node (for DC: dc-backup), monitoring other DCs oldest nodes 12:28:29,470 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] SplitBrainResolver - This node is now the leader responsible for taking SBR decisions among the reachable nodes (more leaders may exist). 12:28:29,473 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterSingletonManager - Singleton manager starting singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:29,473 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest] 12:28:29,473 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] IdleSupervisor - Idle supervisor started on Member(akka://ClusterSystem@127.0.0.1:2552, Up, dc-backup). 12:28:29,828 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterHeartbeat - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Cross DC heartbeat becoming ACTIVE on this node (for DC: dc-backup), monitoring other DCs oldest nodes 12:28:29,830 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Start -> Younger] 12:28:29,831 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonProxy - Singleton identified at [akka://ClusterSystem@127.0.0.1:2552/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:29,834 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] IdleSupervisor - Clearing candidates for member: member-4 12:28:29,834 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] IdleSupervisor - Clearing candidates for member: member-4 12:28:29,842 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] IdleSupervisor - Unable to retrieve candidate data for member-4, no candidates present sending empty reply 12:28:29,843 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] IdleSupervisor - Unable to retrieve candidate data for member-4, no candidates present sending empty reply 12:28:29,843 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] CandidateRegistryInit - member-4 : Clearing of candidates from previous instance done, switching to CandidateRegistry. 12:28:29,843 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] CandidateRegistry - member-4 : Candidate registry started 12:28:29,844 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.eos.akka.owner.supervisor.command.ClearCandidatesResponse] to Actor[akka://ClusterSystem/temp/$a] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/temp/$a] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:29,851 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistry - member-1 - Registering candidate(member-1) for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:29,852 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] IdleSupervisor - Received ActivateDataCenter command switching to syncer behavior, 12:28:29,852 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] CandidateRegistryInit - Stashing RegisterCandidate{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], candidate=member-3} 12:28:29,852 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSyncer - Starting candidate and owner sync 12:28:29,853 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateRegistry - member-1 : Received update response: UpdateSuccess(candidateRegistry) 12:28:29,853 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSyncer - Owner not found. NotFound(DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]) 12:28:29,854 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSyncer - Initial sync done, switching to supervisor. candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=[member-1]}, owners: {} 12:28:29,854 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Entity DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] new owner: member-1 12:28:29,854 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Owner Supervisor started 12:28:29,858 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2550, roles=[dc-dc-primary, member-1]} 12:28:29,858 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2551, roles=[dc-dc-primary, member-2]} 12:28:29,858 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Owner has changed for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:29,859 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2552, roles=[member-3, dc-dc-backup]} 12:28:29,859 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received unreachable event from a foreign datacenter, Ignoring... Roles: [member-3, dc-dc-backup] 12:28:29,859 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2553, roles=[member-4, dc-dc-backup]} 12:28:29,859 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received unreachable event from a foreign datacenter, Ignoring... Roles: [member-4, dc-dc-backup] 12:28:29,882 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - onCandidatesChanged Changed(candidateRegistry) 12:28:29,883 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Processing candidates for : DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], new value: Set(member-1) 12:28:29,883 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - currently present candidates: [member-1] 12:28:29,883 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - difference: [] 12:28:29,883 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Current state for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : [member-1] 12:28:29,954 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] EntityTypeListenerRegistry - Spawning entity type listener actor for: test-type 12:28:29,962 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-1)} 12:28:29,962 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] EntityTypeListenerActor - Starting listener for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:29,963 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] SingleEntityListenerActor - OwnerListenerActor for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] started 12:28:29,964 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] SingleEntityListenerActor - Received initial sync response for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], response: GetSuccess(DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]) 12:28:29,964 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] SingleEntityListenerActor - Owner present for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] at the time of initial sync. 12:28:30,1 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: , newOwner: member-1 12:28:30,2 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: , wasOwner: false, isOwner: true, hasOwner:true 12:28:30,2 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] EntityTypeListenerActor - member-1 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_GRANTED [wasOwner=false, isOwner=true, hasOwner=true], inJeopardy=false} 12:28:30,2 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] EOS-listener-member-1 - member-1 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_GRANTED [wasOwner=false, isOwner=true, hasOwner=true], inJeopardy=false} 12:28:30,2 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] EOS-listener-member-1 - member-1 changes: 0 12:28:30,30 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterHeartbeat - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Cross DC heartbeat becoming ACTIVE on this node (for DC: dc-primary), monitoring other DCs oldest nodes 12:28:30,157 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] EntityTypeListenerRegistry - Spawning entity type listener actor for: test-type 12:28:30,173 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-1)} 12:28:30,174 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] EntityTypeListenerActor - Starting listener for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:30,175 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] SingleEntityListenerActor - OwnerListenerActor for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] started 12:28:30,179 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] SingleEntityListenerActor - Received initial sync response for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], response: GetSuccess(DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]) 12:28:30,179 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] SingleEntityListenerActor - Owner present for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] at the time of initial sync. 12:28:30,211 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: , newOwner: member-1 12:28:30,211 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: , wasOwner: false, isOwner: false, hasOwner:true 12:28:30,211 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] EntityTypeListenerActor - member-3 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=REMOTE_OWNERSHIP_CHANGED [wasOwner=false, isOwner=false, hasOwner=true], inJeopardy=false} 12:28:30,211 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] EOS-listener-member-3 - member-3 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=REMOTE_OWNERSHIP_CHANGED [wasOwner=false, isOwner=false, hasOwner=true], inJeopardy=false} 12:28:30,211 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] EOS-listener-member-3 - member-3 changes: 0 12:28:30,280 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2552, roles=[member-3, dc-dc-backup]} 12:28:30,280 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterHeartbeat - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Cross DC heartbeat becoming ACTIVE on this node (for DC: dc-primary), monitoring other DCs oldest nodes 12:28:30,280 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received reachable event from a foreign datacenter, Ignoring... Roles: [member-3, dc-dc-backup] 12:28:30,280 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2553, roles=[member-4, dc-dc-backup]} 12:28:30,280 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received reachable event from a foreign datacenter, Ignoring... Roles: [member-4, dc-dc-backup] 12:28:30,365 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] CandidateRegistry - member-1 - Removing candidate(member-1) from entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:30,367 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] CandidateRegistry - member-1 : Received update response: UpdateSuccess(candidateRegistry) 12:28:30,368 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet()} 12:28:30,368 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - onCandidatesChanged Changed(candidateRegistry) 12:28:30,368 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Processing candidates for : DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], new value: Set() 12:28:30,368 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - currently present candidates: [member-1] 12:28:30,368 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - difference: [member-1] 12:28:30,368 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Removing candidate from entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] - member-1 12:28:30,368 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Reassigning owners for [DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]] 12:28:30,368 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - No candidates present for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:30,369 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Current state for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : [] 12:28:30,369 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Owner has changed for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:30,402 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: member-1, newOwner: 12:28:30,402 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: member-1, wasOwner: true, isOwner: false, hasOwner:false 12:28:30,402 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] EntityTypeListenerActor - member-1 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_LOST_NO_OWNER [wasOwner=true, isOwner=false, hasOwner=false], inJeopardy=false} 12:28:30,402 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] EOS-listener-member-1 - member-1 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_LOST_NO_OWNER [wasOwner=true, isOwner=false, hasOwner=false], inJeopardy=false} 12:28:30,402 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] EOS-listener-member-1 - member-1 changes: 1 12:28:30,453 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: member-1, newOwner: 12:28:30,453 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: member-1, wasOwner: false, isOwner: false, hasOwner:false 12:28:30,453 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet()} 12:28:30,453 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] EntityTypeListenerActor - member-3 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=REMOTE_OWNERSHIP_LOST_NO_OWNER [wasOwner=false, isOwner=false, hasOwner=false], inJeopardy=false} 12:28:30,453 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] EOS-listener-member-3 - member-3 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=REMOTE_OWNERSHIP_LOST_NO_OWNER [wasOwner=false, isOwner=false, hasOwner=false], inJeopardy=false} 12:28:30,453 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] EOS-listener-member-3 - member-3 changes: 1 12:28:30,482 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] ClusterSingletonProxy - Singleton identified at [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:30,482 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] IdleSupervisor - Clearing candidates for member: member-3 12:28:30,482 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] IdleSupervisor - Clearing candidates for member: member-3 12:28:30,495 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] IdleSupervisor - Retrieved candidate data, clearing candidates for member-3 12:28:30,496 PM [ClusterSystem-akka.actor.default-dispatcher-6] [DEBUG] IdleSupervisor - Retrieved candidate data, clearing candidates for member-3 12:28:30,496 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateCleaner - Clearing candidates for member: member-3 12:28:30,497 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] CandidateCleaner - Did not clear any candidates for member-3 12:28:30,496 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] CandidateCleaner - Clearing candidates for member: member-3 12:28:30,497 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] CandidateCleaner - Did not clear any candidates for member-3 12:28:30,497 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemoteDeadLetterActorRef - Message [org.opendaylight.controller.eos.akka.owner.supervisor.command.ClearCandidatesResponse] to Actor[akka://ClusterSystem/deadLetters] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://ClusterSystem/deadLetters] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:30,502 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] CandidateRegistryInit - member-3 : Clearing of candidates from previous instance done, switching to CandidateRegistry. 12:28:30,502 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] CandidateRegistry - member-3 : Candidate registry started 12:28:30,502 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] CandidateRegistry - member-3 - Registering candidate(member-3) for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:30,506 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] CandidateRegistry - member-3 : Received update response: UpdateSuccess(candidateRegistry) 12:28:30,531 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-3)} 12:28:30,603 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - onCandidatesChanged Changed(candidateRegistry) 12:28:30,603 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-3)} 12:28:30,603 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Processing candidates for : DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], new value: Set(member-3) 12:28:30,603 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - currently present candidates: [] 12:28:30,603 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - difference: [member-3] 12:28:30,604 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Adding new candidate for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : member-3 12:28:30,604 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - No candidate is reachable for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], activeMembers: [member-1, member-2], currentCandidates: [member-3] 12:28:30,604 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Current state for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : [member-3] 12:28:30,604 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Current state for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : [member-3] 12:28:30,642 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - onCandidatesChanged Changed(candidateRegistry) 12:28:30,642 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-3)} 12:28:30,642 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Processing candidates for : DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], new value: Set(member-3) 12:28:30,642 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - currently present candidates: [member-3] 12:28:30,643 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - difference: [] 12:28:30,643 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Current state for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : [member-3] 12:28:30,776 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] OwnerSupervisor - Deactivating Owner Supervisor on Member(akka://ClusterSystem@127.0.0.1:2550, Up, dc-primary) 12:28:30,777 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] IdleSupervisor - Idle supervisor started on Member(akka://ClusterSystem@127.0.0.1:2550, Up, dc-primary). 12:28:30,784 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] IdleSupervisor - Received ActivateDataCenter command switching to syncer behavior, 12:28:30,784 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSyncer - Starting candidate and owner sync 12:28:30,786 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSyncer - Initial sync done, switching to supervisor. candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=[member-3]}, owners: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=} 12:28:30,787 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Reassigning owners for [DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]] 12:28:30,787 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Entity DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] new owner: member-3 12:28:30,788 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Owner Supervisor started 12:28:30,788 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Owner has changed for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:30,789 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2550, roles=[dc-dc-primary, member-1]} 12:28:30,789 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received reachable event from a foreign datacenter, Ignoring... Roles: [dc-dc-primary, member-1] 12:28:30,789 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2551, roles=[dc-dc-primary, member-2]} 12:28:30,789 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received reachable event from a foreign datacenter, Ignoring... Roles: [dc-dc-primary, member-2] 12:28:30,789 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2552, roles=[member-3, dc-dc-backup]} 12:28:30,789 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received MemberUp : MemberUpEvent{address=akka://ClusterSystem@127.0.0.1:2553, roles=[member-4, dc-dc-backup]} 12:28:30,811 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: , newOwner: member-3 12:28:30,811 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: , wasOwner: false, isOwner: true, hasOwner:true 12:28:30,811 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - onCandidatesChanged Changed(candidateRegistry) 12:28:30,811 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] EntityTypeListenerActor - member-3 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_GRANTED [wasOwner=false, isOwner=true, hasOwner=true], inJeopardy=false} 12:28:30,811 PM [ClusterSystem-akka.actor.default-dispatcher-25] [INFO] EOS-listener-member-3 - member-3 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_GRANTED [wasOwner=false, isOwner=true, hasOwner=true], inJeopardy=false} 12:28:30,811 PM [ClusterSystem-akka.actor.default-dispatcher-25] [INFO] EOS-listener-member-3 - member-3 changes: 2 12:28:30,811 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Processing candidates for : DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], new value: Set(member-3) 12:28:30,811 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - currently present candidates: [member-3] 12:28:30,811 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - difference: [] 12:28:30,811 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Current state for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : [member-3] 12:28:31,2 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: , newOwner: member-3 12:28:31,2 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: , wasOwner: false, isOwner: false, hasOwner:true 12:28:31,2 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] EntityTypeListenerActor - member-1 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=REMOTE_OWNERSHIP_CHANGED [wasOwner=false, isOwner=false, hasOwner=true], inJeopardy=false} 12:28:31,2 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] EOS-listener-member-1 - member-1 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=REMOTE_OWNERSHIP_CHANGED [wasOwner=false, isOwner=false, hasOwner=true], inJeopardy=false} 12:28:31,2 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] EOS-listener-member-1 - member-1 changes: 2 12:28:31,297 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] CandidateRegistry - member-3 - Removing candidate(member-3) from entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:31,297 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] CandidateRegistry - member-4 - Registering candidate(member-4) for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:31,298 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] CandidateRegistry - member-4 : Received update response: UpdateSuccess(candidateRegistry) 12:28:31,299 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] CandidateRegistry - member-3 : Received update response: UpdateSuccess(candidateRegistry) 12:28:31,321 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-3, member-4)} 12:28:31,322 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] LocalActorRef - Message [org.opendaylight.controller.eos.akka.owner.supervisor.command.CandidatesChanged] to Actor[akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor#-344315728] was unhandled. [1] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:31,331 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-4)} 12:28:31,331 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - onCandidatesChanged Changed(candidateRegistry) 12:28:31,331 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - Processing candidates for : DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], new value: Set(member-4) 12:28:31,331 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - currently present candidates: [member-3] 12:28:31,331 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - difference: [member-3, member-4] 12:28:31,331 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - Removing candidate from entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] - member-3 12:28:31,331 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - Adding new candidate for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : member-4 12:28:31,331 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - Current state for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : [member-4] 12:28:31,332 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - Reassigning owners for [DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]] 12:28:31,332 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - Entity DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] new owner: member-4 12:28:31,332 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - Current state for entity: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] : [member-4] 12:28:31,332 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - Owner has changed for DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]] 12:28:31,371 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: member-3, newOwner: member-4 12:28:31,371 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: member-3, wasOwner: true, isOwner: false, hasOwner:true 12:28:31,371 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] EntityTypeListenerActor - member-3 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_LOST_NEW_OWNER [wasOwner=true, isOwner=false, hasOwner=true], inJeopardy=false} 12:28:31,371 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] EOS-listener-member-3 - member-3 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=LOCAL_OWNERSHIP_LOST_NEW_OWNER [wasOwner=true, isOwner=false, hasOwner=true], inJeopardy=false} 12:28:31,371 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] EOS-listener-member-3 - member-3 changes: 3 12:28:31,482 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] EntityTypeListenerActor - Entity-type: test-type current candidates: {DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]]=ORSet(member-4)} 12:28:31,482 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] SingleEntityListenerActor - Owner changed for: DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], prevOwner: member-3, newOwner: member-4 12:28:31,482 PM [ClusterSystem-akka.actor.default-dispatcher-5] [DEBUG] SingleEntityListenerActor - Owner changed for entity:DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], currentOwner: member-3, wasOwner: false, isOwner: false, hasOwner:true 12:28:31,482 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] LocalActorRef - Message [org.opendaylight.controller.eos.akka.owner.supervisor.command.CandidatesChanged] to Actor[akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor#-344315728] was unhandled. [2] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:31,482 PM [ClusterSystem-akka.actor.default-dispatcher-10] [DEBUG] EntityTypeListenerActor - member-1 : Entity-type: test-type listener, owner change: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=REMOTE_OWNERSHIP_CHANGED [wasOwner=false, isOwner=false, hasOwner=true], inJeopardy=false} 12:28:31,482 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] EOS-listener-member-1 - member-1 Received ownershipCHanged: EntityOwnerChanged{entity=DOMEntity [type=test-type, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[{(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=entity-1}]], change=REMOTE_OWNERSHIP_CHANGED [wasOwner=false, isOwner=false, hasOwner=true], inJeopardy=false} 12:28:31,483 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] EOS-listener-member-1 - member-1 changes: 3 12:28:41,652 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 12:28:41,653 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Marked address [akka://ClusterSystem@127.0.0.1:2550] as [Leaving] 12:28:41,654 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] LocalActorRef - Message [org.opendaylight.controller.eos.akka.owner.supervisor.command.MemberDownEvent] to Actor[akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor#-344315728] was unhandled. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:41,664 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterSingletonManager - Exited [akka://ClusterSystem@127.0.0.1:2550]. 12:28:41,665 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterSingletonManager - Oldest observed OldestChanged: [akka://ClusterSystem@127.0.0.1:2550 -> Some(akka://ClusterSystem@127.0.0.1:2551)] 12:28:41,665 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Oldest -> WasOldest] 12:28:41,668 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2550, roles=[dc-dc-primary, member-1]} 12:28:41,669 PM [ClusterSystem-akka.actor.default-dispatcher-11] [DEBUG] OwnerSupervisor - Received unreachable event from a foreign datacenter, Ignoring... Roles: [dc-dc-primary, member-1] 12:28:42,512 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2550] to [Exiting] 12:28:42,513 PM [ClusterSystem-akka.actor.default-dispatcher-10] [INFO] LocalActorRef - Message [org.opendaylight.controller.eos.akka.owner.supervisor.command.MemberDownEvent] to Actor[akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor#-344315728] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:28:42,513 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] SplitBrainResolver - This node is not the leader any more and not responsible for taking SBR decisions. 12:28:42,515 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] SplitBrainResolver - This node is now the leader responsible for taking SBR decisions among the reachable nodes (more leaders may exist). 12:28:42,516 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - Younger observed OldestChanged: [Some(akka://ClusterSystem@127.0.0.1:2550) -> myself] 12:28:42,516 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Younger -> BecomingOldest] 12:28:42,518 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - Singleton manager stopping singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:42,519 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [WasOldest -> HandingOver] 12:28:42,520 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - Hand-over in progress at [akka://ClusterSystem@127.0.0.1:2550] 12:28:42,534 PM [ClusterSystem-akka.actor.default-dispatcher-28] [INFO] ClusterSingletonManager - Singleton terminated, hand-over done [akka://ClusterSystem@127.0.0.1:2550 -> Some(akka://ClusterSystem@127.0.0.1:2551)] 12:28:42,534 PM [ClusterSystem-akka.actor.default-dispatcher-28] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [HandingOver -> End] 12:28:42,534 PM [ClusterSystem-akka.actor.default-dispatcher-28] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Exiting completed 12:28:42,534 PM [ClusterSystem-akka.actor.default-dispatcher-28] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Shutting down... 12:28:42,534 PM [ClusterSystem-akka.actor.default-dispatcher-28] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2550] dc [dc-primary] - Successfully shut down 12:28:42,534 PM [ClusterSystem-akka.actor.default-dispatcher-28] [INFO] ClusterSingletonManager - Self removed, stopping ClusterSingletonManager 12:28:42,535 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - Singleton manager starting singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:42,535 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [BecomingOldest -> Oldest] 12:28:42,536 PM [ClusterSystem-akka.actor.default-dispatcher-14] [DEBUG] IdleSupervisor - Idle supervisor started on Member(akka://ClusterSystem@127.0.0.1:2551, Up, dc-primary). 12:28:42,537 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Exiting confirmed [akka://ClusterSystem@127.0.0.1:2550] 12:28:42,540 PM [ClusterSystem-akka.actor.default-dispatcher-30] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 12:28:42,540 PM [ClusterSystem-akka.actor.default-dispatcher-30] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. 12:28:42,592 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - is the new leader among reachable nodes (more leaders may exist) 12:28:42,602 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Leader is removing confirmed Exiting node [akka://ClusterSystem@127.0.0.1:2550] 12:28:42,605 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2550, roles=[dc-dc-primary, member-1]} 12:28:42,605 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received unreachable event from a foreign datacenter, Ignoring... Roles: [dc-dc-primary, member-1] 12:28:42,616 PM [ClusterSystem-akka.actor.default-dispatcher-11] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2551], control stream] Upstream failed, cause: StreamTcpException: The connection has been aborted 12:28:42,622 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. 12:28:42,634 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 12:28:42,636 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Marked address [akka://ClusterSystem@127.0.0.1:2551] as [Leaving] 12:28:42,636 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] ClusterSingletonManager - Exited [akka://ClusterSystem@127.0.0.1:2551]. 12:28:42,636 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - Oldest observed OldestChanged: [akka://ClusterSystem@127.0.0.1:2551 -> None] 12:28:42,636 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Oldest -> WasOldest] 12:28:42,966 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2550, roles=[dc-dc-primary, member-1]} 12:28:42,966 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received unreachable event from a foreign datacenter, Ignoring... Roles: [dc-dc-primary, member-1] 12:28:42,967 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2551, roles=[dc-dc-primary, member-2]} 12:28:42,967 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received unreachable event from a foreign datacenter, Ignoring... Roles: [dc-dc-primary, member-2] 12:28:43,532 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonProxy - Singleton identified at [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:43,612 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2551] to [Exiting] 12:28:43,619 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Association - Association to [akka://ClusterSystem@127.0.0.1:2550] having UID [-3476622026299198726] has been stopped. All messages to this UID will be delivered to dead letters. Reason: ActorSystem terminated 12:28:43,621 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Association - Association to [akka://ClusterSystem@127.0.0.1:2550] having UID [-3476622026299198726] has been stopped. All messages to this UID will be delivered to dead letters. Reason: ActorSystem terminated 12:28:43,622 PM [ClusterSystem-akka.actor.default-dispatcher-25] [INFO] Association - Association to [akka://ClusterSystem@127.0.0.1:2550] having UID [-3476622026299198726] has been stopped. All messages to this UID will be delivered to dead letters. Reason: ActorSystem terminated 12:28:43,652 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - Singleton manager stopping singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:43,652 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [WasOldest -> Stopping] 12:28:43,653 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] ClusterSingletonManager - Singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] was terminated 12:28:43,654 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Exiting completed 12:28:43,657 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Shutting down... 12:28:43,657 PM [ClusterSystem-akka.actor.default-dispatcher-14] [WARN] Cluster - Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config 12:28:43,657 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2551] dc [dc-primary] - Successfully shut down 12:28:43,665 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 12:28:43,665 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. 12:28:43,665 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2551, roles=[dc-dc-primary, member-2]} 12:28:43,666 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received unreachable event from a foreign datacenter, Ignoring... Roles: [dc-dc-primary, member-2] 12:28:44,692 PM [ClusterSystem-akka.actor.default-dispatcher-25] [INFO] Association - Association to [akka://ClusterSystem@127.0.0.1:2551] having UID [-7909535992712766502] has been stopped. All messages to this UID will be delivered to dead letters. Reason: ActorSystem terminated 12:28:44,693 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Association - Association to [akka://ClusterSystem@127.0.0.1:2551] having UID [-7909535992712766502] has been stopped. All messages to this UID will be delivered to dead letters. Reason: ActorSystem terminated 12:28:44,695 PM [ClusterSystem-akka.actor.default-dispatcher-15] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. 12:28:44,703 PM [ClusterSystem-akka.actor.default-dispatcher-25] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 12:28:44,704 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Marked address [akka://ClusterSystem@127.0.0.1:2552] as [Leaving] 12:28:44,704 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2552, roles=[member-3, dc-dc-backup]} 12:28:44,705 PM [ClusterSystem-akka.actor.default-dispatcher-25] [INFO] ClusterSingletonManager - Exited [akka://ClusterSystem@127.0.0.1:2552]. 12:28:44,706 PM [ClusterSystem-akka.actor.default-dispatcher-25] [INFO] ClusterSingletonManager - Oldest observed OldestChanged: [akka://ClusterSystem@127.0.0.1:2552 -> Some(akka://ClusterSystem@127.0.0.1:2553)] 12:28:44,706 PM [ClusterSystem-akka.actor.default-dispatcher-25] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Oldest -> WasOldest] 12:28:44,773 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2552] to [Exiting] 12:28:44,773 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Leader is removing Exiting node [akka://ClusterSystem@127.0.0.1:2551] in DC [dc-primary] 12:28:44,774 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2551, roles=[dc-dc-primary, member-2]} 12:28:44,774 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received unreachable event from a foreign datacenter, Ignoring... Roles: [dc-dc-primary, member-2] 12:28:44,774 PM [ClusterSystem-akka.actor.default-dispatcher-25] [DEBUG] OwnerSupervisor - Received MemberDown : MemberDownEvent{address=akka://ClusterSystem@127.0.0.1:2552, roles=[member-3, dc-dc-backup]} 12:28:44,775 PM [ClusterSystem-akka.actor.default-dispatcher-25] [INFO] SplitBrainResolver - This node is not the leader any more and not responsible for taking SBR decisions. 12:28:44,779 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - Younger observed OldestChanged: [Some(akka://ClusterSystem@127.0.0.1:2552) -> myself] 12:28:44,779 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Younger -> BecomingOldest] 12:28:44,779 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] SplitBrainResolver - This node is now the leader responsible for taking SBR decisions among the reachable nodes (more leaders may exist). 12:28:44,787 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] ClusterSingletonManager - Singleton manager stopping singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:44,787 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [WasOldest -> HandingOver] 12:28:44,788 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] ClusterSingletonManager - Singleton terminated, hand-over done [akka://ClusterSystem@127.0.0.1:2552 -> Some(akka://ClusterSystem@127.0.0.1:2553)] 12:28:44,788 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [HandingOver -> End] 12:28:44,789 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Exiting completed 12:28:44,791 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Shutting down... 12:28:44,791 PM [ClusterSystem-akka.actor.default-dispatcher-11] [WARN] Cluster - Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config 12:28:44,791 PM [ClusterSystem-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2552] dc [dc-backup] - Successfully shut down 12:28:44,791 PM [ClusterSystem-akka.actor.default-dispatcher-25] [INFO] ClusterSingletonManager - Self removed, stopping ClusterSingletonManager 12:28:44,792 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] ClusterSingletonManager - Hand-over in progress at [akka://ClusterSystem@127.0.0.1:2552] 12:28:44,793 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] ClusterSingletonManager - Singleton manager starting singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:44,794 PM [ClusterSystem-akka.actor.default-dispatcher-12] [DEBUG] IdleSupervisor - Idle supervisor started on Member(akka://ClusterSystem@127.0.0.1:2553, Up, dc-backup). 12:28:44,795 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [BecomingOldest -> Oldest] 12:28:44,795 PM [ClusterSystem-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Exiting confirmed [akka://ClusterSystem@127.0.0.1:2552] 12:28:44,798 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 12:28:44,798 PM [ClusterSystem-akka.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. 12:28:44,820 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - is the new leader among reachable nodes (more leaders may exist) 12:28:44,821 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Leader is removing confirmed Exiting node [akka://ClusterSystem@127.0.0.1:2552] 12:28:45,789 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonProxy - Singleton identified at [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:45,815 PM [ClusterSystem-akka.actor.default-dispatcher-10] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2553], control stream] Upstream failed, cause: StreamTcpException: The connection has been aborted 12:28:45,815 PM [ClusterSystem-akka.actor.default-dispatcher-10] [WARN] Materializer - [outbound connection to [akka://ClusterSystem@127.0.0.1:2553], message stream] Upstream failed, cause: StreamTcpException: The connection has been aborted 12:28:45,819 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Association - Association to [akka://ClusterSystem@127.0.0.1:2552] having UID [-3169229466353648859] has been stopped. All messages to this UID will be delivered to dead letters. Reason: ActorSystem terminated 12:28:45,838 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] CoordinatedShutdown - Running CoordinatedShutdown with reason [ActorSystemTerminateReason] 12:28:45,839 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Marked address [akka://ClusterSystem@127.0.0.1:2553] as [Leaving] 12:28:45,840 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - Exited [akka://ClusterSystem@127.0.0.1:2553]. 12:28:45,841 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - Oldest observed OldestChanged: [akka://ClusterSystem@127.0.0.1:2553 -> None] 12:28:45,841 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [Oldest -> WasOldest] 12:28:45,841 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Leader is moving node [akka://ClusterSystem@127.0.0.1:2553] to [Exiting] 12:28:46,860 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - Singleton manager stopping singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] 12:28:46,860 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] ClusterSingletonManager - ClusterSingletonManager state change [WasOldest -> Stopping] 12:28:46,861 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] ClusterSingletonManager - Singleton actor [akka://ClusterSystem/system/singletonManagerOwnerSupervisor/OwnerSupervisor] was terminated 12:28:46,862 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Exiting completed 12:28:46,862 PM [ClusterSystem-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Shutting down... 12:28:46,863 PM [ClusterSystem-akka.actor.default-dispatcher-14] [WARN] Cluster - Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config 12:28:46,863 PM [ClusterSystem-akka.actor.default-dispatcher-14] [INFO] Cluster - Cluster Node [akka://ClusterSystem@127.0.0.1:2553] dc [dc-backup] - Successfully shut down 12:28:46,871 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 12:28:46,871 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. 12:28:46,874 PM [ClusterSystem-akka.actor.default-dispatcher-13] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.