01:17:49,917 AM [test-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started
01:17:49,930 AM [test-akka.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://test@127.0.0.1:2565] with UID [3645394431898910231]
01:17:49,930 AM [test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://test@127.0.0.1:2565] - Starting up, Akka version [2.6.21] ...
01:17:49,931 AM [test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://test@127.0.0.1:2565] - Registered cluster JMX MBean [akka:type=Cluster]
01:17:49,931 AM [test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://test@127.0.0.1:2565] - Started up successfully
01:17:49,941 AM [test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://test@127.0.0.1:2565] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:17:49,941 AM [test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://test@127.0.0.1:2565] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:17:50,76 AM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/$a#1917566301] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:50,84 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config1
01:17:50,116 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config1
01:17:50,117 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config1: Creating local shard: member-1-shard-default-config1
01:17:50,129 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:50,129 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config1
01:17:50,129 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config1: Initializing shard [default]
01:17:50,129 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-default-config1 is initialized
01:17:50,129 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config1: Received role changed for member-1-shard-default-config1 from null to Follower
01:17:50,130 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config1: onChangeShardServersVotingStatus: ChangeShardMembersVotingStatus [shardName=default, meberVotingStatusMap={member-2=true}]
01:17:50,131 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config1: findLocalShard : default
01:17:50,134 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config1: Sending ChangeServersVotingStatus message ChangeServersVotingStatus [serverVotingStatusMap={member-2-shard-default-config1=true}, serversVisited=[]] to local shard akka://test/user/member-1-shard-default-config1
01:17:50,135 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config1: Received ServerChangeReply{status=NO_LEADER} from local shard akka://test/user/member-1-shard-default-config1
01:17:50,135 AM [test-akka.actor.default-dispatcher-10] [WARN] ShardManager - shard-manager-config1: ChangeServersVotingStatus failed for shard default with status NO_LEADER
01:17:50,295 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/member-1-shard-default-config1#759671905]
01:17:50,309 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryWaitForShardLeader starting
01:17:50,312 AM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/$b#1053052505] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:50,312 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config2
01:17:50,313 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config2
01:17:50,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config2: Creating local shard: member-1-shard-default-config2
01:17:50,323 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:50,323 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config2
01:17:50,325 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config2: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:17:50,329 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config2: Scheduling 10000 ms timer to wait for shard ShardInformation [shardId=member-1-shard-default-config2, leaderAvailable=false, actorInitialized=false, followerSyncStatus=false, role=null, leaderId=null, activeMember=true]
01:17:50,473 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config2: Initializing shard [default]
01:17:50,473 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Shard member-1-shard-default-config2 is initialized
01:17:50,473 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Shard member-1-shard-default-config2 is initialized - notifying 1 OnShardInitialized callbacks
01:17:50,623 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config2: Received role changed for member-1-shard-default-config2 from Candidate to Leader
01:17:50,623 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-default-config2 is initialized - notifying 1 OnShardInitialized callbacks
01:17:50,774 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config2: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config2, leaderId=member-1-shard-default-config2, leaderPayloadVersion=13]
01:17:50,774 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-default-config2 is ready - notifying 1 OnShardInitialized callbacks
01:17:50,774 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config2: Found primary for default: LocalPrimaryShardFound [primaryPath=akka://test@127.0.0.1:2565/user/member-1-shard-default-config#-1623423359, localShardDataTree=org.opendaylight.yangtools.yang.data.tree.api.DataTree$MockitoMock$bs5PxSEb@4355bea6]
01:17:50,775 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config2: All Shards are ready - data store config2 is ready
01:17:50,975 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryWaitForShardLeader ending
01:17:51,76 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$b#1053052505]
01:17:51,87 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Stopping ShardManager shard-manager-config2
01:17:51,98 AM [test-akka.actor.default-dispatcher-10] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/$$a] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:51,98 AM [main] [INFO] ShardManager - Starting ShardManager shard-manager-config3
01:17:51,100 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config3
01:17:51,100 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config3: Creating local shard: member-1-shard-default-config3
01:17:51,100 AM [main] [INFO] ShardManager - shard-manager-config3: Received role changed for member-1-shard-default-config3 from Follower to Candidate
01:17:51,101 AM [main] [INFO] ShardManager - shard-manager-config3 Received follower initial sync status for member-1-shard-default-config3 status sync done true
01:17:51,202 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$a]
01:17:51,213 AM [main] [INFO] ShardManager - Stopping ShardManager shard-manager-config3
01:17:51,239 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started
01:17:51,252 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://cluster-test@127.0.0.1:2558] with UID [8651504974702040761]
01:17:51,252 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Starting up, Akka version [2.6.21] ...
01:17:51,260 AM [cluster-test-akka.actor.default-dispatcher-10] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:17:51,260 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Started up successfully
01:17:51,266 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:17:51,266 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:17:51,280 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - Starting ShardManager shard-manager-config4
01:17:51,281 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://cluster-test/user/shardmanager-config4] to Actor[akka://cluster-test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://cluster-test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:51,287 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Node [akka://cluster-test@127.0.0.1:2558] is JOINING itself (with roles [member-1, dc-default], version [0.0.0]) and forming new cluster
01:17:51,287 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started
01:17:51,287 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - is the new leader among reachable nodes (more leaders may exist)
01:17:51,297 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Leader is moving node [akka://cluster-test@127.0.0.1:2558] to [Up]
01:17:51,310 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://cluster-test@127.0.0.1:2559] with UID [1267635854586266739]
01:17:51,311 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Starting up, Akka version [2.6.21] ...
01:17:51,317 AM [cluster-test-akka.actor.default-dispatcher-5] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:17:51,317 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Started up successfully
01:17:51,325 AM [main] [ERROR] ShardManagerTest - Mock Shard Leader Actor : TestActor[akka://cluster-test/user/member-2-shard-default-config4]
01:17:51,333 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:17:51,333 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:17:51,339 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] ShardManager - Recovery complete : shard-manager-config4
01:17:51,339 AM [cluster-test-akka.actor.default-dispatcher-14] [DEBUG] ShardManager - shard-manager-config4: Creating local shard: member-1-shard-default-config4
01:17:51,340 AM [cluster-test-akka.actor.default-dispatcher-14] [DEBUG] ShardManager - shard-manager-config4: Creating local shard: member-1-shard-astronauts-config4
01:17:51,341 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] ShardManager - shard-manager-config4: Received MemberUp: memberName: MemberName{name=member-1}, address: akka://cluster-test@127.0.0.1:2558
01:17:51,341 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config4 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config4/member-1-shard-default-config4
01:17:51,341 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-astronauts-config4 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config4/member-1-shard-astronauts-config4
01:17:51,344 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://cluster-test/user/shardmanager-config4] to Actor[akka://cluster-test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://cluster-test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:51,349 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - Starting ShardManager shard-manager-config4
01:17:51,349 AM [main] [ERROR] ShardManagerTest - Forwarding actor : Actor[akka://cluster-test/user/shardmanager-config4/member-2-shard-default-config4#-1325512702]
01:17:51,356 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config4
01:17:51,356 AM [cluster-test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config4: Creating local shard: member-2-shard-default-config4
01:17:51,360 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:51,360 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - Creating Shard member-2-shard-default-config4
01:17:51,360 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config4: Initializing shard [default]
01:17:51,360 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardInformation - Shard member-2-shard-default-config4 is initialized
01:17:51,360 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config4: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-2-shard-default-config4, leaderId=member-2-shard-default-config4, leaderPayloadVersion=12]
01:17:51,360 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config4: Received role changed for member-2-shard-default-config4 from Candidate to Leader
01:17:51,360 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config4: All Shards are ready - data store config4 is ready
01:17:51,361 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:51,361 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config4
01:17:51,361 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config4 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config4/member-1-shard-default-config4
01:17:51,361 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-default-config4 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config4/member-1-shard-default-config4 to akka://cluster-test/user/member-1-shard-default-config
01:17:51,361 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config4: updated peer member-1-shard-default-config4 on member MemberName{name=member-1} with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config4/member-1-shard-default-config4 on shard member-1-shard-default-config4 whose actor address is Actor[akka://cluster-test/user/member-1-shard-default-config#-1976145309]
01:17:51,361 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - Creating Shard member-1-shard-astronauts-config4
01:17:51,361 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-astronauts-config4 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config4/member-1-shard-astronauts-config4
01:17:51,361 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-astronauts-config4 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config4/member-1-shard-astronauts-config4 to akka://cluster-test/user/member-1-shard-default-config
01:17:51,361 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config4: updated peer member-1-shard-astronauts-config4 on member MemberName{name=member-1} with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config4/member-1-shard-astronauts-config4 on shard member-1-shard-astronauts-config4 whose actor address is Actor[akka://cluster-test/user/member-1-shard-default-config#-1976145309]
01:17:51,361 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config4: Initializing shard [default]
01:17:51,361 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardInformation - Shard member-1-shard-default-config4 is initialized
01:17:51,361 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - shard-manager-config4: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config4, leaderId=member-2-shard-default-config4, leaderPayloadVersion=12]
01:17:51,362 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - shard-manager-config4: Received role changed for member-1-shard-default-config4 from Candidate to Follower
01:17:51,698 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Node [akka://cluster-test@127.0.0.1:2559] is JOINING, roles [member-2, dc-default], version [0.0.0]
01:17:51,756 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config4: Received MemberUp: memberName: MemberName{name=member-1}, address: akka://cluster-test@127.0.0.1:2558
01:17:51,756 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config4 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config4/member-1-shard-default-config4
01:17:51,756 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-default-config4 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config4/member-1-shard-default-config4 to akka://cluster-test/user/member-2-shard-default-config4
01:17:51,756 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config4: All Shards are ready - data store config4 is ready
01:17:51,756 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Welcome from [akka://cluster-test@127.0.0.1:2558]
01:17:52,278 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Leader is moving node [akka://cluster-test@127.0.0.1:2559] to [Up]
01:17:52,285 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config4: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2559
01:17:52,285 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config4 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config4/member-2-shard-default-config4
01:17:52,285 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config4 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config4/member-2-shard-default-config4 to akka://cluster-test/user/member-1-shard-default-config
01:17:52,285 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-astronauts-config4 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config4/member-2-shard-astronauts-config4
01:17:52,285 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-astronauts-config4 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config4/member-2-shard-astronauts-config4 to akka://cluster-test/user/member-1-shard-default-config
01:17:52,286 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config4: onRemoveShardReplica: RemoveShardReplica [shardName=default, memberName=MemberName{name=member-1}]
01:17:52,288 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config4: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:17:52,288 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config4: Found primary for default: RemotePrimaryShardFound [primaryPath=akka://cluster-test@127.0.0.1:2559/user/shardmanager-config4/member-2-shard-default-config4, primaryVersion=12]
01:17:52,289 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config4: Sending RemoveServer message to peer akka://cluster-test@127.0.0.1:2559/user/shardmanager-config4/member-2-shard-default-config4 for shard member-1-shard-default-config4
01:17:52,307 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config4: Received RemoveServerReply{status=OK, leaderHint=member-2-shard-default-config4} for shard default
01:17:52,307 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config4: Leader shard successfully removed the replica shard default
01:17:52,349 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] ShardManager - shard-manager-config4: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2559
01:17:52,349 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config4 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config4/member-2-shard-default-config4
01:17:52,349 AM [cluster-test-akka.actor.default-dispatcher-14] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config4 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config4/member-2-shard-default-config4 to akka://cluster-test/user/member-2-shard-default-config4
01:17:52,349 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] ShardManager - shard-manager-config4: All Shards are ready - data store config4 is ready
01:17:52,439 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config4
01:17:52,444 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:17:52,444 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:17:52,487 AM [cluster-test-akka.actor.default-dispatcher-14] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2559], message stream] Upstream failed, cause: StreamTcpException: The connection has been aborted
01:17:52,487 AM [cluster-test-akka.actor.default-dispatcher-14] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2559], control stream] Upstream failed, cause: StreamTcpException: The connection has been aborted
01:17:52,504 AM [cluster-test-akka.actor.default-dispatcher-14] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2558], control stream] Upstream failed, cause: StreamTcpException: The connection closed with error: Connection reset
01:17:52,504 AM [cluster-test-akka.actor.default-dispatcher-14] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2558], message stream] Upstream failed, cause: StreamTcpException: The connection closed with error: Connection reset
01:17:52,522 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - Stopping ShardManager shard-manager-config4
01:17:52,524 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:17:52,524 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
[WARN] [02/14/2024 01:17:53.543] [cluster-test-akka.actor.internal-dispatcher-9] [Cluster(akka://cluster-test)] Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:17:53,564 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config5
01:17:53,564 AM [test-akka.actor.default-dispatcher-13] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/$c#-271952747] to Actor[akka://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:53,566 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config5
01:17:53,566 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config5: Creating local shard: member-1-shard-default-config5
01:17:53,578 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:53,578 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config5
01:17:53,578 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config5: Initializing shard [default]
01:17:53,578 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-default-config5 is initialized
01:17:53,731 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$c#-271952747]
01:17:53,742 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config5
01:17:53,746 AM [test-akka.actor.default-dispatcher-10] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/$$b] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:53,746 AM [main] [INFO] ShardManager - Starting ShardManager shard-manager-config6
01:17:53,748 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config6
01:17:53,748 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config6: Creating local shard: member-1-shard-default-config6
01:17:53,748 AM [main] [INFO] ShardManager - shard-manager-config6: Received role changed for member-1-shard-default-config6 from null to Follower
01:17:53,758 AM [main] [INFO] ShardManager - shard-manager-config6: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://test
01:17:53,758 AM [main] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config6 with address akka://test/user/shardmanager-config6/member-2-shard-default-config6
01:17:53,759 AM [main] [INFO] ShardManager - shard-manager-config6: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config6, leaderId=member-2-shard-default-config6, leaderPayloadVersion=13]
01:17:53,759 AM [main] [INFO] ShardManager - shard-manager-config6: All Shards are ready - data store config6 is ready
01:17:53,861 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$b]
01:17:53,871 AM [main] [INFO] ShardManager - Stopping ShardManager shard-manager-config6
01:17:53,876 AM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/$d#449107209] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:53,877 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config7
01:17:53,879 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config7
01:17:53,887 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config7: onRemoveShardReplica: RemoveShardReplica [shardName=model-inventory, memberName=MemberName{name=member-1}]
01:17:53,887 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config7: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=model-inventory, waitUntilReady=true]
01:17:53,887 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config7: No shard found for model-inventory
01:17:53,889 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config7: Failed to find leader for shard model-inventory: received response: {}
org.opendaylight.controller.cluster.datastore.exceptions.PrimaryNotFoundException: No primary shard found for model-inventory.
	at org.opendaylight.controller.cluster.datastore.shardmanager.ShardManager.findPrimary(ShardManager.java:1051)
	at org.opendaylight.controller.cluster.datastore.shardmanager.ShardManager.handleCommand(ShardManager.java:207)
	at org.opendaylight.controller.cluster.datastore.shardmanager.ShardManagerTest$TestShardManager.handleCommand(ShardManagerTest.java:2198)
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
	at scala.PartialFunction.applyOrElse(PartialFunction.scala:214)
	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213)
	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269)
	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270)
	at akka.actor.Actor.aroundReceive(Actor.scala:537)
	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
	at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295)
	at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917)
	at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245)
	at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244)
	at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579)
	at akka.actor.ActorCell.invoke(ActorCell.scala:547)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165)
01:17:53,991 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$d#449107209]
01:17:54,1 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Stopping ShardManager shard-manager-config7
01:17:54,3 AM [main] [INFO] ShardManagerTest - testAddShardReplicaWithPreExistingLocalReplicaLeader starting
01:17:54,10 AM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/$e#1804018722] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:54,10 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config8
01:17:54,16 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config8
01:17:54,16 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config8: Creating local shard: member-1-shard-default-config8
01:17:54,21 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:54,21 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config8
01:17:54,21 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config8: Initializing shard [default]
01:17:54,21 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-default-config8 is initialized
01:17:54,21 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config8: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config8, leaderId=member-1-shard-default-config8, leaderPayloadVersion=13]
01:17:54,21 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config8: Received role changed for member-1-shard-default-config8 from Candidate to Leader
01:17:54,21 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config8: All Shards are ready - data store config8 is ready
01:17:54,22 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config8: onAddShardReplica: AddShardReplica[ShardName=default]
01:17:54,23 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config8: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:17:54,24 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config8: Found primary for default: LocalPrimaryShardFound [primaryPath=akka://test@127.0.0.1:2565/user/member-1-shard-default-config#-1594234451, localShardDataTree=org.opendaylight.yangtools.yang.data.tree.api.DataTree$MockitoMock$bs5PxSEb@55365b65]
01:17:54,24 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config8: Local shard default already exists
01:17:54,24 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config8: findLocalShard : default
01:17:54,24 AM [main] [INFO] ShardManagerTest - testAddShardReplicaWithPreExistingLocalReplicaLeader ending
01:17:54,126 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$e#1804018722]
01:17:54,136 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config8
01:17:54,138 AM [main] [INFO] ShardManagerTest - testOnReceiveFindLocalShardWaitForShardInitialized starting
01:17:54,140 AM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/$f#-1817143249] to Actor[akka://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:54,141 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Starting ShardManager shard-manager-config9
01:17:54,142 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config9
01:17:54,142 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config9: Creating local shard: member-1-shard-default-config9
01:17:54,153 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:54,153 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config9
01:17:54,153 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config9: findLocalShard : default
01:17:54,153 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config9: Scheduling 600 ms timer to wait for shard ShardInformation [shardId=member-1-shard-default-config9, leaderAvailable=false, actorInitialized=false, followerSyncStatus=false, role=null, leaderId=null, activeMember=true]
01:17:54,153 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config9: Initializing shard [default]
01:17:54,153 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-default-config9 is initialized
01:17:54,153 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-default-config9 is initialized - notifying 1 OnShardInitialized callbacks
01:17:54,157 AM [main] [INFO] ShardManagerTest - testOnReceiveFindLocalShardWaitForShardInitialized starting
01:17:54,258 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$f#-1817143249]
01:17:54,269 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config9
01:17:54,271 AM [main] [INFO] ShardManagerTest - testShardAvailabilityChangeOnMemberUnreachableAndLeadershipChange starting
01:17:54,279 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started
01:17:54,306 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://cluster-test@127.0.0.1:2558] with UID [6456294597258339691]
01:17:54,307 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Starting up, Akka version [2.6.21] ...
01:17:54,310 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Registered cluster JMX MBean [akka:type=Cluster]
01:17:54,310 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Started up successfully
01:17:54,321 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:17:54,321 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:17:54,327 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Node [akka://cluster-test@127.0.0.1:2558] is JOINING itself (with roles [member-1, dc-default], version [0.0.0]) and forming new cluster
01:17:54,327 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - is the new leader among reachable nodes (more leaders may exist)
01:17:54,327 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Leader is moving node [akka://cluster-test@127.0.0.1:2558] to [Up]
01:17:54,332 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://cluster-test/user/shardmanager-config10] to Actor[akka://cluster-test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://cluster-test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:54,335 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - Starting ShardManager shard-manager-config10
01:17:54,347 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Slf4jLogger - Slf4jLogger started
01:17:54,352 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - Recovery complete : shard-manager-config10
01:17:54,352 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config10: Creating local shard: member-1-shard-default-config10
01:17:54,352 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config10: Received MemberUp: memberName: MemberName{name=member-1}, address: akka://cluster-test@127.0.0.1:2558
01:17:54,352 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config10 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config10/member-1-shard-default-config10
01:17:54,367 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://cluster-test@127.0.0.1:2559] with UID [1740356201734478422]
01:17:54,367 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Starting up, Akka version [2.6.21] ...
01:17:54,372 AM [cluster-test-akka.actor.default-dispatcher-4] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:17:54,372 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Started up successfully
01:17:54,374 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:17:54,374 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:17:54,396 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://cluster-test/user/shardmanager-config10] to Actor[akka://cluster-test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://cluster-test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:54,400 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config10
01:17:54,402 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:54,402 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config10
01:17:54,402 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config10 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config10/member-1-shard-default-config10
01:17:54,402 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-default-config10 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config10/member-1-shard-default-config10 to akka://cluster-test/user/member-1-shard-default-config
01:17:54,402 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config10: updated peer member-1-shard-default-config10 on member MemberName{name=member-1} with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config10/member-1-shard-default-config10 on shard member-1-shard-default-config10 whose actor address is Actor[akka://cluster-test/user/member-1-shard-default-config#874084141]
01:17:54,402 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config10: Initializing shard [default]
01:17:54,402 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardInformation - Shard member-1-shard-default-config10 is initialized
01:17:54,402 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config10: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config10, leaderId=member-2-shard-default-config10, leaderPayloadVersion=13]
01:17:54,402 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config10: Received role changed for member-1-shard-default-config10 from Candidate to Follower
01:17:54,414 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config10
01:17:54,414 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config10: Creating local shard: member-2-shard-default-config10
01:17:54,415 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:54,415 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Creating Shard member-2-shard-default-config10
01:17:54,415 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config10: Initializing shard [default]
01:17:54,415 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-2-shard-default-config10 is initialized
01:17:54,415 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config10: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-2-shard-default-config10, leaderId=member-2-shard-default-config10, leaderPayloadVersion=13]
01:17:54,415 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config10: Received role changed for member-2-shard-default-config10 from Candidate to Leader
01:17:54,415 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config10: All Shards are ready - data store config10 is ready
01:17:54,464 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Node [akka://cluster-test@127.0.0.1:2559] is JOINING, roles [member-2, dc-default], version [0.0.0]
01:17:54,469 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Welcome from [akka://cluster-test@127.0.0.1:2558]
01:17:54,469 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config10: Received MemberUp: memberName: MemberName{name=member-1}, address: akka://cluster-test@127.0.0.1:2558
01:17:54,469 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config10 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config10/member-1-shard-default-config10
01:17:54,469 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-default-config10 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config10/member-1-shard-default-config10 to akka://cluster-test/user/member-2-shard-default-config
01:17:54,469 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config10: All Shards are ready - data store config10 is ready
01:17:55,328 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Leader is moving node [akka://cluster-test@127.0.0.1:2559] to [Up]
01:17:55,328 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config10: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2559
01:17:55,328 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config10 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config10/member-2-shard-default-config10
01:17:55,328 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config10 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config10/member-2-shard-default-config10 to akka://cluster-test/user/member-1-shard-default-config
01:17:55,328 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config10: All Shards are ready - data store config10 is ready
01:17:55,328 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config10: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:17:55,328 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config10: Found primary for default: RemotePrimaryShardFound [primaryPath=akka://cluster-test@127.0.0.1:2559/user/shardmanager-config10/member-2-shard-default-config10, primaryVersion=13]
01:17:55,329 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - Received UnreachableMember: memberName MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2558
01:17:55,330 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - Marking Leader member-2-shard-default-config10 as unavailable.
01:17:55,330 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config10: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:17:55,330 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config10: Scheduling 1200 ms timer to wait for shard ShardInformation [shardId=member-1-shard-default-config10, leaderAvailable=false, actorInitialized=true, followerSyncStatus=false, role=Follower, leaderId=member-2-shard-default-config10, activeMember=true]
01:17:55,398 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config10: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2559
01:17:55,398 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config10 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config10/member-2-shard-default-config10
01:17:55,398 AM [cluster-test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config10 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config10/member-2-shard-default-config10 to akka://cluster-test/user/member-2-shard-default-config
01:17:55,398 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config10: All Shards are ready - data store config10 is ready
01:17:56,547 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config10: Received ShardNotInitializedTimeout message for shard default
01:17:56,547 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config10: Returning NoShardLeaderException for shard default
01:17:56,547 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config10: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config10, leaderId=member-1-shard-default-config10, leaderPayloadVersion=13]
01:17:56,547 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config10: All Shards are ready - data store config10 is ready
01:17:56,547 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config10: Received role changed for member-1-shard-default-config10 from Follower to Leader
01:17:56,547 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - shard-manager-config10: All Shards are ready - data store config10 is ready
01:17:56,547 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config10: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:17:56,547 AM [cluster-test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config10: Found primary for default: LocalPrimaryShardFound [primaryPath=akka://cluster-test@127.0.0.1:2558/user/member-1-shard-default-config#874084141, localShardDataTree=org.opendaylight.yangtools.yang.data.tree.api.DataTree$MockitoMock$bs5PxSEb@364d3241]
01:17:56,548 AM [main] [INFO] ShardManagerTest - testShardAvailabilityChangeOnMemberUnreachableAndLeadershipChange ending
01:17:56,650 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] ShardManager - Stopping ShardManager shard-manager-config10
01:17:56,652 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:17:56,652 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:17:56,661 AM [cluster-test-akka.actor.default-dispatcher-14] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2559], message stream] Upstream failed, cause: StreamTcpException: The connection has been aborted
01:17:56,661 AM [cluster-test-akka.actor.default-dispatcher-14] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2559], control stream] Upstream failed, cause: StreamTcpException: The connection has been aborted
01:17:56,664 AM [cluster-test-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
01:17:56,684 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ShardManager - Stopping ShardManager shard-manager-config10
01:17:56,685 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:17:56,685 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:17:57,700 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[WARN] [02/14/2024 01:17:57.702] [cluster-test-akka.actor.internal-dispatcher-2] [Cluster(akka://cluster-test)] Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:17:57,719 AM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/shardmanager-config11] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:57,719 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Starting ShardManager shard-manager-config11
01:17:57,721 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config11
01:17:57,741 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:57,741 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config11: onAddShardReplica: AddShardReplica[ShardName=astronauts]
01:17:57,743 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config11: Sending AddServer message to peer akka://test@127.0.0.1:2565/system/testProbe-530#-1766397860 for shard member-1-shard-astronauts-config11
01:17:57,755 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config11: onRemoveShardReplica: RemoveShardReplica [shardName=astronauts, memberName=MemberName{name=member-2}]
01:17:57,756 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config11: A shard replica operation for astronauts is already in progress
01:17:57,859 AM [main] [INFO] ShardManagerTest - testPerShardDatastoreContext starting
01:17:57,872 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Starting ShardManager shard-manager-config12
01:17:57,877 AM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/$g#-1918358189] to Actor[akka://test/user/termination-monitor] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:57,878 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Recovery complete : shard-manager-config12
01:17:57,878 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config12: Creating local shard: member-1-shard-default-config12
01:17:57,879 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config12: Creating local shard: member-1-shard-topology-config12
01:17:57,882 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:57,882 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config12
01:17:57,882 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Creating Shard member-1-shard-topology-config12
01:17:57,883 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Sending new DatastoreContext to member-1-shard-default-config12
01:17:57,883 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Sending new DatastoreContext to member-1-shard-topology-config12
01:17:57,933 AM [main] [INFO] ShardManagerTest - testPerShardDatastoreContext ending
01:17:58,34 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/default1#220138961]
01:17:58,45 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/topology2#-1168295445]
01:17:58,45 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$g#-1918358189]
01:17:58,45 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Stopping ShardManager shard-manager-config12
01:17:58,47 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryForLocalLeaderShard starting
01:17:58,50 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config13
01:17:58,53 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config13
01:17:58,53 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config13: Creating local shard: member-1-shard-default-config13
01:17:58,62 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:58,62 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config13
01:17:58,62 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config13: Initializing shard [default]
01:17:58,62 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-default-config13 is initialized
01:17:58,62 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config13: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config13, leaderId=member-1-shard-default-config13, leaderPayloadVersion=13]
01:17:58,113 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config13: Received role changed for member-1-shard-default-config13 from Candidate to Leader
01:17:58,113 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config13: All Shards are ready - data store config13 is ready
01:17:58,113 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config13: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=false]
01:17:58,113 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config13: Found primary for default: LocalPrimaryShardFound [primaryPath=akka://test@127.0.0.1:2565/user/member-1-shard-default-config#222989426, localShardDataTree=org.opendaylight.yangtools.yang.data.tree.api.DataTree$MockitoMock$bs5PxSEb@67fd35a0]
01:17:58,113 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryForLocalLeaderShard ending
01:17:58,214 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$h#1383322450]
01:17:58,225 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config13
01:17:58,227 AM [main] [INFO] ShardManagerTest - testShardAvailabilityChangeOnMemberWithNameContainedInLeaderIdUnreachable starting
01:17:58,239 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Slf4jLogger - Slf4jLogger started
01:17:58,246 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://cluster-test@127.0.0.1:2562] with UID [201958194234544127]
01:17:58,246 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2562] - Starting up, Akka version [2.6.21] ...
01:17:58,248 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2562] - Registered cluster JMX MBean [akka:type=Cluster]
01:17:58,248 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2562] - Started up successfully
01:17:58,254 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2562] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:17:58,254 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2562] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:17:58,261 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2562] - Node [akka://cluster-test@127.0.0.1:2562] is JOINING itself (with roles [member-256, dc-default], version [0.0.0]) and forming new cluster
01:17:58,261 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2562] - is the new leader among reachable nodes (more leaders may exist)
01:17:58,261 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2562] - Leader is moving node [akka://cluster-test@127.0.0.1:2562] to [Up]
01:17:58,261 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://cluster-test/user/shardmanager-config14] to Actor[akka://cluster-test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://cluster-test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:58,268 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config14
01:17:58,287 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config14
01:17:58,287 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config14: Creating local shard: member-256-shard-default-config14
01:17:58,288 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config14: Received MemberUp: memberName: MemberName{name=member-256}, address: akka://cluster-test@127.0.0.1:2562
01:17:58,288 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardInformation - updatePeerAddress for peer member-256-shard-default-config14 with address akka://cluster-test@127.0.0.1:2562/user/shardmanager-config14/member-256-shard-default-config14
01:17:58,295 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started
01:17:58,317 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://cluster-test@127.0.0.1:2559] with UID [5561427695449372576]
01:17:58,317 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Starting up, Akka version [2.6.21] ...
01:17:58,320 AM [cluster-test-akka.actor.default-dispatcher-10] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:17:58,320 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Started up successfully
01:17:58,327 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:17:58,327 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:17:58,339 AM [cluster-test-akka.actor.default-dispatcher-4] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:58,339 AM [cluster-test-akka.actor.default-dispatcher-4] [DEBUG] ShardManager - Creating Shard member-256-shard-default-config14
01:17:58,339 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ShardInformation - updatePeerAddress for peer member-256-shard-default-config14 with address akka://cluster-test@127.0.0.1:2562/user/shardmanager-config14/member-256-shard-default-config14
01:17:58,339 AM [cluster-test-akka.actor.default-dispatcher-4] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-256-shard-default-config14 with address akka://cluster-test@127.0.0.1:2562/user/shardmanager-config14/member-256-shard-default-config14 to akka://cluster-test/user/member-256-shard-default-config
01:17:58,339 AM [cluster-test-akka.actor.default-dispatcher-4] [DEBUG] ShardManager - shard-manager-config14: updated peer member-256-shard-default-config14 on member MemberName{name=member-256} with address akka://cluster-test@127.0.0.1:2562/user/shardmanager-config14/member-256-shard-default-config14 on shard member-256-shard-default-config14 whose actor address is Actor[akka://cluster-test/user/member-256-shard-default-config#-111883276]
01:17:58,339 AM [cluster-test-akka.actor.default-dispatcher-4] [DEBUG] ShardManager - shard-manager-config14: Initializing shard [default]
01:17:58,339 AM [cluster-test-akka.actor.default-dispatcher-4] [DEBUG] ShardInformation - Shard member-256-shard-default-config14 is initialized
01:17:58,339 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ShardManager - shard-manager-config14: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-256-shard-default-config14, leaderId=member-256-shard-default-config14, leaderPayloadVersion=13]
01:17:58,339 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ShardManager - shard-manager-config14: Received role changed for member-256-shard-default-config14 from Candidate to Leader
01:17:58,339 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ShardManager - shard-manager-config14: All Shards are ready - data store config14 is ready
01:17:58,342 AM [cluster-test-akka.actor.default-dispatcher-22] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://cluster-test/user/shardmanager-config14] to Actor[akka://cluster-test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://cluster-test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:17:58,346 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config14
01:17:58,348 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config14
01:17:58,348 AM [cluster-test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config14: Creating local shard: member-2-shard-default-config14
01:17:58,348 AM [cluster-test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:17:58,348 AM [cluster-test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-2-shard-default-config14
01:17:58,348 AM [cluster-test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config14: Initializing shard [default]
01:17:58,348 AM [cluster-test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-2-shard-default-config14 is initialized
01:17:58,348 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config14: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-2-shard-default-config14, leaderId=member-256-shard-default-config14, leaderPayloadVersion=13]
01:17:58,348 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config14: Received role changed for member-2-shard-default-config14 from Candidate to Follower
01:17:58,372 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2562] - Node [akka://cluster-test@127.0.0.1:2559] is JOINING, roles [member-2, dc-default], version [0.0.0]
01:17:58,380 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Welcome from [akka://cluster-test@127.0.0.1:2562]
01:17:58,380 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config14: Received MemberUp: memberName: MemberName{name=member-256}, address: akka://cluster-test@127.0.0.1:2562
01:17:58,380 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardInformation - updatePeerAddress for peer member-256-shard-default-config14 with address akka://cluster-test@127.0.0.1:2562/user/shardmanager-config14/member-256-shard-default-config14
01:17:58,380 AM [cluster-test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-256-shard-default-config14 with address akka://cluster-test@127.0.0.1:2562/user/shardmanager-config14/member-256-shard-default-config14 to akka://cluster-test/user/member-2-shard-default-config
01:17:58,380 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config14: All Shards are ready - data store config14 is ready
01:17:59,264 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2562] - Leader is moving node [akka://cluster-test@127.0.0.1:2559] to [Up]
01:17:59,264 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardManager - shard-manager-config14: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2559
01:17:59,264 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config14 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config14/member-2-shard-default-config14
01:17:59,264 AM [cluster-test-akka.actor.default-dispatcher-11] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config14 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config14/member-2-shard-default-config14 to akka://cluster-test/user/member-256-shard-default-config
01:17:59,264 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardManager - shard-manager-config14: All Shards are ready - data store config14 is ready
01:17:59,265 AM [cluster-test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config14: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:17:59,265 AM [cluster-test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config14: Found primary for default: LocalPrimaryShardFound [primaryPath=akka://cluster-test@127.0.0.1:2562/user/member-256-shard-default-config#-111883276, localShardDataTree=org.opendaylight.yangtools.yang.data.tree.api.DataTree$MockitoMock$bs5PxSEb@3451074e]
01:17:59,265 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Received UnreachableMember: memberName MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2558
01:17:59,266 AM [cluster-test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config14: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:17:59,266 AM [cluster-test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config14: Found primary for default: LocalPrimaryShardFound [primaryPath=akka://cluster-test@127.0.0.1:2562/user/member-256-shard-default-config#-111883276, localShardDataTree=org.opendaylight.yangtools.yang.data.tree.api.DataTree$MockitoMock$bs5PxSEb@3451074e]
01:17:59,269 AM [main] [INFO] ShardManagerTest - testShardAvailabilityChangeOnMemberWithNameContainedInLeaderIdUnreachable ending
01:17:59,342 AM [cluster-test-akka.actor.default-dispatcher-15] [INFO] ShardManager - shard-manager-config14: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2559
01:17:59,342 AM [cluster-test-akka.actor.default-dispatcher-15] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config14 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config14/member-2-shard-default-config14
01:17:59,342 AM [cluster-test-akka.actor.default-dispatcher-15] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config14 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config14/member-2-shard-default-config14 to akka://cluster-test/user/member-2-shard-default-config
01:17:59,342 AM [cluster-test-akka.actor.default-dispatcher-15] [INFO] ShardManager - shard-manager-config14: All Shards are ready - data store config14 is ready
01:17:59,371 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ShardManager - Stopping ShardManager shard-manager-config14
01:17:59,372 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:17:59,372 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:17:59,382 AM [cluster-test-akka.actor.default-dispatcher-10] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2559], message stream] Upstream failed, cause: StreamTcpException: The connection has been aborted
01:17:59,382 AM [cluster-test-akka.actor.default-dispatcher-10] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2559], control stream] Upstream failed, cause: StreamTcpException: The connection has been aborted
01:17:59,386 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
01:17:59,422 AM [cluster-test-akka.actor.default-dispatcher-15] [INFO] ShardManager - Stopping ShardManager shard-manager-config14
01:17:59,423 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:17:59,423 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:18:00,353 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - is the new leader among reachable nodes (more leaders may exist)
01:18:00,445 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[WARN] [02/14/2024 01:18:00.447] [cluster-test-akka.actor.internal-dispatcher-3] [Cluster(akka://cluster-test)] Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:18:00,459 AM [main] [INFO] ShardManager - Starting ShardManager shard-manager-config15
01:18:00,460 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config15
01:18:00,460 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config15: Creating local shard: member-1-shard-default-config15
01:18:00,460 AM [main] [INFO] ShardManager - shard-manager-config15: Received role changed for member-1-shard-default-config15 from Follower to Leader
01:18:00,562 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$c]
01:18:00,572 AM [main] [INFO] ShardManager - Stopping ShardManager shard-manager-config15
01:18:00,576 AM [main] [INFO] ShardManager - Starting ShardManager shard-manager-config16
01:18:00,578 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config16
01:18:00,578 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config16: Creating local shard: member-1-shard-default-config16
01:18:00,677 AM [main] [INFO] ShardManager - shard-manager-config16: Received role changed for member-1-shard-default-config16 from Candidate to Leader
01:18:00,677 AM [main] [INFO] ShardManager - shard-manager-config16: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config16, leaderId=member-1-shard-default-config16, leaderPayloadVersion=13]
01:18:00,678 AM [main] [INFO] ShardManager - shard-manager-config16: All Shards are ready - data store config16 is ready
01:18:00,780 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$d]
01:18:00,791 AM [main] [INFO] ShardManager - Stopping ShardManager shard-manager-config16
01:18:00,792 AM [main] [INFO] ShardManagerTest - testOnCreateShardWithLocalMemberNotInShardConfig starting
01:18:00,795 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Starting ShardManager shard-manager-config17
01:18:00,796 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Recovery complete : shard-manager-config17
01:18:00,796 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:00,810 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config17: onCreateShard: CreateShard [moduleShardConfig=ModuleShardConfiguration [namespace=foo-ns, moduleName=foo-module, shardName=foo, shardMemberNames=[MemberName{name=member-5}, MemberName{name=member-6}], shardStrategyName=null], shardPropsCreator=org.opendaylight.controller.cluster.datastore.Shard$Builder@20009aa5]
01:18:00,812 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config17 doCreateShard: shardId: member-1-shard-foo-config17, memberNames: [MemberName{name=member-5}, MemberName{name=member-6}], peerAddresses: {}, isActiveMember: false
01:18:00,824 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config17: findLocalShard : foo
01:18:00,824 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config17: Scheduling 60000 ms timer to wait for shard ShardInformation [shardId=member-1-shard-foo-config17, leaderAvailable=false, actorInitialized=false, followerSyncStatus=false, role=null, leaderId=null, activeMember=false]
01:18:00,839 AM [test-shard-dispatcher-16] [INFO] Shard - Shard created : member-1-shard-foo-config17, persistent : true
01:18:00,851 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@127.0.0.1:2565/user/$i/member-1-shard-foo-config17/member-1-shard-foo-config17-notifier#1035723861 created and ready for shard:member-1-shard-foo-config17
01:18:00,857 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$i/member-1-shard-foo-config17/shard-member-1:snapshot-read#-1805196284]
01:18:00,861 AM [test-shard-dispatcher-16] [INFO] Shard - Starting recovery for member-1-shard-foo-config17 with journal batch size 1
01:18:00,873 AM [test-shard-dispatcher-16] [DEBUG] Shard - member-1-shard-foo-config17: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters]
01:18:00,875 AM [test-shard-dispatcher-16] [INFO] Shard - member-1-shard-foo-config17: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:18:00,875 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config17: Initializing shard [foo]
01:18:00,875 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-foo-config17 is initialized
01:18:00,875 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-foo-config17 is initialized - notifying 1 OnShardInitialized callbacks
01:18:00,875 AM [main] [INFO] ShardManagerTest - testOnCreateShardWithLocalMemberNotInShardConfig ending
01:18:00,881 AM [test-shard-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-foo-config17: onLeadershipChange, isLeader: false, hasLeader : false
01:18:00,881 AM [test-shard-dispatcher-16] [DEBUG] Shard - member-1-shard-foo-config17: onStateChanged: Closing all transaction chains because shard member-1-shard-foo-config17 is no longer the leader
01:18:00,882 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-foo-config17 , received role change from null to Follower
01:18:00,885 AM [test-shard-dispatcher-16] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
01:18:00,886 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-foo-config17 , registered listener akka://test/user/$i
01:18:00,887 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config17: Received role changed for member-1-shard-foo-config17 from null to Follower
01:18:00,977 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$i#-937920352]
01:18:00,988 AM [test-shard-dispatcher-16] [INFO] Shard - Stopping Shard member-1-shard-foo-config17
01:18:00,988 AM [test-shard-dispatcher-16] [DEBUG] MessageAssembler - member-1-shard-foo-config17 (Follower): Closing
01:18:00,989 AM [test-shard-dispatcher-16] [DEBUG] Shard - member-1-shard-foo-config17: Aborting 0 pending queued transactions
01:18:00,989 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config17
01:18:00,991 AM [main] [INFO] ShardManagerTest - testServerRemovedShardActorNotRunning starting
01:18:00,994 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config18
01:18:00,995 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config18
01:18:00,995 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config18: Creating local shard: member-1-shard-default-config18
01:18:00,995 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config18: Creating local shard: member-1-shard-people-config18
01:18:01,104 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config18: findLocalShard : people
01:18:01,104 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config18: Returning NotInitializedException for shard people
01:18:01,104 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config18: findLocalShard : default
01:18:01,104 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config18: Returning NotInitializedException for shard default
01:18:01,106 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config18 : Local Shard replica for shard default has been removed
01:18:01,106 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config18: persisting the shard list [people]
01:18:01,110 AM [main] [INFO] ShardManagerTest - testServerRemovedShardActorNotRunning ending
01:18:01,114 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config18 saved ShardManager snapshot successfully. Deleting the prev snapshot if available
01:18:01,121 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config18: Successfully deleted prior snapshots
01:18:01,212 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$e]
01:18:01,223 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config18
01:18:01,226 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config19
01:18:01,228 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config19
01:18:01,228 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config19: Creating local shard: member-1-shard-default-config19
01:18:01,237 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:01,237 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config19
01:18:01,238 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config19: Initializing shard [default]
01:18:01,238 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-default-config19 is initialized
01:18:01,238 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config19: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=false]
01:18:01,238 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config19: Returning NoShardLeaderException for shard default
01:18:01,339 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$j#-1087794596]
01:18:01,350 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Stopping ShardManager shard-manager-config19
01:18:01,351 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryForFollowerShardWithNoInitialLeaderId starting
01:18:01,353 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config20
01:18:01,357 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Recovery complete : shard-manager-config20
01:18:01,357 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config20: Creating local shard: member-1-shard-default-config20
01:18:01,364 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:01,364 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config20
01:18:01,364 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config20: Initializing shard [default]
01:18:01,364 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-default-config20 is initialized
01:18:01,364 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config20: Received role changed for member-1-shard-default-config20 from Candidate to Follower
01:18:01,364 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config20: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=false]
01:18:01,364 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config20: Returning NoShardLeaderException for shard default
01:18:01,365 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config20: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config20, leaderId=member-1-shard-default-config20, leaderPayloadVersion=13]
01:18:01,365 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config20: All Shards are ready - data store config20 is ready
01:18:01,365 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config20: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=false]
01:18:01,365 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config20: Found primary for default: LocalPrimaryShardFound [primaryPath=akka://test@127.0.0.1:2565/user/member-1-shard-default-config#259360294, localShardDataTree=org.opendaylight.yangtools.yang.data.tree.api.DataTree$MockitoMock$bs5PxSEb@cd9eb32]
01:18:01,365 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryForFollowerShardWithNoInitialLeaderId starting
01:18:01,466 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$k#1121711384]
01:18:01,477 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Stopping ShardManager shard-manager-config20
01:18:01,481 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config21
01:18:01,482 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config21
01:18:01,505 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:01,506 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config21: onAddShardReplica: AddShardReplica[ShardName=astronauts]
01:18:01,506 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config21: Sending AddServer message to peer akka://test@127.0.0.1:2565/system/testProbe-548#-1357431753 for shard member-1-shard-astronauts-config21
01:18:01,517 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config21: onAddShardReplica: AddShardReplica[ShardName=astronauts]
01:18:01,518 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config21: A shard replica operation for astronauts is already in progress
01:18:01,620 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryWaitForReadyWithCandidateShard starting
01:18:01,623 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config22
01:18:01,624 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config22
01:18:01,624 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config22: Creating local shard: member-1-shard-default-config22
01:18:01,633 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:01,633 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config22
01:18:01,634 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config22: Initializing shard [default]
01:18:01,634 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-default-config22 is initialized
01:18:01,634 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config22: Received role changed for member-1-shard-default-config22 from null to Candidate
01:18:01,634 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config22: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:18:01,634 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config22: Scheduling 1200 ms timer to wait for shard ShardInformation [shardId=member-1-shard-default-config22, leaderAvailable=false, actorInitialized=true, followerSyncStatus=false, role=Candidate, leaderId=null, activeMember=true]
01:18:02,850 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config22: Received ShardNotInitializedTimeout message for shard default
01:18:02,850 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config22: Returning NoShardLeaderException for shard default
01:18:02,851 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryWaitForReadyWithCandidateShard ending
01:18:02,953 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$l#-708524414]
01:18:02,964 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Stopping ShardManager shard-manager-config22
01:18:02,965 AM [main] [INFO] ShardManagerTest - testAddShardReplicaWithAddServerReplyFailure starting
01:18:02,969 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config23
01:18:02,970 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config23
01:18:03,89 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:03,99 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config23: onAddShardReplica: AddShardReplica[ShardName=astronauts]
01:18:03,100 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config23: Sending AddServer message to peer akka://test@127.0.0.1:2565/system/testProbe-553#-940548614 for shard member-1-shard-astronauts-config23
01:18:03,101 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config23: Received AddServerReply{status=TIMEOUT} for shard astronauts from leader akka://test@127.0.0.1:2565/system/testProbe-553#-940548614
01:18:03,102 AM [test-akka.actor.default-dispatcher-13] [WARN] ShardManager - shard-manager-config23: Leader failed to add shard replica astronauts with status TIMEOUT
01:18:03,102 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config23: findLocalShard : astronauts
01:18:03,102 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config23: Local shard astronauts not found - shards present: []
01:18:03,103 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config23: onAddShardReplica: AddShardReplica[ShardName=astronauts]
01:18:03,104 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config23: Sending AddServer message to peer akka://test@127.0.0.1:2565/system/testProbe-553#-940548614 for shard member-1-shard-astronauts-config23
01:18:03,105 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config23: Received AddServerReply{status=NO_LEADER} for shard astronauts from leader akka://test@127.0.0.1:2565/system/testProbe-553#-940548614
01:18:03,105 AM [test-akka.actor.default-dispatcher-10] [WARN] ShardManager - shard-manager-config23: Leader failed to add shard replica astronauts with status NO_LEADER
01:18:03,105 AM [main] [INFO] ShardManagerTest - testAddShardReplicaWithAddServerReplyFailure ending
01:18:03,207 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/member-1-shard-astronauts-config#683458668]
01:18:03,217 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/shardmanager-config23]
01:18:03,218 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config23
01:18:03,222 AM [main] [INFO] ShardManager - Starting ShardManager shard-manager-config24
01:18:03,223 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config24
01:18:03,223 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config24: Creating local shard: member-1-shard-default-config24
01:18:03,223 AM [main] [INFO] ShardManager - shard-manager-config24: Received role changed for member-1-shard-default-config24 from Candidate to Follower
01:18:03,223 AM [main] [INFO] ShardManager - shard-manager-config24 Received follower initial sync status for member-1-shard-default-config24 status sync done true
01:18:03,223 AM [main] [INFO] ShardManager - shard-manager-config24 Received follower initial sync status for member-1-shard-default-config24 status sync done false
01:18:03,325 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$f]
01:18:03,336 AM [main] [INFO] ShardManager - Stopping ShardManager shard-manager-config24
01:18:03,340 AM [main] [INFO] ShardManager - Starting ShardManager shard-manager-config25
01:18:03,342 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config25
01:18:03,342 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config25: Creating local shard: member-1-shard-default-config25
01:18:03,342 AM [main] [INFO] ShardManager - shard-manager-config25: Received role changed for unknown from Candidate to Leader
01:18:03,444 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$g]
01:18:03,454 AM [main] [INFO] ShardManager - Stopping ShardManager shard-manager-config25
01:18:03,456 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryWaitForReadyWithUninitializedShard starting
01:18:03,458 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Starting ShardManager shard-manager-config26
01:18:03,461 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config26
01:18:03,461 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config26: Creating local shard: member-1-shard-default-config26
01:18:03,468 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:03,468 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config26
01:18:03,469 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config26: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:18:03,469 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config26: Scheduling 600 ms timer to wait for shard ShardInformation [shardId=member-1-shard-default-config26, leaderAvailable=false, actorInitialized=false, followerSyncStatus=false, role=null, leaderId=null, activeMember=true]
01:18:04,81 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config26: Received ShardNotInitializedTimeout message for shard default
01:18:04,81 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config26: Returning NotInitializedException for shard default
01:18:04,82 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config26: Initializing shard [default]
01:18:04,82 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-default-config26 is initialized
01:18:04,282 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryWaitForReadyWithUninitializedShard ending
01:18:04,383 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$m#234909676]
01:18:04,394 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config26
01:18:04,398 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config27
01:18:04,399 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config27
01:18:04,399 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config27: Creating local shard: member-1-shard-default-config27
01:18:04,409 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:04,409 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config27
01:18:04,409 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config27: Initializing shard [default]
01:18:04,409 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Shard member-1-shard-default-config27 is initialized
01:18:04,409 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config27: findLocalShard : default
01:18:04,511 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$n#538195224]
01:18:04,521 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config27
01:18:04,523 AM [main] [INFO] ShardManagerTest - testRegisterForShardLeaderChanges starting
01:18:04,524 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config28
01:18:04,527 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config28
01:18:04,527 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config28: Creating local shard: member-1-shard-default-config28
01:18:04,535 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:04,535 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config28
01:18:04,535 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config28: Initializing shard [default]
01:18:04,535 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardInformation - Shard member-1-shard-default-config28 is initialized
01:18:04,535 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config28: onRegisterForShardAvailabilityChanges: org.opendaylight.controller.cluster.datastore.shardmanager.RegisterForShardAvailabilityChanges@3bed2168
01:18:04,545 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config28: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config28, leaderId=member-1-shard-default-config28, leaderPayloadVersion=13]
01:18:04,563 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config28: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config28, leaderId=member-1-shard-default-config28, leaderPayloadVersion=13]
01:18:05,63 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config28: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config28, leaderId=null, leaderPayloadVersion=13]
01:18:05,74 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config28: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config28, leaderId=member-2-shard-default-config28, leaderPayloadVersion=13]
01:18:05,85 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config28: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config28, leaderId=member-1-shard-default-config28, leaderPayloadVersion=13]
01:18:05,585 AM [main] [INFO] ShardManagerTest - testRegisterForShardLeaderChanges ending
01:18:05,687 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$o#-1620938822]
01:18:05,697 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config28
01:18:05,702 AM [main] [INFO] ShardManager - Starting ShardManager shard-manager-config29
01:18:05,703 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config29
01:18:05,703 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config29: Creating local shard: member-1-shard-default-config29
01:18:05,805 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$h]
01:18:05,816 AM [main] [INFO] ShardManager - Stopping ShardManager shard-manager-config29
01:18:05,820 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Starting ShardManager shard-manager-config30
01:18:05,821 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Recovery complete : shard-manager-config30
01:18:05,821 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config30: Creating local shard: member-1-shard-default-config30
01:18:05,831 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:05,831 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config30
01:18:05,831 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config30: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=non-existent, waitUntilReady=false]
01:18:05,831 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config30: No shard found for non-existent
01:18:05,932 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$p#112835862]
01:18:05,943 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config30
01:18:05,947 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Starting ShardManager shard-manager-config31
01:18:05,948 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config31
01:18:05,957 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config31: onAddShardReplica: AddShardReplica[ShardName=model-inventory]
01:18:05,957 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config31: No module configuration exists for shard model-inventory
01:18:06,58 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$q#627446312]
01:18:06,69 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Stopping ShardManager shard-manager-config31
01:18:06,70 AM [main] [INFO] ShardManagerTest - testAddShardReplicaWithPreExistingReplicaInRemoteShardLeader starting
01:18:06,72 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Starting ShardManager shard-manager-config32
01:18:06,74 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Recovery complete : shard-manager-config32
01:18:06,74 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: Creating local shard: member-1-shard-default-config32
01:18:06,183 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:06,183 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config32
01:18:06,183 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config32: Initializing shard [default]
01:18:06,183 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-default-config32 is initialized
01:18:06,183 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config32: Received MemberUp: memberName: MemberName{name=leader-member}, address: akka://test
01:18:06,183 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardInformation - updatePeerAddress for peer leader-member-shard-default-config32 with address akka://test/user/shardmanager-config32/leader-member-shard-default-config32
01:18:06,183 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer leader-member-shard-default-config32 with address akka://test/user/shardmanager-config32/leader-member-shard-default-config32 to akka://test/user/member-1-shard-default-config
01:18:06,183 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config32: Received role changed for member-1-shard-default-config32 from Candidate to Follower
01:18:06,183 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config32: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config32, leaderId=leader-member-shard-default-config32, leaderPayloadVersion=13]
01:18:06,183 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config32: All Shards are ready - data store config32 is ready
01:18:06,183 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config32: onAddShardReplica: AddShardReplica[ShardName=default]
01:18:06,184 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config32: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:18:06,184 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config32: Found primary for default: RemotePrimaryShardFound [primaryPath=akka://test/user/shardmanager-config32/leader-member-shard-default-config32, primaryVersion=13]
01:18:06,184 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config32: Sending AddServer message to peer akka://test/user/shardmanager-config32/leader-member-shard-default-config32 for shard member-1-shard-default-config32
01:18:06,184 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: Received AddServerReply{status=ALREADY_EXISTS} for shard default from leader akka://test/user/shardmanager-config32/leader-member-shard-default-config32
01:18:06,184 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: Local shard default already exists
01:18:06,234 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: findLocalShard : default
01:18:06,234 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: onAddShardReplica: AddShardReplica[ShardName=default]
01:18:06,234 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:18:06,235 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: Found primary for default: RemotePrimaryShardFound [primaryPath=akka://test/user/shardmanager-config32/leader-member-shard-default-config32, primaryVersion=13]
01:18:06,235 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: Sending AddServer message to peer akka://test/user/shardmanager-config32/leader-member-shard-default-config32 for shard member-1-shard-default-config32
01:18:06,235 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: Received AddServerReply{status=ALREADY_EXISTS} for shard default from leader akka://test/user/shardmanager-config32/leader-member-shard-default-config32
01:18:06,235 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: Local shard default already exists
01:18:06,236 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardInformation - Sending new DatastoreContext to member-1-shard-default-config32
01:18:06,236 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: onAddShardReplica: AddShardReplica[ShardName=default]
01:18:06,236 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:18:06,237 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: Found primary for default: RemotePrimaryShardFound [primaryPath=akka://test/user/shardmanager-config32/leader-member-shard-default-config32, primaryVersion=13]
01:18:06,237 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config32: Sending AddServer message to peer akka://test/user/shardmanager-config32/leader-member-shard-default-config32 for shard member-1-shard-default-config32
01:18:06,350 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: AddServer request to akka://test/user/shardmanager-config32/leader-member-shard-default-config32 for default failed
akka.pattern.AskTimeoutException: Ask timed out on [ActorSelection[Anchor(akka://test/), Path(/user/shardmanager-config32/leader-member-shard-default-config32)]] after [100 ms]. Message of type [org.opendaylight.controller.cluster.raft.messages.AddServer]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply.
01:18:06,351 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config32: findLocalShard : default
01:18:06,351 AM [main] [INFO] ShardManagerTest - testAddShardReplicaWithPreExistingReplicaInRemoteShardLeader ending
01:18:06,452 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/shardmanager-config32]
01:18:06,463 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Stopping ShardManager shard-manager-config32
01:18:06,465 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryForRemoteShard starting
01:18:06,472 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started
01:18:06,480 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://cluster-test@127.0.0.1:2558] with UID [-3849465479561373081]
01:18:06,480 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Starting up, Akka version [2.6.21] ...
01:18:06,482 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Registered cluster JMX MBean [akka:type=Cluster]
01:18:06,482 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Started up successfully
01:18:06,482 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:18:06,482 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:18:06,492 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Node [akka://cluster-test@127.0.0.1:2558] is JOINING itself (with roles [member-1, dc-default], version [0.0.0]) and forming new cluster
01:18:06,492 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - is the new leader among reachable nodes (more leaders may exist)
01:18:06,492 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Leader is moving node [akka://cluster-test@127.0.0.1:2558] to [Up]
01:18:06,494 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://cluster-test/user/shardmanager-config33] to Actor[akka://cluster-test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://cluster-test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:18:06,494 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ShardManager - Starting ShardManager shard-manager-config33
01:18:06,500 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Recovery complete : shard-manager-config33
01:18:06,501 AM [cluster-test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config33: Creating local shard: member-1-shard-default-config33
01:18:06,501 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardManager - shard-manager-config33: Received MemberUp: memberName: MemberName{name=member-1}, address: akka://cluster-test@127.0.0.1:2558
01:18:06,501 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config33 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config33/member-1-shard-default-config33
01:18:06,521 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started
01:18:06,534 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://cluster-test@127.0.0.1:2559] with UID [3020855794245350697]
01:18:06,534 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Starting up, Akka version [2.6.21] ...
01:18:06,536 AM [cluster-test-akka.actor.default-dispatcher-6] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:18:06,536 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Started up successfully
01:18:06,538 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:18:06,538 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:18:06,559 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - Starting ShardManager shard-manager-config33
01:18:06,559 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://cluster-test/user/shardmanager-config33] to Actor[akka://cluster-test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://cluster-test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:18:06,566 AM [cluster-test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:06,566 AM [cluster-test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config33
01:18:06,566 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config33 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config33/member-1-shard-default-config33
01:18:06,566 AM [cluster-test-akka.actor.default-dispatcher-11] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-default-config33 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config33/member-1-shard-default-config33 to akka://test/user/member-1-shard-default-config
01:18:06,566 AM [cluster-test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config33: updated peer member-1-shard-default-config33 on member MemberName{name=member-1} with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config33/member-1-shard-default-config33 on shard member-1-shard-default-config33 whose actor address is Actor[akka://test/user/member-1-shard-default-config#2089784661]
01:18:06,582 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config33
01:18:06,582 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config33: Creating local shard: member-2-shard-default-config33
01:18:06,583 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config33: Creating local shard: member-2-shard-astronauts-config33
01:18:06,583 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:06,583 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Creating Shard member-2-shard-default-config33
01:18:06,583 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Creating Shard member-2-shard-astronauts-config33
01:18:06,583 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config33: Initializing shard [astronauts]
01:18:06,583 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-2-shard-astronauts-config33 is initialized
01:18:06,583 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config33: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-2-shard-astronauts-config33, leaderId=member-2-shard-astronauts-config33, leaderPayloadVersion=12]
01:18:06,583 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config33: Received role changed for member-2-shard-astronauts-config33 from Candidate to Leader
01:18:06,653 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Node [akka://cluster-test@127.0.0.1:2559] is JOINING, roles [member-2, dc-default], version [0.0.0]
01:18:06,659 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardManager - shard-manager-config33: Received MemberUp: memberName: MemberName{name=member-1}, address: akka://cluster-test@127.0.0.1:2558
01:18:06,659 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Welcome from [akka://cluster-test@127.0.0.1:2558]
01:18:06,659 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config33 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config33/member-1-shard-default-config33
01:18:06,659 AM [cluster-test-akka.actor.default-dispatcher-11] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-default-config33 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config33/member-1-shard-default-config33 to akka://cluster-test/user/member-2-shard-astronauts-config
01:18:06,659 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-astronauts-config33 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config33/member-1-shard-astronauts-config33
01:18:06,659 AM [cluster-test-akka.actor.default-dispatcher-11] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-astronauts-config33 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config33/member-1-shard-astronauts-config33 to akka://cluster-test/user/member-2-shard-astronauts-config
01:18:07,501 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Leader is moving node [akka://cluster-test@127.0.0.1:2559] to [Up]
01:18:07,501 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config33: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2559
01:18:07,501 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config33 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config33/member-2-shard-default-config33
01:18:07,501 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config33 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config33/member-2-shard-default-config33 to akka://test/user/member-1-shard-default-config
01:18:07,502 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config33: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=astronauts, waitUntilReady=false]
01:18:07,503 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config33: findPrimary for astronauts forwarding to remote ShardManager akka://cluster-test@127.0.0.1:2559/user/shardmanager-config33, visitedAddresses: [akka://cluster-test@127.0.0.1:2558/user/shardmanager-config33]
01:18:07,513 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config33: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.RemoteFindPrimary [shardName=astronauts, waitUntilReady=false]
01:18:07,513 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config33: Found primary for astronauts: RemotePrimaryShardFound [primaryPath=akka://cluster-test@127.0.0.1:2559/user/member-2-shard-astronauts-config#121606164, primaryVersion=12]
01:18:07,516 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryForRemoteShard ending
01:18:07,564 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config33: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2559
01:18:07,564 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config33 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config33/member-2-shard-default-config33
01:18:07,564 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config33 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config33/member-2-shard-default-config33 to akka://cluster-test/user/member-2-shard-astronauts-config
01:18:07,564 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-astronauts-config33 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config33/member-2-shard-astronauts-config33
01:18:07,564 AM [cluster-test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-astronauts-config33 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config33/member-2-shard-astronauts-config33 to akka://cluster-test/user/member-2-shard-astronauts-config
01:18:07,618 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config33
01:18:07,618 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:18:07,619 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:18:07,630 AM [cluster-test-akka.actor.default-dispatcher-11] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2559], control stream] Upstream failed, cause: StreamTcpException: The connection has been aborted
01:18:07,630 AM [cluster-test-akka.actor.default-dispatcher-11] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2559], message stream] Upstream failed, cause: StreamTcpException: The connection has been aborted
01:18:07,631 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
01:18:07,661 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Stopping ShardManager shard-manager-config33
01:18:07,661 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:18:07,661 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:18:08,678 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[WARN] [02/14/2024 01:18:08.681] [cluster-test-akka.actor.internal-dispatcher-4] [Cluster(akka://cluster-test)] Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:18:08,694 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config34
01:18:08,701 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config34
01:18:08,701 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config34: Creating local shard: member-1-shard-default-config34
01:18:08,704 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config34: findLocalShard : default
01:18:08,704 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config34: Returning NotInitializedException for shard default
01:18:08,805 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$r#-511809179]
01:18:08,816 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config34
01:18:08,820 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config35
01:18:08,821 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config35
01:18:08,821 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config35: Creating local shard: member-1-shard-default-config35
01:18:08,829 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:08,829 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config35
01:18:08,829 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config35: Initializing shard [default]
01:18:08,829 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-default-config35 is initialized
01:18:08,829 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config35: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config35, leaderId=member-1-shard-default-config35, leaderPayloadVersion=13]
01:18:08,829 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config35: Received role changed for member-1-shard-default-config35 from Candidate to Leader
01:18:08,829 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config35: All Shards are ready - data store config35 is ready
01:18:08,829 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config35: onChangeShardServersVotingStatus: ChangeShardMembersVotingStatus [shardName=default, meberVotingStatusMap={member-2=true}]
01:18:08,830 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config35: findLocalShard : default
01:18:08,830 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config35: Sending ChangeServersVotingStatus message ChangeServersVotingStatus [serverVotingStatusMap={member-2-shard-default-config35=true}, serversVisited=[]] to local shard akka://test/user/member-1-shard-default-config35
01:18:08,830 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config35: Received ServerChangeReply{status=OK} from local shard akka://test/user/member-1-shard-default-config35
01:18:08,830 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config35: ChangeServersVotingStatus succeeded for shard default
01:18:08,981 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/member-1-shard-default-config35#-2029525731]
01:18:08,993 AM [main] [INFO] ShardManagerTest - testShutDown starting
01:18:09,1 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config36
01:18:09,2 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config36
01:18:09,2 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config36: Creating local shard: member-1-shard-shard2-config36
01:18:09,3 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config36: Creating local shard: member-1-shard-shard1-config36
01:18:09,11 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:09,11 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-shard2-config36
01:18:09,12 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-shard1-config36
01:18:09,12 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config36: Initializing shard [shard1]
01:18:09,12 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-shard1-config36 is initialized
01:18:09,12 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config36: Initializing shard [shard2]
01:18:09,12 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-shard2-config36 is initialized
01:18:09,12 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config36: Issuing gracefulStop to shard member-1-shard-shard2-config36
01:18:09,13 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config36: Issuing gracefulStop to shard member-1-shard-shard1-config36
01:18:09,13 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Shutting down ShardManager shard-manager-config36 - waiting on 2 shards
01:18:09,567 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/member-1-shard-shard1-config36#1723830523]
01:18:09,568 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/member-1-shard-shard2-config36#1638427985]
01:18:09,568 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config36: All shards shutdown - sending PoisonPill to self
01:18:09,569 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Stopping ShardManager shard-manager-config36
01:18:09,569 AM [main] [INFO] ShardManagerTest - testShutDown ending
01:18:09,670 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$t#1291981712]
01:18:09,682 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryForNonLocalLeaderShardBeforeMemberUp starting
01:18:09,685 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Starting ShardManager shard-manager-config37
01:18:09,688 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Recovery complete : shard-manager-config37
01:18:09,688 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config37: Creating local shard: member-1-shard-default-config37
01:18:09,695 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:09,695 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config37
01:18:09,696 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config37: Initializing shard [default]
01:18:09,696 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Shard member-1-shard-default-config37 is initialized
01:18:09,696 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config37: Received role changed for member-1-shard-default-config37 from Candidate to Follower
01:18:09,696 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManagerTest$TestShardManager - Received unhandled message LeaderStateChanged [memberId=member-1-shard-default-config37, leaderId=member-2-shard-default-config37, leaderPayloadVersion=13]
01:18:09,698 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config37: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=false]
01:18:09,698 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config37: Returning NoShardLeaderException for shard default
01:18:09,698 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryForNonLocalLeaderShardBeforeMemberUp ending
01:18:09,800 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$u#-1307640764]
01:18:09,810 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config37
01:18:09,812 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryWaitForReadyWithNoRoleShard starting
01:18:09,814 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Starting ShardManager shard-manager-config38
01:18:09,816 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config38
01:18:09,816 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config38: Creating local shard: member-1-shard-default-config38
01:18:09,825 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:09,825 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config38
01:18:09,825 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config38: Initializing shard [default]
01:18:09,825 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardInformation - Shard member-1-shard-default-config38 is initialized
01:18:09,825 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config38: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:18:09,825 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config38: Scheduling 1200 ms timer to wait for shard ShardInformation [shardId=member-1-shard-default-config38, leaderAvailable=false, actorInitialized=true, followerSyncStatus=false, role=null, leaderId=null, activeMember=true]
01:18:11,40 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config38: Received ShardNotInitializedTimeout message for shard default
01:18:11,41 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config38: Returning NoShardLeaderException for shard default
01:18:11,41 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryWaitForReadyWithNoRoleShard ending
01:18:11,143 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$v#1460656668]
01:18:11,153 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Stopping ShardManager shard-manager-config38
01:18:11,155 AM [main] [INFO] ShardManagerTest - testShardPersistenceWithRestoredData starting
01:18:11,158 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config39
01:18:11,160 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config39: onSnapshotOffer: ShardManagerSnapshot [ShardList = [default, astronauts] ]
01:18:11,160 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config39: adding shard astronauts
01:18:11,160 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config39: removing shard people
01:18:11,161 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config39
01:18:11,161 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config39: Creating local shard: member-1-shard-default-config39
01:18:11,162 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config39: Creating local shard: member-1-shard-astronauts-config39
01:18:11,269 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config39: findLocalShard : people
01:18:11,269 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config39: Local shard people not found - shards present: [default, astronauts]
01:18:11,269 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config39: findLocalShard : default
01:18:11,269 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config39: Returning NotInitializedException for shard default
01:18:11,269 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config39: findLocalShard : astronauts
01:18:11,269 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config39: Returning NotInitializedException for shard astronauts
01:18:11,269 AM [main] [INFO] ShardManagerTest - testShardPersistenceWithRestoredData ending
01:18:11,371 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$i]
01:18:11,382 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config39
01:18:11,384 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryForNonLocalLeaderShard starting
01:18:11,387 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config40
01:18:11,388 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config40
01:18:11,388 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config40: Creating local shard: member-1-shard-default-config40
01:18:11,398 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:11,398 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config40
01:18:11,398 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config40: Initializing shard [default]
01:18:11,398 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-default-config40 is initialized
01:18:11,398 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config40: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://test
01:18:11,398 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config40 with address akka://test/user/shardmanager-config40/member-2-shard-default-config40
01:18:11,398 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config40 with address akka://test/user/shardmanager-config40/member-2-shard-default-config40 to akka://test/user/member-1-shard-default-config
01:18:11,398 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config40: Received role changed for member-1-shard-default-config40 from Candidate to Follower
01:18:11,398 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config40: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config40, leaderId=member-2-shard-default-config40, leaderPayloadVersion=12]
01:18:11,398 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config40: All Shards are ready - data store config40 is ready
01:18:11,398 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config40: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=false]
01:18:11,398 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config40: Found primary for default: RemotePrimaryShardFound [primaryPath=akka://test/user/shardmanager-config40/member-2-shard-default-config40, primaryVersion=12]
01:18:11,398 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryForNonLocalLeaderShard ending
01:18:11,500 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$w#-854825266]
01:18:11,510 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Stopping ShardManager shard-manager-config40
01:18:11,512 AM [main] [INFO] ShardManagerTest - testShardAvailabilityOnChangeOfMemberReachability starting
01:18:11,519 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started
01:18:11,526 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://cluster-test@127.0.0.1:2558] with UID [6806306729694104066]
01:18:11,527 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Starting up, Akka version [2.6.21] ...
01:18:11,528 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Registered cluster JMX MBean [akka:type=Cluster]
01:18:11,528 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Started up successfully
01:18:11,529 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:18:11,529 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:18:11,549 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Node [akka://cluster-test@127.0.0.1:2558] is JOINING itself (with roles [member-1, dc-default], version [0.0.0]) and forming new cluster
01:18:11,549 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - is the new leader among reachable nodes (more leaders may exist)
01:18:11,549 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Leader is moving node [akka://cluster-test@127.0.0.1:2558] to [Up]
01:18:11,549 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://cluster-test/user/shardmanager-config41] to Actor[akka://cluster-test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://cluster-test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:18:11,550 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config41
01:18:11,556 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config41
01:18:11,556 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config41: Creating local shard: member-1-shard-default-config41
01:18:11,557 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config41: Received MemberUp: memberName: MemberName{name=member-1}, address: akka://cluster-test@127.0.0.1:2558
01:18:11,557 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config41 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-1-shard-default-config41
01:18:11,558 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Slf4jLogger - Slf4jLogger started
01:18:11,569 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://cluster-test@127.0.0.1:2559] with UID [5967843485711418881]
01:18:11,569 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Starting up, Akka version [2.6.21] ...
01:18:11,570 AM [cluster-test-akka.actor.default-dispatcher-4] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:18:11,570 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Started up successfully
01:18:11,571 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:18:11,571 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:18:11,584 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ShardManager - Starting ShardManager shard-manager-config41
01:18:11,592 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:11,592 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config41
01:18:11,592 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config41 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-1-shard-default-config41
01:18:11,592 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-default-config41 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-1-shard-default-config41 to akka://cluster-test/user/member-1-shard-default-config
01:18:11,592 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config41: updated peer member-1-shard-default-config41 on member MemberName{name=member-1} with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-1-shard-default-config41 on shard member-1-shard-default-config41 whose actor address is Actor[akka://cluster-test/user/member-1-shard-default-config#118258776]
01:18:11,592 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config41: Initializing shard [default]
01:18:11,592 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Shard member-1-shard-default-config41 is initialized
01:18:11,592 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config41: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config41, leaderId=member-2-shard-default-config41, leaderPayloadVersion=13]
01:18:11,592 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config41: Received role changed for member-1-shard-default-config41 from Candidate to Follower
01:18:11,594 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://cluster-test/user/shardmanager-config41] to Actor[akka://cluster-test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://cluster-test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:18:11,606 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config41
01:18:11,606 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config41: Creating local shard: member-2-shard-default-config41
01:18:11,607 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:11,607 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Creating Shard member-2-shard-default-config41
01:18:11,607 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config41: Initializing shard [default]
01:18:11,607 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Shard member-2-shard-default-config41 is initialized
01:18:11,607 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config41: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-2-shard-default-config41, leaderId=member-2-shard-default-config41, leaderPayloadVersion=13]
01:18:11,607 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config41: Received role changed for member-2-shard-default-config41 from Candidate to Leader
01:18:11,607 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config41: All Shards are ready - data store config41 is ready
01:18:11,663 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Node [akka://cluster-test@127.0.0.1:2559] is JOINING, roles [member-2, dc-default], version [0.0.0]
01:18:11,680 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Welcome from [akka://cluster-test@127.0.0.1:2558]
01:18:11,680 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config41: Received MemberUp: memberName: MemberName{name=member-1}, address: akka://cluster-test@127.0.0.1:2558
01:18:11,680 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config41 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-1-shard-default-config41
01:18:11,680 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-default-config41 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-1-shard-default-config41 to akka://cluster-test/user/member-2-shard-default-config
01:18:11,680 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config41: All Shards are ready - data store config41 is ready
01:18:12,538 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Leader is moving node [akka://cluster-test@127.0.0.1:2559] to [Up]
01:18:12,538 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config41: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2559
01:18:12,539 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config41 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config41/member-2-shard-default-config41
01:18:12,539 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config41 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config41/member-2-shard-default-config41 to akka://cluster-test/user/member-1-shard-default-config
01:18:12,539 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config41: All Shards are ready - data store config41 is ready
01:18:12,539 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config41: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:18:12,539 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config41: Found primary for default: RemotePrimaryShardFound [primaryPath=akka://cluster-test@127.0.0.1:2559/user/shardmanager-config41/member-2-shard-default-config41, primaryVersion=13]
01:18:12,541 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - Received UnreachableMember: memberName MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2558
01:18:12,541 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - Marking Leader member-2-shard-default-config41 as unavailable.
01:18:12,542 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - shard-manager-config41: Received MemberRemoved: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2558
01:18:12,542 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config41: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:18:12,543 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config41: Scheduling 1200 ms timer to wait for shard ShardInformation [shardId=member-1-shard-default-config41, leaderAvailable=false, actorInitialized=true, followerSyncStatus=false, role=Follower, leaderId=member-2-shard-default-config41, activeMember=true]
01:18:12,594 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ShardManager - shard-manager-config41: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2559
01:18:12,594 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config41 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config41/member-2-shard-default-config41
01:18:12,594 AM [cluster-test-akka.actor.default-dispatcher-4] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config41 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config41/member-2-shard-default-config41 to akka://cluster-test/user/member-2-shard-default-config
01:18:12,594 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] ShardManager - shard-manager-config41: All Shards are ready - data store config41 is ready
01:18:13,757 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config41: Received ShardNotInitializedTimeout message for shard default
01:18:13,757 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config41: Returning NoShardLeaderException for shard default
01:18:13,758 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - Received ReachableMember: memberName MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2558
01:18:13,758 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config41 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-2-shard-default-config41
01:18:13,758 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config41 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-2-shard-default-config41 to akka://cluster-test/user/member-1-shard-default-config
01:18:13,758 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - Marking Leader member-2-shard-default-config41 as available.
01:18:13,758 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config41: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:18:13,758 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config41: Found primary for default: RemotePrimaryShardFound [primaryPath=akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-2-shard-default-config41, primaryVersion=13]
01:18:13,758 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config41: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2558
01:18:13,758 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config41 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-2-shard-default-config41
01:18:13,758 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config41 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-2-shard-default-config41 to akka://cluster-test/user/member-1-shard-default-config
01:18:13,758 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config41: All Shards are ready - data store config41 is ready
01:18:13,758 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Received UnreachableMember: memberName MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2558
01:18:13,758 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Marking Leader member-2-shard-default-config41 as unavailable.
01:18:13,759 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config41: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:18:13,759 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config41: Scheduling 1200 ms timer to wait for shard ShardInformation [shardId=member-1-shard-default-config41, leaderAvailable=false, actorInitialized=true, followerSyncStatus=false, role=Follower, leaderId=member-2-shard-default-config41, activeMember=true]
01:18:13,759 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - Received ReachableMember: memberName MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2558
01:18:13,759 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config41 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-2-shard-default-config41
01:18:13,759 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config41 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-2-shard-default-config41 to akka://cluster-test/user/member-1-shard-default-config
01:18:13,759 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardInformation - Shard member-1-shard-default-config41 is initialized - notifying 1 OnShardInitialized callbacks
01:18:13,759 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - Marking Leader member-2-shard-default-config41 as available.
01:18:13,759 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardInformation - Shard member-1-shard-default-config41 is ready - notifying 1 OnShardInitialized callbacks
01:18:13,759 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shard-manager-config41: Found primary for default: RemotePrimaryShardFound [primaryPath=akka://cluster-test@127.0.0.1:2558/user/shardmanager-config41/member-2-shard-default-config41, primaryVersion=13]
01:18:13,759 AM [main] [INFO] ShardManagerTest - testShardAvailabilityOnChangeOfMemberReachability ending
01:18:13,861 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - Stopping ShardManager shard-manager-config41
01:18:13,861 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:18:13,861 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:18:13,870 AM [cluster-test-akka.actor.default-dispatcher-6] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2559], control stream] Upstream failed, cause: StreamTcpException: The connection has been aborted
01:18:13,870 AM [cluster-test-akka.actor.default-dispatcher-6] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2559], message stream] Upstream failed, cause: StreamTcpException: The connection has been aborted
01:18:13,870 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
01:18:13,877 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config41
01:18:13,878 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:18:13,878 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:18:14,903 AM [cluster-test-akka.actor.default-dispatcher-4] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[WARN] [02/14/2024 01:18:14.905] [cluster-test-akka.actor.internal-dispatcher-2] [Cluster(akka://cluster-test)] Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:18:14,916 AM [main] [INFO] ShardManagerTest - testAddShardReplica starting
01:18:14,927 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started
01:18:14,937 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://cluster-test@127.0.0.1:2558] with UID [-6848540301476257365]
01:18:14,937 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Starting up, Akka version [2.6.21] ...
01:18:14,953 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Registered cluster JMX MBean [akka:type=Cluster]
01:18:14,953 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Started up successfully
01:18:14,953 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:18:14,953 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:18:14,954 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Node [akka://cluster-test@127.0.0.1:2558] is JOINING itself (with roles [member-1, dc-default], version [0.0.0]) and forming new cluster
01:18:14,955 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - is the new leader among reachable nodes (more leaders may exist)
01:18:14,955 AM [cluster-test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Leader is moving node [akka://cluster-test@127.0.0.1:2558] to [Up]
01:18:14,956 AM [cluster-test-akka.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://cluster-test/user/shardmanager-config42] to Actor[akka://cluster-test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://cluster-test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:18:14,963 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started
01:18:14,963 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shardmanager-config42
01:18:14,965 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shardmanager-config42
01:18:14,965 AM [cluster-test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shardmanager-config42: Creating local shard: member-1-shard-default-config42
01:18:14,965 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shardmanager-config42: Received MemberUp: memberName: MemberName{name=member-1}, address: akka://cluster-test@127.0.0.1:2558
01:18:14,965 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config42 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config42/member-1-shard-default-config42
01:18:14,971 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://cluster-test@127.0.0.1:2559] with UID [-3399481063686798015]
01:18:14,971 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Starting up, Akka version [2.6.21] ...
01:18:14,973 AM [cluster-test-akka.actor.default-dispatcher-10] [WARN] Cluster - Could not register Cluster JMX MBean with name=akka:type=Cluster as it is already registered. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:18:14,973 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Started up successfully
01:18:14,973 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing
01:18:14,973 AM [cluster-test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining
01:18:14,995 AM [cluster-test-akka.actor.default-dispatcher-15] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:14,995 AM [cluster-test-akka.actor.default-dispatcher-15] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config42
01:18:14,995 AM [cluster-test-akka.actor.default-dispatcher-15] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config42 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config42/member-1-shard-default-config42
01:18:14,995 AM [cluster-test-akka.actor.default-dispatcher-15] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-default-config42 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config42/member-1-shard-default-config42 to akka://cluster-test/user/member-1-shard-default-config
01:18:14,995 AM [cluster-test-akka.actor.default-dispatcher-15] [DEBUG] ShardManager - shardmanager-config42: updated peer member-1-shard-default-config42 on member MemberName{name=member-1} with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config42/member-1-shard-default-config42 on shard member-1-shard-default-config42 whose actor address is Actor[akka://cluster-test/user/member-1-shard-default-config#-1440102300]
01:18:14,995 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://cluster-test/user/shardmanager-config42] to Actor[akka://cluster-test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://cluster-test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
01:18:14,998 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - Starting ShardManager shardmanager-config42
01:18:15,23 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - Recovery complete : shardmanager-config42
01:18:15,23 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shardmanager-config42: Creating local shard: member-2-shard-default-config42
01:18:15,23 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shardmanager-config42: Creating local shard: member-2-shard-astronauts-config42
01:18:15,24 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:15,24 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - Creating Shard member-2-shard-default-config42
01:18:15,24 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - Creating Shard member-2-shard-astronauts-config42
01:18:15,24 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardManager - shardmanager-config42: Initializing shard [astronauts]
01:18:15,24 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardInformation - Shard member-2-shard-astronauts-config42 is initialized
01:18:15,24 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - shardmanager-config42: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-2-shard-astronauts-config42, leaderId=member-2-shard-astronauts-config42, leaderPayloadVersion=12]
01:18:15,24 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - shardmanager-config42: Received role changed for member-2-shard-astronauts-config42 from Candidate to Leader
01:18:15,35 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Node [akka://cluster-test@127.0.0.1:2559] is JOINING, roles [member-2, dc-default], version [0.0.0]
01:18:15,38 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2559] - Welcome from [akka://cluster-test@127.0.0.1:2558]
01:18:15,38 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - shardmanager-config42: Received MemberUp: memberName: MemberName{name=member-1}, address: akka://cluster-test@127.0.0.1:2558
01:18:15,38 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-default-config42 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config42/member-1-shard-default-config42
01:18:15,38 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-default-config42 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config42/member-1-shard-default-config42 to akka://cluster-test/user/member-2-shard-astronauts-config
01:18:15,38 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardInformation - updatePeerAddress for peer member-1-shard-astronauts-config42 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config42/member-1-shard-astronauts-config42
01:18:15,38 AM [cluster-test-akka.actor.default-dispatcher-6] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-1-shard-astronauts-config42 with address akka://cluster-test@127.0.0.1:2558/user/shardmanager-config42/member-1-shard-astronauts-config42 to akka://cluster-test/user/member-2-shard-astronauts-config
01:18:15,962 AM [cluster-test-akka.actor.default-dispatcher-15] [INFO] Cluster - Cluster Node [akka://cluster-test@127.0.0.1:2558] - Leader is moving node [akka://cluster-test@127.0.0.1:2559] to [Up]
01:18:15,962 AM [cluster-test-akka.actor.default-dispatcher-15] [INFO] ShardManager - shardmanager-config42: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2559
01:18:15,962 AM [cluster-test-akka.actor.default-dispatcher-15] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config42 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config42/member-2-shard-default-config42
01:18:15,962 AM [cluster-test-akka.actor.default-dispatcher-15] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config42 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config42/member-2-shard-default-config42 to akka://cluster-test/user/member-1-shard-default-config
01:18:15,965 AM [cluster-test-akka.actor.default-dispatcher-16] [DEBUG] ShardManager - shardmanager-config42: onAddShardReplica: AddShardReplica[ShardName=astronauts]
01:18:15,966 AM [cluster-test-akka.actor.default-dispatcher-16] [DEBUG] ShardManager - shardmanager-config42: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=astronauts, waitUntilReady=true]
01:18:15,966 AM [cluster-test-akka.actor.default-dispatcher-16] [DEBUG] ShardManager - shardmanager-config42: findPrimary for astronauts forwarding to remote ShardManager akka://cluster-test@127.0.0.1:2559/user/shardmanager-config42, visitedAddresses: [akka://cluster-test@127.0.0.1:2558/user/shardmanager-config42]
01:18:15,970 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shardmanager-config42: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.RemoteFindPrimary [shardName=astronauts, waitUntilReady=true]
01:18:15,970 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shardmanager-config42: Found primary for astronauts: RemotePrimaryShardFound [primaryPath=akka://cluster-test@127.0.0.1:2559/user/member-2-shard-astronauts-config, primaryVersion=12]
01:18:15,971 AM [cluster-test-akka.actor.default-dispatcher-16] [DEBUG] ShardManager - shardmanager-config42: Sending AddServer message to peer akka://cluster-test@127.0.0.1:2559/user/member-2-shard-astronauts-config for shard member-1-shard-astronauts-config42
01:18:15,982 AM [cluster-test-akka.actor.default-dispatcher-16] [DEBUG] ShardManager - shardmanager-config42: Received AddServerReply{status=OK, leaderHint=member-2-shard-astronauts-config42} for shard astronauts from leader akka://cluster-test@127.0.0.1:2559/user/member-2-shard-astronauts-config
01:18:15,982 AM [cluster-test-akka.actor.default-dispatcher-16] [DEBUG] ShardManager - shardmanager-config42: Leader shard successfully added the replica shard astronauts
01:18:15,983 AM [cluster-test-akka.actor.default-dispatcher-16] [DEBUG] ShardInformation - Sending new DatastoreContext to member-1-shard-astronauts-config42
01:18:15,983 AM [cluster-test-akka.actor.default-dispatcher-16] [DEBUG] ShardManager - shardmanager-config42: persisting the shard list [default, astronauts]
01:18:15,983 AM [cluster-test-akka.actor.default-dispatcher-16] [DEBUG] ShardManager - shardmanager-config42 saved ShardManager snapshot successfully. Deleting the prev snapshot if available
01:18:15,983 AM [cluster-test-akka.actor.default-dispatcher-16] [DEBUG] ShardManager - shardmanager-config42: Successfully deleted prior snapshots
01:18:15,998 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shardmanager-config42: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://cluster-test@127.0.0.1:2559
01:18:15,998 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config42 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config42/member-2-shard-default-config42
01:18:15,998 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-default-config42 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config42/member-2-shard-default-config42 to akka://cluster-test/user/member-2-shard-astronauts-config
01:18:15,998 AM [cluster-test-akka.actor.default-dispatcher-13] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-astronauts-config42 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config42/member-2-shard-astronauts-config42
01:18:15,998 AM [cluster-test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Sending PeerAddressResolved for peer member-2-shard-astronauts-config42 with address akka://cluster-test@127.0.0.1:2559/user/shardmanager-config42/member-2-shard-astronauts-config42 to akka://cluster-test/user/member-2-shard-astronauts-config
01:18:16,17 AM [main] [INFO] ShardManagerTest - testAddShardReplica ending
01:18:16,119 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Stopping ShardManager shardmanager-config42
01:18:16,120 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:18:16,120 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:18:16,132 AM [cluster-test-akka.actor.default-dispatcher-11] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2559], message stream] Upstream failed, cause: StreamTcpException: The connection has been aborted
01:18:16,132 AM [cluster-test-akka.actor.default-dispatcher-11] [WARN] Materializer - [outbound connection to [akka://cluster-test@127.0.0.1:2559], control stream] Upstream failed, cause: StreamTcpException: The connection has been aborted
01:18:16,134 AM [cluster-test-akka.actor.default-dispatcher-11] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
01:18:16,142 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] ShardManager - Stopping ShardManager shardmanager-config42
01:18:16,143 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:18:16,143 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:18:17,163 AM [cluster-test-akka.actor.default-dispatcher-6] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[WARN] [02/14/2024 01:18:17.164] [cluster-test-akka.actor.internal-dispatcher-3] [Cluster(akka://cluster-test)] Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config
01:18:17,176 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config43
01:18:17,177 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Recovery complete : shard-manager-config43
01:18:17,177 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config43: Creating local shard: member-1-shard-default-config43
01:18:17,185 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:17,185 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config43
01:18:17,185 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config43: Initializing shard [default]
01:18:17,185 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Shard member-1-shard-default-config43 is initialized
01:18:17,185 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config43: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config43, leaderId=member-1-shard-default-config43, leaderPayloadVersion=13]
01:18:17,185 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config43: Received role changed for member-1-shard-default-config43 from Candidate to Leader
01:18:17,186 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config43: All Shards are ready - data store config43 is ready
01:18:17,186 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config43: onRemoveShardReplica: RemoveShardReplica [shardName=default, memberName=MemberName{name=member-1}]
01:18:17,186 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config43: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:18:17,186 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config43: Found primary for default: LocalPrimaryShardFound [primaryPath=akka://test@127.0.0.1:2565/user/member-1-shard-default-config43#754008807, localShardDataTree=org.opendaylight.yangtools.yang.data.tree.api.DataTree$MockitoMock$bs5PxSEb@65a388a0]
01:18:17,186 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config43: Sending RemoveServer message to peer akka://test@127.0.0.1:2565/user/member-1-shard-default-config43#754008807 for shard member-1-shard-default-config43
01:18:17,186 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config43: Received RemoveServerReply{status=OK} for shard default
01:18:17,186 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config43: Leader shard successfully removed the replica shard default
01:18:17,337 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/member-1-shard-default-config43#754008807]
01:18:17,349 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryWaitForReadyWithIsolatedLeaderShard starting
01:18:17,351 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Starting ShardManager shard-manager-config44
01:18:17,352 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Recovery complete : shard-manager-config44
01:18:17,352 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config44: Creating local shard: member-1-shard-default-config44
01:18:17,362 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:17,362 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config44
01:18:17,362 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config44: Initializing shard [default]
01:18:17,362 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Shard member-1-shard-default-config44 is initialized
01:18:17,362 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config44: Received role changed for member-1-shard-default-config44 from null to IsolatedLeader
01:18:17,362 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config44: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=true]
01:18:17,362 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config44: Scheduling 1200 ms timer to wait for shard ShardInformation [shardId=member-1-shard-default-config44, leaderAvailable=false, actorInitialized=true, followerSyncStatus=false, role=IsolatedLeader, leaderId=null, activeMember=true]
01:18:18,580 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config44: Received ShardNotInitializedTimeout message for shard default
01:18:18,580 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config44: Returning NoShardLeaderException for shard default
01:18:18,581 AM [main] [INFO] ShardManagerTest - testOnReceiveFindPrimaryWaitForReadyWithIsolatedLeaderShard ending
01:18:18,682 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$y#105351913]
01:18:18,693 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config44
01:18:18,697 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config45
01:18:18,698 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Recovery complete : shard-manager-config45
01:18:18,698 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config45: Creating local shard: member-1-shard-default-config45
01:18:18,707 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:18,707 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config45
01:18:18,707 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config45: findLocalShard : non-existent
01:18:18,707 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config45: Local shard non-existent not found - shards present: [default]
01:18:18,809 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$z#1531738011]
01:18:18,819 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config45
01:18:18,823 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config46
01:18:18,824 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Recovery complete : shard-manager-config46
01:18:18,844 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:18,844 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config46: onRemoveShardReplica: RemoveShardReplica [shardName=astronauts, memberName=MemberName{name=member-2}]
01:18:18,844 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config46: Sending RemoveServer message to peer akka://test@127.0.0.1:2565/system/testProbe-595#704549502 for shard member-2-shard-astronauts-config46
01:18:18,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config46: onRemoveShardReplica: RemoveShardReplica [shardName=astronauts, memberName=MemberName{name=member-3}]
01:18:18,855 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config46: A shard replica operation for astronauts is already in progress
01:18:18,960 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Starting ShardManager shard-manager-config47
01:18:18,961 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config47
01:18:18,961 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config47: Creating local shard: member-1-shard-default-config47
01:18:18,971 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config47: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=default, waitUntilReady=false]
01:18:18,971 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config47: Returning NotInitializedException for shard default
01:18:19,72 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$A#-720267319]
01:18:19,83 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Stopping ShardManager shard-manager-config47
01:18:19,84 AM [main] [INFO] ShardManagerTest - testServerRemovedShardActorRunning starting
01:18:19,94 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardManager - Starting ShardManager shard-manager-config48
01:18:19,94 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config48
01:18:19,94 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config48: Creating local shard: member-1-shard-default-config48
01:18:19,95 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config48: Creating local shard: member-1-shard-people-config48
01:18:19,198 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:19,198 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - Creating Shard member-1-shard-default-config48
01:18:19,198 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - Creating Shard member-1-shard-people-config48
01:18:19,199 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config48: Initializing shard [default]
01:18:19,199 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardInformation - Shard member-1-shard-default-config48 is initialized
01:18:19,199 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config48: findLocalShard : people
01:18:19,199 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config48: Scheduling 600 ms timer to wait for shard ShardInformation [shardId=member-1-shard-people-config48, leaderAvailable=false, actorInitialized=false, followerSyncStatus=false, role=null, leaderId=null, activeMember=true]
01:18:19,201 AM [test-shard-dispatcher-17] [INFO] Shard - Shard created : member-1-shard-people-config48, persistent : true
01:18:19,206 AM [test-shard-dispatcher-17] [INFO] Shard - Starting recovery for member-1-shard-people-config48 with journal batch size 1
01:18:19,207 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$$j/member-1-shard-people-config48/shard-member-1:snapshot-read#-1386651515]
01:18:19,207 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@127.0.0.1:2565/user/$$j/member-1-shard-people-config48/member-1-shard-people-config48-notifier#-1503064105 created and ready for shard:member-1-shard-people-config48
01:18:19,208 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-people-config48: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters]
01:18:19,208 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-people-config48: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:18:19,208 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config48: Initializing shard [people]
01:18:19,208 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-people-config48 is initialized
01:18:19,208 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-people-config48 is initialized - notifying 1 OnShardInitialized callbacks
01:18:19,209 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-people-config48: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,209 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-people-config48: onStateChanged: Closing all transaction chains because shard member-1-shard-people-config48 is no longer the leader
01:18:19,209 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config48: findLocalShard : default
01:18:19,209 AM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-people-config48 , received role change from null to Follower
01:18:19,209 AM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-people-config48 , registered listener akka://test/user/$$j
01:18:19,209 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config48 : Sending Shutdown to Shard actor Actor[akka://test/user/member-1-shard-default-config48#-303934506] with 10000 ms timeout
01:18:19,210 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config48 : Local Shard replica for shard default has been removed
01:18:19,211 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config48: persisting the shard list [people]
01:18:19,211 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config48: Received role changed for member-1-shard-people-config48 from null to Follower
01:18:19,211 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config48 saved ShardManager snapshot successfully. Deleting the prev snapshot if available
01:18:19,211 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config48: Successfully deleted prior snapshots
01:18:19,211 AM [main] [INFO] ShardManagerTest - testServerRemovedShardActorRunning ending
01:18:19,312 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/member-1-shard-default-config48#-303934506]
01:18:19,323 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config48 : Successfully shut down Shard actor Actor[akka://test/user/member-1-shard-default-config48#-303934506]
01:18:19,323 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$j]
01:18:19,323 AM [test-shard-dispatcher-17] [INFO] Shard - Stopping Shard member-1-shard-people-config48
01:18:19,323 AM [test-shard-dispatcher-17] [DEBUG] MessageAssembler - member-1-shard-people-config48 (Follower): Closing
01:18:19,323 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-people-config48: Aborting 0 pending queued transactions
01:18:19,324 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config48
01:18:19,328 AM [main] [INFO] ShardManager - Starting ShardManager shard-manager-config49
01:18:19,329 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config49
01:18:19,329 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config49: Creating local shard: member-1-shard-default-config49
01:18:19,329 AM [main] [INFO] ShardManager - shard-manager-config49: Received role changed for member-1-shard-default-config49 from null to Follower
01:18:19,329 AM [main] [INFO] ShardManager - shard-manager-config49: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-default-config49, leaderId=member-2-shard-default-config49, leaderPayloadVersion=13]
01:18:19,340 AM [main] [INFO] ShardManager - shard-manager-config49: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://test
01:18:19,340 AM [main] [INFO] ShardInformation - updatePeerAddress for peer member-2-shard-default-config49 with address akka://test/user/shardmanager-config49/member-2-shard-default-config49
01:18:19,340 AM [main] [INFO] ShardManager - shard-manager-config49: All Shards are ready - data store config49 is ready
01:18:19,441 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$k]
01:18:19,451 AM [main] [INFO] ShardManager - Stopping ShardManager shard-manager-config49
01:18:19,453 AM [main] [INFO] ShardManagerTest - testRestoreFromSnapshot starting
01:18:19,455 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - Starting ShardManager shard-manager-config50
01:18:19,456 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Recovery complete : shard-manager-config50
01:18:19,456 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config50: Restoring from ShardManagerSnapshot: ShardManagerSnapshot [ShardList = [shard1, shard2, astronauts] ]
01:18:19,456 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config50: onSnapshotOffer: ShardManagerSnapshot [ShardList = [shard1, shard2, astronauts] ]
01:18:19,457 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config50: adding shard shard1
01:18:19,457 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config50: adding shard shard2
01:18:19,457 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config50: adding shard astronauts
01:18:19,457 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config50: Creating local shard: member-1-shard-shard2-config50
01:18:19,457 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config50: Creating local shard: member-1-shard-astronauts-config50
01:18:19,457 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config50: Creating local shard: member-1-shard-shard1-config50
01:18:19,555 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:19,555 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-shard2-config50
01:18:19,556 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-astronauts-config50
01:18:19,556 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - Creating Shard member-1-shard-shard1-config50
01:18:19,557 AM [test-shard-dispatcher-17] [INFO] Shard - Shard created : member-1-shard-shard2-config50, persistent : true
01:18:19,557 AM [test-shard-dispatcher-18] [INFO] Shard - Shard created : member-1-shard-astronauts-config50, persistent : true
01:18:19,558 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@127.0.0.1:2565/user/$$l/member-1-shard-shard2-config50/member-1-shard-shard2-config50-notifier#1271484809 created and ready for shard:member-1-shard-shard2-config50
01:18:19,558 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$$l/member-1-shard-shard2-config50/shard-member-1:snapshot-read#2019325072]
01:18:19,558 AM [test-shard-dispatcher-18] [INFO] Shard - Starting recovery for member-1-shard-astronauts-config50 with journal batch size 1
01:18:19,558 AM [test-shard-dispatcher-17] [INFO] Shard - Starting recovery for member-1-shard-shard2-config50 with journal batch size 1
01:18:19,559 AM [test-shard-dispatcher-17] [INFO] Shard - Shard created : member-1-shard-shard1-config50, persistent : true
01:18:19,559 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@127.0.0.1:2565/user/$$l/member-1-shard-astronauts-config50/member-1-shard-astronauts-config50-notifier#44056216 created and ready for shard:member-1-shard-astronauts-config50
01:18:19,559 AM [test-akka.actor.default-dispatcher-20] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$$l/member-1-shard-shard1-config50/shard-member-1:snapshot-read#487714517]
01:18:19,559 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@127.0.0.1:2565/user/$$l/member-1-shard-shard1-config50/member-1-shard-shard1-config50-notifier#1510515403 created and ready for shard:member-1-shard-shard1-config50
01:18:19,560 AM [test-shard-dispatcher-17] [INFO] Shard - Starting recovery for member-1-shard-shard1-config50 with journal batch size 1
01:18:19,560 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$$l/member-1-shard-astronauts-config50/shard-member-1:snapshot-read#-434835017]
01:18:19,563 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config50: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters]
01:18:19,563 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-shard1-config50: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:18:19,563 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-shard1-config50: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,563 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-shard1-config50 is no longer the leader
01:18:19,564 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config50 (Follower): Received TimeoutNow - switching to Candidate
01:18:19,564 AM [test-akka.actor.default-dispatcher-21] [DEBUG] ShardManager - shard-manager-config50: Initializing shard [shard1]
01:18:19,564 AM [test-akka.actor.default-dispatcher-21] [DEBUG] ShardInformation - Shard member-1-shard-shard1-config50 is initialized
01:18:19,564 AM [test-akka.actor.default-dispatcher-21] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard1-config50 , received role change from null to Follower
01:18:19,566 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config50: findLocalShard : shard1
01:18:19,566 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config50: findLocalShard : shard2
01:18:19,566 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config50: Scheduling 3000 ms timer to wait for shard ShardInformation [shardId=member-1-shard-shard2-config50, leaderAvailable=false, actorInitialized=false, followerSyncStatus=false, role=null, leaderId=null, activeMember=true]
01:18:19,567 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard2-config50: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters]
01:18:19,567 AM [test-shard-dispatcher-23] [INFO] Shard - member-1-shard-shard2-config50: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:18:19,567 AM [test-shard-dispatcher-23] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-shard2-config50: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,567 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard2-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-shard2-config50 is no longer the leader
01:18:19,567 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-astronauts-config50: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters]
01:18:19,567 AM [test-shard-dispatcher-18] [INFO] Shard - member-1-shard-astronauts-config50: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:18:19,567 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config50: Initializing shard [shard2]
01:18:19,568 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-shard2-config50 is initialized
01:18:19,568 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-shard2-config50 is initialized - notifying 1 OnShardInitialized callbacks
01:18:19,568 AM [test-shard-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-astronauts-config50: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,568 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardManager - shard-manager-config50: Initializing shard [astronauts]
01:18:19,568 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardInformation - Shard member-1-shard-astronauts-config50 is initialized
01:18:19,568 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-astronauts-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-astronauts-config50 is no longer the leader
01:18:19,568 AM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard2-config50 , received role change from null to Follower
01:18:19,568 AM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-astronauts-config50 , received role change from null to Follower
01:18:19,568 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-astronauts-config50 (Follower): Received TimeoutNow - switching to Candidate
01:18:19,568 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config50 (Candidate): Election: Candidate has following voting peers: []
01:18:19,568 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config50: Set currentTerm=1, votedFor=member-1-shard-shard1-config50
01:18:19,568 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-astronauts-config50 (Candidate): Election: Candidate has following voting peers: []
01:18:19,568 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-astronauts-config50: Set currentTerm=1, votedFor=member-1-shard-astronauts-config50
01:18:19,568 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config50: findLocalShard : astronauts
01:18:19,568 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManager - shard-manager-config50: onGetSnapshot
01:18:19,571 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-shard1-config50 (Candidate): Starting new election term 1
01:18:19,571 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-shard1-config50 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
01:18:19,571 AM [test-shard-dispatcher-17] [DEBUG] MessageAssembler - member-1-shard-shard1-config50 (Follower): Closing
01:18:19,571 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-shard1-config50: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,571 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-shard1-config50 is no longer the leader
01:18:19,571 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard1-config50 , received role change from Follower to Candidate
01:18:19,571 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config50: Expecting 3 shard snapshot replies
01:18:19,571 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard2-config50 (Follower): Received TimeoutNow - switching to Candidate
01:18:19,571 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard2-config50 (Candidate): Election: Candidate has following voting peers: []
01:18:19,571 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard2-config50: Set currentTerm=1, votedFor=member-1-shard-shard2-config50
01:18:19,571 AM [test-shard-dispatcher-23] [INFO] Shard - member-1-shard-shard2-config50 (Candidate): Starting new election term 1
01:18:19,571 AM [test-shard-dispatcher-18] [INFO] Shard - member-1-shard-astronauts-config50 (Candidate): Starting new election term 1
01:18:19,571 AM [test-shard-dispatcher-23] [INFO] Shard - member-1-shard-shard2-config50 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
01:18:19,571 AM [test-shard-dispatcher-23] [DEBUG] MessageAssembler - member-1-shard-shard2-config50 (Follower): Closing
01:18:19,572 AM [test-shard-dispatcher-18] [INFO] Shard - member-1-shard-astronauts-config50 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
01:18:19,572 AM [test-shard-dispatcher-23] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-shard2-config50: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,572 AM [test-shard-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-astronauts-config50 (Follower): Closing
01:18:19,572 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard2-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-shard2-config50 is no longer the leader
01:18:19,572 AM [test-shard-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-astronauts-config50: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,572 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-astronauts-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-astronauts-config50 is no longer the leader
01:18:19,572 AM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard2-config50 , received role change from Follower to Candidate
01:18:19,572 AM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-astronauts-config50 , received role change from Follower to Candidate
01:18:19,584 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-shard1-config50 (Candidate): Received ElectionTimeout
01:18:19,594 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard2-config50 (Candidate): Received ElectionTimeout
01:18:19,594 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config50 (Candidate): Received ElectionTimeout
01:18:19,597 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-shard1-config50 (Leader): Election: Leader has following peers: []
01:18:19,597 AM [test-shard-dispatcher-18] [INFO] Shard - member-1-shard-shard1-config50 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
01:18:19,597 AM [test-shard-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-shard1-config50: onLeadershipChange, isLeader: true, hasLeader : true
01:18:19,599 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-shard1-config50: became leader with frontend state for []
01:18:19,602 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-shard1-config50: onGetSnapshot
01:18:19,602 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-shard1-config50: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:18:19,604 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard2-config50 (Leader): Election: Leader has following peers: []
01:18:19,604 AM [test-shard-dispatcher-23] [INFO] Shard - member-1-shard-shard2-config50 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
01:18:19,604 AM [test-shard-dispatcher-23] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-shard2-config50: onLeadershipChange, isLeader: true, hasLeader : true
01:18:19,604 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard2-config50: became leader with frontend state for []
01:18:19,604 AM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard1-config50 , received role change from Candidate to Leader
01:18:19,604 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard2-config50 , received role change from Candidate to Leader
01:18:19,604 AM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard1-config50 , registered listener akka://test/user/$$l
01:18:19,604 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard2-config50: onGetSnapshot
01:18:19,604 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config50: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-shard1-config50, leaderId=member-1-shard-shard1-config50, leaderPayloadVersion=13]
01:18:19,604 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard2-config50: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:18:19,604 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config50: Received role changed for member-1-shard-shard1-config50 from Candidate to Leader
01:18:19,604 AM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard2-config50 , registered listener akka://test/user/$$l
01:18:19,604 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config50: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-shard2-config50, leaderId=member-1-shard-shard2-config50, leaderPayloadVersion=13]
01:18:19,604 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config50: Received role changed for member-1-shard-shard2-config50 from Candidate to Leader
01:18:19,604 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config50 (Leader): Election: Leader has following peers: []
01:18:19,604 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-astronauts-config50 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
01:18:19,604 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-astronauts-config50: onLeadershipChange, isLeader: true, hasLeader : true
01:18:19,604 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config50: became leader with frontend state for []
01:18:19,605 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config50: onGetSnapshot
01:18:19,605 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config50: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:18:19,605 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-astronauts-config50 , received role change from Candidate to Leader
01:18:19,605 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-astronauts-config50 , registered listener akka://test/user/$$l
01:18:19,605 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config50: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-astronauts-config50, leaderId=member-1-shard-astronauts-config50, leaderPayloadVersion=13]
01:18:19,605 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config50: Received role changed for member-1-shard-astronauts-config50 from Candidate to Leader
01:18:19,605 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config50: All Shards are ready - data store config50 is ready
01:18:19,606 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-shard1-config50: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}}
01:18:19,607 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard2-config50: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}}
01:18:19,612 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config50: Received GetSnapshotReply [id=member-1-shard-shard1-config50, snapshot=Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@70f96dcb, electionTerm=1, electionVotedFor=member-1-shard-shard1-config50, ServerConfigPayload=null]]
01:18:19,613 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config50: Received GetSnapshotReply [id=member-1-shard-shard2-config50, snapshot=Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@7c19ea4c, electionTerm=1, electionVotedFor=member-1-shard-shard2-config50, ServerConfigPayload=null]]
01:18:19,616 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config50: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}}
01:18:19,616 AM [test-akka.actor.default-dispatcher-22] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config50: Received GetSnapshotReply [id=member-1-shard-astronauts-config50, snapshot=Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@6116a31b, electionTerm=1, electionVotedFor=member-1-shard-astronauts-config50, ServerConfigPayload=null]]
01:18:19,616 AM [test-akka.actor.default-dispatcher-22] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config50: All shard snapshots received
01:18:19,617 AM [main] [INFO] ShardManagerTest - testRestoreFromSnapshot ending
01:18:19,719 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$l]
01:18:19,730 AM [test-shard-dispatcher-23] [INFO] Shard - Stopping Shard member-1-shard-astronauts-config50
01:18:19,730 AM [test-shard-dispatcher-17] [INFO] Shard - Stopping Shard member-1-shard-shard1-config50
01:18:19,730 AM [test-shard-dispatcher-23] [DEBUG] MessageSlicer - member-1-shard-astronauts-config50 (Leader)_slicer-id-216: Closing
01:18:19,730 AM [test-shard-dispatcher-17] [DEBUG] MessageSlicer - member-1-shard-shard1-config50 (Leader)_slicer-id-214: Closing
01:18:19,730 AM [test-shard-dispatcher-24] [INFO] Shard - Stopping Shard member-1-shard-shard2-config50
01:18:19,730 AM [test-shard-dispatcher-24] [DEBUG] MessageSlicer - member-1-shard-shard2-config50 (Leader)_slicer-id-215: Closing
01:18:19,730 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-astronauts-config50: Aborting 0 pending queued transactions
01:18:19,730 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config50: Aborting 0 pending queued transactions
01:18:19,730 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config50: Aborting 0 pending queued transactions
01:18:19,731 AM [test-akka.actor.default-dispatcher-22] [INFO] ShardManager - Stopping ShardManager shard-manager-config50
01:18:19,733 AM [main] [INFO] ShardManagerTest - testOnCreateShardWithNoInitialSchemaContext starting
01:18:19,736 AM [test-akka.actor.default-dispatcher-22] [INFO] ShardManager - Starting ShardManager shard-manager-config51
01:18:19,738 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Recovery complete : shard-manager-config51
01:18:19,746 AM [test-akka.actor.default-dispatcher-22] [DEBUG] ShardManager - shard-manager-config51: onCreateShard: CreateShard [moduleShardConfig=ModuleShardConfiguration [namespace=foo-ns, moduleName=foo-module, shardName=foo, shardMemberNames=[MemberName{name=member-1}], shardStrategyName=null], shardPropsCreator=org.opendaylight.controller.cluster.datastore.Shard$Builder@3d1b8a45]
01:18:19,747 AM [test-akka.actor.default-dispatcher-22] [DEBUG] ShardManager - shard-manager-config51 doCreateShard: shardId: member-1-shard-foo-config51, memberNames: [MemberName{name=member-1}], peerAddresses: {}, isActiveMember: true
01:18:19,747 AM [test-akka.actor.default-dispatcher-22] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:19,747 AM [test-akka.actor.default-dispatcher-22] [DEBUG] ShardManager - Creating Shard member-1-shard-foo-config51
01:18:19,747 AM [test-akka.actor.default-dispatcher-22] [DEBUG] ShardManager - shard-manager-config51: findLocalShard : foo
01:18:19,747 AM [test-akka.actor.default-dispatcher-22] [DEBUG] ShardManager - shard-manager-config51: Scheduling 600 ms timer to wait for shard ShardInformation [shardId=member-1-shard-foo-config51, leaderAvailable=false, actorInitialized=false, followerSyncStatus=false, role=null, leaderId=null, activeMember=true]
01:18:19,748 AM [test-shard-dispatcher-17] [INFO] Shard - Shard created : member-1-shard-foo-config51, persistent : true
01:18:19,752 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$B/member-1-shard-foo-config51/shard-member-1:snapshot-read#1899018173]
01:18:19,753 AM [test-akka.actor.default-dispatcher-22] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@127.0.0.1:2565/user/$B/member-1-shard-foo-config51/member-1-shard-foo-config51-notifier#-566347307 created and ready for shard:member-1-shard-foo-config51
01:18:19,753 AM [test-shard-dispatcher-17] [INFO] Shard - Starting recovery for member-1-shard-foo-config51 with journal batch size 1
01:18:19,755 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-foo-config51: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters]
01:18:19,755 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-foo-config51: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:18:19,755 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config51: Initializing shard [foo]
01:18:19,755 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-foo-config51 is initialized
01:18:19,755 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-foo-config51 is initialized - notifying 1 OnShardInitialized callbacks
01:18:19,755 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-foo-config51: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,755 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-foo-config51: onStateChanged: Closing all transaction chains because shard member-1-shard-foo-config51 is no longer the leader
01:18:19,756 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-foo-config51 , received role change from null to Follower
01:18:19,756 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-foo-config51 (Follower): Received TimeoutNow - switching to Candidate
01:18:19,756 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-foo-config51 (Candidate): Election: Candidate has following voting peers: []
01:18:19,756 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-foo-config51: Set currentTerm=1, votedFor=member-1-shard-foo-config51
01:18:19,756 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-foo-config51 (Candidate): Starting new election term 1
01:18:19,756 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-foo-config51 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
01:18:19,756 AM [test-shard-dispatcher-17] [DEBUG] MessageAssembler - member-1-shard-foo-config51 (Follower): Closing
01:18:19,756 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-foo-config51: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,756 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-foo-config51: onStateChanged: Closing all transaction chains because shard member-1-shard-foo-config51 is no longer the leader
01:18:19,756 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-foo-config51 , received role change from Follower to Candidate
01:18:19,756 AM [main] [INFO] ShardManagerTest - testOnCreateShardWithNoInitialSchemaContext ending
01:18:19,757 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-foo-config51 (Candidate): Received ElectionTimeout
01:18:19,757 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-foo-config51 (Leader): Election: Leader has following peers: []
01:18:19,757 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-foo-config51 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
01:18:19,757 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-foo-config51: onLeadershipChange, isLeader: true, hasLeader : true
01:18:19,757 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-foo-config51: became leader with frontend state for []
01:18:19,757 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-foo-config51 , received role change from Candidate to Leader
01:18:19,757 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-foo-config51 , registered listener akka://test/user/$B
01:18:19,758 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config51: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-foo-config51, leaderId=member-1-shard-foo-config51, leaderPayloadVersion=13]
01:18:19,758 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config51: Received role changed for member-1-shard-foo-config51 from Candidate to Leader
01:18:19,758 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config51: All Shards are ready - data store config51 is ready
01:18:19,858 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$B#-936981480]
01:18:19,868 AM [test-shard-dispatcher-17] [INFO] Shard - Stopping Shard member-1-shard-foo-config51
01:18:19,868 AM [test-shard-dispatcher-17] [DEBUG] MessageSlicer - member-1-shard-foo-config51 (Leader)_slicer-id-218: Closing
01:18:19,869 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-foo-config51: Aborting 0 pending queued transactions
01:18:19,870 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config51
01:18:19,871 AM [main] [INFO] ShardManagerTest - testGetSnapshot starting
01:18:19,873 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Starting ShardManager shard-manager-config52
01:18:19,878 AM [test-akka.actor.default-dispatcher-22] [INFO] ShardManager - Recovery complete : shard-manager-config52
01:18:19,878 AM [test-akka.actor.default-dispatcher-22] [DEBUG] ShardManager - shard-manager-config52: Creating local shard: member-1-shard-shard2-config52
01:18:19,878 AM [test-akka.actor.default-dispatcher-22] [DEBUG] ShardManager - shard-manager-config52: Creating local shard: member-1-shard-shard1-config52
01:18:19,883 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config52: onGetSnapshot
01:18:19,884 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:19,884 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Creating Shard member-1-shard-shard2-config52
01:18:19,884 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - Creating Shard member-1-shard-shard1-config52
01:18:19,884 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config52: findLocalShard : shard1
01:18:19,884 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config52: Scheduling 600 ms timer to wait for shard ShardInformation [shardId=member-1-shard-shard1-config52, leaderAvailable=false, actorInitialized=false, followerSyncStatus=false, role=null, leaderId=null, activeMember=true]
01:18:19,884 AM [test-shard-dispatcher-24] [INFO] Shard - Shard created : member-1-shard-shard1-config52, persistent : true
01:18:19,884 AM [test-shard-dispatcher-17] [INFO] Shard - Shard created : member-1-shard-shard2-config52, persistent : true
01:18:19,885 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@127.0.0.1:2565/user/$$m/member-1-shard-shard1-config52/member-1-shard-shard1-config52-notifier#471927322 created and ready for shard:member-1-shard-shard1-config52
01:18:19,885 AM [test-shard-dispatcher-24] [INFO] Shard - Starting recovery for member-1-shard-shard1-config52 with journal batch size 1
01:18:19,885 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$$m/member-1-shard-shard1-config52/shard-member-1:snapshot-read#-1668151486]
01:18:19,886 AM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$$m/member-1-shard-shard2-config52/shard-member-1:snapshot-read#-468347358]
01:18:19,886 AM [test-shard-dispatcher-17] [INFO] Shard - Starting recovery for member-1-shard-shard2-config52 with journal batch size 1
01:18:19,886 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@127.0.0.1:2565/user/$$m/member-1-shard-shard2-config52/member-1-shard-shard2-config52-notifier#-1904858634 created and ready for shard:member-1-shard-shard2-config52
01:18:19,895 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config52: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters]
01:18:19,895 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-shard1-config52: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:18:19,895 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config52: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters]
01:18:19,895 AM [test-shard-dispatcher-24] [INFO] Shard - member-1-shard-shard2-config52: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:18:19,895 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-shard1-config52: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,895 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config52: onStateChanged: Closing all transaction chains because shard member-1-shard-shard1-config52 is no longer the leader
01:18:19,895 AM [test-shard-dispatcher-24] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-shard2-config52: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,895 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config52: onStateChanged: Closing all transaction chains because shard member-1-shard-shard2-config52 is no longer the leader
01:18:19,895 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config52 (Follower): Received TimeoutNow - switching to Candidate
01:18:19,895 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard2-config52 , received role change from null to Follower
01:18:19,895 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config52 (Candidate): Election: Candidate has following voting peers: []
01:18:19,895 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config52: Set currentTerm=1, votedFor=member-1-shard-shard1-config52
01:18:19,895 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config52: Initializing shard [shard1]
01:18:19,895 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config52 (Follower): Received TimeoutNow - switching to Candidate
01:18:19,895 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardInformation - Shard member-1-shard-shard1-config52 is initialized
01:18:19,895 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardInformation - Shard member-1-shard-shard1-config52 is initialized - notifying 1 OnShardInitialized callbacks
01:18:19,895 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-shard1-config52 (Candidate): Starting new election term 1
01:18:19,895 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-shard1-config52 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
01:18:19,895 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config52 (Candidate): Election: Candidate has following voting peers: []
01:18:19,895 AM [test-shard-dispatcher-17] [DEBUG] MessageAssembler - member-1-shard-shard1-config52 (Follower): Closing
01:18:19,895 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config52: Set currentTerm=1, votedFor=member-1-shard-shard2-config52
01:18:19,895 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-shard1-config52: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,895 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config52: onStateChanged: Closing all transaction chains because shard member-1-shard-shard1-config52 is no longer the leader
01:18:19,895 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardManager - shard-manager-config52: Initializing shard [shard2]
01:18:19,895 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardInformation - Shard member-1-shard-shard2-config52 is initialized
01:18:19,895 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard1-config52 , received role change from null to Follower
01:18:19,895 AM [test-shard-dispatcher-24] [INFO] Shard - member-1-shard-shard2-config52 (Candidate): Starting new election term 1
01:18:19,895 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard1-config52 , received role change from Follower to Candidate
01:18:19,895 AM [test-shard-dispatcher-24] [INFO] Shard - member-1-shard-shard2-config52 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
01:18:19,895 AM [test-shard-dispatcher-24] [DEBUG] MessageAssembler - member-1-shard-shard2-config52 (Follower): Closing
01:18:19,895 AM [test-shard-dispatcher-24] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-shard2-config52: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,895 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config52: onStateChanged: Closing all transaction chains because shard member-1-shard-shard2-config52 is no longer the leader
01:18:19,896 AM [test-akka.actor.default-dispatcher-22] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard2-config52 , received role change from Follower to Candidate
01:18:19,896 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard1-config52 (Candidate): Received ElectionTimeout
01:18:19,896 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard1-config52 (Leader): Election: Leader has following peers: []
01:18:19,896 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard2-config52 (Candidate): Received ElectionTimeout
01:18:19,896 AM [test-shard-dispatcher-24] [INFO] Shard - member-1-shard-shard1-config52 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
01:18:19,896 AM [test-shard-dispatcher-24] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-shard1-config52: onLeadershipChange, isLeader: true, hasLeader : true
01:18:19,896 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard2-config52 (Leader): Election: Leader has following peers: []
01:18:19,897 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-shard2-config52 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
01:18:19,897 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-shard2-config52: onLeadershipChange, isLeader: true, hasLeader : true
01:18:19,897 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard1-config52: became leader with frontend state for []
01:18:19,897 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard2-config52: became leader with frontend state for []
01:18:19,897 AM [test-akka.actor.default-dispatcher-21] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard2-config52 , received role change from Candidate to Leader
01:18:19,897 AM [test-akka.actor.default-dispatcher-22] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard1-config52 , received role change from Candidate to Leader
01:18:19,897 AM [test-akka.actor.default-dispatcher-21] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard2-config52 , registered listener akka://test/user/$$m
01:18:19,897 AM [test-akka.actor.default-dispatcher-22] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-shard1-config52 , registered listener akka://test/user/$$m
01:18:19,897 AM [test-akka.actor.default-dispatcher-21] [INFO] ShardManager - shard-manager-config52: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-shard2-config52, leaderId=member-1-shard-shard2-config52, leaderPayloadVersion=13]
01:18:19,897 AM [test-akka.actor.default-dispatcher-21] [INFO] ShardManager - shard-manager-config52: Received role changed for member-1-shard-shard2-config52 from Candidate to Leader
01:18:19,897 AM [test-akka.actor.default-dispatcher-21] [INFO] ShardManager - shard-manager-config52: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-shard1-config52, leaderId=member-1-shard-shard1-config52, leaderPayloadVersion=13]
01:18:19,897 AM [test-akka.actor.default-dispatcher-21] [INFO] ShardManager - shard-manager-config52: Received role changed for member-1-shard-shard1-config52 from Candidate to Leader
01:18:19,897 AM [test-akka.actor.default-dispatcher-21] [INFO] ShardManager - shard-manager-config52: All Shards are ready - data store config52 is ready
01:18:19,897 AM [test-akka.actor.default-dispatcher-21] [DEBUG] ShardManager - shard-manager-config52: findLocalShard : shard2
01:18:19,897 AM [test-akka.actor.default-dispatcher-21] [DEBUG] ShardManager - shard-manager-config52: onGetSnapshot
01:18:19,898 AM [test-akka.actor.default-dispatcher-21] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config52: Expecting 2 shard snapshot replies
01:18:19,898 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config52: onGetSnapshot
01:18:19,898 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config52: onGetSnapshot
01:18:19,898 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config52: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:18:19,898 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config52: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:18:19,898 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config52: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}}
01:18:19,898 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config52: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}}
01:18:19,898 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config52: Received GetSnapshotReply [id=member-1-shard-shard1-config52, snapshot=Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@54fa3620, electionTerm=1, electionVotedFor=member-1-shard-shard1-config52, ServerConfigPayload=null]]
01:18:19,898 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config52: Received GetSnapshotReply [id=member-1-shard-shard2-config52, snapshot=Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@5e98e29c, electionTerm=1, electionVotedFor=member-1-shard-shard2-config52, ServerConfigPayload=null]]
01:18:19,898 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config52: All shard snapshots received
01:18:19,914 AM [test-akka.actor.default-dispatcher-21] [DEBUG] ShardManager - shard-manager-config52: onAddShardReplica: AddShardReplica[ShardName=astronauts]
01:18:19,914 AM [test-akka.actor.default-dispatcher-21] [DEBUG] ShardManager - shard-manager-config52: Sending AddServer message to peer akka://test@127.0.0.1:2565/system/testProbe-609#-1058609762 for shard member-1-shard-astronauts-config52
01:18:19,915 AM [test-shard-dispatcher-17] [INFO] Shard - Shard created : member-1-shard-astronauts-config52, persistent : true
01:18:19,915 AM [test-akka.actor.default-dispatcher-21] [DEBUG] ShardManager - shard-manager-config52: Received AddServerReply{status=OK, leaderHint=} for shard astronauts from leader akka://test@127.0.0.1:2565/system/testProbe-609#-1058609762
01:18:19,915 AM [test-akka.actor.default-dispatcher-21] [DEBUG] ShardManager - shard-manager-config52: Leader shard successfully added the replica shard astronauts
01:18:19,915 AM [test-akka.actor.default-dispatcher-21] [DEBUG] ShardInformation - Sending new DatastoreContext to member-1-shard-astronauts-config52
01:18:19,915 AM [test-akka.actor.default-dispatcher-21] [DEBUG] ShardManager - shard-manager-config52: persisting the shard list [shard2, astronauts, shard1]
01:18:19,915 AM [test-akka.actor.default-dispatcher-22] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$$m/member-1-shard-astronauts-config52/shard-member-1:snapshot-read#-542480335]
01:18:19,915 AM [test-shard-dispatcher-17] [INFO] Shard - Starting recovery for member-1-shard-astronauts-config52 with journal batch size 1
01:18:19,915 AM [test-akka.actor.default-dispatcher-21] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@127.0.0.1:2565/user/$$m/member-1-shard-astronauts-config52/member-1-shard-astronauts-config52-notifier#-1351972004 created and ready for shard:member-1-shard-astronauts-config52
01:18:19,915 AM [test-akka.actor.default-dispatcher-20] [DEBUG] ShardManager - shard-manager-config52: findLocalShard : astronauts
01:18:19,915 AM [test-akka.actor.default-dispatcher-20] [DEBUG] ShardManager - shard-manager-config52: Scheduling 600 ms timer to wait for shard ShardInformation [shardId=member-1-shard-astronauts-config52, leaderAvailable=false, actorInitialized=false, followerSyncStatus=false, role=null, leaderId=null, activeMember=true]
01:18:19,916 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config52 saved ShardManager snapshot successfully. Deleting the prev snapshot if available
01:18:19,916 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config52: Successfully deleted prior snapshots
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters]
01:18:19,917 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-astronauts-config52: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-astronauts-config52: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52: onStateChanged: Closing all transaction chains because shard member-1-shard-astronauts-config52 is no longer the leader
01:18:19,917 AM [test-shard-dispatcher-17] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig null
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52: Re-initializing to Follower with previous leaderId null
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] MessageAssembler - member-1-shard-astronauts-config52 (Follower): Closing
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-astronauts-config52: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52: onStateChanged: Closing all transaction chains because shard member-1-shard-astronauts-config52 is no longer the leader
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52 (Follower): Received TimeoutNow - switching to Candidate
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52 (Candidate): Election: Candidate has following voting peers: []
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52: Set currentTerm=1, votedFor=member-1-shard-astronauts-config52
01:18:19,917 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-astronauts-config52 (Candidate): Starting new election term 1
01:18:19,917 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-astronauts-config52 (Follower) :- Switching from behavior Follower to Candidate, election term: 1
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] MessageAssembler - member-1-shard-astronauts-config52 (Follower): Closing
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-astronauts-config52: onLeadershipChange, isLeader: false, hasLeader : false
01:18:19,917 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52: onStateChanged: Closing all transaction chains because shard member-1-shard-astronauts-config52 is no longer the leader
01:18:19,917 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config52: Initializing shard [astronauts]
01:18:19,917 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-astronauts-config52 is initialized
01:18:19,917 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardInformation - Shard member-1-shard-astronauts-config52 is initialized - notifying 1 OnShardInitialized callbacks
01:18:19,917 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-astronauts-config52 , received role change from null to Follower
01:18:19,917 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-astronauts-config52 , received role change from Follower to Candidate
01:18:19,917 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config52: onGetSnapshot
01:18:19,918 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config52: Expecting 3 shard snapshot replies
01:18:19,918 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52 (Candidate): Received ElectionTimeout
01:18:19,918 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52 (Leader): Election: Leader has following peers: []
01:18:19,918 AM [test-shard-dispatcher-17] [INFO] Shard - member-1-shard-astronauts-config52 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1
01:18:19,918 AM [test-shard-dispatcher-17] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-astronauts-config52: onLeadershipChange, isLeader: true, hasLeader : true
01:18:19,918 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config52: onGetSnapshot
01:18:19,918 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52: became leader with frontend state for []
01:18:19,918 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard1-config52: onGetSnapshot
01:18:19,918 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config52: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:18:19,918 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard1-config52: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:18:19,918 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52: onGetSnapshot
01:18:19,918 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead.
01:18:19,918 AM [test-shard-dispatcher-23] [DEBUG] Shard - member-1-shard-shard1-config52: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}}
01:18:19,918 AM [test-shard-dispatcher-24] [DEBUG] Shard - member-1-shard-shard2-config52: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}}
01:18:19,918 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}}
01:18:19,918 AM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-astronauts-config52 , received role change from Candidate to Leader
01:18:19,918 AM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-astronauts-config52 , registered listener akka://test/user/$$m
01:18:19,918 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config52: Received LeaderStateChanged message: LeaderStateChanged [memberId=member-1-shard-astronauts-config52, leaderId=member-1-shard-astronauts-config52, leaderPayloadVersion=13]
01:18:19,918 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config52: Received role changed for member-1-shard-astronauts-config52 from Candidate to Leader
01:18:19,918 AM [test-akka.actor.default-dispatcher-10] [INFO] ShardManager - shard-manager-config52: All Shards are ready - data store config52 is ready
01:18:19,919 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config52: Received GetSnapshotReply [id=member-1-shard-astronauts-config52, snapshot=Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@459c1440, electionTerm=1, electionVotedFor=member-1-shard-astronauts-config52, ServerConfigPayload=null]]
01:18:19,919 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config52: Received GetSnapshotReply [id=member-1-shard-shard2-config52, snapshot=Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@618bd10a, electionTerm=1, electionVotedFor=member-1-shard-shard2-config52, ServerConfigPayload=null]]
01:18:19,919 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config52: Received GetSnapshotReply [id=member-1-shard-shard1-config52, snapshot=Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@3ba1399c, electionTerm=1, electionVotedFor=member-1-shard-shard1-config52, ServerConfigPayload=null]]
01:18:19,919 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardManagerGetSnapshotReplyActor - shard-manager-config52: All shard snapshots received
01:18:19,919 AM [main] [INFO] ShardManagerTest - testGetSnapshot ending
01:18:20,21 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$m]
01:18:20,32 AM [test-shard-dispatcher-17] [INFO] Shard - Stopping Shard member-1-shard-shard1-config52
01:18:20,32 AM [test-shard-dispatcher-17] [DEBUG] MessageSlicer - member-1-shard-shard1-config52 (Leader)_slicer-id-221: Closing
01:18:20,33 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard1-config52: Aborting 0 pending queued transactions
01:18:20,33 AM [test-shard-dispatcher-17] [INFO] Shard - Stopping Shard member-1-shard-astronauts-config52
01:18:20,33 AM [test-shard-dispatcher-17] [DEBUG] MessageSlicer - member-1-shard-astronauts-config52 (Leader)_slicer-id-224: Closing
01:18:20,33 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-astronauts-config52: Aborting 0 pending queued transactions
01:18:20,33 AM [test-shard-dispatcher-17] [INFO] Shard - Stopping Shard member-1-shard-shard2-config52
01:18:20,33 AM [test-shard-dispatcher-17] [DEBUG] MessageSlicer - member-1-shard-shard2-config52 (Leader)_slicer-id-222: Closing
01:18:20,33 AM [test-shard-dispatcher-17] [DEBUG] Shard - member-1-shard-shard2-config52: Aborting 0 pending queued transactions
01:18:20,34 AM [test-akka.actor.default-dispatcher-20] [INFO] ShardManager - Stopping ShardManager shard-manager-config52
01:18:20,35 AM [main] [INFO] ShardManagerTest - testWhenMultipleShardsPresentSyncStatusMustBeTrueForAllShards starting
01:18:20,39 AM [main] [INFO] ShardManager - Starting ShardManager shard-manager-config53
01:18:20,40 AM [test-akka.actor.default-dispatcher-20] [INFO] ShardManager - Recovery complete : shard-manager-config53
01:18:20,40 AM [test-akka.actor.default-dispatcher-20] [DEBUG] ShardManager - shard-manager-config53: Creating local shard: member-1-shard-default-config53
01:18:20,40 AM [test-akka.actor.default-dispatcher-20] [DEBUG] ShardManager - shard-manager-config53: Creating local shard: member-1-shard-astronauts-config53
01:18:20,41 AM [main] [INFO] ShardManager - shard-manager-config53: Received role changed for member-1-shard-default-config53 from Follower to Leader
01:18:20,41 AM [main] [INFO] ShardManager - shard-manager-config53: Received role changed for member-1-shard-astronauts-config53 from Follower to Leader
01:18:20,41 AM [main] [INFO] ShardManager - shard-manager-config53: Received role changed for member-1-shard-astronauts-config53 from Leader to Follower
01:18:20,41 AM [main] [INFO] ShardManager - shard-manager-config53 Received follower initial sync status for member-1-shard-astronauts-config53 status sync done true
01:18:20,41 AM [main] [INFO] ShardManagerTest - testWhenMultipleShardsPresentSyncStatusMustBeTrueForAllShards ending
01:18:20,142 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$n]
01:18:20,153 AM [main] [INFO] ShardManager - Stopping ShardManager shard-manager-config53
01:18:20,155 AM [main] [INFO] ShardManagerTest - testAddShardReplicaWithFindPrimaryTimeout starting
01:18:20,157 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config54
01:18:20,159 AM [test-akka.actor.default-dispatcher-20] [INFO] ShardManager - Recovery complete : shard-manager-config54
01:18:20,167 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:20,167 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config54: Received MemberUp: memberName: MemberName{name=member-2}, address: akka://non-existent@127.0.0.1:5
01:18:20,167 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - shard-manager-config54: All Shards are ready - data store config54 is ready
01:18:20,167 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config54: onAddShardReplica: AddShardReplica[ShardName=astronauts]
01:18:20,168 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config54: In findPrimary: org.opendaylight.controller.cluster.datastore.messages.FindPrimary [shardName=astronauts, waitUntilReady=true]
01:18:20,168 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config54: findPrimary for astronauts forwarding to remote ShardManager akka://non-existent@127.0.0.1:5/user/shardmanager-config54, visitedAddresses: [akka://test@127.0.0.1:2550/user/shardmanager-config54]
01:18:20,187 AM [test-akka.actor.default-dispatcher-13] [WARN] Materializer - [outbound connection to [akka://non-existent@127.0.0.1:5], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/<unresolved>:5,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused
01:18:20,187 AM [test-akka.actor.default-dispatcher-13] [WARN] Materializer - [outbound connection to [akka://non-existent@127.0.0.1:5], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/<unresolved>:5,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused
01:18:20,381 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config54: Received failure from FindPrimary for shard astronauts
akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://test/user/shardmanager-config54#675291756]] after [200 ms]. Message of type [org.opendaylight.controller.cluster.datastore.messages.FindPrimary]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply.
01:18:20,381 AM [main] [INFO] ShardManagerTest - testAddShardReplicaWithFindPrimaryTimeout ending
01:18:20,483 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/shardmanager-config54#675291756]
01:18:20,493 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Stopping ShardManager shard-manager-config54
01:18:20,495 AM [main] [INFO] ShardManagerTest - testOnCreateShard starting
01:18:20,497 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardManager - Starting ShardManager shard-manager-config55
01:18:20,498 AM [test-akka.actor.default-dispatcher-20] [INFO] ShardManager - Recovery complete : shard-manager-config55
01:18:20,498 AM [test-akka.actor.default-dispatcher-20] [DEBUG] ShardManager - Got updated SchemaContext: # of modules 1
01:18:20,508 AM [test-akka.actor.default-dispatcher-20] [DEBUG] ShardManager - shard-manager-config55: onCreateShard: CreateShard [moduleShardConfig=ModuleShardConfiguration [namespace=foo-ns, moduleName=foo-module, shardName=foo, shardMemberNames=[MemberName{name=member-1}, MemberName{name=member-5}, MemberName{name=member-6}], shardStrategyName=null], shardPropsCreator=org.opendaylight.controller.cluster.datastore.Shard$Builder@354f7b07]
01:18:20,508 AM [test-akka.actor.default-dispatcher-20] [DEBUG] ShardManager - shard-manager-config55 doCreateShard: shardId: member-1-shard-foo-config55, memberNames: [MemberName{name=member-1}, MemberName{name=member-5}, MemberName{name=member-6}], peerAddresses: {member-6-shard-foo-config55=null, member-5-shard-foo-config55=null}, isActiveMember: true
01:18:20,509 AM [test-akka.actor.default-dispatcher-20] [DEBUG] ShardManager - shard-manager-config55: findLocalShard : foo
01:18:20,509 AM [test-akka.actor.default-dispatcher-20] [DEBUG] ShardManager - shard-manager-config55: Scheduling 300000 ms timer to wait for shard ShardInformation [shardId=member-1-shard-foo-config55, leaderAvailable=false, actorInitialized=false, followerSyncStatus=false, role=null, leaderId=null, activeMember=true]
01:18:20,511 AM [test-shard-dispatcher-18] [INFO] Shard - Shard created : member-1-shard-foo-config55, persistent : false
01:18:20,512 AM [test-akka.actor.default-dispatcher-20] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@127.0.0.1:2565/user/$C/member-1-shard-foo-config55/member-1-shard-foo-config55-notifier#1588733684 created and ready for shard:member-1-shard-foo-config55
01:18:20,512 AM [test-akka.actor.default-dispatcher-20] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$C/member-1-shard-foo-config55/shard-member-1:snapshot-read#-1916303824]
01:18:20,514 AM [test-shard-dispatcher-18] [INFO] Shard - Starting recovery for member-1-shard-foo-config55 with journal batch size 1
01:18:20,519 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-foo-config55: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters]
01:18:20,519 AM [test-shard-dispatcher-18] [INFO] Shard - member-1-shard-foo-config55: Recovery completed  - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0
01:18:20,519 AM [test-shard-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-foo-config55: onLeadershipChange, isLeader: false, hasLeader : false
01:18:20,519 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-foo-config55: onStateChanged: Closing all transaction chains because shard member-1-shard-foo-config55 is no longer the leader
01:18:20,519 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardManager - shard-manager-config55: Initializing shard [foo]
01:18:20,519 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Shard member-1-shard-foo-config55 is initialized
01:18:20,519 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardInformation - Shard member-1-shard-foo-config55 is initialized - notifying 1 OnShardInitialized callbacks
01:18:20,519 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-foo-config55 , received role change from null to Follower
01:18:20,519 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-foo-config55 , registered listener akka://test/user/$C
01:18:20,519 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config55: onCreateShard: CreateShard [moduleShardConfig=ModuleShardConfiguration [namespace=foo-ns, moduleName=foo-module, shardName=foo, shardMemberNames=[MemberName{name=member-1}, MemberName{name=member-5}, MemberName{name=member-6}], shardStrategyName=null], shardPropsCreator=org.opendaylight.controller.cluster.datastore.Shard$Builder@354f7b07]
01:18:20,520 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardManager - shard-manager-config55: Shard foo already exists
01:18:20,520 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - shard-manager-config55: Received role changed for member-1-shard-foo-config55 from null to Follower
01:18:20,520 AM [main] [INFO] ShardManagerTest - testOnCreateShard ending
01:18:20,621 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/$C#-1548034005]
01:18:20,632 AM [test-shard-dispatcher-18] [INFO] Shard - Stopping Shard member-1-shard-foo-config55
01:18:20,632 AM [test-shard-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-foo-config55 (Follower): Closing
01:18:20,632 AM [test-shard-dispatcher-18] [DEBUG] Shard - member-1-shard-foo-config55: Aborting 0 pending queued transactions
01:18:20,632 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config55
01:18:20,633 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config1
01:18:20,633 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config35
01:18:20,633 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config43
01:18:20,634 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config11
01:18:20,634 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config21
01:18:20,634 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardManager - Stopping ShardManager shard-manager-config46
01:18:20,635 AM [test-akka.actor.default-dispatcher-13] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
01:18:20,635 AM [test-akka.actor.default-dispatcher-13] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
01:18:20,638 AM [test-akka.actor.default-dispatcher-13] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[WARN] [02/14/2024 01:18:20.641] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Could not unregister Cluster JMX MBean with name=akka:type=Cluster as it was not found. If you are running multiple clusters in the same JVM, set 'akka.cluster.jmx.multi-mbeans-in-same-jvm = on' in config