[DEBUG] [03/07/2024 15:02:09.142] [main] [EventStream(akka://test)] logger log1-TestEventListener started 03:02:09,143 PM [test-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [03/07/2024 15:02:09.143] [main] [EventStream(akka://test)] logger log2-Slf4jLogger started [DEBUG] [03/07/2024 15:02:09.143] [main] [EventStream(akka://test)] Default Loggers started [INFO] [03/07/2024 15:02:09.160] [main] [ArteryTransport(akka://test)] Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.170.169:25520] with UID [2174120524032504161] 03:02:09,160 PM [test-akka.actor.default-dispatcher-7] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.170.169:25520] with UID [2174120524032504161] 03:02:09,161 PM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.169:25520] - Starting up, Akka version [2.6.21] ... [INFO] [03/07/2024 15:02:09.161] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.169:25520] - Starting up, Akka version [2.6.21] ... [INFO] [03/07/2024 15:02:09.164] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.169:25520] - Registered cluster JMX MBean [akka:type=Cluster] [INFO] [03/07/2024 15:02:09.164] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.169:25520] - Started up successfully 03:02:09,172 PM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.170.169:25520] - Registered cluster JMX MBean [akka:type=Cluster] 03:02:09,172 PM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.170.169:25520] - Started up successfully [INFO] [03/07/2024 15:02:09.174] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.169:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing [INFO] [03/07/2024 15:02:09.174] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.169:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining 03:02:09,174 PM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.169:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing 03:02:09,174 PM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.169:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining 03:02:09,193 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config0, persistent : true [WARN] [03/07/2024 15:02:09.194] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testApplySnapshot]: org.opendaylight.controller.cluster.common.actor.Monitor@30328d01 [INFO] [akkaDeadLetter][03/07/2024 15:02:09.194] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,194 PM [test-akka.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,195 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testApplySnapshot/member-1-shard-inventory-config0-notifier#-2084817656 created and ready for shard:member-1-shard-inventory-config0 [WARN] [03/07/2024 15:02:09.195] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-notifier#-2084817656]: org.opendaylight.controller.cluster.common.actor.Monitor@608ba1fb [INFO] [akkaDeadLetter][03/07/2024 15:02:09.196] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-notifier#-2084817656] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,196 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#-774925012] [WARN] [03/07/2024 15:02:09.200] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#-774925012]: org.opendaylight.controller.cluster.common.actor.Monitor@5f72b823 03:02:09,200 PM [test-akka.actor.default-dispatcher-13] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-notifier#-2084817656] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,207 PM [test-akka.actor.default-dispatcher-7] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#-774925012] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/07/2024 15:02:09.207] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#-774925012] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,214 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config0 with journal batch size 3 03:02:09,218 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config0: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:09,218 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config0: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:09,218 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config0: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,218 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config0: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config0 is no longer the leader 03:02:09,219 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config0 (Follower): Received TimeoutNow - switching to Candidate 03:02:09,219 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config0 (Candidate): Election: Candidate has following voting peers: [] 03:02:09,219 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config0: Set currentTerm=1, votedFor=member-1-shard-inventory-config0 03:02:09,219 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config0 (Candidate): Starting new election term 1 03:02:09,219 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config0 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:09,219 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config0 (Follower): Closing 03:02:09,219 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config0: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,219 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config0: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config0 is no longer the leader 03:02:09,219 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config0 , received role change from null to Follower 03:02:09,220 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config0 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:09.220] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testApplySnapshot]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@6fe51583 [INFO] [akkaDeadLetter][03/07/2024 15:02:09.220] [test-akka.actor.default-dispatcher-6] [akka://test/user] Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,220 PM [test-akka.actor.default-dispatcher-6] [INFO] LocalActorRef - Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,220 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config0 (Candidate): Received ElectionTimeout 03:02:09,221 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config0 (Leader): Election: Leader has following peers: [] 03:02:09,221 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config0 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:09,221 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config0: onLeadershipChange, isLeader: true, hasLeader : true 03:02:09,221 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config0: became leader with frontend state for [] 03:02:09,221 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config0 , received role change from Candidate to Leader 03:02:09,292 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config0: Applying snapshot on follower: Snapshot [lastIndex=1, lastTerm=2, lastAppliedIndex=3, lastAppliedTerm=4, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@151ffa2c, electionTerm=-1, electionVotedFor=null, ServerConfigPayload=null] 03:02:09,292 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - lastSequenceNumber prior to persisting applied snapshot: 1 03:02:09,292 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config0: SaveSnapshotSuccess received for snapshot, sequenceNr: 1 03:02:09,292 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config0: Snapshot success - sequence number: 1 03:02:09,292 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config0: Moving last applied index from -1 to 3 03:02:09,292 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config0: Set currentTerm=-1, votedFor=null 03:02:09,293 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config0: Applying snapshot 03:02:09,294 PM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendMetadata - member-1-shard-inventory-config0: clearing clients {} 03:02:09,297 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config0: Created publisher actor Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-DTCL-publisher#696644430] with name member-1-shard-inventory-config0-DTCL-publisher 03:02:09,298 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config0: state snapshot applied in 4.075 ms 03:02:09,298 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config0: Done applying snapshot 03:02:09,299 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config0: SnapshotComplete received 03:02:09,299 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-DTCL-publisher#696644430] [WARN] [03/07/2024 15:02:09.300] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-DTCL-publisher#696644430]: org.opendaylight.controller.cluster.common.actor.Monitor@2f67f23b [INFO] [akkaDeadLetter][03/07/2024 15:02:09.300] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-DTCL-publisher#696644430] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,300 PM [test-akka.actor.default-dispatcher-15] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-DTCL-publisher#696644430] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,300 PM [test-akka.actor.default-dispatcher-11] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config0: publishChanges: rootPath: / 03:02:09,301 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config0: Elapsed time for generation of change events for member-1-shard-inventory-config0-DTCL-publisher: 196.0 μs 03:02:09,302 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config0: handled a snapshot response 03:02:09,309 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config0: handled a journal response 03:02:09,367 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testApplySnapshot] 03:02:09,379 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config0 03:02:09,380 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config0 (Leader)_slicer-id-19: Closing 03:02:09,380 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config0: Aborting 0 pending queued transactions 03:02:09,384 PM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config1, persistent : true [WARN] [03/07/2024 15:02:09.384] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPersistence1]: org.opendaylight.controller.cluster.common.actor.Monitor@e6bcb98 03:02:09,385 PM [test-akka.actor.default-dispatcher-16] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence1] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/07/2024 15:02:09.385] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence1] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,386 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testPersistence1/member-1-shard-inventory-config1-notifier#-47048860 created and ready for shard:member-1-shard-inventory-config1 [WARN] [03/07/2024 15:02:09.386] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config1-notifier#-47048860]: org.opendaylight.controller.cluster.common.actor.Monitor@2b5cf23b 03:02:09,386 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#593363679] [INFO] [akkaDeadLetter][03/07/2024 15:02:09.386] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config1-notifier#-47048860] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [03/07/2024 15:02:09.387] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#593363679]: org.opendaylight.controller.cluster.common.actor.Monitor@26407bd3 03:02:09,387 PM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config1-notifier#-47048860] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,387 PM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#593363679] to Actor[akka://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/07/2024 15:02:09.387] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#593363679] to Actor[akka://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,387 PM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config1 with journal batch size 3 03:02:09,388 PM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config1, persistent : false [WARN] [03/07/2024 15:02:09.390] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPersistence2]: org.opendaylight.controller.cluster.common.actor.Monitor@51b55dbd [INFO] [akkaDeadLetter][03/07/2024 15:02:09.390] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence2] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,390 PM [test-akka.actor.default-dispatcher-13] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence2] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [03/07/2024 15:02:09.390] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence2/member-1-shard-inventory-config1-notifier#-1272365624]: org.opendaylight.controller.cluster.common.actor.Monitor@472efe74 03:02:09,391 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testPersistence2/member-1-shard-inventory-config1-notifier#-1272365624 created and ready for shard:member-1-shard-inventory-config1 03:02:09,391 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPersistence2/shard-member-1:snapshot-read#1246241705] [WARN] [03/07/2024 15:02:09.391] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence2/shard-member-1:snapshot-read#1246241705]: org.opendaylight.controller.cluster.common.actor.Monitor@39c522ce [INFO] [akkaDeadLetter][03/07/2024 15:02:09.391] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence2/member-1-shard-inventory-config1-notifier#-1272365624] to Actor[akka://test/user/termination-monitor] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,391 PM [test-akka.actor.default-dispatcher-16] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence2/member-1-shard-inventory-config1-notifier#-1272365624] to Actor[akka://test/user/termination-monitor] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:02:09,392 PM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config1 with journal batch size 3 03:02:09,393 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPersistence1] 03:02:09,393 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config1: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:09,393 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config1: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:09,393 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config1: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,393 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config1: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config1 is no longer the leader [WARN] [03/07/2024 15:02:09.393] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testPersistence1]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@6a923cac 03:02:09,394 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config1 (Follower): Received TimeoutNow - switching to Candidate 03:02:09,394 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config1 , received role change from null to Follower 03:02:09,394 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config1 (Candidate): Election: Candidate has following voting peers: [] 03:02:09,394 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config1: Set currentTerm=1, votedFor=member-1-shard-inventory-config1 03:02:09,394 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config1 (Candidate): Starting new election term 1 03:02:09,394 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config1 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:09,394 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageAssembler - member-1-shard-inventory-config1 (Follower): Closing 03:02:09,394 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config1: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,394 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config1: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config1 is no longer the leader 03:02:09,394 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config1 , received role change from Follower to Candidate 03:02:09,401 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config1: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.UpdateElectionTerm from Actor[akka://test/deadLetters] 03:02:09,401 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config1: Set currentTerm=1, votedFor=member-1-shard-inventory-config1 03:02:09,401 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config1: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:09,401 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config1: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:09,401 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config1: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,401 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config1: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config1 is no longer the leader 03:02:09,401 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config1 , received role change from null to Follower 03:02:09,401 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config1 (Follower): Received TimeoutNow - switching to Candidate 03:02:09,402 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config1 (Candidate): Election: Candidate has following voting peers: [] 03:02:09,402 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config1: Set currentTerm=2, votedFor=member-1-shard-inventory-config1 03:02:09,402 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config1 (Candidate): Starting new election term 2 03:02:09,402 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 03:02:09,402 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config1 (Follower): Closing 03:02:09,402 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config1: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,402 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config1: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config1 is no longer the leader 03:02:09,402 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config1 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:09.402] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testPersistence2]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@d4e74b7 03:02:09,403 PM [main] [DEBUG] Shard - member-1-shard-inventory-config1 (Candidate): Received ElectionTimeout 03:02:09,403 PM [main] [DEBUG] Shard - member-1-shard-inventory-config1 (Leader): Election: Leader has following peers: [] 03:02:09,403 PM [main] [INFO] Shard - member-1-shard-inventory-config1 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:09,403 PM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config1: onLeadershipChange, isLeader: true, hasLeader : true 03:02:09,403 PM [main] [DEBUG] Shard - member-1-shard-inventory-config1: became leader with frontend state for [] 03:02:09,404 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Stopping Shard member-1-shard-inventory-config1 03:02:09,404 PM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageSlicer - member-1-shard-inventory-config1 (Leader)_slicer-id-22: Closing [WARN] [03/07/2024 15:02:09.404] [test-akka.actor.default-dispatcher-16] [akka://test/user/testPersistence1/member-1-shard-inventory-config1-notifier] received dead letter from TestActor[akka://test/user/testPersistence1]: LeaderStateChanged [memberId=member-1-shard-inventory-config1, leaderId=member-1-shard-inventory-config1, leaderPayloadVersion=13] 03:02:09,404 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config1: Aborting 0 pending queued transactions [WARN] [03/07/2024 15:02:09.404] [test-akka.actor.default-dispatcher-16] [akka://test/user/testPersistence1/member-1-shard-inventory-config1-notifier] received dead letter from TestActor[akka://test/user/testPersistence1]: RoleChanged [memberId=member-1-shard-inventory-config1, oldRole=Candidate, newRole=Leader] 03:02:09,404 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPersistence2] 03:02:09,404 PM [main] [DEBUG] Shard - member-1-shard-inventory-config1 (Candidate): Received ElectionTimeout 03:02:09,404 PM [main] [DEBUG] Shard - member-1-shard-inventory-config1 (Leader): Election: Leader has following peers: [] 03:02:09,404 PM [main] [INFO] Shard - member-1-shard-inventory-config1 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 03:02:09,405 PM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config1: onLeadershipChange, isLeader: true, hasLeader : true 03:02:09,405 PM [main] [DEBUG] Shard - member-1-shard-inventory-config1: became leader with frontend state for [] 03:02:09,405 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Stopping Shard member-1-shard-inventory-config1 03:02:09,405 PM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageSlicer - member-1-shard-inventory-config1 (Leader)_slicer-id-23: Closing [WARN] [03/07/2024 15:02:09.405] [test-akka.actor.default-dispatcher-16] [akka://test/user/testPersistence2/member-1-shard-inventory-config1-notifier] received dead letter from TestActor[akka://test/user/testPersistence2]: RoleChanged [memberId=member-1-shard-inventory-config1, oldRole=Candidate, newRole=Leader] 03:02:09,405 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config1: Aborting 0 pending queued transactions 03:02:09,409 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$5 - Shard created : member-1-shard-inventory-config2, persistent : true 03:02:09,410 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$5 - Starting recovery for member-1-shard-inventory-config2 with journal batch size 3 [WARN] [03/07/2024 15:02:09.410] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortWithCommitPending]: org.opendaylight.controller.cluster.common.actor.Monitor@3ed54612 03:02:09,411 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testAbortWithCommitPending/member-1-shard-inventory-config2-notifier#1890938647 created and ready for shard:member-1-shard-inventory-config2 03:02:09,411 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortWithCommitPending/shard-member-1:snapshot-read#-1699475947] [WARN] [03/07/2024 15:02:09.411] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config2-notifier#1890938647]: org.opendaylight.controller.cluster.common.actor.Monitor@3902e5eb [WARN] [03/07/2024 15:02:09.411] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/shard-member-1:snapshot-read#-1699475947]: org.opendaylight.controller.cluster.common.actor.Monitor@435437dd 03:02:09,420 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:09,420 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$5 - member-1-shard-inventory-config2: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:09,420 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config2: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,420 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config2 is no longer the leader 03:02:09,420 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2 (Follower): Received TimeoutNow - switching to Candidate 03:02:09,420 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2 (Candidate): Election: Candidate has following voting peers: [] 03:02:09,420 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Set currentTerm=1, votedFor=member-1-shard-inventory-config2 [WARN] [03/07/2024 15:02:09.420] [test-akka.actor.default-dispatcher-11] [akka://test/user] unhandled message from TestActor[akka://test/user/testAbortWithCommitPending]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@33b2d62d 03:02:09,420 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$5 - member-1-shard-inventory-config2 (Candidate): Starting new election term 1 03:02:09,420 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$5 - member-1-shard-inventory-config2 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:09,420 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config2 (Follower): Closing 03:02:09,420 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config2 , received role change from null to Follower 03:02:09,420 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config2: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,420 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config2 is no longer the leader 03:02:09,421 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config2 , received role change from Follower to Candidate 03:02:09,421 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2 (Candidate): Received ElectionTimeout 03:02:09,421 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2 (Leader): Election: Leader has following peers: [] 03:02:09,421 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$5 - member-1-shard-inventory-config2 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:09,421 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config2: onLeadershipChange, isLeader: true, hasLeader : true 03:02:09,421 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: became leader with frontend state for [] 03:02:09,422 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config2 , received role change from Candidate to Leader 03:02:09,519 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:09,529 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:09,529 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:09,531 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-11-0 03:02:09,531 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Readying Tx member-1-ShardTransactionTest-fe-0-txn-11-0 of 1 operations, client version 13 03:02:09,531 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: readying transaction member-1-ShardTransactionTest-fe-0-txn-11-0 03:02:09,531 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: transaction member-1-ShardTransactionTest-fe-0-txn-11-0 ready 03:02:09,534 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-11-0 03:02:09,535 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Validating transaction member-1-ShardTransactionTest-fe-0-txn-11-0 03:02:09,535 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 validated 03:02:09,535 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:09,535 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: canCommit for member-1-ShardTransactionTest-fe-0-txn-11-0: success 03:02:09,535 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Committing transaction member-1-ShardTransactionTest-fe-0-txn-11-0 03:02:09,536 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-11-0 03:02:09,536 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 candidate ready 03:02:09,537 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-11-0: canCommit - candidate rootPath: / 03:02:09,538 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-11-0: canCommit - messages: [] 03:02:09,538 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-11-0: preCommit - successfulFromPrevious: [] 03:02:09,538 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 prepared 03:02:09,538 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:09,538 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-11-0 03:02:09,539 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-11-0 03:02:09,539 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:09,539 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-11-0 03:02:09,539 PM [test-akka.actor.default-dispatcher-6] [WARN] ShardDataTree - member-1-shard-inventory-config2: transaction member-1-ShardTransactionTest-fe-0-txn-11-0 is committing, skipping abort 03:02:09,539 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:09,540 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:09,540 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 submitted to persistence 03:02:09,540 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:09,540 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Moving last applied index from -1 to 0 03:02:09,540 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:09,540 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:09,540 PM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config2: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:09,540 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=18400825} is already disabled 03:02:09,541 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Persisting ApplyJournalEntries with index=0 03:02:09,541 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:09,541 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Moving last applied index from 0 to 1 03:02:09,541 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Applying state for log index 1 data Simple{size=143} 03:02:09,541 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-11-0 03:02:09,541 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-11-0: commit - successfulFromPrevious: [] 03:02:09,541 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 changing state from COMMIT_PENDING to COMMITTED 03:02:09,541 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 committed as 0, sending response to Actor[akka://test/system/testProbe-117#283188809] 03:02:09,542 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config2: Created publisher actor Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config2-DTCL-publisher#-879421919] with name member-1-shard-inventory-config2-DTCL-publisher 03:02:09,542 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: fakeSnapshot purging log to 0 for term 1 03:02:09,542 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config2-DTCL-publisher#-879421919] 03:02:09,542 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config2: publishChanges: rootPath: / 03:02:09,543 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config2: Elapsed time for generation of change events for member-1-shard-inventory-config2-DTCL-publisher: 75.92 μs 03:02:09,543 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Persisting ApplyJournalEntries with index=1 [WARN] [03/07/2024 15:02:09.543] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config2-DTCL-publisher#-879421919]: org.opendaylight.controller.cluster.common.actor.Monitor@3cd554f9 03:02:09,543 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortWithCommitPending] 03:02:09,554 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$5 - Stopping Shard member-1-shard-inventory-config2 03:02:09,554 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config2 (Leader)_slicer-id-25: Closing 03:02:09,554 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Aborting 0 pending queued transactions 03:02:09,557 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config3, persistent : true [WARN] [03/07/2024 15:02:09.558] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.common.actor.Monitor@4deee021 03:02:09,560 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config3 with journal batch size 3 03:02:09,560 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testAbortAfterReady/member-1-shard-inventory-config3-notifier#-1695974954 created and ready for shard:member-1-shard-inventory-config3 03:02:09,560 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-1660216991] [WARN] [03/07/2024 15:02:09.561] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config3-notifier#-1695974954]: org.opendaylight.controller.cluster.common.actor.Monitor@6e9ea161 [WARN] [03/07/2024 15:02:09.561] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-1660216991]: org.opendaylight.controller.cluster.common.actor.Monitor@70d31f95 03:02:09,563 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config3: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:09,563 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config3: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:09,563 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config3: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,563 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config3: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config3 is no longer the leader 03:02:09,564 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config3 (Follower): Received TimeoutNow - switching to Candidate 03:02:09,564 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config3 (Candidate): Election: Candidate has following voting peers: [] 03:02:09,564 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config3: Set currentTerm=1, votedFor=member-1-shard-inventory-config3 [WARN] [03/07/2024 15:02:09.564] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@b2ee2d8 03:02:09,564 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config3 (Candidate): Starting new election term 1 03:02:09,564 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config3 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:09,564 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config3 , received role change from null to Follower 03:02:09,564 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config3 (Follower): Closing 03:02:09,564 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config3: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,564 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config3: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config3 is no longer the leader 03:02:09,564 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config3 , received role change from Follower to Candidate 03:02:09,565 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config3 (Candidate): Received ElectionTimeout 03:02:09,565 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config3 (Leader): Election: Leader has following peers: [] 03:02:09,565 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config3 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:09,565 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config3: onLeadershipChange, isLeader: true, hasLeader : true 03:02:09,565 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config3: became leader with frontend state for [] 03:02:09,565 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config3 , received role change from Candidate to Leader 03:02:09,669 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:09,669 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:09,669 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:09,670 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-12-0 03:02:09,670 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Readying Tx member-1-ShardTransactionTest-fe-0-txn-12-0 of 1 operations, client version 13 03:02:09,670 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: readying transaction member-1-ShardTransactionTest-fe-0-txn-12-0 03:02:09,670 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: transaction member-1-ShardTransactionTest-fe-0-txn-12-0 ready 03:02:09,671 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-12-0 03:02:09,671 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: aborting head of queue member-1-ShardTransactionTest-fe-0-txn-12-0 in state member-1-ShardTransactionTest-fe-0-txn-12-0 03:02:09,671 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-12-0: abort - successfulFromPrevious: [] 03:02:09,671 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-12-0 03:02:09,671 PM [test-akka.actor.default-dispatcher-6] [ERROR] Shard - member-1-shard-inventory-config3: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-12-0 canCommit java.lang.IllegalStateException: member-1-shard-inventory-config3: Cannot canCommit transaction member-1-ShardTransactionTest-fe-0-txn-12-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:282) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:727) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:379) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:09,672 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:09,672 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Moving last applied index from -1 to 0 03:02:09,672 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:09,672 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:09,672 PM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config3: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:09,672 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3183397} is already disabled 03:02:09,673 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Persisting ApplyJournalEntries with index=0 03:02:09,673 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-13-0 03:02:09,673 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Readying Tx member-1-ShardTransactionTest-fe-0-txn-13-0 of 1 operations, client version 13 03:02:09,673 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: readying transaction member-1-ShardTransactionTest-fe-0-txn-13-0 03:02:09,673 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: transaction member-1-ShardTransactionTest-fe-0-txn-13-0 ready 03:02:09,674 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-13-0 03:02:09,674 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: Validating transaction member-1-ShardTransactionTest-fe-0-txn-13-0 03:02:09,674 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: Transaction member-1-ShardTransactionTest-fe-0-txn-13-0 validated 03:02:09,674 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-13-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:09,674 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: canCommit for member-1-ShardTransactionTest-fe-0-txn-13-0: success 03:02:09,674 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterReady] 03:02:09,685 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config3 03:02:09,685 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config3 (Leader)_slicer-id-27: Closing 03:02:09,685 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Aborting 1 pending queued transactions 03:02:09,691 PM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$2$1 - Shard created : member-1-shard-inventory-config4, persistent : true 03:02:09,693 PM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$2$1 - Starting recovery for member-1-shard-inventory-config4 with journal batch size 3 [WARN] [03/07/2024 15:02:09.693] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader]: org.opendaylight.controller.cluster.common.actor.Monitor@7d9c6cb0 03:02:09,694 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testOnBatchedModificationsWhenNotLeader/member-1-shard-inventory-config4-notifier#601071982 created and ready for shard:member-1-shard-inventory-config4 03:02:09,694 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/shard-member-1:snapshot-read#-2092316642] [WARN] [03/07/2024 15:02:09.694] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/member-1-shard-inventory-config4-notifier#601071982]: org.opendaylight.controller.cluster.common.actor.Monitor@415962a0 [WARN] [03/07/2024 15:02:09.694] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/shard-member-1:snapshot-read#-2092316642]: org.opendaylight.controller.cluster.common.actor.Monitor@74dcdfdd 03:02:09,697 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:09,697 PM [test-akka.actor.default-dispatcher-11] [INFO] ShardTest$2$1 - member-1-shard-inventory-config4: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:09,697 PM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config4: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,697 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config4 is no longer the leader 03:02:09,697 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4 (Follower): Received TimeoutNow - switching to Candidate 03:02:09,697 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4 (Candidate): Election: Candidate has following voting peers: [] 03:02:09,697 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: Set currentTerm=1, votedFor=member-1-shard-inventory-config4 03:02:09,697 PM [test-akka.actor.default-dispatcher-11] [INFO] ShardTest$2$1 - member-1-shard-inventory-config4 (Candidate): Starting new election term 1 03:02:09,697 PM [test-akka.actor.default-dispatcher-11] [INFO] ShardTest$2$1 - member-1-shard-inventory-config4 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:09,697 PM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageAssembler - member-1-shard-inventory-config4 (Follower): Closing 03:02:09,697 PM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config4: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,697 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config4 is no longer the leader 03:02:09,698 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config4 , received role change from null to Follower 03:02:09,698 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config4 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:09.699] [test-akka.actor.default-dispatcher-11] [akka://test/user] unhandled message from TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@2b668249 03:02:09,699 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4 (Candidate): Received ElectionTimeout 03:02:09,699 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4 (Leader): Election: Leader has following peers: [] 03:02:09,699 PM [test-akka.actor.default-dispatcher-11] [INFO] ShardTest$2$1 - member-1-shard-inventory-config4 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:09,699 PM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config4: onLeadershipChange, isLeader: true, hasLeader : true 03:02:09,699 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: became leader with frontend state for [] 03:02:09,699 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config4 , received role change from Candidate to Leader 03:02:09,802 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: Forwarding 1 BatchedModifications to leader ActorSelection[Anchor(akka://test/), Path(/system/testProbe-121)] 03:02:09,803 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader] 03:02:09,814 PM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$2$1 - Stopping Shard member-1-shard-inventory-config4 03:02:09,814 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config4 (Leader)_slicer-id-29: Closing 03:02:09,814 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: Aborting 0 pending queued transactions 03:02:09,818 PM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config5, persistent : true [WARN] [03/07/2024 15:02:09.818] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testOnDatastoreContext]: org.opendaylight.controller.cluster.common.actor.Monitor@4f8588e2 03:02:09,819 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testOnDatastoreContext/member-1-shard-inventory-config5-notifier#-452323657 created and ready for shard:member-1-shard-inventory-config5 [WARN] [03/07/2024 15:02:09.820] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnDatastoreContext/member-1-shard-inventory-config5-notifier#-452323657]: org.opendaylight.controller.cluster.common.actor.Monitor@32b5cbac 03:02:09,820 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testOnDatastoreContext/shard-member-1:snapshot-read#-1009307563] [WARN] [03/07/2024 15:02:09.820] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnDatastoreContext/shard-member-1:snapshot-read#-1009307563]: org.opendaylight.controller.cluster.common.actor.Monitor@8ec67f8 03:02:09,820 PM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config5 with journal batch size 3 03:02:09,823 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config5: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:09,823 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config5: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:09,823 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config5: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,823 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config5: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config5 is no longer the leader 03:02:09,824 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config5 (Follower): Received TimeoutNow - switching to Candidate 03:02:09,824 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config5 (Candidate): Election: Candidate has following voting peers: [] 03:02:09,824 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config5: Set currentTerm=1, votedFor=member-1-shard-inventory-config5 03:02:09,824 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config5 (Candidate): Starting new election term 1 03:02:09,824 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config5 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:09,824 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config5 (Follower): Closing 03:02:09,824 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config5: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,824 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config5: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config5 is no longer the leader 03:02:09,824 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config5 , received role change from null to Follower 03:02:09,824 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config5 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:09.825] [test-akka.actor.default-dispatcher-11] [akka://test/user] unhandled message from TestActor[akka://test/user/testOnDatastoreContext]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@7a185c64 03:02:09,972 PM [main] [DEBUG] Shard - member-1-shard-inventory-config5 (Candidate): Received ElectionTimeout 03:02:09,972 PM [main] [DEBUG] Shard - member-1-shard-inventory-config5 (Leader): Election: Leader has following peers: [] 03:02:09,972 PM [main] [INFO] Shard - member-1-shard-inventory-config5 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:09,973 PM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config5: onLeadershipChange, isLeader: true, hasLeader : true 03:02:09,973 PM [main] [DEBUG] Shard - member-1-shard-inventory-config5: became leader with frontend state for [] 03:02:09,973 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config5 , received role change from Candidate to Leader 03:02:09,973 PM [main] [DEBUG] Shard - member-1-shard-inventory-config5: RaftPolicy used with prev.config null, RaftPolicy used with newConfig null [WARN] [03/07/2024 15:02:09.973] [test-akka.actor.default-dispatcher-14] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testOnDatastoreContext]: org.opendaylight.controller.cluster.raft.client.messages.FindLeaderReply@7bd329b7 03:02:09,974 PM [main] [INFO] Shard - member-1-shard-inventory-config5: Persistence has been enabled - capturing snapshot 03:02:09,974 PM [main] [DEBUG] Shard - Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1 03:02:09,974 PM [main] [DEBUG] Shard - member-1-shard-inventory-config5: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 03:02:09,979 PM [main] [INFO] Shard - member-1-shard-inventory-config5: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true] 03:02:09,980 PM [main] [DEBUG] Shard - member-1-shard-inventory-config5: lastSequenceNumber prior to capture: 1 03:02:09,980 PM [main] [DEBUG] Shard - member-1-shard-inventory-config5: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}} 03:02:09,980 PM [main] [DEBUG] Shard - member-1-shard-inventory-config5: RaftPolicy used with prev.config null, RaftPolicy used with newConfig null 03:02:09,980 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testOnDatastoreContext] 03:02:09,981 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config5: CaptureSnapshotReply received by actor 03:02:09,981 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config5: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@b2fcd3, electionTerm=1, electionVotedFor=member-1-shard-inventory-config5, ServerConfigPayload=null] 03:02:09,981 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config5: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1 03:02:09,981 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config5: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 03:02:09,981 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config5: SaveSnapshotSuccess received for snapshot, sequenceNr: 1 03:02:09,981 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config5: Snapshot success - sequence number: 1 03:02:09,982 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config5: SnapshotComplete received 03:02:09,982 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config5: handled a snapshot response 03:02:09,982 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-17] [DEBUG] Shard - member-1-shard-inventory-config5: handled a journal response 03:02:09,991 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config5 03:02:09,991 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config5 (Leader)_slicer-id-31: Closing 03:02:09,991 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config5: Aborting 0 pending queued transactions 03:02:09,996 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config6, persistent : true [WARN] [03/07/2024 15:02:09.996] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCanCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@39aeec7b 03:02:09,997 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config6 with journal batch size 3 03:02:09,998 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testCanCommitPhaseFailure/member-1-shard-inventory-config6-notifier#1536354156 created and ready for shard:member-1-shard-inventory-config6 03:02:09,998 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCanCommitPhaseFailure/shard-member-1:snapshot-read#1917738427] [WARN] [03/07/2024 15:02:09.998] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitPhaseFailure/member-1-shard-inventory-config6-notifier#1536354156]: org.opendaylight.controller.cluster.common.actor.Monitor@2e55206e [WARN] [03/07/2024 15:02:09.998] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitPhaseFailure/shard-member-1:snapshot-read#1917738427]: org.opendaylight.controller.cluster.common.actor.Monitor@36c95115 03:02:09,999 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:09,999 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config6: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:09,999 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: false, hasLeader : false 03:02:09,999 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config6 is no longer the leader 03:02:10,0 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6 (Follower): Received TimeoutNow - switching to Candidate 03:02:10,0 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6 (Candidate): Election: Candidate has following voting peers: [] 03:02:10,0 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6: Set currentTerm=1, votedFor=member-1-shard-inventory-config6 03:02:10,0 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config6 (Candidate): Starting new election term 1 03:02:10,0 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config6 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:10,0 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config6 (Follower): Closing 03:02:10,0 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,0 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config6 is no longer the leader 03:02:10,0 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from null to Follower 03:02:10,0 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from Follower to Candidate 03:02:10,1 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6 (Candidate): Received ElectionTimeout 03:02:10,1 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6 (Leader): Election: Leader has following peers: [] 03:02:10,1 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config6 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:10,1 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: true, hasLeader : true 03:02:10,1 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6: became leader with frontend state for [] 03:02:10,1 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from Candidate to Leader [WARN] [03/07/2024 15:02:10.001] [test-akka.actor.default-dispatcher-11] [akka://test/user] unhandled message from TestActor[akka://test/user/testCanCommitPhaseFailure]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@61d215b 03:02:10,110 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:10,110 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,110 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,111 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-15-0 03:02:10,111 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: Readying Tx member-1-ShardTransactionTest-fe-0-txn-15-0 of 1 operations, client version 13 03:02:10,111 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: readying transaction member-1-ShardTransactionTest-fe-0-txn-15-0 03:02:10,111 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: transaction member-1-ShardTransactionTest-fe-0-txn-15-0 ready 03:02:10,112 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-15-0 03:02:10,112 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: Validating transaction member-1-ShardTransactionTest-fe-0-txn-15-0 03:02:10,112 PM [test-akka.actor.default-dispatcher-12] [WARN] ShardDataTree - member-1-shard-inventory-config6: Store Tx member-1-ShardTransactionTest-fe-0-txn-15-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:986) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:112) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:242) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:291) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:727) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:379) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:10,113 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: Store Tx member-1-ShardTransactionTest-fe-0-txn-15-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 03:02:10,117 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-15-0 changing state from CAN_COMMIT_PENDING to FAILED 03:02:10,117 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-15-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:855) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:986) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:112) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:242) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:291) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:727) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:379) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) ... 34 more 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: Moving last applied index from -1 to 0 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config6: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=15965455} is already disabled 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-16-0 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: Readying Tx member-1-ShardTransactionTest-fe-0-txn-16-0 of 1 operations, client version 13 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: readying transaction member-1-ShardTransactionTest-fe-0-txn-16-0 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: transaction member-1-ShardTransactionTest-fe-0-txn-16-0 ready 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: Persisting ApplyJournalEntries with index=0 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-16-0 03:02:10,126 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: Validating transaction member-1-ShardTransactionTest-fe-0-txn-16-0 03:02:10,127 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: Transaction member-1-ShardTransactionTest-fe-0-txn-16-0 validated 03:02:10,127 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-16-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:10,127 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: canCommit for member-1-ShardTransactionTest-fe-0-txn-16-0: success 03:02:10,127 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCanCommitPhaseFailure] 03:02:10,138 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config6 03:02:10,138 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config6 (Leader)_slicer-id-33: Closing 03:02:10,138 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6: Aborting 1 pending queued transactions 03:02:10,140 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config7, persistent : true [WARN] [03/07/2024 15:02:10.140] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterCanCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@19f68f1b 03:02:10,141 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testAbortAfterCanCommit/member-1-shard-inventory-config7-notifier#106760580 created and ready for shard:member-1-shard-inventory-config7 03:02:10,141 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config7 with journal batch size 3 [WARN] [03/07/2024 15:02:10.141] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterCanCommit/member-1-shard-inventory-config7-notifier#106760580]: org.opendaylight.controller.cluster.common.actor.Monitor@1ef29e81 03:02:10,141 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterCanCommit/shard-member-1:snapshot-read#943572360] [WARN] [03/07/2024 15:02:10.142] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterCanCommit/shard-member-1:snapshot-read#943572360]: org.opendaylight.controller.cluster.common.actor.Monitor@566add12 03:02:10,143 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config7: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:10,143 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config7: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:10,143 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config7: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,143 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config7: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config7 is no longer the leader 03:02:10,143 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config7 , received role change from null to Follower 03:02:10,143 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config7 (Follower): Received TimeoutNow - switching to Candidate 03:02:10,143 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config7 (Candidate): Election: Candidate has following voting peers: [] 03:02:10,143 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config7: Set currentTerm=1, votedFor=member-1-shard-inventory-config7 03:02:10,143 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config7 (Candidate): Starting new election term 1 03:02:10,143 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config7 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:10,143 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config7 (Follower): Closing 03:02:10,143 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config7: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,143 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config7: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config7 is no longer the leader 03:02:10,143 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config7 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:10.144] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from TestActor[akka://test/user/testAbortAfterCanCommit]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@106ddfd 03:02:10,145 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config7 (Candidate): Received ElectionTimeout 03:02:10,145 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config7 (Leader): Election: Leader has following peers: [] 03:02:10,145 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config7 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:10,145 PM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config7: onLeadershipChange, isLeader: true, hasLeader : true 03:02:10,145 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config7: became leader with frontend state for [] 03:02:10,145 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config7 , received role change from Candidate to Leader 03:02:10,205 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:10,205 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,205 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,205 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-17-0 03:02:10,205 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Readying Tx member-1-ShardTransactionTest-fe-0-txn-17-0 of 1 operations, client version 13 03:02:10,205 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: readying transaction member-1-ShardTransactionTest-fe-0-txn-17-0 03:02:10,206 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: transaction member-1-ShardTransactionTest-fe-0-txn-17-0 ready 03:02:10,207 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-18-0 03:02:10,207 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: Readying Tx member-1-ShardTransactionTest-fe-0-txn-18-0 of 1 operations, client version 13 03:02:10,207 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: readying transaction member-1-ShardTransactionTest-fe-0-txn-18-0 03:02:10,207 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: transaction member-1-ShardTransactionTest-fe-0-txn-18-0 ready 03:02:10,208 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,208 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: Moving last applied index from -1 to 0 03:02:10,208 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:10,208 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:10,208 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config7: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:10,208 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3053615} is already disabled 03:02:10,208 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-17-0 03:02:10,208 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Validating transaction member-1-ShardTransactionTest-fe-0-txn-17-0 03:02:10,208 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-17-0 validated 03:02:10,208 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-17-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:10,208 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: canCommit for member-1-ShardTransactionTest-fe-0-txn-17-0: success 03:02:10,208 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: Persisting ApplyJournalEntries with index=0 03:02:10,209 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-18-0 03:02:10,210 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Tx member-1-ShardTransactionTest-fe-0-txn-18-0 is scheduled for canCommit step 03:02:10,210 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-17-0 03:02:10,210 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: aborting head of queue member-1-ShardTransactionTest-fe-0-txn-17-0 in state member-1-ShardTransactionTest-fe-0-txn-17-0 03:02:10,210 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Validating transaction member-1-ShardTransactionTest-fe-0-txn-18-0 03:02:10,210 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-18-0 validated 03:02:10,210 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-18-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:10,210 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: canCommit for member-1-ShardTransactionTest-fe-0-txn-18-0: success 03:02:10,210 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-17-0: abort - successfulFromPrevious: [] 03:02:10,210 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterCanCommit] 03:02:10,221 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config7 03:02:10,221 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config7 (Leader)_slicer-id-35: Closing 03:02:10,221 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config7: Aborting 1 pending queued transactions [WARN] [03/07/2024 15:02:10.222] [test-akka.actor.default-dispatcher-11] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testAbortAfterCanCommit]: Failure(java.lang.RuntimeException: Transaction aborted due to shutdown.) 03:02:10,224 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config8, persistent : true [WARN] [03/07/2024 15:02:10.224] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testConcurrentThreePhaseCommits]: org.opendaylight.controller.cluster.common.actor.Monitor@37bfc87 03:02:10,225 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config8-notifier#-1263391555 created and ready for shard:member-1-shard-inventory-config8 [WARN] [03/07/2024 15:02:10.225] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config8-notifier#-1263391555]: org.opendaylight.controller.cluster.common.actor.Monitor@16b9d857 03:02:10,225 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testConcurrentThreePhaseCommits/shard-member-1:snapshot-read#-275494649] 03:02:10,226 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config8 with journal batch size 3 [WARN] [03/07/2024 15:02:10.226] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/shard-member-1:snapshot-read#-275494649]: org.opendaylight.controller.cluster.common.actor.Monitor@6c8d04dd 03:02:10,228 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:10,228 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config8: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:10,229 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config8: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,229 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config8 is no longer the leader 03:02:10,229 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config8 , received role change from null to Follower 03:02:10,229 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8 (Follower): Received TimeoutNow - switching to Candidate 03:02:10,229 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8 (Candidate): Election: Candidate has following voting peers: [] 03:02:10,229 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Set currentTerm=1, votedFor=member-1-shard-inventory-config8 03:02:10,229 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config8 (Candidate): Starting new election term 1 03:02:10,229 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config8 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:10,229 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config8 (Follower): Closing 03:02:10,229 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config8: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,229 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config8 is no longer the leader 03:02:10,229 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config8 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:10.229] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testConcurrentThreePhaseCommits]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@31c60938 03:02:10,230 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8 (Candidate): Received ElectionTimeout 03:02:10,230 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8 (Leader): Election: Leader has following peers: [] 03:02:10,230 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config8 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:10,230 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config8: onLeadershipChange, isLeader: true, hasLeader : true 03:02:10,230 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: became leader with frontend state for [] 03:02:10,230 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config8 , received role change from Candidate to Leader 03:02:10,337 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:10,337 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,337 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,337 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-19-0 03:02:10,338 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Readying Tx member-1-ShardTransactionTest-fe-0-txn-19-0 of 1 operations, client version 13 03:02:10,338 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: readying transaction member-1-ShardTransactionTest-fe-0-txn-19-0 03:02:10,338 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: transaction member-1-ShardTransactionTest-fe-0-txn-19-0 ready 03:02:10,339 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,339 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Moving last applied index from -1 to 0 03:02:10,339 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:10,339 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:10,339 PM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config8: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:10,339 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2494771} is already disabled 03:02:10,340 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Persisting ApplyJournalEntries with index=0 03:02:10,343 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-19-0 03:02:10,413 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Validating transaction member-1-ShardTransactionTest-fe-0-txn-19-0 03:02:10,413 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-19-0 validated 03:02:10,413 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-19-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:10,414 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: canCommit for member-1-ShardTransactionTest-fe-0-txn-19-0: success 03:02:10,414 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-20-0 03:02:10,414 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Readying Tx member-1-ShardTransactionTest-fe-0-txn-20-0 of 1 operations, client version 13 03:02:10,414 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: readying transaction member-1-ShardTransactionTest-fe-0-txn-20-0 03:02:10,414 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: transaction member-1-ShardTransactionTest-fe-0-txn-20-0 ready 03:02:10,414 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-21-0 03:02:10,415 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Readying Tx member-1-ShardTransactionTest-fe-0-txn-21-0 of 1 operations, client version 13 03:02:10,415 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: readying transaction member-1-ShardTransactionTest-fe-0-txn-21-0 03:02:10,415 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: transaction member-1-ShardTransactionTest-fe-0-txn-21-0 ready 03:02:10,415 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-20-0 03:02:10,415 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Tx member-1-ShardTransactionTest-fe-0-txn-20-0 is scheduled for canCommit step 03:02:10,415 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-21-0 03:02:10,415 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Tx member-1-ShardTransactionTest-fe-0-txn-21-0 is scheduled for canCommit step 03:02:10,415 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Committing transaction member-1-ShardTransactionTest-fe-0-txn-19-0 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-19-0 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-19-0 candidate ready 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-19-0: canCommit - candidate rootPath: / 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-19-0: canCommit - messages: [] 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-19-0: preCommit - successfulFromPrevious: [] 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-19-0 prepared 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-19-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-19-0 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-19-0 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Validating transaction member-1-ShardTransactionTest-fe-0-txn-20-0 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 validated 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: canCommit for member-1-ShardTransactionTest-fe-0-txn-20-0: success 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:10,416 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-19-0 submitted to persistence 03:02:10,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:10,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Moving last applied index from 0 to 1 03:02:10,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Applying state for log index 1 data Simple{size=143} 03:02:10,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-19-0 03:02:10,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-19-0: commit - successfulFromPrevious: [] 03:02:10,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-19-0 changing state from COMMIT_PENDING to COMMITTED 03:02:10,417 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-19-0 committed as 0, sending response to Actor[akka://test/system/testProbe-128#-1919807292] 03:02:10,418 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config8: Created publisher actor Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config8-DTCL-publisher#-1384649795] with name member-1-shard-inventory-config8-DTCL-publisher 03:02:10,418 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: fakeSnapshot purging log to 0 for term 1 03:02:10,418 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Persisting ApplyJournalEntries with index=1 03:02:10,418 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config8-DTCL-publisher#-1384649795] 03:02:10,418 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config8: publishChanges: rootPath: / [WARN] [03/07/2024 15:02:10.418] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config8-DTCL-publisher#-1384649795]: org.opendaylight.controller.cluster.common.actor.Monitor@2118bf0e 03:02:10,418 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config8: Elapsed time for generation of change events for member-1-shard-inventory-config8-DTCL-publisher: 76.17 μs 03:02:10,420 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Committing transaction member-1-ShardTransactionTest-fe-0-txn-20-0 03:02:10,421 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-20-0 03:02:10,424 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 candidate ready 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-20-0: canCommit - candidate rootPath: / 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-20-0: canCommit - messages: [] 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-20-0: preCommit - successfulFromPrevious: [] 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 prepared 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-20-0 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-20-0 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Validating transaction member-1-ShardTransactionTest-fe-0-txn-21-0 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 validated 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: canCommit for member-1-ShardTransactionTest-fe-0-txn-21-0: success 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config8: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 03:02:10,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 submitted to persistence 03:02:10,426 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Committing transaction member-1-ShardTransactionTest-fe-0-txn-21-0 03:02:10,426 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-21-0 03:02:10,427 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 candidate ready 03:02:10,427 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-21-0: canCommit - candidate rootPath: / 03:02:10,427 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-21-0: canCommit - messages: [] 03:02:10,427 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-21-0: preCommit - successfulFromPrevious: [] 03:02:10,427 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 prepared 03:02:10,427 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:10,427 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-21-0 03:02:10,427 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-21-0 03:02:10,428 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:10,428 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Persist data SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 03:02:10,428 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 03:02:10,428 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 submitted to persistence 03:02:10,428 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 03:02:10,428 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Moving last applied index from 1 to 2 03:02:10,428 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Applying state for log index 2 data Simple{size=45} 03:02:10,428 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-20-0 03:02:10,428 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-20-0: commit - successfulFromPrevious: [] 03:02:10,428 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 changing state from COMMIT_PENDING to COMMITTED 03:02:10,428 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 committed as 0, sending response to Actor[akka://test/temp/testConcurrentThreePhaseCommits$a] 03:02:10,429 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config8: publishChanges: rootPath: / 03:02:10,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: fakeSnapshot purging log to 1 for term 1 03:02:10,429 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config8: Elapsed time for generation of change events for member-1-shard-inventory-config8-DTCL-publisher: 45.81 μs 03:02:10,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Persisting ApplyJournalEntries with index=2 03:02:10,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: persist complete SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 03:02:10,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Moving last applied index from 2 to 3 03:02:10,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Applying state for log index 3 data Simple{size=184} 03:02:10,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-21-0 03:02:10,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-21-0: commit - successfulFromPrevious: [] 03:02:10,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 changing state from COMMIT_PENDING to COMMITTED 03:02:10,429 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 committed as 0, sending response to Actor[akka://test/temp/testConcurrentThreePhaseCommits$b] 03:02:10,431 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config8: publishChanges: rootPath: / 03:02:10,431 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config8: Elapsed time for generation of change events for member-1-shard-inventory-config8-DTCL-publisher: 106.6 μs 03:02:10,432 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: fakeSnapshot purging log to 2 for term 1 03:02:10,432 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Persisting ApplyJournalEntries with index=3 03:02:10,434 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testConcurrentThreePhaseCommits] 03:02:10,446 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config8 03:02:10,446 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config8 (Leader)_slicer-id-37: Closing 03:02:10,446 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Aborting 0 pending queued transactions 03:02:10,449 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config9, persistent : true [WARN] [03/07/2024 15:02:10.449] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true]: org.opendaylight.controller.cluster.common.actor.Monitor@3d9fe13e 03:02:10,451 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config9-notifier#1033732304 created and ready for shard:member-1-shard-inventory-config9 [WARN] [03/07/2024 15:02:10.451] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config9-notifier#1033732304]: org.opendaylight.controller.cluster.common.actor.Monitor@59e26a00 03:02:10,451 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/shard-member-1:snapshot-read#-1588607882] 03:02:10,452 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config9 with journal batch size 3 [WARN] [03/07/2024 15:02:10.452] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/shard-member-1:snapshot-read#-1588607882]: org.opendaylight.controller.cluster.common.actor.Monitor@7f8bb7ae 03:02:10,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:10,454 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config9: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:10,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config9: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config9 is no longer the leader 03:02:10,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config9 (Follower): Received TimeoutNow - switching to Candidate 03:02:10,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config9 (Candidate): Election: Candidate has following voting peers: [] 03:02:10,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config9: Set currentTerm=1, votedFor=member-1-shard-inventory-config9 03:02:10,454 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config9 (Candidate): Starting new election term 1 03:02:10,454 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config9 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:10,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config9 (Follower): Closing 03:02:10,455 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,455 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config9: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config9 is no longer the leader 03:02:10,455 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from null to Follower 03:02:10,455 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:10.455] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@5c0b1ad1 03:02:10,456 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9 (Candidate): Received ElectionTimeout 03:02:10,456 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9 (Leader): Election: Leader has following peers: [] 03:02:10,456 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config9 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:10,456 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: true, hasLeader : true 03:02:10,456 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: became leader with frontend state for [] 03:02:10,456 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from Candidate to Leader 03:02:10,517 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config9: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-22-0 03:02:10,518 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config9: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:10,518 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config9: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,518 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config9: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,518 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config9: Readying transaction member-1-ShardTransactionTest-fe-0-txn-22-0, client version 13 03:02:10,518 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: readying transaction member-1-ShardTransactionTest-fe-0-txn-22-0 03:02:10,518 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: transaction member-1-ShardTransactionTest-fe-0-txn-22-0 ready 03:02:10,518 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Validating transaction member-1-ShardTransactionTest-fe-0-txn-22-0 03:02:10,519 PM [test-akka.actor.default-dispatcher-13] [WARN] ShardDataTree - member-1-shard-inventory-config9: Store Tx member-1-ShardTransactionTest-fe-0-txn-22-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:986) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:112) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:242) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleForwardedReadyTransaction(ShardCommitCoordinator.java:116) at org.opendaylight.controller.cluster.datastore.Shard.handleForwardedReadyTransaction(Shard.java:842) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:375) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:10,519 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Store Tx member-1-ShardTransactionTest-fe-0-txn-22-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 03:02:10,519 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-22-0 changing state from CAN_COMMIT_PENDING to FAILED 03:02:10,519 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config9: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-22-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:855) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:986) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:112) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:242) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleForwardedReadyTransaction(ShardCommitCoordinator.java:116) at org.opendaylight.controller.cluster.datastore.Shard.handleForwardedReadyTransaction(Shard.java:842) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:375) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) ... 34 more 03:02:10,521 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-23-0 03:02:10,521 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Readying transaction member-1-ShardTransactionTest-fe-0-txn-23-0, client version 13 03:02:10,521 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: readying transaction member-1-ShardTransactionTest-fe-0-txn-23-0 03:02:10,521 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: transaction member-1-ShardTransactionTest-fe-0-txn-23-0 ready 03:02:10,521 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Validating transaction member-1-ShardTransactionTest-fe-0-txn-23-0 03:02:10,521 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 validated 03:02:10,521 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:10,521 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: canCommit for member-1-ShardTransactionTest-fe-0-txn-23-0: success 03:02:10,521 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Committing transaction member-1-ShardTransactionTest-fe-0-txn-23-0 03:02:10,521 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-23-0 03:02:10,522 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 candidate ready 03:02:10,522 PM [test-akka.actor.default-dispatcher-11] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-23-0: canCommit - candidate rootPath: / 03:02:10,522 PM [test-akka.actor.default-dispatcher-11] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-23-0: canCommit - messages: [] 03:02:10,522 PM [test-akka.actor.default-dispatcher-11] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-23-0: preCommit - successfulFromPrevious: [] 03:02:10,522 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 prepared 03:02:10,522 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:10,522 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-23-0 03:02:10,522 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-23-0 03:02:10,522 PM [test-akka.actor.default-dispatcher-11] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:10,522 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:10,522 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:10,522 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 submitted to persistence 03:02:10,523 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,523 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Moving last applied index from -1 to 0 03:02:10,523 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:10,523 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:10,523 PM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendMetadata - member-1-shard-inventory-config9: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:10,523 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=5155515} is already disabled 03:02:10,523 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Persisting ApplyJournalEntries with index=0 03:02:10,523 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config9: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:10,524 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config9: Moving last applied index from 0 to 1 03:02:10,524 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config9: Applying state for log index 1 data Simple{size=143} 03:02:10,524 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-23-0 03:02:10,524 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-23-0: commit - successfulFromPrevious: [] 03:02:10,524 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 changing state from COMMIT_PENDING to COMMITTED 03:02:10,524 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 committed as 0, sending response to Actor[akka://test/system/testProbe-130#1899112208] 03:02:10,524 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config9: Created publisher actor Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config9-DTCL-publisher#-1843497804] with name member-1-shard-inventory-config9-DTCL-publisher 03:02:10,525 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config9-DTCL-publisher#-1843497804] 03:02:10,525 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config9: fakeSnapshot purging log to 0 for term 1 03:02:10,525 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config9: Persisting ApplyJournalEntries with index=1 03:02:10,525 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config9: publishChanges: rootPath: / [WARN] [03/07/2024 15:02:10.525] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config9-DTCL-publisher#-1843497804]: org.opendaylight.controller.cluster.common.actor.Monitor@38b1e1a5 03:02:10,526 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config9: Elapsed time for generation of change events for member-1-shard-inventory-config9-DTCL-publisher: 259.3 μs 03:02:10,528 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config9, persistent : true [WARN] [03/07/2024 15:02:10.528] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false]: org.opendaylight.controller.cluster.common.actor.Monitor@62c233b9 03:02:10,529 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config9-notifier#-1492789524 created and ready for shard:member-1-shard-inventory-config9 [WARN] [03/07/2024 15:02:10.530] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config9-notifier#-1492789524]: org.opendaylight.controller.cluster.common.actor.Monitor@26fcb74f 03:02:10,530 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/shard-member-1:snapshot-read#916620147] [WARN] [03/07/2024 15:02:10.530] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/shard-member-1:snapshot-read#916620147]: org.opendaylight.controller.cluster.common.actor.Monitor@2859ae6c 03:02:10,530 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config9 with journal batch size 3 03:02:10,533 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.UpdateElectionTerm from Actor[akka://test/deadLetters] 03:02:10,533 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Set currentTerm=1, votedFor=member-1-shard-inventory-config9 03:02:10,533 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:10,533 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Received ReplicatedLogEntry for recovery: index: 0, size: 37 03:02:10,533 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:10,533 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Received ReplicatedLogEntry for recovery: index: 1, size: 143 03:02:10,534 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 03:02:10,534 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Received apply journal entries for recovery, applying to state: 0 to 0 03:02:10,534 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: starting log recovery batch with max size 3 03:02:10,534 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: ignoring unhandled payload DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:10,534 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Moving last applied index from -1 to 0 03:02:10,534 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 03:02:10,534 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Received apply journal entries for recovery, applying to state: 1 to 1 03:02:10,539 PM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendMetadata - member-1-shard-inventory-config9: Added client Enabled{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@3c2fdc21}, purged=MutableUnsignedLongSet{size=0}} 03:02:10,539 PM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config9: Committed transaction member-1-ShardTransactionTest-fe-0-txn-23-0 03:02:10,539 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Moving last applied index from 0 to 1 03:02:10,540 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:10,540 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config9: Recovery completed in 6.025 ms - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 2 03:02:10,540 PM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,540 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config9 is no longer the leader 03:02:10,540 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from null to Follower [WARN] [03/07/2024 15:02:10.540] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@71842027 03:02:10,541 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9 (Follower): Received TimeoutNow - switching to Candidate 03:02:10,541 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9 (Candidate): Election: Candidate has following voting peers: [] 03:02:10,541 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Set currentTerm=2, votedFor=member-1-shard-inventory-config9 03:02:10,541 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config9 (Candidate): Starting new election term 2 03:02:10,541 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config9 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 03:02:10,541 PM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageAssembler - member-1-shard-inventory-config9 (Follower): Closing 03:02:10,541 PM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,541 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config9 is no longer the leader 03:02:10,541 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from Follower to Candidate 03:02:10,542 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config9 (Candidate): Received ElectionTimeout 03:02:10,542 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config9 (Leader): Election: Leader has following peers: [] 03:02:10,542 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config9 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 03:02:10,542 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: true, hasLeader : true 03:02:10,547 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config9: became leader with frontend state for [member-1-frontend-ShardTransactionTest] 03:02:10,547 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from Candidate to Leader 03:02:10,603 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:10,603 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Persist data SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,603 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,603 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-24-0 03:02:10,603 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Readying Tx member-1-ShardTransactionTest-fe-0-txn-24-0 of 1 operations, client version 13 03:02:10,603 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: readying transaction member-1-ShardTransactionTest-fe-0-txn-24-0 03:02:10,604 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: transaction member-1-ShardTransactionTest-fe-0-txn-24-0 ready 03:02:10,604 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Validating transaction member-1-ShardTransactionTest-fe-0-txn-24-0 03:02:10,604 PM [test-akka.actor.default-dispatcher-11] [WARN] ShardDataTree - member-1-shard-inventory-config9: Store Tx member-1-ShardTransactionTest-fe-0-txn-24-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:986) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:112) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:242) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:173) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:745) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:768) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:373) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:10,604 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Store Tx member-1-ShardTransactionTest-fe-0-txn-24-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 03:02:10,604 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-24-0 changing state from CAN_COMMIT_PENDING to FAILED 03:02:10,604 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-24-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:855) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:986) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:112) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:242) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:173) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:745) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:768) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:373) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) ... 35 more 03:02:10,605 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-25-0 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Readying Tx member-1-ShardTransactionTest-fe-0-txn-25-0 of 1 operations, client version 13 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: readying transaction member-1-ShardTransactionTest-fe-0-txn-25-0 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: transaction member-1-ShardTransactionTest-fe-0-txn-25-0 ready 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Validating transaction member-1-ShardTransactionTest-fe-0-txn-25-0 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 validated 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: canCommit for member-1-ShardTransactionTest-fe-0-txn-25-0: success 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Committing transaction member-1-ShardTransactionTest-fe-0-txn-25-0 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-25-0 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 candidate ready 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-25-0: canCommit - candidate rootPath: / 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-25-0: canCommit - messages: [] 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-25-0: preCommit - successfulFromPrevious: [] 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 prepared 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-25-0 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-25-0 03:02:10,606 PM [test-akka.actor.default-dispatcher-11] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:10,607 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Persist data SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 03:02:10,607 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 03:02:10,607 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 submitted to persistence 03:02:10,607 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: persist complete SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,607 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Moving last applied index from 1 to 2 03:02:10,607 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Applying state for log index 2 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:10,607 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:10,607 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=4338314} is already disabled 03:02:10,607 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: fakeSnapshot purging log to 1 for term 2 03:02:10,607 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config9: Persisting ApplyJournalEntries with index=2 03:02:10,608 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: persist complete SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 03:02:10,608 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: Moving last applied index from 2 to 3 03:02:10,608 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: Applying state for log index 3 data Simple{size=143} 03:02:10,608 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-25-0 03:02:10,608 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-25-0: commit - successfulFromPrevious: [] 03:02:10,608 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 changing state from COMMIT_PENDING to COMMITTED 03:02:10,608 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 committed as 0, sending response to Actor[akka://test/system/testProbe-131#517874790] 03:02:10,609 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config9: Created publisher actor Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config9-DTCL-publisher#-337363803] with name member-1-shard-inventory-config9-DTCL-publisher 03:02:10,609 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: fakeSnapshot purging log to 2 for term 2 03:02:10,609 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: Persisting ApplyJournalEntries with index=3 03:02:10,609 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config9-DTCL-publisher#-337363803] 03:02:10,609 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config9: publishChanges: rootPath: / [WARN] [03/07/2024 15:02:10.609] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config9-DTCL-publisher#-337363803]: org.opendaylight.controller.cluster.common.actor.Monitor@477552ef 03:02:10,610 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config9: Elapsed time for generation of change events for member-1-shard-inventory-config9-DTCL-publisher: 129.7 μs 03:02:10,610 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true] 03:02:10,621 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config9 03:02:10,621 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config9 (Leader)_slicer-id-39: Closing 03:02:10,621 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config9: Aborting 0 pending queued transactions 03:02:10,621 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false] 03:02:10,621 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config9 03:02:10,621 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config9 (Leader)_slicer-id-41: Closing 03:02:10,621 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config9: Aborting 0 pending queued transactions 03:02:10,624 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config10, persistent : true [WARN] [03/07/2024 15:02:10.624] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@5d34705 03:02:10,625 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testCommitPhaseFailure/member-1-shard-inventory-config10-notifier#1304093323 created and ready for shard:member-1-shard-inventory-config10 [WARN] [03/07/2024 15:02:10.625] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitPhaseFailure/member-1-shard-inventory-config10-notifier#1304093323]: org.opendaylight.controller.cluster.common.actor.Monitor@5e18bed6 03:02:10,625 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitPhaseFailure/shard-member-1:snapshot-read#1621389880] 03:02:10,626 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config10 with journal batch size 3 [WARN] [03/07/2024 15:02:10.626] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitPhaseFailure/shard-member-1:snapshot-read#1621389880]: org.opendaylight.controller.cluster.common.actor.Monitor@6ccee6a6 03:02:10,627 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:10,627 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config10: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:10,627 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,627 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config10 is no longer the leader 03:02:10,628 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10 (Follower): Received TimeoutNow - switching to Candidate 03:02:10,628 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10 (Candidate): Election: Candidate has following voting peers: [] 03:02:10,628 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Set currentTerm=1, votedFor=member-1-shard-inventory-config10 03:02:10,628 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config10 (Candidate): Starting new election term 1 03:02:10,628 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config10 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:10,628 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config10 (Follower): Closing 03:02:10,628 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,628 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config10 is no longer the leader 03:02:10,628 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from null to Follower 03:02:10,628 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:10.628] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from TestActor[akka://test/user/testCommitPhaseFailure]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@483c1348 03:02:10,629 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config10 (Candidate): Received ElectionTimeout 03:02:10,629 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config10 (Leader): Election: Leader has following peers: [] 03:02:10,629 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config10 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:10,629 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: true, hasLeader : true 03:02:10,629 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config10: became leader with frontend state for [] 03:02:10,629 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from Candidate to Leader 03:02:10,736 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:10,736 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,736 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,736 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-26-0 03:02:10,737 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Readying Tx member-1-ShardTransactionTest-fe-0-txn-26-0 of 1 operations, client version 13 03:02:10,737 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: readying transaction member-1-ShardTransactionTest-fe-0-txn-26-0 03:02:10,737 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: transaction member-1-ShardTransactionTest-fe-0-txn-26-0 ready 03:02:10,738 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-27-0 03:02:10,738 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: Readying Tx member-1-ShardTransactionTest-fe-0-txn-27-0 of 1 operations, client version 13 03:02:10,738 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: readying transaction member-1-ShardTransactionTest-fe-0-txn-27-0 03:02:10,738 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: transaction member-1-ShardTransactionTest-fe-0-txn-27-0 ready 03:02:10,739 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,739 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: Moving last applied index from -1 to 0 03:02:10,739 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:10,739 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:10,739 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config10: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:10,739 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3139395} is already disabled 03:02:10,739 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: Persisting ApplyJournalEntries with index=0 03:02:10,740 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-26-0 03:02:10,740 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Validating transaction member-1-ShardTransactionTest-fe-0-txn-26-0 03:02:10,740 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Transaction member-1-ShardTransactionTest-fe-0-txn-26-0 validated 03:02:10,740 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-26-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:10,740 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: canCommit for member-1-ShardTransactionTest-fe-0-txn-26-0: success 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-27-0 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Tx member-1-ShardTransactionTest-fe-0-txn-27-0 is scheduled for canCommit step 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: Committing transaction member-1-ShardTransactionTest-fe-0-txn-26-0 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-26-0 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Transaction member-1-ShardTransactionTest-fe-0-txn-26-0 candidate ready 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-26-0: canCommit - candidate rootPath: / 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-26-0: canCommit - messages: [] 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-26-0: preCommit - successfulFromPrevious: [] 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Transaction member-1-ShardTransactionTest-fe-0-txn-26-0 prepared 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-26-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-26-0 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-26-0 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:10,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Validating transaction member-1-ShardTransactionTest-fe-0-txn-27-0 03:02:10,742 PM [test-akka.actor.default-dispatcher-12] [WARN] ShardDataTree - member-1-shard-inventory-config10: Store Tx member-1-ShardTransactionTest-fe-0-txn-27-0: Conflicting modification for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test. 03:02:10,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-27-0 changing state from CAN_COMMIT_PENDING to FAILED 03:02:10,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-27-0 OptimisticLockFailedException{message=Optimistic lock failed for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, errorList=[RpcError [message=Optimistic lock failed for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, severity=ERROR, errorType=APPLICATION, tag=resource-denied, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.ConflictingModificationAppliedException: Node was created by other transaction.]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:846) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCommit(ShardDataTree.java:1134) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.commit(SimpleShardDataTreeCohort.java:150) at org.opendaylight.controller.cluster.datastore.CohortEntry.commit(CohortEntry.java:120) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.finishCommit(ShardCommitCoordinator.java:321) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator$3.onSuccess(ShardCommitCoordinator.java:304) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator$3.onSuccess(ShardCommitCoordinator.java:301) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.successfulPreCommit(SimpleShardDataTreeCohort.java:222) at org.opendaylight.controller.cluster.datastore.ShardDataTree$1.onSuccess(ShardDataTree.java:1052) at org.opendaylight.controller.cluster.datastore.ShardDataTree$1.onSuccess(ShardDataTree.java:1039) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.doUserPreCommit(SimpleShardDataTreeCohort.java:206) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.userPreCommit(SimpleShardDataTreeCohort.java:190) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1039) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:112) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:116) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:301) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:364) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:709) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:381) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.ConflictingModificationAppliedException: Node was created by other transaction. at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkConflicting(SchemaAwareApplyOperation.java:74) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkWriteApplicable(SchemaAwareApplyOperation.java:181) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:111) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.checkChildPreconditions(AbstractNodeContainerModificationStrategy.java:409) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.checkTouchApplicable(AbstractNodeContainerModificationStrategy.java:368) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:110) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractDataTreeTip.validate(AbstractDataTreeTip.java:31) at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) ... 45 more 03:02:10,743 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:10,743 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:10,743 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Transaction member-1-ShardTransactionTest-fe-0-txn-26-0 submitted to persistence 03:02:10,744 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:10,744 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: Moving last applied index from 0 to 1 03:02:10,744 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: Applying state for log index 1 data Simple{size=143} 03:02:10,744 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-26-0 03:02:10,745 PM [test-akka.actor.default-dispatcher-13] [ERROR] ShardDataTree - member-1-shard-inventory-config10: Failed to commit transaction member-1-ShardTransactionTest-fe-0-txn-26-0 java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1083) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:539) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:447) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:996) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:10,745 PM [test-akka.actor.default-dispatcher-13] [ERROR] SimpleShardDataTreeCohort - Transaction failed to commit java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1083) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:539) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:447) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:996) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:10,745 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-26-0: abort - successfulFromPrevious: [] 03:02:10,745 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-26-0 changing state from COMMIT_PENDING to FAILED 03:02:10,745 PM [test-akka.actor.default-dispatcher-13] [ERROR] Shard - member-1-shard-inventory-config10, An exception occurred while committing transaction member-1-ShardTransactionTest-fe-0-txn-26-0 java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1083) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:539) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:447) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:996) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:10,746 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: fakeSnapshot purging log to 0 for term 1 03:02:10,746 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: Persisting ApplyJournalEntries with index=1 03:02:10,756 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitPhaseFailure] 03:02:10,768 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config10 03:02:10,768 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config10 (Leader)_slicer-id-43: Closing 03:02:10,768 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: Aborting 0 pending queued transactions 03:02:10,770 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config11, persistent : true [WARN] [03/07/2024 15:02:10.770] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitTimeout]: org.opendaylight.controller.cluster.common.actor.Monitor@1c4c342d 03:02:10,771 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testTransactionCommitTimeout/member-1-shard-inventory-config11-notifier#600774417 created and ready for shard:member-1-shard-inventory-config11 [WARN] [03/07/2024 15:02:10.771] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config11-notifier#600774417]: org.opendaylight.controller.cluster.common.actor.Monitor@5906a68e 03:02:10,772 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config11 with journal batch size 3 03:02:10,772 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitTimeout/shard-member-1:snapshot-read#908662855] [WARN] [03/07/2024 15:02:10.772] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/shard-member-1:snapshot-read#908662855]: org.opendaylight.controller.cluster.common.actor.Monitor@15456997 03:02:10,773 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:10,773 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config11: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:10,773 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,773 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config11 is no longer the leader 03:02:10,774 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from null to Follower 03:02:10,774 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11 (Follower): Received TimeoutNow - switching to Candidate 03:02:10,774 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11 (Candidate): Election: Candidate has following voting peers: [] 03:02:10,774 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Set currentTerm=1, votedFor=member-1-shard-inventory-config11 03:02:10,774 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config11 (Candidate): Starting new election term 1 03:02:10,774 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config11 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:10,774 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageAssembler - member-1-shard-inventory-config11 (Follower): Closing 03:02:10,774 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: false, hasLeader : false 03:02:10,774 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config11 is no longer the leader 03:02:10,774 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:10.774] [test-akka.actor.default-dispatcher-16] [akka://test/user] unhandled message from TestActor[akka://test/user/testTransactionCommitTimeout]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@f184b35 03:02:10,775 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11 (Candidate): Received ElectionTimeout 03:02:10,775 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11 (Leader): Election: Leader has following peers: [] 03:02:10,775 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config11 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:10,775 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: true, hasLeader : true 03:02:10,775 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: became leader with frontend state for [] 03:02:10,775 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from Candidate to Leader 03:02:10,775 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-28-0 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: Readying Tx member-1-ShardTransactionTest-fe-0-txn-28-0 of 1 operations, client version 13 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: readying transaction member-1-ShardTransactionTest-fe-0-txn-28-0 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: transaction member-1-ShardTransactionTest-fe-0-txn-28-0 ready 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Validating transaction member-1-ShardTransactionTest-fe-0-txn-28-0 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 validated 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: canCommit for member-1-ShardTransactionTest-fe-0-txn-28-0: success 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: Committing transaction member-1-ShardTransactionTest-fe-0-txn-28-0 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-28-0 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 candidate ready 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-28-0: canCommit - candidate rootPath: / 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-28-0: canCommit - messages: [] 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-28-0: preCommit - successfulFromPrevious: [] 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 prepared 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-28-0 03:02:10,776 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-28-0 03:02:10,777 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:10,777 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:10,777 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:10,777 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 submitted to persistence 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Moving last applied index from -1 to 0 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config11: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2362277} is already disabled 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Moving last applied index from 0 to 1 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Applying state for log index 1 data Simple{size=143} 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-28-0 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-28-0: commit - successfulFromPrevious: [] 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 changing state from COMMIT_PENDING to COMMITTED 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 committed as 0, sending response to Actor[akka://test/temp/testTransactionCommitTimeout$c] 03:02:10,778 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config11: Created publisher actor Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config11-DTCL-publisher#1523470704] with name member-1-shard-inventory-config11-DTCL-publisher 03:02:10,778 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config11-DTCL-publisher#1523470704] 03:02:10,779 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: fakeSnapshot purging log to 0 for term 1 03:02:10,779 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config11: publishChanges: rootPath: / 03:02:10,779 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Persisting ApplyJournalEntries with index=0 03:02:10,779 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-29-0 03:02:10,779 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config11: Elapsed time for generation of change events for member-1-shard-inventory-config11-DTCL-publisher: 88.09 μs [WARN] [03/07/2024 15:02:10.779] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config11-DTCL-publisher#1523470704]: org.opendaylight.controller.cluster.common.actor.Monitor@1ddbc349 03:02:10,779 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Readying Tx member-1-ShardTransactionTest-fe-0-txn-29-0 of 1 operations, client version 13 03:02:10,779 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: readying transaction member-1-ShardTransactionTest-fe-0-txn-29-0 03:02:10,779 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: transaction member-1-ShardTransactionTest-fe-0-txn-29-0 ready 03:02:10,779 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Validating transaction member-1-ShardTransactionTest-fe-0-txn-29-0 03:02:10,779 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-29-0 validated 03:02:10,779 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-29-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:10,779 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: canCommit for member-1-ShardTransactionTest-fe-0-txn-29-0: success 03:02:10,779 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Committing transaction member-1-ShardTransactionTest-fe-0-txn-29-0 03:02:10,779 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-29-0 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-29-0 candidate ready 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-29-0: canCommit - candidate rootPath: / 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-29-0: canCommit - messages: [] 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-29-0: preCommit - successfulFromPrevious: [] 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-29-0 prepared 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-29-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-29-0 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-29-0 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-29-0 submitted to persistence 03:02:10,780 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Persisting ApplyJournalEntries with index=1 03:02:10,781 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 03:02:10,781 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Moving last applied index from 1 to 2 03:02:10,781 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Applying state for log index 2 data Simple{size=45} 03:02:10,781 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-29-0 03:02:10,781 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-29-0: commit - successfulFromPrevious: [] 03:02:10,781 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-29-0 changing state from COMMIT_PENDING to COMMITTED 03:02:10,781 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-29-0 committed as 0, sending response to Actor[akka://test/temp/testTransactionCommitTimeout$d] 03:02:10,782 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: fakeSnapshot purging log to 1 for term 1 03:02:10,782 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config11: publishChanges: rootPath: / 03:02:10,782 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config11: Elapsed time for generation of change events for member-1-shard-inventory-config11-DTCL-publisher: 24.09 μs 03:02:10,782 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Persisting ApplyJournalEntries with index=2 03:02:10,792 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-30-0 03:02:10,792 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Readying Tx member-1-ShardTransactionTest-fe-0-txn-30-0 of 1 operations, client version 13 03:02:10,792 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: readying transaction member-1-ShardTransactionTest-fe-0-txn-30-0 03:02:10,792 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: transaction member-1-ShardTransactionTest-fe-0-txn-30-0 ready 03:02:10,793 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-31-0 03:02:10,793 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Readying Tx member-1-ShardTransactionTest-fe-0-txn-31-0 of 1 operations, client version 13 03:02:10,793 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: readying transaction member-1-ShardTransactionTest-fe-0-txn-31-0 03:02:10,793 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: transaction member-1-ShardTransactionTest-fe-0-txn-31-0 ready 03:02:10,794 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-30-0 03:02:10,794 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Validating transaction member-1-ShardTransactionTest-fe-0-txn-30-0 03:02:10,794 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-30-0 validated 03:02:10,794 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-30-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:10,794 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: canCommit for member-1-ShardTransactionTest-fe-0-txn-30-0: success 03:02:10,794 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-31-0 03:02:10,794 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Tx member-1-ShardTransactionTest-fe-0-txn-31-0 is scheduled for canCommit step 03:02:11,452 PM [test-akka.actor.default-dispatcher-13] [WARN] ShardDataTree - member-1-shard-inventory-config11: Current transaction member-1-ShardTransactionTest-fe-0-txn-30-0 has timed out after 657 ms in state CAN_COMMIT_COMPLETE 03:02:11,454 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Validating transaction member-1-ShardTransactionTest-fe-0-txn-31-0 03:02:11,454 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-31-0 validated 03:02:11,454 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-31-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:11,454 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config11: canCommit for member-1-ShardTransactionTest-fe-0-txn-31-0: success 03:02:11,455 PM [test-akka.actor.default-dispatcher-13] [ERROR] Shard - member-1-shard-inventory-config11: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-30-0 commit java.lang.IllegalStateException: member-1-shard-inventory-config11: Cannot commit transaction member-1-ShardTransactionTest-fe-0-txn-30-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:357) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:709) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:381) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:11,456 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config11: Committing transaction member-1-ShardTransactionTest-fe-0-txn-31-0 03:02:11,456 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-31-0 03:02:11,456 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-31-0 candidate ready 03:02:11,456 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-31-0: canCommit - candidate rootPath: / 03:02:11,456 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-31-0: canCommit - messages: [] 03:02:11,456 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-31-0: preCommit - successfulFromPrevious: [] 03:02:11,456 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-31-0 prepared 03:02:11,456 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-31-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:11,456 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config11: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-31-0 03:02:11,456 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-31-0 03:02:11,456 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:11,456 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config11: Persist data SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 03:02:11,457 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config11: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 03:02:11,457 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-31-0 submitted to persistence 03:02:11,457 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config11: persist complete SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 03:02:11,457 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config11: Moving last applied index from 2 to 3 03:02:11,457 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config11: Applying state for log index 3 data Simple{size=184} 03:02:11,457 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-31-0 03:02:11,458 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-31-0: commit - successfulFromPrevious: [] 03:02:11,458 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-31-0 changing state from COMMIT_PENDING to COMMITTED 03:02:11,458 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-31-0 committed as 0, sending response to Actor[akka://test/system/testProbe-135#868225135] 03:02:11,458 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config11: publishChanges: rootPath: / 03:02:11,458 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config11: fakeSnapshot purging log to 2 for term 1 03:02:11,458 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config11: Persisting ApplyJournalEntries with index=3 03:02:11,458 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config11: Elapsed time for generation of change events for member-1-shard-inventory-config11-DTCL-publisher: 342.0 μs 03:02:11,459 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitTimeout] 03:02:11,470 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Stopping Shard member-1-shard-inventory-config11 03:02:11,470 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageSlicer - member-1-shard-inventory-config11 (Leader)_slicer-id-45: Closing 03:02:11,470 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Aborting 0 pending queued transactions 03:02:11,473 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Shard created : member-1-shard-inventory-config12, persistent : true [WARN] [03/07/2024 15:02:11.472] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsOnTransactionChain]: org.opendaylight.controller.cluster.common.actor.Monitor@42d0bc53 03:02:11,474 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config12-notifier#-728082591 created and ready for shard:member-1-shard-inventory-config12 [WARN] [03/07/2024 15:02:11.474] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config12-notifier#-728082591]: org.opendaylight.controller.cluster.common.actor.Monitor@3e23ab44 03:02:11,474 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-member-1:snapshot-read#1503487371] [WARN] [03/07/2024 15:02:11.474] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-member-1:snapshot-read#1503487371]: org.opendaylight.controller.cluster.common.actor.Monitor@39768f54 03:02:11,475 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Starting recovery for member-1-shard-inventory-config12 with journal batch size 3 03:02:11,476 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config12: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:11,476 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config12: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:11,476 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: false, hasLeader : false 03:02:11,477 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config12: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config12 is no longer the leader [WARN] [03/07/2024 15:02:11.476] [test-akka.actor.default-dispatcher-16] [akka://test/user] unhandled message from TestActor[akka://test/user/testBatchedModificationsOnTransactionChain]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@6cb408a1 03:02:11,477 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from null to Follower 03:02:11,477 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config12 (Follower): Received TimeoutNow - switching to Candidate 03:02:11,477 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config12 (Candidate): Election: Candidate has following voting peers: [] 03:02:11,477 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config12: Set currentTerm=1, votedFor=member-1-shard-inventory-config12 03:02:11,477 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config12 (Candidate): Starting new election term 1 03:02:11,477 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config12 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:11,477 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config12 (Follower): Closing 03:02:11,477 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: false, hasLeader : false 03:02:11,477 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config12: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config12 is no longer the leader 03:02:11,477 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from Follower to Candidate 03:02:11,478 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12 (Candidate): Received ElectionTimeout 03:02:11,478 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12 (Leader): Election: Leader has following peers: [] 03:02:11,478 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config12 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:11,478 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: true, hasLeader : true 03:02:11,478 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: became leader with frontend state for [] 03:02:11,478 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from Candidate to Leader 03:02:11,584 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:11,584 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:11,584 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:11,587 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 03:02:11,587 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 03:02:11,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeTransactionChain - Opening an unchained snapshot in LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} 03:02:11,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeTransactionChain - Allocated read-write transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 snapshot org.opendaylight.yangtools.yang.data.tree.impl.node.Version@5275e3d0 03:02:11,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 03:02:11,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Readying Tx member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 of 1 operations, client version 13 03:02:11,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: readying transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 03:02:11,588 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 ready 03:02:11,589 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeTransactionChain - Committing transaction ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0, closed=true, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]} 03:02:11,590 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Creating transaction : member-1-ShardTransactionTest-fe-0-chn-2-txn-1-0 03:02:11,591 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeTransactionChain - Reusing a chained snapshot in LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} 03:02:11,591 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeTransactionChain - Allocated read-only transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-1-0 snapshot MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Moving last applied index from -1 to 0 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config12: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=11194930} is already disabled 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Moving last applied index from 0 to 1 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Applying state for log index 1 data CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39} 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: replication of LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} has no callback 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: fakeSnapshot purging log to 0 for term 1 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Persisting ApplyJournalEntries with index=0 03:02:11,595 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Persisting ApplyJournalEntries with index=1 03:02:11,596 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-inventory-member-1:ShardTransactionTest@0:2-1_1#-1638882882] [WARN] [03/07/2024 15:02:11.596] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-inventory-member-1:ShardTransactionTest@0:2-1_1#-1638882882]: org.opendaylight.controller.cluster.common.actor.Monitor@40d2e3f2 03:02:11,597 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Can committing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 03:02:11,597 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Validating transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 03:02:11,597 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 validated 03:02:11,597 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:11,597 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: canCommit for member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: success 03:02:11,597 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Committing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 03:02:11,597 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Preparing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 03:02:11,598 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 candidate ready 03:02:11,598 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: canCommit - candidate rootPath: / 03:02:11,598 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: canCommit - messages: [] 03:02:11,598 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: preCommit - successfulFromPrevious: [] 03:02:11,598 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 prepared 03:02:11,598 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:11,598 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 03:02:11,600 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Starting commit for transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 03:02:11,600 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:11,600 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 03:02:11,600 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 03:02:11,600 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 submitted to persistence 03:02:11,600 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config12: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 03:02:11,600 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config12: Moving last applied index from 1 to 2 03:02:11,600 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config12: Applying state for log index 2 data Simple{size=143} 03:02:11,600 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 03:02:11,600 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: commit - successfulFromPrevious: [] 03:02:11,600 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from COMMIT_PENDING to COMMITTED 03:02:11,600 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ChainedCommitCohort - Committed transaction ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0, closed=true, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, modificationType=SUBTREE_MODIFIED, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE, modificationType=WRITE}}}]} 03:02:11,600 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 committed as 0, sending response to Actor[akka://test/system/testProbe-137#2036877084] 03:02:11,601 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsOnTransactionChain] 03:02:11,601 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config12: Created publisher actor Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config12-DTCL-publisher#2086037951] with name member-1-shard-inventory-config12-DTCL-publisher 03:02:11,601 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config12-DTCL-publisher#2086037951] 03:02:11,601 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config12: fakeSnapshot purging log to 1 for term 1 03:02:11,601 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config12: publishChanges: rootPath: / 03:02:11,601 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config12: Persisting ApplyJournalEntries with index=2 [WARN] [03/07/2024 15:02:11.601] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config12-DTCL-publisher#2086037951]: org.opendaylight.controller.cluster.common.actor.Monitor@419a75b5 03:02:11,601 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config12: Elapsed time for generation of change events for member-1-shard-inventory-config12-DTCL-publisher: 97.32 μs 03:02:11,612 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config12 03:02:11,612 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config12 (Leader)_slicer-id-47: Closing 03:02:11,612 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config12: Aborting 0 pending queued transactions 03:02:11,614 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config13, persistent : true [WARN] [03/07/2024 15:02:11.614] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCanCommitBeforeReadyFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@280934d1 03:02:11,615 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testCanCommitBeforeReadyFailure/member-1-shard-inventory-config13-notifier#-1478187558 created and ready for shard:member-1-shard-inventory-config13 03:02:11,615 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCanCommitBeforeReadyFailure/shard-member-1:snapshot-read#196949243] 03:02:11,615 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config13 with journal batch size 3 [WARN] [03/07/2024 15:02:11.615] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitBeforeReadyFailure/member-1-shard-inventory-config13-notifier#-1478187558]: org.opendaylight.controller.cluster.common.actor.Monitor@567d9f98 [WARN] [03/07/2024 15:02:11.616] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitBeforeReadyFailure/shard-member-1:snapshot-read#196949243]: org.opendaylight.controller.cluster.common.actor.Monitor@2c5619ec 03:02:11,616 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:11,616 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config13: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:11,617 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: false, hasLeader : false 03:02:11,617 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config13 is no longer the leader 03:02:11,617 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from null to Follower 03:02:11,617 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13 (Follower): Received TimeoutNow - switching to Candidate 03:02:11,617 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13 (Candidate): Election: Candidate has following voting peers: [] 03:02:11,617 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Set currentTerm=1, votedFor=member-1-shard-inventory-config13 03:02:11,617 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config13 (Candidate): Starting new election term 1 03:02:11,617 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config13 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:11,617 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config13 (Follower): Closing 03:02:11,617 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: false, hasLeader : false 03:02:11,617 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config13 is no longer the leader 03:02:11,617 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:11.617] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testCanCommitBeforeReadyFailure]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@686ade95 03:02:11,618 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config13 (Candidate): Received ElectionTimeout 03:02:11,618 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config13 (Leader): Election: Leader has following peers: [] 03:02:11,618 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config13 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:11,618 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: true, hasLeader : true 03:02:11,618 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config13: became leader with frontend state for [] 03:02:11,618 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from Candidate to Leader 03:02:11,626 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config13: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-32-0 03:02:11,626 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config13: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:11,626 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config13: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:11,626 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config13: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:11,627 PM [test-akka.actor.default-dispatcher-13] [ERROR] Shard - member-1-shard-inventory-config13: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-32-0 canCommit java.lang.IllegalStateException: member-1-shard-inventory-config13: Cannot canCommit transaction member-1-ShardTransactionTest-fe-0-txn-32-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:282) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:727) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:379) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:11,627 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCanCommitBeforeReadyFailure] 03:02:11,628 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config13: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:11,628 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config13: Moving last applied index from -1 to 0 03:02:11,628 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config13: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:11,628 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config13: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:11,628 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config13: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:11,628 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config13: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1749281} is already disabled 03:02:11,628 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config13: Persisting ApplyJournalEntries with index=0 03:02:11,639 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config13 03:02:11,639 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config13 (Leader)_slicer-id-49: Closing 03:02:11,639 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config13: Aborting 0 pending queued transactions 03:02:11,642 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config14, persistent : true [WARN] [03/07/2024 15:02:11.643] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady]: org.opendaylight.controller.cluster.common.actor.Monitor@5262d78b 03:02:11,643 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config14-notifier#-1123089943 created and ready for shard:member-1-shard-inventory-config14 [WARN] [03/07/2024 15:02:11.643] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config14-notifier#-1123089943]: org.opendaylight.controller.cluster.common.actor.Monitor@450394b2 03:02:11,644 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/shard-member-1:snapshot-read#-366959334] [WARN] [03/07/2024 15:02:11.644] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/shard-member-1:snapshot-read#-366959334]: org.opendaylight.controller.cluster.common.actor.Monitor@55ea72db 03:02:11,644 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config14 with journal batch size 3 03:02:11,652 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:11,652 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config14: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:11,653 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 03:02:11,653 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 03:02:11,653 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from null to Follower 03:02:11,653 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14 (Follower): Received TimeoutNow - switching to Candidate 03:02:11,653 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14 (Candidate): Election: Candidate has following voting peers: [] 03:02:11,653 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: Set currentTerm=1, votedFor=member-1-shard-inventory-config14 03:02:11,653 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config14 (Candidate): Starting new election term 1 03:02:11,653 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config14 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:11,653 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageAssembler - member-1-shard-inventory-config14 (Follower): Closing 03:02:11,653 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 03:02:11,653 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 03:02:11,653 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:11.655] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@69d2269f 03:02:11,655 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config14 (Candidate): Received ElectionTimeout 03:02:11,656 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config14 (Leader): Election: Leader has following peers: [] 03:02:11,656 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config14 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:11,656 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: true, hasLeader : true 03:02:11,656 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config14: became leader with frontend state for [] 03:02:11,656 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Candidate to Leader 03:02:11,714 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:11,714 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:11,714 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:11,714 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-33-0 03:02:11,716 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-33-0 03:02:11,716 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:11,716 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from -1 to 0 03:02:11,716 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:11,716 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:11,716 PM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config14: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:11,716 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2382539} is already disabled 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-33-0 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: Readying Tx member-1-ShardTransactionTest-fe-0-txn-33-0 of 3 operations, client version 13 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: readying transaction member-1-ShardTransactionTest-fe-0-txn-33-0 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: transaction member-1-ShardTransactionTest-fe-0-txn-33-0 ready 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Validating transaction member-1-ShardTransactionTest-fe-0-txn-33-0 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 validated 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: canCommit for member-1-ShardTransactionTest-fe-0-txn-33-0: success 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: Committing transaction member-1-ShardTransactionTest-fe-0-txn-33-0 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-33-0 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 candidate ready 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-33-0: canCommit - candidate rootPath: / 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-33-0: canCommit - messages: [] 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-33-0: preCommit - successfulFromPrevious: [] 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 prepared 03:02:11,717 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:11,718 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-33-0 03:02:11,718 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-33-0 03:02:11,718 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 03:02:11,718 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 03:02:11,718 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 03:02:11,718 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 submitted to persistence 03:02:11,718 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config14: Persisting ApplyJournalEntries with index=0 03:02:11,719 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 03:02:11,719 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from 0 to 1 03:02:11,719 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: Applying state for log index 1 data Simple{size=175} 03:02:11,719 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-33-0 03:02:11,719 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-33-0: commit - successfulFromPrevious: [] 03:02:11,719 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 changing state from COMMIT_PENDING to COMMITTED 03:02:11,719 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 committed as 0, sending response to Actor[akka://test/system/testProbe-141#-1570509387] 03:02:11,719 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady] 03:02:11,720 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config14: Created publisher actor Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config14-DTCL-publisher#541900286] with name member-1-shard-inventory-config14-DTCL-publisher 03:02:11,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config14-DTCL-publisher#541900286] 03:02:11,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config14: publishChanges: rootPath: / 03:02:11,720 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: fakeSnapshot purging log to 0 for term 1 03:02:11,720 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: Persisting ApplyJournalEntries with index=1 [WARN] [03/07/2024 15:02:11.720] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config14-DTCL-publisher#541900286]: org.opendaylight.controller.cluster.common.actor.Monitor@2a799982 03:02:11,721 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config14: Elapsed time for generation of change events for member-1-shard-inventory-config14-DTCL-publisher: 175.5 μs 03:02:11,731 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config14 03:02:11,731 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config14 (Leader)_slicer-id-51: Closing 03:02:11,731 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config14: Aborting 0 pending queued transactions 03:02:11,736 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config15, persistent : true 03:02:11,737 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config15 with journal batch size 3 [WARN] [03/07/2024 15:02:11.738] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testApplyState]: org.opendaylight.controller.cluster.common.actor.Monitor@5f71f5f 03:02:11,738 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testApplyState/shard-member-1:snapshot-read#-662192329] 03:02:11,738 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testApplyState/member-1-shard-inventory-config15-notifier#-2144503354 created and ready for shard:member-1-shard-inventory-config15 [WARN] [03/07/2024 15:02:11.738] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/shard-member-1:snapshot-read#-662192329]: org.opendaylight.controller.cluster.common.actor.Monitor@6559ad60 [WARN] [03/07/2024 15:02:11.738] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/member-1-shard-inventory-config15-notifier#-2144503354]: org.opendaylight.controller.cluster.common.actor.Monitor@474a55ac 03:02:11,739 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:11,739 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config15: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:11,739 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: false, hasLeader : false 03:02:11,739 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config15 is no longer the leader 03:02:11,739 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from null to Follower 03:02:11,739 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15 (Follower): Received TimeoutNow - switching to Candidate [WARN] [03/07/2024 15:02:11.739] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testApplyState]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@56c3204c 03:02:11,739 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15 (Candidate): Election: Candidate has following voting peers: [] 03:02:11,739 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15: Set currentTerm=1, votedFor=member-1-shard-inventory-config15 03:02:11,739 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config15 (Candidate): Starting new election term 1 03:02:11,739 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config15 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:11,739 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config15 (Follower): Closing 03:02:11,739 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: false, hasLeader : false 03:02:11,739 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config15 is no longer the leader 03:02:11,740 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from Follower to Candidate 03:02:11,740 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15 (Candidate): Received ElectionTimeout 03:02:11,740 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15 (Leader): Election: Leader has following peers: [] 03:02:11,740 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config15 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:11,740 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: true, hasLeader : true 03:02:11,740 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: became leader with frontend state for [] 03:02:11,740 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from Candidate to Leader 03:02:11,791 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:11,791 PM [main] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Applying foreign transaction member-1-ShardTransactionTest-fe-0-txn-34-0 03:02:11,795 PM [main] [DEBUG] FrontendMetadata - member-1-shard-inventory-config15: Added client Enabled{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@7c25155e}, purged=MutableUnsignedLongSet{size=0}} 03:02:11,795 PM [main] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config15: Committed transaction member-1-ShardTransactionTest-fe-0-txn-34-0 03:02:11,795 PM [main] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config15: Created publisher actor Actor[akka://test/user/testApplyState/member-1-shard-inventory-config15-DTCL-publisher#1625413260] with name member-1-shard-inventory-config15-DTCL-publisher 03:02:11,796 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testApplyState/member-1-shard-inventory-config15-DTCL-publisher#1625413260] 03:02:11,796 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config15: publishChanges: rootPath: / [WARN] [03/07/2024 15:02:11.796] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/member-1-shard-inventory-config15-DTCL-publisher#1625413260]: org.opendaylight.controller.cluster.common.actor.Monitor@4e08cc96 03:02:11,796 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config15: Elapsed time for generation of change events for member-1-shard-inventory-config15-DTCL-publisher: 101.6 μs 03:02:11,872 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testApplyState] 03:02:11,883 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config15 03:02:11,883 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config15 (Leader)_slicer-id-53: Closing 03:02:11,884 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: Aborting 0 pending queued transactions 03:02:11,887 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config16, persistent : true [WARN] [03/07/2024 15:02:11.887] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$p/testServerRemoved#923194369]: org.opendaylight.controller.cluster.common.actor.Monitor@49241d4c 03:02:11,888 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/$$p/testServerRemoved/member-1-shard-inventory-config16-notifier#100681503 created and ready for shard:member-1-shard-inventory-config16 [WARN] [03/07/2024 15:02:11.888] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$p/testServerRemoved/member-1-shard-inventory-config16-notifier#100681503]: org.opendaylight.controller.cluster.common.actor.Monitor@3ac698 03:02:11,888 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$$p/testServerRemoved/shard-member-1:snapshot-read#-982864971] 03:02:11,889 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config16 with journal batch size 3 [WARN] [03/07/2024 15:02:11.889] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$p/testServerRemoved/shard-member-1:snapshot-read#-982864971]: org.opendaylight.controller.cluster.common.actor.Monitor@52490437 03:02:11,890 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config16: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:11,890 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config16: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:11,890 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: false, hasLeader : false 03:02:11,890 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config16: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config16 is no longer the leader 03:02:11,890 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from null to Follower 03:02:11,892 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config16 (Follower): Received TimeoutNow - switching to Candidate 03:02:11,892 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config16 (Candidate): Election: Candidate has following voting peers: [] 03:02:11,892 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config16: Set currentTerm=1, votedFor=member-1-shard-inventory-config16 03:02:11,892 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config16 (Candidate): Starting new election term 1 03:02:11,892 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config16 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:11,892 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageAssembler - member-1-shard-inventory-config16 (Follower): Closing 03:02:11,892 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: false, hasLeader : false 03:02:11,892 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config16: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config16 is no longer the leader 03:02:11,892 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from Follower to Candidate 03:02:11,893 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16 (Candidate): Received ElectionTimeout 03:02:11,893 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16 (Leader): Election: Leader has following peers: [] 03:02:11,893 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config16 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:11,893 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: true, hasLeader : true 03:02:11,893 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: became leader with frontend state for [] 03:02:11,893 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from Candidate to Leader 03:02:11,937 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$p] 03:02:11,948 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Stopping Shard member-1-shard-inventory-config16 03:02:11,948 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageSlicer - member-1-shard-inventory-config16 (Leader)_slicer-id-55: Closing 03:02:11,948 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config16: Aborting 0 pending queued transactions 03:02:11,950 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Shard created : member-1-shard-inventory-config17, persistent : true [WARN] [03/07/2024 15:02:11.950] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithOperationFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@50a8c9c9 [WARN] [03/07/2024 15:02:11.951] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithOperationFailure/member-1-shard-inventory-config17-notifier#-602679288]: org.opendaylight.controller.cluster.common.actor.Monitor@73d352d 03:02:11,952 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testBatchedModificationsWithOperationFailure/member-1-shard-inventory-config17-notifier#-602679288 created and ready for shard:member-1-shard-inventory-config17 03:02:11,952 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithOperationFailure/shard-member-1:snapshot-read#-471749107] 03:02:11,952 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Starting recovery for member-1-shard-inventory-config17 with journal batch size 3 [WARN] [03/07/2024 15:02:11.952] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithOperationFailure/shard-member-1:snapshot-read#-471749107]: org.opendaylight.controller.cluster.common.actor.Monitor@17c2ad15 03:02:11,953 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:11,953 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config17: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:11,953 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: false, hasLeader : false 03:02:11,954 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config17 is no longer the leader 03:02:11,954 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from null to Follower 03:02:11,954 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17 (Follower): Received TimeoutNow - switching to Candidate 03:02:11,954 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17 (Candidate): Election: Candidate has following voting peers: [] 03:02:11,954 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: Set currentTerm=1, votedFor=member-1-shard-inventory-config17 03:02:11,954 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config17 (Candidate): Starting new election term 1 03:02:11,954 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config17 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:11,954 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config17 (Follower): Closing 03:02:11,954 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: false, hasLeader : false 03:02:11,954 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config17 is no longer the leader [WARN] [03/07/2024 15:02:11.954] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testBatchedModificationsWithOperationFailure]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@71a0f618 03:02:11,954 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from Follower to Candidate 03:02:11,955 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config17 (Candidate): Received ElectionTimeout 03:02:11,955 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config17 (Leader): Election: Leader has following peers: [] 03:02:11,955 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config17 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:11,955 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: true, hasLeader : true 03:02:11,955 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config17: became leader with frontend state for [] 03:02:11,955 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from Candidate to Leader 03:02:12,16 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:12,16 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:12,16 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:12,16 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-35-0 03:02:12,17 PM [test-akka.actor.default-dispatcher-7] [ERROR] Shard - member-1-shard-inventory-config17: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-35-0 org.opendaylight.yangtools.yang.data.tree.api.SchemaValidationFailedException: Node (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:junk?revision=2014-03-13)junk is not a valid child of (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test according to the schema. at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.recursivelyVerifyStructure(AbstractNodeContainerModificationStrategy.java:157) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.mergeIntoModifiedNode(AbstractNodeContainerModificationStrategy.java:263) at org.opendaylight.yangtools.yang.data.tree.impl.OperationWithModification.merge(OperationWithModification.java:48) at org.opendaylight.yangtools.yang.data.tree.impl.InMemoryDataTreeModification.merge(InMemoryDataTreeModification.java:108) at org.opendaylight.controller.cluster.datastore.modification.MergeModification.apply(MergeModification.java:48) at org.opendaylight.controller.cluster.datastore.CohortEntry.applyModifications(CohortEntry.java:102) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:147) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:745) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:768) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:373) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:12,19 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Applying 0 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-35-0 03:02:12,20 PM [test-akka.actor.default-dispatcher-7] [ERROR] Shard - member-1-shard-inventory-config17: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-35-0 org.opendaylight.yangtools.yang.data.tree.api.SchemaValidationFailedException: Node (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:junk?revision=2014-03-13)junk is not a valid child of (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test according to the schema. at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.recursivelyVerifyStructure(AbstractNodeContainerModificationStrategy.java:157) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.mergeIntoModifiedNode(AbstractNodeContainerModificationStrategy.java:263) at org.opendaylight.yangtools.yang.data.tree.impl.OperationWithModification.merge(OperationWithModification.java:48) at org.opendaylight.yangtools.yang.data.tree.impl.InMemoryDataTreeModification.merge(InMemoryDataTreeModification.java:108) at org.opendaylight.controller.cluster.datastore.modification.MergeModification.apply(MergeModification.java:48) at org.opendaylight.controller.cluster.datastore.CohortEntry.applyModifications(CohortEntry.java:102) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:147) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:745) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:768) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:373) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:12,20 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithOperationFailure] 03:02:12,20 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:12,21 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Moving last applied index from -1 to 0 03:02:12,21 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:12,21 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:12,21 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config17: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:12,21 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=4820566} is already disabled 03:02:12,21 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Persisting ApplyJournalEntries with index=0 03:02:12,31 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config17 03:02:12,31 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config17 (Leader)_slicer-id-57: Closing 03:02:12,31 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Aborting 0 pending queued transactions 03:02:12,36 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1TestShard - Shard created : member-1-shard-inventory-config19, persistent : true 03:02:12,38 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateSnapshot/shard-member-1:snapshot-read#-1382175647] [WARN] [03/07/2024 15:02:12.038] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCreateSnapshot]: org.opendaylight.controller.cluster.common.actor.Monitor@4e6ef05d 03:02:12,38 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1TestShard - Starting recovery for member-1-shard-inventory-config19 with journal batch size 3 03:02:12,38 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testCreateSnapshot/member-1-shard-inventory-config19-notifier#1144778023 created and ready for shard:member-1-shard-inventory-config19 [WARN] [03/07/2024 15:02:12.038] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config19-notifier#1144778023]: org.opendaylight.controller.cluster.common.actor.Monitor@429f734e [WARN] [03/07/2024 15:02:12.039] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/shard-member-1:snapshot-read#-1382175647]: org.opendaylight.controller.cluster.common.actor.Monitor@7b4a9f58 03:02:12,40 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:12,40 PM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:12,40 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: false, hasLeader : false 03:02:12,40 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config19 is no longer the leader [WARN] [03/07/2024 15:02:12.040] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from TestActor[akka://test/user/testCreateSnapshot]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@75db802d 03:02:12,40 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19 (Follower): Received TimeoutNow - switching to Candidate 03:02:12,40 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from null to Follower 03:02:12,40 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19 (Candidate): Election: Candidate has following voting peers: [] 03:02:12,40 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Set currentTerm=1, votedFor=member-1-shard-inventory-config19 03:02:12,40 PM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19 (Candidate): Starting new election term 1 03:02:12,40 PM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:12,40 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config19 (Follower): Closing 03:02:12,40 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: false, hasLeader : false 03:02:12,40 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config19 is no longer the leader 03:02:12,40 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from Follower to Candidate 03:02:12,41 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19 (Candidate): Received ElectionTimeout 03:02:12,41 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19 (Leader): Election: Leader has following peers: [] 03:02:12,42 PM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:12,42 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: true, hasLeader : true 03:02:12,42 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: became leader with frontend state for [] 03:02:12,42 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from Candidate to Leader 03:02:12,137 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:12,137 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:12,137 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-36-0 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Readying Tx member-1-ShardTransactionTest-fe-0-txn-36-0 of 1 operations, client version 13 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: readying transaction member-1-ShardTransactionTest-fe-0-txn-36-0 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: transaction member-1-ShardTransactionTest-fe-0-txn-36-0 ready 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Validating transaction member-1-ShardTransactionTest-fe-0-txn-36-0 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 validated 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: canCommit for member-1-ShardTransactionTest-fe-0-txn-36-0: success 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Committing transaction member-1-ShardTransactionTest-fe-0-txn-36-0 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-36-0 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 candidate ready 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-36-0: canCommit - candidate rootPath: / 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-36-0: canCommit - messages: [] 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-36-0: preCommit - successfulFromPrevious: [] 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 prepared 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-36-0 03:02:12,138 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-36-0 03:02:12,139 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:12,139 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:12,139 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:12,139 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 submitted to persistence 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Moving last applied index from -1 to 0 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config19: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=7946362} is already disabled 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Moving last applied index from 0 to 1 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Applying state for log index 1 data Simple{size=143} 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-36-0 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-36-0: commit - successfulFromPrevious: [] 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 changing state from COMMIT_PENDING to COMMITTED 03:02:12,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 committed as 0, sending response to Actor[akka://test/temp/testCreateSnapshot$e] 03:02:12,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config19: Created publisher actor Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config19-DTCL-publisher#-67308] with name member-1-shard-inventory-config19-DTCL-publisher 03:02:12,146 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config19-DTCL-publisher#-67308] 03:02:12,146 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config19: publishChanges: rootPath: / 03:02:12,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: fakeSnapshot purging log to 0 for term 1 03:02:12,147 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config19: Elapsed time for generation of change events for member-1-shard-inventory-config19-DTCL-publisher: 142.2 μs [WARN] [03/07/2024 15:02:12.147] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config19-DTCL-publisher#-67308]: org.opendaylight.controller.cluster.common.actor.Monitor@1777f4ea 03:02:12,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Persisting ApplyJournalEntries with index=0 03:02:12,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Persisting ApplyJournalEntries with index=1 03:02:12,218 PM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 03:02:12,218 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: lastSequenceNumber prior to capture: 5 03:02:12,219 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{identifer=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 03:02:12,219 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: CaptureSnapshotReply received by actor 03:02:12,219 PM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=1, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@3eb94d51, electionTerm=1, electionVotedFor=member-1-shard-inventory-config19, ServerConfigPayload=null] 03:02:12,219 PM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 0 and term: 1 03:02:12,219 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: SaveSnapshotSuccess received for snapshot, sequenceNr: 5 03:02:12,219 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Snapshot success - sequence number: 5 03:02:12,219 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: SnapshotComplete received 03:02:12,220 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: handled a snapshot response 03:02:12,220 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: handled a journal response 03:02:12,220 PM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 03:02:12,220 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: lastSequenceNumber prior to capture: 5 03:02:12,220 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{identifer=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 03:02:12,220 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: CaptureSnapshotReply received by actor 03:02:12,220 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=1, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@69e788ab, electionTerm=1, electionVotedFor=member-1-shard-inventory-config19, ServerConfigPayload=null] 03:02:12,220 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 0 and term: 1 03:02:12,220 PM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: SaveSnapshotSuccess received for snapshot, sequenceNr: 5 03:02:12,220 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Snapshot success - sequence number: 5 03:02:12,220 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: SnapshotComplete received 03:02:12,221 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: handled a journal response 03:02:12,221 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: handled a snapshot response 03:02:12,221 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCreateSnapshot] 03:02:12,232 PM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - Stopping Shard member-1-shard-inventory-config19 03:02:12,232 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config19 (Leader)_slicer-id-59: Closing 03:02:12,232 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Aborting 0 pending queued transactions 03:02:12,234 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config20, persistent : true 03:02:12,236 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config20 with journal batch size 3 [WARN] [03/07/2024 15:02:12.236] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries]: org.opendaylight.controller.cluster.common.actor.Monitor@363617df 03:02:12,236 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testTransactionCommitWithPriorExpiredCohortEntries/member-1-shard-inventory-config20-notifier#923751200 created and ready for shard:member-1-shard-inventory-config20 03:02:12,237 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/shard-member-1:snapshot-read#-102135571] [WARN] [03/07/2024 15:02:12.237] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/member-1-shard-inventory-config20-notifier#923751200]: org.opendaylight.controller.cluster.common.actor.Monitor@7d359715 [WARN] [03/07/2024 15:02:12.237] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/shard-member-1:snapshot-read#-102135571]: org.opendaylight.controller.cluster.common.actor.Monitor@6f11bb17 03:02:12,238 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config20: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: false, hasLeader : false 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config20 is no longer the leader 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20 (Follower): Received TimeoutNow - switching to Candidate 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20 (Candidate): Election: Candidate has following voting peers: [] 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Set currentTerm=1, votedFor=member-1-shard-inventory-config20 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config20 (Candidate): Starting new election term 1 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config20 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config20 (Follower): Closing 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: false, hasLeader : false 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config20 is no longer the leader 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from null to Follower 03:02:12,239 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:12.240] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@4a4ec05b 03:02:12,241 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20 (Candidate): Received ElectionTimeout 03:02:12,241 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20 (Leader): Election: Leader has following peers: [] 03:02:12,241 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config20 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:12,241 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: true, hasLeader : true 03:02:12,241 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: became leader with frontend state for [] 03:02:12,241 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from Candidate to Leader 03:02:12,345 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config20: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:12,346 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config20: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:12,346 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config20: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:12,346 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config20: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-37-0 03:02:12,346 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config20: Readying Tx member-1-ShardTransactionTest-fe-0-txn-37-0 of 1 operations, client version 13 03:02:12,346 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: readying transaction member-1-ShardTransactionTest-fe-0-txn-37-0 03:02:12,346 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: transaction member-1-ShardTransactionTest-fe-0-txn-37-0 ready 03:02:12,347 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config20: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-38-0 03:02:12,347 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config20: Readying Tx member-1-ShardTransactionTest-fe-0-txn-38-0 of 1 operations, client version 13 03:02:12,347 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: readying transaction member-1-ShardTransactionTest-fe-0-txn-38-0 03:02:12,347 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: transaction member-1-ShardTransactionTest-fe-0-txn-38-0 ready 03:02:12,348 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-39-0 03:02:12,348 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: Readying Tx member-1-ShardTransactionTest-fe-0-txn-39-0 of 1 operations, client version 13 03:02:12,348 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: readying transaction member-1-ShardTransactionTest-fe-0-txn-39-0 03:02:12,348 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: transaction member-1-ShardTransactionTest-fe-0-txn-39-0 ready 03:02:12,348 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:12,348 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: Moving last applied index from -1 to 0 03:02:12,349 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:12,349 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:12,349 PM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config20: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:12,349 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3064425} is already disabled 03:02:12,349 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: Persisting ApplyJournalEntries with index=0 03:02:12,349 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-39-0 03:02:12,350 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Tx member-1-ShardTransactionTest-fe-0-txn-39-0 is scheduled for canCommit step 03:02:12,921 PM [test-akka.actor.default-dispatcher-15] [WARN] ShardDataTree - member-1-shard-inventory-config20: Current transaction member-1-ShardTransactionTest-fe-0-txn-37-0 has timed out after 574 ms in state READY 03:02:13,81 PM [test-akka.actor.default-dispatcher-15] [WARN] ShardDataTree - member-1-shard-inventory-config20: Current transaction member-1-ShardTransactionTest-fe-0-txn-38-0 has timed out after 733 ms in state READY 03:02:13,81 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Validating transaction member-1-ShardTransactionTest-fe-0-txn-39-0 03:02:13,81 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Transaction member-1-ShardTransactionTest-fe-0-txn-39-0 validated 03:02:13,81 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-39-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:13,81 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: canCommit for member-1-ShardTransactionTest-fe-0-txn-39-0: success 03:02:13,82 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries] 03:02:13,94 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config20 03:02:13,94 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config20 (Leader)_slicer-id-61: Closing 03:02:13,94 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config20: Aborting 1 pending queued transactions 03:02:13,97 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config21, persistent : true [WARN] [03/07/2024 15:02:13.097] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyWithImmediateCommit-true]: org.opendaylight.controller.cluster.common.actor.Monitor@54d98e99 03:02:13,98 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config21-notifier#385849092 created and ready for shard:member-1-shard-inventory-config21 [WARN] [03/07/2024 15:02:13.098] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config21-notifier#385849092]: org.opendaylight.controller.cluster.common.actor.Monitor@7ff211c 03:02:13,98 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-true/shard-member-1:snapshot-read#-294364797] [WARN] [03/07/2024 15:02:13.098] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/shard-member-1:snapshot-read#-294364797]: org.opendaylight.controller.cluster.common.actor.Monitor@62ef84d4 03:02:13,99 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config21 with journal batch size 3 03:02:13,100 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:13,100 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config21: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:13,100 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,100 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config21 is no longer the leader 03:02:13,101 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from null to Follower 03:02:13,101 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21 (Follower): Received TimeoutNow - switching to Candidate 03:02:13,101 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21 (Candidate): Election: Candidate has following voting peers: [] 03:02:13,101 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Set currentTerm=1, votedFor=member-1-shard-inventory-config21 03:02:13,101 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config21 (Candidate): Starting new election term 1 03:02:13,101 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config21 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:13,101 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config21 (Follower): Closing 03:02:13,101 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,101 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config21 is no longer the leader 03:02:13,101 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from Follower to Candidate 03:02:13,101 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config21 (Candidate): Received ElectionTimeout 03:02:13,101 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config21 (Leader): Election: Leader has following peers: [] 03:02:13,101 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config21 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:13,101 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: true, hasLeader : true 03:02:13,101 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config21: became leader with frontend state for [] 03:02:13,102 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from Candidate to Leader [WARN] [03/07/2024 15:02:13.104] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testReadyWithImmediateCommit-true]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@2ab2068e 03:02:13,208 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-40-0 03:02:13,208 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:13,208 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,208 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Readying transaction member-1-ShardTransactionTest-fe-0-txn-40-0, client version 13 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: readying transaction member-1-ShardTransactionTest-fe-0-txn-40-0 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: transaction member-1-ShardTransactionTest-fe-0-txn-40-0 ready 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Validating transaction member-1-ShardTransactionTest-fe-0-txn-40-0 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 validated 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: canCommit for member-1-ShardTransactionTest-fe-0-txn-40-0: success 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Committing transaction member-1-ShardTransactionTest-fe-0-txn-40-0 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-40-0 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 candidate ready 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-40-0: canCommit - candidate rootPath: / 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-40-0: canCommit - messages: [] 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-40-0: preCommit - successfulFromPrevious: [] 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 prepared 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-40-0 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-40-0 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:13,209 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:13,210 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:13,210 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 submitted to persistence 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Moving last applied index from -1 to 0 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config21: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3588317} is already disabled 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Moving last applied index from 0 to 1 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Applying state for log index 1 data Simple{size=143} 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-40-0 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-40-0: commit - successfulFromPrevious: [] 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 changing state from COMMIT_PENDING to COMMITTED 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 committed as 0, sending response to Actor[akka://test/system/testProbe-150#-1803634418] 03:02:13,212 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config21: Created publisher actor Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config21-DTCL-publisher#129379741] with name member-1-shard-inventory-config21-DTCL-publisher 03:02:13,213 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config21-DTCL-publisher#129379741] 03:02:13,213 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: fakeSnapshot purging log to 0 for term 1 03:02:13,213 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Persisting ApplyJournalEntries with index=0 03:02:13,213 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config21: publishChanges: rootPath: / 03:02:13,213 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Persisting ApplyJournalEntries with index=1 03:02:13,213 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyWithImmediateCommit-true] [WARN] [03/07/2024 15:02:13.213] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config21-DTCL-publisher#129379741]: org.opendaylight.controller.cluster.common.actor.Monitor@2efd3bec 03:02:13,214 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config21: Elapsed time for generation of change events for member-1-shard-inventory-config21-DTCL-publisher: 127.9 μs 03:02:13,224 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config21 03:02:13,225 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config21 (Leader)_slicer-id-63: Closing 03:02:13,225 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Aborting 0 pending queued transactions 03:02:13,230 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config22, persistent : true [WARN] [03/07/2024 15:02:13.230] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRegisterRoleChangeListener]: org.opendaylight.controller.cluster.common.actor.Monitor@1f201646 03:02:13,231 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testRegisterRoleChangeListener/member-1-shard-inventory-config22-notifier#-1927157796 created and ready for shard:member-1-shard-inventory-config22 [WARN] [03/07/2024 15:02:13.231] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterRoleChangeListener/member-1-shard-inventory-config22-notifier#-1927157796]: org.opendaylight.controller.cluster.common.actor.Monitor@7f18f8c 03:02:13,231 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRegisterRoleChangeListener/shard-member-1:snapshot-read#-1333183416] [WARN] [03/07/2024 15:02:13.232] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterRoleChangeListener/shard-member-1:snapshot-read#-1333183416]: org.opendaylight.controller.cluster.common.actor.Monitor@5ba16050 03:02:13,232 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config22 with journal batch size 3 03:02:13,233 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:13,233 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config22: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:13,233 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,233 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 03:02:13,233 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from null to Follower 03:02:13,233 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22 (Follower): Received TimeoutNow - switching to Candidate 03:02:13,233 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Election: Candidate has following voting peers: [] 03:02:13,233 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: Set currentTerm=1, votedFor=member-1-shard-inventory-config22 03:02:13,233 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config22 (Candidate): Starting new election term 1 [WARN] [03/07/2024 15:02:13.233] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testRegisterRoleChangeListener]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@5336e6d1 03:02:13,233 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config22 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:13,233 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config22 (Follower): Closing 03:02:13,233 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,233 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 03:02:13,233 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Follower to Candidate 03:02:13,234 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Received ElectionTimeout 03:02:13,234 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Election: Leader has following peers: [] 03:02:13,234 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config22 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:13,234 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: true, hasLeader : true 03:02:13,234 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config22: became leader with frontend state for [] 03:02:13,234 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Candidate to Leader 03:02:13,332 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , registered listener akka://test/user/$a 03:02:13,394 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 03:02:13,394 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Cluster state: [] 03:02:13,399 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Candidate in requestVote:RequestVote [term=10000, candidateId=member2, lastLogIndex=50, lastLogTerm=50] with higher term appears reachable, updating term. 03:02:13,399 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config22 (Leader): Term 10000 in "RequestVote [term=10000, candidateId=member2, lastLogIndex=50, lastLogTerm=50]" message is greater than leader's term 1 - switching to Follower 03:02:13,399 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Set currentTerm=10000, votedFor=null 03:02:13,399 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config22 (Leader) :- Switching from behavior Leader to Follower, election term: 10000 03:02:13,399 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config22 (Leader)_slicer-id-65: Closing 03:02:13,399 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,399 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 03:02:13,399 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config22: Closing 03:02:13,400 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Leader to Follower 03:02:13,400 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config22 (Follower): Received TimeoutNow - switching to Candidate 03:02:13,400 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Election: Candidate has following voting peers: [] 03:02:13,400 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config22: Set currentTerm=10001, votedFor=member-1-shard-inventory-config22 03:02:13,400 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config22 (Candidate): Starting new election term 10001 03:02:13,400 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config22 (Follower) :- Switching from behavior Follower to Candidate, election term: 10001 03:02:13,400 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config22 (Follower): Closing 03:02:13,400 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,400 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 03:02:13,400 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Follower to Candidate 03:02:13,401 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Received ElectionTimeout 03:02:13,401 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Election: Leader has following peers: [] 03:02:13,401 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config22 (Candidate) :- Switching from behavior Candidate to Leader, election term: 10001 03:02:13,401 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: true, hasLeader : true 03:02:13,401 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: became leader with frontend state for [] 03:02:13,401 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Candidate to Leader 03:02:13,445 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testRegisterRoleChangeListener] 03:02:13,456 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config22 03:02:13,456 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config22 (Leader)_slicer-id-66: Closing 03:02:13,456 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config22: Aborting 0 pending queued transactions 03:02:13,463 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3#-440516904] [WARN] [03/07/2024 15:02:13.463] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3#-440516904]: org.opendaylight.controller.cluster.common.actor.Monitor@52d0e231 03:02:13,465 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config23, persistent : true 03:02:13,467 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config23 with journal batch size 3 [WARN] [03/07/2024 15:02:13.467] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]: org.opendaylight.controller.cluster.common.actor.Monitor@49a60355 03:02:13,468 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config23-notifier#1067500657 created and ready for shard:member-1-shard-inventory-config23 03:02:13,468 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/shard-member-1:snapshot-read#-1015558547] [WARN] [03/07/2024 15:02:13.468] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config23-notifier#1067500657]: org.opendaylight.controller.cluster.common.actor.Monitor@72120f82 [WARN] [03/07/2024 15:02:13.468] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/shard-member-1:snapshot-read#-1015558547]: org.opendaylight.controller.cluster.common.actor.Monitor@76d93179 03:02:13,468 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#1843407405] 03:02:13,468 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23: SnapshotOffer called. 03:02:13,469 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23: Moving last applied index from -1 to -1 03:02:13,469 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23: Set currentTerm=1, votedFor=null 03:02:13,469 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23: Applying recovered snapshot 03:02:13,469 PM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config23: clearing clients {} 03:02:13,469 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config23: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config23-DTCL-publisher#-591661774] with name member-1-shard-inventory-config23-DTCL-publisher 03:02:13,469 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config23-DTCL-publisher#-591661774] 03:02:13,469 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config23: state snapshot applied in 499.9 μs 03:02:13,469 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config23: publishChanges: rootPath: / 03:02:13,470 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Recovery snapshot applied for member-1-shard-inventory-config23 in 803.9 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 [WARN] [03/07/2024 15:02:13.470] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config23-DTCL-publisher#-591661774]: org.opendaylight.controller.cluster.common.actor.Monitor@707691e3 03:02:13,470 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config23: Elapsed time for generation of change events for member-1-shard-inventory-config23-DTCL-publisher: 169.9 μs 03:02:13,471 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:13,471 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config23: Recovery completed in 2.163 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:13,471 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,471 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config23 is no longer the leader 03:02:13,471 PM [test-akka.actor.default-dispatcher-12] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 03:02:13,472 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config23 , received role change from null to Follower [WARN] [03/07/2024 15:02:13.472] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@18e9497f 03:02:13,484 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3#-440516904]], isLeader: false, hasLeader: false 03:02:13,485 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: Shard does not have a leader - delaying registration 03:02:13,485 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/$a#-1230583736] [WARN] [03/07/2024 15:02:13.485] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/$a#-1230583736]: org.opendaylight.controller.cluster.common.actor.Monitor@7f1e0809 03:02:13,485 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/$a 03:02:13,486 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig null 03:02:13,486 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23: Re-initializing to Follower with previous leaderId null 03:02:13,489 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config23 (Follower): Closing 03:02:13,489 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,489 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config23 is no longer the leader 03:02:13,489 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23 (Follower): Received TimeoutNow - switching to Candidate 03:02:13,489 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23 (Candidate): Election: Candidate has following voting peers: [] 03:02:13,489 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23: Set currentTerm=2, votedFor=member-1-shard-inventory-config23 03:02:13,489 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config23 (Candidate): Starting new election term 2 03:02:13,489 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config23 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 03:02:13,489 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config23 (Follower): Closing 03:02:13,489 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,489 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config23 is no longer the leader 03:02:13,489 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config23 , received role change from Follower to Candidate 03:02:13,490 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23 (Candidate): Received ElectionTimeout 03:02:13,490 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23 (Leader): Election: Leader has following peers: [] 03:02:13,490 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config23 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 03:02:13,490 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onLeadershipChange, isLeader: true, hasLeader : true 03:02:13,490 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 03:02:13,492 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config23: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@33223ab 03:02:13,492 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config23: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]], initialState present=true] to publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config23-DTCL-publisher#-591661774] 03:02:13,492 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config23: became leader with frontend state for [] 03:02:13,492 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config23: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]], initialState present=true] 03:02:13,492 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config23 , received role change from Candidate to Leader 03:02:13,492 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config23: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]] 03:02:13,493 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config23: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]] 03:02:13,494 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)] 03:02:13,494 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config23: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@33223ab 03:02:13,494 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config23: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]] 03:02:13,494 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3#-440516904] 03:02:13,506 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4] 03:02:13,507 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config23 03:02:13,507 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config23 (Leader)_slicer-id-68: Closing 03:02:13,507 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config23: Aborting 0 pending queued transactions 03:02:13,510 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config, persistent : true 03:02:13,512 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config with journal batch size 3 [WARN] [03/07/2024 15:02:13.512] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]: org.opendaylight.controller.cluster.common.actor.Monitor@5768eea4 03:02:13,513 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-notifier#2134508801 created and ready for shard:testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 03:02:13,513 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-follower5:snapshot-read#-333756807] [WARN] [03/07/2024 15:02:13.513] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-notifier#2134508801]: org.opendaylight.controller.cluster.common.actor.Monitor@49fa71f1 [WARN] [03/07/2024 15:02:13.513] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-follower5:snapshot-read#-333756807]: org.opendaylight.controller.cluster.common.actor.Monitor@9488908 03:02:13,515 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:13,515 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:13,515 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,515 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config is no longer the leader 03:02:13,515 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config , received role change from null to Follower [WARN] [03/07/2024 15:02:13.515] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@63d1915a 03:02:13,613 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, persistent : true [WARN] [03/07/2024 15:02:13.613] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config]: org.opendaylight.controller.cluster.common.actor.Monitor@460bd7de 03:02:13,614 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-notifier#-813113061 created and ready for shard:testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config [WARN] [03/07/2024 15:02:13.614] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-notifier#-813113061]: org.opendaylight.controller.cluster.common.actor.Monitor@4bae5f8b 03:02:13,614 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-leader6:snapshot-read#-1498188653] [WARN] [03/07/2024 15:02:13.615] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-leader6:snapshot-read#-1498188653]: org.opendaylight.controller.cluster.common.actor.Monitor@6e6cc568 03:02:13,615 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config with journal batch size 3 03:02:13,616 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:13,616 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:13,617 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,617 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config is no longer the leader 03:02:13,617 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config , received role change from null to Follower 03:02:13,617 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Follower): Received TimeoutNow - switching to Candidate 03:02:13,617 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): Election: Candidate has following voting peers: [testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config] 03:02:13,617 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Set currentTerm=1, votedFor=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 03:02:13,617 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): Starting new election term 1 [WARN] [03/07/2024 15:02:13.617] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@4d3f39fe 03:02:13,617 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): Sending RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] to peer testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 03:02:13,617 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 03:02:13,617 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:13,617 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Follower): Closing 03:02:13,617 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,617 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config is no longer the leader 03:02:13,617 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Cluster state: [] 03:02:13,617 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Candidate in requestVote:RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 03:02:13,617 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Term 1 in "RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 0 - updating term 03:02:13,617 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Set currentTerm=1, votedFor=null 03:02:13,617 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config , received role change from Follower to Candidate 03:02:13,618 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): In requestVote: RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 03:02:13,618 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Set currentTerm=1, votedFor=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 03:02:13,622 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): requestVote returning: RequestVoteReply [term=1, voteGranted=true] 03:02:13,623 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): RaftRPC message received RequestVoteReply [term=1, voteGranted=true], my term is 1 03:02:13,623 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): handleRequestVoteReply: RequestVoteReply [term=1, voteGranted=true], current voteCount: 1 03:02:13,623 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Election: Leader has following peers: [testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config] 03:02:13,623 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 03:02:13,624 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:13,624 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onLeadershipChange, isLeader: true, hasLeader : true 03:02:13,624 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: became leader with frontend state for [] 03:02:13,624 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config , received role change from Candidate to Leader 03:02:13,625 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config updated: matchIndex: -1, nextIndex: 0 03:02:13,625 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 03:02:13,625 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Closing 03:02:13,625 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config [WARN] [03/07/2024 15:02:13.626] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@21cd1d28 03:02:13,666 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 03:02:13,668 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7#1542382154] [WARN] [03/07/2024 15:02:13.668] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7#1542382154]: org.opendaylight.controller.cluster.common.actor.Monitor@10754835 03:02:13,679 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7#1542382154]], isLeader: false, hasLeader: true 03:02:13,680 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/$a#422488947] 03:02:13,680 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 03:02:13,680 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@56d35545 [WARN] [03/07/2024 15:02:13.680] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/$a#422488947]: org.opendaylight.controller.cluster.common.actor.Monitor@1a05327a 03:02:13,680 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher#1534495422] with name testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher 03:02:13,680 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher#1534495422] 03:02:13,680 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]], initialState present=true] to publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher#1534495422] 03:02:13,680 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/$a 03:02:13,681 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]], initialState present=true] 03:02:13,681 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]] [WARN] [03/07/2024 15:02:13.681] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher#1534495422]: org.opendaylight.controller.cluster.common.actor.Monitor@44e9021c 03:02:13,681 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ForwardingDataTreeChangeListener - Sending OnInitialData to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)] 03:02:13,681 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 03:02:13,681 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Forwarding 1 BatchedModifications to leader ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config)] 03:02:13,681 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]] 03:02:13,681 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Notifying onInitialData to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@56d35545 03:02:13,681 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:13,681 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,681 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,682 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Replicate message: identifier: ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, logIndex: 0, payload: class org.opendaylight.controller.cluster.datastore.persisted.DisableTrackingPayload, isSendImmediate: true 03:02:13,684 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 03:02:13,684 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): sendAppendEntries: 0 is present for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 03:02:13,689 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Sending AppendEntries to follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}]]] 03:02:13,689 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-41-0 03:02:13,689 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): handleAppendEntries: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}]]] 03:02:13,689 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Number of entries to be appended = 1 03:02:13,689 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 03:02:13,689 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Readying Tx member-1-ShardTransactionTest-fe-0-txn-41-0 of 1 operations, client version 13 03:02:13,689 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: readying transaction member-1-ShardTransactionTest-fe-0-txn-41-0 03:02:13,689 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: transaction member-1-ShardTransactionTest-fe-0-txn-41-0 ready 03:02:13,689 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Validating transaction member-1-ShardTransactionTest-fe-0-txn-41-0 03:02:13,689 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-41-0 validated 03:02:13,689 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-41-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:13,689 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: canCommit for member-1-ShardTransactionTest-fe-0-txn-41-0: success 03:02:13,689 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Committing transaction member-1-ShardTransactionTest-fe-0-txn-41-0 03:02:13,689 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-41-0 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-41-0 candidate ready 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-41-0: canCommit - candidate rootPath: / 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-41-0: canCommit - messages: [] 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-41-0: preCommit - successfulFromPrevious: [] 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-41-0 prepared 03:02:13,690 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Append entry to log DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-41-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-41-0 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-41-0 03:02:13,690 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Replicate message: identifier: member-1-ShardTransactionTest-fe-0-txn-41-0, logIndex: 1, payload: class org.opendaylight.controller.cluster.datastore.persisted.CommitTransactionPayload$Simple, isSendImmediate: true 03:02:13,690 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Log size is now 1 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): sendAppendEntries: 0 is present for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 03:02:13,690 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-41-0 submitted to persistence 03:02:13,692 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,693 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:13,698 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=13, raftVersion=5, recipientRaftVersion=5] 03:02:13,699 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config updated: matchIndex: 0, nextIndex: 1 03:02:13,699 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 03:02:13,699 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Setting last applied to 0 03:02:13,699 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Moving last applied index from -1 to 0 03:02:13,699 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:13,699 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:13,699 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:13,699 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=17430301} is already disabled 03:02:13,699 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 03:02:13,699 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): sendAppendEntries: 1 is present for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 03:02:13,699 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,700 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Sending AppendEntries to follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}]]] 03:02:13,700 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Persisting ApplyJournalEntries with index=0 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): handleAppendEntries: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}]]] 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Number of entries to be appended = 1 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Append entry to log Simple{size=143} 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Log size is now 2 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Commit index set to 0 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=13, raftVersion=5, recipientRaftVersion=5] 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Setting last applied to 0 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Moving last applied index from -1 to 0 [WARN] [03/07/2024 15:02:13.700] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5d6d24aa 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:13,700 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:13,700 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config updated: matchIndex: 1, nextIndex: 2 03:02:13,700 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 03:02:13,700 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Setting last applied to 1 03:02:13,700 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Moving last applied index from 0 to 1 03:02:13,700 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Applying state for log index 1 data Simple{size=143} 03:02:13,700 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-41-0 03:02:13,700 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-41-0: commit - successfulFromPrevious: [] 03:02:13,700 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-41-0 changing state from COMMIT_PENDING to COMMITTED 03:02:13,700 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-41-0 committed as 0, sending response to Actor[akka://test/temp/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config$f] 03:02:13,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher#-1219316837] with name testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher 03:02:13,701 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher#-1219316837] 03:02:13,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: fakeSnapshot purging log to 0 for term 1 03:02:13,701 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: publishChanges: rootPath: / 03:02:13,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: 0 03:02:13,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Persisting ApplyJournalEntries with index=1 03:02:13,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:13,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Persisting ApplyJournalEntries with index=0 03:02:13,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Commit index set to 1 03:02:13,701 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Elapsed time for generation of change events for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher: 117.0 μs 03:02:13,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1 03:02:13,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Setting last applied to 1 03:02:13,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Moving last applied index from 0 to 1 03:02:13,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Applying state for log index 1 data Simple{size=143} [WARN] [03/07/2024 15:02:13.701] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher#-1219316837]: org.opendaylight.controller.cluster.common.actor.Monitor@661a9656 03:02:13,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Applying foreign transaction member-1-ShardTransactionTest-fe-0-txn-41-0 03:02:13,702 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: fakeSnapshot purging log to 0 for term 1 03:02:13,702 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: publishChanges: rootPath: / 03:02:13,702 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Persisting ApplyJournalEntries with index=1 03:02:13,702 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]] 03:02:13,702 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)] 03:02:13,702 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Elapsed time for generation of change events for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher: 382.7 μs 03:02:13,702 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@56d35545 03:02:13,703 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config] 03:02:13,714 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Stopping Shard testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 03:02:13,714 PM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Closing 03:02:13,714 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Aborting 0 pending queued transactions 03:02:13,715 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config] 03:02:13,716 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Stopping Shard testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 03:02:13,716 PM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageSlicer - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader)_slicer-id-71: Closing 03:02:13,716 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Aborting 0 pending queued transactions 03:02:13,716 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7#1542382154] 03:02:13,718 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Shard created : member-1-shard-inventory-config25, persistent : true [WARN] [03/07/2024 15:02:13.719] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPeerAddressResolved]: org.opendaylight.controller.cluster.common.actor.Monitor@e3c8654 03:02:13,720 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testPeerAddressResolved/member-1-shard-inventory-config25-notifier#-1990753391 created and ready for shard:member-1-shard-inventory-config25 [WARN] [03/07/2024 15:02:13.720] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPeerAddressResolved/member-1-shard-inventory-config25-notifier#-1990753391]: org.opendaylight.controller.cluster.common.actor.Monitor@6d3dbcd9 03:02:13,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPeerAddressResolved/shard-member-1:snapshot-read#-63105871] 03:02:13,720 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Starting recovery for member-1-shard-inventory-config25 with journal batch size 3 [WARN] [03/07/2024 15:02:13.720] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPeerAddressResolved/shard-member-1:snapshot-read#-63105871]: org.opendaylight.controller.cluster.common.actor.Monitor@6a334855 03:02:13,722 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config25: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:13,722 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config25: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:13,722 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config25: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,722 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config25: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config25 is no longer the leader 03:02:13,722 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config25 , received role change from null to Follower [WARN] [03/07/2024 15:02:13.722] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testPeerAddressResolved]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@2268ae28 03:02:13,819 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Peer address for peer member-2-shard-inventory-config set to akka://foobar 03:02:13,830 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPeerAddressResolved] 03:02:13,841 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config25 03:02:13,841 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config25 (Follower): Closing 03:02:13,841 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config25: Aborting 0 pending queued transactions 03:02:13,843 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config26, persistent : true [WARN] [03/07/2024 15:02:13.843] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount]: org.opendaylight.controller.cluster.common.actor.Monitor@28b17bbd 03:02:13,845 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config26 with journal batch size 3 03:02:13,845 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/member-1-shard-inventory-config26-notifier#974928264 created and ready for shard:member-1-shard-inventory-config26 03:02:13,845 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/shard-member-1:snapshot-read#567595430] [WARN] [03/07/2024 15:02:13.845] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/member-1-shard-inventory-config26-notifier#974928264]: org.opendaylight.controller.cluster.common.actor.Monitor@35ea9f26 [WARN] [03/07/2024 15:02:13.845] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/shard-member-1:snapshot-read#567595430]: org.opendaylight.controller.cluster.common.actor.Monitor@11c9de78 03:02:13,846 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config26: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:13,846 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config26: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:13,847 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,847 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config26: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config26 is no longer the leader [WARN] [03/07/2024 15:02:13.847] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@1f7e406a 03:02:13,847 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config26 (Follower): Received TimeoutNow - switching to Candidate 03:02:13,847 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from null to Follower 03:02:13,847 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config26 (Candidate): Election: Candidate has following voting peers: [] 03:02:13,847 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config26: Set currentTerm=1, votedFor=member-1-shard-inventory-config26 03:02:13,847 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config26 (Candidate): Starting new election term 1 03:02:13,847 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config26 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:13,847 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config26 (Follower): Closing 03:02:13,847 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,847 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config26: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config26 is no longer the leader 03:02:13,847 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from Follower to Candidate 03:02:13,848 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config26 (Candidate): Received ElectionTimeout 03:02:13,848 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config26 (Leader): Election: Leader has following peers: [] 03:02:13,848 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config26 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:13,848 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: true, hasLeader : true 03:02:13,848 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config26: became leader with frontend state for [] 03:02:13,848 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from Candidate to Leader 03:02:13,909 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config26: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:13,909 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config26: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,909 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config26: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,909 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config26: Applying 0 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-42-0 03:02:13,909 PM [test-akka.actor.default-dispatcher-11] [ERROR] Shard - member-1-shard-inventory-config26: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-42-0 java.lang.IllegalStateException: The total number of batched messages received 1 does not match the number sent 2 at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:157) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:745) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:768) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:373) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:13,911 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config26: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,911 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config26: Moving last applied index from -1 to 0 03:02:13,913 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount] 03:02:13,913 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config26: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:13,913 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config26: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:13,913 PM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendMetadata - member-1-shard-inventory-config26: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:13,913 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config26: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=4830517} is already disabled 03:02:13,914 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config26: Persisting ApplyJournalEntries with index=0 03:02:13,925 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Stopping Shard member-1-shard-inventory-config26 03:02:13,925 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageSlicer - member-1-shard-inventory-config26 (Leader)_slicer-id-74: Closing 03:02:13,925 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config26: Aborting 0 pending queued transactions 03:02:13,931 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Shard created : member-1-shard-inventory-config27, persistent : true [WARN] [03/07/2024 15:02:13.931] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true]: org.opendaylight.controller.cluster.common.actor.Monitor@3f03623c 03:02:13,932 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config27-notifier#712066964 created and ready for shard:member-1-shard-inventory-config27 03:02:13,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/shard-member-1:snapshot-read#1370798649] [WARN] [03/07/2024 15:02:13.932] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config27-notifier#712066964]: org.opendaylight.controller.cluster.common.actor.Monitor@7d18c685 03:02:13,932 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Starting recovery for member-1-shard-inventory-config27 with journal batch size 3 [WARN] [03/07/2024 15:02:13.932] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/shard-member-1:snapshot-read#1370798649]: org.opendaylight.controller.cluster.common.actor.Monitor@1ae62ee0 03:02:13,934 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config27: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:13,934 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config27: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:13,934 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,934 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 03:02:13,934 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from null to Follower 03:02:13,935 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config27 (Follower): Received TimeoutNow - switching to Candidate 03:02:13,935 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Election: Candidate has following voting peers: [] 03:02:13,935 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config27: Set currentTerm=1, votedFor=member-1-shard-inventory-config27 03:02:13,935 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config27 (Candidate): Starting new election term 1 03:02:13,935 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config27 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:13,935 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config27 (Follower): Closing 03:02:13,935 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 03:02:13,935 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 03:02:13,935 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:13.935] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@41048876 03:02:13,936 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Received ElectionTimeout 03:02:13,936 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Election: Leader has following peers: [] 03:02:13,937 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config27 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:13,937 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: true, hasLeader : true 03:02:13,937 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config27: became leader with frontend state for [] 03:02:13,937 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Candidate to Leader 03:02:13,996 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-43-0 03:02:13,997 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:13,997 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,997 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,997 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Readying transaction member-1-ShardTransactionTest-fe-0-txn-43-0, client version 13 03:02:13,997 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: readying transaction member-1-ShardTransactionTest-fe-0-txn-43-0 03:02:13,997 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: transaction member-1-ShardTransactionTest-fe-0-txn-43-0 ready 03:02:13,999 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:13,999 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Moving last applied index from -1 to 0 03:02:13,999 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:13,999 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:13,999 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config27: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:13,999 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2213574} is already disabled 03:02:13,999 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Persisting ApplyJournalEntries with index=0 03:02:14,0 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-43-0 03:02:14,1 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Validating transaction member-1-ShardTransactionTest-fe-0-txn-43-0 03:02:14,1 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Transaction member-1-ShardTransactionTest-fe-0-txn-43-0 validated 03:02:14,1 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-43-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:14,1 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: canCommit for member-1-ShardTransactionTest-fe-0-txn-43-0: success 03:02:14,1 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Committing transaction member-1-ShardTransactionTest-fe-0-txn-43-0 03:02:14,1 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-43-0 03:02:14,1 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Transaction member-1-ShardTransactionTest-fe-0-txn-43-0 candidate ready 03:02:14,1 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-43-0: canCommit - candidate rootPath: / 03:02:14,2 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-43-0: canCommit - messages: [] 03:02:14,2 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-43-0: preCommit - successfulFromPrevious: [] 03:02:14,2 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Transaction member-1-ShardTransactionTest-fe-0-txn-43-0 prepared 03:02:14,2 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-43-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:14,2 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-43-0 03:02:14,2 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-43-0 03:02:14,2 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:14,2 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:14,2 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:14,2 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Transaction member-1-ShardTransactionTest-fe-0-txn-43-0 submitted to persistence 03:02:14,3 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:14,3 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Moving last applied index from 0 to 1 03:02:14,3 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Applying state for log index 1 data Simple{size=143} 03:02:14,3 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-43-0 03:02:14,3 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-43-0: commit - successfulFromPrevious: [] 03:02:14,3 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-43-0 changing state from COMMIT_PENDING to COMMITTED 03:02:14,3 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Transaction member-1-ShardTransactionTest-fe-0-txn-43-0 committed as 0, sending response to Actor[akka://test/system/testProbe-162#-1901413735] 03:02:14,4 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config27: Created publisher actor Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config27-DTCL-publisher#-303089685] with name member-1-shard-inventory-config27-DTCL-publisher 03:02:14,4 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config27-DTCL-publisher#-303089685] 03:02:14,4 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: fakeSnapshot purging log to 0 for term 1 03:02:14,4 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config27: publishChanges: rootPath: / 03:02:14,4 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Persisting ApplyJournalEntries with index=1 [WARN] [03/07/2024 15:02:14.005] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config27-DTCL-publisher#-303089685]: org.opendaylight.controller.cluster.common.actor.Monitor@62d2bee9 03:02:14,5 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config27: Elapsed time for generation of change events for member-1-shard-inventory-config27-DTCL-publisher: 154.6 μs 03:02:14,207 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true] 03:02:14,218 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Stopping Shard member-1-shard-inventory-config27 03:02:14,218 PM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageSlicer - member-1-shard-inventory-config27 (Leader)_slicer-id-76: Closing 03:02:14,218 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config27: Aborting 0 pending queued transactions 03:02:14,220 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Shard created : member-1-shard-inventory-config28, persistent : true 03:02:14,222 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Starting recovery for member-1-shard-inventory-config28 with journal batch size 3 [WARN] [03/07/2024 15:02:14.222] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady]: org.opendaylight.controller.cluster.common.actor.Monitor@2dd2cefb 03:02:14,222 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config28-notifier#-1276775658 created and ready for shard:member-1-shard-inventory-config28 03:02:14,222 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/shard-member-1:snapshot-read#1707516684] [WARN] [03/07/2024 15:02:14.222] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config28-notifier#-1276775658]: org.opendaylight.controller.cluster.common.actor.Monitor@1225689 [WARN] [03/07/2024 15:02:14.222] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/shard-member-1:snapshot-read#1707516684]: org.opendaylight.controller.cluster.common.actor.Monitor@575f1862 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config28: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: false, hasLeader : false 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config28 is no longer the leader [WARN] [03/07/2024 15:02:14.224] [test-akka.actor.default-dispatcher-16] [akka://test/user] unhandled message from TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@642e09d 03:02:14,224 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config28 , received role change from null to Follower 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28 (Follower): Received TimeoutNow - switching to Candidate 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28 (Candidate): Election: Candidate has following voting peers: [] 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Set currentTerm=1, votedFor=member-1-shard-inventory-config28 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config28 (Candidate): Starting new election term 1 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config28 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageAssembler - member-1-shard-inventory-config28 (Follower): Closing 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: false, hasLeader : false 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config28 is no longer the leader 03:02:14,224 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config28 , received role change from Follower to Candidate 03:02:14,225 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28 (Candidate): Received ElectionTimeout 03:02:14,225 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28 (Leader): Election: Leader has following peers: [] 03:02:14,225 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config28 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:14,226 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: true, hasLeader : true 03:02:14,226 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: became leader with frontend state for [] 03:02:14,226 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config28 , received role change from Candidate to Leader 03:02:14,285 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:14,285 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:14,285 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:14,285 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-44-0 03:02:14,286 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-44-0 03:02:14,287 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-44-0 03:02:14,287 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Readying Tx member-1-ShardTransactionTest-fe-0-txn-44-0 of 3 operations, client version 13 03:02:14,287 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: readying transaction member-1-ShardTransactionTest-fe-0-txn-44-0 03:02:14,287 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: transaction member-1-ShardTransactionTest-fe-0-txn-44-0 ready 03:02:14,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-44-0 03:02:14,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Validating transaction member-1-ShardTransactionTest-fe-0-txn-44-0 03:02:14,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Transaction member-1-ShardTransactionTest-fe-0-txn-44-0 validated 03:02:14,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-44-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:14,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: canCommit for member-1-ShardTransactionTest-fe-0-txn-44-0: success 03:02:14,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:14,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Moving last applied index from -1 to 0 03:02:14,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:14,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:14,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendMetadata - member-1-shard-inventory-config28: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:14,288 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3326160} is already disabled 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Committing transaction member-1-ShardTransactionTest-fe-0-txn-44-0 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-44-0 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Transaction member-1-ShardTransactionTest-fe-0-txn-44-0 candidate ready 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-44-0: canCommit - candidate rootPath: / 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-44-0: canCommit - messages: [] 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-44-0: preCommit - successfulFromPrevious: [] 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Transaction member-1-ShardTransactionTest-fe-0-txn-44-0 prepared 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-44-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-44-0 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-44-0 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 03:02:14,289 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Transaction member-1-ShardTransactionTest-fe-0-txn-44-0 submitted to persistence 03:02:14,290 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Persisting ApplyJournalEntries with index=0 03:02:14,290 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 03:02:14,290 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Moving last applied index from 0 to 1 03:02:14,290 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Applying state for log index 1 data Simple{size=175} 03:02:14,290 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-44-0 03:02:14,291 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-44-0: commit - successfulFromPrevious: [] 03:02:14,291 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-44-0 changing state from COMMIT_PENDING to COMMITTED 03:02:14,291 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Transaction member-1-ShardTransactionTest-fe-0-txn-44-0 committed as 0, sending response to Actor[akka://test/system/testProbe-164#-416161129] 03:02:14,291 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady] 03:02:14,291 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config28: Created publisher actor Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config28-DTCL-publisher#-1499487648] with name member-1-shard-inventory-config28-DTCL-publisher 03:02:14,292 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: fakeSnapshot purging log to 0 for term 1 03:02:14,292 PM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Persisting ApplyJournalEntries with index=1 03:02:14,292 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config28-DTCL-publisher#-1499487648] 03:02:14,292 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config28: publishChanges: rootPath: / [WARN] [03/07/2024 15:02:14.292] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config28-DTCL-publisher#-1499487648]: org.opendaylight.controller.cluster.common.actor.Monitor@5eb2abcb 03:02:14,293 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config28: Elapsed time for generation of change events for member-1-shard-inventory-config28-DTCL-publisher: 168.8 μs 03:02:14,302 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config28 03:02:14,302 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config28 (Leader)_slicer-id-78: Closing 03:02:14,302 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config28: Aborting 0 pending queued transactions 03:02:14,304 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config29, persistent : true [WARN] [03/07/2024 15:02:14.305] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionMessagesWithNoLeader]: org.opendaylight.controller.cluster.common.actor.Monitor@5afca6c9 03:02:14,305 PM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testTransactionMessagesWithNoLeader/member-1-shard-inventory-config29-notifier#-445494322 created and ready for shard:member-1-shard-inventory-config29 03:02:14,305 PM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionMessagesWithNoLeader/shard-member-1:snapshot-read#-712415935] [WARN] [03/07/2024 15:02:14.305] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionMessagesWithNoLeader/member-1-shard-inventory-config29-notifier#-445494322]: org.opendaylight.controller.cluster.common.actor.Monitor@472fc621 03:02:14,306 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config29 with journal batch size 3 [WARN] [03/07/2024 15:02:14.305] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionMessagesWithNoLeader/shard-member-1:snapshot-read#-712415935]: org.opendaylight.controller.cluster.common.actor.Monitor@1b29146c 03:02:14,307 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config29: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:14,307 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config29: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:14,307 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config29: onLeadershipChange, isLeader: false, hasLeader : false 03:02:14,307 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config29: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config29 is no longer the leader 03:02:14,307 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config29 , received role change from null to Follower 03:02:14,307 PM [test-akka.actor.default-dispatcher-12] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [03/07/2024 15:02:14.307] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testTransactionMessagesWithNoLeader]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@6b3a108f 03:02:14,416 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config29: Adding message BatchedModifications [transactionId=member-1-ShardTransactionTest-fe-0-txn-45-0, ready=false, participatingShardNames=null, totalMessagesSent=0, modifications size=0] to retry 03:02:14,531 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config29: Timer expired for message BatchedModifications [transactionId=member-1-ShardTransactionTest-fe-0-txn-45-0, ready=false, participatingShardNames=null, totalMessagesSent=0, modifications size=0] 03:02:14,532 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config29: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-45-0 03:02:14,537 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config29: Adding message ForwardedReadyTransaction [transactionId=member-1-ShardTransactionTest-fe-0-txn-45-0, transaction=ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-txn-45-0, closed=false, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]}, doImmediateCommit=true, participatingShardNames=null, txnClientVersion=13] to retry 03:02:14,651 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config29: Timer expired for message ForwardedReadyTransaction [transactionId=member-1-ShardTransactionTest-fe-0-txn-45-0, transaction=ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-txn-45-0, closed=false, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]}, doImmediateCommit=true, participatingShardNames=null, txnClientVersion=13] 03:02:14,652 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config29: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-45-0 03:02:14,652 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config29: Adding message org.opendaylight.controller.cluster.datastore.messages.ReadyLocalTransaction@40dc1b39 to retry 03:02:14,771 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config29: Timer expired for message org.opendaylight.controller.cluster.datastore.messages.ReadyLocalTransaction@40dc1b39 03:02:14,772 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionMessagesWithNoLeader] 03:02:14,783 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config29 03:02:14,783 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config29 (Follower): Closing 03:02:14,783 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config29: Aborting 0 pending queued transactions 03:02:14,786 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config30, persistent : true [WARN] [03/07/2024 15:02:14.786] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction#-646328016]: org.opendaylight.controller.cluster.common.actor.Monitor@7a427348 03:02:14,788 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config30 with journal batch size 3 03:02:14,788 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateTransaction/shard-member-1:snapshot-read#1498577694] 03:02:14,788 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testCreateTransaction/member-1-shard-inventory-config30-notifier#500386931 created and ready for shard:member-1-shard-inventory-config30 [WARN] [03/07/2024 15:02:14.788] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/member-1-shard-inventory-config30-notifier#500386931]: org.opendaylight.controller.cluster.common.actor.Monitor@40d86443 [WARN] [03/07/2024 15:02:14.788] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/shard-member-1:snapshot-read#1498577694]: org.opendaylight.controller.cluster.common.actor.Monitor@370f01e7 03:02:14,789 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:14,790 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config30: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:14,790 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config30: onLeadershipChange, isLeader: false, hasLeader : false 03:02:14,790 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config30 is no longer the leader 03:02:14,790 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config30 , received role change from null to Follower 03:02:14,790 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30 (Follower): Received TimeoutNow - switching to Candidate 03:02:14,790 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30 (Candidate): Election: Candidate has following voting peers: [] 03:02:14,790 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: Set currentTerm=1, votedFor=member-1-shard-inventory-config30 03:02:14,790 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config30 (Candidate): Starting new election term 1 03:02:14,790 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config30 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:14,790 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config30 (Follower): Closing 03:02:14,790 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config30: onLeadershipChange, isLeader: false, hasLeader : false 03:02:14,790 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config30 is no longer the leader 03:02:14,790 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config30 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:14.790] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/user/testCreateTransaction#-646328016]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@7b884e4 03:02:14,791 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30 (Candidate): Received ElectionTimeout 03:02:14,791 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30 (Leader): Election: Leader has following peers: [] 03:02:14,791 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config30 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:14,791 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config30: onLeadershipChange, isLeader: true, hasLeader : true 03:02:14,791 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: became leader with frontend state for [] 03:02:14,791 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config30 , received role change from Candidate to Leader 03:02:14,864 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:14,864 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:14,864 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:14,865 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Creating transaction : member-1-ShardTransactionTest-fe-0-txn-46-0 03:02:14,866 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testCreateTransaction/shard-inventory-member-1:ShardTransactionTest@0:46_2#-1744508917] [WARN] [03/07/2024 15:02:14.866] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/shard-inventory-member-1:ShardTransactionTest@0:46_2#-1744508917]: org.opendaylight.controller.cluster.common.actor.Monitor@31d83920 03:02:14,866 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testCreateTransaction#-646328016] 03:02:14,868 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:14,868 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: Moving last applied index from -1 to 0 03:02:14,868 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:14,868 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:14,868 PM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config30: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:14,868 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3906485} is already disabled 03:02:14,868 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: Persisting ApplyJournalEntries with index=0 03:02:14,877 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config30 03:02:14,877 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config30 (Leader)_slicer-id-81: Closing 03:02:14,877 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: Aborting 0 pending queued transactions 03:02:14,879 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Shard created : member-1-shard-inventory-config31, persistent : false [WARN] [03/07/2024 15:02:14.880] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWithPersistenceDisabled]: org.opendaylight.controller.cluster.common.actor.Monitor@456e64f5 03:02:14,881 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWithPersistenceDisabled/shard-member-1:snapshot-read#78255886] [WARN] [03/07/2024 15:02:14.881] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/shard-member-1:snapshot-read#78255886]: org.opendaylight.controller.cluster.common.actor.Monitor@5e6810c7 03:02:14,881 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config31-notifier#-1505517144 created and ready for shard:member-1-shard-inventory-config31 [WARN] [03/07/2024 15:02:14.881] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config31-notifier#-1505517144]: org.opendaylight.controller.cluster.common.actor.Monitor@619fd724 03:02:14,882 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Starting recovery for member-1-shard-inventory-config31 with journal batch size 3 03:02:14,885 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config31: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:14,885 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config31: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:14,885 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: false, hasLeader : false 03:02:14,885 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config31: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config31 is no longer the leader 03:02:14,885 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config31 (Follower): Received TimeoutNow - switching to Candidate 03:02:14,885 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config31 (Candidate): Election: Candidate has following voting peers: [] [WARN] [03/07/2024 15:02:14.885] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testCommitWithPersistenceDisabled]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@3a7a6182 03:02:14,885 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config31: Set currentTerm=1, votedFor=member-1-shard-inventory-config31 03:02:14,885 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from null to Follower 03:02:14,885 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config31 (Candidate): Starting new election term 1 03:02:14,885 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config31 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:14,885 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageAssembler - member-1-shard-inventory-config31 (Follower): Closing 03:02:14,885 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: false, hasLeader : false 03:02:14,885 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config31: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config31 is no longer the leader 03:02:14,885 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from Follower to Candidate 03:02:14,886 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config31 (Candidate): Received ElectionTimeout 03:02:14,886 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config31 (Leader): Election: Leader has following peers: [] 03:02:14,886 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config31 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:14,886 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: true, hasLeader : true 03:02:14,886 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config31: became leader with frontend state for [] 03:02:14,886 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from Candidate to Leader 03:02:14,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:14,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:14,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config31: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:14,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=144265} is already disabled 03:02:14,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-47-0 03:02:14,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31: Readying Tx member-1-ShardTransactionTest-fe-0-txn-47-0 of 1 operations, client version 13 03:02:14,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: readying transaction member-1-ShardTransactionTest-fe-0-txn-47-0 03:02:14,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: transaction member-1-ShardTransactionTest-fe-0-txn-47-0 ready 03:02:14,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-47-0 03:02:14,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Validating transaction member-1-ShardTransactionTest-fe-0-txn-47-0 03:02:14,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-47-0 validated 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-47-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31: canCommit for member-1-ShardTransactionTest-fe-0-txn-47-0: success 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31: Committing transaction member-1-ShardTransactionTest-fe-0-txn-47-0 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-47-0 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-47-0 candidate ready 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-47-0: canCommit - candidate rootPath: / 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-47-0: canCommit - messages: [] 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-47-0: preCommit - successfulFromPrevious: [] 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-47-0 prepared 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-47-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-47-0 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-47-0 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-47-0 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-47-0: commit - successfulFromPrevious: [] 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-47-0 changing state from COMMIT_PENDING to COMMITTED 03:02:14,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-47-0 committed as 0, sending response to Actor[akka://test/system/testProbe-170#-1792401023] 03:02:14,994 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWithPersistenceDisabled] 03:02:14,994 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config31: Created publisher actor Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config31-DTCL-publisher#2124438529] with name member-1-shard-inventory-config31-DTCL-publisher 03:02:14,994 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-47-0 submitted to persistence 03:02:14,994 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config31-DTCL-publisher#2124438529] 03:02:14,995 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config31: publishChanges: rootPath: / [WARN] [03/07/2024 15:02:14.995] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config31-DTCL-publisher#2124438529]: org.opendaylight.controller.cluster.common.actor.Monitor@7a9d57d9 03:02:14,995 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config31: Elapsed time for generation of change events for member-1-shard-inventory-config31-DTCL-publisher: 301.6 μs 03:02:15,5 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config31 03:02:15,5 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config31 (Leader)_slicer-id-83: Closing 03:02:15,5 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: Aborting 0 pending queued transactions 03:02:15,7 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config32, persistent : true 03:02:15,9 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-false/shard-member-1:snapshot-read#-637718369] 03:02:15,9 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config32-notifier#466083429 created and ready for shard:member-1-shard-inventory-config32 03:02:15,9 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config32 with journal batch size 3 [WARN] [03/07/2024 15:02:15.009] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyWithImmediateCommit-false]: org.opendaylight.controller.cluster.common.actor.Monitor@2db27e74 [WARN] [03/07/2024 15:02:15.009] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config32-notifier#466083429]: org.opendaylight.controller.cluster.common.actor.Monitor@6caf4bf7 [WARN] [03/07/2024 15:02:15.009] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/shard-member-1:snapshot-read#-637718369]: org.opendaylight.controller.cluster.common.actor.Monitor@67a1fbc2 03:02:15,11 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config32: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:15,11 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config32: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:15,11 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,11 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config32: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config32 is no longer the leader 03:02:15,11 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from null to Follower 03:02:15,11 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config32 (Follower): Received TimeoutNow - switching to Candidate 03:02:15,11 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config32 (Candidate): Election: Candidate has following voting peers: [] 03:02:15,11 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config32: Set currentTerm=1, votedFor=member-1-shard-inventory-config32 03:02:15,11 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config32 (Candidate): Starting new election term 1 03:02:15,11 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config32 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:15,11 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageAssembler - member-1-shard-inventory-config32 (Follower): Closing 03:02:15,11 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,12 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config32: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config32 is no longer the leader 03:02:15,12 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:15.012] [test-akka.actor.default-dispatcher-16] [akka://test/user] unhandled message from TestActor[akka://test/user/testReadyWithImmediateCommit-false]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@648ff0f 03:02:15,12 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32 (Candidate): Received ElectionTimeout 03:02:15,12 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32 (Leader): Election: Leader has following peers: [] 03:02:15,12 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config32 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:15,13 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: true, hasLeader : true 03:02:15,13 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: became leader with frontend state for [] 03:02:15,13 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Candidate to Leader 03:02:15,72 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:15,72 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,73 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,73 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-48-0 03:02:15,73 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32: Readying Tx member-1-ShardTransactionTest-fe-0-txn-48-0 of 1 operations, client version 13 03:02:15,73 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: readying transaction member-1-ShardTransactionTest-fe-0-txn-48-0 03:02:15,73 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: transaction member-1-ShardTransactionTest-fe-0-txn-48-0 ready 03:02:15,73 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Validating transaction member-1-ShardTransactionTest-fe-0-txn-48-0 03:02:15,73 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-48-0 validated 03:02:15,73 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-48-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:15,73 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32: canCommit for member-1-ShardTransactionTest-fe-0-txn-48-0: success 03:02:15,73 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32: Committing transaction member-1-ShardTransactionTest-fe-0-txn-48-0 03:02:15,73 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-48-0 03:02:15,73 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-48-0 candidate ready 03:02:15,74 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-48-0: canCommit - candidate rootPath: / 03:02:15,74 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-48-0: canCommit - messages: [] 03:02:15,74 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-48-0: preCommit - successfulFromPrevious: [] 03:02:15,74 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-48-0 prepared 03:02:15,74 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-48-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:15,74 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-48-0 03:02:15,74 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-48-0 03:02:15,74 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:15,74 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:15,74 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:15,74 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-48-0 submitted to persistence 03:02:15,75 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,75 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: Moving last applied index from -1 to 0 03:02:15,75 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:15,75 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:15,76 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config32: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:15,76 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3212898} is already disabled 03:02:15,76 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:15,76 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: Moving last applied index from 0 to 1 03:02:15,76 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: Applying state for log index 1 data Simple{size=143} 03:02:15,76 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-48-0 03:02:15,76 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-48-0: commit - successfulFromPrevious: [] 03:02:15,76 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-48-0 changing state from COMMIT_PENDING to COMMITTED 03:02:15,76 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-48-0 committed as 0, sending response to Actor[akka://test/system/testProbe-172#-877050827] 03:02:15,76 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyWithImmediateCommit-false] 03:02:15,76 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config32: Created publisher actor Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config32-DTCL-publisher#1034776321] with name member-1-shard-inventory-config32-DTCL-publisher 03:02:15,77 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config32-DTCL-publisher#1034776321] 03:02:15,77 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: fakeSnapshot purging log to 0 for term 1 03:02:15,77 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: Persisting ApplyJournalEntries with index=0 03:02:15,77 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config32: publishChanges: rootPath: / [WARN] [03/07/2024 15:02:15.077] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config32-DTCL-publisher#1034776321]: org.opendaylight.controller.cluster.common.actor.Monitor@45a44b5a 03:02:15,77 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: Persisting ApplyJournalEntries with index=1 03:02:15,77 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config32: Elapsed time for generation of change events for member-1-shard-inventory-config32-DTCL-publisher: 141.1 μs 03:02:15,87 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config32 03:02:15,87 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config32 (Leader)_slicer-id-85: Closing 03:02:15,87 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: Aborting 0 pending queued transactions 03:02:15,90 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 03:02:15,91 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,93 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,93 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,94 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,95 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,96 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,96 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,97 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,97 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,98 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,98 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,99 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,99 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,100 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,100 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,100 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:02:15,102 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - Shard created : member-1-shard-inventory-config33, persistent : true [WARN] [03/07/2024 15:02:15.102] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRecovery]: org.opendaylight.controller.cluster.common.actor.Monitor@102efcc2 [WARN] [03/07/2024 15:02:15.104] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config33-notifier#1477092546]: org.opendaylight.controller.cluster.common.actor.Monitor@528977fd 03:02:15,104 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testRecovery/member-1-shard-inventory-config33-notifier#1477092546 created and ready for shard:member-1-shard-inventory-config33 03:02:15,104 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#1584600976] [WARN] [03/07/2024 15:02:15.104] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#1584600976]: org.opendaylight.controller.cluster.common.actor.Monitor@1f237fc9 03:02:15,104 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - Starting recovery for member-1-shard-inventory-config33 with journal batch size 3 03:02:15,106 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#1843407405] 03:02:15,106 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: SnapshotOffer called. 03:02:15,106 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Moving last applied index from -1 to -1 03:02:15,106 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Set currentTerm=1, votedFor=null 03:02:15,106 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Applying recovered snapshot 03:02:15,106 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config33: clearing clients {} 03:02:15,106 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config33: Created publisher actor Actor[akka://test/user/testRecovery/member-1-shard-inventory-config33-DTCL-publisher#-1015304214] with name member-1-shard-inventory-config33-DTCL-publisher 03:02:15,106 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testRecovery/member-1-shard-inventory-config33-DTCL-publisher#-1015304214] 03:02:15,106 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config33: publishChanges: rootPath: / 03:02:15,106 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: state snapshot applied in 536.3 μs [WARN] [03/07/2024 15:02:15.107] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config33-DTCL-publisher#-1015304214]: org.opendaylight.controller.cluster.common.actor.Monitor@711934d3 03:02:15,107 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - Recovery snapshot applied for member-1-shard-inventory-config33 in 840.7 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 03:02:15,107 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config33: Elapsed time for generation of change events for member-1-shard-inventory-config33-DTCL-publisher: 136.3 μs 03:02:15,111 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,111 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 0, size: 45 03:02:15,111 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,111 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 1, size: 184 03:02:15,111 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,111 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 2, size: 184 03:02:15,111 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,111 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 3, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 4, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 5, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 6, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 7, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 8, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 9, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 10, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 11, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 12, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 13, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 14, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 15, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 16, size: 184 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received apply journal entries for recovery, applying to state: 0 to 16 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: starting log recovery batch with max size 3 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config33: Added client Enabled{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@2d75eb88}, purged=MutableUnsignedLongSet{size=0}} 03:02:15,112 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-49-0 03:02:15,113 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-50-0 03:02:15,114 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-51-0 03:02:15,114 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: starting log recovery batch with max size 3 03:02:15,114 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-52-0 03:02:15,114 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-53-0 03:02:15,117 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-54-0 03:02:15,117 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: starting log recovery batch with max size 3 03:02:15,118 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-55-0 03:02:15,118 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-56-0 03:02:15,119 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-57-0 03:02:15,119 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: starting log recovery batch with max size 3 03:02:15,119 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-58-0 03:02:15,120 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-59-0 03:02:15,120 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-60-0 03:02:15,120 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: starting log recovery batch with max size 3 03:02:15,120 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-61-0 03:02:15,121 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-62-0 03:02:15,121 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-63-0 03:02:15,121 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: starting log recovery batch with max size 3 03:02:15,122 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-64-0 03:02:15,122 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-65-0 03:02:15,122 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Moving last applied index from -1 to 16 03:02:15,122 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:15,123 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config33: Recovery completed in 16.78 ms - Switching actor to Follower - last log index = 16, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 17 03:02:15,123 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,123 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config33 is no longer the leader 03:02:15,123 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33 (Follower): Received TimeoutNow - switching to Candidate 03:02:15,123 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33 (Candidate): Election: Candidate has following voting peers: [] 03:02:15,123 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Set currentTerm=2, votedFor=member-1-shard-inventory-config33 03:02:15,123 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config33 (Candidate): Starting new election term 2 03:02:15,123 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config33 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 03:02:15,123 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config33 (Follower): Closing 03:02:15,123 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,123 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config33 is no longer the leader 03:02:15,123 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from null to Follower 03:02:15,123 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:15.124] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testRecovery]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@202362bb 03:02:15,131 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33 (Candidate): Received ElectionTimeout 03:02:15,131 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33 (Leader): Election: Leader has following peers: [] 03:02:15,131 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config33 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 03:02:15,131 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: true, hasLeader : true 03:02:15,132 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: became leader with frontend state for [member-1-frontend-ShardTransactionTest] 03:02:15,132 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from Candidate to Leader 03:02:15,133 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - Stopping Shard member-1-shard-inventory-config33 03:02:15,133 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config33 (Leader)_slicer-id-87: Closing 03:02:15,133 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Aborting 0 pending queued transactions 03:02:15,134 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config34, persistent : true [WARN] [03/07/2024 15:02:15.134] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.common.actor.Monitor@b67c3dc 03:02:15,135 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config34 with journal batch size 3 03:02:15,135 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testAbortAfterReady/member-1-shard-inventory-config34-notifier#2141263465 created and ready for shard:member-1-shard-inventory-config34 03:02:15,135 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#1263782881] [WARN] [03/07/2024 15:02:15.135] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config34-notifier#2141263465]: org.opendaylight.controller.cluster.common.actor.Monitor@58ba4503 [WARN] [03/07/2024 15:02:15.135] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#1263782881]: org.opendaylight.controller.cluster.common.actor.Monitor@45081552 03:02:15,137 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:15,137 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config34: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:15,137 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config34: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,137 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config34 is no longer the leader 03:02:15,137 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config34 , received role change from null to Follower 03:02:15,137 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34 (Follower): Received TimeoutNow - switching to Candidate 03:02:15,137 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34 (Candidate): Election: Candidate has following voting peers: [] 03:02:15,137 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: Set currentTerm=1, votedFor=member-1-shard-inventory-config34 03:02:15,137 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config34 (Candidate): Starting new election term 1 03:02:15,137 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config34 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:15,137 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config34 (Follower): Closing 03:02:15,137 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config34: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,137 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config34 is no longer the leader 03:02:15,137 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config34 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:15.138] [test-akka.actor.default-dispatcher-16] [akka://test/user] unhandled message from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@40261ed8 03:02:15,138 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34 (Candidate): Received ElectionTimeout 03:02:15,138 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34 (Leader): Election: Leader has following peers: [] 03:02:15,138 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config34 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:15,138 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config34: onLeadershipChange, isLeader: true, hasLeader : true 03:02:15,139 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: became leader with frontend state for [] 03:02:15,139 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config34 , received role change from Candidate to Leader 03:02:15,245 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:15,245 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,245 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,246 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-66-0 03:02:15,246 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Readying Tx member-1-ShardTransactionTest-fe-0-txn-66-0 of 1 operations, client version 13 03:02:15,246 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: readying transaction member-1-ShardTransactionTest-fe-0-txn-66-0 03:02:15,246 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: transaction member-1-ShardTransactionTest-fe-0-txn-66-0 ready 03:02:15,246 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-67-0 03:02:15,246 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Readying Tx member-1-ShardTransactionTest-fe-0-txn-67-0 of 1 operations, client version 13 03:02:15,246 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: readying transaction member-1-ShardTransactionTest-fe-0-txn-67-0 03:02:15,246 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: transaction member-1-ShardTransactionTest-fe-0-txn-67-0 ready 03:02:15,247 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-68-0 03:02:15,247 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Readying Tx member-1-ShardTransactionTest-fe-0-txn-68-0 of 1 operations, client version 13 03:02:15,247 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: readying transaction member-1-ShardTransactionTest-fe-0-txn-68-0 03:02:15,247 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: transaction member-1-ShardTransactionTest-fe-0-txn-68-0 ready 03:02:15,248 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-67-0 03:02:15,248 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: aborting queued transaction member-1-ShardTransactionTest-fe-0-txn-67-0 03:02:15,248 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-67-0: abort - successfulFromPrevious: [] 03:02:15,248 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,248 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Moving last applied index from -1 to 0 03:02:15,248 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:15,248 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:15,248 PM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config34: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:15,248 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3190877} is already disabled 03:02:15,248 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-66-0 03:02:15,248 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Validating transaction member-1-ShardTransactionTest-fe-0-txn-66-0 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 validated 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: canCommit for member-1-ShardTransactionTest-fe-0-txn-66-0: success 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Persisting ApplyJournalEntries with index=0 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Committing transaction member-1-ShardTransactionTest-fe-0-txn-66-0 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-66-0 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 candidate ready 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-66-0: canCommit - candidate rootPath: / 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-66-0: canCommit - messages: [] 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-66-0: preCommit - successfulFromPrevious: [] 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 prepared 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-66-0 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-66-0 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:15,249 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:15,250 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:15,250 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 submitted to persistence 03:02:15,250 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:15,250 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: Moving last applied index from 0 to 1 03:02:15,250 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: Applying state for log index 1 data Simple{size=143} 03:02:15,250 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-66-0 03:02:15,251 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-66-0: commit - successfulFromPrevious: [] 03:02:15,251 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 changing state from COMMIT_PENDING to COMMITTED 03:02:15,251 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 committed as 0, sending response to Actor[akka://test/system/testProbe-174#1813065672] 03:02:15,251 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config34: Created publisher actor Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config34-DTCL-publisher#-952274474] with name member-1-shard-inventory-config34-DTCL-publisher 03:02:15,251 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config34-DTCL-publisher#-952274474] 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-68-0 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Validating transaction member-1-ShardTransactionTest-fe-0-txn-68-0 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-68-0 validated 03:02:15,252 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config34: publishChanges: rootPath: / 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-68-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: canCommit for member-1-ShardTransactionTest-fe-0-txn-68-0: success 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: fakeSnapshot purging log to 0 for term 1 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: Persisting ApplyJournalEntries with index=1 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: Committing transaction member-1-ShardTransactionTest-fe-0-txn-68-0 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-68-0 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-68-0 candidate ready 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-68-0: canCommit - candidate rootPath: / 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-68-0: canCommit - messages: [] 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-68-0: preCommit - successfulFromPrevious: [] 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-68-0 prepared 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-68-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-68-0 03:02:15,252 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config34: Elapsed time for generation of change events for member-1-shard-inventory-config34-DTCL-publisher: 149.4 μs 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-68-0 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 03:02:15,252 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-68-0 submitted to persistence [WARN] [03/07/2024 15:02:15.252] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config34-DTCL-publisher#-952274474]: org.opendaylight.controller.cluster.common.actor.Monitor@771a7cc 03:02:15,253 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 03:02:15,253 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Moving last applied index from 1 to 2 03:02:15,253 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Applying state for log index 2 data Simple{size=45} 03:02:15,253 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-68-0 03:02:15,254 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-68-0: commit - successfulFromPrevious: [] 03:02:15,254 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-68-0 changing state from COMMIT_PENDING to COMMITTED 03:02:15,254 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-68-0 committed as 0, sending response to Actor[akka://test/system/testProbe-174#1813065672] 03:02:15,254 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterReady] 03:02:15,254 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: fakeSnapshot purging log to 1 for term 1 03:02:15,254 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config34: Persisting ApplyJournalEntries with index=2 03:02:15,254 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config34: publishChanges: rootPath: / 03:02:15,254 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config34: Elapsed time for generation of change events for member-1-shard-inventory-config34-DTCL-publisher: 26.86 μs 03:02:15,265 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config34 03:02:15,265 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config34 (Leader)_slicer-id-89: Closing 03:02:15,265 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config34: Aborting 0 pending queued transactions 03:02:15,268 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config35, persistent : true [WARN] [03/07/2024 15:02:15.268] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false]: org.opendaylight.controller.cluster.common.actor.Monitor@df7cbad 03:02:15,270 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config35-notifier#2096607356 created and ready for shard:member-1-shard-inventory-config35 [WARN] [03/07/2024 15:02:15.270] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config35-notifier#2096607356]: org.opendaylight.controller.cluster.common.actor.Monitor@39eb35d3 03:02:15,270 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/shard-member-1:snapshot-read#-1765014139] [WARN] [03/07/2024 15:02:15.270] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/shard-member-1:snapshot-read#-1765014139]: org.opendaylight.controller.cluster.common.actor.Monitor@10f7a76e 03:02:15,270 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config35 with journal batch size 3 03:02:15,276 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:15,276 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config35: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:15,276 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,276 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config35 is no longer the leader 03:02:15,276 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from null to Follower 03:02:15,276 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35 (Follower): Received TimeoutNow - switching to Candidate 03:02:15,276 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35 (Candidate): Election: Candidate has following voting peers: [] 03:02:15,276 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Set currentTerm=1, votedFor=member-1-shard-inventory-config35 03:02:15,277 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config35 (Candidate): Starting new election term 1 03:02:15,277 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config35 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:15,277 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config35 (Follower): Closing 03:02:15,277 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,277 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config35 is no longer the leader 03:02:15,277 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:15.277] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@7b8758e7 03:02:15,277 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config35 (Candidate): Received ElectionTimeout 03:02:15,278 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config35 (Leader): Election: Leader has following peers: [] 03:02:15,278 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config35 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:15,278 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: true, hasLeader : true 03:02:15,278 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config35: became leader with frontend state for [] 03:02:15,278 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from Candidate to Leader 03:02:15,338 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:15,338 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,338 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,338 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-69-0 03:02:15,339 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Readying Tx member-1-ShardTransactionTest-fe-0-txn-69-0 of 1 operations, client version 13 03:02:15,339 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: readying transaction member-1-ShardTransactionTest-fe-0-txn-69-0 03:02:15,339 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: transaction member-1-ShardTransactionTest-fe-0-txn-69-0 ready 03:02:15,340 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,340 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Moving last applied index from -1 to 0 03:02:15,340 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:15,340 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:15,340 PM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config35: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:15,340 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2420479} is already disabled 03:02:15,340 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Persisting ApplyJournalEntries with index=0 03:02:15,344 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-69-0 03:02:15,344 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Validating transaction member-1-ShardTransactionTest-fe-0-txn-69-0 03:02:15,344 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 validated 03:02:15,344 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:15,344 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: canCommit for member-1-ShardTransactionTest-fe-0-txn-69-0: success 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Committing transaction member-1-ShardTransactionTest-fe-0-txn-69-0 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-69-0 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 candidate ready 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-69-0: canCommit - candidate rootPath: / 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-69-0: canCommit - messages: [] 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-69-0: preCommit - successfulFromPrevious: [] 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 prepared 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-69-0 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-69-0 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:15,345 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:15,346 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 submitted to persistence 03:02:15,346 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:15,346 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Moving last applied index from 0 to 1 03:02:15,346 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Applying state for log index 1 data Simple{size=143} 03:02:15,346 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-69-0 03:02:15,346 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-69-0: commit - successfulFromPrevious: [] 03:02:15,347 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 changing state from COMMIT_PENDING to COMMITTED 03:02:15,347 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 committed as 0, sending response to Actor[akka://test/system/testProbe-176#534052612] 03:02:15,347 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config35: Created publisher actor Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config35-DTCL-publisher#-1607982049] with name member-1-shard-inventory-config35-DTCL-publisher 03:02:15,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config35-DTCL-publisher#-1607982049] 03:02:15,348 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: fakeSnapshot purging log to 0 for term 1 03:02:15,348 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Persisting ApplyJournalEntries with index=1 03:02:15,348 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config35: publishChanges: rootPath: / [WARN] [03/07/2024 15:02:15.348] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config35-DTCL-publisher#-1607982049]: org.opendaylight.controller.cluster.common.actor.Monitor@1e8c612e 03:02:15,348 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config35: Elapsed time for generation of change events for member-1-shard-inventory-config35-DTCL-publisher: 214.6 μs 03:02:15,550 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false] 03:02:15,562 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config35 03:02:15,562 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config35 (Leader)_slicer-id-91: Closing 03:02:15,562 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config35: Aborting 0 pending queued transactions 03:02:15,564 PM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - Shard created : member-1-shard-inventory-config36, persistent : false [WARN] [03/07/2024 15:02:15.564] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData]: org.opendaylight.controller.cluster.common.actor.Monitor@4603af43 03:02:15,566 PM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - Starting recovery for member-1-shard-inventory-config36 with journal batch size 3 03:02:15,566 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/shard-member-1:snapshot-read#470019363] 03:02:15,566 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config36-notifier#688689174 created and ready for shard:member-1-shard-inventory-config36 [WARN] [03/07/2024 15:02:15.566] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config36-notifier#688689174]: org.opendaylight.controller.cluster.common.actor.Monitor@a1e3792 [WARN] [03/07/2024 15:02:15.566] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/shard-member-1:snapshot-read#470019363]: org.opendaylight.controller.cluster.common.actor.Monitor@63812122 03:02:15,568 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:15,568 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:15,569 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,569 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config36 is no longer the leader 03:02:15,569 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from null to Follower 03:02:15,569 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36 (Follower): Received TimeoutNow - switching to Candidate [WARN] [03/07/2024 15:02:15.569] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@722a7b60 03:02:15,569 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36 (Candidate): Election: Candidate has following voting peers: [] 03:02:15,569 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Set currentTerm=1, votedFor=member-1-shard-inventory-config36 03:02:15,569 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36 (Candidate): Starting new election term 1 03:02:15,569 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:15,569 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config36 (Follower): Closing 03:02:15,569 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,569 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config36 is no longer the leader 03:02:15,569 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from Follower to Candidate 03:02:15,570 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36 (Candidate): Received ElectionTimeout 03:02:15,570 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36 (Leader): Election: Leader has following peers: [] 03:02:15,570 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:15,570 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: true, hasLeader : true 03:02:15,570 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: became leader with frontend state for [] 03:02:15,570 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from Candidate to Leader 03:02:15,620 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:15,620 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:15,620 PM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config36: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:15,620 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=119974} is already disabled 03:02:15,620 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-70-0 03:02:15,620 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Readying Tx member-1-ShardTransactionTest-fe-0-txn-70-0 of 1 operations, client version 13 03:02:15,620 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: readying transaction member-1-ShardTransactionTest-fe-0-txn-70-0 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: transaction member-1-ShardTransactionTest-fe-0-txn-70-0 ready 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Validating transaction member-1-ShardTransactionTest-fe-0-txn-70-0 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-70-0 validated 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-70-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: canCommit for member-1-ShardTransactionTest-fe-0-txn-70-0: success 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Committing transaction member-1-ShardTransactionTest-fe-0-txn-70-0 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-70-0 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-70-0 candidate ready 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-70-0: canCommit - candidate rootPath: / 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-70-0: canCommit - messages: [] 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-70-0: preCommit - successfulFromPrevious: [] 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-70-0 prepared 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-70-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-70-0 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-70-0 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-70-0 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-70-0: commit - successfulFromPrevious: [] 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-70-0 changing state from COMMIT_PENDING to COMMITTED 03:02:15,621 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-70-0 committed as 0, sending response to Actor[akka://test/temp/testCreateSnapshotWithNonPersistentData$g] 03:02:15,622 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config36: Created publisher actor Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config36-DTCL-publisher#497365208] with name member-1-shard-inventory-config36-DTCL-publisher 03:02:15,622 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-70-0 submitted to persistence 03:02:15,622 PM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 03:02:15,622 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: lastSequenceNumber prior to capture: -1 03:02:15,622 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config36-DTCL-publisher#497365208] 03:02:15,622 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{identifer=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 03:02:15,623 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config36: publishChanges: rootPath: / 03:02:15,623 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: CaptureSnapshotReply received by actor 03:02:15,623 PM [test-akka.actor.default-dispatcher-16] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@d7703ca, electionTerm=1, electionVotedFor=member-1-shard-inventory-config36, ServerConfigPayload=null] 03:02:15,623 PM [test-akka.actor.default-dispatcher-16] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 03:02:15,623 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Snapshot success - sequence number: -1 03:02:15,623 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: SnapshotComplete received [WARN] [03/07/2024 15:02:15.623] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config36-DTCL-publisher#497365208]: org.opendaylight.controller.cluster.common.actor.Monitor@403421a8 03:02:15,623 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config36: Elapsed time for generation of change events for member-1-shard-inventory-config36-DTCL-publisher: 139.4 μs 03:02:15,623 PM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 03:02:15,623 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: lastSequenceNumber prior to capture: -1 03:02:15,623 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{identifer=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 03:02:15,624 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: CaptureSnapshotReply received by actor 03:02:15,624 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@23998d0a, electionTerm=1, electionVotedFor=member-1-shard-inventory-config36, ServerConfigPayload=null] 03:02:15,624 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 03:02:15,624 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Snapshot success - sequence number: -1 03:02:15,624 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: SnapshotComplete received 03:02:15,624 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData] 03:02:15,636 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - Stopping Shard member-1-shard-inventory-config36 03:02:15,636 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config36 (Leader)_slicer-id-93: Closing 03:02:15,636 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Aborting 0 pending queued transactions 03:02:15,638 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config37, persistent : true [WARN] [03/07/2024 15:02:15.638] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.common.actor.Monitor@46f0cf4b 03:02:15,639 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testFollowerInitialSyncStatus/member-1-shard-inventory-config37-notifier#1931225320 created and ready for shard:member-1-shard-inventory-config37 03:02:15,639 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testFollowerInitialSyncStatus/shard-member-1:snapshot-read#-1370660291] [WARN] [03/07/2024 15:02:15.639] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testFollowerInitialSyncStatus/member-1-shard-inventory-config37-notifier#1931225320]: org.opendaylight.controller.cluster.common.actor.Monitor@3da6965a [WARN] [03/07/2024 15:02:15.639] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testFollowerInitialSyncStatus/shard-member-1:snapshot-read#-1370660291]: org.opendaylight.controller.cluster.common.actor.Monitor@20990a4 03:02:15,640 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config37 with journal batch size 3 03:02:15,640 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testFollowerInitialSyncStatus] [WARN] [03/07/2024 15:02:15.640] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3beccd12 [WARN] [03/07/2024 15:02:15.640] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@231ca4af 03:02:15,643 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config37: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:15,643 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config37: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:15,644 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,644 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config37: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config37 is no longer the leader 03:02:15,644 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from null to Follower 03:02:15,644 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config37 (Follower): Received TimeoutNow - switching to Candidate 03:02:15,644 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config37 (Candidate): Election: Candidate has following voting peers: [] 03:02:15,644 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config37: Set currentTerm=1, votedFor=member-1-shard-inventory-config37 03:02:15,644 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config37 (Candidate): Starting new election term 1 03:02:15,644 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config37 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:15,644 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageAssembler - member-1-shard-inventory-config37 (Follower): Closing 03:02:15,644 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,644 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config37: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config37 is no longer the leader 03:02:15,644 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:15.644] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@30414f41 03:02:15,645 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config37 (Candidate): Received ElectionTimeout 03:02:15,645 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config37 (Leader): Election: Leader has following peers: [] 03:02:15,645 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config37 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:15,645 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: true, hasLeader : true 03:02:15,645 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config37: became leader with frontend state for [] 03:02:15,645 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from Candidate to Leader 03:02:15,651 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config37 03:02:15,651 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config37 (Leader)_slicer-id-95: Closing 03:02:15,651 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config37: Aborting 0 pending queued transactions 03:02:15,655 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#734251706] [WARN] [03/07/2024 15:02:15.656] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#734251706]: org.opendaylight.controller.cluster.common.actor.Monitor@b2b301 03:02:15,657 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1$1 - Shard created : member-1-shard-inventory-config38, persistent : true 03:02:15,658 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1$1 - Starting recovery for member-1-shard-inventory-config38 with journal batch size 3 [WARN] [03/07/2024 15:02:15.658] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]: org.opendaylight.controller.cluster.common.actor.Monitor@552fa8aa 03:02:15,658 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config38-notifier#-2070288196 created and ready for shard:member-1-shard-inventory-config38 03:02:15,658 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/shard-member-1:snapshot-read#-860602913] [WARN] [03/07/2024 15:02:15.658] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config38-notifier#-2070288196]: org.opendaylight.controller.cluster.common.actor.Monitor@6a68c57f [WARN] [03/07/2024 15:02:15.658] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/shard-member-1:snapshot-read#-860602913]: org.opendaylight.controller.cluster.common.actor.Monitor@1c5b9f49 03:02:15,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#1843407405] 03:02:15,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: SnapshotOffer called. 03:02:15,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: Moving last applied index from -1 to -1 03:02:15,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: Set currentTerm=1, votedFor=null 03:02:15,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: Applying recovered snapshot 03:02:15,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config38: clearing clients {} 03:02:15,659 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config38: Created publisher actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config38-DTCL-publisher#1651282131] with name member-1-shard-inventory-config38-DTCL-publisher 03:02:15,660 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: state snapshot applied in 596.3 μs 03:02:15,660 PM [test-akka.actor.default-dispatcher-16] [INFO] ShardTest$1$1 - Recovery snapshot applied for member-1-shard-inventory-config38 in 967.8 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 03:02:15,660 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config38-DTCL-publisher#1651282131] 03:02:15,660 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config38: publishChanges: rootPath: / [WARN] [03/07/2024 15:02:15.660] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config38-DTCL-publisher#1651282131]: org.opendaylight.controller.cluster.common.actor.Monitor@4a11dad2 03:02:15,660 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config38: Elapsed time for generation of change events for member-1-shard-inventory-config38-DTCL-publisher: 110.2 μs 03:02:15,661 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:15,661 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1$1 - member-1-shard-inventory-config38: Recovery completed in 1.802 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:15,661 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,661 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config38 is no longer the leader 03:02:15,661 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from null to Follower [WARN] [03/07/2024 15:02:15.661] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@567ab84d 03:02:15,661 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38 (Follower): Received TimeoutNow - switching to Candidate 03:02:15,661 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38 (Candidate): Election: Candidate has following voting peers: [] 03:02:15,661 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: Set currentTerm=2, votedFor=member-1-shard-inventory-config38 03:02:15,661 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1$1 - member-1-shard-inventory-config38 (Candidate): Starting new election term 2 03:02:15,661 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1$1 - member-1-shard-inventory-config38 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 03:02:15,661 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config38 (Follower): Closing 03:02:15,661 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,661 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config38 is no longer the leader 03:02:15,662 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from Follower to Candidate 03:02:15,676 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#734251706]], isLeader: false, hasLeader: false 03:02:15,676 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: Shard does not have a leader - delaying registration 03:02:15,676 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a#-313703862] 03:02:15,676 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a [WARN] [03/07/2024 15:02:15.676] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a#-313703862]: org.opendaylight.controller.cluster.common.actor.Monitor@49d86899 03:02:15,677 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38 (Candidate): Received ElectionTimeout 03:02:15,677 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38 (Leader): Election: Leader has following peers: [] 03:02:15,677 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1$1 - member-1-shard-inventory-config38 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 03:02:15,677 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: true, hasLeader : true 03:02:15,677 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config38: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@5b05828f 03:02:15,677 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 03:02:15,677 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config38: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]], initialState present=true] to publisher actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config38-DTCL-publisher#1651282131] 03:02:15,677 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config38: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]], initialState present=true] 03:02:15,677 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: became leader with frontend state for [] 03:02:15,677 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config38: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 03:02:15,677 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from Candidate to Leader 03:02:15,678 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config38: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 03:02:15,678 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)] 03:02:15,678 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config38: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 03:02:15,678 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config38: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@5b05828f 03:02:15,678 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#734251706] 03:02:15,689 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration] 03:02:15,689 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1$1 - Stopping Shard member-1-shard-inventory-config38 03:02:15,689 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config38 (Leader)_slicer-id-97: Closing 03:02:15,689 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: Aborting 0 pending queued transactions 03:02:15,691 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config39, persistent : true [WARN] [03/07/2024 15:02:15.691] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@3011357c 03:02:15,692 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config39-notifier#-1286763547 created and ready for shard:member-1-shard-inventory-config39 03:02:15,692 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/shard-member-1:snapshot-read#1239802705] [WARN] [03/07/2024 15:02:15.692] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config39-notifier#-1286763547]: org.opendaylight.controller.cluster.common.actor.Monitor@11a70555 03:02:15,692 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config39 with journal batch size 3 [WARN] [03/07/2024 15:02:15.692] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/shard-member-1:snapshot-read#1239802705]: org.opendaylight.controller.cluster.common.actor.Monitor@1e6b47fb 03:02:15,694 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:15,694 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config39: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:15,694 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,694 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config39 is no longer the leader [WARN] [03/07/2024 15:02:15.694] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@7e661a9f 03:02:15,694 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39 (Follower): Received TimeoutNow - switching to Candidate 03:02:15,695 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from null to Follower 03:02:15,695 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39 (Candidate): Election: Candidate has following voting peers: [] 03:02:15,695 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: Set currentTerm=1, votedFor=member-1-shard-inventory-config39 03:02:15,695 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config39 (Candidate): Starting new election term 1 03:02:15,695 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config39 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:15,695 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config39 (Follower): Closing 03:02:15,695 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,695 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config39 is no longer the leader 03:02:15,695 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from Follower to Candidate 03:02:15,696 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39 (Candidate): Received ElectionTimeout 03:02:15,696 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39 (Leader): Election: Leader has following peers: [] 03:02:15,696 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config39 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:15,696 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: true, hasLeader : true 03:02:15,696 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: became leader with frontend state for [] 03:02:15,696 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from Candidate to Leader 03:02:15,756 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-71-0 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-71-0 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Validating transaction member-1-ShardTransactionTest-fe-0-txn-71-0 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 validated 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: canCommit for member-1-ShardTransactionTest-fe-0-txn-71-0: success 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: Committing transaction member-1-ShardTransactionTest-fe-0-txn-71-0 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-71-0 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 candidate ready 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-71-0: canCommit - candidate rootPath: / 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-71-0: canCommit - messages: [] 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-71-0: preCommit - successfulFromPrevious: [] 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 prepared 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:15,757 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-71-0 03:02:15,758 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-71-0 03:02:15,758 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 03:02:15,758 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 03:02:15,758 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config39: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 03:02:15,758 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 submitted to persistence 03:02:15,759 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,759 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: Moving last applied index from -1 to 0 03:02:15,760 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:15,760 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:15,760 PM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config39: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:15,760 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3023583} is already disabled 03:02:15,760 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 03:02:15,760 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: Moving last applied index from 0 to 1 03:02:15,760 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: Applying state for log index 1 data Simple{size=175} 03:02:15,760 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-71-0 03:02:15,760 PM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-71-0: commit - successfulFromPrevious: [] 03:02:15,760 PM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 changing state from COMMIT_PENDING to COMMITTED 03:02:15,760 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 committed as 0, sending response to Actor[akka://test/system/testProbe-182#1238400218] 03:02:15,760 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit] 03:02:15,760 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config39: Created publisher actor Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config39-DTCL-publisher#858212085] with name member-1-shard-inventory-config39-DTCL-publisher 03:02:15,760 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config39-DTCL-publisher#858212085] 03:02:15,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config39: publishChanges: rootPath: / 03:02:15,761 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: fakeSnapshot purging log to 0 for term 1 03:02:15,761 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: Persisting ApplyJournalEntries with index=0 03:02:15,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config39: Elapsed time for generation of change events for member-1-shard-inventory-config39-DTCL-publisher: 148.0 μs [WARN] [03/07/2024 15:02:15.761] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config39-DTCL-publisher#858212085]: org.opendaylight.controller.cluster.common.actor.Monitor@2560bcd0 03:02:15,762 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config39: Persisting ApplyJournalEntries with index=1 03:02:15,771 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config39 03:02:15,771 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config39 (Leader)_slicer-id-99: Closing 03:02:15,771 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Aborting 0 pending queued transactions 03:02:15,774 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config40, persistent : true [WARN] [03/07/2024 15:02:15.774] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain#-1784820808]: org.opendaylight.controller.cluster.common.actor.Monitor@22cdf58c 03:02:15,775 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testCreateTransactionOnChain/member-1-shard-inventory-config40-notifier#-818935602 created and ready for shard:member-1-shard-inventory-config40 [WARN] [03/07/2024 15:02:15.775] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/member-1-shard-inventory-config40-notifier#-818935602]: org.opendaylight.controller.cluster.common.actor.Monitor@4aaf6c6d 03:02:15,775 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateTransactionOnChain/shard-member-1:snapshot-read#572625821] [WARN] [03/07/2024 15:02:15.776] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/shard-member-1:snapshot-read#572625821]: org.opendaylight.controller.cluster.common.actor.Monitor@2984bda6 03:02:15,776 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config40 with journal batch size 3 03:02:15,777 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:15,778 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config40: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:15,778 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,778 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config40 is no longer the leader [WARN] [03/07/2024 15:02:15.778] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/user/testCreateTransactionOnChain#-1784820808]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@64aacdd 03:02:15,778 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from null to Follower 03:02:15,778 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40 (Follower): Received TimeoutNow - switching to Candidate 03:02:15,778 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40 (Candidate): Election: Candidate has following voting peers: [] 03:02:15,778 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: Set currentTerm=1, votedFor=member-1-shard-inventory-config40 03:02:15,778 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config40 (Candidate): Starting new election term 1 03:02:15,778 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config40 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:15,778 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config40 (Follower): Closing 03:02:15,778 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,778 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config40 is no longer the leader 03:02:15,778 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from Follower to Candidate 03:02:15,779 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40 (Candidate): Received ElectionTimeout 03:02:15,779 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40 (Leader): Election: Leader has following peers: [] 03:02:15,779 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config40 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:15,779 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: true, hasLeader : true 03:02:15,779 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: became leader with frontend state for [] 03:02:15,779 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from Candidate to Leader 03:02:15,839 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:15,839 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,839 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,840 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: Creating transaction : member-1-ShardTransactionTest-fe-0-txn-72-0 03:02:15,840 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testCreateTransactionOnChain/shard-inventory-member-1:ShardTransactionTest@0:72_3#746719478] [WARN] [03/07/2024 15:02:15.841] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/shard-inventory-member-1:ShardTransactionTest@0:72_3#746719478]: org.opendaylight.controller.cluster.common.actor.Monitor@5be230b9 03:02:15,841 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,841 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testCreateTransactionOnChain#-1784820808] 03:02:15,841 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: Moving last applied index from -1 to 0 03:02:15,842 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:15,842 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:15,842 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config40: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:15,842 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2518241} is already disabled 03:02:15,842 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: Persisting ApplyJournalEntries with index=0 03:02:15,852 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config40 03:02:15,852 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config40 (Leader)_slicer-id-101: Closing 03:02:15,853 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config40: Aborting 0 pending queued transactions 03:02:15,855 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config41, persistent : true 03:02:15,856 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config41 with journal batch size 3 [WARN] [03/07/2024 15:02:15.857] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRegisterDataTreeChangeListener]: org.opendaylight.controller.cluster.common.actor.Monitor@1b0d963e 03:02:15,857 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-notifier#-2068169302 created and ready for shard:member-1-shard-inventory-config41 03:02:15,857 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/shard-member-1:snapshot-read#-1173082161] [WARN] [03/07/2024 15:02:15.857] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-notifier#-2068169302]: org.opendaylight.controller.cluster.common.actor.Monitor@5c84c694 [WARN] [03/07/2024 15:02:15.857] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/shard-member-1:snapshot-read#-1173082161]: org.opendaylight.controller.cluster.common.actor.Monitor@4b7d82bc 03:02:15,859 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:15,859 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config41: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:15,859 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,859 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config41 is no longer the leader 03:02:15,859 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from null to Follower 03:02:15,860 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41 (Follower): Received TimeoutNow - switching to Candidate 03:02:15,860 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41 (Candidate): Election: Candidate has following voting peers: [] 03:02:15,860 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Set currentTerm=1, votedFor=member-1-shard-inventory-config41 03:02:15,860 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config41 (Candidate): Starting new election term 1 03:02:15,860 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config41 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:15,860 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config41 (Follower): Closing 03:02:15,860 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: false, hasLeader : false 03:02:15,860 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config41 is no longer the leader 03:02:15,860 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from Follower to Candidate 03:02:15,860 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41 (Candidate): Received ElectionTimeout 03:02:15,861 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41 (Leader): Election: Leader has following peers: [] 03:02:15,861 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config41 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:15,861 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: true, hasLeader : true [WARN] [03/07/2024 15:02:15.860] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testRegisterDataTreeChangeListener]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@6307a8a0 03:02:15,861 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: became leader with frontend state for [] 03:02:15,861 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from Candidate to Leader 03:02:15,911 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#1104920183] [WARN] [03/07/2024 15:02:15.911] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#1104920183]: org.opendaylight.controller.cluster.common.actor.Monitor@49f61d1a 03:02:15,922 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#1104920183]], isLeader: true, hasLeader: true 03:02:15,922 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/$a#-1028645784] 03:02:15,922 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config41: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@5c9ac7a1 03:02:15,922 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test [WARN] [03/07/2024 15:02:15.922] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/$a#-1028645784]: org.opendaylight.controller.cluster.common.actor.Monitor@564fa93 03:02:15,923 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config41: Created publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-DTCL-publisher#1553950988] with name member-1-shard-inventory-config41-DTCL-publisher 03:02:15,923 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config41: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] to publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-DTCL-publisher#1553950988] 03:02:15,923 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testRegisterDataTreeChangeListener/$a 03:02:15,923 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-DTCL-publisher#1553950988] 03:02:15,923 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config41: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] 03:02:15,923 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] [WARN] [03/07/2024 15:02:15.923] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-DTCL-publisher#1553950988]: org.opendaylight.controller.cluster.common.actor.Monitor@719b3d47 03:02:15,924 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ForwardingDataTreeChangeListener - Sending OnInitialData to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] 03:02:15,924 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 03:02:15,924 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config41: Notifying onInitialData to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@5c9ac7a1 03:02:15,924 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:15,924 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,924 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-73-0 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Readying Tx member-1-ShardTransactionTest-fe-0-txn-73-0 of 1 operations, client version 13 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: readying transaction member-1-ShardTransactionTest-fe-0-txn-73-0 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: transaction member-1-ShardTransactionTest-fe-0-txn-73-0 ready 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Validating transaction member-1-ShardTransactionTest-fe-0-txn-73-0 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-73-0 validated 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-73-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: canCommit for member-1-ShardTransactionTest-fe-0-txn-73-0: success 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Committing transaction member-1-ShardTransactionTest-fe-0-txn-73-0 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-73-0 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-73-0 candidate ready 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-73-0: canCommit - candidate rootPath: / 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-73-0: canCommit - messages: [] 03:02:15,925 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-73-0: preCommit - successfulFromPrevious: [] 03:02:15,926 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-73-0 prepared 03:02:15,926 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-73-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:15,926 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-73-0 03:02:15,926 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-73-0 03:02:15,926 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:15,926 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:15,926 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:15,926 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-73-0 submitted to persistence 03:02:15,927 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:15,927 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Moving last applied index from -1 to 0 03:02:15,927 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:15,927 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:15,927 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config41: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:15,927 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3223028} is already disabled 03:02:15,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:15,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Moving last applied index from 0 to 1 03:02:15,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Applying state for log index 1 data Simple{size=143} 03:02:15,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-73-0 03:02:15,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-73-0: commit - successfulFromPrevious: [] 03:02:15,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-73-0 changing state from COMMIT_PENDING to COMMITTED 03:02:15,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-73-0 committed as 0, sending response to Actor[akka://test/temp/testRegisterDataTreeChangeListener$h] 03:02:15,928 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: publishChanges: rootPath: / 03:02:15,928 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 03:02:15,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: fakeSnapshot purging log to 0 for term 1 03:02:15,928 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] 03:02:15,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Persisting ApplyJournalEntries with index=0 03:02:15,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Persisting ApplyJournalEntries with index=1 03:02:15,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config41: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@5c9ac7a1 03:02:15,929 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config41: Elapsed time for generation of change events for member-1-shard-inventory-config41-DTCL-publisher: 406.5 μs 03:02:15,930 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#-2039824085] [WARN] [03/07/2024 15:02:15.930] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#-2039824085]: org.opendaylight.controller.cluster.common.actor.Monitor@5df2cc14 03:02:15,930 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#-2039824085]], isLeader: true, hasLeader: true 03:02:15,931 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/$b#-150938198] 03:02:15,931 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config41: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@7d3fcb51 03:02:15,931 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 03:02:15,931 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config41: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] to publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-DTCL-publisher#1553950988] 03:02:15,931 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testRegisterDataTreeChangeListener/$b 03:02:15,931 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config41: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] [WARN] [03/07/2024 15:02:15.931] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/$b#-150938198]: org.opendaylight.controller.cluster.common.actor.Monitor@52e914dd 03:02:15,931 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 03:02:15,931 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 03:02:15,931 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)] 03:02:15,932 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 03:02:15,932 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config41: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@7d3fcb51 03:02:16,432 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testRegisterDataTreeChangeListener] 03:02:16,443 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config41 03:02:16,444 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config41 (Leader)_slicer-id-103: Closing 03:02:16,444 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config41: Aborting 0 pending queued transactions 03:02:16,444 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#1104920183] 03:02:16,444 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#-2039824085] 03:02:16,446 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener8#-1118650574] [WARN] [03/07/2024 15:02:16.447] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener8#-1118650574]: org.opendaylight.controller.cluster.common.actor.Monitor@13e0cc4f 03:02:16,454 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config42, persistent : true [WARN] [03/07/2024 15:02:16.454] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9]: org.opendaylight.controller.cluster.common.actor.Monitor@3bef1fb5 [WARN] [03/07/2024 15:02:16.455] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config42-notifier#-815775498]: org.opendaylight.controller.cluster.common.actor.Monitor@6b4463c3 03:02:16,455 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config42-notifier#-815775498 created and ready for shard:member-1-shard-inventory-config42 03:02:16,455 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/shard-member-1:snapshot-read#-982443835] [WARN] [03/07/2024 15:02:16.455] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/shard-member-1:snapshot-read#-982443835]: org.opendaylight.controller.cluster.common.actor.Monitor@79952434 03:02:16,455 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config42 with journal batch size 3 03:02:16,457 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config42: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#1843407405] 03:02:16,457 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config42: SnapshotOffer called. 03:02:16,457 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config42: Moving last applied index from -1 to -1 03:02:16,457 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config42: Set currentTerm=1, votedFor=null 03:02:16,457 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config42: Applying recovered snapshot 03:02:16,457 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config42: clearing clients {} 03:02:16,458 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config42: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config42-DTCL-publisher#-923862746] with name member-1-shard-inventory-config42-DTCL-publisher 03:02:16,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config42-DTCL-publisher#-923862746] 03:02:16,458 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config42: state snapshot applied in 642.5 μs 03:02:16,458 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config42: publishChanges: rootPath: / 03:02:16,458 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Recovery snapshot applied for member-1-shard-inventory-config42 in 925.1 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 [WARN] [03/07/2024 15:02:16.458] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config42-DTCL-publisher#-923862746]: org.opendaylight.controller.cluster.common.actor.Monitor@4c9ddda5 03:02:16,459 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config42: Elapsed time for generation of change events for member-1-shard-inventory-config42-DTCL-publisher: 203.8 μs 03:02:16,459 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:16,459 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config42: Recovery completed in 1.822 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:16,459 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: false, hasLeader : false 03:02:16,459 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config42 is no longer the leader 03:02:16,459 PM [test-akka.actor.default-dispatcher-12] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 03:02:16,460 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from null to Follower [WARN] [03/07/2024 15:02:16.461] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@7e4e4c3a 03:02:16,560 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener8#-1118650574]], isLeader: false, hasLeader: false 03:02:16,560 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: Shard does not have a leader - delaying registration 03:02:16,560 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/$a 03:02:16,560 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/$a#-1341298325] [WARN] [03/07/2024 15:02:16.561] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/$a#-1341298325]: org.opendaylight.controller.cluster.common.actor.Monitor@471e93a 03:02:16,561 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config42: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig null 03:02:16,561 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config42: Re-initializing to Follower with previous leaderId null 03:02:16,562 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageAssembler - member-1-shard-inventory-config42 (Follower): Closing 03:02:16,562 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: false, hasLeader : false 03:02:16,562 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config42: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config42 is no longer the leader 03:02:16,562 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config42 (Follower): Received TimeoutNow - switching to Candidate 03:02:16,562 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config42 (Candidate): Election: Candidate has following voting peers: [] 03:02:16,562 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config42: Set currentTerm=2, votedFor=member-1-shard-inventory-config42 03:02:16,562 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config42 (Candidate): Starting new election term 2 03:02:16,562 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config42 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 03:02:16,562 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageAssembler - member-1-shard-inventory-config42 (Follower): Closing 03:02:16,562 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: false, hasLeader : false 03:02:16,562 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config42: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config42 is no longer the leader 03:02:16,562 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from Follower to Candidate 03:02:16,563 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config42 (Candidate): Received ElectionTimeout 03:02:16,563 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config42 (Leader): Election: Leader has following peers: [] 03:02:16,563 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config42 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 03:02:16,563 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: true, hasLeader : true 03:02:16,564 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config42: became leader with frontend state for [] 03:02:16,564 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from Candidate to Leader 03:02:17,62 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener8#-1118650574] 03:02:17,73 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9] 03:02:17,73 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Stopping Shard member-1-shard-inventory-config42 03:02:17,73 PM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageSlicer - member-1-shard-inventory-config42 (Leader)_slicer-id-105: Closing 03:02:17,73 PM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config42: Aborting 0 pending queued transactions 03:02:17,76 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Shard created : member-1-shard-inventory-config43, persistent : true [WARN] [03/07/2024 15:02:17.076] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@1d9a261a 03:02:17,77 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config43-notifier#-1074898986 created and ready for shard:member-1-shard-inventory-config43 [WARN] [03/07/2024 15:02:17.077] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config43-notifier#-1074898986]: org.opendaylight.controller.cluster.common.actor.Monitor@4cf05b2c 03:02:17,77 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/shard-member-1:snapshot-read#-2021678981] [WARN] [03/07/2024 15:02:17.077] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/shard-member-1:snapshot-read#-2021678981]: org.opendaylight.controller.cluster.common.actor.Monitor@46330922 03:02:17,77 PM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Starting recovery for member-1-shard-inventory-config43 with journal batch size 3 03:02:17,79 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:17,79 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config43: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:17,79 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: false, hasLeader : false 03:02:17,79 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config43 is no longer the leader 03:02:17,79 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from null to Follower [WARN] [03/07/2024 15:02:17.079] [test-akka.actor.default-dispatcher-16] [akka://test/user] unhandled message from TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@41c2cde9 03:02:17,80 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43 (Follower): Received TimeoutNow - switching to Candidate 03:02:17,80 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43 (Candidate): Election: Candidate has following voting peers: [] 03:02:17,80 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: Set currentTerm=1, votedFor=member-1-shard-inventory-config43 03:02:17,80 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config43 (Candidate): Starting new election term 1 03:02:17,80 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config43 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:17,80 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config43 (Follower): Closing 03:02:17,80 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: false, hasLeader : false 03:02:17,80 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config43 is no longer the leader 03:02:17,80 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from Follower to Candidate 03:02:17,81 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43 (Candidate): Received ElectionTimeout 03:02:17,81 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43 (Leader): Election: Leader has following peers: [] 03:02:17,81 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config43 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:17,81 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: true, hasLeader : true 03:02:17,81 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: became leader with frontend state for [] 03:02:17,81 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from Candidate to Leader 03:02:17,143 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-74-0 03:02:17,143 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:17,143 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:17,143 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:17,143 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-74-0 03:02:17,145 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:17,145 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: Moving last applied index from -1 to 0 03:02:17,145 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:17,145 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:17,145 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config43: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:17,145 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1607498} is already disabled 03:02:17,145 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: Persisting ApplyJournalEntries with index=0 03:02:17,145 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-74-0 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Validating transaction member-1-ShardTransactionTest-fe-0-txn-74-0 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 validated 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: canCommit for member-1-ShardTransactionTest-fe-0-txn-74-0: success 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: Committing transaction member-1-ShardTransactionTest-fe-0-txn-74-0 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-74-0 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 candidate ready 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-74-0: canCommit - candidate rootPath: / 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-74-0: canCommit - messages: [] 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-74-0: preCommit - successfulFromPrevious: [] 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 prepared 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-74-0 03:02:17,146 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-74-0 03:02:17,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 03:02:17,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 03:02:17,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 03:02:17,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 submitted to persistence 03:02:17,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 03:02:17,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: Moving last applied index from 0 to 1 03:02:17,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: Applying state for log index 1 data Simple{size=175} 03:02:17,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-74-0 03:02:17,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-74-0: commit - successfulFromPrevious: [] 03:02:17,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 changing state from COMMIT_PENDING to COMMITTED 03:02:17,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 committed as 0, sending response to Actor[akka://test/system/testProbe-190#-1295479629] 03:02:17,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config43: Created publisher actor Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config43-DTCL-publisher#1192668213] with name member-1-shard-inventory-config43-DTCL-publisher 03:02:17,149 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: fakeSnapshot purging log to 0 for term 1 03:02:17,149 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config43: Persisting ApplyJournalEntries with index=1 03:02:17,149 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config43-DTCL-publisher#1192668213] 03:02:17,149 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config43: publishChanges: rootPath: / 03:02:17,149 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit] [WARN] [03/07/2024 15:02:17.149] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config43-DTCL-publisher#1192668213]: org.opendaylight.controller.cluster.common.actor.Monitor@7e534850 03:02:17,149 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config43: Elapsed time for generation of change events for member-1-shard-inventory-config43-DTCL-publisher: 125.2 μs 03:02:17,160 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config43 03:02:17,160 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config43 (Leader)_slicer-id-107: Closing 03:02:17,160 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config43: Aborting 0 pending queued transactions 03:02:17,162 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config44, persistent : true [WARN] [03/07/2024 15:02:17.162] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry]: org.opendaylight.controller.cluster.common.actor.Monitor@6036325e 03:02:17,163 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config44-notifier#-1920702013 created and ready for shard:member-1-shard-inventory-config44 [WARN] [03/07/2024 15:02:17.163] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config44-notifier#-1920702013]: org.opendaylight.controller.cluster.common.actor.Monitor@5015897f 03:02:17,163 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/shard-member-1:snapshot-read#763826956] [WARN] [03/07/2024 15:02:17.163] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/shard-member-1:snapshot-read#763826956]: org.opendaylight.controller.cluster.common.actor.Monitor@28043e70 03:02:17,164 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config44 with journal batch size 3 03:02:17,165 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:17,165 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config44: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:17,165 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: false, hasLeader : false 03:02:17,165 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config44 is no longer the leader 03:02:17,165 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from null to Follower [WARN] [03/07/2024 15:02:17.165] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@5d56f9eb 03:02:17,165 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44 (Follower): Received TimeoutNow - switching to Candidate 03:02:17,165 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44 (Candidate): Election: Candidate has following voting peers: [] 03:02:17,165 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Set currentTerm=1, votedFor=member-1-shard-inventory-config44 03:02:17,165 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config44 (Candidate): Starting new election term 1 03:02:17,165 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config44 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:17,165 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config44 (Follower): Closing 03:02:17,165 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: false, hasLeader : false 03:02:17,165 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config44 is no longer the leader 03:02:17,165 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from Follower to Candidate 03:02:17,166 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44 (Candidate): Received ElectionTimeout 03:02:17,166 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44 (Leader): Election: Leader has following peers: [] 03:02:17,166 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config44 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:17,166 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: true, hasLeader : true 03:02:17,166 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: became leader with frontend state for [] 03:02:17,166 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from Candidate to Leader 03:02:17,226 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:17,226 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:17,226 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:17,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-75-0 03:02:17,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Readying Tx member-1-ShardTransactionTest-fe-0-txn-75-0 of 1 operations, client version 13 03:02:17,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: readying transaction member-1-ShardTransactionTest-fe-0-txn-75-0 03:02:17,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: transaction member-1-ShardTransactionTest-fe-0-txn-75-0 ready 03:02:17,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-75-0 03:02:17,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Validating transaction member-1-ShardTransactionTest-fe-0-txn-75-0 03:02:17,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-75-0 validated 03:02:17,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-75-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:17,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: canCommit for member-1-ShardTransactionTest-fe-0-txn-75-0: success 03:02:17,228 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-76-0 03:02:17,228 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Readying Tx member-1-ShardTransactionTest-fe-0-txn-76-0 of 1 operations, client version 13 03:02:17,228 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: readying transaction member-1-ShardTransactionTest-fe-0-txn-76-0 03:02:17,228 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: transaction member-1-ShardTransactionTest-fe-0-txn-76-0 ready 03:02:17,228 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:17,228 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from -1 to 0 03:02:17,228 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:17,228 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:17,228 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config44: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:17,228 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1759622} is already disabled 03:02:17,228 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=0 03:02:17,228 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-77-0 03:02:17,228 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-77-0 03:02:17,228 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Tx member-1-ShardTransactionTest-fe-0-txn-77-0 is scheduled for canCommit step 03:02:17,228 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Committing transaction member-1-ShardTransactionTest-fe-0-txn-75-0 03:02:17,228 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-75-0 03:02:17,229 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-75-0 candidate ready 03:02:17,229 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-75-0: canCommit - candidate rootPath: / 03:02:17,229 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-75-0: canCommit - messages: [] 03:02:17,229 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-75-0: preCommit - successfulFromPrevious: [] 03:02:17,229 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-75-0 prepared 03:02:17,229 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-75-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:17,229 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-75-0 03:02:17,229 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-75-0 03:02:17,229 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 03:02:17,229 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:17,229 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:17,229 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-75-0 submitted to persistence 03:02:17,230 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 03:02:17,230 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from 0 to 1 03:02:17,230 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 1 data Simple{size=143} 03:02:17,230 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-75-0 03:02:17,230 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-75-0: commit - successfulFromPrevious: [] 03:02:17,230 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-75-0 changing state from COMMIT_PENDING to COMMITTED 03:02:17,230 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-75-0 committed as 0, sending response to Actor[akka://test/system/testProbe-192#1818592340] 03:02:17,231 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config44: Created publisher actor Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config44-DTCL-publisher#-1735605830] with name member-1-shard-inventory-config44-DTCL-publisher 03:02:17,231 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config44-DTCL-publisher#-1735605830] 03:02:17,231 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config44: publishChanges: rootPath: / [WARN] [03/07/2024 15:02:17.231] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config44-DTCL-publisher#-1735605830]: org.opendaylight.controller.cluster.common.actor.Monitor@52c6da4c 03:02:17,232 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config44: Elapsed time for generation of change events for member-1-shard-inventory-config44-DTCL-publisher: 169.6 μs 03:02:17,232 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: fakeSnapshot purging log to 0 for term 1 03:02:17,232 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=1 03:02:17,841 PM [test-akka.actor.default-dispatcher-15] [WARN] ShardDataTree - member-1-shard-inventory-config44: Current transaction member-1-ShardTransactionTest-fe-0-txn-76-0 has timed out after 613 ms in state READY 03:02:17,841 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Validating transaction member-1-ShardTransactionTest-fe-0-txn-77-0 03:02:17,841 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-77-0 validated 03:02:17,842 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-77-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:17,842 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: canCommit for member-1-ShardTransactionTest-fe-0-txn-77-0: success 03:02:17,842 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: Committing transaction member-1-ShardTransactionTest-fe-0-txn-77-0 03:02:17,842 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-77-0 03:02:17,842 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-77-0 candidate ready 03:02:17,842 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-77-0: canCommit - candidate rootPath: / 03:02:17,842 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-77-0: canCommit - messages: [] 03:02:17,842 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-77-0: preCommit - successfulFromPrevious: [] 03:02:17,842 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-77-0 prepared 03:02:17,842 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-77-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 03:02:17,843 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-77-0 03:02:17,843 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-77-0 03:02:17,843 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 144 03:02:17,843 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=144}] 03:02:17,843 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=144}] 03:02:17,843 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-77-0 submitted to persistence 03:02:17,844 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=144}] 03:02:17,844 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from 1 to 2 03:02:17,844 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 2 data Simple{size=144} 03:02:17,844 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-77-0 03:02:17,844 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-77-0: commit - successfulFromPrevious: [] 03:02:17,844 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-77-0 changing state from COMMIT_PENDING to COMMITTED 03:02:17,844 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-77-0 committed as 0, sending response to Actor[akka://test/system/testProbe-192#1818592340] 03:02:17,845 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config44: publishChanges: rootPath: / 03:02:17,845 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config44: Elapsed time for generation of change events for member-1-shard-inventory-config44-DTCL-publisher: 172.0 μs 03:02:17,846 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: fakeSnapshot purging log to 1 for term 1 03:02:17,846 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=2 03:02:17,846 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry] 03:02:17,857 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config44 03:02:17,857 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config44 (Leader)_slicer-id-109: Closing 03:02:17,857 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Aborting 0 pending queued transactions 03:02:17,860 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config45, persistent : true [WARN] [03/07/2024 15:02:17.860] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPreCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@5addaaa0 03:02:17,861 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testPreCommitPhaseFailure/member-1-shard-inventory-config45-notifier#837374943 created and ready for shard:member-1-shard-inventory-config45 [WARN] [03/07/2024 15:02:17.861] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPreCommitPhaseFailure/member-1-shard-inventory-config45-notifier#837374943]: org.opendaylight.controller.cluster.common.actor.Monitor@ffb1236 03:02:17,861 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPreCommitPhaseFailure/shard-member-1:snapshot-read#2084294402] 03:02:17,862 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config45 with journal batch size 3 [WARN] [03/07/2024 15:02:17.862] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPreCommitPhaseFailure/shard-member-1:snapshot-read#2084294402]: org.opendaylight.controller.cluster.common.actor.Monitor@19a4f879 03:02:17,864 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:02:17,864 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config45: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 03:02:17,864 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: false, hasLeader : false 03:02:17,864 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config45 is no longer the leader 03:02:17,864 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from null to Follower 03:02:17,864 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45 (Follower): Received TimeoutNow - switching to Candidate 03:02:17,864 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45 (Candidate): Election: Candidate has following voting peers: [] 03:02:17,864 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Set currentTerm=1, votedFor=member-1-shard-inventory-config45 03:02:17,864 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config45 (Candidate): Starting new election term 1 03:02:17,864 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config45 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 03:02:17,864 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config45 (Follower): Closing 03:02:17,864 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: false, hasLeader : false 03:02:17,864 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config45 is no longer the leader 03:02:17,865 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from Follower to Candidate [WARN] [03/07/2024 15:02:17.865] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testPreCommitPhaseFailure]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@34364fb 03:02:17,865 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45 (Candidate): Received ElectionTimeout 03:02:17,865 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45 (Leader): Election: Leader has following peers: [] 03:02:17,865 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config45 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 03:02:17,865 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: true, hasLeader : true 03:02:17,865 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: became leader with frontend state for [] 03:02:17,866 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from Candidate to Leader 03:02:17,926 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config45: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 03:02:17,926 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config45: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:17,926 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config45: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:17,927 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config45: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-78-0 03:02:17,927 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config45: Readying Tx member-1-ShardTransactionTest-fe-0-txn-78-0 of 1 operations, client version 13 03:02:17,927 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: readying transaction member-1-ShardTransactionTest-fe-0-txn-78-0 03:02:17,927 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: transaction member-1-ShardTransactionTest-fe-0-txn-78-0 ready 03:02:17,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-79-0 03:02:17,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Readying Tx member-1-ShardTransactionTest-fe-0-txn-79-0 of 1 operations, client version 13 03:02:17,928 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: readying transaction member-1-ShardTransactionTest-fe-0-txn-79-0 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: transaction member-1-ShardTransactionTest-fe-0-txn-79-0 ready 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Moving last applied index from -1 to 0 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config45: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2559852} is already disabled 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Persisting ApplyJournalEntries with index=0 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-78-0 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Validating transaction member-1-ShardTransactionTest-fe-0-txn-78-0 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Transaction member-1-ShardTransactionTest-fe-0-txn-78-0 validated 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-78-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:17,929 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: canCommit for member-1-ShardTransactionTest-fe-0-txn-78-0: success 03:02:17,930 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-79-0 03:02:17,930 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Tx member-1-ShardTransactionTest-fe-0-txn-79-0 is scheduled for canCommit step 03:02:17,930 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Committing transaction member-1-ShardTransactionTest-fe-0-txn-78-0 03:02:17,930 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-78-0 03:02:17,930 PM [test-akka.actor.default-dispatcher-14] [ERROR] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-78-0 failed to prepare java.lang.RuntimeException: mock preCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1032) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:112) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:116) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:301) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:364) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:709) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:381) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:17,930 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-78-0: abort - successfulFromPrevious: [] 03:02:17,930 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-78-0 changing state from PRE_COMMIT_PENDING to FAILED 03:02:17,931 PM [test-akka.actor.default-dispatcher-14] [ERROR] Shard - member-1-shard-inventory-config45 An exception occurred while preCommitting transaction member-1-ShardTransactionTest-fe-0-txn-78-0 java.lang.RuntimeException: mock preCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1032) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:112) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:116) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:301) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:364) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:709) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:381) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 03:02:17,931 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Validating transaction member-1-ShardTransactionTest-fe-0-txn-79-0 03:02:17,931 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Transaction member-1-ShardTransactionTest-fe-0-txn-79-0 validated 03:02:17,931 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-79-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 03:02:17,931 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: canCommit for member-1-ShardTransactionTest-fe-0-txn-79-0: success 03:02:17,933 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPreCommitPhaseFailure] 03:02:17,944 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config45 03:02:17,944 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config45 (Leader)_slicer-id-111: Closing 03:02:17,945 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Aborting 1 pending queued transactions [WARN] [03/07/2024 15:02:17.945] [test-akka.actor.default-dispatcher-12] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testPreCommitPhaseFailure]: Failure(java.lang.RuntimeException: Transaction aborted due to shutdown.) [INFO] [03/07/2024 15:02:17.949] [test-akka.remote.default-remote-dispatcher-8] [akka://test@10.30.170.169:25520/system/remoting-terminator] Shutting down remote daemon. [INFO] [03/07/2024 15:02:17.949] [test-akka.remote.default-remote-dispatcher-8] [akka://test@10.30.170.169:25520/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. [INFO] [03/07/2024 15:02:17.953] [test-akka.remote.default-remote-dispatcher-9] [akka://test@10.30.170.169:25520/system/remoting-terminator] Remoting shut down. [DEBUG] [03/07/2024 15:02:17.953] [test-akka.actor.internal-dispatcher-2] [EventStream] shutting down: StandardOutLogger 03:02:17,953 PM [test-akka.actor.default-dispatcher-12] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 03:02:17,953 PM [test-akka.actor.default-dispatcher-12] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. 03:02:17,953 PM [test-akka.actor.default-dispatcher-12] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.