[DEBUG] [03/13/2024 12:26:21.513] [main] [EventStream(akka://test)] logger log1-TestEventListener started 12:26:21,513 PM [test-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [03/13/2024 12:26:21.514] [main] [EventStream(akka://test)] logger log2-Slf4jLogger started [DEBUG] [03/13/2024 12:26:21.514] [main] [EventStream(akka://test)] Default Loggers started [INFO] [03/13/2024 12:26:21.523] [main] [ArteryTransport(akka://test)] Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.170.237:25520] with UID [-3685786932064901467] 12:26:21,524 PM [test-akka.actor.default-dispatcher-6] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.170.237:25520] with UID [-3685786932064901467] 12:26:21,524 PM [test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://test@10.30.170.237:25520] - Starting up, Akka version [2.6.21] ... [INFO] [03/13/2024 12:26:21.524] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.237:25520] - Starting up, Akka version [2.6.21] ... 12:26:21,525 PM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.237:25520] - Registered cluster JMX MBean [akka:type=Cluster] 12:26:21,525 PM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.170.237:25520] - Started up successfully [INFO] [03/13/2024 12:26:21.525] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.237:25520] - Registered cluster JMX MBean [akka:type=Cluster] [INFO] [03/13/2024 12:26:21.525] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.237:25520] - Started up successfully [INFO] [03/13/2024 12:26:21.532] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.237:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing [INFO] [03/13/2024 12:26:21.532] [test-akka.actor.internal-dispatcher-3] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.237:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining 12:26:21,532 PM [test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://test@10.30.170.237:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing 12:26:21,532 PM [test-akka.actor.default-dispatcher-10] [INFO] Cluster - Cluster Node [akka://test@10.30.170.237:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining 12:26:21,538 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config10, persistent : true [WARN] [03/13/2024 12:26:21.538] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testApplySnapshot]: org.opendaylight.controller.cluster.common.actor.Monitor@695c5e8c [INFO] [akkaDeadLetter][03/13/2024 12:26:21.538] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [03/13/2024 12:26:21.539] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config10-notifier#-41928693]: org.opendaylight.controller.cluster.common.actor.Monitor@67c3598e 12:26:21,541 PM [test-akka.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,541 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#-374864] [WARN] [03/13/2024 12:26:21.541] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#-374864]: org.opendaylight.controller.cluster.common.actor.Monitor@17eccd2d [INFO] [akkaDeadLetter][03/13/2024 12:26:21.541] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#-374864] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,542 PM [test-akka.actor.default-dispatcher-14] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#-374864] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,543 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config10 with journal batch size 3 12:26:21,544 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testApplySnapshot/member-1-shard-inventory-config10-notifier#-41928693 created and ready for shard:member-1-shard-inventory-config10 12:26:21,544 PM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config10-notifier#-41928693] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/13/2024 12:26:21.544] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config10-notifier#-41928693] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,545 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config10: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:21,545 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config10: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:21,545 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,545 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config10: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config10 is no longer the leader 12:26:21,545 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from null to Follower 12:26:21,545 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config10 (Follower): Received TimeoutNow - switching to Candidate 12:26:21,545 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config10 (Candidate): Election: Candidate has following voting peers: [] 12:26:21,545 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config10: Set currentTerm=1, votedFor=member-1-shard-inventory-config10 12:26:21,545 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config10 (Candidate): Starting new election term 1 12:26:21,545 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config10 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:21,545 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config10 (Follower): Closing 12:26:21,545 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,545 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config10: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config10 is no longer the leader 12:26:21,545 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:21.546] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testApplySnapshot]] 12:26:21,546 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10 (Candidate): Received ElectionTimeout 12:26:21,546 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10 (Leader): Election: Leader has following peers: [] 12:26:21,546 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config10 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:21,546 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: true, hasLeader : true [INFO] [akkaDeadLetter][03/13/2024 12:26:21.546] [test-akka.actor.default-dispatcher-10] [akka://test/user] Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] to Actor[akka://test/user] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,546 PM [test-akka.actor.default-dispatcher-10] [INFO] LocalActorRef - Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] to Actor[akka://test/user] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,546 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: became leader with frontend state for [] 12:26:21,546 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from Candidate to Leader 12:26:21,638 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config10: Applying snapshot on follower: Snapshot [lastIndex=1, lastTerm=2, lastAppliedIndex=3, lastAppliedTerm=4, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@5ddd2005, electionTerm=-1, electionVotedFor=null, ServerConfigPayload=null] 12:26:21,638 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - lastSequenceNumber prior to persisting applied snapshot: 1 12:26:21,638 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config10: SaveSnapshotSuccess received for snapshot, sequenceNr: 1 12:26:21,638 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config10: Snapshot success - sequence number: 1 12:26:21,638 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config10: Moving last applied index from -1 to 3 12:26:21,638 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config10: Set currentTerm=-1, votedFor=null 12:26:21,638 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config10: Applying snapshot 12:26:21,638 PM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config10: clearing clients {} 12:26:21,639 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config10: Created publisher actor Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config10-DTCL-publisher#-1369786549] with name member-1-shard-inventory-config10-DTCL-publisher 12:26:21,639 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config10-DTCL-publisher#-1369786549] 12:26:21,639 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: state snapshot applied in 374.0 μs 12:26:21,639 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config10: Done applying snapshot 12:26:21,639 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config10: publishChanges: rootPath: / 12:26:21,639 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config10: SnapshotComplete received [WARN] [03/13/2024 12:26:21.639] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config10-DTCL-publisher#-1369786549]: org.opendaylight.controller.cluster.common.actor.Monitor@200c8214 [INFO] [akkaDeadLetter][03/13/2024 12:26:21.639] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config10-DTCL-publisher#-1369786549] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,639 PM [test-akka.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config10-DTCL-publisher#-1369786549] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,639 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config10: handled a snapshot response 12:26:21,639 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config10: handled a journal response 12:26:21,639 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config10: Elapsed time for generation of change events for member-1-shard-inventory-config10-DTCL-publisher: 98.18 μs 12:26:21,713 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testApplySnapshot] 12:26:21,724 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config10 12:26:21,724 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config10 (Leader)_slicer-id-662: Closing 12:26:21,724 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: Aborting 0 pending queued transactions 12:26:21,726 PM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config11, persistent : true 12:26:21,727 PM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config11 with journal batch size 3 12:26:21,728 PM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config11, persistent : false [WARN] [03/13/2024 12:26:21.730] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPersistence1]: org.opendaylight.controller.cluster.common.actor.Monitor@798f8186 [WARN] [03/13/2024 12:26:21.730] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPersistence2]: org.opendaylight.controller.cluster.common.actor.Monitor@44d81a8e [INFO] [akkaDeadLetter][03/13/2024 12:26:21.730] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence1] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/13/2024 12:26:21.730] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence2] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,730 PM [test-akka.actor.default-dispatcher-10] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence1] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,730 PM [test-akka.actor.default-dispatcher-10] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence2] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,730 PM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config11 with journal batch size 3 12:26:21,730 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#-132985035] 12:26:21,730 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testPersistence1/member-1-shard-inventory-config11-notifier#-783388443 created and ready for shard:member-1-shard-inventory-config11 [WARN] [03/13/2024 12:26:21.730] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config11-notifier#-783388443]: org.opendaylight.controller.cluster.common.actor.Monitor@4989bb7 [WARN] [03/13/2024 12:26:21.730] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#-132985035]: org.opendaylight.controller.cluster.common.actor.Monitor@2beefa94 12:26:21,730 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPersistence1] [INFO] [akkaDeadLetter][03/13/2024 12:26:21.730] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config11-notifier#-783388443] to Actor[akka://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/13/2024 12:26:21.730] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#-132985035] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,730 PM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config11-notifier#-783388443] to Actor[akka://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,730 PM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#-132985035] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,730 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPersistence2/shard-member-1:snapshot-read#-1325514440] [WARN] [03/13/2024 12:26:21.731] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence2/member-1-shard-inventory-config11-notifier#-1469939751]: org.opendaylight.controller.cluster.common.actor.Monitor@682c345d [WARN] [03/13/2024 12:26:21.731] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence2/shard-member-1:snapshot-read#-1325514440]: org.opendaylight.controller.cluster.common.actor.Monitor@616f0d38 12:26:21,731 PM [test-akka.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence2/shard-member-1:snapshot-read#-1325514440] to Actor[akka://test/user/termination-monitor] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/13/2024 12:26:21.731] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence2/shard-member-1:snapshot-read#-1325514440] to Actor[akka://test/user/termination-monitor] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 12:26:21,731 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testPersistence2/member-1-shard-inventory-config11-notifier#-1469939751 created and ready for shard:member-1-shard-inventory-config11 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config11: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config11 is no longer the leader 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11 (Follower): Received TimeoutNow - switching to Candidate 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11 (Candidate): Election: Candidate has following voting peers: [] 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11: Set currentTerm=1, votedFor=member-1-shard-inventory-config11 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config11 (Candidate): Starting new election term 1 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config11 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config11 (Follower): Closing 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config11 is no longer the leader 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from null to Follower 12:26:21,734 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:21.735] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testPersistence1]] 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.UpdateElectionTerm from Actor[akka://test/deadLetters] 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11: Set currentTerm=1, votedFor=member-1-shard-inventory-config11 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config11: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config11 is no longer the leader 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11 (Follower): Received TimeoutNow - switching to Candidate 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11 (Candidate): Election: Candidate has following voting peers: [] [WARN] [03/13/2024 12:26:21.735] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testPersistence2]] 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11: Set currentTerm=2, votedFor=member-1-shard-inventory-config11 12:26:21,735 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from null to Follower 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config11 (Candidate): Starting new election term 2 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config11 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config11 (Follower): Closing 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,735 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config11 is no longer the leader 12:26:21,735 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from Follower to Candidate 12:26:21,740 PM [main] [DEBUG] Shard - member-1-shard-inventory-config11 (Candidate): Received ElectionTimeout 12:26:21,740 PM [main] [DEBUG] Shard - member-1-shard-inventory-config11 (Leader): Election: Leader has following peers: [] 12:26:21,740 PM [main] [INFO] Shard - member-1-shard-inventory-config11 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:21,740 PM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: true, hasLeader : true 12:26:21,740 PM [main] [DEBUG] Shard - member-1-shard-inventory-config11: became leader with frontend state for [] 12:26:21,740 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from Candidate to Leader 12:26:21,741 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Stopping Shard member-1-shard-inventory-config11 12:26:21,741 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageSlicer - member-1-shard-inventory-config11 (Leader)_slicer-id-665: Closing 12:26:21,741 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config11: Aborting 0 pending queued transactions 12:26:21,741 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPersistence2] 12:26:21,741 PM [main] [DEBUG] Shard - member-1-shard-inventory-config11 (Candidate): Received ElectionTimeout 12:26:21,741 PM [main] [DEBUG] Shard - member-1-shard-inventory-config11 (Leader): Election: Leader has following peers: [] 12:26:21,741 PM [main] [INFO] Shard - member-1-shard-inventory-config11 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 12:26:21,741 PM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: true, hasLeader : true 12:26:21,741 PM [main] [DEBUG] Shard - member-1-shard-inventory-config11: became leader with frontend state for [] 12:26:21,741 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from Candidate to Leader 12:26:21,741 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config11 12:26:21,741 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config11 (Leader)_slicer-id-666: Closing 12:26:21,741 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config11: Aborting 0 pending queued transactions 12:26:21,743 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$5 - Shard created : member-1-shard-inventory-config12, persistent : true [WARN] [03/13/2024 12:26:21.743] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortWithCommitPending]: org.opendaylight.controller.cluster.common.actor.Monitor@4cf8ae30 12:26:21,744 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testAbortWithCommitPending/member-1-shard-inventory-config12-notifier#-1557744724 created and ready for shard:member-1-shard-inventory-config12 [WARN] [03/13/2024 12:26:21.744] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config12-notifier#-1557744724]: org.opendaylight.controller.cluster.common.actor.Monitor@67887a8e 12:26:21,744 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortWithCommitPending/shard-member-1:snapshot-read#430963442] 12:26:21,744 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$5 - Starting recovery for member-1-shard-inventory-config12 with journal batch size 3 [WARN] [03/13/2024 12:26:21.744] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/shard-member-1:snapshot-read#430963442]: org.opendaylight.controller.cluster.common.actor.Monitor@35cd4402 12:26:21,746 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:21,746 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$5 - member-1-shard-inventory-config12: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:21,746 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,746 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config12 is no longer the leader 12:26:21,746 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12 (Follower): Received TimeoutNow - switching to Candidate 12:26:21,746 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from null to Follower 12:26:21,746 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12 (Candidate): Election: Candidate has following voting peers: [] 12:26:21,746 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Set currentTerm=1, votedFor=member-1-shard-inventory-config12 12:26:21,746 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$5 - member-1-shard-inventory-config12 (Candidate): Starting new election term 1 12:26:21,746 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$5 - member-1-shard-inventory-config12 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:21,746 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config12 (Follower): Closing 12:26:21,746 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,746 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config12 is no longer the leader 12:26:21,746 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:21.746] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testAbortWithCommitPending]] 12:26:21,747 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12 (Candidate): Received ElectionTimeout 12:26:21,747 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12 (Leader): Election: Leader has following peers: [] 12:26:21,747 PM [test-akka.actor.default-dispatcher-10] [INFO] ShardTest$5 - member-1-shard-inventory-config12 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:21,747 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: true, hasLeader : true 12:26:21,748 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: became leader with frontend state for [] 12:26:21,748 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from Candidate to Leader 12:26:21,758 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:21,758 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:21,758 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:21,758 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-201-0 12:26:21,759 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Readying Tx member-1-ShardTransactionTest-fe-0-txn-201-0 of 1 operations, client version 13 12:26:21,759 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: readying transaction member-1-ShardTransactionTest-fe-0-txn-201-0 12:26:21,759 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: transaction member-1-ShardTransactionTest-fe-0-txn-201-0 ready 12:26:21,759 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-201-0 12:26:21,759 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Validating transaction member-1-ShardTransactionTest-fe-0-txn-201-0 12:26:21,759 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-txn-201-0 validated 12:26:21,759 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-201-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:21,759 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: canCommit for member-1-ShardTransactionTest-fe-0-txn-201-0: success 12:26:21,759 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Committing transaction member-1-ShardTransactionTest-fe-0-txn-201-0 12:26:21,759 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-201-0 12:26:21,760 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-txn-201-0 candidate ready 12:26:21,760 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-201-0: canCommit - candidate rootPath: / 12:26:21,760 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-201-0: canCommit - messages: [] 12:26:21,760 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-201-0: preCommit - successfulFromPrevious: [] 12:26:21,760 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-txn-201-0 prepared 12:26:21,760 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-201-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:21,760 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-201-0 12:26:21,760 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-201-0 12:26:21,760 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:21,760 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-201-0 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [WARN] ShardDataTree - member-1-shard-inventory-config12: transaction member-1-ShardTransactionTest-fe-0-txn-201-0 is committing, skipping abort 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-txn-201-0 submitted to persistence 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Moving last applied index from -1 to 0 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config12: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3016974} is already disabled 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Persisting ApplyJournalEntries with index=0 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Moving last applied index from 0 to 1 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Applying state for log index 1 data Simple{size=143} 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-201-0 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-201-0: commit - successfulFromPrevious: [] 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-201-0 changing state from COMMIT_PENDING to COMMITTED 12:26:21,761 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-txn-201-0 committed as 0, sending response to Actor[akka://test/system/testProbe-693#-529635098] 12:26:21,762 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config12: Created publisher actor Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config12-DTCL-publisher#452630718] with name member-1-shard-inventory-config12-DTCL-publisher 12:26:21,762 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortWithCommitPending] 12:26:21,762 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config12-DTCL-publisher#452630718] 12:26:21,762 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: fakeSnapshot purging log to 0 for term 1 12:26:21,762 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Persisting ApplyJournalEntries with index=1 12:26:21,762 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config12: publishChanges: rootPath: / [WARN] [03/13/2024 12:26:21.762] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config12-DTCL-publisher#452630718]: org.opendaylight.controller.cluster.common.actor.Monitor@6c0f57e2 12:26:21,762 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config12: Elapsed time for generation of change events for member-1-shard-inventory-config12-DTCL-publisher: 86.03 μs 12:26:21,772 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$5 - Stopping Shard member-1-shard-inventory-config12 12:26:21,772 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageSlicer - member-1-shard-inventory-config12 (Leader)_slicer-id-668: Closing 12:26:21,772 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$5 - member-1-shard-inventory-config12: Aborting 0 pending queued transactions 12:26:21,774 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - Shard created : member-1-shard-inventory-config13, persistent : true 12:26:21,774 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - Starting recovery for member-1-shard-inventory-config13 with journal batch size 3 [WARN] [03/13/2024 12:26:21.774] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.common.actor.Monitor@1de7b70 12:26:21,775 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testAbortAfterReady/member-1-shard-inventory-config13-notifier#-931597106 created and ready for shard:member-1-shard-inventory-config13 12:26:21,775 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-1990528111] [WARN] [03/13/2024 12:26:21.775] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config13-notifier#-931597106]: org.opendaylight.controller.cluster.common.actor.Monitor@1d389d44 [WARN] [03/13/2024 12:26:21.775] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-1990528111]: org.opendaylight.controller.cluster.common.actor.Monitor@4057fd13 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config13: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config13: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config13: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config13 is no longer the leader 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config13 (Follower): Received TimeoutNow - switching to Candidate 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config13 (Candidate): Election: Candidate has following voting peers: [] 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config13: Set currentTerm=1, votedFor=member-1-shard-inventory-config13 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config13 (Candidate): Starting new election term 1 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config13 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config13 (Follower): Closing 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config13: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config13 is no longer the leader 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from null to Follower 12:26:21,776 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:21.776] [test-akka.actor.default-dispatcher-10] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testAbortAfterReady]] 12:26:21,777 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13 (Candidate): Received ElectionTimeout 12:26:21,777 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13 (Leader): Election: Leader has following peers: [] 12:26:21,777 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config13 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:21,777 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: true, hasLeader : true 12:26:21,777 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: became leader with frontend state for [] 12:26:21,777 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from Candidate to Leader 12:26:21,837 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:21,837 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:21,837 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:21,838 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-202-0 12:26:21,838 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: Readying Tx member-1-ShardTransactionTest-fe-0-txn-202-0 of 1 operations, client version 13 12:26:21,838 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: readying transaction member-1-ShardTransactionTest-fe-0-txn-202-0 12:26:21,838 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: transaction member-1-ShardTransactionTest-fe-0-txn-202-0 ready 12:26:21,838 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:21,838 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: Moving last applied index from -1 to 0 12:26:21,838 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:21,838 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:21,838 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config13: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:21,838 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=982194} is already disabled 12:26:21,838 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: Persisting ApplyJournalEntries with index=0 12:26:21,839 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-202-0 12:26:21,839 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: aborting head of queue member-1-ShardTransactionTest-fe-0-txn-202-0 in state member-1-ShardTransactionTest-fe-0-txn-202-0 12:26:21,839 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-202-0: abort - successfulFromPrevious: [] 12:26:21,839 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-202-0 12:26:21,840 PM [test-akka.actor.default-dispatcher-14] [ERROR] Shard - member-1-shard-inventory-config13: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-202-0 canCommit java.lang.IllegalStateException: member-1-shard-inventory-config13: Cannot canCommit transaction member-1-ShardTransactionTest-fe-0-txn-202-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:283) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:734) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:414) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:21,840 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-203-0 12:26:21,840 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: Readying Tx member-1-ShardTransactionTest-fe-0-txn-203-0 of 1 operations, client version 13 12:26:21,840 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: readying transaction member-1-ShardTransactionTest-fe-0-txn-203-0 12:26:21,840 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: transaction member-1-ShardTransactionTest-fe-0-txn-203-0 ready 12:26:21,840 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-203-0 12:26:21,840 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Validating transaction member-1-ShardTransactionTest-fe-0-txn-203-0 12:26:21,840 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-203-0 validated 12:26:21,840 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-203-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:21,840 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config13: canCommit for member-1-ShardTransactionTest-fe-0-txn-203-0: success 12:26:21,840 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterReady] 12:26:21,851 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config13 12:26:21,851 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config13 (Leader)_slicer-id-670: Closing 12:26:21,851 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Aborting 1 pending queued transactions 12:26:21,860 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$2$1 - Shard created : member-1-shard-inventory-config14, persistent : true [WARN] [03/13/2024 12:26:21.860] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader]: org.opendaylight.controller.cluster.common.actor.Monitor@5414b7fd 12:26:21,861 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testOnBatchedModificationsWhenNotLeader/member-1-shard-inventory-config14-notifier#-1224024963 created and ready for shard:member-1-shard-inventory-config14 [WARN] [03/13/2024 12:26:21.861] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/member-1-shard-inventory-config14-notifier#-1224024963]: org.opendaylight.controller.cluster.common.actor.Monitor@4e4d27ea 12:26:21,861 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/shard-member-1:snapshot-read#-629815633] [WARN] [03/13/2024 12:26:21.861] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/shard-member-1:snapshot-read#-629815633]: org.opendaylight.controller.cluster.common.actor.Monitor@4f5e780 12:26:21,861 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$2$1 - Starting recovery for member-1-shard-inventory-config14 with journal batch size 3 12:26:21,862 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config14: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:21,862 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$2$1 - member-1-shard-inventory-config14: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:21,862 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,862 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 12:26:21,862 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from null to Follower 12:26:21,862 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config14 (Follower): Received TimeoutNow - switching to Candidate 12:26:21,862 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config14 (Candidate): Election: Candidate has following voting peers: [] 12:26:21,862 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config14: Set currentTerm=1, votedFor=member-1-shard-inventory-config14 12:26:21,862 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$2$1 - member-1-shard-inventory-config14 (Candidate): Starting new election term 1 12:26:21,862 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$2$1 - member-1-shard-inventory-config14 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:21,862 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config14 (Follower): Closing 12:26:21,862 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,862 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 12:26:21,862 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:21.863] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader]] 12:26:21,863 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config14 (Candidate): Received ElectionTimeout 12:26:21,863 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config14 (Leader): Election: Leader has following peers: [] 12:26:21,863 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$2$1 - member-1-shard-inventory-config14 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:21,863 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: true, hasLeader : true 12:26:21,863 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config14: became leader with frontend state for [] 12:26:21,863 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Candidate to Leader 12:26:21,923 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config14: Forwarding 1 BatchedModifications to leader ActorSelection[Anchor(akka://test/), Path(/system/testProbe-697)] 12:26:21,924 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader] 12:26:21,935 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$2$1 - Stopping Shard member-1-shard-inventory-config14 12:26:21,935 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config14 (Leader)_slicer-id-672: Closing 12:26:21,935 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config14: Aborting 0 pending queued transactions 12:26:21,936 PM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config15, persistent : true [WARN] [03/13/2024 12:26:21.936] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testOnDatastoreContext]: org.opendaylight.controller.cluster.common.actor.Monitor@78670ebe 12:26:21,937 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testOnDatastoreContext/member-1-shard-inventory-config15-notifier#897915836 created and ready for shard:member-1-shard-inventory-config15 12:26:21,937 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testOnDatastoreContext/shard-member-1:snapshot-read#-753773461] [WARN] [03/13/2024 12:26:21.937] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnDatastoreContext/member-1-shard-inventory-config15-notifier#897915836]: org.opendaylight.controller.cluster.common.actor.Monitor@9aaf4d4 [WARN] [03/13/2024 12:26:21.937] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnDatastoreContext/shard-member-1:snapshot-read#-753773461]: org.opendaylight.controller.cluster.common.actor.Monitor@22c8db86 12:26:21,937 PM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config15 with journal batch size 3 12:26:21,940 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config15: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:21,940 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config15: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:21,940 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,940 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config15: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config15 is no longer the leader 12:26:21,940 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from null to Follower 12:26:21,940 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config15 (Follower): Received TimeoutNow - switching to Candidate 12:26:21,940 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config15 (Candidate): Election: Candidate has following voting peers: [] 12:26:21,940 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config15: Set currentTerm=1, votedFor=member-1-shard-inventory-config15 12:26:21,940 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config15 (Candidate): Starting new election term 1 12:26:21,940 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config15 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:21,940 PM [test-akka.actor.default-dispatcher-10] [DEBUG] MessageAssembler - member-1-shard-inventory-config15 (Follower): Closing 12:26:21,940 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: false, hasLeader : false 12:26:21,940 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config15: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config15 is no longer the leader 12:26:21,940 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:21.941] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testOnDatastoreContext]] 12:26:22,91 PM [main] [DEBUG] Shard - member-1-shard-inventory-config15 (Candidate): Received ElectionTimeout 12:26:22,91 PM [main] [DEBUG] Shard - member-1-shard-inventory-config15 (Leader): Election: Leader has following peers: [] 12:26:22,91 PM [main] [INFO] Shard - member-1-shard-inventory-config15 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:22,91 PM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: true, hasLeader : true 12:26:22,91 PM [main] [DEBUG] Shard - member-1-shard-inventory-config15: became leader with frontend state for [] 12:26:22,91 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from Candidate to Leader 12:26:22,91 PM [main] [DEBUG] Shard - member-1-shard-inventory-config15: RaftPolicy used with prev.config null, RaftPolicy used with newConfig null 12:26:22,92 PM [main] [INFO] Shard - member-1-shard-inventory-config15: Persistence has been enabled - capturing snapshot 12:26:22,92 PM [main] [DEBUG] Shard - Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1 12:26:22,92 PM [main] [DEBUG] Shard - member-1-shard-inventory-config15: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 12:26:22,92 PM [main] [INFO] Shard - member-1-shard-inventory-config15: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true] 12:26:22,92 PM [main] [DEBUG] Shard - member-1-shard-inventory-config15: lastSequenceNumber prior to capture: 1 [WARN] [03/13/2024 12:26:22.092] [test-akka.actor.default-dispatcher-5] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testOnDatastoreContext]: org.opendaylight.controller.cluster.raft.client.messages.FindLeaderReply@70668c97 12:26:22,92 PM [main] [DEBUG] Shard - member-1-shard-inventory-config15: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}} 12:26:22,92 PM [main] [DEBUG] Shard - member-1-shard-inventory-config15: RaftPolicy used with prev.config null, RaftPolicy used with newConfig null 12:26:22,92 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testOnDatastoreContext] 12:26:22,92 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config15: CaptureSnapshotReply received by actor 12:26:22,92 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config15: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@9360ef7, electionTerm=1, electionVotedFor=member-1-shard-inventory-config15, ServerConfigPayload=null] 12:26:22,92 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config15: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1 12:26:22,92 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config15: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 12:26:22,92 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-17] [INFO] Shard - member-1-shard-inventory-config15: SaveSnapshotSuccess received for snapshot, sequenceNr: 1 12:26:22,92 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-17] [DEBUG] Shard - member-1-shard-inventory-config15: Snapshot success - sequence number: 1 12:26:22,92 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-17] [DEBUG] Shard - member-1-shard-inventory-config15: SnapshotComplete received 12:26:22,92 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-17] [DEBUG] Shard - member-1-shard-inventory-config15: handled a snapshot response 12:26:22,93 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config15: handled a journal response 12:26:22,103 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config15 12:26:22,103 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config15 (Leader)_slicer-id-674: Closing 12:26:22,103 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config15: Aborting 0 pending queued transactions 12:26:22,107 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Shard created : member-1-shard-inventory-config16, persistent : true [WARN] [03/13/2024 12:26:22.107] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCanCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@237b3eb5 12:26:22,108 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testCanCommitPhaseFailure/member-1-shard-inventory-config16-notifier#-1680613296 created and ready for shard:member-1-shard-inventory-config16 [WARN] [03/13/2024 12:26:22.108] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitPhaseFailure/member-1-shard-inventory-config16-notifier#-1680613296]: org.opendaylight.controller.cluster.common.actor.Monitor@2b31ec3e 12:26:22,108 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCanCommitPhaseFailure/shard-member-1:snapshot-read#-427278914] [WARN] [03/13/2024 12:26:22.108] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitPhaseFailure/shard-member-1:snapshot-read#-427278914]: org.opendaylight.controller.cluster.common.actor.Monitor@33ca0108 12:26:22,108 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Starting recovery for member-1-shard-inventory-config16 with journal batch size 3 12:26:22,109 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config16: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:22,109 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config16: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:22,109 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,109 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config16: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config16 is no longer the leader [WARN] [03/13/2024 12:26:22.109] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCanCommitPhaseFailure]] 12:26:22,109 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from null to Follower 12:26:22,109 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config16 (Follower): Received TimeoutNow - switching to Candidate 12:26:22,109 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config16 (Candidate): Election: Candidate has following voting peers: [] 12:26:22,109 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config16: Set currentTerm=1, votedFor=member-1-shard-inventory-config16 12:26:22,109 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config16 (Candidate): Starting new election term 1 12:26:22,109 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config16 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:22,109 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config16 (Follower): Closing 12:26:22,109 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,109 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config16: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config16 is no longer the leader 12:26:22,110 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from Follower to Candidate 12:26:22,110 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16 (Candidate): Received ElectionTimeout 12:26:22,110 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16 (Leader): Election: Leader has following peers: [] 12:26:22,110 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config16 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:22,110 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: true, hasLeader : true 12:26:22,110 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: became leader with frontend state for [] 12:26:22,110 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from Candidate to Leader 12:26:22,218 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:22,218 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,219 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,219 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-205-0 12:26:22,219 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: Readying Tx member-1-ShardTransactionTest-fe-0-txn-205-0 of 1 operations, client version 13 12:26:22,219 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: readying transaction member-1-ShardTransactionTest-fe-0-txn-205-0 12:26:22,219 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: transaction member-1-ShardTransactionTest-fe-0-txn-205-0 ready 12:26:22,220 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-205-0 12:26:22,220 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Validating transaction member-1-ShardTransactionTest-fe-0-txn-205-0 12:26:22,220 PM [test-akka.actor.default-dispatcher-10] [WARN] ShardDataTree - member-1-shard-inventory-config16: Store Tx member-1-ShardTransactionTest-fe-0-txn-205-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:292) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:734) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:414) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:22,220 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Store Tx member-1-ShardTransactionTest-fe-0-txn-205-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 12:26:22,221 PM [test-akka.actor.default-dispatcher-10] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-205-0 changing state from CAN_COMMIT_PENDING to FAILED 12:26:22,221 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-205-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:853) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:292) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:734) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:414) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) ... 34 more 12:26:22,221 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,221 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: Moving last applied index from -1 to 0 12:26:22,221 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:22,221 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:22,221 PM [test-akka.actor.default-dispatcher-10] [DEBUG] FrontendMetadata - member-1-shard-inventory-config16: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:22,221 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2798288} is already disabled 12:26:22,221 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-206-0 12:26:22,221 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: Readying Tx member-1-ShardTransactionTest-fe-0-txn-206-0 of 1 operations, client version 13 12:26:22,221 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: readying transaction member-1-ShardTransactionTest-fe-0-txn-206-0 12:26:22,221 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: transaction member-1-ShardTransactionTest-fe-0-txn-206-0 ready 12:26:22,222 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: Persisting ApplyJournalEntries with index=0 12:26:22,222 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-206-0 12:26:22,222 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Validating transaction member-1-ShardTransactionTest-fe-0-txn-206-0 12:26:22,222 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-206-0 validated 12:26:22,222 PM [test-akka.actor.default-dispatcher-10] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-206-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:22,222 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config16: canCommit for member-1-ShardTransactionTest-fe-0-txn-206-0: success 12:26:22,222 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCanCommitPhaseFailure] 12:26:22,233 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config16 12:26:22,233 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config16 (Leader)_slicer-id-676: Closing 12:26:22,233 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config16: Aborting 1 pending queued transactions 12:26:22,235 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config17, persistent : true 12:26:22,236 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config17 with journal batch size 3 [WARN] [03/13/2024 12:26:22.236] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterCanCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@3cc6695c 12:26:22,236 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testAbortAfterCanCommit/member-1-shard-inventory-config17-notifier#682625027 created and ready for shard:member-1-shard-inventory-config17 12:26:22,236 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterCanCommit/shard-member-1:snapshot-read#-1511396642] [WARN] [03/13/2024 12:26:22.236] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterCanCommit/member-1-shard-inventory-config17-notifier#682625027]: org.opendaylight.controller.cluster.common.actor.Monitor@42e643db [WARN] [03/13/2024 12:26:22.236] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterCanCommit/shard-member-1:snapshot-read#-1511396642]: org.opendaylight.controller.cluster.common.actor.Monitor@47c96d79 12:26:22,238 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config17: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:22,238 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config17: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:22,238 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,238 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config17: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config17 is no longer the leader [WARN] [03/13/2024 12:26:22.238] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testAbortAfterCanCommit]] 12:26:22,238 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config17 (Follower): Received TimeoutNow - switching to Candidate 12:26:22,238 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from null to Follower 12:26:22,238 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config17 (Candidate): Election: Candidate has following voting peers: [] 12:26:22,238 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config17: Set currentTerm=1, votedFor=member-1-shard-inventory-config17 12:26:22,238 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config17 (Candidate): Starting new election term 1 12:26:22,238 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config17 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:22,238 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config17 (Follower): Closing 12:26:22,238 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,238 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config17: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config17 is no longer the leader 12:26:22,238 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from Follower to Candidate 12:26:22,238 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17 (Candidate): Received ElectionTimeout 12:26:22,238 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17 (Leader): Election: Leader has following peers: [] 12:26:22,238 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config17 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:22,238 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: true, hasLeader : true 12:26:22,238 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: became leader with frontend state for [] 12:26:22,238 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from Candidate to Leader 12:26:22,345 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:22,346 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,346 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,346 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-207-0 12:26:22,346 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Readying Tx member-1-ShardTransactionTest-fe-0-txn-207-0 of 1 operations, client version 13 12:26:22,346 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: readying transaction member-1-ShardTransactionTest-fe-0-txn-207-0 12:26:22,346 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: transaction member-1-ShardTransactionTest-fe-0-txn-207-0 ready 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-208-0 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Readying Tx member-1-ShardTransactionTest-fe-0-txn-208-0 of 1 operations, client version 13 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: readying transaction member-1-ShardTransactionTest-fe-0-txn-208-0 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: transaction member-1-ShardTransactionTest-fe-0-txn-208-0 ready 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Moving last applied index from -1 to 0 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config17: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1385874} is already disabled 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-207-0 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Validating transaction member-1-ShardTransactionTest-fe-0-txn-207-0 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Transaction member-1-ShardTransactionTest-fe-0-txn-207-0 validated 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-207-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: canCommit for member-1-ShardTransactionTest-fe-0-txn-207-0: success 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Persisting ApplyJournalEntries with index=0 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-208-0 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Tx member-1-ShardTransactionTest-fe-0-txn-208-0 is scheduled for canCommit step 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-207-0 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: aborting head of queue member-1-ShardTransactionTest-fe-0-txn-207-0 in state member-1-ShardTransactionTest-fe-0-txn-207-0 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Validating transaction member-1-ShardTransactionTest-fe-0-txn-208-0 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Transaction member-1-ShardTransactionTest-fe-0-txn-208-0 validated 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-208-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: canCommit for member-1-ShardTransactionTest-fe-0-txn-208-0: success 12:26:22,347 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-207-0: abort - successfulFromPrevious: [] 12:26:22,348 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterCanCommit] 12:26:22,358 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Stopping Shard member-1-shard-inventory-config17 12:26:22,358 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageSlicer - member-1-shard-inventory-config17 (Leader)_slicer-id-678: Closing 12:26:22,358 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config17: Aborting 1 pending queued transactions [WARN] [03/13/2024 12:26:22.359] [test-akka.actor.default-dispatcher-5] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testAbortAfterCanCommit]: Failure(java.lang.RuntimeException: Transaction aborted due to shutdown.) 12:26:22,361 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Shard created : member-1-shard-inventory-config18, persistent : true [WARN] [03/13/2024 12:26:22.361] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testConcurrentThreePhaseCommits]: org.opendaylight.controller.cluster.common.actor.Monitor@3aecfb3c 12:26:22,362 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config18-notifier#1611107832 created and ready for shard:member-1-shard-inventory-config18 [WARN] [03/13/2024 12:26:22.362] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config18-notifier#1611107832]: org.opendaylight.controller.cluster.common.actor.Monitor@1dd5d30a 12:26:22,362 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testConcurrentThreePhaseCommits/shard-member-1:snapshot-read#-1308108262] [WARN] [03/13/2024 12:26:22.362] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/shard-member-1:snapshot-read#-1308108262]: org.opendaylight.controller.cluster.common.actor.Monitor@3232f030 12:26:22,362 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Starting recovery for member-1-shard-inventory-config18 with journal batch size 3 12:26:22,363 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:22,363 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config18: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [03/13/2024 12:26:22.363] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testConcurrentThreePhaseCommits]] 12:26:22,363 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config18: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,363 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config18 is no longer the leader 12:26:22,363 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config18 , received role change from null to Follower 12:26:22,363 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18 (Follower): Received TimeoutNow - switching to Candidate 12:26:22,363 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18 (Candidate): Election: Candidate has following voting peers: [] 12:26:22,363 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: Set currentTerm=1, votedFor=member-1-shard-inventory-config18 12:26:22,363 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config18 (Candidate): Starting new election term 1 12:26:22,363 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config18 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:22,363 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config18 (Follower): Closing 12:26:22,363 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config18: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,363 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config18 is no longer the leader 12:26:22,363 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config18 , received role change from Follower to Candidate 12:26:22,364 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18 (Candidate): Received ElectionTimeout 12:26:22,364 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18 (Leader): Election: Leader has following peers: [] 12:26:22,364 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config18 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:22,364 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config18: onLeadershipChange, isLeader: true, hasLeader : true 12:26:22,364 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: became leader with frontend state for [] 12:26:22,364 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config18 , received role change from Candidate to Leader 12:26:22,381 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:22,381 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,381 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,381 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-209-0 12:26:22,381 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: Readying Tx member-1-ShardTransactionTest-fe-0-txn-209-0 of 1 operations, client version 13 12:26:22,381 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: readying transaction member-1-ShardTransactionTest-fe-0-txn-209-0 12:26:22,381 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: transaction member-1-ShardTransactionTest-fe-0-txn-209-0 ready 12:26:22,381 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-209-0 12:26:22,384 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Validating transaction member-1-ShardTransactionTest-fe-0-txn-209-0 12:26:22,384 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-209-0 validated 12:26:22,384 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-209-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:22,385 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: canCommit for member-1-ShardTransactionTest-fe-0-txn-209-0: success 12:26:22,385 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,385 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: Moving last applied index from -1 to 0 12:26:22,385 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:22,385 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:22,385 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config18: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:22,385 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=4178752} is already disabled 12:26:22,385 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-210-0 12:26:22,385 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: Readying Tx member-1-ShardTransactionTest-fe-0-txn-210-0 of 1 operations, client version 13 12:26:22,385 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: readying transaction member-1-ShardTransactionTest-fe-0-txn-210-0 12:26:22,385 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: transaction member-1-ShardTransactionTest-fe-0-txn-210-0 ready 12:26:22,385 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: Persisting ApplyJournalEntries with index=0 12:26:22,386 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-211-0 12:26:22,386 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: Readying Tx member-1-ShardTransactionTest-fe-0-txn-211-0 of 1 operations, client version 13 12:26:22,386 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: readying transaction member-1-ShardTransactionTest-fe-0-txn-211-0 12:26:22,386 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: transaction member-1-ShardTransactionTest-fe-0-txn-211-0 ready 12:26:22,386 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-210-0 12:26:22,387 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Tx member-1-ShardTransactionTest-fe-0-txn-210-0 is scheduled for canCommit step 12:26:22,387 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-211-0 12:26:22,387 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Tx member-1-ShardTransactionTest-fe-0-txn-211-0 is scheduled for canCommit step 12:26:22,387 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: Committing transaction member-1-ShardTransactionTest-fe-0-txn-209-0 12:26:22,387 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-209-0 12:26:22,387 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-209-0 candidate ready 12:26:22,387 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-209-0: canCommit - candidate rootPath: / 12:26:22,387 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-209-0: canCommit - messages: [] 12:26:22,387 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-209-0: preCommit - successfulFromPrevious: [] 12:26:22,387 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-209-0 prepared 12:26:22,387 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-209-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:22,388 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-209-0 12:26:22,388 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-209-0 12:26:22,388 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:22,388 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Validating transaction member-1-ShardTransactionTest-fe-0-txn-210-0 12:26:22,388 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-210-0 validated 12:26:22,388 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-210-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:22,388 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: canCommit for member-1-ShardTransactionTest-fe-0-txn-210-0: success 12:26:22,388 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:22,388 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:22,388 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-209-0 submitted to persistence 12:26:22,391 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:22,391 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: Moving last applied index from 0 to 1 12:26:22,391 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: Applying state for log index 1 data Simple{size=143} 12:26:22,391 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-209-0 12:26:22,391 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-209-0: commit - successfulFromPrevious: [] 12:26:22,391 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-209-0 changing state from COMMIT_PENDING to COMMITTED 12:26:22,391 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-209-0 committed as 0, sending response to Actor[akka://test/system/testProbe-704#-1916320228] 12:26:22,391 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config18: Created publisher actor Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config18-DTCL-publisher#-1822533373] with name member-1-shard-inventory-config18-DTCL-publisher 12:26:22,391 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config18-DTCL-publisher#-1822533373] 12:26:22,391 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: fakeSnapshot purging log to 0 for term 1 12:26:22,391 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config18: Persisting ApplyJournalEntries with index=1 12:26:22,391 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config18: publishChanges: rootPath: / [WARN] [03/13/2024 12:26:22.391] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config18-DTCL-publisher#-1822533373]: org.opendaylight.controller.cluster.common.actor.Monitor@115664f2 12:26:22,392 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config18: Elapsed time for generation of change events for member-1-shard-inventory-config18-DTCL-publisher: 106.8 μs 12:26:22,394 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: Committing transaction member-1-ShardTransactionTest-fe-0-txn-210-0 12:26:22,394 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-210-0 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-210-0 candidate ready 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-210-0: canCommit - candidate rootPath: / 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-210-0: canCommit - messages: [] 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-210-0: preCommit - successfulFromPrevious: [] 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-210-0 prepared 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-210-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-210-0 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-210-0 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Validating transaction member-1-ShardTransactionTest-fe-0-txn-211-0 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-211-0 validated 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-211-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: canCommit for member-1-ShardTransactionTest-fe-0-txn-211-0: success 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-210-0 submitted to persistence 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: Committing transaction member-1-ShardTransactionTest-fe-0-txn-211-0 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-211-0 12:26:22,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-211-0 candidate ready 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-211-0: canCommit - candidate rootPath: / 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-211-0: canCommit - messages: [] 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-211-0: preCommit - successfulFromPrevious: [] 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-211-0 prepared 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-211-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-211-0 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-211-0 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: Persist data SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-211-0 submitted to persistence 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: Moving last applied index from 1 to 2 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: Applying state for log index 2 data Simple{size=45} 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-210-0 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-210-0: commit - successfulFromPrevious: [] 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-210-0 changing state from COMMIT_PENDING to COMMITTED 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-210-0 committed as 0, sending response to Actor[akka://test/temp/testConcurrentThreePhaseCommits$a] 12:26:22,396 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config18: publishChanges: rootPath: / 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: fakeSnapshot purging log to 1 for term 1 12:26:22,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config18: Persisting ApplyJournalEntries with index=2 12:26:22,396 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config18: Elapsed time for generation of change events for member-1-shard-inventory-config18-DTCL-publisher: 37.41 μs 12:26:22,398 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: persist complete SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 12:26:22,398 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Moving last applied index from 2 to 3 12:26:22,398 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Applying state for log index 3 data Simple{size=184} 12:26:22,398 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config18: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-211-0 12:26:22,398 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-211-0: commit - successfulFromPrevious: [] 12:26:22,398 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-211-0 changing state from COMMIT_PENDING to COMMITTED 12:26:22,398 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Transaction member-1-ShardTransactionTest-fe-0-txn-211-0 committed as 0, sending response to Actor[akka://test/temp/testConcurrentThreePhaseCommits$b] 12:26:22,398 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config18: publishChanges: rootPath: / 12:26:22,399 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config18: Elapsed time for generation of change events for member-1-shard-inventory-config18-DTCL-publisher: 79.11 μs 12:26:22,399 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: fakeSnapshot purging log to 2 for term 1 12:26:22,399 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Persisting ApplyJournalEntries with index=3 12:26:22,399 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testConcurrentThreePhaseCommits] 12:26:22,410 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config18 12:26:22,410 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config18 (Leader)_slicer-id-680: Closing 12:26:22,410 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Aborting 0 pending queued transactions 12:26:22,412 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - Shard created : member-1-shard-inventory-config19, persistent : true 12:26:22,412 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - Starting recovery for member-1-shard-inventory-config19 with journal batch size 3 [WARN] [03/13/2024 12:26:22.412] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true]: org.opendaylight.controller.cluster.common.actor.Monitor@75ef6b75 12:26:22,412 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config19-notifier#-237677402 created and ready for shard:member-1-shard-inventory-config19 12:26:22,412 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/shard-member-1:snapshot-read#1379347668] [WARN] [03/13/2024 12:26:22.412] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config19-notifier#-237677402]: org.opendaylight.controller.cluster.common.actor.Monitor@64ec959e [WARN] [03/13/2024 12:26:22.412] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/shard-member-1:snapshot-read#1379347668]: org.opendaylight.controller.cluster.common.actor.Monitor@6648f88e 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config19: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config19: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config19: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config19 is no longer the leader 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config19 (Follower): Received TimeoutNow - switching to Candidate 12:26:22,414 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from null to Follower 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config19 (Candidate): Election: Candidate has following voting peers: [] 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config19: Set currentTerm=1, votedFor=member-1-shard-inventory-config19 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config19 (Candidate): Starting new election term 1 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config19 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config19 (Follower): Closing 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config19: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config19 is no longer the leader [WARN] [03/13/2024 12:26:22.414] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true]] 12:26:22,414 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from Follower to Candidate 12:26:22,414 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19 (Candidate): Received ElectionTimeout 12:26:22,414 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19 (Leader): Election: Leader has following peers: [] 12:26:22,414 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config19 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:22,414 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: true, hasLeader : true 12:26:22,414 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: became leader with frontend state for [] 12:26:22,414 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from Candidate to Leader 12:26:22,476 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-212-0 12:26:22,476 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:22,476 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,476 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,476 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Readying transaction member-1-ShardTransactionTest-fe-0-txn-212-0, client version 13 12:26:22,476 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: readying transaction member-1-ShardTransactionTest-fe-0-txn-212-0 12:26:22,476 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: transaction member-1-ShardTransactionTest-fe-0-txn-212-0 ready 12:26:22,476 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Validating transaction member-1-ShardTransactionTest-fe-0-txn-212-0 12:26:22,476 PM [test-akka.actor.default-dispatcher-15] [WARN] ShardDataTree - member-1-shard-inventory-config19: Store Tx member-1-ShardTransactionTest-fe-0-txn-212-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleForwardedReadyTransaction(ShardCommitCoordinator.java:116) at org.opendaylight.controller.cluster.datastore.Shard.handleForwardedReadyTransaction(Shard.java:852) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:410) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:22,477 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Store Tx member-1-ShardTransactionTest-fe-0-txn-212-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 12:26:22,477 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-212-0 changing state from CAN_COMMIT_PENDING to FAILED 12:26:22,477 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-212-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:853) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleForwardedReadyTransaction(ShardCommitCoordinator.java:116) at org.opendaylight.controller.cluster.datastore.Shard.handleForwardedReadyTransaction(Shard.java:852) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:410) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) ... 34 more 12:26:22,477 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-213-0 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Readying transaction member-1-ShardTransactionTest-fe-0-txn-213-0, client version 13 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: readying transaction member-1-ShardTransactionTest-fe-0-txn-213-0 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: transaction member-1-ShardTransactionTest-fe-0-txn-213-0 ready 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Validating transaction member-1-ShardTransactionTest-fe-0-txn-213-0 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-213-0 validated 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-213-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: canCommit for member-1-ShardTransactionTest-fe-0-txn-213-0: success 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Committing transaction member-1-ShardTransactionTest-fe-0-txn-213-0 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-213-0 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-213-0 candidate ready 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-213-0: canCommit - candidate rootPath: / 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-213-0: canCommit - messages: [] 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-213-0: preCommit - successfulFromPrevious: [] 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-213-0 prepared 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-213-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-213-0 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-213-0 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-213-0 submitted to persistence 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Moving last applied index from -1 to 0 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config19: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2704726} is already disabled 12:26:22,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Persisting ApplyJournalEntries with index=0 12:26:22,479 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:22,479 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Moving last applied index from 0 to 1 12:26:22,479 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Applying state for log index 1 data Simple{size=143} 12:26:22,479 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-213-0 12:26:22,479 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-213-0: commit - successfulFromPrevious: [] 12:26:22,479 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-213-0 changing state from COMMIT_PENDING to COMMITTED 12:26:22,479 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-213-0 committed as 0, sending response to Actor[akka://test/system/testProbe-706#-1274350643] 12:26:22,479 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config19: Created publisher actor Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config19-DTCL-publisher#-1567496509] with name member-1-shard-inventory-config19-DTCL-publisher 12:26:22,479 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config19-DTCL-publisher#-1567496509] 12:26:22,480 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: fakeSnapshot purging log to 0 for term 1 12:26:22,480 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config19: publishChanges: rootPath: / 12:26:22,480 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config19: Persisting ApplyJournalEntries with index=1 12:26:22,480 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config19: Elapsed time for generation of change events for member-1-shard-inventory-config19-DTCL-publisher: 73.97 μs [WARN] [03/13/2024 12:26:22.480] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config19-DTCL-publisher#-1567496509]: org.opendaylight.controller.cluster.common.actor.Monitor@29d6c2d6 12:26:22,480 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config19, persistent : true [WARN] [03/13/2024 12:26:22.480] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false]: org.opendaylight.controller.cluster.common.actor.Monitor@2542d2d2 12:26:22,481 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config19-notifier#1223211190 created and ready for shard:member-1-shard-inventory-config19 12:26:22,481 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/shard-member-1:snapshot-read#-743078905] [WARN] [03/13/2024 12:26:22.481] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config19-notifier#1223211190]: org.opendaylight.controller.cluster.common.actor.Monitor@ace25d3 [WARN] [03/13/2024 12:26:22.481] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/shard-member-1:snapshot-read#-743078905]: org.opendaylight.controller.cluster.common.actor.Monitor@10e8f8b8 12:26:22,481 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config19 with journal batch size 3 12:26:22,486 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.UpdateElectionTerm from Actor[akka://test/deadLetters] 12:26:22,487 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Set currentTerm=1, votedFor=member-1-shard-inventory-config19 12:26:22,487 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:22,487 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Received ReplicatedLogEntry for recovery: index: 0, size: 37 12:26:22,487 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:22,487 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Received ReplicatedLogEntry for recovery: index: 1, size: 143 12:26:22,487 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 12:26:22,487 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Received apply journal entries for recovery, applying to state: 0 to 0 12:26:22,487 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: starting log recovery batch with max size 3 12:26:22,487 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: ignoring unhandled payload DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:22,487 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Moving last applied index from -1 to 0 12:26:22,487 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 12:26:22,487 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Received apply journal entries for recovery, applying to state: 1 to 1 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [DEBUG] FrontendMetadata - member-1-shard-inventory-config19: Added client Enabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@4ac033e1}, purged=MutableUnsignedLongSet{size=0}} 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config19: Committed transaction member-1-ShardTransactionTest-fe-0-txn-213-0 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Moving last applied index from 0 to 1 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config19: Recovery completed in 1.152 ms - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 2 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config19 is no longer the leader 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19 (Follower): Received TimeoutNow - switching to Candidate 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19 (Candidate): Election: Candidate has following voting peers: [] [WARN] [03/13/2024 12:26:22.488] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false]] 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Set currentTerm=2, votedFor=member-1-shard-inventory-config19 12:26:22,488 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from null to Follower 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config19 (Candidate): Starting new election term 2 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config19 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [DEBUG] MessageAssembler - member-1-shard-inventory-config19 (Follower): Closing 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,488 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config19 is no longer the leader 12:26:22,488 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from Follower to Candidate 12:26:22,489 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19 (Candidate): Received ElectionTimeout 12:26:22,489 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19 (Leader): Election: Leader has following peers: [] 12:26:22,489 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config19 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 12:26:22,489 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: true, hasLeader : true 12:26:22,489 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: became leader with frontend state for [member-1-frontend-ShardTransactionTest] 12:26:22,489 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from Candidate to Leader 12:26:22,591 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:22,591 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Persist data SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,591 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,591 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-214-0 12:26:22,591 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Readying Tx member-1-ShardTransactionTest-fe-0-txn-214-0 of 1 operations, client version 13 12:26:22,591 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: readying transaction member-1-ShardTransactionTest-fe-0-txn-214-0 12:26:22,591 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: transaction member-1-ShardTransactionTest-fe-0-txn-214-0 ready 12:26:22,591 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Validating transaction member-1-ShardTransactionTest-fe-0-txn-214-0 12:26:22,591 PM [test-akka.actor.default-dispatcher-10] [WARN] ShardDataTree - member-1-shard-inventory-config19: Store Tx member-1-ShardTransactionTest-fe-0-txn-214-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:173) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Store Tx member-1-ShardTransactionTest-fe-0-txn-214-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-214-0 changing state from CAN_COMMIT_PENDING to FAILED 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-214-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:853) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:173) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) ... 35 more 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-215-0 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Readying Tx member-1-ShardTransactionTest-fe-0-txn-215-0 of 1 operations, client version 13 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: readying transaction member-1-ShardTransactionTest-fe-0-txn-215-0 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: transaction member-1-ShardTransactionTest-fe-0-txn-215-0 ready 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Validating transaction member-1-ShardTransactionTest-fe-0-txn-215-0 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-215-0 validated 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-215-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: canCommit for member-1-ShardTransactionTest-fe-0-txn-215-0: success 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Committing transaction member-1-ShardTransactionTest-fe-0-txn-215-0 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-215-0 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-215-0 candidate ready 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-215-0: canCommit - candidate rootPath: / 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-215-0: canCommit - messages: [] 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-215-0: preCommit - successfulFromPrevious: [] 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-215-0 prepared 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-215-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:22,592 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-215-0 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-215-0 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Persist data SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-215-0 submitted to persistence 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: persist complete SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Moving last applied index from 1 to 2 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Applying state for log index 2 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1780153} is already disabled 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: fakeSnapshot purging log to 1 for term 2 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Persisting ApplyJournalEntries with index=2 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: persist complete SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Moving last applied index from 2 to 3 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Applying state for log index 3 data Simple{size=143} 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-215-0 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-215-0: commit - successfulFromPrevious: [] 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-215-0 changing state from COMMIT_PENDING to COMMITTED 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-215-0 committed as 0, sending response to Actor[akka://test/system/testProbe-707#1138756333] 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config19: Created publisher actor Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config19-DTCL-publisher#-364388877] with name member-1-shard-inventory-config19-DTCL-publisher 12:26:22,593 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config19-DTCL-publisher#-364388877] 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: fakeSnapshot purging log to 2 for term 2 12:26:22,593 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config19: Persisting ApplyJournalEntries with index=3 12:26:22,594 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true] 12:26:22,594 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config19: publishChanges: rootPath: / [WARN] [03/13/2024 12:26:22.594] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config19-DTCL-publisher#-364388877]: org.opendaylight.controller.cluster.common.actor.Monitor@4f6eea6e 12:26:22,594 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config19: Elapsed time for generation of change events for member-1-shard-inventory-config19-DTCL-publisher: 95.97 μs 12:26:22,604 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config19 12:26:22,604 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config19 (Leader)_slicer-id-682: Closing 12:26:22,604 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Aborting 0 pending queued transactions 12:26:22,605 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false] 12:26:22,605 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config19 12:26:22,605 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config19 (Leader)_slicer-id-684: Closing 12:26:22,605 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Aborting 0 pending queued transactions 12:26:22,607 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config20, persistent : true 12:26:22,608 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config20 with journal batch size 3 [WARN] [03/13/2024 12:26:22.608] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@2502d7ae 12:26:22,608 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitPhaseFailure/shard-member-1:snapshot-read#-1858924142] 12:26:22,608 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testCommitPhaseFailure/member-1-shard-inventory-config20-notifier#-385422287 created and ready for shard:member-1-shard-inventory-config20 [WARN] [03/13/2024 12:26:22.608] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitPhaseFailure/member-1-shard-inventory-config20-notifier#-385422287]: org.opendaylight.controller.cluster.common.actor.Monitor@642686bd [WARN] [03/13/2024 12:26:22.608] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitPhaseFailure/shard-member-1:snapshot-read#-1858924142]: org.opendaylight.controller.cluster.common.actor.Monitor@f0c13af 12:26:22,609 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:22,609 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config20: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:22,609 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,609 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config20 is no longer the leader 12:26:22,609 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from null to Follower [WARN] [03/13/2024 12:26:22.609] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCommitPhaseFailure]] 12:26:22,609 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20 (Follower): Received TimeoutNow - switching to Candidate 12:26:22,609 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20 (Candidate): Election: Candidate has following voting peers: [] 12:26:22,609 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: Set currentTerm=1, votedFor=member-1-shard-inventory-config20 12:26:22,609 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config20 (Candidate): Starting new election term 1 12:26:22,609 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config20 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:22,609 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config20 (Follower): Closing 12:26:22,609 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,609 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config20 is no longer the leader 12:26:22,609 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from Follower to Candidate 12:26:22,610 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20 (Candidate): Received ElectionTimeout 12:26:22,610 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20 (Leader): Election: Leader has following peers: [] 12:26:22,610 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config20 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:22,610 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: true, hasLeader : true 12:26:22,610 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: became leader with frontend state for [] 12:26:22,610 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from Candidate to Leader 12:26:22,670 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:22,670 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,671 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,671 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-216-0 12:26:22,671 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Readying Tx member-1-ShardTransactionTest-fe-0-txn-216-0 of 1 operations, client version 13 12:26:22,671 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: readying transaction member-1-ShardTransactionTest-fe-0-txn-216-0 12:26:22,671 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: transaction member-1-ShardTransactionTest-fe-0-txn-216-0 ready 12:26:22,671 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-217-0 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Readying Tx member-1-ShardTransactionTest-fe-0-txn-217-0 of 1 operations, client version 13 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: readying transaction member-1-ShardTransactionTest-fe-0-txn-217-0 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: transaction member-1-ShardTransactionTest-fe-0-txn-217-0 ready 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Moving last applied index from -1 to 0 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config20: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1415705} is already disabled 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-216-0 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Validating transaction member-1-ShardTransactionTest-fe-0-txn-216-0 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Transaction member-1-ShardTransactionTest-fe-0-txn-216-0 validated 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-216-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: canCommit for member-1-ShardTransactionTest-fe-0-txn-216-0: success 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Persisting ApplyJournalEntries with index=0 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-217-0 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Tx member-1-ShardTransactionTest-fe-0-txn-217-0 is scheduled for canCommit step 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Committing transaction member-1-ShardTransactionTest-fe-0-txn-216-0 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-216-0 12:26:22,672 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Transaction member-1-ShardTransactionTest-fe-0-txn-216-0 candidate ready 12:26:22,673 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-216-0: canCommit - candidate rootPath: / 12:26:22,673 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-216-0: canCommit - messages: [] 12:26:22,673 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-216-0: preCommit - successfulFromPrevious: [] 12:26:22,673 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Transaction member-1-ShardTransactionTest-fe-0-txn-216-0 prepared 12:26:22,673 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-216-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:22,673 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-216-0 12:26:22,673 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-216-0 12:26:22,673 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:22,673 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Validating transaction member-1-ShardTransactionTest-fe-0-txn-217-0 12:26:22,673 PM [test-akka.actor.default-dispatcher-15] [WARN] ShardDataTree - member-1-shard-inventory-config20: Store Tx member-1-ShardTransactionTest-fe-0-txn-217-0: Conflicting modification for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test. 12:26:22,673 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-217-0 changing state from CAN_COMMIT_PENDING to FAILED 12:26:22,673 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-217-0 OptimisticLockFailedException{message=Optimistic lock failed for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, errorList=[RpcError [message=Optimistic lock failed for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, severity=ERROR, errorType=APPLICATION, tag=resource-denied, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.ConflictingModificationAppliedException: Node was created by other transaction.]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:844) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCommit(ShardDataTree.java:1132) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.commit(SimpleShardDataTreeCohort.java:151) at org.opendaylight.controller.cluster.datastore.CohortEntry.commit(CohortEntry.java:121) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.finishCommit(ShardCommitCoordinator.java:322) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator$3.onSuccess(ShardCommitCoordinator.java:305) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator$3.onSuccess(ShardCommitCoordinator.java:302) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.successfulPreCommit(SimpleShardDataTreeCohort.java:223) at org.opendaylight.controller.cluster.datastore.ShardDataTree$1.onSuccess(ShardDataTree.java:1050) at org.opendaylight.controller.cluster.datastore.ShardDataTree$1.onSuccess(ShardDataTree.java:1037) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.doUserPreCommit(SimpleShardDataTreeCohort.java:207) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.userPreCommit(SimpleShardDataTreeCohort.java:191) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1037) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:113) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:117) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:302) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:365) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:715) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:416) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.ConflictingModificationAppliedException: Node was created by other transaction. at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkConflicting(SchemaAwareApplyOperation.java:77) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkWriteApplicable(SchemaAwareApplyOperation.java:180) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:110) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.checkChildPreconditions(AbstractNodeContainerModificationStrategy.java:409) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.checkTouchApplicable(AbstractNodeContainerModificationStrategy.java:368) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:109) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractDataTreeTip.validate(AbstractDataTreeTip.java:31) at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) ... 45 more 12:26:22,674 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:22,674 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:22,674 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Transaction member-1-ShardTransactionTest-fe-0-txn-216-0 submitted to persistence 12:26:22,674 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:22,674 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: Moving last applied index from 0 to 1 12:26:22,674 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: Applying state for log index 1 data Simple{size=143} 12:26:22,674 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-216-0 12:26:22,675 PM [test-akka.actor.default-dispatcher-12] [ERROR] ShardDataTree - member-1-shard-inventory-config20: Failed to commit transaction member-1-ShardTransactionTest-fe-0-txn-216-0 java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1081) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:538) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:445) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:1013) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:22,675 PM [test-akka.actor.default-dispatcher-12] [ERROR] SimpleShardDataTreeCohort - Transaction failed to commit java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1081) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:538) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:445) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:1013) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:22,675 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-216-0: abort - successfulFromPrevious: [] 12:26:22,675 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-216-0 changing state from COMMIT_PENDING to FAILED 12:26:22,675 PM [test-akka.actor.default-dispatcher-12] [ERROR] Shard - member-1-shard-inventory-config20, An exception occurred while committing transaction member-1-ShardTransactionTest-fe-0-txn-216-0 java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1081) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:538) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:445) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:1013) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:22,675 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: fakeSnapshot purging log to 0 for term 1 12:26:22,675 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: Persisting ApplyJournalEntries with index=1 12:26:22,678 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitPhaseFailure] 12:26:22,688 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config20 12:26:22,688 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config20 (Leader)_slicer-id-686: Closing 12:26:22,688 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Aborting 0 pending queued transactions 12:26:22,690 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config21, persistent : true [WARN] [03/13/2024 12:26:22.690] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitTimeout]: org.opendaylight.controller.cluster.common.actor.Monitor@3027bc23 12:26:22,691 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testTransactionCommitTimeout/member-1-shard-inventory-config21-notifier#832127452 created and ready for shard:member-1-shard-inventory-config21 [WARN] [03/13/2024 12:26:22.691] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config21-notifier#832127452]: org.opendaylight.controller.cluster.common.actor.Monitor@36effad2 12:26:22,691 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitTimeout/shard-member-1:snapshot-read#628129688] [WARN] [03/13/2024 12:26:22.691] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/shard-member-1:snapshot-read#628129688]: org.opendaylight.controller.cluster.common.actor.Monitor@74dcbcad 12:26:22,692 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config21 with journal batch size 3 12:26:22,692 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:22,692 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config21: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:22,693 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,693 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config21 is no longer the leader [WARN] [03/13/2024 12:26:22.693] [test-akka.actor.default-dispatcher-10] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testTransactionCommitTimeout]] 12:26:22,693 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from null to Follower 12:26:22,693 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21 (Follower): Received TimeoutNow - switching to Candidate 12:26:22,693 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21 (Candidate): Election: Candidate has following voting peers: [] 12:26:22,693 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Set currentTerm=1, votedFor=member-1-shard-inventory-config21 12:26:22,693 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config21 (Candidate): Starting new election term 1 12:26:22,693 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config21 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:22,693 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config21 (Follower): Closing 12:26:22,693 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: false, hasLeader : false 12:26:22,693 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config21 is no longer the leader 12:26:22,693 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from Follower to Candidate 12:26:22,693 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config21 (Candidate): Received ElectionTimeout 12:26:22,693 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config21 (Leader): Election: Leader has following peers: [] 12:26:22,693 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config21 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:22,693 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: true, hasLeader : true 12:26:22,694 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config21: became leader with frontend state for [] 12:26:22,694 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from Candidate to Leader 12:26:22,743 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:22,743 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,743 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-218-0 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Readying Tx member-1-ShardTransactionTest-fe-0-txn-218-0 of 1 operations, client version 13 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: readying transaction member-1-ShardTransactionTest-fe-0-txn-218-0 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: transaction member-1-ShardTransactionTest-fe-0-txn-218-0 ready 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Validating transaction member-1-ShardTransactionTest-fe-0-txn-218-0 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-218-0 validated 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-218-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: canCommit for member-1-ShardTransactionTest-fe-0-txn-218-0: success 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Committing transaction member-1-ShardTransactionTest-fe-0-txn-218-0 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-218-0 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-218-0 candidate ready 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-218-0: canCommit - candidate rootPath: / 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-218-0: canCommit - messages: [] 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-218-0: preCommit - successfulFromPrevious: [] 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-218-0 prepared 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-218-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-218-0 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-218-0 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:22,744 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-218-0 submitted to persistence 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Moving last applied index from -1 to 0 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config21: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1704362} is already disabled 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Moving last applied index from 0 to 1 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Applying state for log index 1 data Simple{size=143} 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-218-0 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-218-0: commit - successfulFromPrevious: [] 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-218-0 changing state from COMMIT_PENDING to COMMITTED 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-218-0 committed as 0, sending response to Actor[akka://test/temp/testTransactionCommitTimeout$c] 12:26:22,745 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config21: Created publisher actor Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config21-DTCL-publisher#-2068917522] with name member-1-shard-inventory-config21-DTCL-publisher 12:26:22,746 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config21-DTCL-publisher#-2068917522] 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: fakeSnapshot purging log to 0 for term 1 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Persisting ApplyJournalEntries with index=0 12:26:22,746 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config21: publishChanges: rootPath: / 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-219-0 12:26:22,746 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config21: Elapsed time for generation of change events for member-1-shard-inventory-config21-DTCL-publisher: 72.54 μs 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Readying Tx member-1-ShardTransactionTest-fe-0-txn-219-0 of 1 operations, client version 13 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: readying transaction member-1-ShardTransactionTest-fe-0-txn-219-0 [WARN] [03/13/2024 12:26:22.746] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config21-DTCL-publisher#-2068917522]: org.opendaylight.controller.cluster.common.actor.Monitor@1867b995 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: transaction member-1-ShardTransactionTest-fe-0-txn-219-0 ready 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Validating transaction member-1-ShardTransactionTest-fe-0-txn-219-0 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-219-0 validated 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-219-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: canCommit for member-1-ShardTransactionTest-fe-0-txn-219-0: success 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Committing transaction member-1-ShardTransactionTest-fe-0-txn-219-0 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-219-0 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-219-0 candidate ready 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-219-0: canCommit - candidate rootPath: / 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-219-0: canCommit - messages: [] 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-219-0: preCommit - successfulFromPrevious: [] 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-219-0 prepared 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-219-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-219-0 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-219-0 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 12:26:22,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 12:26:22,747 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 12:26:22,747 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-219-0 submitted to persistence 12:26:22,747 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Persisting ApplyJournalEntries with index=1 12:26:22,747 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 12:26:22,747 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Moving last applied index from 1 to 2 12:26:22,747 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Applying state for log index 2 data Simple{size=45} 12:26:22,747 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-219-0 12:26:22,747 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-219-0: commit - successfulFromPrevious: [] 12:26:22,747 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-219-0 changing state from COMMIT_PENDING to COMMITTED 12:26:22,747 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-219-0 committed as 0, sending response to Actor[akka://test/temp/testTransactionCommitTimeout$d] 12:26:22,747 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config21: publishChanges: rootPath: / 12:26:22,747 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: fakeSnapshot purging log to 1 for term 1 12:26:22,747 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Persisting ApplyJournalEntries with index=2 12:26:22,747 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config21: Elapsed time for generation of change events for member-1-shard-inventory-config21-DTCL-publisher: 23.22 μs 12:26:22,758 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-220-0 12:26:22,758 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Readying Tx member-1-ShardTransactionTest-fe-0-txn-220-0 of 1 operations, client version 13 12:26:22,758 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: readying transaction member-1-ShardTransactionTest-fe-0-txn-220-0 12:26:22,758 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: transaction member-1-ShardTransactionTest-fe-0-txn-220-0 ready 12:26:22,758 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-221-0 12:26:22,758 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Readying Tx member-1-ShardTransactionTest-fe-0-txn-221-0 of 1 operations, client version 13 12:26:22,758 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: readying transaction member-1-ShardTransactionTest-fe-0-txn-221-0 12:26:22,758 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: transaction member-1-ShardTransactionTest-fe-0-txn-221-0 ready 12:26:22,759 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-220-0 12:26:22,759 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Validating transaction member-1-ShardTransactionTest-fe-0-txn-220-0 12:26:22,759 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-220-0 validated 12:26:22,759 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-220-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:22,759 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: canCommit for member-1-ShardTransactionTest-fe-0-txn-220-0: success 12:26:22,759 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-221-0 12:26:22,759 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Tx member-1-ShardTransactionTest-fe-0-txn-221-0 is scheduled for canCommit step 12:26:23,372 PM [test-akka.actor.default-dispatcher-5] [WARN] ShardDataTree - member-1-shard-inventory-config21: Current transaction member-1-ShardTransactionTest-fe-0-txn-220-0 has timed out after 612 ms in state CAN_COMMIT_COMPLETE 12:26:23,372 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Validating transaction member-1-ShardTransactionTest-fe-0-txn-221-0 12:26:23,372 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-221-0 validated 12:26:23,372 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-221-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:23,372 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: canCommit for member-1-ShardTransactionTest-fe-0-txn-221-0: success 12:26:23,373 PM [test-akka.actor.default-dispatcher-5] [ERROR] Shard - member-1-shard-inventory-config21: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-220-0 commit java.lang.IllegalStateException: member-1-shard-inventory-config21: Cannot commit transaction member-1-ShardTransactionTest-fe-0-txn-220-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:358) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:715) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:416) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:23,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Committing transaction member-1-ShardTransactionTest-fe-0-txn-221-0 12:26:23,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-221-0 12:26:23,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-221-0 candidate ready 12:26:23,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-221-0: canCommit - candidate rootPath: / 12:26:23,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-221-0: canCommit - messages: [] 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-221-0: preCommit - successfulFromPrevious: [] 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-221-0 prepared 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-221-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-221-0 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-221-0 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Persist data SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-221-0 submitted to persistence 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: persist complete SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Moving last applied index from 2 to 3 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Applying state for log index 3 data Simple{size=184} 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-221-0 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-221-0: commit - successfulFromPrevious: [] 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-221-0 changing state from COMMIT_PENDING to COMMITTED 12:26:23,374 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-221-0 committed as 0, sending response to Actor[akka://test/system/testProbe-711#637860224] 12:26:23,374 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config21: publishChanges: rootPath: / 12:26:23,375 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config21: Elapsed time for generation of change events for member-1-shard-inventory-config21-DTCL-publisher: 42.73 μs 12:26:23,375 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: fakeSnapshot purging log to 2 for term 1 12:26:23,375 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: Persisting ApplyJournalEntries with index=3 12:26:23,375 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitTimeout] 12:26:23,385 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config21 12:26:23,385 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config21 (Leader)_slicer-id-688: Closing 12:26:23,386 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Aborting 0 pending queued transactions 12:26:23,387 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config22, persistent : true [WARN] [03/13/2024 12:26:23.387] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsOnTransactionChain]: org.opendaylight.controller.cluster.common.actor.Monitor@47b9a4c0 12:26:23,387 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config22-notifier#-190287762 created and ready for shard:member-1-shard-inventory-config22 [WARN] [03/13/2024 12:26:23.387] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config22-notifier#-190287762]: org.opendaylight.controller.cluster.common.actor.Monitor@7f5f551d 12:26:23,387 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-member-1:snapshot-read#-460446917] [WARN] [03/13/2024 12:26:23.387] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-member-1:snapshot-read#-460446917]: org.opendaylight.controller.cluster.common.actor.Monitor@5a7ac5d3 12:26:23,387 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config22 with journal batch size 3 12:26:23,389 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:23,389 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config22: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:23,389 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 12:26:23,389 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 12:26:23,389 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from null to Follower 12:26:23,389 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22 (Follower): Received TimeoutNow - switching to Candidate 12:26:23,389 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Election: Candidate has following voting peers: [] 12:26:23,389 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22: Set currentTerm=1, votedFor=member-1-shard-inventory-config22 12:26:23,389 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config22 (Candidate): Starting new election term 1 12:26:23,389 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config22 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:23,389 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config22 (Follower): Closing 12:26:23,389 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 12:26:23,389 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 12:26:23,389 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Follower to Candidate 12:26:23,390 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Received ElectionTimeout 12:26:23,390 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Election: Leader has following peers: [] 12:26:23,390 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config22 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:23,390 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: true, hasLeader : true 12:26:23,390 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22: became leader with frontend state for [] 12:26:23,390 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Candidate to Leader [WARN] [03/13/2024 12:26:23.393] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsOnTransactionChain]] 12:26:23,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:23,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:23,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:23,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 12:26:23,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 12:26:23,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeTransactionChain - Opening an unchained snapshot in LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} 12:26:23,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeTransactionChain - Allocated read-write transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 snapshot org.opendaylight.yangtools.yang.data.tree.impl.node.Version@12b3043 12:26:23,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 12:26:23,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Readying Tx member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 of 1 operations, client version 13 12:26:23,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config22: readying transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 12:26:23,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config22: transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 ready 12:26:23,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeTransactionChain - Committing transaction ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0, closed=true, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]} 12:26:23,451 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Creating transaction : member-1-ShardTransactionTest-fe-0-chn-2-txn-1-0 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeTransactionChain - Reusing a chained snapshot in LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeTransactionChain - Allocated read-only transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-1-0 snapshot MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:23,452 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-inventory-member-1:ShardTransactionTest@0:2-1_1#83762607] 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Moving last applied index from -1 to 0 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config22: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2249975} is already disabled 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Moving last applied index from 0 to 1 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Applying state for log index 1 data CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39} 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config22: replication of LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} has no callback 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: fakeSnapshot purging log to 0 for term 1 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Persisting ApplyJournalEntries with index=0 12:26:23,452 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Persisting ApplyJournalEntries with index=1 [WARN] [03/13/2024 12:26:23.452] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-inventory-member-1:ShardTransactionTest@0:2-1_1#83762607]: org.opendaylight.controller.cluster.common.actor.Monitor@28c2be3 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: Can committing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config22: Validating transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config22: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 validated 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: canCommit for member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: success 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: Committing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config22: Preparing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config22: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 candidate ready 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: canCommit - candidate rootPath: / 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: canCommit - messages: [] 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: preCommit - successfulFromPrevious: [] 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config22: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 prepared 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config22: Starting commit for transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 12:26:23,453 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config22: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 submitted to persistence 12:26:23,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 12:26:23,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: Moving last applied index from 1 to 2 12:26:23,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: Applying state for log index 2 data Simple{size=143} 12:26:23,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config22: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 12:26:23,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: commit - successfulFromPrevious: [] 12:26:23,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from COMMIT_PENDING to COMMITTED 12:26:23,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ChainedCommitCohort - Committed transaction ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0, closed=true, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, modificationType=SUBTREE_MODIFIED, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE, modificationType=WRITE}}}]} 12:26:23,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 committed as 0, sending response to Actor[akka://test/system/testProbe-713#1138650968] 12:26:23,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config22: Created publisher actor Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config22-DTCL-publisher#1689168326] with name member-1-shard-inventory-config22-DTCL-publisher 12:26:23,454 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config22-DTCL-publisher#1689168326] 12:26:23,454 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config22: publishChanges: rootPath: / 12:26:23,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: fakeSnapshot purging log to 1 for term 1 [WARN] [03/13/2024 12:26:23.454] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config22-DTCL-publisher#1689168326]: org.opendaylight.controller.cluster.common.actor.Monitor@3ef70ba4 12:26:23,454 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config22: Persisting ApplyJournalEntries with index=2 12:26:23,454 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsOnTransactionChain] 12:26:23,455 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config22: Elapsed time for generation of change events for member-1-shard-inventory-config22-DTCL-publisher: 276.4 μs 12:26:23,465 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config22 12:26:23,465 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config22 (Leader)_slicer-id-690: Closing 12:26:23,465 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Aborting 0 pending queued transactions 12:26:23,466 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config23, persistent : true [WARN] [03/13/2024 12:26:23.466] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCanCommitBeforeReadyFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@1dc18e0e 12:26:23,467 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testCanCommitBeforeReadyFailure/member-1-shard-inventory-config23-notifier#1404105353 created and ready for shard:member-1-shard-inventory-config23 12:26:23,467 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCanCommitBeforeReadyFailure/shard-member-1:snapshot-read#-1993103497] [WARN] [03/13/2024 12:26:23.467] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitBeforeReadyFailure/member-1-shard-inventory-config23-notifier#1404105353]: org.opendaylight.controller.cluster.common.actor.Monitor@671790fd [WARN] [03/13/2024 12:26:23.467] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitBeforeReadyFailure/shard-member-1:snapshot-read#-1993103497]: org.opendaylight.controller.cluster.common.actor.Monitor@2ea4537b 12:26:23,467 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config23 with journal batch size 3 12:26:23,467 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:23,467 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config23: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:23,468 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onLeadershipChange, isLeader: false, hasLeader : false 12:26:23,468 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config23 is no longer the leader 12:26:23,468 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23 (Follower): Received TimeoutNow - switching to Candidate 12:26:23,468 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23 (Candidate): Election: Candidate has following voting peers: [] 12:26:23,468 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: Set currentTerm=1, votedFor=member-1-shard-inventory-config23 12:26:23,468 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config23 , received role change from null to Follower 12:26:23,468 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config23 (Candidate): Starting new election term 1 12:26:23,468 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config23 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:23,468 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config23 (Follower): Closing 12:26:23,468 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onLeadershipChange, isLeader: false, hasLeader : false 12:26:23,468 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config23 is no longer the leader 12:26:23,468 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config23 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:23.468] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCanCommitBeforeReadyFailure]] 12:26:23,468 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config23 (Candidate): Received ElectionTimeout 12:26:23,468 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config23 (Leader): Election: Leader has following peers: [] 12:26:23,468 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config23 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:23,468 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onLeadershipChange, isLeader: true, hasLeader : true 12:26:23,468 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config23: became leader with frontend state for [] 12:26:23,468 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config23 , received role change from Candidate to Leader 12:26:23,477 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-222-0 12:26:23,477 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:23,477 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:23,477 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:23,477 PM [test-akka.actor.default-dispatcher-15] [ERROR] Shard - member-1-shard-inventory-config23: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-222-0 canCommit java.lang.IllegalStateException: member-1-shard-inventory-config23: Cannot canCommit transaction member-1-ShardTransactionTest-fe-0-txn-222-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:283) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:734) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:414) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:23,478 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCanCommitBeforeReadyFailure] 12:26:23,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:23,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: Moving last applied index from -1 to 0 12:26:23,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:23,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:23,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config23: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:23,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=575824} is already disabled 12:26:23,478 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: Persisting ApplyJournalEntries with index=0 12:26:23,488 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config23 12:26:23,488 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config23 (Leader)_slicer-id-692: Closing 12:26:23,488 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: Aborting 0 pending queued transactions 12:26:23,489 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config24, persistent : true [WARN] [03/13/2024 12:26:23.489] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady]: org.opendaylight.controller.cluster.common.actor.Monitor@3dcc906d 12:26:23,490 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config24-notifier#1691028149 created and ready for shard:member-1-shard-inventory-config24 [WARN] [03/13/2024 12:26:23.490] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config24-notifier#1691028149]: org.opendaylight.controller.cluster.common.actor.Monitor@25956907 12:26:23,490 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/shard-member-1:snapshot-read#-408558126] 12:26:23,490 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config24 with journal batch size 3 [WARN] [03/13/2024 12:26:23.490] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/shard-member-1:snapshot-read#-408558126]: org.opendaylight.controller.cluster.common.actor.Monitor@57018082 12:26:23,491 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config24: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:23,491 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config24: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:23,491 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config24: onLeadershipChange, isLeader: false, hasLeader : false 12:26:23,491 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config24: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config24 is no longer the leader 12:26:23,491 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config24 , received role change from null to Follower 12:26:23,491 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config24 (Follower): Received TimeoutNow - switching to Candidate 12:26:23,491 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config24 (Candidate): Election: Candidate has following voting peers: [] 12:26:23,491 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config24: Set currentTerm=1, votedFor=member-1-shard-inventory-config24 12:26:23,491 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config24 (Candidate): Starting new election term 1 12:26:23,491 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config24 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:23,491 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config24 (Follower): Closing 12:26:23,491 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config24: onLeadershipChange, isLeader: false, hasLeader : false 12:26:23,491 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config24: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config24 is no longer the leader 12:26:23,491 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config24 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:23.491] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady]] 12:26:23,491 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24 (Candidate): Received ElectionTimeout 12:26:23,491 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24 (Leader): Election: Leader has following peers: [] 12:26:23,491 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config24 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:23,491 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config24: onLeadershipChange, isLeader: true, hasLeader : true 12:26:23,492 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: became leader with frontend state for [] 12:26:23,492 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config24 , received role change from Candidate to Leader 12:26:23,552 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:23,552 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:23,552 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:23,552 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-223-0 12:26:23,552 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-223-0 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Moving last applied index from -1 to 0 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config24: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1110027} is already disabled 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Persisting ApplyJournalEntries with index=0 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-223-0 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Readying Tx member-1-ShardTransactionTest-fe-0-txn-223-0 of 3 operations, client version 13 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: readying transaction member-1-ShardTransactionTest-fe-0-txn-223-0 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: transaction member-1-ShardTransactionTest-fe-0-txn-223-0 ready 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Validating transaction member-1-ShardTransactionTest-fe-0-txn-223-0 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-223-0 validated 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-223-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: canCommit for member-1-ShardTransactionTest-fe-0-txn-223-0: success 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Committing transaction member-1-ShardTransactionTest-fe-0-txn-223-0 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-223-0 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-223-0 candidate ready 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-223-0: canCommit - candidate rootPath: / 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-223-0: canCommit - messages: [] 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-223-0: preCommit - successfulFromPrevious: [] 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-223-0 prepared 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-223-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-223-0 12:26:23,553 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-223-0 12:26:23,554 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 12:26:23,554 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 12:26:23,554 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 12:26:23,554 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-223-0 submitted to persistence 12:26:23,557 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 12:26:23,557 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Moving last applied index from 0 to 1 12:26:23,557 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Applying state for log index 1 data Simple{size=175} 12:26:23,557 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-223-0 12:26:23,557 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-223-0: commit - successfulFromPrevious: [] 12:26:23,557 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-223-0 changing state from COMMIT_PENDING to COMMITTED 12:26:23,557 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-223-0 committed as 0, sending response to Actor[akka://test/system/testProbe-717#935397735] 12:26:23,558 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady] 12:26:23,558 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config24: Created publisher actor Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config24-DTCL-publisher#457449984] with name member-1-shard-inventory-config24-DTCL-publisher 12:26:23,558 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config24-DTCL-publisher#457449984] 12:26:23,558 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config24: publishChanges: rootPath: / 12:26:23,558 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: fakeSnapshot purging log to 0 for term 1 12:26:23,558 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config24: Persisting ApplyJournalEntries with index=1 12:26:23,558 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config24: Elapsed time for generation of change events for member-1-shard-inventory-config24-DTCL-publisher: 67.27 μs [WARN] [03/13/2024 12:26:23.558] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config24-DTCL-publisher#457449984]: org.opendaylight.controller.cluster.common.actor.Monitor@2d10c01b 12:26:23,568 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config24 12:26:23,568 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config24 (Leader)_slicer-id-694: Closing 12:26:23,568 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config24: Aborting 0 pending queued transactions 12:26:23,570 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config25, persistent : true [WARN] [03/13/2024 12:26:23.570] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testApplyState]: org.opendaylight.controller.cluster.common.actor.Monitor@5a324db5 12:26:23,571 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testApplyState/member-1-shard-inventory-config25-notifier#-1027072417 created and ready for shard:member-1-shard-inventory-config25 12:26:23,571 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testApplyState/shard-member-1:snapshot-read#274907580] [WARN] [03/13/2024 12:26:23.571] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/member-1-shard-inventory-config25-notifier#-1027072417]: org.opendaylight.controller.cluster.common.actor.Monitor@2aae1a0 [WARN] [03/13/2024 12:26:23.571] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/shard-member-1:snapshot-read#274907580]: org.opendaylight.controller.cluster.common.actor.Monitor@486707a 12:26:23,571 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config25 with journal batch size 3 12:26:23,572 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config25: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:23,572 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config25: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:23,572 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config25: onLeadershipChange, isLeader: false, hasLeader : false 12:26:23,572 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config25: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config25 is no longer the leader 12:26:23,572 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config25 , received role change from null to Follower [WARN] [03/13/2024 12:26:23.572] [test-akka.actor.default-dispatcher-10] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testApplyState]] 12:26:23,572 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config25 (Follower): Received TimeoutNow - switching to Candidate 12:26:23,572 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config25 (Candidate): Election: Candidate has following voting peers: [] 12:26:23,572 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config25: Set currentTerm=1, votedFor=member-1-shard-inventory-config25 12:26:23,572 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config25 (Candidate): Starting new election term 1 12:26:23,572 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config25 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:23,572 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config25 (Follower): Closing 12:26:23,572 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config25: onLeadershipChange, isLeader: false, hasLeader : false 12:26:23,572 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config25: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config25 is no longer the leader 12:26:23,572 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config25 , received role change from Follower to Candidate 12:26:23,572 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config25 (Candidate): Received ElectionTimeout 12:26:23,572 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config25 (Leader): Election: Leader has following peers: [] 12:26:23,572 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config25 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:23,572 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config25: onLeadershipChange, isLeader: true, hasLeader : true 12:26:23,572 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config25: became leader with frontend state for [] 12:26:23,572 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config25 , received role change from Candidate to Leader 12:26:23,623 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:23,623 PM [main] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: Applying foreign transaction member-1-ShardTransactionTest-fe-0-txn-224-0 12:26:23,623 PM [main] [DEBUG] FrontendMetadata - member-1-shard-inventory-config25: Added client Enabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@7f64a0f3}, purged=MutableUnsignedLongSet{size=0}} 12:26:23,623 PM [main] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config25: Committed transaction member-1-ShardTransactionTest-fe-0-txn-224-0 12:26:23,623 PM [main] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config25: Created publisher actor Actor[akka://test/user/testApplyState/member-1-shard-inventory-config25-DTCL-publisher#1472864493] with name member-1-shard-inventory-config25-DTCL-publisher 12:26:23,623 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testApplyState/member-1-shard-inventory-config25-DTCL-publisher#1472864493] 12:26:23,623 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config25: publishChanges: rootPath: / [WARN] [03/13/2024 12:26:23.623] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/member-1-shard-inventory-config25-DTCL-publisher#1472864493]: org.opendaylight.controller.cluster.common.actor.Monitor@7e5e8530 12:26:23,624 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config25: Elapsed time for generation of change events for member-1-shard-inventory-config25-DTCL-publisher: 122.2 μs 12:26:23,698 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testApplyState] 12:26:23,709 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config25 12:26:23,709 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config25 (Leader)_slicer-id-696: Closing 12:26:23,709 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config25: Aborting 0 pending queued transactions 12:26:23,812 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config26, persistent : true [WARN] [03/13/2024 12:26:23.812] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$R/testServerRemoved#1970766666]: org.opendaylight.controller.cluster.common.actor.Monitor@aeef73 12:26:23,813 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/$$R/testServerRemoved/member-1-shard-inventory-config26-notifier#1237406469 created and ready for shard:member-1-shard-inventory-config26 12:26:23,813 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$$R/testServerRemoved/shard-member-1:snapshot-read#-278085176] [WARN] [03/13/2024 12:26:23.813] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$R/testServerRemoved/member-1-shard-inventory-config26-notifier#1237406469]: org.opendaylight.controller.cluster.common.actor.Monitor@3556f1ec [WARN] [03/13/2024 12:26:23.813] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$R/testServerRemoved/shard-member-1:snapshot-read#-278085176]: org.opendaylight.controller.cluster.common.actor.Monitor@3b057b10 12:26:23,813 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config26 with journal batch size 3 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config26: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config26: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: false, hasLeader : false 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config26: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config26 is no longer the leader 12:26:23,814 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from null to Follower 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config26 (Follower): Received TimeoutNow - switching to Candidate 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config26 (Candidate): Election: Candidate has following voting peers: [] 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config26: Set currentTerm=1, votedFor=member-1-shard-inventory-config26 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config26 (Candidate): Starting new election term 1 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config26 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config26 (Follower): Closing 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: false, hasLeader : false 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config26: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config26 is no longer the leader 12:26:23,814 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from Follower to Candidate 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config26 (Candidate): Received ElectionTimeout 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config26 (Leader): Election: Leader has following peers: [] 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config26 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: true, hasLeader : true 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config26: became leader with frontend state for [] 12:26:23,814 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from Candidate to Leader 12:26:23,862 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$R] 12:26:23,873 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config26 12:26:23,873 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config26 (Leader)_slicer-id-698: Closing 12:26:23,873 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config26: Aborting 0 pending queued transactions 12:26:23,878 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config27, persistent : true [WARN] [03/13/2024 12:26:23.878] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithOperationFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@79f2093c 12:26:23,878 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testBatchedModificationsWithOperationFailure/member-1-shard-inventory-config27-notifier#665246503 created and ready for shard:member-1-shard-inventory-config27 12:26:23,878 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithOperationFailure/shard-member-1:snapshot-read#1646361398] [WARN] [03/13/2024 12:26:23.878] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithOperationFailure/member-1-shard-inventory-config27-notifier#665246503]: org.opendaylight.controller.cluster.common.actor.Monitor@47c03552 [WARN] [03/13/2024 12:26:23.878] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithOperationFailure/shard-member-1:snapshot-read#1646361398]: org.opendaylight.controller.cluster.common.actor.Monitor@35093fa9 12:26:23,878 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config27 with journal batch size 3 12:26:23,884 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:23,884 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config27: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:23,884 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 12:26:23,884 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 12:26:23,884 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from null to Follower 12:26:23,884 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27 (Follower): Received TimeoutNow - switching to Candidate 12:26:23,884 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Election: Candidate has following voting peers: [] [WARN] [03/13/2024 12:26:23.884] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsWithOperationFailure]] 12:26:23,884 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27: Set currentTerm=1, votedFor=member-1-shard-inventory-config27 12:26:23,884 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config27 (Candidate): Starting new election term 1 12:26:23,884 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config27 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:23,884 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config27 (Follower): Closing 12:26:23,884 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 12:26:23,884 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 12:26:23,884 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Follower to Candidate 12:26:23,884 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Received ElectionTimeout 12:26:23,884 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Election: Leader has following peers: [] 12:26:23,884 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config27 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:23,884 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: true, hasLeader : true 12:26:23,885 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config27: became leader with frontend state for [] 12:26:23,885 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Candidate to Leader 12:26:23,985 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:23,986 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:23,986 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:23,986 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-225-0 12:26:23,986 PM [test-akka.actor.default-dispatcher-14] [ERROR] Shard - member-1-shard-inventory-config27: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-225-0 org.opendaylight.yangtools.yang.data.tree.api.SchemaValidationFailedException: Node (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:junk?revision=2014-03-13)junk is not a valid child of (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test according to the schema. at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.recursivelyVerifyStructure(AbstractNodeContainerModificationStrategy.java:157) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.mergeIntoModifiedNode(AbstractNodeContainerModificationStrategy.java:263) at org.opendaylight.yangtools.yang.data.tree.impl.OperationWithModification.merge(OperationWithModification.java:48) at org.opendaylight.yangtools.yang.data.tree.impl.InMemoryDataTreeModification.merge(InMemoryDataTreeModification.java:106) at org.opendaylight.controller.cluster.datastore.modification.MergeModification.apply(MergeModification.java:49) at org.opendaylight.controller.cluster.datastore.CohortEntry.applyModifications(CohortEntry.java:103) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:147) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:23,987 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: Applying 0 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-225-0 12:26:23,987 PM [test-akka.actor.default-dispatcher-14] [ERROR] Shard - member-1-shard-inventory-config27: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-225-0 org.opendaylight.yangtools.yang.data.tree.api.SchemaValidationFailedException: Node (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:junk?revision=2014-03-13)junk is not a valid child of (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test according to the schema. at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.recursivelyVerifyStructure(AbstractNodeContainerModificationStrategy.java:157) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.mergeIntoModifiedNode(AbstractNodeContainerModificationStrategy.java:263) at org.opendaylight.yangtools.yang.data.tree.impl.OperationWithModification.merge(OperationWithModification.java:48) at org.opendaylight.yangtools.yang.data.tree.impl.InMemoryDataTreeModification.merge(InMemoryDataTreeModification.java:106) at org.opendaylight.controller.cluster.datastore.modification.MergeModification.apply(MergeModification.java:49) at org.opendaylight.controller.cluster.datastore.CohortEntry.applyModifications(CohortEntry.java:103) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:147) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:23,987 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:23,987 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: Moving last applied index from -1 to 0 12:26:23,987 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithOperationFailure] 12:26:23,987 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:23,987 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:23,987 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config27: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:23,987 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1597049} is already disabled 12:26:23,987 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: Persisting ApplyJournalEntries with index=0 12:26:23,998 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config27 12:26:23,998 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config27 (Leader)_slicer-id-700: Closing 12:26:23,998 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Aborting 0 pending queued transactions 12:26:24,6 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - Shard created : member-1-shard-inventory-config29, persistent : true [WARN] [03/13/2024 12:26:24.006] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCreateSnapshot]: org.opendaylight.controller.cluster.common.actor.Monitor@3c066986 12:26:24,7 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateSnapshot/shard-member-1:snapshot-read#79854935] 12:26:24,7 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testCreateSnapshot/member-1-shard-inventory-config29-notifier#37312082 created and ready for shard:member-1-shard-inventory-config29 [WARN] [03/13/2024 12:26:24.007] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config29-notifier#37312082]: org.opendaylight.controller.cluster.common.actor.Monitor@a8d09f [WARN] [03/13/2024 12:26:24.007] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/shard-member-1:snapshot-read#79854935]: org.opendaylight.controller.cluster.common.actor.Monitor@6cacce5c 12:26:24,7 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - Starting recovery for member-1-shard-inventory-config29 with journal batch size 3 12:26:24,8 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:24,8 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config29: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:24,8 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config29: onLeadershipChange, isLeader: false, hasLeader : false 12:26:24,8 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config29 is no longer the leader [WARN] [03/13/2024 12:26:24.008] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCreateSnapshot]] 12:26:24,8 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config29 , received role change from null to Follower 12:26:24,8 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29 (Follower): Received TimeoutNow - switching to Candidate 12:26:24,8 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29 (Candidate): Election: Candidate has following voting peers: [] 12:26:24,8 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Set currentTerm=1, votedFor=member-1-shard-inventory-config29 12:26:24,8 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config29 (Candidate): Starting new election term 1 12:26:24,8 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config29 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:24,8 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config29 (Follower): Closing 12:26:24,8 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config29: onLeadershipChange, isLeader: false, hasLeader : false 12:26:24,8 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config29 is no longer the leader 12:26:24,8 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config29 , received role change from Follower to Candidate 12:26:24,8 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29 (Candidate): Received ElectionTimeout 12:26:24,8 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29 (Leader): Election: Leader has following peers: [] 12:26:24,8 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config29 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:24,8 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config29: onLeadershipChange, isLeader: true, hasLeader : true 12:26:24,8 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: became leader with frontend state for [] 12:26:24,9 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config29 , received role change from Candidate to Leader 12:26:24,101 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:24,101 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:24,101 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:24,101 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-226-0 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Readying Tx member-1-ShardTransactionTest-fe-0-txn-226-0 of 1 operations, client version 13 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config29: readying transaction member-1-ShardTransactionTest-fe-0-txn-226-0 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config29: transaction member-1-ShardTransactionTest-fe-0-txn-226-0 ready 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config29: Validating transaction member-1-ShardTransactionTest-fe-0-txn-226-0 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config29: Transaction member-1-ShardTransactionTest-fe-0-txn-226-0 validated 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-226-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: canCommit for member-1-ShardTransactionTest-fe-0-txn-226-0: success 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Committing transaction member-1-ShardTransactionTest-fe-0-txn-226-0 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config29: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-226-0 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config29: Transaction member-1-ShardTransactionTest-fe-0-txn-226-0 candidate ready 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-226-0: canCommit - candidate rootPath: / 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-226-0: canCommit - messages: [] 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-226-0: preCommit - successfulFromPrevious: [] 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config29: Transaction member-1-ShardTransactionTest-fe-0-txn-226-0 prepared 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-226-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-226-0 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config29: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-226-0 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:24,102 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config29: Transaction member-1-ShardTransactionTest-fe-0-txn-226-0 submitted to persistence 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Moving last applied index from -1 to 0 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config29: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=5897074} is already disabled 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Moving last applied index from 0 to 1 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Applying state for log index 1 data Simple{size=143} 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config29: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-226-0 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-226-0: commit - successfulFromPrevious: [] 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-226-0 changing state from COMMIT_PENDING to COMMITTED 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Transaction member-1-ShardTransactionTest-fe-0-txn-226-0 committed as 0, sending response to Actor[akka://test/temp/testCreateSnapshot$e] 12:26:24,107 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config29: Created publisher actor Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config29-DTCL-publisher#2146356897] with name member-1-shard-inventory-config29-DTCL-publisher 12:26:24,108 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config29-DTCL-publisher#2146356897] 12:26:24,108 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config29: publishChanges: rootPath: / 12:26:24,108 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config29: Elapsed time for generation of change events for member-1-shard-inventory-config29-DTCL-publisher: 122.3 μs 12:26:24,108 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: fakeSnapshot purging log to 0 for term 1 12:26:24,108 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Persisting ApplyJournalEntries with index=0 12:26:24,108 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Persisting ApplyJournalEntries with index=1 [WARN] [03/13/2024 12:26:24.108] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config29-DTCL-publisher#2146356897]: org.opendaylight.controller.cluster.common.actor.Monitor@22371321 12:26:24,207 PM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config29: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 12:26:24,207 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: lastSequenceNumber prior to capture: 5 12:26:24,207 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 12:26:24,207 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: CaptureSnapshotReply received by actor 12:26:24,207 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config29: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=1, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@5fdb44f0, electionTerm=1, electionVotedFor=member-1-shard-inventory-config29, ServerConfigPayload=null] 12:26:24,207 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config29: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 0 and term: 1 12:26:24,212 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config29: SaveSnapshotSuccess received for snapshot, sequenceNr: 5 12:26:24,212 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Snapshot success - sequence number: 5 12:26:24,212 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: SnapshotComplete received 12:26:24,212 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: handled a snapshot response 12:26:24,212 PM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config29: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 12:26:24,212 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: lastSequenceNumber prior to capture: 5 12:26:24,212 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 12:26:24,212 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: CaptureSnapshotReply received by actor 12:26:24,212 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config29: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=1, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@67779e7b, electionTerm=1, electionVotedFor=member-1-shard-inventory-config29, ServerConfigPayload=null] 12:26:24,212 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config29: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 0 and term: 1 12:26:24,212 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config29: SaveSnapshotSuccess received for snapshot, sequenceNr: 5 12:26:24,212 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Snapshot success - sequence number: 5 12:26:24,212 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: SnapshotComplete received 12:26:24,212 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: handled a snapshot response 12:26:24,212 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCreateSnapshot] 12:26:24,213 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: handled a journal response 12:26:24,213 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: handled a journal response 12:26:24,223 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - Stopping Shard member-1-shard-inventory-config29 12:26:24,223 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config29 (Leader)_slicer-id-702: Closing 12:26:24,223 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config29: Aborting 0 pending queued transactions 12:26:24,224 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config30, persistent : true [WARN] [03/13/2024 12:26:24.225] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries]: org.opendaylight.controller.cluster.common.actor.Monitor@cd3f0a4 12:26:24,226 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config30 with journal batch size 3 12:26:24,226 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testTransactionCommitWithPriorExpiredCohortEntries/member-1-shard-inventory-config30-notifier#-1999728212 created and ready for shard:member-1-shard-inventory-config30 12:26:24,226 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/shard-member-1:snapshot-read#-1133472155] [WARN] [03/13/2024 12:26:24.226] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/member-1-shard-inventory-config30-notifier#-1999728212]: org.opendaylight.controller.cluster.common.actor.Monitor@6b84adec [WARN] [03/13/2024 12:26:24.226] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/shard-member-1:snapshot-read#-1133472155]: org.opendaylight.controller.cluster.common.actor.Monitor@70ed1eb3 12:26:24,226 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:24,226 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config30: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:24,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config30: onLeadershipChange, isLeader: false, hasLeader : false 12:26:24,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config30 is no longer the leader 12:26:24,227 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config30 , received role change from null to Follower 12:26:24,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30 (Follower): Received TimeoutNow - switching to Candidate 12:26:24,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30 (Candidate): Election: Candidate has following voting peers: [] 12:26:24,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: Set currentTerm=1, votedFor=member-1-shard-inventory-config30 12:26:24,227 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config30 (Candidate): Starting new election term 1 12:26:24,227 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config30 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:24,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config30 (Follower): Closing 12:26:24,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config30: onLeadershipChange, isLeader: false, hasLeader : false 12:26:24,227 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config30 is no longer the leader 12:26:24,227 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config30 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:24.227] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries]] 12:26:24,227 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config30 (Candidate): Received ElectionTimeout 12:26:24,227 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config30 (Leader): Election: Leader has following peers: [] 12:26:24,227 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config30 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:24,227 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config30: onLeadershipChange, isLeader: true, hasLeader : true 12:26:24,227 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config30: became leader with frontend state for [] 12:26:24,227 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config30 , received role change from Candidate to Leader 12:26:24,335 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:24,336 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:24,336 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:24,336 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-227-0 12:26:24,336 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Readying Tx member-1-ShardTransactionTest-fe-0-txn-227-0 of 1 operations, client version 13 12:26:24,336 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config30: readying transaction member-1-ShardTransactionTest-fe-0-txn-227-0 12:26:24,336 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config30: transaction member-1-ShardTransactionTest-fe-0-txn-227-0 ready 12:26:24,336 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-228-0 12:26:24,336 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Readying Tx member-1-ShardTransactionTest-fe-0-txn-228-0 of 1 operations, client version 13 12:26:24,336 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config30: readying transaction member-1-ShardTransactionTest-fe-0-txn-228-0 12:26:24,336 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config30: transaction member-1-ShardTransactionTest-fe-0-txn-228-0 ready 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-229-0 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Readying Tx member-1-ShardTransactionTest-fe-0-txn-229-0 of 1 operations, client version 13 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config30: readying transaction member-1-ShardTransactionTest-fe-0-txn-229-0 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config30: transaction member-1-ShardTransactionTest-fe-0-txn-229-0 ready 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-229-0 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config30: Tx member-1-ShardTransactionTest-fe-0-txn-229-0 is scheduled for canCommit step 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Moving last applied index from -1 to 0 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config30: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1674020} is already disabled 12:26:24,337 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config30: Persisting ApplyJournalEntries with index=0 12:26:24,901 PM [test-akka.actor.default-dispatcher-12] [WARN] ShardDataTree - member-1-shard-inventory-config30: Current transaction member-1-ShardTransactionTest-fe-0-txn-227-0 has timed out after 565 ms in state READY 12:26:25,71 PM [test-akka.actor.default-dispatcher-12] [WARN] ShardDataTree - member-1-shard-inventory-config30: Current transaction member-1-ShardTransactionTest-fe-0-txn-228-0 has timed out after 734 ms in state READY 12:26:25,71 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config30: Validating transaction member-1-ShardTransactionTest-fe-0-txn-229-0 12:26:25,71 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config30: Transaction member-1-ShardTransactionTest-fe-0-txn-229-0 validated 12:26:25,71 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-229-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:25,71 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: canCommit for member-1-ShardTransactionTest-fe-0-txn-229-0: success 12:26:25,72 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries] 12:26:25,82 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config30 12:26:25,82 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config30 (Leader)_slicer-id-704: Closing 12:26:25,82 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: Aborting 1 pending queued transactions 12:26:25,84 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config31, persistent : true 12:26:25,85 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config31 with journal batch size 3 [WARN] [03/13/2024 12:26:25.085] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyWithImmediateCommit-true]: org.opendaylight.controller.cluster.common.actor.Monitor@5ccea07b 12:26:25,85 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-true/shard-member-1:snapshot-read#-1631968956] 12:26:25,85 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config31-notifier#-1410924695 created and ready for shard:member-1-shard-inventory-config31 [WARN] [03/13/2024 12:26:25.085] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config31-notifier#-1410924695]: org.opendaylight.controller.cluster.common.actor.Monitor@4fa8be4e [WARN] [03/13/2024 12:26:25.085] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/shard-member-1:snapshot-read#-1631968956]: org.opendaylight.controller.cluster.common.actor.Monitor@a37d563 12:26:25,86 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:25,86 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config31: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:25,86 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,86 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config31 is no longer the leader [WARN] [03/13/2024 12:26:25.086] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testReadyWithImmediateCommit-true]] 12:26:25,86 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from null to Follower 12:26:25,86 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31 (Follower): Received TimeoutNow - switching to Candidate 12:26:25,86 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31 (Candidate): Election: Candidate has following voting peers: [] 12:26:25,86 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Set currentTerm=1, votedFor=member-1-shard-inventory-config31 12:26:25,86 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config31 (Candidate): Starting new election term 1 12:26:25,87 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config31 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:25,87 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config31 (Follower): Closing 12:26:25,87 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,87 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config31 is no longer the leader 12:26:25,87 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from Follower to Candidate 12:26:25,87 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31 (Candidate): Received ElectionTimeout 12:26:25,87 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31 (Leader): Election: Leader has following peers: [] 12:26:25,87 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config31 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:25,87 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: true, hasLeader : true 12:26:25,87 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config31: became leader with frontend state for [] 12:26:25,87 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from Candidate to Leader 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-230-0 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Readying transaction member-1-ShardTransactionTest-fe-0-txn-230-0, client version 13 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: readying transaction member-1-ShardTransactionTest-fe-0-txn-230-0 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: transaction member-1-ShardTransactionTest-fe-0-txn-230-0 ready 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Validating transaction member-1-ShardTransactionTest-fe-0-txn-230-0 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-230-0 validated 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-230-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: canCommit for member-1-ShardTransactionTest-fe-0-txn-230-0: success 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Committing transaction member-1-ShardTransactionTest-fe-0-txn-230-0 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-230-0 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-230-0 candidate ready 12:26:25,147 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-230-0: canCommit - candidate rootPath: / 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-230-0: canCommit - messages: [] 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-230-0: preCommit - successfulFromPrevious: [] 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-230-0 prepared 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-230-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-230-0 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-230-0 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-230-0 submitted to persistence 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Moving last applied index from -1 to 0 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config31: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1105307} is already disabled 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Moving last applied index from 0 to 1 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Applying state for log index 1 data Simple{size=143} 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-230-0 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-230-0: commit - successfulFromPrevious: [] 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-230-0 changing state from COMMIT_PENDING to COMMITTED 12:26:25,148 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-230-0 committed as 0, sending response to Actor[akka://test/system/testProbe-726#1862280871] 12:26:25,149 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config31: Created publisher actor Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config31-DTCL-publisher#-1703194653] with name member-1-shard-inventory-config31-DTCL-publisher 12:26:25,149 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config31-DTCL-publisher#-1703194653] 12:26:25,149 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: fakeSnapshot purging log to 0 for term 1 12:26:25,149 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Persisting ApplyJournalEntries with index=0 12:26:25,149 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Persisting ApplyJournalEntries with index=1 12:26:25,149 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config31: publishChanges: rootPath: / [WARN] [03/13/2024 12:26:25.149] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config31-DTCL-publisher#-1703194653]: org.opendaylight.controller.cluster.common.actor.Monitor@f95399 12:26:25,149 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config31: Elapsed time for generation of change events for member-1-shard-inventory-config31-DTCL-publisher: 63.36 μs 12:26:25,149 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyWithImmediateCommit-true] 12:26:25,160 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config31 12:26:25,160 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config31 (Leader)_slicer-id-706: Closing 12:26:25,160 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config31: Aborting 0 pending queued transactions 12:26:25,161 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config32, persistent : true [WARN] [03/13/2024 12:26:25.161] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRegisterRoleChangeListener]: org.opendaylight.controller.cluster.common.actor.Monitor@4364d249 12:26:25,162 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testRegisterRoleChangeListener/member-1-shard-inventory-config32-notifier#-43024850 created and ready for shard:member-1-shard-inventory-config32 [WARN] [03/13/2024 12:26:25.162] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterRoleChangeListener/member-1-shard-inventory-config32-notifier#-43024850]: org.opendaylight.controller.cluster.common.actor.Monitor@4f5f1734 12:26:25,162 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRegisterRoleChangeListener/shard-member-1:snapshot-read#-629367941] 12:26:25,162 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config32 with journal batch size 3 [WARN] [03/13/2024 12:26:25.162] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterRoleChangeListener/shard-member-1:snapshot-read#-629367941]: org.opendaylight.controller.cluster.common.actor.Monitor@66833564 12:26:25,163 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config32: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:25,163 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config32: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:25,163 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,163 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config32: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config32 is no longer the leader [WARN] [03/13/2024 12:26:25.163] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testRegisterRoleChangeListener]] 12:26:25,163 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from null to Follower 12:26:25,163 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config32 (Follower): Received TimeoutNow - switching to Candidate 12:26:25,163 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config32 (Candidate): Election: Candidate has following voting peers: [] 12:26:25,163 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config32: Set currentTerm=1, votedFor=member-1-shard-inventory-config32 12:26:25,163 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config32 (Candidate): Starting new election term 1 12:26:25,163 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config32 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:25,163 PM [test-akka.actor.default-dispatcher-10] [DEBUG] MessageAssembler - member-1-shard-inventory-config32 (Follower): Closing 12:26:25,163 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,163 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config32: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config32 is no longer the leader 12:26:25,163 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Follower to Candidate 12:26:25,164 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32 (Candidate): Received ElectionTimeout 12:26:25,164 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32 (Leader): Election: Leader has following peers: [] 12:26:25,164 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config32 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:25,164 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: true, hasLeader : true 12:26:25,164 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: became leader with frontend state for [] 12:26:25,164 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Candidate to Leader 12:26:25,214 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , registered listener akka://test/user/$a 12:26:25,275 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:26:25,275 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32 (Leader): Cluster state: [] 12:26:25,275 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32 (Leader): Candidate in requestVote:RequestVote [term=10000, candidateId=member2, lastLogIndex=50, lastLogTerm=50] with higher term appears reachable, updating term. 12:26:25,275 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config32 (Leader): Term 10000 in "RequestVote [term=10000, candidateId=member2, lastLogIndex=50, lastLogTerm=50]" message is greater than leader's term 1 - switching to Follower 12:26:25,275 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Set currentTerm=10000, votedFor=null 12:26:25,275 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config32 (Leader) :- Switching from behavior Leader to Follower, election term: 10000 12:26:25,275 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config32 (Leader)_slicer-id-708: Closing 12:26:25,275 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,275 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config32 is no longer the leader 12:26:25,275 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config32: Closing 12:26:25,275 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Leader to Follower 12:26:25,275 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config32 (Follower): Received TimeoutNow - switching to Candidate 12:26:25,276 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config32 (Candidate): Election: Candidate has following voting peers: [] 12:26:25,276 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config32: Set currentTerm=10001, votedFor=member-1-shard-inventory-config32 12:26:25,276 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config32 (Candidate): Starting new election term 10001 12:26:25,276 PM [test-akka.actor.default-dispatcher-10] [INFO] Shard - member-1-shard-inventory-config32 (Follower) :- Switching from behavior Follower to Candidate, election term: 10001 12:26:25,276 PM [test-akka.actor.default-dispatcher-10] [DEBUG] MessageAssembler - member-1-shard-inventory-config32 (Follower): Closing 12:26:25,276 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,276 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config32: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config32 is no longer the leader 12:26:25,276 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Follower to Candidate 12:26:25,276 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32 (Candidate): Received ElectionTimeout 12:26:25,276 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32 (Leader): Election: Leader has following peers: [] 12:26:25,276 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config32 (Candidate) :- Switching from behavior Candidate to Leader, election term: 10001 12:26:25,276 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: true, hasLeader : true 12:26:25,276 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config32: became leader with frontend state for [] 12:26:25,276 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Candidate to Leader 12:26:25,325 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testRegisterRoleChangeListener] 12:26:25,336 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config32 12:26:25,336 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config32 (Leader)_slicer-id-709: Closing 12:26:25,336 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Aborting 0 pending queued transactions 12:26:25,337 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22#-1998610124] [WARN] [03/13/2024 12:26:25.338] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22#-1998610124]: org.opendaylight.controller.cluster.common.actor.Monitor@4435eef8 12:26:25,338 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config33, persistent : true [WARN] [03/13/2024 12:26:25.338] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]: org.opendaylight.controller.cluster.common.actor.Monitor@596d5b1d 12:26:25,339 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/member-1-shard-inventory-config33-notifier#-721632667 created and ready for shard:member-1-shard-inventory-config33 [WARN] [03/13/2024 12:26:25.339] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/member-1-shard-inventory-config33-notifier#-721632667]: org.opendaylight.controller.cluster.common.actor.Monitor@52b5d5ae 12:26:25,339 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/shard-member-1:snapshot-read#-1598646154] [WARN] [03/13/2024 12:26:25.339] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/shard-member-1:snapshot-read#-1598646154]: org.opendaylight.controller.cluster.common.actor.Monitor@2c8d983c 12:26:25,339 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config33 with journal batch size 3 12:26:25,340 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1192440829] 12:26:25,340 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: SnapshotOffer called. 12:26:25,340 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: Moving last applied index from -1 to -1 12:26:25,340 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: Set currentTerm=1, votedFor=null 12:26:25,340 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: Applying recovered snapshot 12:26:25,340 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config33: clearing clients {} 12:26:25,340 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config33: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/member-1-shard-inventory-config33-DTCL-publisher#1310535090] with name member-1-shard-inventory-config33-DTCL-publisher 12:26:25,340 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/member-1-shard-inventory-config33-DTCL-publisher#1310535090] 12:26:25,340 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config33: publishChanges: rootPath: / 12:26:25,340 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: state snapshot applied in 389.6 μs 12:26:25,340 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Recovery snapshot applied for member-1-shard-inventory-config33 in 603.6 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:26:25,341 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config33: Elapsed time for generation of change events for member-1-shard-inventory-config33-DTCL-publisher: 75.48 μs [WARN] [03/13/2024 12:26:25.341] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/member-1-shard-inventory-config33-DTCL-publisher#1310535090]: org.opendaylight.controller.cluster.common.actor.Monitor@36d827b6 12:26:25,341 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config33: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:25,341 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config33: Recovery completed in 1.143 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:25,341 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,341 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config33: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config33 is no longer the leader 12:26:25,341 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from null to Follower 12:26:25,341 PM [test-akka.actor.default-dispatcher-15] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [03/13/2024 12:26:25.342] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]] 12:26:25,352 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22#-1998610124]], isLeader: false, hasLeader: false 12:26:25,352 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: Shard does not have a leader - delaying registration 12:26:25,352 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/$a#2024639047] [WARN] [03/13/2024 12:26:25.352] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/$a#2024639047]: org.opendaylight.controller.cluster.common.actor.Monitor@4eda6c7e 12:26:25,353 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/$a 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config33: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig null 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config33: Re-initializing to Follower with previous leaderId null 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config33 (Follower): Closing 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config33: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config33 is no longer the leader 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config33 (Follower): Received TimeoutNow - switching to Candidate 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config33 (Candidate): Election: Candidate has following voting peers: [] 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config33: Set currentTerm=2, votedFor=member-1-shard-inventory-config33 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config33 (Candidate): Starting new election term 2 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config33 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config33 (Follower): Closing 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,354 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config33: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config33 is no longer the leader 12:26:25,354 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from Follower to Candidate 12:26:25,354 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config33 (Candidate): Received ElectionTimeout 12:26:25,354 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config33 (Leader): Election: Leader has following peers: [] 12:26:25,354 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config33 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 12:26:25,354 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: true, hasLeader : true 12:26:25,355 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config33: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@78b0b266 12:26:25,355 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 12:26:25,355 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config33: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]], initialState present=true] to publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/member-1-shard-inventory-config33-DTCL-publisher#1310535090] 12:26:25,355 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config33: became leader with frontend state for [] 12:26:25,355 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config33: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]], initialState present=true] 12:26:25,355 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from Candidate to Leader 12:26:25,355 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config33: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]] 12:26:25,355 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config33: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]] 12:26:25,355 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)] 12:26:25,355 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config33: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]] 12:26:25,355 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config33: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@78b0b266 12:26:25,355 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22#-1998610124] 12:26:25,366 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23] 12:26:25,366 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config33 12:26:25,366 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config33 (Leader)_slicer-id-711: Closing 12:26:25,366 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config33: Aborting 0 pending queued transactions 12:26:25,368 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config, persistent : true 12:26:25,369 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config with journal batch size 3 [WARN] [03/13/2024 12:26:25.369] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]: org.opendaylight.controller.cluster.common.actor.Monitor@6b0d4951 12:26:25,369 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-notifier#1482025299 created and ready for shard:testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config 12:26:25,370 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-follower24:snapshot-read#353344464] [WARN] [03/13/2024 12:26:25.370] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-notifier#1482025299]: org.opendaylight.controller.cluster.common.actor.Monitor@71825d1a [WARN] [03/13/2024 12:26:25.370] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-follower24:snapshot-read#353344464]: org.opendaylight.controller.cluster.common.actor.Monitor@10ffb7cf 12:26:25,370 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, persistent : true [WARN] [03/13/2024 12:26:25.370] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config]: org.opendaylight.controller.cluster.common.actor.Monitor@4ee8d97b 12:26:25,371 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-notifier#1412485149 created and ready for shard:testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config [WARN] [03/13/2024 12:26:25.371] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-notifier#1412485149]: org.opendaylight.controller.cluster.common.actor.Monitor@62f7ad9 12:26:25,371 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-leader25:snapshot-read#1091378333] 12:26:25,371 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config with journal batch size 3 [WARN] [03/13/2024 12:26:25.371] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-leader25:snapshot-read#1091378333]: org.opendaylight.controller.cluster.common.actor.Monitor@31459bde 12:26:25,371 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:25,371 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:25,372 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:25,372 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config is no longer the leader 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config is no longer the leader 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Follower): Received TimeoutNow - switching to Candidate 12:26:25,372 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config , received role change from null to Follower 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Candidate): Election: Candidate has following voting peers: [testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config] 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Set currentTerm=1, votedFor=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config 12:26:25,372 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config , received role change from null to Follower 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Candidate): Starting new election term 1 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Candidate): Sending RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] to peer testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Follower): Closing 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config is no longer the leader 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Cluster state: [] 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Candidate in requestVote:RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Term 1 in "RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 0 - updating term [WARN] [03/13/2024 12:26:25.372] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]] 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Set currentTerm=1, votedFor=null [WARN] [03/13/2024 12:26:25.372] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config]] 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): In requestVote: RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 12:26:25,372 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config , received role change from Follower to Candidate 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Set currentTerm=1, votedFor=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config 12:26:25,372 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): requestVote returning: RequestVoteReply [term=1, voteGranted=true] 12:26:25,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Candidate): RaftRPC message received RequestVoteReply [term=1, voteGranted=true], my term is 1 12:26:25,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Candidate): handleRequestVoteReply: RequestVoteReply [term=1, voteGranted=true], current voteCount: 1 12:26:25,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Election: Leader has following peers: [testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config] 12:26:25,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 12:26:25,373 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:25,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: onLeadershipChange, isLeader: true, hasLeader : true 12:26:25,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: became leader with frontend state for [] 12:26:25,373 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Closing 12:26:25,373 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config 12:26:25,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config updated: matchIndex: -1, nextIndex: 0 12:26:25,373 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config , received role change from Candidate to Leader 12:26:25,373 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [03/13/2024 12:26:25.373] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@76ec72c 12:26:25,422 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config 12:26:25,423 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26#1360913624] [WARN] [03/13/2024 12:26:25.423] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26#1360913624]: org.opendaylight.controller.cluster.common.actor.Monitor@4d6c193c 12:26:25,433 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26#1360913624]], isLeader: false, hasLeader: true 12:26:25,434 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 12:26:25,434 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/$a#983947993] 12:26:25,434 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@26553836 [WARN] [03/13/2024 12:26:25.434] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/$a#983947993]: org.opendaylight.controller.cluster.common.actor.Monitor@39eb7da 12:26:25,434 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-DTCL-publisher#-2030172596] with name testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-DTCL-publisher 12:26:25,434 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-DTCL-publisher#-2030172596] 12:26:25,434 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]], initialState present=true] to publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-DTCL-publisher#-2030172596] 12:26:25,434 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/$a [WARN] [03/13/2024 12:26:25.434] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-DTCL-publisher#-2030172596]: org.opendaylight.controller.cluster.common.actor.Monitor@449e415a 12:26:25,434 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]], initialState present=true] 12:26:25,434 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]] 12:26:25,434 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ForwardingDataTreeChangeListener - Sending OnInitialData to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)] 12:26:25,434 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]] 12:26:25,434 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Notifying onInitialData to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@26553836 12:26:25,434 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config 12:26:25,434 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Forwarding 1 BatchedModifications to leader ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config)] 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Replicate message: identifier: ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, logIndex: 0, isSendImmediate: true 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): sendAppendEntries: 0 is present for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Sending AppendEntries to follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}]]] 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-231-0 12:26:25,435 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): handleAppendEntries: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}]]] 12:26:25,435 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Number of entries to be appended = 1 12:26:25,435 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 12:26:25,435 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Append entry to log DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:25,435 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Readying Tx member-1-ShardTransactionTest-fe-0-txn-231-0 of 1 operations, client version 13 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: readying transaction member-1-ShardTransactionTest-fe-0-txn-231-0 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: transaction member-1-ShardTransactionTest-fe-0-txn-231-0 ready 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Validating transaction member-1-ShardTransactionTest-fe-0-txn-231-0 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-231-0 validated 12:26:25,435 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Log size is now 1 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-231-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: canCommit for member-1-ShardTransactionTest-fe-0-txn-231-0: success 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Committing transaction member-1-ShardTransactionTest-fe-0-txn-231-0 12:26:25,435 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=13, raftVersion=5, recipientRaftVersion=5] 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-231-0 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-231-0 candidate ready 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-231-0: canCommit - candidate rootPath: / 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-231-0: canCommit - messages: [] 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-231-0: preCommit - successfulFromPrevious: [] 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-231-0 prepared 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-231-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-231-0 12:26:25,435 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-231-0 12:26:25,436 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:25,436 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:25,436 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:25,436 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Replicate message: identifier: member-1-ShardTransactionTest-fe-0-txn-231-0, logIndex: 1, isSendImmediate: true 12:26:25,436 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1 12:26:25,436 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): sendAppendEntries: 0 is present for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config 12:26:25,436 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-231-0 submitted to persistence 12:26:25,436 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config updated: matchIndex: 0, nextIndex: 1 12:26:25,436 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 12:26:25,436 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): sendAppendEntries: 1 is present for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config 12:26:25,436 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Sending AppendEntries to follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}]]] 12:26:25,436 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,436 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): handleAppendEntries: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}]]] 12:26:25,436 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,436 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Number of entries to be appended = 1 12:26:25,436 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 12:26:25,436 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Append entry to log Simple{size=143} 12:26:25,436 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:25,436 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 12:26:25,436 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Setting last applied to 0 12:26:25,437 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Log size is now 2 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Moving last applied index from -1 to 0 12:26:25,437 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=13, raftVersion=5, recipientRaftVersion=5] 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2019109} is already disabled 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] [WARN] [03/13/2024 12:26:25.437] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1105f177 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config updated: matchIndex: 1, nextIndex: 2 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Setting last applied to 1 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Moving last applied index from 0 to 1 12:26:25,437 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Applying state for log index 1 data Simple{size=143} 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-231-0 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-231-0: commit - successfulFromPrevious: [] 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-231-0 changing state from COMMIT_PENDING to COMMITTED 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-231-0 committed as 0, sending response to Actor[akka://test/temp/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config$f] 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-DTCL-publisher#-15332666] with name testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-DTCL-publisher 12:26:25,437 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-DTCL-publisher#-15332666] 12:26:25,437 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: publishChanges: rootPath: / 12:26:25,437 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: fakeSnapshot purging log to 0 for term 1 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: 0 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Persisting ApplyJournalEntries with index=0 12:26:25,438 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Elapsed time for generation of change events for testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-DTCL-publisher: 73.20 μs 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Persisting ApplyJournalEntries with index=1 [WARN] [03/13/2024 12:26:25.438] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-DTCL-publisher#-15332666]: org.opendaylight.controller.cluster.common.actor.Monitor@6814e0c0 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Commit index set to 1 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): -1, lastIndex(): 1 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Setting last applied to 0 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Moving last applied index from -1 to 0 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Setting last applied to 1 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Moving last applied index from 0 to 1 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Applying state for log index 1 data Simple{size=143} 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Applying foreign transaction member-1-ShardTransactionTest-fe-0-txn-231-0 12:26:25,438 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: publishChanges: rootPath: / 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: fakeSnapshot purging log to 0 for term 1 12:26:25,438 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Persisting ApplyJournalEntries with index=1 12:26:25,438 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]] 12:26:25,438 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)] 12:26:25,438 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Elapsed time for generation of change events for testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-DTCL-publisher: 170.8 μs 12:26:25,438 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@26553836 12:26:25,439 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config] 12:26:25,449 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config 12:26:25,449 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Closing 12:26:25,449 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Aborting 0 pending queued transactions 12:26:25,450 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config] 12:26:25,450 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config 12:26:25,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader)_slicer-id-714: Closing 12:26:25,450 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Aborting 0 pending queued transactions 12:26:25,451 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26#1360913624] 12:26:25,452 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config35, persistent : true [WARN] [03/13/2024 12:26:25.452] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPeerAddressResolved]: org.opendaylight.controller.cluster.common.actor.Monitor@330c2be8 12:26:25,452 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testPeerAddressResolved/member-1-shard-inventory-config35-notifier#-2049872565 created and ready for shard:member-1-shard-inventory-config35 [WARN] [03/13/2024 12:26:25.452] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPeerAddressResolved/member-1-shard-inventory-config35-notifier#-2049872565]: org.opendaylight.controller.cluster.common.actor.Monitor@21f26567 12:26:25,452 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPeerAddressResolved/shard-member-1:snapshot-read#1625730903] [WARN] [03/13/2024 12:26:25.452] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPeerAddressResolved/shard-member-1:snapshot-read#1625730903]: org.opendaylight.controller.cluster.common.actor.Monitor@693695f8 12:26:25,452 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config35 with journal batch size 3 12:26:25,453 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:25,453 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config35: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:25,453 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,453 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config35 is no longer the leader 12:26:25,453 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Peer address for peer member-2-shard-inventory-config set to akka://foobar 12:26:25,453 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from null to Follower [WARN] [03/13/2024 12:26:25.453] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testPeerAddressResolved]] 12:26:25,463 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPeerAddressResolved] 12:26:25,473 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config35 12:26:25,473 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config35 (Follower): Closing 12:26:25,473 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config35: Aborting 0 pending queued transactions 12:26:25,475 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config36, persistent : true 12:26:25,475 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config36 with journal batch size 3 [WARN] [03/13/2024 12:26:25.475] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount]: org.opendaylight.controller.cluster.common.actor.Monitor@35aaa51c 12:26:25,476 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/member-1-shard-inventory-config36-notifier#-992353498 created and ready for shard:member-1-shard-inventory-config36 12:26:25,476 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/shard-member-1:snapshot-read#1139799084] [WARN] [03/13/2024 12:26:25.476] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/member-1-shard-inventory-config36-notifier#-992353498]: org.opendaylight.controller.cluster.common.actor.Monitor@236300d9 [WARN] [03/13/2024 12:26:25.476] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/shard-member-1:snapshot-read#1139799084]: org.opendaylight.controller.cluster.common.actor.Monitor@2e30565f 12:26:25,476 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config36: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:25,476 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config36: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:25,477 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,477 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config36: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config36 is no longer the leader [WARN] [03/13/2024 12:26:25.477] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount]] 12:26:25,477 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from null to Follower 12:26:25,477 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config36 (Follower): Received TimeoutNow - switching to Candidate 12:26:25,477 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config36 (Candidate): Election: Candidate has following voting peers: [] 12:26:25,477 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config36: Set currentTerm=1, votedFor=member-1-shard-inventory-config36 12:26:25,477 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config36 (Candidate): Starting new election term 1 12:26:25,477 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config36 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:25,477 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config36 (Follower): Closing 12:26:25,477 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,477 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config36: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config36 is no longer the leader 12:26:25,477 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from Follower to Candidate 12:26:25,477 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36 (Candidate): Received ElectionTimeout 12:26:25,477 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36 (Leader): Election: Leader has following peers: [] 12:26:25,477 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config36 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:25,477 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: true, hasLeader : true 12:26:25,477 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: became leader with frontend state for [] 12:26:25,477 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from Candidate to Leader 12:26:25,537 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config36: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:25,538 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config36: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,538 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config36: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,538 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config36: Applying 0 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-232-0 12:26:25,538 PM [test-akka.actor.default-dispatcher-15] [ERROR] Shard - member-1-shard-inventory-config36: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-232-0 java.lang.IllegalStateException: The total number of batched messages received 1 does not match the number sent 2 at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:157) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:25,538 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount] 12:26:25,538 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config36: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,538 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config36: Moving last applied index from -1 to 0 12:26:25,538 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config36: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:25,539 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config36: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:25,539 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config36: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:25,539 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config36: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1041935} is already disabled 12:26:25,539 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config36: Persisting ApplyJournalEntries with index=0 12:26:25,549 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config36 12:26:25,549 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config36 (Leader)_slicer-id-717: Closing 12:26:25,549 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config36: Aborting 0 pending queued transactions 12:26:25,551 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config37, persistent : true [WARN] [03/13/2024 12:26:25.551] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true]: org.opendaylight.controller.cluster.common.actor.Monitor@7abe59f 12:26:25,552 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config37-notifier#-871378439 created and ready for shard:member-1-shard-inventory-config37 [WARN] [03/13/2024 12:26:25.552] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config37-notifier#-871378439]: org.opendaylight.controller.cluster.common.actor.Monitor@b4eb441 12:26:25,552 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/shard-member-1:snapshot-read#-921570831] [WARN] [03/13/2024 12:26:25.552] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/shard-member-1:snapshot-read#-921570831]: org.opendaylight.controller.cluster.common.actor.Monitor@15e8f67c 12:26:25,553 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config37 with journal batch size 3 12:26:25,553 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config37: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:25,553 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config37: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:25,554 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,554 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config37: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config37 is no longer the leader [WARN] [03/13/2024 12:26:25.554] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true]] 12:26:25,554 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from null to Follower 12:26:25,554 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config37 (Follower): Received TimeoutNow - switching to Candidate 12:26:25,554 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config37 (Candidate): Election: Candidate has following voting peers: [] 12:26:25,554 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config37: Set currentTerm=1, votedFor=member-1-shard-inventory-config37 12:26:25,554 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config37 (Candidate): Starting new election term 1 12:26:25,554 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config37 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:25,554 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config37 (Follower): Closing 12:26:25,554 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,554 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config37: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config37 is no longer the leader 12:26:25,554 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from Follower to Candidate 12:26:25,554 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config37 (Candidate): Received ElectionTimeout 12:26:25,554 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config37 (Leader): Election: Leader has following peers: [] 12:26:25,554 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config37 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:25,554 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: true, hasLeader : true 12:26:25,554 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config37: became leader with frontend state for [] 12:26:25,554 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from Candidate to Leader 12:26:25,662 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-233-0 12:26:25,662 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:25,662 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,662 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,662 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Readying transaction member-1-ShardTransactionTest-fe-0-txn-233-0, client version 13 12:26:25,662 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: readying transaction member-1-ShardTransactionTest-fe-0-txn-233-0 12:26:25,662 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: transaction member-1-ShardTransactionTest-fe-0-txn-233-0 ready 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-233-0 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Validating transaction member-1-ShardTransactionTest-fe-0-txn-233-0 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-233-0 validated 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-233-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: canCommit for member-1-ShardTransactionTest-fe-0-txn-233-0: success 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Committing transaction member-1-ShardTransactionTest-fe-0-txn-233-0 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-233-0 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-233-0 candidate ready 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-233-0: canCommit - candidate rootPath: / 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-233-0: canCommit - messages: [] 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-233-0: preCommit - successfulFromPrevious: [] 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-233-0 prepared 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-233-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-233-0 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-233-0 12:26:25,663 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-233-0 submitted to persistence 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Moving last applied index from -1 to 0 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config37: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1534258} is already disabled 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Persisting ApplyJournalEntries with index=0 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Moving last applied index from 0 to 1 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Applying state for log index 1 data Simple{size=143} 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-233-0 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-233-0: commit - successfulFromPrevious: [] 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-233-0 changing state from COMMIT_PENDING to COMMITTED 12:26:25,664 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-233-0 committed as 0, sending response to Actor[akka://test/system/testProbe-738#1127467571] 12:26:25,665 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config37: Created publisher actor Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config37-DTCL-publisher#1669294988] with name member-1-shard-inventory-config37-DTCL-publisher 12:26:25,665 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config37-DTCL-publisher#1669294988] 12:26:25,665 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: fakeSnapshot purging log to 0 for term 1 12:26:25,665 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config37: Persisting ApplyJournalEntries with index=1 12:26:25,665 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config37: publishChanges: rootPath: / [WARN] [03/13/2024 12:26:25.665] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config37-DTCL-publisher#1669294988]: org.opendaylight.controller.cluster.common.actor.Monitor@55758bab 12:26:25,665 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config37: Elapsed time for generation of change events for member-1-shard-inventory-config37-DTCL-publisher: 97.57 μs 12:26:25,866 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true] 12:26:25,877 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config37 12:26:25,877 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config37 (Leader)_slicer-id-719: Closing 12:26:25,877 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config37: Aborting 0 pending queued transactions 12:26:25,879 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config38, persistent : true [WARN] [03/13/2024 12:26:25.879] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady]: org.opendaylight.controller.cluster.common.actor.Monitor@62321b1b 12:26:25,880 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/shard-member-1:snapshot-read#1777898290] 12:26:25,880 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config38-notifier#-2044618591 created and ready for shard:member-1-shard-inventory-config38 12:26:25,880 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config38 with journal batch size 3 [WARN] [03/13/2024 12:26:25.880] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config38-notifier#-2044618591]: org.opendaylight.controller.cluster.common.actor.Monitor@63368c5e [WARN] [03/13/2024 12:26:25.880] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/shard-member-1:snapshot-read#1777898290]: org.opendaylight.controller.cluster.common.actor.Monitor@1a06176 12:26:25,881 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:25,881 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config38: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:25,881 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,881 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config38 is no longer the leader [WARN] [03/13/2024 12:26:25.881] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady]] 12:26:25,881 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from null to Follower 12:26:25,881 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38 (Follower): Received TimeoutNow - switching to Candidate 12:26:25,881 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38 (Candidate): Election: Candidate has following voting peers: [] 12:26:25,881 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Set currentTerm=1, votedFor=member-1-shard-inventory-config38 12:26:25,881 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config38 (Candidate): Starting new election term 1 12:26:25,881 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config38 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:25,881 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config38 (Follower): Closing 12:26:25,881 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: false, hasLeader : false 12:26:25,881 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config38 is no longer the leader 12:26:25,881 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from Follower to Candidate 12:26:25,882 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38 (Candidate): Received ElectionTimeout 12:26:25,882 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38 (Leader): Election: Leader has following peers: [] 12:26:25,882 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config38 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:25,882 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: true, hasLeader : true 12:26:25,882 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: became leader with frontend state for [] 12:26:25,882 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from Candidate to Leader 12:26:25,989 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config38: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:25,990 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config38: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,990 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config38: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,990 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config38: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-234-0 12:26:25,990 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config38: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-234-0 12:26:25,990 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:25,990 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Moving last applied index from -1 to 0 12:26:25,990 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:25,990 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:25,990 PM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config38: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:25,990 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=969803} is already disabled 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-234-0 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Readying Tx member-1-ShardTransactionTest-fe-0-txn-234-0 of 3 operations, client version 13 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: readying transaction member-1-ShardTransactionTest-fe-0-txn-234-0 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: transaction member-1-ShardTransactionTest-fe-0-txn-234-0 ready 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Persisting ApplyJournalEntries with index=0 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-234-0 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: Validating transaction member-1-ShardTransactionTest-fe-0-txn-234-0 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: Transaction member-1-ShardTransactionTest-fe-0-txn-234-0 validated 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-234-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: canCommit for member-1-ShardTransactionTest-fe-0-txn-234-0: success 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Committing transaction member-1-ShardTransactionTest-fe-0-txn-234-0 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-234-0 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: Transaction member-1-ShardTransactionTest-fe-0-txn-234-0 candidate ready 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-234-0: canCommit - candidate rootPath: / 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-234-0: canCommit - messages: [] 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-234-0: preCommit - successfulFromPrevious: [] 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: Transaction member-1-ShardTransactionTest-fe-0-txn-234-0 prepared 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-234-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-234-0 12:26:25,991 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-234-0 12:26:25,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 12:26:25,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 12:26:25,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 12:26:25,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: Transaction member-1-ShardTransactionTest-fe-0-txn-234-0 submitted to persistence 12:26:25,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 12:26:25,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Moving last applied index from 0 to 1 12:26:25,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Applying state for log index 1 data Simple{size=175} 12:26:25,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-234-0 12:26:25,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-234-0: commit - successfulFromPrevious: [] 12:26:25,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-234-0 changing state from COMMIT_PENDING to COMMITTED 12:26:25,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Transaction member-1-ShardTransactionTest-fe-0-txn-234-0 committed as 0, sending response to Actor[akka://test/system/testProbe-740#1186343361] 12:26:25,992 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady] 12:26:25,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config38: Created publisher actor Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config38-DTCL-publisher#1676958090] with name member-1-shard-inventory-config38-DTCL-publisher 12:26:25,993 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config38-DTCL-publisher#1676958090] 12:26:25,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: fakeSnapshot purging log to 0 for term 1 12:26:25,993 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Persisting ApplyJournalEntries with index=1 12:26:25,993 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config38: publishChanges: rootPath: / [WARN] [03/13/2024 12:26:25.993] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config38-DTCL-publisher#1676958090]: org.opendaylight.controller.cluster.common.actor.Monitor@792878f2 12:26:25,993 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config38: Elapsed time for generation of change events for member-1-shard-inventory-config38-DTCL-publisher: 64.69 μs 12:26:26,3 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config38 12:26:26,3 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config38 (Leader)_slicer-id-721: Closing 12:26:26,3 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config38: Aborting 0 pending queued transactions 12:26:26,5 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config39, persistent : true [WARN] [03/13/2024 12:26:26.005] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionMessagesWithNoLeader]: org.opendaylight.controller.cluster.common.actor.Monitor@7e34825c 12:26:26,5 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testTransactionMessagesWithNoLeader/member-1-shard-inventory-config39-notifier#-611484704 created and ready for shard:member-1-shard-inventory-config39 [WARN] [03/13/2024 12:26:26.005] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionMessagesWithNoLeader/member-1-shard-inventory-config39-notifier#-611484704]: org.opendaylight.controller.cluster.common.actor.Monitor@3bd5d4b6 12:26:26,6 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionMessagesWithNoLeader/shard-member-1:snapshot-read#-1791575130] [WARN] [03/13/2024 12:26:26.006] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionMessagesWithNoLeader/shard-member-1:snapshot-read#-1791575130]: org.opendaylight.controller.cluster.common.actor.Monitor@d75f902 12:26:26,6 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config39 with journal batch size 3 12:26:26,6 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config39: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:26,7 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config39: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:26,7 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,7 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config39: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config39 is no longer the leader 12:26:26,7 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from null to Follower [WARN] [03/13/2024 12:26:26.007] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testTransactionMessagesWithNoLeader]] 12:26:26,7 PM [test-akka.actor.default-dispatcher-12] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 12:26:26,116 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config39: Adding message BatchedModifications [transactionId=member-1-ShardTransactionTest-fe-0-txn-235-0, ready=false, participatingShardNames=null, totalMessagesSent=0, modifications size=0] to retry 12:26:26,231 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config39: Timer expired for message BatchedModifications [transactionId=member-1-ShardTransactionTest-fe-0-txn-235-0, ready=false, participatingShardNames=null, totalMessagesSent=0, modifications size=0] 12:26:26,232 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config39: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-235-0 12:26:26,236 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config39: Adding message ForwardedReadyTransaction [transactionId=member-1-ShardTransactionTest-fe-0-txn-235-0, transaction=ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-txn-235-0, closed=false, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]}, doImmediateCommit=true, participatingShardNames=null, txnClientVersion=13] to retry 12:26:26,352 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config39: Timer expired for message ForwardedReadyTransaction [transactionId=member-1-ShardTransactionTest-fe-0-txn-235-0, transaction=ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-txn-235-0, closed=false, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]}, doImmediateCommit=true, participatingShardNames=null, txnClientVersion=13] 12:26:26,352 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config39: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-235-0 12:26:26,352 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config39: Adding message org.opendaylight.controller.cluster.datastore.messages.ReadyLocalTransaction@18f084e8 to retry 12:26:26,471 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config39: Timer expired for message org.opendaylight.controller.cluster.datastore.messages.ReadyLocalTransaction@18f084e8 12:26:26,471 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionMessagesWithNoLeader] 12:26:26,482 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config39 12:26:26,482 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config39 (Follower): Closing 12:26:26,482 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config39: Aborting 0 pending queued transactions [WARN] [03/13/2024 12:26:26.484] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction#1541629674]: org.opendaylight.controller.cluster.common.actor.Monitor@3f993a3f 12:26:26,485 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config40, persistent : true 12:26:26,486 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testCreateTransaction/member-1-shard-inventory-config40-notifier#-869064568 created and ready for shard:member-1-shard-inventory-config40 [WARN] [03/13/2024 12:26:26.486] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/member-1-shard-inventory-config40-notifier#-869064568]: org.opendaylight.controller.cluster.common.actor.Monitor@215f0baa 12:26:26,486 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateTransaction/shard-member-1:snapshot-read#188673448] [WARN] [03/13/2024 12:26:26.486] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/shard-member-1:snapshot-read#188673448]: org.opendaylight.controller.cluster.common.actor.Monitor@6965bb4b 12:26:26,487 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config40 with journal batch size 3 12:26:26,488 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:26,488 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config40: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:26,488 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,488 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config40 is no longer the leader 12:26:26,488 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from null to Follower 12:26:26,488 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40 (Follower): Received TimeoutNow - switching to Candidate 12:26:26,488 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40 (Candidate): Election: Candidate has following voting peers: [] 12:26:26,488 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: Set currentTerm=1, votedFor=member-1-shard-inventory-config40 12:26:26,488 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config40 (Candidate): Starting new election term 1 12:26:26,488 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config40 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 [WARN] [03/13/2024 12:26:26.488] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=Actor[akka://test/user/testCreateTransaction#1541629674]] 12:26:26,488 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config40 (Follower): Closing 12:26:26,488 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,488 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config40 is no longer the leader 12:26:26,488 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from Follower to Candidate 12:26:26,489 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40 (Candidate): Received ElectionTimeout 12:26:26,489 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40 (Leader): Election: Leader has following peers: [] 12:26:26,489 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config40 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:26,489 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: true, hasLeader : true 12:26:26,489 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40: became leader with frontend state for [] 12:26:26,489 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from Candidate to Leader 12:26:26,563 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:26,563 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:26,563 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:26,563 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: Creating transaction : member-1-ShardTransactionTest-fe-0-txn-236-0 12:26:26,564 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testCreateTransaction/shard-inventory-member-1:ShardTransactionTest@0:236_2#-1745995690] [WARN] [03/13/2024 12:26:26.564] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/shard-inventory-member-1:ShardTransactionTest@0:236_2#-1745995690]: org.opendaylight.controller.cluster.common.actor.Monitor@564b5923 12:26:26,564 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testCreateTransaction#1541629674] 12:26:26,564 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:26,564 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: Moving last applied index from -1 to 0 12:26:26,564 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:26,564 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:26,564 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config40: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:26,564 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1274511} is already disabled 12:26:26,564 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: Persisting ApplyJournalEntries with index=0 12:26:26,574 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config40 12:26:26,575 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config40 (Leader)_slicer-id-724: Closing 12:26:26,575 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: Aborting 0 pending queued transactions 12:26:26,576 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config41, persistent : false [WARN] [03/13/2024 12:26:26.576] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWithPersistenceDisabled]: org.opendaylight.controller.cluster.common.actor.Monitor@787377de 12:26:26,577 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config41 with journal batch size 3 12:26:26,577 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config41-notifier#1313842487 created and ready for shard:member-1-shard-inventory-config41 12:26:26,577 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWithPersistenceDisabled/shard-member-1:snapshot-read#757148359] [WARN] [03/13/2024 12:26:26.577] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config41-notifier#1313842487]: org.opendaylight.controller.cluster.common.actor.Monitor@30b61a86 [WARN] [03/13/2024 12:26:26.578] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/shard-member-1:snapshot-read#757148359]: org.opendaylight.controller.cluster.common.actor.Monitor@2b2bf2f2 12:26:26,578 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:26,578 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config41: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:26,578 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,578 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config41 is no longer the leader 12:26:26,578 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from null to Follower [WARN] [03/13/2024 12:26:26.578] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCommitWithPersistenceDisabled]] 12:26:26,578 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41 (Follower): Received TimeoutNow - switching to Candidate 12:26:26,578 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41 (Candidate): Election: Candidate has following voting peers: [] 12:26:26,578 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Set currentTerm=1, votedFor=member-1-shard-inventory-config41 12:26:26,579 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config41 (Candidate): Starting new election term 1 12:26:26,579 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config41 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:26,579 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config41 (Follower): Closing 12:26:26,579 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,579 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config41 is no longer the leader 12:26:26,579 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from Follower to Candidate 12:26:26,579 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41 (Candidate): Received ElectionTimeout 12:26:26,579 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41 (Leader): Election: Leader has following peers: [] 12:26:26,579 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config41 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:26,579 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: true, hasLeader : true 12:26:26,579 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: became leader with frontend state for [] 12:26:26,579 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from Candidate to Leader 12:26:26,640 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config41: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:26,640 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config41: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:26,640 PM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config41: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:26,640 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config41: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=113193} is already disabled 12:26:26,640 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config41: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-237-0 12:26:26,640 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config41: Readying Tx member-1-ShardTransactionTest-fe-0-txn-237-0 of 1 operations, client version 13 12:26:26,640 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: readying transaction member-1-ShardTransactionTest-fe-0-txn-237-0 12:26:26,640 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: transaction member-1-ShardTransactionTest-fe-0-txn-237-0 ready 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config41: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-237-0 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Validating transaction member-1-ShardTransactionTest-fe-0-txn-237-0 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-237-0 validated 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-237-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config41: canCommit for member-1-ShardTransactionTest-fe-0-txn-237-0: success 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config41: Committing transaction member-1-ShardTransactionTest-fe-0-txn-237-0 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-237-0 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-237-0 candidate ready 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-237-0: canCommit - candidate rootPath: / 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-237-0: canCommit - messages: [] 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-237-0: preCommit - successfulFromPrevious: [] 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-237-0 prepared 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-237-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config41: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-237-0 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-237-0 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-237-0 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-237-0: commit - successfulFromPrevious: [] 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-237-0 changing state from COMMIT_PENDING to COMMITTED 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-237-0 committed as 0, sending response to Actor[akka://test/system/testProbe-746#-1333117390] 12:26:26,641 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWithPersistenceDisabled] 12:26:26,641 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config41: Created publisher actor Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config41-DTCL-publisher#-921006102] with name member-1-shard-inventory-config41-DTCL-publisher 12:26:26,642 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config41-DTCL-publisher#-921006102] 12:26:26,642 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-237-0 submitted to persistence 12:26:26,642 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: publishChanges: rootPath: / [WARN] [03/13/2024 12:26:26.642] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config41-DTCL-publisher#-921006102]: org.opendaylight.controller.cluster.common.actor.Monitor@162584f9 12:26:26,642 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config41: Elapsed time for generation of change events for member-1-shard-inventory-config41-DTCL-publisher: 82.70 μs 12:26:26,652 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config41 12:26:26,652 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config41 (Leader)_slicer-id-726: Closing 12:26:26,652 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config41: Aborting 0 pending queued transactions [WARN] [03/13/2024 12:26:26.653] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyWithImmediateCommit-false]: org.opendaylight.controller.cluster.common.actor.Monitor@4fe77eae 12:26:26,653 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config42, persistent : true 12:26:26,654 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config42-notifier#-1240602138 created and ready for shard:member-1-shard-inventory-config42 [WARN] [03/13/2024 12:26:26.654] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config42-notifier#-1240602138]: org.opendaylight.controller.cluster.common.actor.Monitor@2c1c1996 12:26:26,654 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-false/shard-member-1:snapshot-read#1188743781] [WARN] [03/13/2024 12:26:26.654] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/shard-member-1:snapshot-read#1188743781]: org.opendaylight.controller.cluster.common.actor.Monitor@6b7139b7 12:26:26,654 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config42 with journal batch size 3 12:26:26,655 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:26,655 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config42: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:26,655 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,655 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config42 is no longer the leader 12:26:26,655 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from null to Follower 12:26:26,656 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42 (Follower): Received TimeoutNow - switching to Candidate 12:26:26,656 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42 (Candidate): Election: Candidate has following voting peers: [] 12:26:26,656 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: Set currentTerm=1, votedFor=member-1-shard-inventory-config42 12:26:26,656 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config42 (Candidate): Starting new election term 1 12:26:26,656 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config42 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:26,656 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config42 (Follower): Closing 12:26:26,656 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,656 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config42 is no longer the leader 12:26:26,656 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from Follower to Candidate 12:26:26,656 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42 (Candidate): Received ElectionTimeout [WARN] [03/13/2024 12:26:26.656] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testReadyWithImmediateCommit-false]] 12:26:26,656 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42 (Leader): Election: Leader has following peers: [] 12:26:26,656 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config42 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:26,656 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: true, hasLeader : true 12:26:26,656 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: became leader with frontend state for [] 12:26:26,656 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from Candidate to Leader 12:26:26,716 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:26,716 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:26,716 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-238-0 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Readying Tx member-1-ShardTransactionTest-fe-0-txn-238-0 of 1 operations, client version 13 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config42: readying transaction member-1-ShardTransactionTest-fe-0-txn-238-0 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config42: transaction member-1-ShardTransactionTest-fe-0-txn-238-0 ready 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config42: Validating transaction member-1-ShardTransactionTest-fe-0-txn-238-0 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config42: Transaction member-1-ShardTransactionTest-fe-0-txn-238-0 validated 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-238-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: canCommit for member-1-ShardTransactionTest-fe-0-txn-238-0: success 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Committing transaction member-1-ShardTransactionTest-fe-0-txn-238-0 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config42: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-238-0 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config42: Transaction member-1-ShardTransactionTest-fe-0-txn-238-0 candidate ready 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-238-0: canCommit - candidate rootPath: / 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-238-0: canCommit - messages: [] 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-238-0: preCommit - successfulFromPrevious: [] 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config42: Transaction member-1-ShardTransactionTest-fe-0-txn-238-0 prepared 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-238-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-238-0 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config42: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-238-0 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:26,717 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config42: Transaction member-1-ShardTransactionTest-fe-0-txn-238-0 submitted to persistence 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Moving last applied index from -1 to 0 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config42: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1527297} is already disabled 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Moving last applied index from 0 to 1 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Applying state for log index 1 data Simple{size=143} 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config42: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-238-0 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-238-0: commit - successfulFromPrevious: [] 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-238-0 changing state from COMMIT_PENDING to COMMITTED 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Transaction member-1-ShardTransactionTest-fe-0-txn-238-0 committed as 0, sending response to Actor[akka://test/system/testProbe-748#3516658] 12:26:26,718 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyWithImmediateCommit-false] 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config42: Created publisher actor Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config42-DTCL-publisher#-1822874977] with name member-1-shard-inventory-config42-DTCL-publisher 12:26:26,718 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config42-DTCL-publisher#-1822874977] 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: fakeSnapshot purging log to 0 for term 1 12:26:26,718 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Persisting ApplyJournalEntries with index=0 12:26:26,718 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config42: publishChanges: rootPath: / 12:26:26,719 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: Persisting ApplyJournalEntries with index=1 [WARN] [03/13/2024 12:26:26.719] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config42-DTCL-publisher#-1822874977]: org.opendaylight.controller.cluster.common.actor.Monitor@43afed9f 12:26:26,719 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config42: Elapsed time for generation of change events for member-1-shard-inventory-config42-DTCL-publisher: 99.24 μs 12:26:26,729 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config42 12:26:26,729 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config42 (Leader)_slicer-id-728: Closing 12:26:26,729 PM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config42: Aborting 0 pending queued transactions 12:26:26,731 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 12:26:26,731 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,732 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,732 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,733 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,733 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,733 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,734 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,734 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,735 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,735 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,735 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,736 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,736 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,736 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,737 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,737 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 12:26:26,738 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractShardTest$1 - Shard created : member-1-shard-inventory-config43, persistent : true [WARN] [03/13/2024 12:26:26.738] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRecovery]: org.opendaylight.controller.cluster.common.actor.Monitor@43cdad46 12:26:26,738 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testRecovery/member-1-shard-inventory-config43-notifier#4452417 created and ready for shard:member-1-shard-inventory-config43 12:26:26,738 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#841229774] [WARN] [03/13/2024 12:26:26.738] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config43-notifier#4452417]: org.opendaylight.controller.cluster.common.actor.Monitor@7356c414 [WARN] [03/13/2024 12:26:26.738] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#841229774]: org.opendaylight.controller.cluster.common.actor.Monitor@59c6ea54 12:26:26,739 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractShardTest$1 - Starting recovery for member-1-shard-inventory-config43 with journal batch size 3 12:26:26,739 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1192440829] 12:26:26,739 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: SnapshotOffer called. 12:26:26,739 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Moving last applied index from -1 to -1 12:26:26,739 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Set currentTerm=1, votedFor=null 12:26:26,739 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Applying recovered snapshot 12:26:26,739 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config43: clearing clients {} 12:26:26,740 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config43: Created publisher actor Actor[akka://test/user/testRecovery/member-1-shard-inventory-config43-DTCL-publisher#-677973028] with name member-1-shard-inventory-config43-DTCL-publisher 12:26:26,740 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testRecovery/member-1-shard-inventory-config43-DTCL-publisher#-677973028] 12:26:26,740 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: state snapshot applied in 235.6 μs 12:26:26,740 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractShardTest$1 - Recovery snapshot applied for member-1-shard-inventory-config43 in 378.0 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 [WARN] [03/13/2024 12:26:26.740] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config43-DTCL-publisher#-677973028]: org.opendaylight.controller.cluster.common.actor.Monitor@2a0f3833 12:26:26,740 PM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config43: publishChanges: rootPath: / 12:26:26,740 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config43: Elapsed time for generation of change events for member-1-shard-inventory-config43-DTCL-publisher: 130.4 μs 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 0, size: 45 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 1, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 2, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 3, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 4, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 5, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 6, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 7, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 8, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 9, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 10, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 11, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 12, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 13, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 14, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 15, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received ReplicatedLogEntry for recovery: index: 16, size: 184 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Received apply journal entries for recovery, applying to state: 0 to 16 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: starting log recovery batch with max size 3 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config43: Added client Enabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@3432bef1}, purged=MutableUnsignedLongSet{size=0}} 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-239-0 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-240-0 12:26:26,742 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-241-0 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: starting log recovery batch with max size 3 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-242-0 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-243-0 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-244-0 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: starting log recovery batch with max size 3 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-245-0 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-246-0 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-247-0 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: starting log recovery batch with max size 3 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-248-0 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-249-0 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-250-0 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: starting log recovery batch with max size 3 12:26:26,743 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-251-0 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-252-0 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-253-0 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: starting log recovery batch with max size 3 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-254-0 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config43: Committed transaction member-1-ShardTransactionTest-fe-0-txn-255-0 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Moving last applied index from -1 to 16 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config43: Recovery completed in 4.534 ms - Switching actor to Follower - last log index = 16, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 17 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config43 is no longer the leader 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43 (Follower): Received TimeoutNow - switching to Candidate 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43 (Candidate): Election: Candidate has following voting peers: [] 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Set currentTerm=2, votedFor=member-1-shard-inventory-config43 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config43 (Candidate): Starting new election term 2 12:26:26,744 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from null to Follower 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config43 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config43 (Follower): Closing 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,744 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config43 is no longer the leader 12:26:26,744 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:26.745] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testRecovery]] 12:26:26,745 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43 (Candidate): Received ElectionTimeout 12:26:26,745 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43 (Leader): Election: Leader has following peers: [] 12:26:26,745 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config43 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 12:26:26,745 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: true, hasLeader : true 12:26:26,745 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: became leader with frontend state for [member-1-frontend-ShardTransactionTest] 12:26:26,745 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from Candidate to Leader 12:26:26,745 PM [test-akka.actor.default-dispatcher-15] [INFO] AbstractShardTest$1 - Stopping Shard member-1-shard-inventory-config43 12:26:26,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config43 (Leader)_slicer-id-730: Closing 12:26:26,746 PM [test-akka.actor.default-dispatcher-15] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config43: Aborting 0 pending queued transactions 12:26:26,746 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config44, persistent : true [WARN] [03/13/2024 12:26:26.746] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.common.actor.Monitor@6fd2877e 12:26:26,747 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testAbortAfterReady/member-1-shard-inventory-config44-notifier#2127288964 created and ready for shard:member-1-shard-inventory-config44 [WARN] [03/13/2024 12:26:26.747] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config44-notifier#2127288964]: org.opendaylight.controller.cluster.common.actor.Monitor@3ef54872 12:26:26,747 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-383866398] [WARN] [03/13/2024 12:26:26.747] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-383866398]: org.opendaylight.controller.cluster.common.actor.Monitor@5f086ff1 12:26:26,747 PM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config44 with journal batch size 3 12:26:26,747 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:26,747 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config44: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:26,747 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,747 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config44 is no longer the leader 12:26:26,748 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from null to Follower 12:26:26,748 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44 (Follower): Received TimeoutNow - switching to Candidate 12:26:26,748 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44 (Candidate): Election: Candidate has following voting peers: [] 12:26:26,748 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Set currentTerm=1, votedFor=member-1-shard-inventory-config44 12:26:26,748 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config44 (Candidate): Starting new election term 1 12:26:26,748 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config44 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:26,748 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config44 (Follower): Closing 12:26:26,748 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,748 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config44 is no longer the leader 12:26:26,748 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from Follower to Candidate 12:26:26,748 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44 (Candidate): Received ElectionTimeout 12:26:26,748 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44 (Leader): Election: Leader has following peers: [] 12:26:26,748 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config44 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:26,748 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: true, hasLeader : true 12:26:26,748 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: became leader with frontend state for [] 12:26:26,748 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from Candidate to Leader [WARN] [03/13/2024 12:26:26.749] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testAbortAfterReady]] 12:26:26,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:26,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:26,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:26,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-256-0 12:26:26,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Readying Tx member-1-ShardTransactionTest-fe-0-txn-256-0 of 1 operations, client version 13 12:26:26,857 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: readying transaction member-1-ShardTransactionTest-fe-0-txn-256-0 12:26:26,858 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: transaction member-1-ShardTransactionTest-fe-0-txn-256-0 ready 12:26:26,858 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-257-0 12:26:26,858 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Readying Tx member-1-ShardTransactionTest-fe-0-txn-257-0 of 1 operations, client version 13 12:26:26,858 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: readying transaction member-1-ShardTransactionTest-fe-0-txn-257-0 12:26:26,858 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: transaction member-1-ShardTransactionTest-fe-0-txn-257-0 ready 12:26:26,858 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-258-0 12:26:26,858 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Readying Tx member-1-ShardTransactionTest-fe-0-txn-258-0 of 1 operations, client version 13 12:26:26,858 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: readying transaction member-1-ShardTransactionTest-fe-0-txn-258-0 12:26:26,858 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: transaction member-1-ShardTransactionTest-fe-0-txn-258-0 ready 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from -1 to 0 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config44: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1790443} is already disabled 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-257-0 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: aborting queued transaction member-1-ShardTransactionTest-fe-0-txn-257-0 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-257-0: abort - successfulFromPrevious: [] 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=0 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-256-0 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Validating transaction member-1-ShardTransactionTest-fe-0-txn-256-0 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-256-0 validated 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-256-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:26,859 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: canCommit for member-1-ShardTransactionTest-fe-0-txn-256-0: success 12:26:26,859 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Committing transaction member-1-ShardTransactionTest-fe-0-txn-256-0 12:26:26,859 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-256-0 12:26:26,859 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-256-0 candidate ready 12:26:26,859 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-256-0: canCommit - candidate rootPath: / 12:26:26,860 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-256-0: canCommit - messages: [] 12:26:26,860 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-256-0: preCommit - successfulFromPrevious: [] 12:26:26,860 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-256-0 prepared 12:26:26,860 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-256-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:26,860 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-256-0 12:26:26,860 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-256-0 12:26:26,860 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 144 12:26:26,860 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=144}] 12:26:26,860 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=144}] 12:26:26,860 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-256-0 submitted to persistence 12:26:26,860 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=144}] 12:26:26,861 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from 0 to 1 12:26:26,861 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 1 data Simple{size=144} 12:26:26,861 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-256-0 12:26:26,861 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-256-0: commit - successfulFromPrevious: [] 12:26:26,861 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-256-0 changing state from COMMIT_PENDING to COMMITTED 12:26:26,861 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-256-0 committed as 0, sending response to Actor[akka://test/system/testProbe-750#1793595170] 12:26:26,861 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config44: Created publisher actor Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config44-DTCL-publisher#-52834483] with name member-1-shard-inventory-config44-DTCL-publisher 12:26:26,861 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config44-DTCL-publisher#-52834483] 12:26:26,861 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config44: publishChanges: rootPath: / 12:26:26,861 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-258-0 12:26:26,861 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Validating transaction member-1-ShardTransactionTest-fe-0-txn-258-0 12:26:26,861 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-258-0 validated 12:26:26,861 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-258-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:26,861 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: canCommit for member-1-ShardTransactionTest-fe-0-txn-258-0: success 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: fakeSnapshot purging log to 0 for term 1 12:26:26,862 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config44: Elapsed time for generation of change events for member-1-shard-inventory-config44-DTCL-publisher: 82.61 μs 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=1 [WARN] [03/13/2024 12:26:26.862] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config44-DTCL-publisher#-52834483]: org.opendaylight.controller.cluster.common.actor.Monitor@585c68d 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Committing transaction member-1-ShardTransactionTest-fe-0-txn-258-0 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-258-0 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-258-0 candidate ready 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-258-0: canCommit - candidate rootPath: / 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-258-0: canCommit - messages: [] 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-258-0: preCommit - successfulFromPrevious: [] 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-258-0 prepared 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-258-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-258-0 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-258-0 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 46 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=46}] 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=46}] 12:26:26,862 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-258-0 submitted to persistence 12:26:26,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=46}] 12:26:26,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from 1 to 2 12:26:26,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 2 data Simple{size=46} 12:26:26,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-258-0 12:26:26,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-258-0: commit - successfulFromPrevious: [] 12:26:26,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-258-0 changing state from COMMIT_PENDING to COMMITTED 12:26:26,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-258-0 committed as 0, sending response to Actor[akka://test/system/testProbe-750#1793595170] 12:26:26,863 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config44: publishChanges: rootPath: / 12:26:26,863 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterReady] 12:26:26,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: fakeSnapshot purging log to 1 for term 1 12:26:26,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=2 12:26:26,863 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config44: Elapsed time for generation of change events for member-1-shard-inventory-config44-DTCL-publisher: 27.89 μs 12:26:26,873 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config44 12:26:26,873 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config44 (Leader)_slicer-id-732: Closing 12:26:26,874 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Aborting 0 pending queued transactions 12:26:26,875 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config45, persistent : true [WARN] [03/13/2024 12:26:26.876] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false]: org.opendaylight.controller.cluster.common.actor.Monitor@2c15854e 12:26:26,876 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config45-notifier#-809719283 created and ready for shard:member-1-shard-inventory-config45 [WARN] [03/13/2024 12:26:26.876] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config45-notifier#-809719283]: org.opendaylight.controller.cluster.common.actor.Monitor@480d4f06 12:26:26,876 PM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/shard-member-1:snapshot-read#929434487] 12:26:26,876 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config45 with journal batch size 3 [WARN] [03/13/2024 12:26:26.876] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/shard-member-1:snapshot-read#929434487]: org.opendaylight.controller.cluster.common.actor.Monitor@eec7fe9 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config45: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config45: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config45: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config45 is no longer the leader 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config45 (Follower): Received TimeoutNow - switching to Candidate [WARN] [03/13/2024 12:26:26.877] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false]] 12:26:26,877 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from null to Follower 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config45 (Candidate): Election: Candidate has following voting peers: [] 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config45: Set currentTerm=1, votedFor=member-1-shard-inventory-config45 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config45 (Candidate): Starting new election term 1 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config45 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config45 (Follower): Closing 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: false, hasLeader : false 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config45: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config45 is no longer the leader 12:26:26,877 PM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from Follower to Candidate 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config45 (Candidate): Received ElectionTimeout 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config45 (Leader): Election: Leader has following peers: [] 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config45 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:26,877 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: true, hasLeader : true 12:26:26,878 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config45: became leader with frontend state for [] 12:26:26,878 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from Candidate to Leader 12:26:26,986 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:26,986 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:26,986 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:26,986 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-259-0 12:26:26,987 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Readying Tx member-1-ShardTransactionTest-fe-0-txn-259-0 of 1 operations, client version 13 12:26:26,987 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: readying transaction member-1-ShardTransactionTest-fe-0-txn-259-0 12:26:26,987 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: transaction member-1-ShardTransactionTest-fe-0-txn-259-0 ready 12:26:26,987 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-259-0 12:26:26,987 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Validating transaction member-1-ShardTransactionTest-fe-0-txn-259-0 12:26:26,987 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Transaction member-1-ShardTransactionTest-fe-0-txn-259-0 validated 12:26:26,987 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-259-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:26,987 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: canCommit for member-1-ShardTransactionTest-fe-0-txn-259-0: success 12:26:26,987 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Committing transaction member-1-ShardTransactionTest-fe-0-txn-259-0 12:26:26,987 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-259-0 12:26:26,987 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Transaction member-1-ShardTransactionTest-fe-0-txn-259-0 candidate ready 12:26:26,987 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-259-0: canCommit - candidate rootPath: / 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-259-0: canCommit - messages: [] 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-259-0: preCommit - successfulFromPrevious: [] 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Transaction member-1-ShardTransactionTest-fe-0-txn-259-0 prepared 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-259-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-259-0 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-259-0 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 144 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=144}] 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=144}] 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Transaction member-1-ShardTransactionTest-fe-0-txn-259-0 submitted to persistence 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Moving last applied index from -1 to 0 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config45: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2056950} is already disabled 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Persisting ApplyJournalEntries with index=0 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=144}] 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Moving last applied index from 0 to 1 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Applying state for log index 1 data Simple{size=144} 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-259-0 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-259-0: commit - successfulFromPrevious: [] 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-259-0 changing state from COMMIT_PENDING to COMMITTED 12:26:26,988 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Transaction member-1-ShardTransactionTest-fe-0-txn-259-0 committed as 0, sending response to Actor[akka://test/system/testProbe-752#656444902] 12:26:26,989 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config45: Created publisher actor Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config45-DTCL-publisher#-1988049065] with name member-1-shard-inventory-config45-DTCL-publisher 12:26:26,989 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config45-DTCL-publisher#-1988049065] 12:26:26,989 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config45: publishChanges: rootPath: / 12:26:26,989 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: fakeSnapshot purging log to 0 for term 1 12:26:26,989 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Persisting ApplyJournalEntries with index=1 12:26:26,989 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config45: Elapsed time for generation of change events for member-1-shard-inventory-config45-DTCL-publisher: 79.33 μs [WARN] [03/13/2024 12:26:26.989] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config45-DTCL-publisher#-1988049065]: org.opendaylight.controller.cluster.common.actor.Monitor@62e7950 12:26:27,190 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false] 12:26:27,201 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config45 12:26:27,201 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config45 (Leader)_slicer-id-734: Closing 12:26:27,201 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config45: Aborting 0 pending queued transactions 12:26:27,203 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1TestShard - Shard created : member-1-shard-inventory-config46, persistent : false [WARN] [03/13/2024 12:26:27.203] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData]: org.opendaylight.controller.cluster.common.actor.Monitor@2825ae25 12:26:27,204 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config46-notifier#1552351460 created and ready for shard:member-1-shard-inventory-config46 [WARN] [03/13/2024 12:26:27.204] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config46-notifier#1552351460]: org.opendaylight.controller.cluster.common.actor.Monitor@4c03ce86 12:26:27,204 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/shard-member-1:snapshot-read#-1017415053] [WARN] [03/13/2024 12:26:27.204] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/shard-member-1:snapshot-read#-1017415053]: org.opendaylight.controller.cluster.common.actor.Monitor@6d030bd4 12:26:27,204 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1TestShard - Starting recovery for member-1-shard-inventory-config46 with journal batch size 3 12:26:27,205 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:27,205 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config46: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:27,205 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onLeadershipChange, isLeader: false, hasLeader : false 12:26:27,205 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config46 is no longer the leader 12:26:27,206 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46 (Follower): Received TimeoutNow - switching to Candidate [WARN] [03/13/2024 12:26:27.206] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData]] 12:26:27,206 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config46 , received role change from null to Follower 12:26:27,206 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46 (Candidate): Election: Candidate has following voting peers: [] 12:26:27,206 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: Set currentTerm=1, votedFor=member-1-shard-inventory-config46 12:26:27,206 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config46 (Candidate): Starting new election term 1 12:26:27,206 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config46 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:27,206 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config46 (Follower): Closing 12:26:27,206 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onLeadershipChange, isLeader: false, hasLeader : false 12:26:27,206 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config46 is no longer the leader 12:26:27,206 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config46 , received role change from Follower to Candidate 12:26:27,211 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46 (Candidate): Received ElectionTimeout 12:26:27,211 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46 (Leader): Election: Leader has following peers: [] 12:26:27,211 PM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config46 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:27,211 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onLeadershipChange, isLeader: true, hasLeader : true 12:26:27,211 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: became leader with frontend state for [] 12:26:27,211 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config46 , received role change from Candidate to Leader 12:26:27,261 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:27,261 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:27,261 PM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendMetadata - member-1-shard-inventory-config46: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:27,261 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=84302} is already disabled 12:26:27,261 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-260-0 12:26:27,261 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: Readying Tx member-1-ShardTransactionTest-fe-0-txn-260-0 of 1 operations, client version 13 12:26:27,261 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: readying transaction member-1-ShardTransactionTest-fe-0-txn-260-0 12:26:27,261 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: transaction member-1-ShardTransactionTest-fe-0-txn-260-0 ready 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Validating transaction member-1-ShardTransactionTest-fe-0-txn-260-0 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-260-0 validated 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-260-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: canCommit for member-1-ShardTransactionTest-fe-0-txn-260-0: success 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: Committing transaction member-1-ShardTransactionTest-fe-0-txn-260-0 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-260-0 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-260-0 candidate ready 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-260-0: canCommit - candidate rootPath: / 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-260-0: canCommit - messages: [] 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-260-0: preCommit - successfulFromPrevious: [] 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-260-0 prepared 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-260-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-260-0 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-260-0 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 144 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-260-0 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-260-0: commit - successfulFromPrevious: [] 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-260-0 changing state from COMMIT_PENDING to COMMITTED 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-260-0 committed as 0, sending response to Actor[akka://test/temp/testCreateSnapshotWithNonPersistentData$g] 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config46: Created publisher actor Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config46-DTCL-publisher#102833593] with name member-1-shard-inventory-config46-DTCL-publisher 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-260-0 submitted to persistence 12:26:27,262 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config46-DTCL-publisher#102833593] 12:26:27,263 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: publishChanges: rootPath: / [WARN] [03/13/2024 12:26:27.263] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config46-DTCL-publisher#102833593]: org.opendaylight.controller.cluster.common.actor.Monitor@39f1b6c6 12:26:27,263 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config46: Elapsed time for generation of change events for member-1-shard-inventory-config46-DTCL-publisher: 48.94 μs 12:26:27,265 PM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config46: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 12:26:27,265 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: lastSequenceNumber prior to capture: -1 12:26:27,265 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 12:26:27,265 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: CaptureSnapshotReply received by actor 12:26:27,265 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config46: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@5d525fd5, electionTerm=1, electionVotedFor=member-1-shard-inventory-config46, ServerConfigPayload=null] 12:26:27,265 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config46: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 12:26:27,265 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: Snapshot success - sequence number: -1 12:26:27,265 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: SnapshotComplete received 12:26:27,265 PM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config46: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 12:26:27,265 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: lastSequenceNumber prior to capture: -1 12:26:27,265 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 12:26:27,265 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: CaptureSnapshotReply received by actor 12:26:27,265 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config46: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@72fa09e2, electionTerm=1, electionVotedFor=member-1-shard-inventory-config46, ServerConfigPayload=null] 12:26:27,265 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config46: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 12:26:27,266 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: Snapshot success - sequence number: -1 12:26:27,266 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: SnapshotComplete received 12:26:27,266 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData] 12:26:27,276 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - Stopping Shard member-1-shard-inventory-config46 12:26:27,276 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageSlicer - member-1-shard-inventory-config46 (Leader)_slicer-id-736: Closing 12:26:27,276 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config46: Aborting 0 pending queued transactions 12:26:27,279 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Shard created : member-1-shard-inventory-config47, persistent : true [WARN] [03/13/2024 12:26:27.279] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.common.actor.Monitor@2645aa0a 12:26:27,280 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testFollowerInitialSyncStatus/member-1-shard-inventory-config47-notifier#644932509 created and ready for shard:member-1-shard-inventory-config47 [WARN] [03/13/2024 12:26:27.280] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testFollowerInitialSyncStatus/member-1-shard-inventory-config47-notifier#644932509]: org.opendaylight.controller.cluster.common.actor.Monitor@73869bba 12:26:27,280 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testFollowerInitialSyncStatus/shard-member-1:snapshot-read#327001227] 12:26:27,280 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Starting recovery for member-1-shard-inventory-config47 with journal batch size 3 [WARN] [03/13/2024 12:26:27.280] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testFollowerInitialSyncStatus/shard-member-1:snapshot-read#327001227]: org.opendaylight.controller.cluster.common.actor.Monitor@61fa867e 12:26:27,281 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config47: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:27,281 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config47: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:27,281 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onLeadershipChange, isLeader: false, hasLeader : false 12:26:27,281 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config47: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config47 is no longer the leader 12:26:27,281 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config47 , received role change from null to Follower 12:26:27,281 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config47 (Follower): Received TimeoutNow - switching to Candidate 12:26:27,281 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config47 (Candidate): Election: Candidate has following voting peers: [] 12:26:27,281 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config47: Set currentTerm=1, votedFor=member-1-shard-inventory-config47 12:26:27,281 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config47 (Candidate): Starting new election term 1 12:26:27,281 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config47 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:27,281 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config47 (Follower): Closing 12:26:27,281 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onLeadershipChange, isLeader: false, hasLeader : false 12:26:27,281 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config47: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config47 is no longer the leader 12:26:27,281 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config47 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:27.281] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testFollowerInitialSyncStatus]] 12:26:27,282 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config47 (Candidate): Received ElectionTimeout 12:26:27,282 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config47 (Leader): Election: Leader has following peers: [] 12:26:27,282 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config47 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:27,282 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onLeadershipChange, isLeader: true, hasLeader : true 12:26:27,282 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config47: became leader with frontend state for [] 12:26:27,282 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config47 , received role change from Candidate to Leader 12:26:27,379 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testFollowerInitialSyncStatus] [WARN] [03/13/2024 12:26:27.380] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@62255338 [WARN] [03/13/2024 12:26:27.380] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@d3b5d6b 12:26:27,390 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Stopping Shard member-1-shard-inventory-config47 12:26:27,390 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageSlicer - member-1-shard-inventory-config47 (Leader)_slicer-id-738: Closing 12:26:27,390 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config47: Aborting 0 pending queued transactions 12:26:27,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#-609250479] [WARN] [03/13/2024 12:26:27.395] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#-609250479]: org.opendaylight.controller.cluster.common.actor.Monitor@7c5d4a4b 12:26:27,397 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1$1 - Shard created : member-1-shard-inventory-config48, persistent : true 12:26:27,397 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1$1 - Starting recovery for member-1-shard-inventory-config48 with journal batch size 3 [WARN] [03/13/2024 12:26:27.397] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]: org.opendaylight.controller.cluster.common.actor.Monitor@6c064e74 12:26:27,397 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config48-notifier#-2016039575 created and ready for shard:member-1-shard-inventory-config48 12:26:27,398 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/shard-member-1:snapshot-read#-881058419] [WARN] [03/13/2024 12:26:27.398] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config48-notifier#-2016039575]: org.opendaylight.controller.cluster.common.actor.Monitor@4d398190 [WARN] [03/13/2024 12:26:27.398] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/shard-member-1:snapshot-read#-881058419]: org.opendaylight.controller.cluster.common.actor.Monitor@27183152 12:26:27,398 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1192440829] 12:26:27,398 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48: SnapshotOffer called. 12:26:27,398 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48: Moving last applied index from -1 to -1 12:26:27,398 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48: Set currentTerm=1, votedFor=null 12:26:27,398 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48: Applying recovered snapshot 12:26:27,398 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config48: clearing clients {} 12:26:27,398 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config48: Created publisher actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config48-DTCL-publisher#1511939992] with name member-1-shard-inventory-config48-DTCL-publisher 12:26:27,398 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: state snapshot applied in 330.7 μs 12:26:27,399 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1$1 - Recovery snapshot applied for member-1-shard-inventory-config48 in 494.5 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:26:27,399 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config48-DTCL-publisher#1511939992] 12:26:27,399 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config48: publishChanges: rootPath: / 12:26:27,399 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config48: Elapsed time for generation of change events for member-1-shard-inventory-config48-DTCL-publisher: 75.18 μs [WARN] [03/13/2024 12:26:27.399] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config48-DTCL-publisher#1511939992]: org.opendaylight.controller.cluster.common.actor.Monitor@2a7e187c 12:26:27,399 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:27,399 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1$1 - member-1-shard-inventory-config48: Recovery completed in 1.032 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:27,399 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: onLeadershipChange, isLeader: false, hasLeader : false 12:26:27,399 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config48 is no longer the leader [WARN] [03/13/2024 12:26:27.399] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 12:26:27,399 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config48 , received role change from null to Follower 12:26:27,399 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48 (Follower): Received TimeoutNow - switching to Candidate 12:26:27,399 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48 (Candidate): Election: Candidate has following voting peers: [] 12:26:27,400 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48: Set currentTerm=2, votedFor=member-1-shard-inventory-config48 12:26:27,400 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1$1 - member-1-shard-inventory-config48 (Candidate): Starting new election term 2 12:26:27,400 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1$1 - member-1-shard-inventory-config48 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 12:26:27,400 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config48 (Follower): Closing 12:26:27,400 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: onLeadershipChange, isLeader: false, hasLeader : false 12:26:27,400 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config48 is no longer the leader 12:26:27,400 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config48 , received role change from Follower to Candidate 12:26:27,411 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#-609250479]], isLeader: false, hasLeader: false 12:26:27,412 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: Shard does not have a leader - delaying registration 12:26:27,412 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a 12:26:27,412 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a#-785587832] [WARN] [03/13/2024 12:26:27.412] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a#-785587832]: org.opendaylight.controller.cluster.common.actor.Monitor@7a6abb9b 12:26:27,412 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48 (Candidate): Received ElectionTimeout 12:26:27,412 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48 (Leader): Election: Leader has following peers: [] 12:26:27,412 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1$1 - member-1-shard-inventory-config48 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 12:26:27,412 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: onLeadershipChange, isLeader: true, hasLeader : true 12:26:27,412 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config48: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@76b7292e 12:26:27,412 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 12:26:27,412 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config48: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]], initialState present=true] to publisher actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config48-DTCL-publisher#1511939992] 12:26:27,413 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48: became leader with frontend state for [] 12:26:27,413 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config48: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]], initialState present=true] 12:26:27,413 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config48 , received role change from Candidate to Leader 12:26:27,413 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config48: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 12:26:27,413 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config48: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 12:26:27,413 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)] 12:26:27,413 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config48: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 12:26:27,413 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config48: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@76b7292e 12:26:27,414 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#-609250479] 12:26:27,424 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration] 12:26:27,425 PM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1$1 - Stopping Shard member-1-shard-inventory-config48 12:26:27,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config48 (Leader)_slicer-id-740: Closing 12:26:27,425 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config48: Aborting 0 pending queued transactions 12:26:27,426 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config49, persistent : true 12:26:27,427 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config49 with journal batch size 3 [WARN] [03/13/2024 12:26:27.427] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@7df01011 12:26:27,427 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/shard-member-1:snapshot-read#766746732] 12:26:27,427 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config49-notifier#-173806354 created and ready for shard:member-1-shard-inventory-config49 [WARN] [03/13/2024 12:26:27.427] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config49-notifier#-173806354]: org.opendaylight.controller.cluster.common.actor.Monitor@24511588 [WARN] [03/13/2024 12:26:27.428] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/shard-member-1:snapshot-read#766746732]: org.opendaylight.controller.cluster.common.actor.Monitor@e5b785a 12:26:27,429 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:27,429 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config49: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:27,429 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config49: onLeadershipChange, isLeader: false, hasLeader : false 12:26:27,429 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config49 is no longer the leader 12:26:27,429 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config49 , received role change from null to Follower 12:26:27,429 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49 (Follower): Received TimeoutNow - switching to Candidate 12:26:27,429 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49 (Candidate): Election: Candidate has following voting peers: [] 12:26:27,429 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Set currentTerm=1, votedFor=member-1-shard-inventory-config49 12:26:27,429 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config49 (Candidate): Starting new election term 1 12:26:27,429 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config49 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:27,429 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config49 (Follower): Closing 12:26:27,429 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config49: onLeadershipChange, isLeader: false, hasLeader : false 12:26:27,429 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config49 is no longer the leader 12:26:27,430 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config49 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:27.430] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit]] 12:26:27,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49 (Candidate): Received ElectionTimeout 12:26:27,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49 (Leader): Election: Leader has following peers: [] 12:26:27,430 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config49 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:27,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config49: onLeadershipChange, isLeader: true, hasLeader : true 12:26:27,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: became leader with frontend state for [] 12:26:27,430 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config49 , received role change from Candidate to Leader 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-261-0 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-261-0 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Validating transaction member-1-ShardTransactionTest-fe-0-txn-261-0 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-261-0 validated 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-261-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: canCommit for member-1-ShardTransactionTest-fe-0-txn-261-0: success 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Committing transaction member-1-ShardTransactionTest-fe-0-txn-261-0 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-261-0 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-261-0 candidate ready 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-261-0: canCommit - candidate rootPath: / 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-261-0: canCommit - messages: [] 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-261-0: preCommit - successfulFromPrevious: [] 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-261-0 prepared 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-261-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-261-0 12:26:27,491 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-261-0 12:26:27,492 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 176 12:26:27,492 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=176}] 12:26:27,492 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=176}] 12:26:27,492 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-261-0 submitted to persistence 12:26:27,492 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:27,492 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Moving last applied index from -1 to 0 12:26:27,492 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config49: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1718693} is already disabled 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=176}] 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Moving last applied index from 0 to 1 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Applying state for log index 1 data Simple{size=176} 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-261-0 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-261-0: commit - successfulFromPrevious: [] 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-261-0 changing state from COMMIT_PENDING to COMMITTED 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-261-0 committed as 0, sending response to Actor[akka://test/system/testProbe-758#-633928603] 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config49: Created publisher actor Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config49-DTCL-publisher#1007361875] with name member-1-shard-inventory-config49-DTCL-publisher 12:26:27,493 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config49-DTCL-publisher#1007361875] 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: fakeSnapshot purging log to 0 for term 1 12:26:27,493 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config49: publishChanges: rootPath: / 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Persisting ApplyJournalEntries with index=0 12:26:27,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config49: Persisting ApplyJournalEntries with index=1 [WARN] [03/13/2024 12:26:27.493] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config49-DTCL-publisher#1007361875]: org.opendaylight.controller.cluster.common.actor.Monitor@66ca7260 12:26:27,494 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config49: Elapsed time for generation of change events for member-1-shard-inventory-config49-DTCL-publisher: 113.3 μs 12:26:27,494 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit] 12:26:27,504 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config49 12:26:27,504 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config49 (Leader)_slicer-id-742: Closing 12:26:27,504 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config49: Aborting 0 pending queued transactions 12:26:27,506 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config50, persistent : true [WARN] [03/13/2024 12:26:27.506] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain#673504746]: org.opendaylight.controller.cluster.common.actor.Monitor@f647f59 12:26:27,506 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testCreateTransactionOnChain/member-1-shard-inventory-config50-notifier#-1417503447 created and ready for shard:member-1-shard-inventory-config50 [WARN] [03/13/2024 12:26:27.506] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/member-1-shard-inventory-config50-notifier#-1417503447]: org.opendaylight.controller.cluster.common.actor.Monitor@60929644 12:26:27,507 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateTransactionOnChain/shard-member-1:snapshot-read#1840732324] [WARN] [03/13/2024 12:26:27.507] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/shard-member-1:snapshot-read#1840732324]: org.opendaylight.controller.cluster.common.actor.Monitor@3433cda1 12:26:27,517 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config50 with journal batch size 3 12:26:27,518 PM [Cleaner-1] [DEBUG] ProxyHistory - Proxy org.opendaylight.controller.cluster.databroker.actors.dds.ProxyHistory$RemoteSingle@13330ec aborted transaction RemoteProxyTransaction{identifier=member-2-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-1-1, state=OPEN} 12:26:27,518 PM [Cleaner-1] [DEBUG] AbstractProxyTransaction - Transaction RemoteProxyTransaction{identifier=member-2-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-1-1, state=OPEN} allocated sequence 1 12:26:27,518 PM [Cleaner-1] [DEBUG] AbstractProxyTransaction - Transaction proxy RemoteProxyTransaction{identifier=member-2-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-1-1, state=OPEN} sending request ModifyTransactionRequest{target=member-2-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-1-1, sequence=1, replyTo=Actor[akka://cluster-test/user/$a#2019315241], modifications=0, protocol=ABORT} callback org.opendaylight.controller.cluster.databroker.actors.dds.AbstractProxyTransaction$$Lambda$1188/0x00000008012c3c50@6b3aa1ec 12:26:27,518 PM [Cleaner-1] [DEBUG] AbstractClientConnection - member-2-frontend-datastore-testWriteTransactionWithMultipleShards: timer already scheduled on ConnectedClientConnection{client=ClientIdentifier{frontend=member-2-frontend-datastore-testWriteTransactionWithMultipleShards, generation=0}, cookie=1, backend=ShardBackendInfo{actor=Actor[akka://cluster-test@127.0.0.1:2558/user/shardmanager-testWriteTransactionWithMultipleShards/member-1-shard-cars-testWriteTransactionWithMultipleShards#-424198523], sessionId=0, version=POTASSIUM, maxMessages=1000, cookie=1, shard=cars, dataTree=absent}} 12:26:27,518 PM [Cleaner-1] [DEBUG] AbstractClientConnection - member-2-frontend-datastore-testWriteTransactionWithMultipleShards: timer already scheduled on ReconnectingClientConnection{client=ClientIdentifier{frontend=member-2-frontend-datastore-testWriteTransactionWithMultipleShards, generation=0}, cookie=1, backend=ShardBackendInfo{actor=Actor[akka://cluster-test@127.0.0.1:2558/user/shardmanager-testWriteTransactionWithMultipleShards/member-1-shard-cars-testWriteTransactionWithMultipleShards#-424198523], sessionId=0, version=POTASSIUM, maxMessages=1000, cookie=1, shard=cars, dataTree=absent}} 12:26:27,518 PM [Cleaner-1] [DEBUG] ProxyHistory - Proxy org.opendaylight.controller.cluster.databroker.actors.dds.ProxyHistory$RemoteSingle@7fef9a76 aborted transaction RemoteProxyTransaction{identifier=member-2-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-1-2, state=OPEN} 12:26:27,518 PM [Cleaner-1] [DEBUG] AbstractProxyTransaction - Transaction RemoteProxyTransaction{identifier=member-2-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-1-2, state=OPEN} allocated sequence 1 12:26:27,518 PM [Cleaner-1] [DEBUG] AbstractProxyTransaction - Transaction proxy RemoteProxyTransaction{identifier=member-2-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-1-2, state=OPEN} sending request ModifyTransactionRequest{target=member-2-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-1-2, sequence=1, replyTo=Actor[akka://cluster-test/user/$a#2019315241], modifications=0, protocol=ABORT} callback org.opendaylight.controller.cluster.databroker.actors.dds.AbstractProxyTransaction$$Lambda$1188/0x00000008012c3c50@48f4aa16 12:26:27,518 PM [Cleaner-1] [DEBUG] AbstractClientConnection - member-2-frontend-datastore-testWriteTransactionWithMultipleShards: timer already scheduled on ConnectedClientConnection{client=ClientIdentifier{frontend=member-2-frontend-datastore-testWriteTransactionWithMultipleShards, generation=0}, cookie=2, backend=ShardBackendInfo{actor=Actor[akka://cluster-test@127.0.0.1:2558/user/shardmanager-testWriteTransactionWithMultipleShards/member-1-shard-people-testWriteTransactionWithMultipleShards#515256423], sessionId=1, version=POTASSIUM, maxMessages=1000, cookie=2, shard=people, dataTree=absent}} 12:26:27,518 PM [Cleaner-1] [DEBUG] AbstractClientConnection - member-2-frontend-datastore-testWriteTransactionWithMultipleShards: timer already scheduled on ReconnectingClientConnection{client=ClientIdentifier{frontend=member-2-frontend-datastore-testWriteTransactionWithMultipleShards, generation=0}, cookie=2, backend=ShardBackendInfo{actor=Actor[akka://cluster-test@127.0.0.1:2558/user/shardmanager-testWriteTransactionWithMultipleShards/member-1-shard-people-testWriteTransactionWithMultipleShards#515256423], sessionId=1, version=POTASSIUM, maxMessages=1000, cookie=2, shard=people, dataTree=absent}} 12:26:27,518 PM [Cleaner-1] [INFO] ClientBackedTransaction - Aborted orphan transaction ClientSnapshot{identifier=member-2-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-1-0} 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config50: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config50: onLeadershipChange, isLeader: false, hasLeader : false 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config50 is no longer the leader 12:26:27,519 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config50 , received role change from null to Follower 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50 (Follower): Received TimeoutNow - switching to Candidate 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50 (Candidate): Election: Candidate has following voting peers: [] 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50: Set currentTerm=1, votedFor=member-1-shard-inventory-config50 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config50 (Candidate): Starting new election term 1 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config50 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config50 (Follower): Closing 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config50: onLeadershipChange, isLeader: false, hasLeader : false 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config50 is no longer the leader 12:26:27,519 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config50 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:27.519] [test-akka.actor.default-dispatcher-10] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=Actor[akka://test/user/testCreateTransactionOnChain#673504746]] 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50 (Candidate): Received ElectionTimeout 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50 (Leader): Election: Leader has following peers: [] 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config50 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config50: onLeadershipChange, isLeader: true, hasLeader : true 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50: became leader with frontend state for [] 12:26:27,519 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config50 , received role change from Candidate to Leader 12:26:27,579 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config50: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:27,580 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config50: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:27,580 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config50: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:27,580 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config50: Creating transaction : member-1-ShardTransactionTest-fe-0-txn-262-0 12:26:27,580 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testCreateTransactionOnChain/shard-inventory-member-1:ShardTransactionTest@0:262_3#-1332541360] 12:26:27,581 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testCreateTransactionOnChain#673504746] [WARN] [03/13/2024 12:26:27.581] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/shard-inventory-member-1:ShardTransactionTest@0:262_3#-1332541360]: org.opendaylight.controller.cluster.common.actor.Monitor@f41a70 12:26:27,581 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config50: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:27,581 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config50: Moving last applied index from -1 to 0 12:26:27,581 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config50: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:27,581 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config50: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:27,581 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config50: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:27,581 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config50: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1435895} is already disabled 12:26:27,581 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config50: Persisting ApplyJournalEntries with index=0 12:26:27,591 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config50 12:26:27,591 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config50 (Leader)_slicer-id-744: Closing 12:26:27,591 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config50: Aborting 0 pending queued transactions 12:26:27,593 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config51, persistent : true 12:26:27,594 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config51 with journal batch size 3 [WARN] [03/13/2024 12:26:27.594] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRegisterDataTreeChangeListener]: org.opendaylight.controller.cluster.common.actor.Monitor@1e5435ae 12:26:27,594 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config51-notifier#-1765180272 created and ready for shard:member-1-shard-inventory-config51 12:26:27,594 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/shard-member-1:snapshot-read#2031171539] [WARN] [03/13/2024 12:26:27.594] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config51-notifier#-1765180272]: org.opendaylight.controller.cluster.common.actor.Monitor@7f181b21 [WARN] [03/13/2024 12:26:27.594] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/shard-member-1:snapshot-read#2031171539]: org.opendaylight.controller.cluster.common.actor.Monitor@5fa4f286 12:26:27,595 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config51: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:27,595 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config51: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:27,595 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config51: onLeadershipChange, isLeader: false, hasLeader : false 12:26:27,595 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config51: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config51 is no longer the leader 12:26:27,595 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config51 , received role change from null to Follower [WARN] [03/13/2024 12:26:27.595] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 12:26:27,596 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config51 (Follower): Received TimeoutNow - switching to Candidate 12:26:27,596 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config51 (Candidate): Election: Candidate has following voting peers: [] 12:26:27,596 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config51: Set currentTerm=1, votedFor=member-1-shard-inventory-config51 12:26:27,596 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config51 (Candidate): Starting new election term 1 12:26:27,596 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config51 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:27,596 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config51 (Follower): Closing 12:26:27,596 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config51: onLeadershipChange, isLeader: false, hasLeader : false 12:26:27,596 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config51: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config51 is no longer the leader 12:26:27,596 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config51 , received role change from Follower to Candidate 12:26:27,598 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config51 (Candidate): Received ElectionTimeout 12:26:27,598 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config51 (Leader): Election: Leader has following peers: [] 12:26:27,598 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config51 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:27,598 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config51: onLeadershipChange, isLeader: true, hasLeader : true 12:26:27,599 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config51: became leader with frontend state for [] 12:26:27,599 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config51 , received role change from Candidate to Leader 12:26:27,694 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#-413649036] [WARN] [03/13/2024 12:26:27.694] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#-413649036]: org.opendaylight.controller.cluster.common.actor.Monitor@6a04e76e 12:26:27,704 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config51: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#-413649036]], isLeader: true, hasLeader: true 12:26:27,705 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config51: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 12:26:27,705 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config51: Created publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config51-DTCL-publisher#-1972741321] with name member-1-shard-inventory-config51-DTCL-publisher 12:26:27,705 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config51: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] to publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config51-DTCL-publisher#-1972741321] 12:26:27,705 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config51: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testRegisterDataTreeChangeListener/$a 12:26:27,705 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/$a#-21512482] 12:26:27,705 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config51: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@2c282bdc 12:26:27,705 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config51-DTCL-publisher#-1972741321] 12:26:27,705 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config51: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] 12:26:27,706 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config51: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking [WARN] [03/13/2024 12:26:27.706] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/$a#-21512482]: org.opendaylight.controller.cluster.common.actor.Monitor@3c3b816a 12:26:27,706 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ForwardingDataTreeChangeListener - Sending OnInitialData to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] [WARN] [03/13/2024 12:26:27.706] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config51-DTCL-publisher#-1972741321]: org.opendaylight.controller.cluster.common.actor.Monitor@30f84c92 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:27,706 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config51: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 12:26:27,706 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config51: Notifying onInitialData to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@2c282bdc 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-263-0 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Readying Tx member-1-ShardTransactionTest-fe-0-txn-263-0 of 1 operations, client version 13 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config51: readying transaction member-1-ShardTransactionTest-fe-0-txn-263-0 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config51: transaction member-1-ShardTransactionTest-fe-0-txn-263-0 ready 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config51: Validating transaction member-1-ShardTransactionTest-fe-0-txn-263-0 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config51: Transaction member-1-ShardTransactionTest-fe-0-txn-263-0 validated 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-263-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: canCommit for member-1-ShardTransactionTest-fe-0-txn-263-0: success 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Committing transaction member-1-ShardTransactionTest-fe-0-txn-263-0 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config51: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-263-0 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config51: Transaction member-1-ShardTransactionTest-fe-0-txn-263-0 candidate ready 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-263-0: canCommit - candidate rootPath: / 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-263-0: canCommit - messages: [] 12:26:27,706 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-263-0: preCommit - successfulFromPrevious: [] 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config51: Transaction member-1-ShardTransactionTest-fe-0-txn-263-0 prepared 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-263-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-263-0 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config51: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-263-0 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 144 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=144}] 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=144}] 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config51: Transaction member-1-ShardTransactionTest-fe-0-txn-263-0 submitted to persistence 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Moving last applied index from -1 to 0 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config51: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1687850} is already disabled 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=144}] 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Moving last applied index from 0 to 1 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Applying state for log index 1 data Simple{size=144} 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config51: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-263-0 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-263-0: commit - successfulFromPrevious: [] 12:26:27,707 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-263-0 changing state from COMMIT_PENDING to COMMITTED 12:26:27,708 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Transaction member-1-ShardTransactionTest-fe-0-txn-263-0 committed as 0, sending response to Actor[akka://test/temp/testRegisterDataTreeChangeListener$h] 12:26:27,708 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config51: publishChanges: rootPath: / 12:26:27,708 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config51: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 12:26:27,708 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: fakeSnapshot purging log to 0 for term 1 12:26:27,708 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] 12:26:27,708 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Persisting ApplyJournalEntries with index=0 12:26:27,708 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config51: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@2c282bdc 12:26:27,708 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config51: Persisting ApplyJournalEntries with index=1 12:26:27,708 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config51: Elapsed time for generation of change events for member-1-shard-inventory-config51-DTCL-publisher: 228.3 μs 12:26:27,708 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#-1842976147] [WARN] [03/13/2024 12:26:27.709] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#-1842976147]: org.opendaylight.controller.cluster.common.actor.Monitor@1ab4126a 12:26:27,709 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config51: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#-1842976147]], isLeader: true, hasLeader: true 12:26:27,709 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config51: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@25954d03 12:26:27,709 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/$b#-1105259156] 12:26:27,709 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config51: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 12:26:27,709 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config51: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] to publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config51-DTCL-publisher#-1972741321] 12:26:27,709 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config51: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testRegisterDataTreeChangeListener/$b 12:26:27,709 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config51: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] 12:26:27,709 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config51: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] [WARN] [03/13/2024 12:26:27.709] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/$b#-1105259156]: org.opendaylight.controller.cluster.common.actor.Monitor@334aa6f6 12:26:27,709 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config51: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 12:26:27,709 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)] 12:26:27,709 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config51: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 12:26:27,709 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config51: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@25954d03 12:26:28,210 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testRegisterDataTreeChangeListener] 12:26:28,221 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config51 12:26:28,221 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config51 (Leader)_slicer-id-746: Closing 12:26:28,221 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config51: Aborting 0 pending queued transactions 12:26:28,221 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#-413649036] 12:26:28,221 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#-1842976147] 12:26:28,222 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener27#-391144673] [WARN] [03/13/2024 12:26:28.223] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener27#-391144673]: org.opendaylight.controller.cluster.common.actor.Monitor@60eb9f6d 12:26:28,224 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config52, persistent : true [WARN] [03/13/2024 12:26:28.224] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28]: org.opendaylight.controller.cluster.common.actor.Monitor@3525958c 12:26:28,224 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/member-1-shard-inventory-config52-notifier#1119821389 created and ready for shard:member-1-shard-inventory-config52 [WARN] [03/13/2024 12:26:28.224] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/member-1-shard-inventory-config52-notifier#1119821389]: org.opendaylight.controller.cluster.common.actor.Monitor@12cfe53c 12:26:28,224 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/shard-member-1:snapshot-read#-1947103493] [WARN] [03/13/2024 12:26:28.225] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/shard-member-1:snapshot-read#-1947103493]: org.opendaylight.controller.cluster.common.actor.Monitor@8860584 12:26:28,225 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config52 with journal batch size 3 12:26:28,225 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1192440829] 12:26:28,225 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52: SnapshotOffer called. 12:26:28,225 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52: Moving last applied index from -1 to -1 12:26:28,225 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52: Set currentTerm=1, votedFor=null 12:26:28,225 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52: Applying recovered snapshot 12:26:28,225 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config52: clearing clients {} 12:26:28,226 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config52: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/member-1-shard-inventory-config52-DTCL-publisher#-1873648268] with name member-1-shard-inventory-config52-DTCL-publisher 12:26:28,226 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/member-1-shard-inventory-config52-DTCL-publisher#-1873648268] 12:26:28,226 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config52: state snapshot applied in 468.5 μs 12:26:28,226 PM [test-akka.actor.default-dispatcher-10] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config52: publishChanges: rootPath: / [WARN] [03/13/2024 12:26:28.226] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/member-1-shard-inventory-config52-DTCL-publisher#-1873648268]: org.opendaylight.controller.cluster.common.actor.Monitor@59b2fa51 12:26:28,226 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Recovery snapshot applied for member-1-shard-inventory-config52 in 620.0 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 12:26:28,226 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config52: Elapsed time for generation of change events for member-1-shard-inventory-config52-DTCL-publisher: 97.35 μs 12:26:28,226 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:28,226 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config52: Recovery completed in 985.2 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:28,226 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config52: onLeadershipChange, isLeader: false, hasLeader : false 12:26:28,226 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config52 is no longer the leader 12:26:28,226 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config52 , received role change from null to Follower 12:26:28,226 PM [test-akka.actor.default-dispatcher-13] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [03/13/2024 12:26:28.226] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28]] 12:26:28,334 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config52: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener27#-391144673]], isLeader: false, hasLeader: false 12:26:28,334 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config52: Shard does not have a leader - delaying registration 12:26:28,334 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config52: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/$a 12:26:28,335 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/$a#-1902979717] [WARN] [03/13/2024 12:26:28.335] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/$a#-1902979717]: org.opendaylight.controller.cluster.common.actor.Monitor@67b513d1 12:26:28,335 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig null 12:26:28,336 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52: Re-initializing to Follower with previous leaderId null 12:26:28,336 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config52 (Follower): Closing 12:26:28,336 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config52: onLeadershipChange, isLeader: false, hasLeader : false 12:26:28,336 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config52 is no longer the leader 12:26:28,336 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52 (Follower): Received TimeoutNow - switching to Candidate 12:26:28,336 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52 (Candidate): Election: Candidate has following voting peers: [] 12:26:28,336 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52: Set currentTerm=2, votedFor=member-1-shard-inventory-config52 12:26:28,336 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config52 (Candidate): Starting new election term 2 12:26:28,336 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config52 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 12:26:28,336 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config52 (Follower): Closing 12:26:28,336 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config52: onLeadershipChange, isLeader: false, hasLeader : false 12:26:28,336 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config52: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config52 is no longer the leader 12:26:28,336 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config52 , received role change from Follower to Candidate 12:26:28,336 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config52 (Candidate): Received ElectionTimeout 12:26:28,336 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config52 (Leader): Election: Leader has following peers: [] 12:26:28,336 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config52 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 12:26:28,336 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config52: onLeadershipChange, isLeader: true, hasLeader : true 12:26:28,336 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config52: became leader with frontend state for [] 12:26:28,337 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config52 , received role change from Candidate to Leader 12:26:28,836 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener27#-391144673] 12:26:28,847 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28] 12:26:28,847 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config52 12:26:28,847 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config52 (Leader)_slicer-id-748: Closing 12:26:28,847 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config52: Aborting 0 pending queued transactions 12:26:28,849 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config53, persistent : true 12:26:28,850 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config53 with journal batch size 3 [WARN] [03/13/2024 12:26:28.850] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@4095f0ed 12:26:28,850 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config53-notifier#-528654929 created and ready for shard:member-1-shard-inventory-config53 12:26:28,850 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/shard-member-1:snapshot-read#-1533362513] [WARN] [03/13/2024 12:26:28.850] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config53-notifier#-528654929]: org.opendaylight.controller.cluster.common.actor.Monitor@3481ed5e [WARN] [03/13/2024 12:26:28.850] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/shard-member-1:snapshot-read#-1533362513]: org.opendaylight.controller.cluster.common.actor.Monitor@27413ddd 12:26:28,851 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config53: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:28,851 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config53: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:28,851 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config53: onLeadershipChange, isLeader: false, hasLeader : false 12:26:28,851 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config53: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config53 is no longer the leader 12:26:28,852 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config53 , received role change from null to Follower 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config53 (Follower): Received TimeoutNow - switching to Candidate 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config53 (Candidate): Election: Candidate has following voting peers: [] 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config53: Set currentTerm=1, votedFor=member-1-shard-inventory-config53 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config53 (Candidate): Starting new election term 1 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config53 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config53 (Follower): Closing 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config53: onLeadershipChange, isLeader: false, hasLeader : false 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config53: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config53 is no longer the leader 12:26:28,852 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config53 , received role change from Follower to Candidate [WARN] [03/13/2024 12:26:28.852] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit]] 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config53 (Candidate): Received ElectionTimeout 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config53 (Leader): Election: Leader has following peers: [] 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config53 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config53: onLeadershipChange, isLeader: true, hasLeader : true 12:26:28,852 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config53: became leader with frontend state for [] 12:26:28,852 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config53 , received role change from Candidate to Leader 12:26:28,960 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-264-0 12:26:28,960 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:28,960 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-264-0 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-264-0 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config53: Validating transaction member-1-ShardTransactionTest-fe-0-txn-264-0 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config53: Transaction member-1-ShardTransactionTest-fe-0-txn-264-0 validated 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-264-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: canCommit for member-1-ShardTransactionTest-fe-0-txn-264-0: success 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Committing transaction member-1-ShardTransactionTest-fe-0-txn-264-0 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config53: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-264-0 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config53: Transaction member-1-ShardTransactionTest-fe-0-txn-264-0 candidate ready 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-264-0: canCommit - candidate rootPath: / 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-264-0: canCommit - messages: [] 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-264-0: preCommit - successfulFromPrevious: [] 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config53: Transaction member-1-ShardTransactionTest-fe-0-txn-264-0 prepared 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-264-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-264-0 12:26:28,961 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config53: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-264-0 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 176 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=176}] 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=176}] 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config53: Transaction member-1-ShardTransactionTest-fe-0-txn-264-0 submitted to persistence 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Moving last applied index from -1 to 0 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config53: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1540357} is already disabled 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Persisting ApplyJournalEntries with index=0 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=176}] 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Moving last applied index from 0 to 1 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Applying state for log index 1 data Simple{size=176} 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config53: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-264-0 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-264-0: commit - successfulFromPrevious: [] 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-264-0 changing state from COMMIT_PENDING to COMMITTED 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Transaction member-1-ShardTransactionTest-fe-0-txn-264-0 committed as 0, sending response to Actor[akka://test/system/testProbe-766#-917246422] 12:26:28,962 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit] 12:26:28,962 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config53: Created publisher actor Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config53-DTCL-publisher#-2012643672] with name member-1-shard-inventory-config53-DTCL-publisher 12:26:28,963 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config53-DTCL-publisher#-2012643672] 12:26:28,963 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config53: publishChanges: rootPath: / 12:26:28,963 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: fakeSnapshot purging log to 0 for term 1 [WARN] [03/13/2024 12:26:28.963] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config53-DTCL-publisher#-2012643672]: org.opendaylight.controller.cluster.common.actor.Monitor@500c61d5 12:26:28,963 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config53: Persisting ApplyJournalEntries with index=1 12:26:28,963 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config53: Elapsed time for generation of change events for member-1-shard-inventory-config53-DTCL-publisher: 65.29 μs 12:26:28,973 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config53 12:26:28,973 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config53 (Leader)_slicer-id-750: Closing 12:26:28,973 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config53: Aborting 0 pending queued transactions 12:26:28,975 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config54, persistent : true 12:26:28,976 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config54 with journal batch size 3 [WARN] [03/13/2024 12:26:28.976] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry]: org.opendaylight.controller.cluster.common.actor.Monitor@7750a23c 12:26:28,976 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config54-notifier#1974033563 created and ready for shard:member-1-shard-inventory-config54 12:26:28,976 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/shard-member-1:snapshot-read#-1286183692] [WARN] [03/13/2024 12:26:28.976] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config54-notifier#1974033563]: org.opendaylight.controller.cluster.common.actor.Monitor@358c880a [WARN] [03/13/2024 12:26:28.976] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/shard-member-1:snapshot-read#-1286183692]: org.opendaylight.controller.cluster.common.actor.Monitor@6be891d2 12:26:28,978 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config54: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:28,978 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config54: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:28,978 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config54: onLeadershipChange, isLeader: false, hasLeader : false 12:26:28,978 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config54: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config54 is no longer the leader 12:26:28,978 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config54 , received role change from null to Follower 12:26:28,978 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config54 (Follower): Received TimeoutNow - switching to Candidate 12:26:28,978 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config54 (Candidate): Election: Candidate has following voting peers: [] 12:26:28,978 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config54: Set currentTerm=1, votedFor=member-1-shard-inventory-config54 12:26:28,979 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config54 (Candidate): Starting new election term 1 12:26:28,979 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config54 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:28,979 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config54 (Follower): Closing 12:26:28,979 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config54: onLeadershipChange, isLeader: false, hasLeader : false 12:26:28,979 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config54: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config54 is no longer the leader 12:26:28,979 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config54 , received role change from Follower to Candidate 12:26:28,980 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config54 (Candidate): Received ElectionTimeout 12:26:28,980 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config54 (Leader): Election: Leader has following peers: [] 12:26:28,980 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config54 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:28,980 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config54: onLeadershipChange, isLeader: true, hasLeader : true 12:26:28,980 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config54: became leader with frontend state for [] 12:26:28,980 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config54 , received role change from Candidate to Leader [WARN] [03/13/2024 12:26:28.980] [test-akka.actor.default-dispatcher-10] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry]] 12:26:29,39 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:29,39 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:29,39 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-265-0 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Readying Tx member-1-ShardTransactionTest-fe-0-txn-265-0 of 1 operations, client version 13 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: readying transaction member-1-ShardTransactionTest-fe-0-txn-265-0 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: transaction member-1-ShardTransactionTest-fe-0-txn-265-0 ready 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-265-0 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Validating transaction member-1-ShardTransactionTest-fe-0-txn-265-0 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Transaction member-1-ShardTransactionTest-fe-0-txn-265-0 validated 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-265-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: canCommit for member-1-ShardTransactionTest-fe-0-txn-265-0: success 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-266-0 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Readying Tx member-1-ShardTransactionTest-fe-0-txn-266-0 of 1 operations, client version 13 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: readying transaction member-1-ShardTransactionTest-fe-0-txn-266-0 12:26:29,40 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: transaction member-1-ShardTransactionTest-fe-0-txn-266-0 ready 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Moving last applied index from -1 to 0 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config54: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1327862} is already disabled 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Persisting ApplyJournalEntries with index=0 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-267-0 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-267-0 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Tx member-1-ShardTransactionTest-fe-0-txn-267-0 is scheduled for canCommit step 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Committing transaction member-1-ShardTransactionTest-fe-0-txn-265-0 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-265-0 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Transaction member-1-ShardTransactionTest-fe-0-txn-265-0 candidate ready 12:26:29,41 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-265-0: canCommit - candidate rootPath: / 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-265-0: canCommit - messages: [] 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-265-0: preCommit - successfulFromPrevious: [] 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Transaction member-1-ShardTransactionTest-fe-0-txn-265-0 prepared 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-265-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-265-0 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-265-0 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 144 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=144}] 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=144}] 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Transaction member-1-ShardTransactionTest-fe-0-txn-265-0 submitted to persistence 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=144}] 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Moving last applied index from 0 to 1 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Applying state for log index 1 data Simple{size=144} 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-265-0 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-265-0: commit - successfulFromPrevious: [] 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-265-0 changing state from COMMIT_PENDING to COMMITTED 12:26:29,42 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Transaction member-1-ShardTransactionTest-fe-0-txn-265-0 committed as 0, sending response to Actor[akka://test/system/testProbe-768#-1329813867] 12:26:29,43 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config54: Created publisher actor Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config54-DTCL-publisher#386188146] with name member-1-shard-inventory-config54-DTCL-publisher 12:26:29,43 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config54-DTCL-publisher#386188146] 12:26:29,43 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: fakeSnapshot purging log to 0 for term 1 12:26:29,43 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Persisting ApplyJournalEntries with index=1 12:26:29,43 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config54: publishChanges: rootPath: / [WARN] [03/13/2024 12:26:29.043] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config54-DTCL-publisher#386188146]: org.opendaylight.controller.cluster.common.actor.Monitor@1fea8fc6 12:26:29,43 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config54: Elapsed time for generation of change events for member-1-shard-inventory-config54-DTCL-publisher: 61.22 μs 12:26:29,661 PM [test-akka.actor.default-dispatcher-10] [WARN] ShardDataTree - member-1-shard-inventory-config54: Current transaction member-1-ShardTransactionTest-fe-0-txn-266-0 has timed out after 620 ms in state READY 12:26:29,661 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Validating transaction member-1-ShardTransactionTest-fe-0-txn-267-0 12:26:29,661 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Transaction member-1-ShardTransactionTest-fe-0-txn-267-0 validated 12:26:29,661 PM [test-akka.actor.default-dispatcher-10] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-267-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:29,661 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config54: canCommit for member-1-ShardTransactionTest-fe-0-txn-267-0: success 12:26:29,661 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config54: Committing transaction member-1-ShardTransactionTest-fe-0-txn-267-0 12:26:29,661 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-267-0 12:26:29,662 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Transaction member-1-ShardTransactionTest-fe-0-txn-267-0 candidate ready 12:26:29,662 PM [test-akka.actor.default-dispatcher-10] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-267-0: canCommit - candidate rootPath: / 12:26:29,662 PM [test-akka.actor.default-dispatcher-10] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-267-0: canCommit - messages: [] 12:26:29,662 PM [test-akka.actor.default-dispatcher-10] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-267-0: preCommit - successfulFromPrevious: [] 12:26:29,662 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Transaction member-1-ShardTransactionTest-fe-0-txn-267-0 prepared 12:26:29,662 PM [test-akka.actor.default-dispatcher-10] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-267-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 12:26:29,662 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config54: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-267-0 12:26:29,662 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-267-0 12:26:29,662 PM [test-akka.actor.default-dispatcher-10] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 145 12:26:29,662 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config54: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=145}] 12:26:29,662 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config54: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=145}] 12:26:29,662 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Transaction member-1-ShardTransactionTest-fe-0-txn-267-0 submitted to persistence 12:26:29,663 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config54: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=145}] 12:26:29,663 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config54: Moving last applied index from 1 to 2 12:26:29,663 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config54: Applying state for log index 2 data Simple{size=145} 12:26:29,663 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardDataTree - member-1-shard-inventory-config54: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-267-0 12:26:29,663 PM [test-akka.actor.default-dispatcher-10] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-267-0: commit - successfulFromPrevious: [] 12:26:29,663 PM [test-akka.actor.default-dispatcher-10] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-267-0 changing state from COMMIT_PENDING to COMMITTED 12:26:29,663 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config54: Transaction member-1-ShardTransactionTest-fe-0-txn-267-0 committed as 0, sending response to Actor[akka://test/system/testProbe-768#-1329813867] 12:26:29,663 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config54: publishChanges: rootPath: / 12:26:29,664 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config54: Elapsed time for generation of change events for member-1-shard-inventory-config54-DTCL-publisher: 59.86 μs 12:26:29,664 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry] 12:26:29,664 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config54: fakeSnapshot purging log to 1 for term 1 12:26:29,664 PM [test-akka.actor.default-dispatcher-10] [DEBUG] Shard - member-1-shard-inventory-config54: Persisting ApplyJournalEntries with index=2 12:26:29,674 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config54 12:26:29,674 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config54 (Leader)_slicer-id-752: Closing 12:26:29,675 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config54: Aborting 0 pending queued transactions 12:26:29,677 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config55, persistent : true [WARN] [03/13/2024 12:26:29.677] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPreCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@554845ed 12:26:29,678 PM [test-akka.actor.default-dispatcher-10] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.237:25520/user/testPreCommitPhaseFailure/member-1-shard-inventory-config55-notifier#2141207536 created and ready for shard:member-1-shard-inventory-config55 [WARN] [03/13/2024 12:26:29.678] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPreCommitPhaseFailure/member-1-shard-inventory-config55-notifier#2141207536]: org.opendaylight.controller.cluster.common.actor.Monitor@76ed750e 12:26:29,678 PM [test-akka.actor.default-dispatcher-10] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPreCommitPhaseFailure/shard-member-1:snapshot-read#1750091997] [WARN] [03/13/2024 12:26:29.678] [test-akka.actor.default-dispatcher-10] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPreCommitPhaseFailure/shard-member-1:snapshot-read#1750091997]: org.opendaylight.controller.cluster.common.actor.Monitor@72cabe34 12:26:29,678 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config55 with journal batch size 3 12:26:29,679 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config55: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 12:26:29,679 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config55: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 12:26:29,679 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config55: onLeadershipChange, isLeader: false, hasLeader : false 12:26:29,679 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config55: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config55 is no longer the leader [WARN] [03/13/2024 12:26:29.679] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testPreCommitPhaseFailure]] 12:26:29,679 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config55 , received role change from null to Follower 12:26:29,679 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config55 (Follower): Received TimeoutNow - switching to Candidate 12:26:29,679 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config55 (Candidate): Election: Candidate has following voting peers: [] 12:26:29,679 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config55: Set currentTerm=1, votedFor=member-1-shard-inventory-config55 12:26:29,679 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config55 (Candidate): Starting new election term 1 12:26:29,679 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config55 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 12:26:29,679 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config55 (Follower): Closing 12:26:29,679 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config55: onLeadershipChange, isLeader: false, hasLeader : false 12:26:29,679 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config55: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config55 is no longer the leader 12:26:29,679 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config55 , received role change from Follower to Candidate 12:26:29,680 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config55 (Candidate): Received ElectionTimeout 12:26:29,680 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config55 (Leader): Election: Leader has following peers: [] 12:26:29,680 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config55 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 12:26:29,680 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config55: onLeadershipChange, isLeader: true, hasLeader : true 12:26:29,680 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config55: became leader with frontend state for [] 12:26:29,680 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config55 , received role change from Candidate to Leader 12:26:29,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 12:26:29,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:29,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:29,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-268-0 12:26:29,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: Readying Tx member-1-ShardTransactionTest-fe-0-txn-268-0 of 1 operations, client version 13 12:26:29,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config55: readying transaction member-1-ShardTransactionTest-fe-0-txn-268-0 12:26:29,741 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config55: transaction member-1-ShardTransactionTest-fe-0-txn-268-0 ready 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-269-0 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: Readying Tx member-1-ShardTransactionTest-fe-0-txn-269-0 of 1 operations, client version 13 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config55: readying transaction member-1-ShardTransactionTest-fe-0-txn-269-0 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config55: transaction member-1-ShardTransactionTest-fe-0-txn-269-0 ready 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: Moving last applied index from -1 to 0 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config55: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=883851} is already disabled 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-268-0 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config55: Validating transaction member-1-ShardTransactionTest-fe-0-txn-268-0 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config55: Transaction member-1-ShardTransactionTest-fe-0-txn-268-0 validated 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-268-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: canCommit for member-1-ShardTransactionTest-fe-0-txn-268-0: success 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: Persisting ApplyJournalEntries with index=0 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-269-0 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config55: Tx member-1-ShardTransactionTest-fe-0-txn-269-0 is scheduled for canCommit step 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: Committing transaction member-1-ShardTransactionTest-fe-0-txn-268-0 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config55: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-268-0 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [ERROR] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-268-0 failed to prepare java.lang.RuntimeException: mock preCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1030) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:113) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:117) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:302) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:365) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:715) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:416) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-268-0: abort - successfulFromPrevious: [] 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-268-0 changing state from PRE_COMMIT_PENDING to FAILED 12:26:29,742 PM [test-akka.actor.default-dispatcher-12] [ERROR] Shard - member-1-shard-inventory-config55 An exception occurred while preCommitting transaction member-1-ShardTransactionTest-fe-0-txn-268-0 java.lang.RuntimeException: mock preCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1030) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:113) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:117) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:302) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:365) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:715) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:416) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 12:26:29,743 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config55: Validating transaction member-1-ShardTransactionTest-fe-0-txn-269-0 12:26:29,743 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config55: Transaction member-1-ShardTransactionTest-fe-0-txn-269-0 validated 12:26:29,743 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-269-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 12:26:29,743 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config55: canCommit for member-1-ShardTransactionTest-fe-0-txn-269-0: success 12:26:29,745 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPreCommitPhaseFailure] 12:26:29,755 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config55 12:26:29,755 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config55 (Leader)_slicer-id-754: Closing 12:26:29,755 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config55: Aborting 1 pending queued transactions [WARN] [03/13/2024 12:26:29.756] [test-akka.actor.default-dispatcher-13] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testPreCommitPhaseFailure]: Failure(java.lang.RuntimeException: Transaction aborted due to shutdown.) [INFO] [03/13/2024 12:26:29.757] [test-akka.remote.default-remote-dispatcher-7] [akka://test@10.30.170.237:25520/system/remoting-terminator] Shutting down remote daemon. [INFO] [03/13/2024 12:26:29.757] [test-akka.remote.default-remote-dispatcher-7] [akka://test@10.30.170.237:25520/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. 12:26:29,757 PM [test-akka.actor.default-dispatcher-13] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 12:26:29,757 PM [test-akka.actor.default-dispatcher-13] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [03/13/2024 12:26:29.758] [test-akka.remote.default-remote-dispatcher-7] [akka://test@10.30.170.237:25520/system/remoting-terminator] Remoting shut down. 12:26:29,758 PM [test-akka.actor.default-dispatcher-12] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. [DEBUG] [03/13/2024 12:26:29.758] [test-akka.actor.internal-dispatcher-3] [EventStream] shutting down: StandardOutLogger