[DEBUG] [03/26/2024 11:59:46.452] [main] [EventStream(akka://test)] logger log1-TestEventListener started 11:59:46,452 AM [test-akka.actor.default-dispatcher-6] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [03/26/2024 11:59:46.453] [main] [EventStream(akka://test)] logger log2-Slf4jLogger started [DEBUG] [03/26/2024 11:59:46.453] [main] [EventStream(akka://test)] Default Loggers started [INFO] [03/26/2024 11:59:46.466] [main] [ArteryTransport(akka://test)] Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.171.73:25520] with UID [-7304623787796814762] 11:59:46,466 AM [test-akka.actor.default-dispatcher-7] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.171.73:25520] with UID [-7304623787796814762] [INFO] [03/26/2024 11:59:46.466] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.73:25520] - Starting up, Akka version [2.6.21] ... 11:59:46,467 AM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.171.73:25520] - Starting up, Akka version [2.6.21] ... [INFO] [03/26/2024 11:59:46.468] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.73:25520] - Registered cluster JMX MBean [akka:type=Cluster] [INFO] [03/26/2024 11:59:46.468] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.73:25520] - Started up successfully 11:59:46,470 AM [test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://test@10.30.171.73:25520] - Registered cluster JMX MBean [akka:type=Cluster] 11:59:46,470 AM [test-akka.actor.default-dispatcher-12] [INFO] Cluster - Cluster Node [akka://test@10.30.171.73:25520] - Started up successfully 11:59:46,479 AM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.171.73:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing 11:59:46,479 AM [test-akka.actor.default-dispatcher-6] [INFO] Cluster - Cluster Node [akka://test@10.30.171.73:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining [INFO] [03/26/2024 11:59:46.478] [test-akka.actor.internal-dispatcher-2] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.73:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing [INFO] [03/26/2024 11:59:46.478] [test-akka.actor.internal-dispatcher-2] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.73:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining 11:59:46,485 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Shard created : member-1-shard-inventory-config0, persistent : true [WARN] [03/26/2024 11:59:46.486] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testApplySnapshot]: org.opendaylight.controller.cluster.common.actor.Monitor@44e03bbe [INFO] [akkaDeadLetter][03/26/2024 11:59:46.486] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,486 AM [test-akka.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,488 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testApplySnapshot/member-1-shard-inventory-config0-notifier#1062166299 created and ready for shard:member-1-shard-inventory-config0 [WARN] [03/26/2024 11:59:46.488] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-notifier#1062166299]: org.opendaylight.controller.cluster.common.actor.Monitor@44ed5c28 [INFO] [akkaDeadLetter][03/26/2024 11:59:46.489] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-notifier#1062166299] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,489 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#994789923] [WARN] [03/26/2024 11:59:46.491] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#994789923]: org.opendaylight.controller.cluster.common.actor.Monitor@75ddf71b 11:59:46,491 AM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-notifier#1062166299] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,500 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Starting recovery for member-1-shard-inventory-config0 with journal batch size 3 11:59:46,501 AM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#994789923] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/26/2024 11:59:46.501] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#994789923] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,501 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config0: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:46,501 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config0: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:46,502 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config0: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,502 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config0: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config0 is no longer the leader 11:59:46,502 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config0 , received role change from null to Follower 11:59:46,502 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config0 (Follower): Received TimeoutNow - switching to Candidate 11:59:46,502 AM [test-akka.actor.default-dispatcher-13] [INFO] LocalActorRef - Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] to Actor[akka://test/user] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,502 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config0 (Candidate): Election: Candidate has following voting peers: [] 11:59:46,502 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config0: Set currentTerm=1, votedFor=member-1-shard-inventory-config0 11:59:46,502 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config0 (Candidate): Starting new election term 1 11:59:46,502 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config0 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:46,502 AM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageAssembler - member-1-shard-inventory-config0 (Follower): Closing [WARN] [03/26/2024 11:59:46.502] [test-akka.actor.default-dispatcher-11] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testApplySnapshot]] 11:59:46,502 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config0: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,502 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config0: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config0 is no longer the leader [INFO] [akkaDeadLetter][03/26/2024 11:59:46.502] [test-akka.actor.default-dispatcher-13] [akka://test/user] Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] to Actor[akka://test/user] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,502 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config0 , received role change from Follower to Candidate 11:59:46,502 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config0 (Candidate): Received ElectionTimeout 11:59:46,507 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config0 (Leader): Election: Leader has following peers: [] 11:59:46,507 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config0 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:46,507 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config0: onLeadershipChange, isLeader: true, hasLeader : true 11:59:46,507 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config0: became leader with frontend state for [] 11:59:46,507 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config0 , received role change from Candidate to Leader 11:59:46,554 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config0: Applying snapshot on follower: Snapshot [lastIndex=1, lastTerm=2, lastAppliedIndex=3, lastAppliedTerm=4, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@8a09d34, electionTerm=-1, electionVotedFor=null, ServerConfigPayload=null] 11:59:46,554 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - lastSequenceNumber prior to persisting applied snapshot: 1 11:59:46,554 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config0: SaveSnapshotSuccess received for snapshot, sequenceNr: 1 11:59:46,554 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config0: Snapshot success - sequence number: 1 11:59:46,554 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config0: Moving last applied index from -1 to 3 11:59:46,554 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config0: Set currentTerm=-1, votedFor=null 11:59:46,554 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config0: Applying snapshot 11:59:46,554 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config0: clearing clients {} 11:59:46,555 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config0: Created publisher actor Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-DTCL-publisher#1624184631] with name member-1-shard-inventory-config0-DTCL-publisher 11:59:46,555 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-DTCL-publisher#1624184631] 11:59:46,555 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config0: state snapshot applied in 700.4 μs 11:59:46,555 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config0: Done applying snapshot 11:59:46,555 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config0: publishChanges: rootPath: / 11:59:46,555 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config0: SnapshotComplete received 11:59:46,555 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config0: Elapsed time for generation of change events for member-1-shard-inventory-config0-DTCL-publisher: 89.20 μs 11:59:46,555 AM [test-akka.actor.default-dispatcher-15] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-DTCL-publisher#1624184631] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [03/26/2024 11:59:46.555] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-DTCL-publisher#1624184631]: org.opendaylight.controller.cluster.common.actor.Monitor@781ebc05 [INFO] [akkaDeadLetter][03/26/2024 11:59:46.555] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config0-DTCL-publisher#1624184631] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,556 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config0: handled a snapshot response 11:59:46,556 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config0: handled a journal response 11:59:46,628 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testApplySnapshot] 11:59:46,640 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Stopping Shard member-1-shard-inventory-config0 11:59:46,640 AM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageSlicer - member-1-shard-inventory-config0 (Leader)_slicer-id-174: Closing 11:59:46,640 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config0: Aborting 0 pending queued transactions 11:59:46,644 AM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config1, persistent : true [WARN] [03/26/2024 11:59:46.644] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPersistence1]: org.opendaylight.controller.cluster.common.actor.Monitor@727c1214 11:59:46,644 AM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence1] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/26/2024 11:59:46.644] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence1] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,646 AM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config1 with journal batch size 3 11:59:46,647 AM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config1, persistent : false 11:59:46,647 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#1113691949] [WARN] [03/26/2024 11:59:46.647] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPersistence2]: org.opendaylight.controller.cluster.common.actor.Monitor@6548e272 [WARN] [03/26/2024 11:59:46.647] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#1113691949]: org.opendaylight.controller.cluster.common.actor.Monitor@71927c96 11:59:46,647 AM [test-akka.actor.default-dispatcher-15] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence2] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/26/2024 11:59:46.647] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence2] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,647 AM [test-akka.actor.default-dispatcher-15] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#1113691949] to Actor[akka://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/26/2024 11:59:46.647] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#1113691949] to Actor[akka://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,648 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testPersistence1/member-1-shard-inventory-config1-notifier#-211017190 created and ready for shard:member-1-shard-inventory-config1 [WARN] [03/26/2024 11:59:46.648] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config1-notifier#-211017190]: org.opendaylight.controller.cluster.common.actor.Monitor@27cd44ad 11:59:46,648 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testPersistence2/member-1-shard-inventory-config1-notifier#1852311947 created and ready for shard:member-1-shard-inventory-config1 [INFO] [akkaDeadLetter][03/26/2024 11:59:46.648] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config1-notifier#-211017190] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [03/26/2024 11:59:46.648] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence2/member-1-shard-inventory-config1-notifier#1852311947]: org.opendaylight.controller.cluster.common.actor.Monitor@11282e14 11:59:46,648 AM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config1-notifier#-211017190] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,648 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPersistence2/shard-member-1:snapshot-read#1297321481] [INFO] [akkaDeadLetter][03/26/2024 11:59:46.648] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence2/member-1-shard-inventory-config1-notifier#1852311947] to Actor[akka://test/user/termination-monitor] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 11:59:46,648 AM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence2/member-1-shard-inventory-config1-notifier#1852311947] to Actor[akka://test/user/termination-monitor] was not delivered. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [03/26/2024 11:59:46.649] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence2/shard-member-1:snapshot-read#1297321481]: org.opendaylight.controller.cluster.common.actor.Monitor@3fd359f5 11:59:46,650 AM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config1 with journal batch size 3 11:59:46,650 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPersistence1] 11:59:46,650 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config1: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:46,650 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config1: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:46,651 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config1: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,651 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config1: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config1 is no longer the leader 11:59:46,651 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config1 (Follower): Received TimeoutNow - switching to Candidate 11:59:46,651 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config1 (Candidate): Election: Candidate has following voting peers: [] 11:59:46,651 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config1: Set currentTerm=1, votedFor=member-1-shard-inventory-config1 11:59:46,651 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config1 (Candidate): Starting new election term 1 11:59:46,651 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config1 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:46,651 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config1 (Follower): Closing 11:59:46,651 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config1: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,651 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config1: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config1 is no longer the leader 11:59:46,651 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config1 , received role change from null to Follower 11:59:46,651 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config1 , received role change from Follower to Candidate [WARN] [03/26/2024 11:59:46.651] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testPersistence1]] 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config1: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.UpdateElectionTerm from Actor[akka://test/deadLetters] 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config1: Set currentTerm=1, votedFor=member-1-shard-inventory-config1 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config1: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config1: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config1: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config1: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config1 is no longer the leader 11:59:46,653 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config1 , received role change from null to Follower 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config1 (Follower): Received TimeoutNow - switching to Candidate 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config1 (Candidate): Election: Candidate has following voting peers: [] 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config1: Set currentTerm=2, votedFor=member-1-shard-inventory-config1 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config1 (Candidate): Starting new election term 2 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config1 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config1 (Follower): Closing 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config1: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,653 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config1: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config1 is no longer the leader 11:59:46,653 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config1 , received role change from Follower to Candidate [WARN] [03/26/2024 11:59:46.654] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testPersistence2]] 11:59:46,660 AM [main] [DEBUG] Shard - member-1-shard-inventory-config1 (Candidate): Received ElectionTimeout 11:59:46,660 AM [main] [DEBUG] Shard - member-1-shard-inventory-config1 (Leader): Election: Leader has following peers: [] 11:59:46,660 AM [main] [INFO] Shard - member-1-shard-inventory-config1 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:46,660 AM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config1: onLeadershipChange, isLeader: true, hasLeader : true 11:59:46,660 AM [main] [DEBUG] Shard - member-1-shard-inventory-config1: became leader with frontend state for [] 11:59:46,660 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config1 , received role change from Candidate to Leader 11:59:46,660 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config1 11:59:46,660 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config1 (Leader)_slicer-id-177: Closing 11:59:46,661 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config1: Aborting 0 pending queued transactions 11:59:46,661 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPersistence2] 11:59:46,661 AM [main] [DEBUG] Shard - member-1-shard-inventory-config1 (Candidate): Received ElectionTimeout 11:59:46,661 AM [main] [DEBUG] Shard - member-1-shard-inventory-config1 (Leader): Election: Leader has following peers: [] 11:59:46,661 AM [main] [INFO] Shard - member-1-shard-inventory-config1 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 11:59:46,661 AM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config1: onLeadershipChange, isLeader: true, hasLeader : true 11:59:46,661 AM [main] [DEBUG] Shard - member-1-shard-inventory-config1: became leader with frontend state for [] 11:59:46,661 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config1 , received role change from Candidate to Leader 11:59:46,661 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config1 11:59:46,661 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config1 (Leader)_slicer-id-178: Closing 11:59:46,661 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config1: Aborting 0 pending queued transactions 11:59:46,664 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$5 - Shard created : member-1-shard-inventory-config2, persistent : true [WARN] [03/26/2024 11:59:46.664] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortWithCommitPending]: org.opendaylight.controller.cluster.common.actor.Monitor@541dce6 11:59:46,665 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testAbortWithCommitPending/member-1-shard-inventory-config2-notifier#-845260834 created and ready for shard:member-1-shard-inventory-config2 11:59:46,665 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortWithCommitPending/shard-member-1:snapshot-read#-90733141] [WARN] [03/26/2024 11:59:46.664] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config2-notifier#-845260834]: org.opendaylight.controller.cluster.common.actor.Monitor@33ebbf6d [WARN] [03/26/2024 11:59:46.665] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/shard-member-1:snapshot-read#-90733141]: org.opendaylight.controller.cluster.common.actor.Monitor@6dfa62f7 11:59:46,665 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$5 - Starting recovery for member-1-shard-inventory-config2 with journal batch size 3 11:59:46,666 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:46,666 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$5 - member-1-shard-inventory-config2: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:46,666 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config2: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,666 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config2 is no longer the leader 11:59:46,667 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config2 , received role change from null to Follower 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2 (Follower): Received TimeoutNow - switching to Candidate 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2 (Candidate): Election: Candidate has following voting peers: [] 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Set currentTerm=1, votedFor=member-1-shard-inventory-config2 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$5 - member-1-shard-inventory-config2 (Candidate): Starting new election term 1 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$5 - member-1-shard-inventory-config2 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config2 (Follower): Closing 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config2: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config2 is no longer the leader 11:59:46,667 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config2 , received role change from Follower to Candidate 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2 (Candidate): Received ElectionTimeout 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2 (Leader): Election: Leader has following peers: [] [WARN] [03/26/2024 11:59:46.667] [test-akka.actor.default-dispatcher-16] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testAbortWithCommitPending]] 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$5 - member-1-shard-inventory-config2 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config2: onLeadershipChange, isLeader: true, hasLeader : true 11:59:46,667 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: became leader with frontend state for [] 11:59:46,668 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config2 , received role change from Candidate to Leader 11:59:46,729 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:46,731 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:46,731 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:46,732 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-3-0 11:59:46,733 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Readying Tx member-1-ShardTransactionTest-fe-0-txn-3-0 of 1 operations, client version 13 11:59:46,733 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: readying transaction member-1-ShardTransactionTest-fe-0-txn-3-0 11:59:46,733 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: transaction member-1-ShardTransactionTest-fe-0-txn-3-0 ready 11:59:46,733 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-3-0 11:59:46,734 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Validating transaction member-1-ShardTransactionTest-fe-0-txn-3-0 11:59:46,734 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Transaction member-1-ShardTransactionTest-fe-0-txn-3-0 validated 11:59:46,734 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-3-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:46,734 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: canCommit for member-1-ShardTransactionTest-fe-0-txn-3-0: success 11:59:46,734 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:46,734 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Moving last applied index from -1 to 0 11:59:46,734 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:46,734 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:46,734 AM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config2: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:46,735 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=4861764} is already disabled 11:59:46,735 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Committing transaction member-1-ShardTransactionTest-fe-0-txn-3-0 11:59:46,735 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-3-0 11:59:46,735 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Transaction member-1-ShardTransactionTest-fe-0-txn-3-0 candidate ready 11:59:46,735 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-3-0: canCommit - candidate rootPath: / 11:59:46,736 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-3-0: canCommit - messages: [] 11:59:46,736 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-3-0: preCommit - successfulFromPrevious: [] 11:59:46,736 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Transaction member-1-ShardTransactionTest-fe-0-txn-3-0 prepared 11:59:46,736 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-3-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:46,736 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-3-0 11:59:46,736 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-3-0 11:59:46,737 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:46,737 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-3-0 11:59:46,738 AM [test-akka.actor.default-dispatcher-16] [WARN] ShardDataTree - member-1-shard-inventory-config2: transaction member-1-ShardTransactionTest-fe-0-txn-3-0 is committing, skipping abort 11:59:46,738 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:46,738 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:46,738 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Transaction member-1-ShardTransactionTest-fe-0-txn-3-0 submitted to persistence 11:59:46,738 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Persisting ApplyJournalEntries with index=0 11:59:46,739 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:46,739 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Moving last applied index from 0 to 1 11:59:46,739 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Applying state for log index 1 data Simple{size=143} 11:59:46,739 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config2: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-3-0 11:59:46,739 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-3-0: commit - successfulFromPrevious: [] 11:59:46,739 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-3-0 changing state from COMMIT_PENDING to COMMITTED 11:59:46,739 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Transaction member-1-ShardTransactionTest-fe-0-txn-3-0 committed as 0, sending response to Actor[akka://test/system/testProbe-115#1025858668] 11:59:46,739 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config2: Created publisher actor Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config2-DTCL-publisher#-716089510] with name member-1-shard-inventory-config2-DTCL-publisher 11:59:46,739 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortWithCommitPending] 11:59:46,739 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config2-DTCL-publisher#-716089510] 11:59:46,740 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: fakeSnapshot purging log to 0 for term 1 11:59:46,740 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Persisting ApplyJournalEntries with index=1 11:59:46,740 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config2: publishChanges: rootPath: / 11:59:46,740 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config2: Elapsed time for generation of change events for member-1-shard-inventory-config2-DTCL-publisher: 47.30 μs [WARN] [03/26/2024 11:59:46.740] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config2-DTCL-publisher#-716089510]: org.opendaylight.controller.cluster.common.actor.Monitor@e840660 11:59:46,750 AM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$5 - Stopping Shard member-1-shard-inventory-config2 11:59:46,750 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config2 (Leader)_slicer-id-180: Closing 11:59:46,750 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$5 - member-1-shard-inventory-config2: Aborting 0 pending queued transactions 11:59:46,752 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config3, persistent : true [WARN] [03/26/2024 11:59:46.752] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.common.actor.Monitor@17b6af95 11:59:46,754 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config3 with journal batch size 3 11:59:46,754 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testAbortAfterReady/member-1-shard-inventory-config3-notifier#-783522338 created and ready for shard:member-1-shard-inventory-config3 11:59:46,754 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#1927764124] [WARN] [03/26/2024 11:59:46.755] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config3-notifier#-783522338]: org.opendaylight.controller.cluster.common.actor.Monitor@360ac471 [WARN] [03/26/2024 11:59:46.755] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#1927764124]: org.opendaylight.controller.cluster.common.actor.Monitor@4b91cf98 11:59:46,756 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config3: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:46,756 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config3: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:46,757 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config3: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,757 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config3: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config3 is no longer the leader 11:59:46,757 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config3 , received role change from null to Follower [WARN] [03/26/2024 11:59:46.757] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testAbortAfterReady]] 11:59:46,757 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config3 (Follower): Received TimeoutNow - switching to Candidate 11:59:46,757 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config3 (Candidate): Election: Candidate has following voting peers: [] 11:59:46,757 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config3: Set currentTerm=1, votedFor=member-1-shard-inventory-config3 11:59:46,757 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config3 (Candidate): Starting new election term 1 11:59:46,757 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config3 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:46,757 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config3 (Follower): Closing 11:59:46,757 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config3: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,757 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config3: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config3 is no longer the leader 11:59:46,757 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config3 , received role change from Follower to Candidate 11:59:46,758 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config3 (Candidate): Received ElectionTimeout 11:59:46,758 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config3 (Leader): Election: Leader has following peers: [] 11:59:46,758 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config3 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:46,758 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config3: onLeadershipChange, isLeader: true, hasLeader : true 11:59:46,758 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config3: became leader with frontend state for [] 11:59:46,758 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config3 , received role change from Candidate to Leader 11:59:46,818 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config3: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:46,818 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config3: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:46,818 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config3: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:46,818 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config3: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-4-0 11:59:46,818 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config3: Readying Tx member-1-ShardTransactionTest-fe-0-txn-4-0 of 1 operations, client version 13 11:59:46,818 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: readying transaction member-1-ShardTransactionTest-fe-0-txn-4-0 11:59:46,818 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: transaction member-1-ShardTransactionTest-fe-0-txn-4-0 ready 11:59:46,819 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config3: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-4-0 11:59:46,819 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: aborting head of queue member-1-ShardTransactionTest-fe-0-txn-4-0 in state member-1-ShardTransactionTest-fe-0-txn-4-0 11:59:46,819 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-4-0: abort - successfulFromPrevious: [] 11:59:46,819 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-4-0 11:59:46,819 AM [test-akka.actor.default-dispatcher-6] [ERROR] Shard - member-1-shard-inventory-config3: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-4-0 canCommit java.lang.IllegalStateException: member-1-shard-inventory-config3: Cannot canCommit transaction member-1-ShardTransactionTest-fe-0-txn-4-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:283) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:734) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:414) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:46,820 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:46,820 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Moving last applied index from -1 to 0 11:59:46,820 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:46,820 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:46,820 AM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config3: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:46,820 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2117800} is already disabled 11:59:46,820 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-5-0 11:59:46,820 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Readying Tx member-1-ShardTransactionTest-fe-0-txn-5-0 of 1 operations, client version 13 11:59:46,820 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: readying transaction member-1-ShardTransactionTest-fe-0-txn-5-0 11:59:46,820 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: transaction member-1-ShardTransactionTest-fe-0-txn-5-0 ready 11:59:46,820 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Persisting ApplyJournalEntries with index=0 11:59:46,821 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-5-0 11:59:46,821 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: Validating transaction member-1-ShardTransactionTest-fe-0-txn-5-0 11:59:46,821 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config3: Transaction member-1-ShardTransactionTest-fe-0-txn-5-0 validated 11:59:46,821 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-5-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:46,821 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config3: canCommit for member-1-ShardTransactionTest-fe-0-txn-5-0: success 11:59:46,821 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterReady] 11:59:46,832 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config3 11:59:46,832 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config3 (Leader)_slicer-id-182: Closing 11:59:46,832 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config3: Aborting 1 pending queued transactions 11:59:46,839 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$2$1 - Shard created : member-1-shard-inventory-config4, persistent : true [WARN] [03/26/2024 11:59:46.840] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader]: org.opendaylight.controller.cluster.common.actor.Monitor@15d7a76f 11:59:46,840 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testOnBatchedModificationsWhenNotLeader/member-1-shard-inventory-config4-notifier#843214767 created and ready for shard:member-1-shard-inventory-config4 [WARN] [03/26/2024 11:59:46.841] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/member-1-shard-inventory-config4-notifier#843214767]: org.opendaylight.controller.cluster.common.actor.Monitor@365837cd 11:59:46,841 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/shard-member-1:snapshot-read#-1177979451] [WARN] [03/26/2024 11:59:46.841] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/shard-member-1:snapshot-read#-1177979451]: org.opendaylight.controller.cluster.common.actor.Monitor@6148454a 11:59:46,841 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$2$1 - Starting recovery for member-1-shard-inventory-config4 with journal batch size 3 11:59:46,843 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:46,843 AM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$2$1 - member-1-shard-inventory-config4: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:46,843 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config4: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,843 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config4 is no longer the leader 11:59:46,843 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4 (Follower): Received TimeoutNow - switching to Candidate 11:59:46,843 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4 (Candidate): Election: Candidate has following voting peers: [] 11:59:46,843 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: Set currentTerm=1, votedFor=member-1-shard-inventory-config4 11:59:46,843 AM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$2$1 - member-1-shard-inventory-config4 (Candidate): Starting new election term 1 11:59:46,843 AM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$2$1 - member-1-shard-inventory-config4 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 [WARN] [03/26/2024 11:59:46.843] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader]] 11:59:46,843 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config4 (Follower): Closing 11:59:46,843 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config4: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,843 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config4 is no longer the leader 11:59:46,843 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config4 , received role change from null to Follower 11:59:46,843 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config4 , received role change from Follower to Candidate 11:59:46,844 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4 (Candidate): Received ElectionTimeout 11:59:46,844 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4 (Leader): Election: Leader has following peers: [] 11:59:46,844 AM [test-akka.actor.default-dispatcher-16] [INFO] ShardTest$2$1 - member-1-shard-inventory-config4 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:46,844 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config4: onLeadershipChange, isLeader: true, hasLeader : true 11:59:46,844 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: became leader with frontend state for [] 11:59:46,844 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config4 , received role change from Candidate to Leader 11:59:46,904 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: Forwarding 1 BatchedModifications to leader ActorSelection[Anchor(akka://test/), Path(/system/testProbe-119)] 11:59:46,906 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader] 11:59:46,917 AM [test-akka.actor.default-dispatcher-16] [INFO] ShardTest$2$1 - Stopping Shard member-1-shard-inventory-config4 11:59:46,917 AM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageSlicer - member-1-shard-inventory-config4 (Leader)_slicer-id-184: Closing 11:59:46,917 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config4: Aborting 0 pending queued transactions 11:59:46,919 AM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config5, persistent : true [WARN] [03/26/2024 11:59:46.919] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testOnDatastoreContext]: org.opendaylight.controller.cluster.common.actor.Monitor@7904eae4 11:59:46,920 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testOnDatastoreContext/member-1-shard-inventory-config5-notifier#1075284090 created and ready for shard:member-1-shard-inventory-config5 [WARN] [03/26/2024 11:59:46.920] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnDatastoreContext/member-1-shard-inventory-config5-notifier#1075284090]: org.opendaylight.controller.cluster.common.actor.Monitor@187d2c81 11:59:46,920 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testOnDatastoreContext/shard-member-1:snapshot-read#-2103557000] 11:59:46,920 AM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config5 with journal batch size 3 [WARN] [03/26/2024 11:59:46.920] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnDatastoreContext/shard-member-1:snapshot-read#-2103557000]: org.opendaylight.controller.cluster.common.actor.Monitor@4bc37c50 11:59:46,922 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config5: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:46,922 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config5: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:46,922 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config5: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,922 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config5: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config5 is no longer the leader 11:59:46,922 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config5 , received role change from null to Follower 11:59:46,922 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config5 (Follower): Received TimeoutNow - switching to Candidate 11:59:46,922 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config5 (Candidate): Election: Candidate has following voting peers: [] 11:59:46,922 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config5: Set currentTerm=1, votedFor=member-1-shard-inventory-config5 11:59:46,922 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config5 (Candidate): Starting new election term 1 11:59:46,922 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config5 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:46,922 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config5 (Follower): Closing 11:59:46,922 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config5: onLeadershipChange, isLeader: false, hasLeader : false 11:59:46,922 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config5: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config5 is no longer the leader 11:59:46,923 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config5 , received role change from Follower to Candidate [WARN] [03/26/2024 11:59:46.923] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testOnDatastoreContext]] 11:59:47,72 AM [main] [DEBUG] Shard - member-1-shard-inventory-config5 (Candidate): Received ElectionTimeout 11:59:47,72 AM [main] [DEBUG] Shard - member-1-shard-inventory-config5 (Leader): Election: Leader has following peers: [] 11:59:47,72 AM [main] [INFO] Shard - member-1-shard-inventory-config5 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:47,72 AM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config5: onLeadershipChange, isLeader: true, hasLeader : true 11:59:47,72 AM [main] [DEBUG] Shard - member-1-shard-inventory-config5: became leader with frontend state for [] 11:59:47,72 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config5 , received role change from Candidate to Leader 11:59:47,73 AM [main] [DEBUG] Shard - member-1-shard-inventory-config5: RaftPolicy used with prev.config null, RaftPolicy used with newConfig null [WARN] [03/26/2024 11:59:47.072] [test-akka.actor.default-dispatcher-6] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testOnDatastoreContext]: org.opendaylight.controller.cluster.raft.client.messages.FindLeaderReply@6d521008 11:59:47,73 AM [main] [INFO] Shard - member-1-shard-inventory-config5: Persistence has been enabled - capturing snapshot 11:59:47,73 AM [main] [DEBUG] Shard - Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1 11:59:47,73 AM [main] [DEBUG] Shard - member-1-shard-inventory-config5: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 11:59:47,79 AM [main] [INFO] Shard - member-1-shard-inventory-config5: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true] 11:59:47,79 AM [main] [DEBUG] Shard - member-1-shard-inventory-config5: lastSequenceNumber prior to capture: 1 11:59:47,80 AM [main] [DEBUG] Shard - member-1-shard-inventory-config5: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}} 11:59:47,80 AM [main] [DEBUG] Shard - member-1-shard-inventory-config5: RaftPolicy used with prev.config null, RaftPolicy used with newConfig null 11:59:47,80 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testOnDatastoreContext] 11:59:47,80 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config5: CaptureSnapshotReply received by actor 11:59:47,80 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config5: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@48222745, electionTerm=1, electionVotedFor=member-1-shard-inventory-config5, ServerConfigPayload=null] 11:59:47,80 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config5: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1 11:59:47,81 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config5: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 11:59:47,81 AM [test-akka.persistence.dispatchers.default-plugin-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config5: SaveSnapshotSuccess received for snapshot, sequenceNr: 1 11:59:47,81 AM [test-akka.persistence.dispatchers.default-plugin-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config5: Snapshot success - sequence number: 1 11:59:47,81 AM [test-akka.persistence.dispatchers.default-plugin-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config5: SnapshotComplete received 11:59:47,81 AM [test-akka.persistence.dispatchers.default-plugin-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config5: handled a snapshot response 11:59:47,81 AM [test-akka.persistence.dispatchers.default-plugin-dispatcher-17] [DEBUG] Shard - member-1-shard-inventory-config5: handled a journal response 11:59:47,91 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config5 11:59:47,91 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config5 (Leader)_slicer-id-186: Closing 11:59:47,91 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config5: Aborting 0 pending queued transactions 11:59:47,94 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config6, persistent : true [WARN] [03/26/2024 11:59:47.094] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCanCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@1c3a3007 11:59:47,96 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config6 with journal batch size 3 11:59:47,96 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testCanCommitPhaseFailure/member-1-shard-inventory-config6-notifier#837824670 created and ready for shard:member-1-shard-inventory-config6 11:59:47,96 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCanCommitPhaseFailure/shard-member-1:snapshot-read#-264911162] [WARN] [03/26/2024 11:59:47.096] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitPhaseFailure/member-1-shard-inventory-config6-notifier#837824670]: org.opendaylight.controller.cluster.common.actor.Monitor@2cae70e5 [WARN] [03/26/2024 11:59:47.097] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitPhaseFailure/shard-member-1:snapshot-read#-264911162]: org.opendaylight.controller.cluster.common.actor.Monitor@645ac925 11:59:47,98 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:47,98 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config6: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:47,98 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,98 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config6 is no longer the leader 11:59:47,98 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6 (Follower): Received TimeoutNow - switching to Candidate 11:59:47,98 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6 (Candidate): Election: Candidate has following voting peers: [] 11:59:47,98 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6: Set currentTerm=1, votedFor=member-1-shard-inventory-config6 [WARN] [03/26/2024 11:59:47.098] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCanCommitPhaseFailure]] 11:59:47,98 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from null to Follower 11:59:47,98 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config6 (Candidate): Starting new election term 1 11:59:47,98 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config6 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:47,98 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config6 (Follower): Closing 11:59:47,98 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,98 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config6 is no longer the leader 11:59:47,98 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from Follower to Candidate 11:59:47,99 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config6 (Candidate): Received ElectionTimeout 11:59:47,99 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config6 (Leader): Election: Leader has following peers: [] 11:59:47,99 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config6 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:47,99 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: true, hasLeader : true 11:59:47,99 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config6: became leader with frontend state for [] 11:59:47,99 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from Candidate to Leader 11:59:47,209 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:47,209 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,209 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,210 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-7-0 11:59:47,210 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: Readying Tx member-1-ShardTransactionTest-fe-0-txn-7-0 of 1 operations, client version 13 11:59:47,210 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: readying transaction member-1-ShardTransactionTest-fe-0-txn-7-0 11:59:47,210 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: transaction member-1-ShardTransactionTest-fe-0-txn-7-0 ready 11:59:47,211 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-7-0 11:59:47,211 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: Validating transaction member-1-ShardTransactionTest-fe-0-txn-7-0 11:59:47,211 AM [test-akka.actor.default-dispatcher-16] [WARN] ShardDataTree - member-1-shard-inventory-config6: Store Tx member-1-ShardTransactionTest-fe-0-txn-7-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:292) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:734) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:414) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:47,212 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: Store Tx member-1-ShardTransactionTest-fe-0-txn-7-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 11:59:47,212 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-7-0 changing state from CAN_COMMIT_PENDING to FAILED 11:59:47,212 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-7-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:853) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:292) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:734) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:414) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) ... 34 more 11:59:47,212 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,212 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: Moving last applied index from -1 to 0 11:59:47,212 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:47,212 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:47,212 AM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config6: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:47,213 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3402840} is already disabled 11:59:47,213 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-8-0 11:59:47,213 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: Readying Tx member-1-ShardTransactionTest-fe-0-txn-8-0 of 1 operations, client version 13 11:59:47,213 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: readying transaction member-1-ShardTransactionTest-fe-0-txn-8-0 11:59:47,213 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: transaction member-1-ShardTransactionTest-fe-0-txn-8-0 ready 11:59:47,213 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: Persisting ApplyJournalEntries with index=0 11:59:47,213 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-8-0 11:59:47,213 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: Validating transaction member-1-ShardTransactionTest-fe-0-txn-8-0 11:59:47,213 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config6: Transaction member-1-ShardTransactionTest-fe-0-txn-8-0 validated 11:59:47,213 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-8-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:47,213 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config6: canCommit for member-1-ShardTransactionTest-fe-0-txn-8-0: success 11:59:47,213 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCanCommitPhaseFailure] 11:59:47,224 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config6 11:59:47,224 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config6 (Leader)_slicer-id-188: Closing 11:59:47,224 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config6: Aborting 1 pending queued transactions 11:59:47,227 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config7, persistent : true [WARN] [03/26/2024 11:59:47.227] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterCanCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@ac2ce68 11:59:47,227 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testAbortAfterCanCommit/member-1-shard-inventory-config7-notifier#1961154166 created and ready for shard:member-1-shard-inventory-config7 11:59:47,228 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterCanCommit/shard-member-1:snapshot-read#1663090696] [WARN] [03/26/2024 11:59:47.227] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterCanCommit/member-1-shard-inventory-config7-notifier#1961154166]: org.opendaylight.controller.cluster.common.actor.Monitor@75519257 [WARN] [03/26/2024 11:59:47.228] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterCanCommit/shard-member-1:snapshot-read#1663090696]: org.opendaylight.controller.cluster.common.actor.Monitor@74a3910f 11:59:47,228 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config7 with journal batch size 3 11:59:47,229 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:47,229 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config7: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:47,229 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config7: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,229 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config7 is no longer the leader 11:59:47,229 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config7 , received role change from null to Follower [WARN] [03/26/2024 11:59:47.229] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testAbortAfterCanCommit]] 11:59:47,229 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7 (Follower): Received TimeoutNow - switching to Candidate 11:59:47,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7 (Candidate): Election: Candidate has following voting peers: [] 11:59:47,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Set currentTerm=1, votedFor=member-1-shard-inventory-config7 11:59:47,230 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config7 (Candidate): Starting new election term 1 11:59:47,230 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config7 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:47,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageAssembler - member-1-shard-inventory-config7 (Follower): Closing 11:59:47,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config7: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,230 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config7 is no longer the leader 11:59:47,230 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config7 , received role change from Follower to Candidate 11:59:47,236 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7 (Candidate): Received ElectionTimeout 11:59:47,236 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7 (Leader): Election: Leader has following peers: [] 11:59:47,236 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config7 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:47,236 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config7: onLeadershipChange, isLeader: true, hasLeader : true 11:59:47,236 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: became leader with frontend state for [] 11:59:47,237 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config7 , received role change from Candidate to Leader 11:59:47,290 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:47,291 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,291 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,291 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-9-0 11:59:47,291 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Readying Tx member-1-ShardTransactionTest-fe-0-txn-9-0 of 1 operations, client version 13 11:59:47,291 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: readying transaction member-1-ShardTransactionTest-fe-0-txn-9-0 11:59:47,291 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: transaction member-1-ShardTransactionTest-fe-0-txn-9-0 ready 11:59:47,291 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-10-0 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Readying Tx member-1-ShardTransactionTest-fe-0-txn-10-0 of 1 operations, client version 13 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: readying transaction member-1-ShardTransactionTest-fe-0-txn-10-0 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: transaction member-1-ShardTransactionTest-fe-0-txn-10-0 ready 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-9-0 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Validating transaction member-1-ShardTransactionTest-fe-0-txn-9-0 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-9-0 validated 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-9-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: canCommit for member-1-ShardTransactionTest-fe-0-txn-9-0: success 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Moving last applied index from -1 to 0 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config7: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1631738} is already disabled 11:59:47,292 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-10-0 11:59:47,293 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Tx member-1-ShardTransactionTest-fe-0-txn-10-0 is scheduled for canCommit step 11:59:47,293 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-9-0 11:59:47,293 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: aborting head of queue member-1-ShardTransactionTest-fe-0-txn-9-0 in state member-1-ShardTransactionTest-fe-0-txn-9-0 11:59:47,293 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Validating transaction member-1-ShardTransactionTest-fe-0-txn-10-0 11:59:47,293 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-10-0 validated 11:59:47,293 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-10-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:47,293 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: canCommit for member-1-ShardTransactionTest-fe-0-txn-10-0: success 11:59:47,293 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-9-0: abort - successfulFromPrevious: [] 11:59:47,293 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Persisting ApplyJournalEntries with index=0 11:59:47,293 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterCanCommit] 11:59:47,304 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Stopping Shard member-1-shard-inventory-config7 11:59:47,304 AM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageSlicer - member-1-shard-inventory-config7 (Leader)_slicer-id-190: Closing 11:59:47,304 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config7: Aborting 1 pending queued transactions [WARN] [03/26/2024 11:59:47.304] [test-akka.actor.default-dispatcher-13] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testAbortAfterCanCommit]: Failure(java.lang.RuntimeException: Transaction aborted due to shutdown.) 11:59:47,306 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config8, persistent : true [WARN] [03/26/2024 11:59:47.306] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testConcurrentThreePhaseCommits]: org.opendaylight.controller.cluster.common.actor.Monitor@6dad9a3a 11:59:47,307 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config8-notifier#86225693 created and ready for shard:member-1-shard-inventory-config8 [WARN] [03/26/2024 11:59:47.307] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config8-notifier#86225693]: org.opendaylight.controller.cluster.common.actor.Monitor@41709f03 11:59:47,307 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testConcurrentThreePhaseCommits/shard-member-1:snapshot-read#977623973] [WARN] [03/26/2024 11:59:47.307] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/shard-member-1:snapshot-read#977623973]: org.opendaylight.controller.cluster.common.actor.Monitor@c872522 11:59:47,308 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config8 with journal batch size 3 11:59:47,309 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:47,309 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config8: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:47,309 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config8: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,309 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config8 is no longer the leader 11:59:47,309 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config8 , received role change from null to Follower [WARN] [03/26/2024 11:59:47.309] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testConcurrentThreePhaseCommits]] 11:59:47,309 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8 (Follower): Received TimeoutNow - switching to Candidate 11:59:47,309 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8 (Candidate): Election: Candidate has following voting peers: [] 11:59:47,309 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Set currentTerm=1, votedFor=member-1-shard-inventory-config8 11:59:47,309 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config8 (Candidate): Starting new election term 1 11:59:47,309 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config8 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:47,309 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config8 (Follower): Closing 11:59:47,309 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config8: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,309 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config8 is no longer the leader 11:59:47,309 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config8 , received role change from Follower to Candidate 11:59:47,310 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8 (Candidate): Received ElectionTimeout 11:59:47,310 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8 (Leader): Election: Leader has following peers: [] 11:59:47,310 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config8 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:47,310 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config8: onLeadershipChange, isLeader: true, hasLeader : true 11:59:47,310 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: became leader with frontend state for [] 11:59:47,310 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config8 , received role change from Candidate to Leader 11:59:47,419 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:47,419 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,419 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,419 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-11-0 11:59:47,420 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Readying Tx member-1-ShardTransactionTest-fe-0-txn-11-0 of 1 operations, client version 13 11:59:47,420 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: readying transaction member-1-ShardTransactionTest-fe-0-txn-11-0 11:59:47,420 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: transaction member-1-ShardTransactionTest-fe-0-txn-11-0 ready 11:59:47,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Moving last applied index from -1 to 0 11:59:47,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:47,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:47,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config8: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:47,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1813763} is already disabled 11:59:47,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Persisting ApplyJournalEntries with index=0 11:59:47,422 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-11-0 11:59:47,428 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Validating transaction member-1-ShardTransactionTest-fe-0-txn-11-0 11:59:47,428 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 validated 11:59:47,428 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:47,428 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: canCommit for member-1-ShardTransactionTest-fe-0-txn-11-0: success 11:59:47,428 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-12-0 11:59:47,429 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Readying Tx member-1-ShardTransactionTest-fe-0-txn-12-0 of 1 operations, client version 13 11:59:47,429 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: readying transaction member-1-ShardTransactionTest-fe-0-txn-12-0 11:59:47,429 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: transaction member-1-ShardTransactionTest-fe-0-txn-12-0 ready 11:59:47,429 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-13-0 11:59:47,429 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Readying Tx member-1-ShardTransactionTest-fe-0-txn-13-0 of 1 operations, client version 13 11:59:47,429 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: readying transaction member-1-ShardTransactionTest-fe-0-txn-13-0 11:59:47,429 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: transaction member-1-ShardTransactionTest-fe-0-txn-13-0 ready 11:59:47,430 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-12-0 11:59:47,430 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Tx member-1-ShardTransactionTest-fe-0-txn-12-0 is scheduled for canCommit step 11:59:47,430 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-13-0 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Tx member-1-ShardTransactionTest-fe-0-txn-13-0 is scheduled for canCommit step 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Committing transaction member-1-ShardTransactionTest-fe-0-txn-11-0 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-11-0 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 candidate ready 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-11-0: canCommit - candidate rootPath: / 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-11-0: canCommit - messages: [] 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-11-0: preCommit - successfulFromPrevious: [] 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 prepared 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-11-0 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-11-0 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Validating transaction member-1-ShardTransactionTest-fe-0-txn-12-0 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-12-0 validated 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-12-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: canCommit for member-1-ShardTransactionTest-fe-0-txn-12-0: success 11:59:47,431 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:47,432 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:47,432 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 submitted to persistence 11:59:47,434 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:47,434 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Moving last applied index from 0 to 1 11:59:47,434 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Applying state for log index 1 data Simple{size=143} 11:59:47,434 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-11-0 11:59:47,434 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-11-0: commit - successfulFromPrevious: [] 11:59:47,434 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 changing state from COMMIT_PENDING to COMMITTED 11:59:47,435 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-11-0 committed as 0, sending response to Actor[akka://test/system/testProbe-126#-1238033769] 11:59:47,435 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config8: Created publisher actor Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config8-DTCL-publisher#1398818721] with name member-1-shard-inventory-config8-DTCL-publisher 11:59:47,435 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config8-DTCL-publisher#1398818721] 11:59:47,436 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config8: publishChanges: rootPath: / 11:59:47,436 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: fakeSnapshot purging log to 0 for term 1 11:59:47,436 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Persisting ApplyJournalEntries with index=1 11:59:47,436 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config8: Elapsed time for generation of change events for member-1-shard-inventory-config8-DTCL-publisher: 107.3 μs [WARN] [03/26/2024 11:59:47.436] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config8-DTCL-publisher#1398818721]: org.opendaylight.controller.cluster.common.actor.Monitor@f992336 11:59:47,439 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Committing transaction member-1-ShardTransactionTest-fe-0-txn-12-0 11:59:47,440 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-12-0 11:59:47,440 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-12-0 candidate ready 11:59:47,440 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-12-0: canCommit - candidate rootPath: / 11:59:47,440 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 11:59:47,440 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-12-0: canCommit - messages: [] 11:59:47,440 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-12-0: preCommit - successfulFromPrevious: [] 11:59:47,440 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-12-0 prepared 11:59:47,440 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-12-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:47,440 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-12-0 11:59:47,441 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-12-0 11:59:47,441 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 11:59:47,441 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Validating transaction member-1-ShardTransactionTest-fe-0-txn-13-0 11:59:47,441 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-13-0 validated 11:59:47,441 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-13-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:47,441 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: canCommit for member-1-ShardTransactionTest-fe-0-txn-13-0: success 11:59:47,441 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 11:59:47,441 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 11:59:47,441 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-12-0 submitted to persistence 11:59:47,441 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Committing transaction member-1-ShardTransactionTest-fe-0-txn-13-0 11:59:47,441 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-13-0 11:59:47,442 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-13-0 candidate ready 11:59:47,442 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-13-0: canCommit - candidate rootPath: / 11:59:47,442 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-13-0: canCommit - messages: [] 11:59:47,442 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-13-0: preCommit - successfulFromPrevious: [] 11:59:47,442 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-13-0 prepared 11:59:47,442 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-13-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:47,442 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-13-0 11:59:47,442 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-13-0 11:59:47,442 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Persist data SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-13-0 submitted to persistence 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Moving last applied index from 1 to 2 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Applying state for log index 2 data Simple{size=45} 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-12-0 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-12-0: commit - successfulFromPrevious: [] 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-12-0 changing state from COMMIT_PENDING to COMMITTED 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-12-0 committed as 0, sending response to Actor[akka://test/temp/testConcurrentThreePhaseCommits$a] 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config8: publishChanges: rootPath: / 11:59:47,443 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: fakeSnapshot purging log to 1 for term 1 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config8: Elapsed time for generation of change events for member-1-shard-inventory-config8-DTCL-publisher: 27.51 μs 11:59:47,443 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Persisting ApplyJournalEntries with index=2 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: persist complete SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Moving last applied index from 2 to 3 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Applying state for log index 3 data Simple{size=184} 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-13-0 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-13-0: commit - successfulFromPrevious: [] 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-13-0 changing state from COMMIT_PENDING to COMMITTED 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-13-0 committed as 0, sending response to Actor[akka://test/temp/testConcurrentThreePhaseCommits$b] 11:59:47,443 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config8: publishChanges: rootPath: / 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: fakeSnapshot purging log to 2 for term 1 11:59:47,443 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config8: Persisting ApplyJournalEntries with index=3 11:59:47,443 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config8: Elapsed time for generation of change events for member-1-shard-inventory-config8-DTCL-publisher: 81.51 μs 11:59:47,446 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testConcurrentThreePhaseCommits] 11:59:47,457 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config8 11:59:47,457 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config8 (Leader)_slicer-id-192: Closing 11:59:47,457 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config8: Aborting 0 pending queued transactions 11:59:47,460 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config9, persistent : true [WARN] [03/26/2024 11:59:47.461] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true]: org.opendaylight.controller.cluster.common.actor.Monitor@7929dab9 11:59:47,462 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config9 with journal batch size 3 11:59:47,463 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config9-notifier#-311000468 created and ready for shard:member-1-shard-inventory-config9 11:59:47,463 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/shard-member-1:snapshot-read#-849173350] [WARN] [03/26/2024 11:59:47.463] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config9-notifier#-311000468]: org.opendaylight.controller.cluster.common.actor.Monitor@19d100d2 [WARN] [03/26/2024 11:59:47.463] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/shard-member-1:snapshot-read#-849173350]: org.opendaylight.controller.cluster.common.actor.Monitor@41a926bb 11:59:47,465 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:47,465 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config9: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:47,465 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,465 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config9: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config9 is no longer the leader 11:59:47,465 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from null to Follower 11:59:47,465 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config9 (Follower): Received TimeoutNow - switching to Candidate 11:59:47,465 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config9 (Candidate): Election: Candidate has following voting peers: [] 11:59:47,465 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config9: Set currentTerm=1, votedFor=member-1-shard-inventory-config9 11:59:47,465 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config9 (Candidate): Starting new election term 1 11:59:47,465 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config9 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:47,465 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config9 (Follower): Closing 11:59:47,465 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,465 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config9: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config9 is no longer the leader 11:59:47,466 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from Follower to Candidate 11:59:47,466 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9 (Candidate): Received ElectionTimeout [WARN] [03/26/2024 11:59:47.466] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true]] 11:59:47,466 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9 (Leader): Election: Leader has following peers: [] 11:59:47,467 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config9 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:47,467 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: true, hasLeader : true 11:59:47,467 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: became leader with frontend state for [] 11:59:47,467 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from Candidate to Leader 11:59:47,534 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-14-0 11:59:47,534 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:47,534 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,534 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,534 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: Readying transaction member-1-ShardTransactionTest-fe-0-txn-14-0, client version 13 11:59:47,534 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: readying transaction member-1-ShardTransactionTest-fe-0-txn-14-0 11:59:47,534 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: transaction member-1-ShardTransactionTest-fe-0-txn-14-0 ready 11:59:47,534 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Validating transaction member-1-ShardTransactionTest-fe-0-txn-14-0 11:59:47,535 AM [test-akka.actor.default-dispatcher-14] [WARN] ShardDataTree - member-1-shard-inventory-config9: Store Tx member-1-ShardTransactionTest-fe-0-txn-14-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleForwardedReadyTransaction(ShardCommitCoordinator.java:116) at org.opendaylight.controller.cluster.datastore.Shard.handleForwardedReadyTransaction(Shard.java:852) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:410) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:47,535 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Store Tx member-1-ShardTransactionTest-fe-0-txn-14-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 11:59:47,535 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-14-0 changing state from CAN_COMMIT_PENDING to FAILED 11:59:47,535 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-14-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:853) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleForwardedReadyTransaction(ShardCommitCoordinator.java:116) at org.opendaylight.controller.cluster.datastore.Shard.handleForwardedReadyTransaction(Shard.java:852) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:410) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) ... 34 more 11:59:47,536 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-15-0 11:59:47,536 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Readying transaction member-1-ShardTransactionTest-fe-0-txn-15-0, client version 13 11:59:47,536 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: readying transaction member-1-ShardTransactionTest-fe-0-txn-15-0 11:59:47,536 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: transaction member-1-ShardTransactionTest-fe-0-txn-15-0 ready 11:59:47,536 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Validating transaction member-1-ShardTransactionTest-fe-0-txn-15-0 11:59:47,536 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-15-0 validated 11:59:47,536 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-15-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:47,536 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: canCommit for member-1-ShardTransactionTest-fe-0-txn-15-0: success 11:59:47,536 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Committing transaction member-1-ShardTransactionTest-fe-0-txn-15-0 11:59:47,536 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-15-0 11:59:47,536 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-15-0 candidate ready 11:59:47,536 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-15-0: canCommit - candidate rootPath: / 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-15-0: canCommit - messages: [] 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-15-0: preCommit - successfulFromPrevious: [] 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-15-0 prepared 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-15-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-15-0 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-15-0 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-15-0 submitted to persistence 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Moving last applied index from -1 to 0 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config9: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3435660} is already disabled 11:59:47,537 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Persisting ApplyJournalEntries with index=0 11:59:47,538 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:47,538 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Moving last applied index from 0 to 1 11:59:47,538 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Applying state for log index 1 data Simple{size=143} 11:59:47,538 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-15-0 11:59:47,538 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-15-0: commit - successfulFromPrevious: [] 11:59:47,538 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-15-0 changing state from COMMIT_PENDING to COMMITTED 11:59:47,538 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-15-0 committed as 0, sending response to Actor[akka://test/system/testProbe-128#-1672479799] 11:59:47,538 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config9: Created publisher actor Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config9-DTCL-publisher#1467395729] with name member-1-shard-inventory-config9-DTCL-publisher 11:59:47,539 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config9-DTCL-publisher#1467395729] 11:59:47,539 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config9: publishChanges: rootPath: / 11:59:47,539 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: fakeSnapshot purging log to 0 for term 1 11:59:47,539 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Persisting ApplyJournalEntries with index=1 11:59:47,539 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config9: Elapsed time for generation of change events for member-1-shard-inventory-config9-DTCL-publisher: 105.5 μs [WARN] [03/26/2024 11:59:47.539] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config9-DTCL-publisher#1467395729]: org.opendaylight.controller.cluster.common.actor.Monitor@cab8bb0 11:59:47,540 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config9, persistent : true 11:59:47,542 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config9 with journal batch size 3 [WARN] [03/26/2024 11:59:47.542] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false]: org.opendaylight.controller.cluster.common.actor.Monitor@63938ca9 11:59:47,543 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config9-notifier#-254204937 created and ready for shard:member-1-shard-inventory-config9 11:59:47,543 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/shard-member-1:snapshot-read#-1873867458] [WARN] [03/26/2024 11:59:47.543] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config9-notifier#-254204937]: org.opendaylight.controller.cluster.common.actor.Monitor@6b0ea923 [WARN] [03/26/2024 11:59:47.543] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/shard-member-1:snapshot-read#-1873867458]: org.opendaylight.controller.cluster.common.actor.Monitor@f6e1d2c 11:59:47,545 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.UpdateElectionTerm from Actor[akka://test/deadLetters] 11:59:47,545 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Set currentTerm=1, votedFor=member-1-shard-inventory-config9 11:59:47,545 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:47,545 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Received ReplicatedLogEntry for recovery: index: 0, size: 37 11:59:47,545 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:47,545 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Received ReplicatedLogEntry for recovery: index: 1, size: 143 11:59:47,545 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 11:59:47,545 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Received apply journal entries for recovery, applying to state: 0 to 0 11:59:47,545 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: starting log recovery batch with max size 3 11:59:47,546 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: ignoring unhandled payload DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:47,546 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Moving last applied index from -1 to 0 11:59:47,546 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 11:59:47,546 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Received apply journal entries for recovery, applying to state: 1 to 1 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config9: Added client Enabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@7df25ebd}, purged=MutableUnsignedLongSet{size=0}} 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config9: Committed transaction member-1-ShardTransactionTest-fe-0-txn-15-0 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Moving last applied index from 0 to 1 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config9: Recovery completed in 1.220 ms - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 2 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config9 is no longer the leader [WARN] [03/26/2024 11:59:47.547] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false]] 11:59:47,547 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from null to Follower 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9 (Follower): Received TimeoutNow - switching to Candidate 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9 (Candidate): Election: Candidate has following voting peers: [] 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Set currentTerm=2, votedFor=member-1-shard-inventory-config9 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config9 (Candidate): Starting new election term 2 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config9 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config9 (Follower): Closing 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,547 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config9 is no longer the leader 11:59:47,548 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from Follower to Candidate 11:59:47,548 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config9 (Candidate): Received ElectionTimeout 11:59:47,548 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config9 (Leader): Election: Leader has following peers: [] 11:59:47,548 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config9 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 11:59:47,548 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: true, hasLeader : true 11:59:47,549 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config9: became leader with frontend state for [member-1-frontend-ShardTransactionTest] 11:59:47,549 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from Candidate to Leader 11:59:47,609 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:47,609 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Persist data SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,609 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,610 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-16-0 11:59:47,610 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Readying Tx member-1-ShardTransactionTest-fe-0-txn-16-0 of 1 operations, client version 13 11:59:47,610 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: readying transaction member-1-ShardTransactionTest-fe-0-txn-16-0 11:59:47,610 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: transaction member-1-ShardTransactionTest-fe-0-txn-16-0 ready 11:59:47,610 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Validating transaction member-1-ShardTransactionTest-fe-0-txn-16-0 11:59:47,610 AM [test-akka.actor.default-dispatcher-15] [WARN] ShardDataTree - member-1-shard-inventory-config9: Store Tx member-1-ShardTransactionTest-fe-0-txn-16-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:173) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:47,610 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Store Tx member-1-ShardTransactionTest-fe-0-txn-16-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 11:59:47,610 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-16-0 changing state from CAN_COMMIT_PENDING to FAILED 11:59:47,610 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-16-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:853) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:173) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) ... 35 more 11:59:47,611 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-17-0 11:59:47,611 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Readying Tx member-1-ShardTransactionTest-fe-0-txn-17-0 of 1 operations, client version 13 11:59:47,611 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: readying transaction member-1-ShardTransactionTest-fe-0-txn-17-0 11:59:47,611 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: transaction member-1-ShardTransactionTest-fe-0-txn-17-0 ready 11:59:47,611 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Validating transaction member-1-ShardTransactionTest-fe-0-txn-17-0 11:59:47,611 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-17-0 validated 11:59:47,611 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-17-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:47,611 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: canCommit for member-1-ShardTransactionTest-fe-0-txn-17-0: success 11:59:47,611 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Committing transaction member-1-ShardTransactionTest-fe-0-txn-17-0 11:59:47,611 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-17-0 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-17-0 candidate ready 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-17-0: canCommit - candidate rootPath: / 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-17-0: canCommit - messages: [] 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-17-0: preCommit - successfulFromPrevious: [] 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-17-0 prepared 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-17-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-17-0 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-17-0 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Persist data SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-17-0 submitted to persistence 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: persist complete SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Moving last applied index from 1 to 2 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Applying state for log index 2 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2836156} is already disabled 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: fakeSnapshot purging log to 1 for term 2 11:59:47,612 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config9: Persisting ApplyJournalEntries with index=2 11:59:47,613 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config9: persist complete SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 11:59:47,613 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config9: Moving last applied index from 2 to 3 11:59:47,613 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config9: Applying state for log index 3 data Simple{size=143} 11:59:47,613 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config9: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-17-0 11:59:47,613 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-17-0: commit - successfulFromPrevious: [] 11:59:47,613 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-17-0 changing state from COMMIT_PENDING to COMMITTED 11:59:47,613 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config9: Transaction member-1-ShardTransactionTest-fe-0-txn-17-0 committed as 0, sending response to Actor[akka://test/system/testProbe-129#-114577030] 11:59:47,613 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true] 11:59:47,614 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config9: Created publisher actor Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config9-DTCL-publisher#403865735] with name member-1-shard-inventory-config9-DTCL-publisher 11:59:47,614 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config9-DTCL-publisher#403865735] 11:59:47,614 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config9: publishChanges: rootPath: / 11:59:47,614 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config9: fakeSnapshot purging log to 2 for term 2 11:59:47,614 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config9: Persisting ApplyJournalEntries with index=3 11:59:47,614 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config9: Elapsed time for generation of change events for member-1-shard-inventory-config9-DTCL-publisher: 68.82 μs [WARN] [03/26/2024 11:59:47.614] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config9-DTCL-publisher#403865735]: org.opendaylight.controller.cluster.common.actor.Monitor@20f6cba9 11:59:47,624 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config9 11:59:47,624 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config9 (Leader)_slicer-id-194: Closing 11:59:47,624 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config9: Aborting 0 pending queued transactions 11:59:47,624 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false] 11:59:47,625 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config9 11:59:47,625 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config9 (Leader)_slicer-id-196: Closing 11:59:47,625 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config9: Aborting 0 pending queued transactions 11:59:47,627 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config10, persistent : true 11:59:47,629 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config10 with journal batch size 3 [WARN] [03/26/2024 11:59:47.629] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@42811d6f 11:59:47,629 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitPhaseFailure/shard-member-1:snapshot-read#1072007610] 11:59:47,629 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testCommitPhaseFailure/member-1-shard-inventory-config10-notifier#963875511 created and ready for shard:member-1-shard-inventory-config10 [WARN] [03/26/2024 11:59:47.629] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitPhaseFailure/member-1-shard-inventory-config10-notifier#963875511]: org.opendaylight.controller.cluster.common.actor.Monitor@6b9608a3 [WARN] [03/26/2024 11:59:47.629] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitPhaseFailure/shard-member-1:snapshot-read#1072007610]: org.opendaylight.controller.cluster.common.actor.Monitor@3b1475b6 11:59:47,630 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:47,630 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config10: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:47,631 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,631 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config10 is no longer the leader 11:59:47,631 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10 (Follower): Received TimeoutNow - switching to Candidate 11:59:47,631 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10 (Candidate): Election: Candidate has following voting peers: [] 11:59:47,631 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: Set currentTerm=1, votedFor=member-1-shard-inventory-config10 11:59:47,631 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config10 (Candidate): Starting new election term 1 11:59:47,631 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config10 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:47,631 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config10 (Follower): Closing 11:59:47,631 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,631 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config10: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config10 is no longer the leader 11:59:47,631 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from null to Follower 11:59:47,631 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from Follower to Candidate [WARN] [03/26/2024 11:59:47.631] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCommitPhaseFailure]] 11:59:47,632 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config10 (Candidate): Received ElectionTimeout 11:59:47,632 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config10 (Leader): Election: Leader has following peers: [] 11:59:47,632 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config10 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:47,632 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: true, hasLeader : true 11:59:47,632 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config10: became leader with frontend state for [] 11:59:47,632 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from Candidate to Leader 11:59:47,694 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:47,694 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,694 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,694 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-18-0 11:59:47,694 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: Readying Tx member-1-ShardTransactionTest-fe-0-txn-18-0 of 1 operations, client version 13 11:59:47,694 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: readying transaction member-1-ShardTransactionTest-fe-0-txn-18-0 11:59:47,694 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: transaction member-1-ShardTransactionTest-fe-0-txn-18-0 ready 11:59:47,695 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,695 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: Moving last applied index from -1 to 0 11:59:47,695 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:47,695 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:47,695 AM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config10: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:47,695 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1265990} is already disabled 11:59:47,695 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: Persisting ApplyJournalEntries with index=0 11:59:47,703 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-19-0 11:59:47,703 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Readying Tx member-1-ShardTransactionTest-fe-0-txn-19-0 of 1 operations, client version 13 11:59:47,703 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: readying transaction member-1-ShardTransactionTest-fe-0-txn-19-0 11:59:47,703 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: transaction member-1-ShardTransactionTest-fe-0-txn-19-0 ready 11:59:47,703 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-18-0 11:59:47,703 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Validating transaction member-1-ShardTransactionTest-fe-0-txn-18-0 11:59:47,703 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Transaction member-1-ShardTransactionTest-fe-0-txn-18-0 validated 11:59:47,703 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-18-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:47,703 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: canCommit for member-1-ShardTransactionTest-fe-0-txn-18-0: success 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-19-0 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Tx member-1-ShardTransactionTest-fe-0-txn-19-0 is scheduled for canCommit step 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Committing transaction member-1-ShardTransactionTest-fe-0-txn-18-0 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-18-0 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Transaction member-1-ShardTransactionTest-fe-0-txn-18-0 candidate ready 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-18-0: canCommit - candidate rootPath: / 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-18-0: canCommit - messages: [] 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-18-0: preCommit - successfulFromPrevious: [] 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Transaction member-1-ShardTransactionTest-fe-0-txn-18-0 prepared 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-18-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-18-0 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-18-0 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:47,704 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Validating transaction member-1-ShardTransactionTest-fe-0-txn-19-0 11:59:47,709 AM [test-akka.actor.default-dispatcher-14] [WARN] ShardDataTree - member-1-shard-inventory-config10: Store Tx member-1-ShardTransactionTest-fe-0-txn-19-0: Conflicting modification for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test. 11:59:47,709 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-19-0 changing state from CAN_COMMIT_PENDING to FAILED 11:59:47,709 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-19-0 OptimisticLockFailedException{message=Optimistic lock failed for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, errorList=[RpcError [message=Optimistic lock failed for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, severity=ERROR, errorType=APPLICATION, tag=resource-denied, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.ConflictingModificationAppliedException: Node was created by other transaction.]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:844) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCommit(ShardDataTree.java:1132) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.commit(SimpleShardDataTreeCohort.java:151) at org.opendaylight.controller.cluster.datastore.CohortEntry.commit(CohortEntry.java:121) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.finishCommit(ShardCommitCoordinator.java:322) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator$3.onSuccess(ShardCommitCoordinator.java:305) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator$3.onSuccess(ShardCommitCoordinator.java:302) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.successfulPreCommit(SimpleShardDataTreeCohort.java:223) at org.opendaylight.controller.cluster.datastore.ShardDataTree$1.onSuccess(ShardDataTree.java:1050) at org.opendaylight.controller.cluster.datastore.ShardDataTree$1.onSuccess(ShardDataTree.java:1037) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.doUserPreCommit(SimpleShardDataTreeCohort.java:207) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.userPreCommit(SimpleShardDataTreeCohort.java:191) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1037) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:113) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:117) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:302) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:365) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:715) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:416) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.ConflictingModificationAppliedException: Node was created by other transaction. at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkConflicting(SchemaAwareApplyOperation.java:77) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkWriteApplicable(SchemaAwareApplyOperation.java:180) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:110) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.checkChildPreconditions(AbstractNodeContainerModificationStrategy.java:409) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.checkTouchApplicable(AbstractNodeContainerModificationStrategy.java:368) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:109) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractDataTreeTip.validate(AbstractDataTreeTip.java:31) at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) ... 45 more 11:59:47,710 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:47,710 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:47,710 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Transaction member-1-ShardTransactionTest-fe-0-txn-18-0 submitted to persistence 11:59:47,710 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:47,710 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Moving last applied index from 0 to 1 11:59:47,710 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Applying state for log index 1 data Simple{size=143} 11:59:47,710 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config10: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-18-0 11:59:47,710 AM [test-akka.actor.default-dispatcher-14] [ERROR] ShardDataTree - member-1-shard-inventory-config10: Failed to commit transaction member-1-ShardTransactionTest-fe-0-txn-18-0 java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1081) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:538) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:445) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:1013) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:47,711 AM [test-akka.actor.default-dispatcher-14] [ERROR] SimpleShardDataTreeCohort - Transaction failed to commit java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1081) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:538) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:445) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:1013) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:47,711 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-18-0: abort - successfulFromPrevious: [] 11:59:47,711 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-18-0 changing state from COMMIT_PENDING to FAILED 11:59:47,711 AM [test-akka.actor.default-dispatcher-14] [ERROR] Shard - member-1-shard-inventory-config10, An exception occurred while committing transaction member-1-ShardTransactionTest-fe-0-txn-18-0 java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1081) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:538) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:445) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:1013) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:47,712 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: fakeSnapshot purging log to 0 for term 1 11:59:47,712 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Persisting ApplyJournalEntries with index=1 11:59:47,717 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitPhaseFailure] 11:59:47,728 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config10 11:59:47,728 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config10 (Leader)_slicer-id-198: Closing 11:59:47,728 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config10: Aborting 0 pending queued transactions 11:59:47,731 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config11, persistent : true [WARN] [03/26/2024 11:59:47.731] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitTimeout]: org.opendaylight.controller.cluster.common.actor.Monitor@270863fa 11:59:47,732 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testTransactionCommitTimeout/member-1-shard-inventory-config11-notifier#-1714712276 created and ready for shard:member-1-shard-inventory-config11 [WARN] [03/26/2024 11:59:47.732] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config11-notifier#-1714712276]: org.opendaylight.controller.cluster.common.actor.Monitor@5de1d127 11:59:47,733 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitTimeout/shard-member-1:snapshot-read#-567275383] 11:59:47,733 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config11 with journal batch size 3 [WARN] [03/26/2024 11:59:47.733] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/shard-member-1:snapshot-read#-567275383]: org.opendaylight.controller.cluster.common.actor.Monitor@351c7545 11:59:47,737 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config11: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:47,737 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config11: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:47,737 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,737 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config11: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config11 is no longer the leader 11:59:47,737 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config11 (Follower): Received TimeoutNow - switching to Candidate 11:59:47,737 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from null to Follower 11:59:47,737 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config11 (Candidate): Election: Candidate has following voting peers: [] 11:59:47,737 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config11: Set currentTerm=1, votedFor=member-1-shard-inventory-config11 11:59:47,738 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config11 (Candidate): Starting new election term 1 11:59:47,738 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config11 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:47,738 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config11 (Follower): Closing 11:59:47,738 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: false, hasLeader : false 11:59:47,738 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config11: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config11 is no longer the leader [WARN] [03/26/2024 11:59:47.738] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testTransactionCommitTimeout]] 11:59:47,738 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from Follower to Candidate 11:59:47,738 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config11 (Candidate): Received ElectionTimeout 11:59:47,738 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config11 (Leader): Election: Leader has following peers: [] 11:59:47,738 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config11 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:47,738 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: true, hasLeader : true 11:59:47,738 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config11: became leader with frontend state for [] 11:59:47,738 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from Candidate to Leader 11:59:47,832 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:47,832 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,832 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,832 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-20-0 11:59:47,832 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Readying Tx member-1-ShardTransactionTest-fe-0-txn-20-0 of 1 operations, client version 13 11:59:47,832 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: readying transaction member-1-ShardTransactionTest-fe-0-txn-20-0 11:59:47,832 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: transaction member-1-ShardTransactionTest-fe-0-txn-20-0 ready 11:59:47,832 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Validating transaction member-1-ShardTransactionTest-fe-0-txn-20-0 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 validated 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: canCommit for member-1-ShardTransactionTest-fe-0-txn-20-0: success 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Committing transaction member-1-ShardTransactionTest-fe-0-txn-20-0 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-20-0 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 candidate ready 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-20-0: canCommit - candidate rootPath: / 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-20-0: canCommit - messages: [] 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-20-0: preCommit - successfulFromPrevious: [] 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 prepared 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-20-0 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-20-0 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:47,833 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 submitted to persistence 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Moving last applied index from -1 to 0 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config11: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2231952} is already disabled 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Moving last applied index from 0 to 1 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Applying state for log index 1 data Simple{size=143} 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-20-0 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-20-0: commit - successfulFromPrevious: [] 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 changing state from COMMIT_PENDING to COMMITTED 11:59:47,834 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-20-0 committed as 0, sending response to Actor[akka://test/temp/testTransactionCommitTimeout$c] 11:59:47,835 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config11: Created publisher actor Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config11-DTCL-publisher#1820938610] with name member-1-shard-inventory-config11-DTCL-publisher 11:59:47,835 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config11-DTCL-publisher#1820938610] 11:59:47,835 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config11: publishChanges: rootPath: / 11:59:47,835 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: fakeSnapshot purging log to 0 for term 1 11:59:47,835 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Persisting ApplyJournalEntries with index=0 11:59:47,835 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config11: Elapsed time for generation of change events for member-1-shard-inventory-config11-DTCL-publisher: 130.4 μs 11:59:47,835 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-21-0 11:59:47,835 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Readying Tx member-1-ShardTransactionTest-fe-0-txn-21-0 of 1 operations, client version 13 11:59:47,835 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: readying transaction member-1-ShardTransactionTest-fe-0-txn-21-0 [WARN] [03/26/2024 11:59:47.835] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config11-DTCL-publisher#1820938610]: org.opendaylight.controller.cluster.common.actor.Monitor@607f3679 11:59:47,835 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: transaction member-1-ShardTransactionTest-fe-0-txn-21-0 ready 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Validating transaction member-1-ShardTransactionTest-fe-0-txn-21-0 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 validated 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: canCommit for member-1-ShardTransactionTest-fe-0-txn-21-0: success 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Committing transaction member-1-ShardTransactionTest-fe-0-txn-21-0 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-21-0 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 candidate ready 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-21-0: canCommit - candidate rootPath: / 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-21-0: canCommit - messages: [] 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-21-0: preCommit - successfulFromPrevious: [] 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 prepared 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-21-0 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-21-0 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 submitted to persistence 11:59:47,836 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Persisting ApplyJournalEntries with index=1 11:59:47,837 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 11:59:47,837 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Moving last applied index from 1 to 2 11:59:47,837 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Applying state for log index 2 data Simple{size=45} 11:59:47,837 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-21-0 11:59:47,837 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-21-0: commit - successfulFromPrevious: [] 11:59:47,837 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 changing state from COMMIT_PENDING to COMMITTED 11:59:47,837 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-21-0 committed as 0, sending response to Actor[akka://test/temp/testTransactionCommitTimeout$d] 11:59:47,837 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: fakeSnapshot purging log to 1 for term 1 11:59:47,837 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config11: publishChanges: rootPath: / 11:59:47,837 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config11: Elapsed time for generation of change events for member-1-shard-inventory-config11-DTCL-publisher: 23.98 μs 11:59:47,837 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Persisting ApplyJournalEntries with index=2 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-22-0 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Readying Tx member-1-ShardTransactionTest-fe-0-txn-22-0 of 1 operations, client version 13 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: readying transaction member-1-ShardTransactionTest-fe-0-txn-22-0 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: transaction member-1-ShardTransactionTest-fe-0-txn-22-0 ready 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-23-0 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Readying Tx member-1-ShardTransactionTest-fe-0-txn-23-0 of 1 operations, client version 13 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: readying transaction member-1-ShardTransactionTest-fe-0-txn-23-0 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: transaction member-1-ShardTransactionTest-fe-0-txn-23-0 ready 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-22-0 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Validating transaction member-1-ShardTransactionTest-fe-0-txn-22-0 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-22-0 validated 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-22-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:47,848 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: canCommit for member-1-ShardTransactionTest-fe-0-txn-22-0: success 11:59:47,849 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-23-0 11:59:47,849 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Tx member-1-ShardTransactionTest-fe-0-txn-23-0 is scheduled for canCommit step 11:59:48,415 AM [test-akka.actor.default-dispatcher-16] [WARN] ShardDataTree - member-1-shard-inventory-config11: Current transaction member-1-ShardTransactionTest-fe-0-txn-22-0 has timed out after 566 ms in state CAN_COMMIT_COMPLETE 11:59:48,416 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Validating transaction member-1-ShardTransactionTest-fe-0-txn-23-0 11:59:48,416 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 validated 11:59:48,416 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:48,416 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: canCommit for member-1-ShardTransactionTest-fe-0-txn-23-0: success 11:59:48,416 AM [test-akka.actor.default-dispatcher-16] [ERROR] Shard - member-1-shard-inventory-config11: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-22-0 commit java.lang.IllegalStateException: member-1-shard-inventory-config11: Cannot commit transaction member-1-ShardTransactionTest-fe-0-txn-22-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:358) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:715) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:416) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Committing transaction member-1-ShardTransactionTest-fe-0-txn-23-0 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-23-0 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 candidate ready 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-23-0: canCommit - candidate rootPath: / 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-23-0: canCommit - messages: [] 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-23-0: preCommit - successfulFromPrevious: [] 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 prepared 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-23-0 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-23-0 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Persist data SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 11:59:48,417 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 submitted to persistence 11:59:48,418 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: persist complete SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 11:59:48,418 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Moving last applied index from 2 to 3 11:59:48,418 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Applying state for log index 3 data Simple{size=184} 11:59:48,418 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-23-0 11:59:48,418 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-23-0: commit - successfulFromPrevious: [] 11:59:48,418 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 changing state from COMMIT_PENDING to COMMITTED 11:59:48,418 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-23-0 committed as 0, sending response to Actor[akka://test/system/testProbe-133#1198588257] 11:59:48,419 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: fakeSnapshot purging log to 2 for term 1 11:59:48,419 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config11: Persisting ApplyJournalEntries with index=3 11:59:48,419 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config11: publishChanges: rootPath: / 11:59:48,419 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitTimeout] 11:59:48,419 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config11: Elapsed time for generation of change events for member-1-shard-inventory-config11-DTCL-publisher: 101.4 μs 11:59:48,430 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config11 11:59:48,430 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config11 (Leader)_slicer-id-200: Closing 11:59:48,430 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Aborting 0 pending queued transactions 11:59:48,432 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Shard created : member-1-shard-inventory-config12, persistent : true 11:59:48,434 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Starting recovery for member-1-shard-inventory-config12 with journal batch size 3 [WARN] [03/26/2024 11:59:48.434] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsOnTransactionChain]: org.opendaylight.controller.cluster.common.actor.Monitor@ab22ef9 11:59:48,434 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-member-1:snapshot-read#-1916252059] [WARN] [03/26/2024 11:59:48.435] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-member-1:snapshot-read#-1916252059]: org.opendaylight.controller.cluster.common.actor.Monitor@113d86b2 [WARN] [03/26/2024 11:59:48.435] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config12-notifier#757098320]: org.opendaylight.controller.cluster.common.actor.Monitor@5fc860dd 11:59:48,435 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config12-notifier#757098320 created and ready for shard:member-1-shard-inventory-config12 11:59:48,436 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:48,436 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config12: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:48,436 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: false, hasLeader : false 11:59:48,436 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config12 is no longer the leader 11:59:48,436 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from null to Follower 11:59:48,436 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12 (Follower): Received TimeoutNow - switching to Candidate 11:59:48,436 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12 (Candidate): Election: Candidate has following voting peers: [] 11:59:48,436 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Set currentTerm=1, votedFor=member-1-shard-inventory-config12 11:59:48,436 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config12 (Candidate): Starting new election term 1 [WARN] [03/26/2024 11:59:48.436] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsOnTransactionChain]] 11:59:48,436 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config12 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:48,436 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config12 (Follower): Closing 11:59:48,436 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: false, hasLeader : false 11:59:48,436 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config12 is no longer the leader 11:59:48,436 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from Follower to Candidate 11:59:48,441 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12 (Candidate): Received ElectionTimeout 11:59:48,441 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12 (Leader): Election: Leader has following peers: [] 11:59:48,441 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config12 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:48,441 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: true, hasLeader : true 11:59:48,441 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: became leader with frontend state for [] 11:59:48,441 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from Candidate to Leader 11:59:48,497 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:48,497 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:48,497 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:48,497 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 11:59:48,497 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 11:59:48,497 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeTransactionChain - Opening an unchained snapshot in LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} 11:59:48,497 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeTransactionChain - Allocated read-write transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 snapshot org.opendaylight.yangtools.yang.data.tree.impl.node.Version@6a7dd667 11:59:48,497 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 11:59:48,497 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Readying Tx member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 of 1 operations, client version 13 11:59:48,497 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: readying transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 11:59:48,498 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 ready 11:59:48,498 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeTransactionChain - Committing transaction ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0, closed=true, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]} 11:59:48,498 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Creating transaction : member-1-ShardTransactionTest-fe-0-chn-2-txn-1-0 11:59:48,500 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeTransactionChain - Reusing a chained snapshot in LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} 11:59:48,500 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeTransactionChain - Allocated read-only transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-1-0 snapshot MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 11:59:48,501 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-inventory-member-1:ShardTransactionTest@0:2-1_1#-1629173315] 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Moving last applied index from -1 to 0 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config12: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3988283} is already disabled 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Moving last applied index from 0 to 1 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Applying state for log index 1 data CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39} 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: replication of LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} has no callback [WARN] [03/26/2024 11:59:48.501] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-inventory-member-1:ShardTransactionTest@0:2-1_1#-1629173315]: org.opendaylight.controller.cluster.common.actor.Monitor@7589af6 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: fakeSnapshot purging log to 0 for term 1 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Persisting ApplyJournalEntries with index=0 11:59:48,501 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Persisting ApplyJournalEntries with index=1 11:59:48,502 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Can committing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 11:59:48,502 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Validating transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 11:59:48,502 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 validated 11:59:48,502 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:48,502 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: canCommit for member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: success 11:59:48,502 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Committing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 11:59:48,502 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Preparing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 11:59:48,503 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 candidate ready 11:59:48,503 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: canCommit - candidate rootPath: / 11:59:48,503 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: canCommit - messages: [] 11:59:48,503 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: preCommit - successfulFromPrevious: [] 11:59:48,503 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 prepared 11:59:48,503 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:48,503 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 11:59:48,504 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Starting commit for transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 11:59:48,504 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:48,504 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 11:59:48,504 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config12: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 11:59:48,504 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 submitted to persistence 11:59:48,505 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 11:59:48,505 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Moving last applied index from 1 to 2 11:59:48,505 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Applying state for log index 2 data Simple{size=143} 11:59:48,505 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 11:59:48,505 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: commit - successfulFromPrevious: [] 11:59:48,505 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from COMMIT_PENDING to COMMITTED 11:59:48,505 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ChainedCommitCohort - Committed transaction ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0, closed=true, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, modificationType=SUBTREE_MODIFIED, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE, modificationType=WRITE}}}]} 11:59:48,505 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 committed as 0, sending response to Actor[akka://test/system/testProbe-135#1977515103] 11:59:48,505 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsOnTransactionChain] 11:59:48,506 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config12: Created publisher actor Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config12-DTCL-publisher#-119119100] with name member-1-shard-inventory-config12-DTCL-publisher 11:59:48,506 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config12-DTCL-publisher#-119119100] 11:59:48,506 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config12: publishChanges: rootPath: / 11:59:48,506 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: fakeSnapshot purging log to 1 for term 1 11:59:48,506 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Persisting ApplyJournalEntries with index=2 11:59:48,506 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config12: Elapsed time for generation of change events for member-1-shard-inventory-config12-DTCL-publisher: 73.17 μs [WARN] [03/26/2024 11:59:48.506] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config12-DTCL-publisher#-119119100]: org.opendaylight.controller.cluster.common.actor.Monitor@265e1d4 11:59:48,516 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config12 11:59:48,516 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config12 (Leader)_slicer-id-202: Closing 11:59:48,516 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Aborting 0 pending queued transactions 11:59:48,518 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config13, persistent : true 11:59:48,519 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config13 with journal batch size 3 [WARN] [03/26/2024 11:59:48.519] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCanCommitBeforeReadyFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@76fae659 11:59:48,519 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testCanCommitBeforeReadyFailure/member-1-shard-inventory-config13-notifier#1223354134 created and ready for shard:member-1-shard-inventory-config13 11:59:48,519 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCanCommitBeforeReadyFailure/shard-member-1:snapshot-read#599394490] [WARN] [03/26/2024 11:59:48.519] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitBeforeReadyFailure/member-1-shard-inventory-config13-notifier#1223354134]: org.opendaylight.controller.cluster.common.actor.Monitor@5cafbcc5 [WARN] [03/26/2024 11:59:48.519] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitBeforeReadyFailure/shard-member-1:snapshot-read#599394490]: org.opendaylight.controller.cluster.common.actor.Monitor@5a031857 11:59:48,520 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:48,520 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config13: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:48,520 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: false, hasLeader : false 11:59:48,520 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config13 is no longer the leader [WARN] [03/26/2024 11:59:48.520] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCanCommitBeforeReadyFailure]] 11:59:48,520 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13 (Follower): Received TimeoutNow - switching to Candidate 11:59:48,520 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from null to Follower 11:59:48,520 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13 (Candidate): Election: Candidate has following voting peers: [] 11:59:48,520 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Set currentTerm=1, votedFor=member-1-shard-inventory-config13 11:59:48,521 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config13 (Candidate): Starting new election term 1 11:59:48,521 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config13 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:48,521 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config13 (Follower): Closing 11:59:48,521 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: false, hasLeader : false 11:59:48,521 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config13 is no longer the leader 11:59:48,521 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from Follower to Candidate 11:59:48,521 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config13 (Candidate): Received ElectionTimeout 11:59:48,521 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config13 (Leader): Election: Leader has following peers: [] 11:59:48,521 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config13 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:48,521 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: true, hasLeader : true 11:59:48,521 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config13: became leader with frontend state for [] 11:59:48,521 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from Candidate to Leader 11:59:48,629 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-24-0 11:59:48,629 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:48,629 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:48,629 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:48,629 AM [test-akka.actor.default-dispatcher-6] [ERROR] Shard - member-1-shard-inventory-config13: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-24-0 canCommit java.lang.IllegalStateException: member-1-shard-inventory-config13: Cannot canCommit transaction member-1-ShardTransactionTest-fe-0-txn-24-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:283) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:734) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:414) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:48,630 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCanCommitBeforeReadyFailure] 11:59:48,630 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:48,630 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Moving last applied index from -1 to 0 11:59:48,630 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:48,630 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:48,630 AM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config13: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:48,630 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1461804} is already disabled 11:59:48,630 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Persisting ApplyJournalEntries with index=0 11:59:48,641 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config13 11:59:48,641 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config13 (Leader)_slicer-id-204: Closing 11:59:48,641 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config13: Aborting 0 pending queued transactions 11:59:48,643 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config14, persistent : true [WARN] [03/26/2024 11:59:48.643] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady]: org.opendaylight.controller.cluster.common.actor.Monitor@9298bc 11:59:48,644 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config14-notifier#310080681 created and ready for shard:member-1-shard-inventory-config14 [WARN] [03/26/2024 11:59:48.644] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config14-notifier#310080681]: org.opendaylight.controller.cluster.common.actor.Monitor@51581a54 11:59:48,644 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/shard-member-1:snapshot-read#-1291123418] 11:59:48,644 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config14 with journal batch size 3 [WARN] [03/26/2024 11:59:48.644] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/shard-member-1:snapshot-read#-1291123418]: org.opendaylight.controller.cluster.common.actor.Monitor@6cb1d4b4 11:59:48,645 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:48,645 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config14: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:48,645 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 11:59:48,645 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 11:59:48,645 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from null to Follower 11:59:48,645 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14 (Follower): Received TimeoutNow - switching to Candidate 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14 (Candidate): Election: Candidate has following voting peers: [] [WARN] [03/26/2024 11:59:48.645] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady]] 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Set currentTerm=1, votedFor=member-1-shard-inventory-config14 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config14 (Candidate): Starting new election term 1 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config14 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config14 (Follower): Closing 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 11:59:48,646 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Follower to Candidate 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14 (Candidate): Received ElectionTimeout 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14 (Leader): Election: Leader has following peers: [] 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config14 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: true, hasLeader : true 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: became leader with frontend state for [] 11:59:48,646 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Candidate to Leader 11:59:48,753 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config14: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:48,754 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config14: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:48,754 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config14: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:48,754 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config14: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-25-0 11:59:48,755 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-25-0 11:59:48,755 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:48,755 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from -1 to 0 11:59:48,755 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:48,755 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:48,755 AM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config14: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:48,755 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1659879} is already disabled 11:59:48,755 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Persisting ApplyJournalEntries with index=0 11:59:48,755 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-25-0 11:59:48,755 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Readying Tx member-1-ShardTransactionTest-fe-0-txn-25-0 of 3 operations, client version 13 11:59:48,755 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: readying transaction member-1-ShardTransactionTest-fe-0-txn-25-0 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: transaction member-1-ShardTransactionTest-fe-0-txn-25-0 ready 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Validating transaction member-1-ShardTransactionTest-fe-0-txn-25-0 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 validated 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: canCommit for member-1-ShardTransactionTest-fe-0-txn-25-0: success 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Committing transaction member-1-ShardTransactionTest-fe-0-txn-25-0 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-25-0 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 candidate ready 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-25-0: canCommit - candidate rootPath: / 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-25-0: canCommit - messages: [] 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-25-0: preCommit - successfulFromPrevious: [] 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 prepared 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-25-0 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-25-0 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 submitted to persistence 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from 0 to 1 11:59:48,756 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Applying state for log index 1 data Simple{size=175} 11:59:48,757 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-25-0 11:59:48,757 AM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-25-0: commit - successfulFromPrevious: [] 11:59:48,757 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 changing state from COMMIT_PENDING to COMMITTED 11:59:48,757 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-25-0 committed as 0, sending response to Actor[akka://test/system/testProbe-139#710011203] 11:59:48,757 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config14: Created publisher actor Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config14-DTCL-publisher#-707574101] with name member-1-shard-inventory-config14-DTCL-publisher 11:59:48,757 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config14-DTCL-publisher#-707574101] 11:59:48,757 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config14: publishChanges: rootPath: / 11:59:48,757 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: fakeSnapshot purging log to 0 for term 1 11:59:48,757 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Persisting ApplyJournalEntries with index=1 11:59:48,757 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config14: Elapsed time for generation of change events for member-1-shard-inventory-config14-DTCL-publisher: 94.69 μs [WARN] [03/26/2024 11:59:48.757] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config14-DTCL-publisher#-707574101]: org.opendaylight.controller.cluster.common.actor.Monitor@5ce3fbd2 11:59:48,758 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady] 11:59:48,773 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config14 11:59:48,773 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config14 (Leader)_slicer-id-206: Closing 11:59:48,773 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: Aborting 0 pending queued transactions 11:59:48,776 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config15, persistent : true [WARN] [03/26/2024 11:59:48.776] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testApplyState]: org.opendaylight.controller.cluster.common.actor.Monitor@1b96d0c4 11:59:48,778 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config15 with journal batch size 3 11:59:48,778 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testApplyState/shard-member-1:snapshot-read#46197595] 11:59:48,778 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testApplyState/member-1-shard-inventory-config15-notifier#-1404059467 created and ready for shard:member-1-shard-inventory-config15 [WARN] [03/26/2024 11:59:48.778] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/member-1-shard-inventory-config15-notifier#-1404059467]: org.opendaylight.controller.cluster.common.actor.Monitor@5e9b66f0 [WARN] [03/26/2024 11:59:48.778] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/shard-member-1:snapshot-read#46197595]: org.opendaylight.controller.cluster.common.actor.Monitor@47fe7340 11:59:48,780 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:48,780 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config15: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [03/26/2024 11:59:48.780] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testApplyState]] 11:59:48,780 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: false, hasLeader : false 11:59:48,780 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config15 is no longer the leader 11:59:48,780 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from null to Follower 11:59:48,780 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15 (Follower): Received TimeoutNow - switching to Candidate 11:59:48,780 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15 (Candidate): Election: Candidate has following voting peers: [] 11:59:48,780 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15: Set currentTerm=1, votedFor=member-1-shard-inventory-config15 11:59:48,780 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config15 (Candidate): Starting new election term 1 11:59:48,780 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config15 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:48,780 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config15 (Follower): Closing 11:59:48,780 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: false, hasLeader : false 11:59:48,780 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config15 is no longer the leader 11:59:48,780 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from Follower to Candidate 11:59:48,781 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15 (Candidate): Received ElectionTimeout 11:59:48,781 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15 (Leader): Election: Leader has following peers: [] 11:59:48,781 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config15 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:48,781 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: true, hasLeader : true 11:59:48,781 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15: became leader with frontend state for [] 11:59:48,781 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from Candidate to Leader 11:59:48,831 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:48,831 AM [main] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Applying foreign transaction member-1-ShardTransactionTest-fe-0-txn-26-0 11:59:48,833 AM [main] [DEBUG] FrontendMetadata - member-1-shard-inventory-config15: Added client Enabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@8e36320}, purged=MutableUnsignedLongSet{size=0}} 11:59:48,833 AM [main] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config15: Committed transaction member-1-ShardTransactionTest-fe-0-txn-26-0 11:59:48,833 AM [main] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config15: Created publisher actor Actor[akka://test/user/testApplyState/member-1-shard-inventory-config15-DTCL-publisher#218817890] with name member-1-shard-inventory-config15-DTCL-publisher 11:59:48,833 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testApplyState/member-1-shard-inventory-config15-DTCL-publisher#218817890] 11:59:48,834 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config15: publishChanges: rootPath: / [WARN] [03/26/2024 11:59:48.834] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/member-1-shard-inventory-config15-DTCL-publisher#218817890]: org.opendaylight.controller.cluster.common.actor.Monitor@4b05945 11:59:48,834 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config15: Elapsed time for generation of change events for member-1-shard-inventory-config15-DTCL-publisher: 110.0 μs 11:59:48,909 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testApplyState] 11:59:48,920 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config15 11:59:48,920 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config15 (Leader)_slicer-id-208: Closing 11:59:48,920 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config15: Aborting 0 pending queued transactions 11:59:48,923 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config16, persistent : true [WARN] [03/26/2024 11:59:48.923] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$p/testServerRemoved#-1941198256]: org.opendaylight.controller.cluster.common.actor.Monitor@232fdc2b 11:59:48,924 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/$$p/testServerRemoved/member-1-shard-inventory-config16-notifier#-913390614 created and ready for shard:member-1-shard-inventory-config16 11:59:48,924 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$$p/testServerRemoved/shard-member-1:snapshot-read#-1765500260] [WARN] [03/26/2024 11:59:48.924] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$p/testServerRemoved/member-1-shard-inventory-config16-notifier#-913390614]: org.opendaylight.controller.cluster.common.actor.Monitor@49d6bfbd [WARN] [03/26/2024 11:59:48.924] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$p/testServerRemoved/shard-member-1:snapshot-read#-1765500260]: org.opendaylight.controller.cluster.common.actor.Monitor@69874e 11:59:48,924 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config16 with journal batch size 3 11:59:48,925 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:48,925 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config16: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:48,925 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: false, hasLeader : false 11:59:48,925 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config16 is no longer the leader 11:59:48,925 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from null to Follower 11:59:48,926 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16 (Follower): Received TimeoutNow - switching to Candidate 11:59:48,926 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16 (Candidate): Election: Candidate has following voting peers: [] 11:59:48,926 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Set currentTerm=1, votedFor=member-1-shard-inventory-config16 11:59:48,926 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config16 (Candidate): Starting new election term 1 11:59:48,926 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config16 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:48,926 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config16 (Follower): Closing 11:59:48,926 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: false, hasLeader : false 11:59:48,926 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config16 is no longer the leader 11:59:48,926 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from Follower to Candidate 11:59:48,927 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16 (Candidate): Received ElectionTimeout 11:59:48,927 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16 (Leader): Election: Leader has following peers: [] 11:59:48,927 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config16 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:48,927 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: true, hasLeader : true 11:59:48,927 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: became leader with frontend state for [] 11:59:48,927 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from Candidate to Leader 11:59:48,973 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$p] 11:59:48,984 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config16 11:59:48,984 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config16 (Leader)_slicer-id-210: Closing 11:59:48,984 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config16: Aborting 0 pending queued transactions 11:59:48,985 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config17, persistent : true 11:59:48,987 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config17 with journal batch size 3 [WARN] [03/26/2024 11:59:48.987] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithOperationFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@53308eb9 11:59:48,987 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithOperationFailure/shard-member-1:snapshot-read#-824128580] 11:59:48,987 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testBatchedModificationsWithOperationFailure/member-1-shard-inventory-config17-notifier#-235689804 created and ready for shard:member-1-shard-inventory-config17 [WARN] [03/26/2024 11:59:48.987] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithOperationFailure/member-1-shard-inventory-config17-notifier#-235689804]: org.opendaylight.controller.cluster.common.actor.Monitor@523349c2 [WARN] [03/26/2024 11:59:48.987] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithOperationFailure/shard-member-1:snapshot-read#-824128580]: org.opendaylight.controller.cluster.common.actor.Monitor@2eaaf71c 11:59:48,988 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:48,988 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config17: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:48,988 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: false, hasLeader : false 11:59:48,988 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config17 is no longer the leader 11:59:48,988 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17 (Follower): Received TimeoutNow - switching to Candidate 11:59:48,988 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17 (Candidate): Election: Candidate has following voting peers: [] 11:59:48,988 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Set currentTerm=1, votedFor=member-1-shard-inventory-config17 [WARN] [03/26/2024 11:59:48.988] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsWithOperationFailure]] 11:59:48,989 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from null to Follower 11:59:48,989 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config17 (Candidate): Starting new election term 1 11:59:48,989 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config17 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:48,989 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config17 (Follower): Closing 11:59:48,989 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: false, hasLeader : false 11:59:48,989 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config17 is no longer the leader 11:59:48,989 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from Follower to Candidate 11:59:48,989 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17 (Candidate): Received ElectionTimeout 11:59:48,989 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17 (Leader): Election: Leader has following peers: [] 11:59:48,989 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config17 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:48,989 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: true, hasLeader : true 11:59:48,989 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: became leader with frontend state for [] 11:59:48,989 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from Candidate to Leader 11:59:49,50 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:49,50 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:49,50 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:49,51 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-27-0 11:59:49,51 AM [test-akka.actor.default-dispatcher-15] [ERROR] Shard - member-1-shard-inventory-config17: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-27-0 org.opendaylight.yangtools.yang.data.tree.api.SchemaValidationFailedException: Node (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:junk?revision=2014-03-13)junk is not a valid child of (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test according to the schema. at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.recursivelyVerifyStructure(AbstractNodeContainerModificationStrategy.java:157) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.mergeIntoModifiedNode(AbstractNodeContainerModificationStrategy.java:263) at org.opendaylight.yangtools.yang.data.tree.impl.OperationWithModification.merge(OperationWithModification.java:48) at org.opendaylight.yangtools.yang.data.tree.impl.InMemoryDataTreeModification.merge(InMemoryDataTreeModification.java:106) at org.opendaylight.controller.cluster.datastore.modification.MergeModification.apply(MergeModification.java:49) at org.opendaylight.controller.cluster.datastore.CohortEntry.applyModifications(CohortEntry.java:103) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:147) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:49,52 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Applying 0 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-27-0 11:59:49,52 AM [test-akka.actor.default-dispatcher-15] [ERROR] Shard - member-1-shard-inventory-config17: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-27-0 org.opendaylight.yangtools.yang.data.tree.api.SchemaValidationFailedException: Node (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:junk?revision=2014-03-13)junk is not a valid child of (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test according to the schema. at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.recursivelyVerifyStructure(AbstractNodeContainerModificationStrategy.java:157) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.mergeIntoModifiedNode(AbstractNodeContainerModificationStrategy.java:263) at org.opendaylight.yangtools.yang.data.tree.impl.OperationWithModification.merge(OperationWithModification.java:48) at org.opendaylight.yangtools.yang.data.tree.impl.InMemoryDataTreeModification.merge(InMemoryDataTreeModification.java:106) at org.opendaylight.controller.cluster.datastore.modification.MergeModification.apply(MergeModification.java:49) at org.opendaylight.controller.cluster.datastore.CohortEntry.applyModifications(CohortEntry.java:103) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:147) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:49,52 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithOperationFailure] 11:59:49,52 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:49,52 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Moving last applied index from -1 to 0 11:59:49,52 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:49,52 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:49,52 AM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config17: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:49,52 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2094649} is already disabled 11:59:49,52 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Persisting ApplyJournalEntries with index=0 11:59:49,63 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config17 11:59:49,63 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config17 (Leader)_slicer-id-212: Closing 11:59:49,63 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config17: Aborting 0 pending queued transactions 11:59:49,70 AM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - Shard created : member-1-shard-inventory-config19, persistent : true [WARN] [03/26/2024 11:59:49.071] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCreateSnapshot]: org.opendaylight.controller.cluster.common.actor.Monitor@6195da00 11:59:49,71 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateSnapshot/shard-member-1:snapshot-read#1252217307] 11:59:49,72 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testCreateSnapshot/member-1-shard-inventory-config19-notifier#-544893288 created and ready for shard:member-1-shard-inventory-config19 [WARN] [03/26/2024 11:59:49.072] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config19-notifier#-544893288]: org.opendaylight.controller.cluster.common.actor.Monitor@5f840fc0 [WARN] [03/26/2024 11:59:49.072] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/shard-member-1:snapshot-read#1252217307]: org.opendaylight.controller.cluster.common.actor.Monitor@72c22ea5 11:59:49,72 AM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - Starting recovery for member-1-shard-inventory-config19 with journal batch size 3 11:59:49,73 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:49,73 AM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:49,73 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: false, hasLeader : false 11:59:49,73 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config19 is no longer the leader 11:59:49,73 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from null to Follower [WARN] [03/26/2024 11:59:49.073] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCreateSnapshot]] 11:59:49,74 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19 (Follower): Received TimeoutNow - switching to Candidate 11:59:49,74 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19 (Candidate): Election: Candidate has following voting peers: [] 11:59:49,74 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Set currentTerm=1, votedFor=member-1-shard-inventory-config19 11:59:49,74 AM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19 (Candidate): Starting new election term 1 11:59:49,74 AM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:49,74 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config19 (Follower): Closing 11:59:49,74 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: false, hasLeader : false 11:59:49,74 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config19 is no longer the leader 11:59:49,74 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from Follower to Candidate 11:59:49,74 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19 (Candidate): Received ElectionTimeout 11:59:49,74 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19 (Leader): Election: Leader has following peers: [] 11:59:49,75 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:49,75 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: true, hasLeader : true 11:59:49,75 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: became leader with frontend state for [] 11:59:49,75 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from Candidate to Leader 11:59:49,124 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:49,124 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:49,124 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:49,124 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-28-0 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Readying Tx member-1-ShardTransactionTest-fe-0-txn-28-0 of 1 operations, client version 13 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: readying transaction member-1-ShardTransactionTest-fe-0-txn-28-0 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: transaction member-1-ShardTransactionTest-fe-0-txn-28-0 ready 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Validating transaction member-1-ShardTransactionTest-fe-0-txn-28-0 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 validated 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: canCommit for member-1-ShardTransactionTest-fe-0-txn-28-0: success 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Committing transaction member-1-ShardTransactionTest-fe-0-txn-28-0 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-28-0 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 candidate ready 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-28-0: canCommit - candidate rootPath: / 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-28-0: canCommit - messages: [] 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-28-0: preCommit - successfulFromPrevious: [] 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 prepared 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-28-0 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-28-0 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:49,125 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 submitted to persistence 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Moving last applied index from -1 to 0 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config19: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=8011428} is already disabled 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Moving last applied index from 0 to 1 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Applying state for log index 1 data Simple{size=143} 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-28-0 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-28-0: commit - successfulFromPrevious: [] 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 changing state from COMMIT_PENDING to COMMITTED 11:59:49,132 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-28-0 committed as 0, sending response to Actor[akka://test/temp/testCreateSnapshot$e] 11:59:49,133 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config19: Created publisher actor Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config19-DTCL-publisher#1923209045] with name member-1-shard-inventory-config19-DTCL-publisher 11:59:49,133 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config19-DTCL-publisher#1923209045] 11:59:49,133 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config19: publishChanges: rootPath: / 11:59:49,133 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config19: Elapsed time for generation of change events for member-1-shard-inventory-config19-DTCL-publisher: 54.30 μs 11:59:49,133 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: fakeSnapshot purging log to 0 for term 1 11:59:49,134 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Persisting ApplyJournalEntries with index=0 11:59:49,134 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Persisting ApplyJournalEntries with index=1 [WARN] [03/26/2024 11:59:49.134] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config19-DTCL-publisher#1923209045]: org.opendaylight.controller.cluster.common.actor.Monitor@3e0d0124 11:59:49,208 AM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 11:59:49,208 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: lastSequenceNumber prior to capture: 5 11:59:49,208 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 11:59:49,209 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: CaptureSnapshotReply received by actor 11:59:49,209 AM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=1, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@6448339f, electionTerm=1, electionVotedFor=member-1-shard-inventory-config19, ServerConfigPayload=null] 11:59:49,209 AM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 0 and term: 1 11:59:49,209 AM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: SaveSnapshotSuccess received for snapshot, sequenceNr: 5 11:59:49,209 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Snapshot success - sequence number: 5 11:59:49,209 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: SnapshotComplete received 11:59:49,209 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: handled a snapshot response 11:59:49,209 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: handled a journal response 11:59:49,215 AM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 11:59:49,215 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: lastSequenceNumber prior to capture: 5 11:59:49,215 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 11:59:49,215 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: CaptureSnapshotReply received by actor 11:59:49,215 AM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=1, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@632ccf84, electionTerm=1, electionVotedFor=member-1-shard-inventory-config19, ServerConfigPayload=null] 11:59:49,215 AM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 0 and term: 1 11:59:49,215 AM [test-akka.actor.default-dispatcher-6] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config19: SaveSnapshotSuccess received for snapshot, sequenceNr: 5 11:59:49,215 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Snapshot success - sequence number: 5 11:59:49,215 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: SnapshotComplete received 11:59:49,216 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCreateSnapshot] 11:59:49,216 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: handled a snapshot response 11:59:49,216 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: handled a journal response 11:59:49,227 AM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - Stopping Shard member-1-shard-inventory-config19 11:59:49,227 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config19 (Leader)_slicer-id-214: Closing 11:59:49,227 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config19: Aborting 0 pending queued transactions 11:59:49,230 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config20, persistent : true [WARN] [03/26/2024 11:59:49.230] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries]: org.opendaylight.controller.cluster.common.actor.Monitor@31452b6f 11:59:49,231 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testTransactionCommitWithPriorExpiredCohortEntries/member-1-shard-inventory-config20-notifier#883150605 created and ready for shard:member-1-shard-inventory-config20 [WARN] [03/26/2024 11:59:49.231] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/member-1-shard-inventory-config20-notifier#883150605]: org.opendaylight.controller.cluster.common.actor.Monitor@521165c 11:59:49,231 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/shard-member-1:snapshot-read#-2047255492] [WARN] [03/26/2024 11:59:49.231] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/shard-member-1:snapshot-read#-2047255492]: org.opendaylight.controller.cluster.common.actor.Monitor@113bc388 11:59:49,231 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config20 with journal batch size 3 11:59:49,232 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:49,232 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config20: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:49,233 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: false, hasLeader : false 11:59:49,233 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config20 is no longer the leader 11:59:49,233 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from null to Follower [WARN] [03/26/2024 11:59:49.233] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries]] 11:59:49,233 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20 (Follower): Received TimeoutNow - switching to Candidate 11:59:49,233 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20 (Candidate): Election: Candidate has following voting peers: [] 11:59:49,233 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: Set currentTerm=1, votedFor=member-1-shard-inventory-config20 11:59:49,233 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config20 (Candidate): Starting new election term 1 11:59:49,233 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config20 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:49,233 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config20 (Follower): Closing 11:59:49,233 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: false, hasLeader : false 11:59:49,233 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config20 is no longer the leader 11:59:49,233 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from Follower to Candidate 11:59:49,234 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20 (Candidate): Received ElectionTimeout 11:59:49,234 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20 (Leader): Election: Leader has following peers: [] 11:59:49,234 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config20 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:49,234 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: true, hasLeader : true 11:59:49,234 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: became leader with frontend state for [] 11:59:49,234 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from Candidate to Leader 11:59:49,294 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:49,294 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:49,294 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:49,294 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-29-0 11:59:49,295 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Readying Tx member-1-ShardTransactionTest-fe-0-txn-29-0 of 1 operations, client version 13 11:59:49,295 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: readying transaction member-1-ShardTransactionTest-fe-0-txn-29-0 11:59:49,295 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: transaction member-1-ShardTransactionTest-fe-0-txn-29-0 ready 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-30-0 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Readying Tx member-1-ShardTransactionTest-fe-0-txn-30-0 of 1 operations, client version 13 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: readying transaction member-1-ShardTransactionTest-fe-0-txn-30-0 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: transaction member-1-ShardTransactionTest-fe-0-txn-30-0 ready 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Moving last applied index from -1 to 0 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config20: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1805423} is already disabled 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-31-0 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Readying Tx member-1-ShardTransactionTest-fe-0-txn-31-0 of 1 operations, client version 13 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: readying transaction member-1-ShardTransactionTest-fe-0-txn-31-0 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: transaction member-1-ShardTransactionTest-fe-0-txn-31-0 ready 11:59:49,296 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config20: Persisting ApplyJournalEntries with index=0 11:59:49,298 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-31-0 11:59:49,298 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Tx member-1-ShardTransactionTest-fe-0-txn-31-0 is scheduled for canCommit step 11:59:49,915 AM [test-akka.actor.default-dispatcher-12] [WARN] ShardDataTree - member-1-shard-inventory-config20: Current transaction member-1-ShardTransactionTest-fe-0-txn-29-0 has timed out after 620 ms in state READY 11:59:50,75 AM [test-akka.actor.default-dispatcher-14] [WARN] ShardDataTree - member-1-shard-inventory-config20: Current transaction member-1-ShardTransactionTest-fe-0-txn-30-0 has timed out after 779 ms in state READY 11:59:50,75 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Validating transaction member-1-ShardTransactionTest-fe-0-txn-31-0 11:59:50,75 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Transaction member-1-ShardTransactionTest-fe-0-txn-31-0 validated 11:59:50,75 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-31-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:50,75 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config20: canCommit for member-1-ShardTransactionTest-fe-0-txn-31-0: success 11:59:50,76 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries] 11:59:50,87 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config20 11:59:50,87 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config20 (Leader)_slicer-id-216: Closing 11:59:50,87 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config20: Aborting 1 pending queued transactions 11:59:50,89 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config21, persistent : true [WARN] [03/26/2024 11:59:50.089] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyWithImmediateCommit-true]: org.opendaylight.controller.cluster.common.actor.Monitor@5c1ac26 11:59:50,90 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config21-notifier#-1661841477 created and ready for shard:member-1-shard-inventory-config21 11:59:50,90 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-true/shard-member-1:snapshot-read#-444015409] [WARN] [03/26/2024 11:59:50.090] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config21-notifier#-1661841477]: org.opendaylight.controller.cluster.common.actor.Monitor@3397806f [WARN] [03/26/2024 11:59:50.090] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/shard-member-1:snapshot-read#-444015409]: org.opendaylight.controller.cluster.common.actor.Monitor@47e05b14 11:59:50,91 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config21 with journal batch size 3 11:59:50,92 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config21: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:50,92 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config21: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:50,92 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,92 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config21: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config21 is no longer the leader 11:59:50,92 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from null to Follower 11:59:50,92 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config21 (Follower): Received TimeoutNow - switching to Candidate 11:59:50,92 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config21 (Candidate): Election: Candidate has following voting peers: [] 11:59:50,92 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config21: Set currentTerm=1, votedFor=member-1-shard-inventory-config21 11:59:50,92 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config21 (Candidate): Starting new election term 1 11:59:50,92 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config21 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:50,92 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config21 (Follower): Closing 11:59:50,92 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,92 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config21: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config21 is no longer the leader 11:59:50,92 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from Follower to Candidate 11:59:50,93 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config21 (Candidate): Received ElectionTimeout 11:59:50,93 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config21 (Leader): Election: Leader has following peers: [] 11:59:50,93 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config21 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:50,93 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: true, hasLeader : true 11:59:50,93 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config21: became leader with frontend state for [] 11:59:50,93 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from Candidate to Leader [WARN] [03/26/2024 11:59:50.094] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testReadyWithImmediateCommit-true]] 11:59:50,153 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-32-0 11:59:50,153 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:50,153 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:50,153 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:50,153 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Readying transaction member-1-ShardTransactionTest-fe-0-txn-32-0, client version 13 11:59:50,153 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: readying transaction member-1-ShardTransactionTest-fe-0-txn-32-0 11:59:50,153 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: transaction member-1-ShardTransactionTest-fe-0-txn-32-0 ready 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Validating transaction member-1-ShardTransactionTest-fe-0-txn-32-0 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-32-0 validated 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-32-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: canCommit for member-1-ShardTransactionTest-fe-0-txn-32-0: success 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Committing transaction member-1-ShardTransactionTest-fe-0-txn-32-0 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-32-0 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-32-0 candidate ready 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-32-0: canCommit - candidate rootPath: / 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-32-0: canCommit - messages: [] 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-32-0: preCommit - successfulFromPrevious: [] 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-32-0 prepared 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-32-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-32-0 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-32-0 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:50,154 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-32-0 submitted to persistence 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Moving last applied index from -1 to 0 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config21: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1904845} is already disabled 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Moving last applied index from 0 to 1 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Applying state for log index 1 data Simple{size=143} 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config21: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-32-0 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-32-0: commit - successfulFromPrevious: [] 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-32-0 changing state from COMMIT_PENDING to COMMITTED 11:59:50,155 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Transaction member-1-ShardTransactionTest-fe-0-txn-32-0 committed as 0, sending response to Actor[akka://test/system/testProbe-148#-744214982] 11:59:50,156 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyWithImmediateCommit-true] 11:59:50,156 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config21: Created publisher actor Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config21-DTCL-publisher#1204187696] with name member-1-shard-inventory-config21-DTCL-publisher 11:59:50,156 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config21-DTCL-publisher#1204187696] 11:59:50,156 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config21: publishChanges: rootPath: / 11:59:50,156 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: fakeSnapshot purging log to 0 for term 1 11:59:50,156 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Persisting ApplyJournalEntries with index=0 11:59:50,156 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config21: Elapsed time for generation of change events for member-1-shard-inventory-config21-DTCL-publisher: 93.67 μs 11:59:50,156 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config21: Persisting ApplyJournalEntries with index=1 [WARN] [03/26/2024 11:59:50.156] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config21-DTCL-publisher#1204187696]: org.opendaylight.controller.cluster.common.actor.Monitor@7e63206c 11:59:50,166 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config21 11:59:50,166 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config21 (Leader)_slicer-id-218: Closing 11:59:50,166 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config21: Aborting 0 pending queued transactions 11:59:50,169 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config22, persistent : true [WARN] [03/26/2024 11:59:50.169] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRegisterRoleChangeListener]: org.opendaylight.controller.cluster.common.actor.Monitor@3de6a1c4 11:59:50,170 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testRegisterRoleChangeListener/member-1-shard-inventory-config22-notifier#992391661 created and ready for shard:member-1-shard-inventory-config22 [WARN] [03/26/2024 11:59:50.170] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterRoleChangeListener/member-1-shard-inventory-config22-notifier#992391661]: org.opendaylight.controller.cluster.common.actor.Monitor@46a631b 11:59:50,170 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRegisterRoleChangeListener/shard-member-1:snapshot-read#-770609971] [WARN] [03/26/2024 11:59:50.170] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterRoleChangeListener/shard-member-1:snapshot-read#-770609971]: org.opendaylight.controller.cluster.common.actor.Monitor@380c2c9a 11:59:50,170 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config22 with journal batch size 3 11:59:50,171 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:50,171 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config22: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:50,172 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,172 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 11:59:50,172 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from null to Follower 11:59:50,172 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22 (Follower): Received TimeoutNow - switching to Candidate 11:59:50,172 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Election: Candidate has following voting peers: [] 11:59:50,172 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22: Set currentTerm=1, votedFor=member-1-shard-inventory-config22 11:59:50,172 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config22 (Candidate): Starting new election term 1 11:59:50,172 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config22 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:50,172 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config22 (Follower): Closing 11:59:50,172 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,172 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 11:59:50,172 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Follower to Candidate [WARN] [03/26/2024 11:59:50.172] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testRegisterRoleChangeListener]] 11:59:50,173 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Received ElectionTimeout 11:59:50,173 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Election: Leader has following peers: [] 11:59:50,173 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config22 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:50,173 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: true, hasLeader : true 11:59:50,173 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: became leader with frontend state for [] 11:59:50,173 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Candidate to Leader 11:59:50,222 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , registered listener akka://test/user/$a 11:59:50,284 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:59:50,284 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Cluster state: [] 11:59:50,289 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Candidate in requestVote:RequestVote [term=10000, candidateId=member2, lastLogIndex=50, lastLogTerm=50] with higher term appears reachable, updating term. 11:59:50,289 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config22 (Leader): Term 10000 in "RequestVote [term=10000, candidateId=member2, lastLogIndex=50, lastLogTerm=50]" message is greater than leader's term 1 - switching to Follower 11:59:50,289 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22: Set currentTerm=10000, votedFor=null 11:59:50,289 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config22 (Leader) :- Switching from behavior Leader to Follower, election term: 10000 11:59:50,289 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config22 (Leader)_slicer-id-220: Closing 11:59:50,289 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,289 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 11:59:50,289 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config22: Closing 11:59:50,289 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Leader to Follower 11:59:50,290 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22 (Follower): Received TimeoutNow - switching to Candidate 11:59:50,290 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Election: Candidate has following voting peers: [] 11:59:50,290 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: Set currentTerm=10001, votedFor=member-1-shard-inventory-config22 11:59:50,290 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config22 (Candidate): Starting new election term 10001 11:59:50,290 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config22 (Follower) :- Switching from behavior Follower to Candidate, election term: 10001 11:59:50,290 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config22 (Follower): Closing 11:59:50,290 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,290 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 11:59:50,290 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Follower to Candidate 11:59:50,291 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Received ElectionTimeout 11:59:50,291 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Election: Leader has following peers: [] 11:59:50,291 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config22 (Candidate) :- Switching from behavior Candidate to Leader, election term: 10001 11:59:50,291 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: true, hasLeader : true 11:59:50,291 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22: became leader with frontend state for [] 11:59:50,291 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Candidate to Leader 11:59:50,334 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testRegisterRoleChangeListener] 11:59:50,345 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config22 11:59:50,345 AM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config22 (Leader)_slicer-id-221: Closing 11:59:50,345 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config22: Aborting 0 pending queued transactions 11:59:50,347 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3#2044387020] [WARN] [03/26/2024 11:59:50.348] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3#2044387020]: org.opendaylight.controller.cluster.common.actor.Monitor@4492a8a4 11:59:50,349 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config23, persistent : true [WARN] [03/26/2024 11:59:50.349] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]: org.opendaylight.controller.cluster.common.actor.Monitor@1d5e687 11:59:50,350 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config23-notifier#-1914540404 created and ready for shard:member-1-shard-inventory-config23 [WARN] [03/26/2024 11:59:50.350] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config23-notifier#-1914540404]: org.opendaylight.controller.cluster.common.actor.Monitor@6c95bfac 11:59:50,351 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/shard-member-1:snapshot-read#-746114290] [WARN] [03/26/2024 11:59:50.351] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/shard-member-1:snapshot-read#-746114290]: org.opendaylight.controller.cluster.common.actor.Monitor@2d9d3b3f 11:59:50,351 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config23 with journal batch size 3 11:59:50,351 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1978765765] 11:59:50,351 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: SnapshotOffer called. 11:59:50,352 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: Moving last applied index from -1 to -1 11:59:50,352 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: Set currentTerm=1, votedFor=null 11:59:50,352 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config23: Applying recovered snapshot 11:59:50,352 AM [test-akka.actor.default-dispatcher-15] [DEBUG] FrontendMetadata - member-1-shard-inventory-config23: clearing clients {} 11:59:50,352 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config23: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config23-DTCL-publisher#-1765310848] with name member-1-shard-inventory-config23-DTCL-publisher 11:59:50,352 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config23-DTCL-publisher#-1765310848] 11:59:50,352 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTree - member-1-shard-inventory-config23: state snapshot applied in 657.5 μs 11:59:50,353 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config23: publishChanges: rootPath: / 11:59:50,353 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Recovery snapshot applied for member-1-shard-inventory-config23 in 788.2 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 [WARN] [03/26/2024 11:59:50.353] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config23-DTCL-publisher#-1765310848]: org.opendaylight.controller.cluster.common.actor.Monitor@49322127 11:59:50,353 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config23: Elapsed time for generation of change events for member-1-shard-inventory-config23-DTCL-publisher: 185.5 μs 11:59:50,353 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:50,354 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config23: Recovery completed in 1.920 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:50,354 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,354 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config23 is no longer the leader 11:59:50,354 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config23 , received role change from null to Follower 11:59:50,354 AM [test-akka.actor.default-dispatcher-12] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [03/26/2024 11:59:50.355] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]] 11:59:50,460 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3#2044387020]], isLeader: false, hasLeader: false 11:59:50,460 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: Shard does not have a leader - delaying registration 11:59:50,461 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/$a#386066639] [WARN] [03/26/2024 11:59:50.462] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/$a#386066639]: org.opendaylight.controller.cluster.common.actor.Monitor@7cee6103 11:59:50,462 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/$a 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig null 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23: Re-initializing to Follower with previous leaderId null 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config23 (Follower): Closing 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config23 is no longer the leader 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23 (Follower): Received TimeoutNow - switching to Candidate 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23 (Candidate): Election: Candidate has following voting peers: [] 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23: Set currentTerm=2, votedFor=member-1-shard-inventory-config23 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config23 (Candidate): Starting new election term 2 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config23 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config23 (Follower): Closing 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,463 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config23 is no longer the leader 11:59:50,463 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config23 , received role change from Follower to Candidate 11:59:50,464 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23 (Candidate): Received ElectionTimeout 11:59:50,464 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23 (Leader): Election: Leader has following peers: [] 11:59:50,464 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config23 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 11:59:50,464 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: onLeadershipChange, isLeader: true, hasLeader : true 11:59:50,464 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config23: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@1f9a2076 11:59:50,464 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config23: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 11:59:50,465 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config23: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]], initialState present=true] to publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config23-DTCL-publisher#-1765310848] 11:59:50,465 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config23: became leader with frontend state for [] 11:59:50,465 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config23 , received role change from Candidate to Leader 11:59:50,465 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config23: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]], initialState present=true] 11:59:50,465 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config23: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]] 11:59:50,465 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config23: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]] 11:59:50,465 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)] 11:59:50,465 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config23: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@1f9a2076 11:59:50,465 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config23: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]] 11:59:50,465 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3#2044387020] 11:59:50,476 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4] 11:59:50,477 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config23 11:59:50,477 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config23 (Leader)_slicer-id-223: Closing 11:59:50,477 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config23: Aborting 0 pending queued transactions 11:59:50,480 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config, persistent : true [WARN] [03/26/2024 11:59:50.480] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]: org.opendaylight.controller.cluster.common.actor.Monitor@5fdbc06a 11:59:50,481 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-notifier#-283091998 created and ready for shard:testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config [WARN] [03/26/2024 11:59:50.481] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-notifier#-283091998]: org.opendaylight.controller.cluster.common.actor.Monitor@3c1987de 11:59:50,481 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-follower5:snapshot-read#-83484062] [WARN] [03/26/2024 11:59:50.481] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-follower5:snapshot-read#-83484062]: org.opendaylight.controller.cluster.common.actor.Monitor@11d7d01d 11:59:50,481 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config with journal batch size 3 11:59:50,483 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:50,483 AM [test-akka.actor.default-dispatcher-6] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:50,483 AM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,483 AM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config is no longer the leader 11:59:50,483 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config , received role change from null to Follower [WARN] [03/26/2024 11:59:50.483] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]] 11:59:50,581 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, persistent : true [WARN] [03/26/2024 11:59:50.581] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config]: org.opendaylight.controller.cluster.common.actor.Monitor@78dab5c2 11:59:50,582 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-notifier#-418520566 created and ready for shard:testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config [WARN] [03/26/2024 11:59:50.582] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-notifier#-418520566]: org.opendaylight.controller.cluster.common.actor.Monitor@125cc49f 11:59:50,582 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-leader6:snapshot-read#-248977328] [WARN] [03/26/2024 11:59:50.582] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-leader6:snapshot-read#-248977328]: org.opendaylight.controller.cluster.common.actor.Monitor@7f1cbdf5 11:59:50,582 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config with journal batch size 3 11:59:50,584 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:50,584 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:50,584 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,584 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config is no longer the leader [WARN] [03/26/2024 11:59:50.584] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config]] 11:59:50,584 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config , received role change from null to Follower 11:59:50,681 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Follower): Received TimeoutNow - switching to Candidate 11:59:50,681 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): Election: Candidate has following voting peers: [testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config] 11:59:50,681 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Set currentTerm=1, votedFor=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 11:59:50,681 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): Starting new election term 1 11:59:50,682 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): Sending RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] to peer testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 11:59:50,682 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:50,682 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 11:59:50,682 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Follower): Closing 11:59:50,682 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,682 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config is no longer the leader 11:59:50,682 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Cluster state: [] 11:59:50,682 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Candidate in requestVote:RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 11:59:50,682 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config , received role change from Follower to Candidate 11:59:50,682 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Term 1 in "RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 0 - updating term 11:59:50,682 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Set currentTerm=1, votedFor=null 11:59:50,683 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): In requestVote: RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 11:59:50,684 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Set currentTerm=1, votedFor=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 11:59:50,686 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): requestVote returning: RequestVoteReply [term=1, voteGranted=true] 11:59:50,686 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): RaftRPC message received RequestVoteReply [term=1, voteGranted=true], my term is 1 11:59:50,686 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): handleRequestVoteReply: RequestVoteReply [term=1, voteGranted=true], current voteCount: 1 11:59:50,687 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Election: Leader has following peers: [testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config] 11:59:50,687 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:59:50,688 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:50,688 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onLeadershipChange, isLeader: true, hasLeader : true 11:59:50,688 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: became leader with frontend state for [] 11:59:50,688 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config , received role change from Candidate to Leader 11:59:50,688 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config updated: matchIndex: -1, nextIndex: 0 11:59:50,688 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 11:59:50,689 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Closing 11:59:50,689 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config [WARN] [03/26/2024 11:59:50.689] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5c03d668 11:59:50,731 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 11:59:50,732 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7#-2076616392] [WARN] [03/26/2024 11:59:50.732] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7#-2076616392]: org.opendaylight.controller.cluster.common.actor.Monitor@6c4588e0 11:59:50,743 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7#-2076616392]], isLeader: false, hasLeader: true 11:59:50,754 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 11:59:50,743 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/$a#-1102570360] 11:59:50,754 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@42c13794 [WARN] [03/26/2024 11:59:50.754] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/$a#-1102570360]: org.opendaylight.controller.cluster.common.actor.Monitor@50d06236 11:59:50,754 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher#1807490782] with name testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher 11:59:50,754 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher#1807490782] 11:59:50,754 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]], initialState present=true] to publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher#1807490782] 11:59:50,754 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/$a 11:59:50,754 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]], initialState present=true] 11:59:50,754 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]] 11:59:50,754 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ForwardingDataTreeChangeListener - Sending OnInitialData to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)] [WARN] [03/26/2024 11:59:50.754] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher#1807490782]: org.opendaylight.controller.cluster.common.actor.Monitor@34c130df 11:59:50,755 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]] 11:59:50,755 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Notifying onInitialData to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@42c13794 11:59:50,755 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 11:59:50,755 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Forwarding 1 BatchedModifications to leader ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config)] 11:59:50,755 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:50,755 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:50,755 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:50,756 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Replicate message: identifier: ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, logIndex: 0, isSendImmediate: true 11:59:50,756 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 11:59:50,756 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): sendAppendEntries: 0 is present for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 11:59:50,760 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Sending AppendEntries to follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}]]] 11:59:50,760 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-33-0 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Readying Tx member-1-ShardTransactionTest-fe-0-txn-33-0 of 1 operations, client version 13 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: readying transaction member-1-ShardTransactionTest-fe-0-txn-33-0 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: transaction member-1-ShardTransactionTest-fe-0-txn-33-0 ready 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Validating transaction member-1-ShardTransactionTest-fe-0-txn-33-0 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 validated 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: canCommit for member-1-ShardTransactionTest-fe-0-txn-33-0: success 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Committing transaction member-1-ShardTransactionTest-fe-0-txn-33-0 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-33-0 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 candidate ready 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-33-0: canCommit - candidate rootPath: / 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-33-0: canCommit - messages: [] 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-33-0: preCommit - successfulFromPrevious: [] 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 prepared 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-33-0 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-33-0 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Replicate message: identifier: member-1-ShardTransactionTest-fe-0-txn-33-0, logIndex: 1, isSendImmediate: true 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): sendAppendEntries: 0 is present for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 11:59:50,761 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 submitted to persistence 11:59:50,762 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): handleAppendEntries: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}]]] 11:59:50,762 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Number of entries to be appended = 1 11:59:50,762 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 11:59:50,762 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Append entry to log DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:50,762 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:50,763 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:50,763 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Log size is now 1 11:59:50,763 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:50,766 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=13, raftVersion=5, recipientRaftVersion=5] 11:59:50,767 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config updated: matchIndex: 0, nextIndex: 1 11:59:50,767 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 11:59:50,767 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Setting last applied to 0 11:59:50,767 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Moving last applied index from -1 to 0 11:59:50,767 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:50,767 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:50,767 AM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:50,767 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=11486690} is already disabled 11:59:50,767 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 11:59:50,767 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): sendAppendEntries: 1 is present for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 11:59:50,768 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:50,768 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Sending AppendEntries to follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}]]] 11:59:50,768 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Persisting ApplyJournalEntries with index=0 11:59:50,768 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): handleAppendEntries: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}]]] 11:59:50,768 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Number of entries to be appended = 1 11:59:50,768 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 11:59:50,768 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Append entry to log Simple{size=143} 11:59:50,768 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:50,768 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Log size is now 2 11:59:50,768 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Commit index set to 0 11:59:50,768 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=13, raftVersion=5, recipientRaftVersion=5] 11:59:50,768 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 11:59:50,768 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Setting last applied to 0 11:59:50,768 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Moving last applied index from -1 to 0 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config updated: matchIndex: 1, nextIndex: 2 11:59:50,769 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 11:59:50,769 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Setting last applied to 1 11:59:50,769 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Moving last applied index from 0 to 1 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Applying state for log index 1 data Simple{size=143} 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-33-0 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-33-0: commit - successfulFromPrevious: [] 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 changing state from COMMIT_PENDING to COMMITTED 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-33-0 committed as 0, sending response to Actor[akka://test/temp/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config$f] 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher#-504933084] with name testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: fakeSnapshot purging log to 0 for term 1 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: 0 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Persisting ApplyJournalEntries with index=1 11:59:50,769 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher#-504933084] 11:59:50,770 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: publishChanges: rootPath: / 11:59:50,770 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Elapsed time for generation of change events for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher: 67.96 μs [WARN] [03/26/2024 11:59:50.770] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher#-504933084]: org.opendaylight.controller.cluster.common.actor.Monitor@755b6a96 11:59:50,770 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:50,770 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Persisting ApplyJournalEntries with index=0 11:59:50,770 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Commit index set to 1 11:59:50,770 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1 11:59:50,770 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Setting last applied to 1 11:59:50,770 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Moving last applied index from 0 to 1 11:59:50,770 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Applying state for log index 1 data Simple{size=143} 11:59:50,770 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Applying foreign transaction member-1-ShardTransactionTest-fe-0-txn-33-0 [WARN] [03/26/2024 11:59:50.771] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@35ab2068 11:59:50,771 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: fakeSnapshot purging log to 0 for term 1 11:59:50,771 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: publishChanges: rootPath: / 11:59:50,771 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Persisting ApplyJournalEntries with index=1 11:59:50,771 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]] 11:59:50,771 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)] 11:59:50,771 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Elapsed time for generation of change events for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher: 385.8 μs 11:59:50,771 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@42c13794 11:59:50,772 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config] 11:59:50,783 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Stopping Shard testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 11:59:50,783 AM [test-akka.actor.default-dispatcher-16] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Closing 11:59:50,783 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Aborting 0 pending queued transactions 11:59:50,785 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config] 11:59:50,785 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Stopping Shard testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 11:59:50,785 AM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageSlicer - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader)_slicer-id-226: Closing 11:59:50,785 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Aborting 0 pending queued transactions 11:59:50,786 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7#-2076616392] 11:59:50,788 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Shard created : member-1-shard-inventory-config25, persistent : true [WARN] [03/26/2024 11:59:50.788] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPeerAddressResolved]: org.opendaylight.controller.cluster.common.actor.Monitor@395a81e5 11:59:50,789 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testPeerAddressResolved/member-1-shard-inventory-config25-notifier#-278326548 created and ready for shard:member-1-shard-inventory-config25 [WARN] [03/26/2024 11:59:50.789] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPeerAddressResolved/member-1-shard-inventory-config25-notifier#-278326548]: org.opendaylight.controller.cluster.common.actor.Monitor@5f49e605 11:59:50,790 AM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPeerAddressResolved/shard-member-1:snapshot-read#1645413990] [WARN] [03/26/2024 11:59:50.790] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPeerAddressResolved/shard-member-1:snapshot-read#1645413990]: org.opendaylight.controller.cluster.common.actor.Monitor@2e01334b 11:59:50,790 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Starting recovery for member-1-shard-inventory-config25 with journal batch size 3 11:59:50,791 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config25: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:50,791 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config25: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:50,791 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config25: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,791 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config25: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config25 is no longer the leader 11:59:50,791 AM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config25 , received role change from null to Follower 11:59:50,791 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Peer address for peer member-2-shard-inventory-config set to akka://foobar [WARN] [03/26/2024 11:59:50.791] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testPeerAddressResolved]] 11:59:50,801 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPeerAddressResolved] 11:59:50,823 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Stopping Shard member-1-shard-inventory-config25 11:59:50,823 AM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageAssembler - member-1-shard-inventory-config25 (Follower): Closing 11:59:50,823 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config25: Aborting 0 pending queued transactions 11:59:50,824 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Shard created : member-1-shard-inventory-config26, persistent : true [WARN] [03/26/2024 11:59:50.825] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount]: org.opendaylight.controller.cluster.common.actor.Monitor@3843b481 11:59:50,825 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/member-1-shard-inventory-config26-notifier#439812990 created and ready for shard:member-1-shard-inventory-config26 [WARN] [03/26/2024 11:59:50.825] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/member-1-shard-inventory-config26-notifier#439812990]: org.opendaylight.controller.cluster.common.actor.Monitor@119abf90 11:59:50,825 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/shard-member-1:snapshot-read#1956505013] [WARN] [03/26/2024 11:59:50.825] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/shard-member-1:snapshot-read#1956505013]: org.opendaylight.controller.cluster.common.actor.Monitor@3ec6d09e 11:59:50,825 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Starting recovery for member-1-shard-inventory-config26 with journal batch size 3 11:59:50,826 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config26: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:50,826 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config26: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:50,826 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,826 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config26: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config26 is no longer the leader [WARN] [03/26/2024 11:59:50.826] [test-akka.actor.default-dispatcher-11] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount]] 11:59:50,826 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from null to Follower 11:59:50,826 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config26 (Follower): Received TimeoutNow - switching to Candidate 11:59:50,826 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config26 (Candidate): Election: Candidate has following voting peers: [] 11:59:50,826 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config26: Set currentTerm=1, votedFor=member-1-shard-inventory-config26 11:59:50,826 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config26 (Candidate): Starting new election term 1 11:59:50,826 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config26 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:50,826 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config26 (Follower): Closing 11:59:50,826 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,826 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config26: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config26 is no longer the leader 11:59:50,826 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from Follower to Candidate 11:59:50,827 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config26 (Candidate): Received ElectionTimeout 11:59:50,827 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config26 (Leader): Election: Leader has following peers: [] 11:59:50,827 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config26 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:50,827 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: true, hasLeader : true 11:59:50,827 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config26: became leader with frontend state for [] 11:59:50,827 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from Candidate to Leader 11:59:50,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:50,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:50,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:50,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Applying 0 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-34-0 11:59:50,936 AM [test-akka.actor.default-dispatcher-12] [ERROR] Shard - member-1-shard-inventory-config26: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-34-0 java.lang.IllegalStateException: The total number of batched messages received 1 does not match the number sent 2 at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:157) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:50,937 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount] 11:59:50,937 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:50,937 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Moving last applied index from -1 to 0 11:59:50,937 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:50,937 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:50,937 AM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config26: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:50,937 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1624848} is already disabled 11:59:50,938 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Persisting ApplyJournalEntries with index=0 11:59:50,948 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config26 11:59:50,948 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config26 (Leader)_slicer-id-229: Closing 11:59:50,948 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Aborting 0 pending queued transactions 11:59:50,952 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config27, persistent : true 11:59:50,954 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config27 with journal batch size 3 [WARN] [03/26/2024 11:59:50.954] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true]: org.opendaylight.controller.cluster.common.actor.Monitor@345ed4fa 11:59:50,954 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config27-notifier#-94871247 created and ready for shard:member-1-shard-inventory-config27 11:59:50,954 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/shard-member-1:snapshot-read#681710634] [WARN] [03/26/2024 11:59:50.955] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config27-notifier#-94871247]: org.opendaylight.controller.cluster.common.actor.Monitor@d88ff96 [WARN] [03/26/2024 11:59:50.955] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/shard-member-1:snapshot-read#681710634]: org.opendaylight.controller.cluster.common.actor.Monitor@3fc85f52 11:59:50,956 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:50,956 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config27: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:50,956 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,956 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 11:59:50,956 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27 (Follower): Received TimeoutNow - switching to Candidate 11:59:50,957 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Election: Candidate has following voting peers: [] 11:59:50,957 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: Set currentTerm=1, votedFor=member-1-shard-inventory-config27 11:59:50,957 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config27 (Candidate): Starting new election term 1 11:59:50,957 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config27 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:50,957 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config27 (Follower): Closing 11:59:50,957 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 11:59:50,957 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 11:59:50,957 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from null to Follower 11:59:50,957 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Follower to Candidate [WARN] [03/26/2024 11:59:50.957] [test-akka.actor.default-dispatcher-11] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true]] 11:59:50,958 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Received ElectionTimeout 11:59:50,958 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Election: Leader has following peers: [] 11:59:50,958 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config27 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:50,958 AM [test-akka.actor.default-dispatcher-16] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: true, hasLeader : true 11:59:50,958 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config27: became leader with frontend state for [] 11:59:50,958 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Candidate to Leader 11:59:51,63 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-35-0 11:59:51,63 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:51,63 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:51,63 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:51,63 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Readying transaction member-1-ShardTransactionTest-fe-0-txn-35-0, client version 13 11:59:51,63 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: readying transaction member-1-ShardTransactionTest-fe-0-txn-35-0 11:59:51,63 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: transaction member-1-ShardTransactionTest-fe-0-txn-35-0 ready 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-35-0 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Validating transaction member-1-ShardTransactionTest-fe-0-txn-35-0 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Transaction member-1-ShardTransactionTest-fe-0-txn-35-0 validated 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-35-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: canCommit for member-1-ShardTransactionTest-fe-0-txn-35-0: success 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Committing transaction member-1-ShardTransactionTest-fe-0-txn-35-0 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-35-0 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Transaction member-1-ShardTransactionTest-fe-0-txn-35-0 candidate ready 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-35-0: canCommit - candidate rootPath: / 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-35-0: canCommit - messages: [] 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-35-0: preCommit - successfulFromPrevious: [] 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Transaction member-1-ShardTransactionTest-fe-0-txn-35-0 prepared 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-35-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-35-0 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-35-0 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Transaction member-1-ShardTransactionTest-fe-0-txn-35-0 submitted to persistence 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Moving last applied index from -1 to 0 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config27: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:51,64 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1499186} is already disabled 11:59:51,65 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Persisting ApplyJournalEntries with index=0 11:59:51,65 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:51,65 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Moving last applied index from 0 to 1 11:59:51,65 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Applying state for log index 1 data Simple{size=143} 11:59:51,65 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config27: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-35-0 11:59:51,65 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-35-0: commit - successfulFromPrevious: [] 11:59:51,65 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-35-0 changing state from COMMIT_PENDING to COMMITTED 11:59:51,65 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Transaction member-1-ShardTransactionTest-fe-0-txn-35-0 committed as 0, sending response to Actor[akka://test/system/testProbe-160#-90073773] 11:59:51,65 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config27: Created publisher actor Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config27-DTCL-publisher#-1703904628] with name member-1-shard-inventory-config27-DTCL-publisher 11:59:51,66 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: fakeSnapshot purging log to 0 for term 1 11:59:51,66 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Persisting ApplyJournalEntries with index=1 11:59:51,66 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config27-DTCL-publisher#-1703904628] 11:59:51,66 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config27: publishChanges: rootPath: / 11:59:51,66 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config27: Elapsed time for generation of change events for member-1-shard-inventory-config27-DTCL-publisher: 67.91 μs [WARN] [03/26/2024 11:59:51.066] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config27-DTCL-publisher#-1703904628]: org.opendaylight.controller.cluster.common.actor.Monitor@278b5f35 11:59:51,267 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true] 11:59:51,278 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Stopping Shard member-1-shard-inventory-config27 11:59:51,278 AM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageSlicer - member-1-shard-inventory-config27 (Leader)_slicer-id-231: Closing 11:59:51,278 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config27: Aborting 0 pending queued transactions 11:59:51,280 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Shard created : member-1-shard-inventory-config28, persistent : true [WARN] [03/26/2024 11:59:51.281] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady]: org.opendaylight.controller.cluster.common.actor.Monitor@3b607c26 11:59:51,281 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config28-notifier#1605070277 created and ready for shard:member-1-shard-inventory-config28 [WARN] [03/26/2024 11:59:51.281] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config28-notifier#1605070277]: org.opendaylight.controller.cluster.common.actor.Monitor@35ab679 11:59:51,282 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Starting recovery for member-1-shard-inventory-config28 with journal batch size 3 11:59:51,282 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/shard-member-1:snapshot-read#1932725297] [WARN] [03/26/2024 11:59:51.282] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/shard-member-1:snapshot-read#1932725297]: org.opendaylight.controller.cluster.common.actor.Monitor@51b18bd7 11:59:51,283 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:51,283 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config28: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:51,283 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: false, hasLeader : false 11:59:51,283 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config28 is no longer the leader 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28 (Follower): Received TimeoutNow - switching to Candidate 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28 (Candidate): Election: Candidate has following voting peers: [] 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: Set currentTerm=1, votedFor=member-1-shard-inventory-config28 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config28 (Candidate): Starting new election term 1 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config28 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageAssembler - member-1-shard-inventory-config28 (Follower): Closing 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: false, hasLeader : false 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config28 is no longer the leader 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config28 , received role change from null to Follower 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config28 , received role change from Follower to Candidate [WARN] [03/26/2024 11:59:51.284] [test-akka.actor.default-dispatcher-11] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady]] 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28 (Candidate): Received ElectionTimeout 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28 (Leader): Election: Leader has following peers: [] 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - member-1-shard-inventory-config28 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: true, hasLeader : true 11:59:51,284 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config28: became leader with frontend state for [] 11:59:51,284 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config28 , received role change from Candidate to Leader 11:59:51,392 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config28: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:51,392 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config28: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:51,392 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config28: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:51,392 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config28: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-36-0 11:59:51,392 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config28: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-36-0 11:59:51,394 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-36-0 11:59:51,394 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Readying Tx member-1-ShardTransactionTest-fe-0-txn-36-0 of 3 operations, client version 13 11:59:51,394 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: readying transaction member-1-ShardTransactionTest-fe-0-txn-36-0 11:59:51,394 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: transaction member-1-ShardTransactionTest-fe-0-txn-36-0 ready 11:59:51,394 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-36-0 11:59:51,394 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Validating transaction member-1-ShardTransactionTest-fe-0-txn-36-0 11:59:51,394 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 validated 11:59:51,394 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:51,394 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: canCommit for member-1-ShardTransactionTest-fe-0-txn-36-0: success 11:59:51,394 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Committing transaction member-1-ShardTransactionTest-fe-0-txn-36-0 11:59:51,394 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-36-0 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 candidate ready 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-36-0: canCommit - candidate rootPath: / 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-36-0: canCommit - messages: [] 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-36-0: preCommit - successfulFromPrevious: [] 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 prepared 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-36-0 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-36-0 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 submitted to persistence 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Moving last applied index from -1 to 0 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config28: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:51,395 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3850271} is already disabled 11:59:51,396 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Persisting ApplyJournalEntries with index=0 11:59:51,396 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 11:59:51,396 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Moving last applied index from 0 to 1 11:59:51,396 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Applying state for log index 1 data Simple{size=175} 11:59:51,396 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-36-0 11:59:51,396 AM [test-akka.actor.default-dispatcher-16] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-36-0: commit - successfulFromPrevious: [] 11:59:51,396 AM [test-akka.actor.default-dispatcher-16] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 changing state from COMMIT_PENDING to COMMITTED 11:59:51,396 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Transaction member-1-ShardTransactionTest-fe-0-txn-36-0 committed as 0, sending response to Actor[akka://test/system/testProbe-162#878265413] 11:59:51,396 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady] 11:59:51,396 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config28: Created publisher actor Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config28-DTCL-publisher#1906037129] with name member-1-shard-inventory-config28-DTCL-publisher 11:59:51,397 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: fakeSnapshot purging log to 0 for term 1 11:59:51,397 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config28: Persisting ApplyJournalEntries with index=1 11:59:51,397 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config28-DTCL-publisher#1906037129] 11:59:51,397 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config28: publishChanges: rootPath: / 11:59:51,397 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config28: Elapsed time for generation of change events for member-1-shard-inventory-config28-DTCL-publisher: 73.03 μs [WARN] [03/26/2024 11:59:51.397] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config28-DTCL-publisher#1906037129]: org.opendaylight.controller.cluster.common.actor.Monitor@1953a90f 11:59:51,407 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config28 11:59:51,407 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config28 (Leader)_slicer-id-233: Closing 11:59:51,407 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config28: Aborting 0 pending queued transactions 11:59:51,409 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config29, persistent : true [WARN] [03/26/2024 11:59:51.409] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionMessagesWithNoLeader]: org.opendaylight.controller.cluster.common.actor.Monitor@1946a504 11:59:51,410 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testTransactionMessagesWithNoLeader/member-1-shard-inventory-config29-notifier#1882033430 created and ready for shard:member-1-shard-inventory-config29 11:59:51,411 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionMessagesWithNoLeader/shard-member-1:snapshot-read#-1203489381] 11:59:51,411 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config29 with journal batch size 3 [WARN] [03/26/2024 11:59:51.411] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionMessagesWithNoLeader/member-1-shard-inventory-config29-notifier#1882033430]: org.opendaylight.controller.cluster.common.actor.Monitor@5cede6c [WARN] [03/26/2024 11:59:51.411] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionMessagesWithNoLeader/shard-member-1:snapshot-read#-1203489381]: org.opendaylight.controller.cluster.common.actor.Monitor@686eb77a 11:59:51,412 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config29: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:51,412 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config29: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:51,412 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config29: onLeadershipChange, isLeader: false, hasLeader : false 11:59:51,412 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config29: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config29 is no longer the leader 11:59:51,412 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config29 , received role change from null to Follower 11:59:51,412 AM [test-akka.actor.default-dispatcher-12] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [03/26/2024 11:59:51.412] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testTransactionMessagesWithNoLeader]] 11:59:51,520 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config29: Adding message BatchedModifications [transactionId=member-1-ShardTransactionTest-fe-0-txn-37-0, ready=false, participatingShardNames=null, totalMessagesSent=0, modifications size=0] to retry 11:59:51,636 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config29: Timer expired for message BatchedModifications [transactionId=member-1-ShardTransactionTest-fe-0-txn-37-0, ready=false, participatingShardNames=null, totalMessagesSent=0, modifications size=0] 11:59:51,637 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config29: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-37-0 11:59:51,641 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config29: Adding message ForwardedReadyTransaction [transactionId=member-1-ShardTransactionTest-fe-0-txn-37-0, transaction=ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-txn-37-0, closed=false, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]}, doImmediateCommit=true, participatingShardNames=null, txnClientVersion=13] to retry 11:59:51,756 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config29: Timer expired for message ForwardedReadyTransaction [transactionId=member-1-ShardTransactionTest-fe-0-txn-37-0, transaction=ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-txn-37-0, closed=false, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]}, doImmediateCommit=true, participatingShardNames=null, txnClientVersion=13] 11:59:51,756 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config29: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-37-0 11:59:51,757 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config29: Adding message org.opendaylight.controller.cluster.datastore.messages.ReadyLocalTransaction@261a8134 to retry 11:59:51,875 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config29: Timer expired for message org.opendaylight.controller.cluster.datastore.messages.ReadyLocalTransaction@261a8134 11:59:51,875 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionMessagesWithNoLeader] 11:59:51,886 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config29 11:59:51,886 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config29 (Follower): Closing 11:59:51,887 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config29: Aborting 0 pending queued transactions 11:59:51,889 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config30, persistent : true [WARN] [03/26/2024 11:59:51.889] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction#1041877859]: org.opendaylight.controller.cluster.common.actor.Monitor@1db34171 11:59:51,890 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testCreateTransaction/member-1-shard-inventory-config30-notifier#-1901615753 created and ready for shard:member-1-shard-inventory-config30 [WARN] [03/26/2024 11:59:51.890] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/member-1-shard-inventory-config30-notifier#-1901615753]: org.opendaylight.controller.cluster.common.actor.Monitor@4a96d7a6 11:59:51,890 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateTransaction/shard-member-1:snapshot-read#1510189381] 11:59:51,890 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config30 with journal batch size 3 [WARN] [03/26/2024 11:59:51.890] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/shard-member-1:snapshot-read#1510189381]: org.opendaylight.controller.cluster.common.actor.Monitor@57acfe7c 11:59:51,891 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config30: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:51,891 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config30: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:51,892 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config30: onLeadershipChange, isLeader: false, hasLeader : false 11:59:51,892 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config30: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config30 is no longer the leader 11:59:51,892 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config30 , received role change from null to Follower 11:59:51,892 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config30 (Follower): Received TimeoutNow - switching to Candidate 11:59:51,892 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config30 (Candidate): Election: Candidate has following voting peers: [] 11:59:51,892 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config30: Set currentTerm=1, votedFor=member-1-shard-inventory-config30 11:59:51,892 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config30 (Candidate): Starting new election term 1 11:59:51,892 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config30 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:51,892 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config30 (Follower): Closing 11:59:51,892 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config30: onLeadershipChange, isLeader: false, hasLeader : false 11:59:51,892 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config30: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config30 is no longer the leader 11:59:51,892 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config30 , received role change from Follower to Candidate [WARN] [03/26/2024 11:59:51.892] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=Actor[akka://test/user/testCreateTransaction#1041877859]] 11:59:51,893 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30 (Candidate): Received ElectionTimeout 11:59:51,893 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30 (Leader): Election: Leader has following peers: [] 11:59:51,893 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config30 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:51,893 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config30: onLeadershipChange, isLeader: true, hasLeader : true 11:59:51,893 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: became leader with frontend state for [] 11:59:51,893 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config30 , received role change from Candidate to Leader 11:59:51,966 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config30: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:51,966 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config30: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:51,966 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config30: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:51,966 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config30: Creating transaction : member-1-ShardTransactionTest-fe-0-txn-38-0 11:59:51,967 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testCreateTransaction/shard-inventory-member-1:ShardTransactionTest@0:38_2#1200764778] [WARN] [03/26/2024 11:59:51.967] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/shard-inventory-member-1:ShardTransactionTest@0:38_2#1200764778]: org.opendaylight.controller.cluster.common.actor.Monitor@1039d25e 11:59:51,967 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testCreateTransaction#1041877859] 11:59:51,968 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config30: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:51,968 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config30: Moving last applied index from -1 to 0 11:59:51,968 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config30: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:51,968 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config30: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:51,968 AM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config30: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:51,968 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config30: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2514579} is already disabled 11:59:51,969 AM [test-akka.actor.default-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config30: Persisting ApplyJournalEntries with index=0 11:59:51,978 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config30 11:59:51,978 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config30 (Leader)_slicer-id-236: Closing 11:59:51,978 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config30: Aborting 0 pending queued transactions 11:59:51,980 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Shard created : member-1-shard-inventory-config31, persistent : false 11:59:51,981 AM [test-akka.actor.default-dispatcher-16] [INFO] Shard - Starting recovery for member-1-shard-inventory-config31 with journal batch size 3 [WARN] [03/26/2024 11:59:51.981] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWithPersistenceDisabled]: org.opendaylight.controller.cluster.common.actor.Monitor@2b76fcf3 11:59:51,981 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config31-notifier#1018565049 created and ready for shard:member-1-shard-inventory-config31 11:59:51,981 AM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWithPersistenceDisabled/shard-member-1:snapshot-read#-1904060804] [WARN] [03/26/2024 11:59:51.981] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config31-notifier#1018565049]: org.opendaylight.controller.cluster.common.actor.Monitor@77f9f2fb [WARN] [03/26/2024 11:59:51.981] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/shard-member-1:snapshot-read#-1904060804]: org.opendaylight.controller.cluster.common.actor.Monitor@35b72f 11:59:51,982 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:51,982 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config31: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:51,983 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: false, hasLeader : false 11:59:51,983 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config31 is no longer the leader [WARN] [03/26/2024 11:59:51.983] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCommitWithPersistenceDisabled]] 11:59:51,983 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from null to Follower 11:59:51,983 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31 (Follower): Received TimeoutNow - switching to Candidate 11:59:51,983 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31 (Candidate): Election: Candidate has following voting peers: [] 11:59:51,983 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: Set currentTerm=1, votedFor=member-1-shard-inventory-config31 11:59:51,983 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config31 (Candidate): Starting new election term 1 11:59:51,983 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config31 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:51,983 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config31 (Follower): Closing 11:59:51,983 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: false, hasLeader : false 11:59:51,983 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config31 is no longer the leader 11:59:51,983 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from Follower to Candidate 11:59:51,984 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config31 (Candidate): Received ElectionTimeout 11:59:51,984 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config31 (Leader): Election: Leader has following peers: [] 11:59:51,984 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config31 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:51,984 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: true, hasLeader : true 11:59:51,984 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config31: became leader with frontend state for [] 11:59:51,984 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from Candidate to Leader 11:59:52,44 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:52,44 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:52,44 AM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config31: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:52,44 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=136963} is already disabled 11:59:52,44 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-39-0 11:59:52,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: Readying Tx member-1-ShardTransactionTest-fe-0-txn-39-0 of 1 operations, client version 13 11:59:52,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: readying transaction member-1-ShardTransactionTest-fe-0-txn-39-0 11:59:52,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: transaction member-1-ShardTransactionTest-fe-0-txn-39-0 ready 11:59:52,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-39-0 11:59:52,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Validating transaction member-1-ShardTransactionTest-fe-0-txn-39-0 11:59:52,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-39-0 validated 11:59:52,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-39-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:52,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: canCommit for member-1-ShardTransactionTest-fe-0-txn-39-0: success 11:59:52,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: Committing transaction member-1-ShardTransactionTest-fe-0-txn-39-0 11:59:52,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-39-0 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-39-0 candidate ready 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-39-0: canCommit - candidate rootPath: / 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-39-0: canCommit - messages: [] 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-39-0: preCommit - successfulFromPrevious: [] 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-39-0 prepared 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-39-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-39-0 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-39-0 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-39-0 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-39-0: commit - successfulFromPrevious: [] 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-39-0 changing state from COMMIT_PENDING to COMMITTED 11:59:52,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-39-0 committed as 0, sending response to Actor[akka://test/system/testProbe-168#-1506504991] 11:59:52,47 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config31: Created publisher actor Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config31-DTCL-publisher#-1278493696] with name member-1-shard-inventory-config31-DTCL-publisher 11:59:52,47 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config31: Transaction member-1-ShardTransactionTest-fe-0-txn-39-0 submitted to persistence 11:59:52,47 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config31-DTCL-publisher#-1278493696] 11:59:52,47 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config31: publishChanges: rootPath: / 11:59:52,47 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config31: Elapsed time for generation of change events for member-1-shard-inventory-config31-DTCL-publisher: 94.01 μs [WARN] [03/26/2024 11:59:52.048] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config31-DTCL-publisher#-1278493696]: org.opendaylight.controller.cluster.common.actor.Monitor@fcaae52 11:59:52,48 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWithPersistenceDisabled] 11:59:52,59 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config31 11:59:52,59 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config31 (Leader)_slicer-id-238: Closing 11:59:52,59 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config31: Aborting 0 pending queued transactions 11:59:52,61 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Shard created : member-1-shard-inventory-config32, persistent : true 11:59:52,62 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Starting recovery for member-1-shard-inventory-config32 with journal batch size 3 [WARN] [03/26/2024 11:59:52.062] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyWithImmediateCommit-false]: org.opendaylight.controller.cluster.common.actor.Monitor@65474c09 11:59:52,63 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config32-notifier#-1789994706 created and ready for shard:member-1-shard-inventory-config32 11:59:52,63 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-false/shard-member-1:snapshot-read#1326062242] [WARN] [03/26/2024 11:59:52.063] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config32-notifier#-1789994706]: org.opendaylight.controller.cluster.common.actor.Monitor@7e0bcc48 [WARN] [03/26/2024 11:59:52.063] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/shard-member-1:snapshot-read#1326062242]: org.opendaylight.controller.cluster.common.actor.Monitor@3d39856c 11:59:52,64 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:52,64 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config32: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:52,64 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,64 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config32 is no longer the leader 11:59:52,64 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32 (Follower): Received TimeoutNow - switching to Candidate [WARN] [03/26/2024 11:59:52.064] [test-akka.actor.default-dispatcher-16] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testReadyWithImmediateCommit-false]] 11:59:52,64 AM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from null to Follower 11:59:52,64 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32 (Candidate): Election: Candidate has following voting peers: [] 11:59:52,64 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: Set currentTerm=1, votedFor=member-1-shard-inventory-config32 11:59:52,64 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config32 (Candidate): Starting new election term 1 11:59:52,64 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config32 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:52,64 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config32 (Follower): Closing 11:59:52,64 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,65 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config32: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config32 is no longer the leader 11:59:52,65 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Follower to Candidate 11:59:52,65 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config32 (Candidate): Received ElectionTimeout 11:59:52,65 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config32 (Leader): Election: Leader has following peers: [] 11:59:52,65 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config32 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:52,65 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: true, hasLeader : true 11:59:52,65 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config32: became leader with frontend state for [] 11:59:52,65 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Candidate to Leader 11:59:52,77 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:52,77 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,77 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,77 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-40-0 11:59:52,77 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Readying Tx member-1-ShardTransactionTest-fe-0-txn-40-0 of 1 operations, client version 13 11:59:52,77 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: readying transaction member-1-ShardTransactionTest-fe-0-txn-40-0 11:59:52,77 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: transaction member-1-ShardTransactionTest-fe-0-txn-40-0 ready 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Validating transaction member-1-ShardTransactionTest-fe-0-txn-40-0 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 validated 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: canCommit for member-1-ShardTransactionTest-fe-0-txn-40-0: success 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Committing transaction member-1-ShardTransactionTest-fe-0-txn-40-0 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-40-0 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 candidate ready 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-40-0: canCommit - candidate rootPath: / 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-40-0: canCommit - messages: [] 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-40-0: preCommit - successfulFromPrevious: [] 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 prepared 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-40-0 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-40-0 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:52,78 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 submitted to persistence 11:59:52,81 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,81 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Moving last applied index from -1 to 0 11:59:52,82 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:52,82 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:52,82 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config32: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:52,82 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=4667589} is already disabled 11:59:52,82 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:52,82 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Moving last applied index from 0 to 1 11:59:52,82 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Applying state for log index 1 data Simple{size=143} 11:59:52,82 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-40-0 11:59:52,82 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-40-0: commit - successfulFromPrevious: [] 11:59:52,82 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 changing state from COMMIT_PENDING to COMMITTED 11:59:52,82 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-40-0 committed as 0, sending response to Actor[akka://test/system/testProbe-170#612154303] 11:59:52,82 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyWithImmediateCommit-false] 11:59:52,82 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config32: Created publisher actor Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config32-DTCL-publisher#-1020736355] with name member-1-shard-inventory-config32-DTCL-publisher 11:59:52,82 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config32-DTCL-publisher#-1020736355] 11:59:52,82 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config32: publishChanges: rootPath: / 11:59:52,83 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config32: Elapsed time for generation of change events for member-1-shard-inventory-config32-DTCL-publisher: 113.9 μs [WARN] [03/26/2024 11:59:52.083] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config32-DTCL-publisher#-1020736355]: org.opendaylight.controller.cluster.common.actor.Monitor@5263d446 11:59:52,83 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: fakeSnapshot purging log to 0 for term 1 11:59:52,83 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Persisting ApplyJournalEntries with index=0 11:59:52,83 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config32: Persisting ApplyJournalEntries with index=1 11:59:52,93 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config32 11:59:52,93 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config32 (Leader)_slicer-id-240: Closing 11:59:52,93 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config32: Aborting 0 pending queued transactions 11:59:52,95 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 11:59:52,96 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,96 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,96 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,97 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,97 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,97 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,97 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,98 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,98 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,98 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,99 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,99 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,99 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,99 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,100 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,100 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 11:59:52,102 AM [test-akka.actor.default-dispatcher-14] [INFO] AbstractShardTest$1 - Shard created : member-1-shard-inventory-config33, persistent : true 11:59:52,103 AM [test-akka.actor.default-dispatcher-14] [INFO] AbstractShardTest$1 - Starting recovery for member-1-shard-inventory-config33 with journal batch size 3 [WARN] [03/26/2024 11:59:52.103] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRecovery]: org.opendaylight.controller.cluster.common.actor.Monitor@53d19f5e 11:59:52,104 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testRecovery/member-1-shard-inventory-config33-notifier#1149471489 created and ready for shard:member-1-shard-inventory-config33 11:59:52,104 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#1603339473] [WARN] [03/26/2024 11:59:52.104] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config33-notifier#1149471489]: org.opendaylight.controller.cluster.common.actor.Monitor@395618ce [WARN] [03/26/2024 11:59:52.104] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#1603339473]: org.opendaylight.controller.cluster.common.actor.Monitor@63db9650 11:59:52,105 AM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1978765765] 11:59:52,105 AM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: SnapshotOffer called. 11:59:52,105 AM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Moving last applied index from -1 to -1 11:59:52,105 AM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Set currentTerm=1, votedFor=null 11:59:52,105 AM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Applying recovered snapshot 11:59:52,105 AM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config33: clearing clients {} 11:59:52,105 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config33: Created publisher actor Actor[akka://test/user/testRecovery/member-1-shard-inventory-config33-DTCL-publisher#609932007] with name member-1-shard-inventory-config33-DTCL-publisher 11:59:52,105 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: state snapshot applied in 410.3 μs 11:59:52,105 AM [test-akka.actor.default-dispatcher-13] [INFO] AbstractShardTest$1 - Recovery snapshot applied for member-1-shard-inventory-config33 in 522.1 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 11:59:52,105 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testRecovery/member-1-shard-inventory-config33-DTCL-publisher#609932007] 11:59:52,105 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config33: publishChanges: rootPath: / 11:59:52,105 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config33: Elapsed time for generation of change events for member-1-shard-inventory-config33-DTCL-publisher: 84.96 μs [WARN] [03/26/2024 11:59:52.105] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config33-DTCL-publisher#609932007]: org.opendaylight.controller.cluster.common.actor.Monitor@62abd190 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 0, size: 45 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 1, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 2, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 3, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 4, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 5, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 6, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 7, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 8, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 9, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 10, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 11, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 12, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 13, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 14, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 15, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received ReplicatedLogEntry for recovery: index: 16, size: 184 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Received apply journal entries for recovery, applying to state: 0 to 16 11:59:52,110 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: starting log recovery batch with max size 3 11:59:52,111 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendMetadata - member-1-shard-inventory-config33: Added client Enabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@2c1283a1}, purged=MutableUnsignedLongSet{size=0}} 11:59:52,111 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-41-0 11:59:52,112 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-42-0 11:59:52,112 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-43-0 11:59:52,112 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: starting log recovery batch with max size 3 11:59:52,112 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-44-0 11:59:52,113 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-45-0 11:59:52,113 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-46-0 11:59:52,113 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: starting log recovery batch with max size 3 11:59:52,114 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-47-0 11:59:52,114 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-48-0 11:59:52,114 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-49-0 11:59:52,114 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: starting log recovery batch with max size 3 11:59:52,115 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-50-0 11:59:52,115 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-51-0 11:59:52,116 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-52-0 11:59:52,116 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: starting log recovery batch with max size 3 11:59:52,116 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-53-0 11:59:52,116 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-54-0 11:59:52,117 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-55-0 11:59:52,117 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: starting log recovery batch with max size 3 11:59:52,117 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-56-0 11:59:52,117 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config33: Committed transaction member-1-ShardTransactionTest-fe-0-txn-57-0 11:59:52,118 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Moving last applied index from -1 to 16 11:59:52,118 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:52,118 AM [test-akka.actor.default-dispatcher-11] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config33: Recovery completed in 13.15 ms - Switching actor to Follower - last log index = 16, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 17 [WARN] [03/26/2024 11:59:52.118] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testRecovery]] 11:59:52,118 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,118 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config33 is no longer the leader 11:59:52,118 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from null to Follower 11:59:52,118 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33 (Follower): Received TimeoutNow - switching to Candidate 11:59:52,118 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33 (Candidate): Election: Candidate has following voting peers: [] 11:59:52,118 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Set currentTerm=2, votedFor=member-1-shard-inventory-config33 11:59:52,118 AM [test-akka.actor.default-dispatcher-11] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config33 (Candidate): Starting new election term 2 11:59:52,118 AM [test-akka.actor.default-dispatcher-11] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config33 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 11:59:52,118 AM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageAssembler - member-1-shard-inventory-config33 (Follower): Closing 11:59:52,118 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,119 AM [test-akka.actor.default-dispatcher-11] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config33 is no longer the leader 11:59:52,119 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from Follower to Candidate 11:59:52,119 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33 (Candidate): Received ElectionTimeout 11:59:52,119 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33 (Leader): Election: Leader has following peers: [] 11:59:52,119 AM [test-akka.actor.default-dispatcher-12] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config33 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 11:59:52,119 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: true, hasLeader : true 11:59:52,119 AM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: became leader with frontend state for [member-1-frontend-ShardTransactionTest] 11:59:52,119 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from Candidate to Leader 11:59:52,120 AM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - Stopping Shard member-1-shard-inventory-config33 11:59:52,120 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config33 (Leader)_slicer-id-242: Closing 11:59:52,120 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config33: Aborting 0 pending queued transactions 11:59:52,120 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config34, persistent : true 11:59:52,121 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config34 with journal batch size 3 [WARN] [03/26/2024 11:59:52.121] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.common.actor.Monitor@41d1b418 11:59:52,121 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-1501670738] 11:59:52,121 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testAbortAfterReady/member-1-shard-inventory-config34-notifier#-1770438603 created and ready for shard:member-1-shard-inventory-config34 [WARN] [03/26/2024 11:59:52.121] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-1501670738]: org.opendaylight.controller.cluster.common.actor.Monitor@26ff9156 [WARN] [03/26/2024 11:59:52.121] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config34-notifier#-1770438603]: org.opendaylight.controller.cluster.common.actor.Monitor@c3c23de 11:59:52,122 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:52,122 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config34: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:52,122 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config34: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,122 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config34 is no longer the leader 11:59:52,122 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config34 , received role change from null to Follower 11:59:52,122 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34 (Follower): Received TimeoutNow - switching to Candidate 11:59:52,122 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34 (Candidate): Election: Candidate has following voting peers: [] 11:59:52,122 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Set currentTerm=1, votedFor=member-1-shard-inventory-config34 11:59:52,122 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config34 (Candidate): Starting new election term 1 11:59:52,122 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config34 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:52,122 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config34 (Follower): Closing 11:59:52,122 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config34: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,122 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config34 is no longer the leader 11:59:52,122 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config34 , received role change from Follower to Candidate [WARN] [03/26/2024 11:59:52.122] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testAbortAfterReady]] 11:59:52,123 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34 (Candidate): Received ElectionTimeout 11:59:52,123 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34 (Leader): Election: Leader has following peers: [] 11:59:52,123 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config34 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:52,123 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config34: onLeadershipChange, isLeader: true, hasLeader : true 11:59:52,123 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: became leader with frontend state for [] 11:59:52,123 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config34 , received role change from Candidate to Leader 11:59:52,183 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:52,183 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,183 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,183 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-58-0 11:59:52,184 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: Readying Tx member-1-ShardTransactionTest-fe-0-txn-58-0 of 1 operations, client version 13 11:59:52,184 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: readying transaction member-1-ShardTransactionTest-fe-0-txn-58-0 11:59:52,184 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: transaction member-1-ShardTransactionTest-fe-0-txn-58-0 ready 11:59:52,184 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-59-0 11:59:52,184 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: Readying Tx member-1-ShardTransactionTest-fe-0-txn-59-0 of 1 operations, client version 13 11:59:52,184 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: readying transaction member-1-ShardTransactionTest-fe-0-txn-59-0 11:59:52,184 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: transaction member-1-ShardTransactionTest-fe-0-txn-59-0 ready 11:59:52,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-60-0 11:59:52,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Readying Tx member-1-ShardTransactionTest-fe-0-txn-60-0 of 1 operations, client version 13 11:59:52,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: readying transaction member-1-ShardTransactionTest-fe-0-txn-60-0 11:59:52,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: transaction member-1-ShardTransactionTest-fe-0-txn-60-0 ready 11:59:52,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-59-0 11:59:52,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: aborting queued transaction member-1-ShardTransactionTest-fe-0-txn-59-0 11:59:52,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-59-0: abort - successfulFromPrevious: [] 11:59:52,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Moving last applied index from -1 to 0 11:59:52,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:52,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config34: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2637842} is already disabled 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-58-0 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Validating transaction member-1-ShardTransactionTest-fe-0-txn-58-0 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 validated 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: canCommit for member-1-ShardTransactionTest-fe-0-txn-58-0: success 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Persisting ApplyJournalEntries with index=0 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Committing transaction member-1-ShardTransactionTest-fe-0-txn-58-0 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-58-0 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 candidate ready 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-58-0: canCommit - candidate rootPath: / 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-58-0: canCommit - messages: [] 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-58-0: preCommit - successfulFromPrevious: [] 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 prepared 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-58-0 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-58-0 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:52,186 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:52,187 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:52,187 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 submitted to persistence 11:59:52,188 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:52,188 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: Moving last applied index from 0 to 1 11:59:52,188 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: Applying state for log index 1 data Simple{size=143} 11:59:52,188 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-58-0 11:59:52,188 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-58-0: commit - successfulFromPrevious: [] 11:59:52,188 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 changing state from COMMIT_PENDING to COMMITTED 11:59:52,188 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 committed as 0, sending response to Actor[akka://test/system/testProbe-172#-2127384834] 11:59:52,188 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config34: Created publisher actor Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config34-DTCL-publisher#-1999197938] with name member-1-shard-inventory-config34-DTCL-publisher 11:59:52,189 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config34-DTCL-publisher#-1999197938] 11:59:52,189 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config34: publishChanges: rootPath: / 11:59:52,189 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-60-0 11:59:52,189 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Validating transaction member-1-ShardTransactionTest-fe-0-txn-60-0 11:59:52,189 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-60-0 validated 11:59:52,189 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-60-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:52,189 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config34: Elapsed time for generation of change events for member-1-shard-inventory-config34-DTCL-publisher: 93.87 μs 11:59:52,189 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: canCommit for member-1-ShardTransactionTest-fe-0-txn-60-0: success 11:59:52,189 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: fakeSnapshot purging log to 0 for term 1 11:59:52,189 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: Persisting ApplyJournalEntries with index=1 [WARN] [03/26/2024 11:59:52.189] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config34-DTCL-publisher#-1999197938]: org.opendaylight.controller.cluster.common.actor.Monitor@633982c5 11:59:52,189 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: Committing transaction member-1-ShardTransactionTest-fe-0-txn-60-0 11:59:52,189 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-60-0 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-60-0 candidate ready 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-60-0: canCommit - candidate rootPath: / 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-60-0: canCommit - messages: [] 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-60-0: preCommit - successfulFromPrevious: [] 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-60-0 prepared 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-60-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-60-0 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-60-0 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-60-0 submitted to persistence 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: Moving last applied index from 1 to 2 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: Applying state for log index 2 data Simple{size=45} 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config34: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-60-0 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-60-0: commit - successfulFromPrevious: [] 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-60-0 changing state from COMMIT_PENDING to COMMITTED 11:59:52,190 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: Transaction member-1-ShardTransactionTest-fe-0-txn-60-0 committed as 0, sending response to Actor[akka://test/system/testProbe-172#-2127384834] 11:59:52,191 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterReady] 11:59:52,191 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: fakeSnapshot purging log to 1 for term 1 11:59:52,191 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: Persisting ApplyJournalEntries with index=2 11:59:52,191 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config34: publishChanges: rootPath: / 11:59:52,191 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config34: Elapsed time for generation of change events for member-1-shard-inventory-config34-DTCL-publisher: 25.14 μs 11:59:52,201 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config34 11:59:52,201 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config34 (Leader)_slicer-id-244: Closing 11:59:52,201 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config34: Aborting 0 pending queued transactions 11:59:52,204 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config35, persistent : true [WARN] [03/26/2024 11:59:52.204] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false]: org.opendaylight.controller.cluster.common.actor.Monitor@85f7590 11:59:52,205 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config35-notifier#586929919 created and ready for shard:member-1-shard-inventory-config35 [WARN] [03/26/2024 11:59:52.205] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config35-notifier#586929919]: org.opendaylight.controller.cluster.common.actor.Monitor@10de34e9 11:59:52,205 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/shard-member-1:snapshot-read#-1689897631] 11:59:52,205 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config35 with journal batch size 3 [WARN] [03/26/2024 11:59:52.205] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/shard-member-1:snapshot-read#-1689897631]: org.opendaylight.controller.cluster.common.actor.Monitor@4eedf0f7 11:59:52,206 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:52,207 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config35: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:52,207 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,207 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config35 is no longer the leader 11:59:52,207 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from null to Follower 11:59:52,207 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35 (Follower): Received TimeoutNow - switching to Candidate 11:59:52,207 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35 (Candidate): Election: Candidate has following voting peers: [] 11:59:52,207 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: Set currentTerm=1, votedFor=member-1-shard-inventory-config35 11:59:52,207 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config35 (Candidate): Starting new election term 1 11:59:52,207 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config35 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:52,207 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config35 (Follower): Closing 11:59:52,207 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,207 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config35 is no longer the leader 11:59:52,207 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from Follower to Candidate [WARN] [03/26/2024 11:59:52.207] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false]] 11:59:52,208 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35 (Candidate): Received ElectionTimeout 11:59:52,208 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35 (Leader): Election: Leader has following peers: [] 11:59:52,208 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config35 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:52,208 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: true, hasLeader : true 11:59:52,208 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: became leader with frontend state for [] 11:59:52,208 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from Candidate to Leader 11:59:52,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config35: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:52,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config35: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config35: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config35: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-61-0 11:59:52,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config35: Readying Tx member-1-ShardTransactionTest-fe-0-txn-61-0 of 1 operations, client version 13 11:59:52,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: readying transaction member-1-ShardTransactionTest-fe-0-txn-61-0 11:59:52,269 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: transaction member-1-ShardTransactionTest-fe-0-txn-61-0 ready 11:59:52,269 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config35: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-61-0 11:59:52,270 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Validating transaction member-1-ShardTransactionTest-fe-0-txn-61-0 11:59:52,270 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 validated 11:59:52,270 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:52,270 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config35: canCommit for member-1-ShardTransactionTest-fe-0-txn-61-0: success 11:59:52,270 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: Committing transaction member-1-ShardTransactionTest-fe-0-txn-61-0 11:59:52,270 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-61-0 11:59:52,270 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 candidate ready 11:59:52,270 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-61-0: canCommit - candidate rootPath: / 11:59:52,270 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-61-0: canCommit - messages: [] 11:59:52,270 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-61-0: preCommit - successfulFromPrevious: [] 11:59:52,270 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 prepared 11:59:52,270 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:52,270 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-61-0 11:59:52,270 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-61-0 11:59:52,271 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:52,271 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:52,271 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:52,271 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 submitted to persistence 11:59:52,271 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,271 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: Moving last applied index from -1 to 0 11:59:52,271 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:52,271 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:52,271 AM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config35: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:52,271 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3415260} is already disabled 11:59:52,271 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: Persisting ApplyJournalEntries with index=0 11:59:52,272 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:52,272 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: Moving last applied index from 0 to 1 11:59:52,272 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: Applying state for log index 1 data Simple{size=143} 11:59:52,272 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config35: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-61-0 11:59:52,272 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-61-0: commit - successfulFromPrevious: [] 11:59:52,272 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 changing state from COMMIT_PENDING to COMMITTED 11:59:52,272 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 committed as 0, sending response to Actor[akka://test/system/testProbe-174#-1694364642] 11:59:52,272 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config35: Created publisher actor Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config35-DTCL-publisher#-1586858174] with name member-1-shard-inventory-config35-DTCL-publisher 11:59:52,272 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config35-DTCL-publisher#-1586858174] 11:59:52,273 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config35: publishChanges: rootPath: / 11:59:52,273 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: fakeSnapshot purging log to 0 for term 1 11:59:52,273 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: Persisting ApplyJournalEntries with index=1 11:59:52,273 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config35: Elapsed time for generation of change events for member-1-shard-inventory-config35-DTCL-publisher: 129.2 μs [WARN] [03/26/2024 11:59:52.273] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config35-DTCL-publisher#-1586858174]: org.opendaylight.controller.cluster.common.actor.Monitor@24e6d6a5 11:59:52,476 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false] 11:59:52,487 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Stopping Shard member-1-shard-inventory-config35 11:59:52,487 AM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageSlicer - member-1-shard-inventory-config35 (Leader)_slicer-id-246: Closing 11:59:52,487 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config35: Aborting 0 pending queued transactions 11:59:52,489 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardTest$1TestShard - Shard created : member-1-shard-inventory-config36, persistent : false [WARN] [03/26/2024 11:59:52.489] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData]: org.opendaylight.controller.cluster.common.actor.Monitor@4df6c02e 11:59:52,490 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config36-notifier#1959763126 created and ready for shard:member-1-shard-inventory-config36 [WARN] [03/26/2024 11:59:52.490] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config36-notifier#1959763126]: org.opendaylight.controller.cluster.common.actor.Monitor@441587c0 11:59:52,490 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/shard-member-1:snapshot-read#-1688605749] 11:59:52,490 AM [test-akka.actor.default-dispatcher-11] [INFO] ShardTest$1TestShard - Starting recovery for member-1-shard-inventory-config36 with journal batch size 3 [WARN] [03/26/2024 11:59:52.490] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/shard-member-1:snapshot-read#-1688605749]: org.opendaylight.controller.cluster.common.actor.Monitor@7f6dd2df 11:59:52,491 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:52,491 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:52,492 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,492 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config36 is no longer the leader [WARN] [03/26/2024 11:59:52.492] [test-akka.actor.default-dispatcher-11] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData]] 11:59:52,492 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from null to Follower 11:59:52,492 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36 (Follower): Received TimeoutNow - switching to Candidate 11:59:52,492 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36 (Candidate): Election: Candidate has following voting peers: [] 11:59:52,492 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Set currentTerm=1, votedFor=member-1-shard-inventory-config36 11:59:52,492 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36 (Candidate): Starting new election term 1 11:59:52,492 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:52,492 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config36 (Follower): Closing 11:59:52,492 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,492 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config36 is no longer the leader 11:59:52,492 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from Follower to Candidate 11:59:52,493 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36 (Candidate): Received ElectionTimeout 11:59:52,493 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36 (Leader): Election: Leader has following peers: [] 11:59:52,493 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:52,493 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: true, hasLeader : true 11:59:52,493 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: became leader with frontend state for [] 11:59:52,493 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from Candidate to Leader 11:59:52,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:52,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:52,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config36: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:52,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=54721} is already disabled 11:59:52,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-62-0 11:59:52,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Readying Tx member-1-ShardTransactionTest-fe-0-txn-62-0 of 1 operations, client version 13 11:59:52,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: readying transaction member-1-ShardTransactionTest-fe-0-txn-62-0 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: transaction member-1-ShardTransactionTest-fe-0-txn-62-0 ready 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Validating transaction member-1-ShardTransactionTest-fe-0-txn-62-0 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-62-0 validated 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-62-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: canCommit for member-1-ShardTransactionTest-fe-0-txn-62-0: success 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Committing transaction member-1-ShardTransactionTest-fe-0-txn-62-0 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-62-0 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-62-0 candidate ready 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-62-0: canCommit - candidate rootPath: / 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-62-0: canCommit - messages: [] 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-62-0: preCommit - successfulFromPrevious: [] 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-62-0 prepared 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-62-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-62-0 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-62-0 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-62-0 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-62-0: commit - successfulFromPrevious: [] 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-62-0 changing state from COMMIT_PENDING to COMMITTED 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-62-0 committed as 0, sending response to Actor[akka://test/temp/testCreateSnapshotWithNonPersistentData$g] 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config36: Created publisher actor Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config36-DTCL-publisher#400945726] with name member-1-shard-inventory-config36-DTCL-publisher 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-62-0 submitted to persistence 11:59:52,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config36-DTCL-publisher#400945726] 11:59:52,544 AM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 11:59:52,545 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: lastSequenceNumber prior to capture: -1 11:59:52,545 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config36: publishChanges: rootPath: / 11:59:52,545 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 11:59:52,545 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config36: Elapsed time for generation of change events for member-1-shard-inventory-config36-DTCL-publisher: 42.72 μs 11:59:52,545 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: CaptureSnapshotReply received by actor [WARN] [03/26/2024 11:59:52.545] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config36-DTCL-publisher#400945726]: org.opendaylight.controller.cluster.common.actor.Monitor@32d7865b 11:59:52,545 AM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@4f372c37, electionTerm=1, electionVotedFor=member-1-shard-inventory-config36, ServerConfigPayload=null] 11:59:52,545 AM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 11:59:52,545 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Snapshot success - sequence number: -1 11:59:52,545 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: SnapshotComplete received 11:59:52,545 AM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 11:59:52,545 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: lastSequenceNumber prior to capture: -1 11:59:52,545 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 11:59:52,545 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: CaptureSnapshotReply received by actor 11:59:52,545 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@258e40b1, electionTerm=1, electionVotedFor=member-1-shard-inventory-config36, ServerConfigPayload=null] 11:59:52,545 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config36: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 11:59:52,546 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Snapshot success - sequence number: -1 11:59:52,546 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: SnapshotComplete received 11:59:52,546 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData] 11:59:52,556 AM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1TestShard - Stopping Shard member-1-shard-inventory-config36 11:59:52,556 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config36 (Leader)_slicer-id-248: Closing 11:59:52,557 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config36: Aborting 0 pending queued transactions 11:59:52,559 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config37, persistent : true [WARN] [03/26/2024 11:59:52.559] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.common.actor.Monitor@66158709 11:59:52,559 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testFollowerInitialSyncStatus/member-1-shard-inventory-config37-notifier#826633836 created and ready for shard:member-1-shard-inventory-config37 [WARN] [03/26/2024 11:59:52.559] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testFollowerInitialSyncStatus/member-1-shard-inventory-config37-notifier#826633836]: org.opendaylight.controller.cluster.common.actor.Monitor@6aee735a 11:59:52,560 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testFollowerInitialSyncStatus/shard-member-1:snapshot-read#1022560036] [WARN] [03/26/2024 11:59:52.560] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testFollowerInitialSyncStatus/shard-member-1:snapshot-read#1022560036]: org.opendaylight.controller.cluster.common.actor.Monitor@401a2d10 11:59:52,560 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config37 with journal batch size 3 11:59:52,561 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:52,561 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config37: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:52,561 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,561 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config37 is no longer the leader 11:59:52,561 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from null to Follower 11:59:52,561 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37 (Follower): Received TimeoutNow - switching to Candidate [WARN] [03/26/2024 11:59:52.561] [test-akka.actor.default-dispatcher-15] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testFollowerInitialSyncStatus]] 11:59:52,561 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37 (Candidate): Election: Candidate has following voting peers: [] 11:59:52,561 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37: Set currentTerm=1, votedFor=member-1-shard-inventory-config37 11:59:52,561 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config37 (Candidate): Starting new election term 1 11:59:52,561 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config37 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:52,561 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config37 (Follower): Closing 11:59:52,561 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,561 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config37 is no longer the leader 11:59:52,562 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from Follower to Candidate 11:59:52,562 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37 (Candidate): Received ElectionTimeout 11:59:52,562 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37 (Leader): Election: Leader has following peers: [] 11:59:52,562 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config37 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:52,562 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: true, hasLeader : true 11:59:52,562 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37: became leader with frontend state for [] 11:59:52,562 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from Candidate to Leader 11:59:52,659 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testFollowerInitialSyncStatus] [WARN] [03/26/2024 11:59:52.659] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@d083eb1 [WARN] [03/26/2024 11:59:52.659] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@1cebe0ad 11:59:52,670 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config37 11:59:52,670 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config37 (Leader)_slicer-id-250: Closing 11:59:52,670 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37: Aborting 0 pending queued transactions 11:59:52,674 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#1653165128] [WARN] [03/26/2024 11:59:52.675] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#1653165128]: org.opendaylight.controller.cluster.common.actor.Monitor@46808971 11:59:52,676 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1$1 - Shard created : member-1-shard-inventory-config38, persistent : true [WARN] [03/26/2024 11:59:52.676] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]: org.opendaylight.controller.cluster.common.actor.Monitor@ccadca5 11:59:52,677 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config38-notifier#511005574 created and ready for shard:member-1-shard-inventory-config38 [WARN] [03/26/2024 11:59:52.677] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config38-notifier#511005574]: org.opendaylight.controller.cluster.common.actor.Monitor@7555ef14 11:59:52,677 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/shard-member-1:snapshot-read#748049490] [WARN] [03/26/2024 11:59:52.677] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/shard-member-1:snapshot-read#748049490]: org.opendaylight.controller.cluster.common.actor.Monitor@1525ec4 11:59:52,677 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1$1 - Starting recovery for member-1-shard-inventory-config38 with journal batch size 3 11:59:52,678 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1978765765] 11:59:52,678 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: SnapshotOffer called. 11:59:52,678 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: Moving last applied index from -1 to -1 11:59:52,678 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: Set currentTerm=1, votedFor=null 11:59:52,678 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: Applying recovered snapshot 11:59:52,678 AM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config38: clearing clients {} 11:59:52,679 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config38: Created publisher actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config38-DTCL-publisher#2105742539] with name member-1-shard-inventory-config38-DTCL-publisher 11:59:52,679 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config38-DTCL-publisher#2105742539] 11:59:52,679 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: state snapshot applied in 628.8 μs 11:59:52,679 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1$1 - Recovery snapshot applied for member-1-shard-inventory-config38 in 741.8 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 11:59:52,679 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config38: publishChanges: rootPath: / [WARN] [03/26/2024 11:59:52.679] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config38-DTCL-publisher#2105742539]: org.opendaylight.controller.cluster.common.actor.Monitor@72bb5b5d 11:59:52,679 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config38: Elapsed time for generation of change events for member-1-shard-inventory-config38-DTCL-publisher: 118.5 μs 11:59:52,680 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:52,680 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1$1 - member-1-shard-inventory-config38: Recovery completed in 1.339 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:52,680 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,680 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config38 is no longer the leader 11:59:52,680 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from null to Follower 11:59:52,680 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38 (Follower): Received TimeoutNow - switching to Candidate 11:59:52,680 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38 (Candidate): Election: Candidate has following voting peers: [] 11:59:52,680 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: Set currentTerm=2, votedFor=member-1-shard-inventory-config38 11:59:52,680 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1$1 - member-1-shard-inventory-config38 (Candidate): Starting new election term 2 11:59:52,680 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1$1 - member-1-shard-inventory-config38 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 11:59:52,680 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config38 (Follower): Closing 11:59:52,680 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,680 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config38 is no longer the leader 11:59:52,680 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from Follower to Candidate [WARN] [03/26/2024 11:59:52.680] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 11:59:52,692 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#1653165128]], isLeader: false, hasLeader: false 11:59:52,692 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: Shard does not have a leader - delaying registration 11:59:52,692 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a 11:59:52,692 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a#1902128559] [WARN] [03/26/2024 11:59:52.692] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a#1902128559]: org.opendaylight.controller.cluster.common.actor.Monitor@7c3ccf08 11:59:52,692 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38 (Candidate): Received ElectionTimeout 11:59:52,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38 (Leader): Election: Leader has following peers: [] 11:59:52,693 AM [test-akka.actor.default-dispatcher-15] [INFO] ShardTest$1$1 - member-1-shard-inventory-config38 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 11:59:52,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: true, hasLeader : true 11:59:52,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 11:59:52,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config38: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@be1c032 11:59:52,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config38: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]], initialState present=true] to publisher actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config38-DTCL-publisher#2105742539] 11:59:52,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config38: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]], initialState present=true] 11:59:52,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config38: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 11:59:52,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: became leader with frontend state for [] 11:59:52,693 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from Candidate to Leader 11:59:52,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config38: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 11:59:52,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)] 11:59:52,693 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config38: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 11:59:52,693 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config38: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@be1c032 11:59:52,693 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#1653165128] 11:59:52,704 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration] 11:59:52,705 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1$1 - Stopping Shard member-1-shard-inventory-config38 11:59:52,705 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config38 (Leader)_slicer-id-252: Closing 11:59:52,705 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config38: Aborting 0 pending queued transactions 11:59:52,707 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config39, persistent : true [WARN] [03/26/2024 11:59:52.707] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@90dd369 11:59:52,708 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config39-notifier#642888666 created and ready for shard:member-1-shard-inventory-config39 [WARN] [03/26/2024 11:59:52.708] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config39-notifier#642888666]: org.opendaylight.controller.cluster.common.actor.Monitor@6ca3d73c 11:59:52,709 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/shard-member-1:snapshot-read#2129526051] [WARN] [03/26/2024 11:59:52.709] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/shard-member-1:snapshot-read#2129526051]: org.opendaylight.controller.cluster.common.actor.Monitor@23e5515a 11:59:52,709 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config39 with journal batch size 3 11:59:52,710 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:52,710 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config39: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:52,710 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,710 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config39 is no longer the leader 11:59:52,710 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from null to Follower 11:59:52,711 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39 (Follower): Received TimeoutNow - switching to Candidate 11:59:52,711 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39 (Candidate): Election: Candidate has following voting peers: [] 11:59:52,711 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Set currentTerm=1, votedFor=member-1-shard-inventory-config39 11:59:52,711 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config39 (Candidate): Starting new election term 1 11:59:52,711 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config39 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:52,711 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config39 (Follower): Closing 11:59:52,711 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,711 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config39 is no longer the leader 11:59:52,711 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from Follower to Candidate 11:59:52,711 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config39 (Candidate): Received ElectionTimeout [WARN] [03/26/2024 11:59:52.711] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit]] 11:59:52,711 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config39 (Leader): Election: Leader has following peers: [] 11:59:52,711 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config39 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:52,711 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: true, hasLeader : true 11:59:52,712 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config39: became leader with frontend state for [] 11:59:52,712 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from Candidate to Leader 11:59:52,819 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-63-0 11:59:52,819 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:52,819 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,819 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,819 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-63-0 11:59:52,819 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Validating transaction member-1-ShardTransactionTest-fe-0-txn-63-0 11:59:52,819 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 validated 11:59:52,819 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:52,819 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: canCommit for member-1-ShardTransactionTest-fe-0-txn-63-0: success 11:59:52,819 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Committing transaction member-1-ShardTransactionTest-fe-0-txn-63-0 11:59:52,819 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-63-0 11:59:52,820 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 candidate ready 11:59:52,820 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-63-0: canCommit - candidate rootPath: / 11:59:52,820 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-63-0: canCommit - messages: [] 11:59:52,820 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-63-0: preCommit - successfulFromPrevious: [] 11:59:52,820 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 prepared 11:59:52,820 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:52,820 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-63-0 11:59:52,820 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-63-0 11:59:52,820 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 11:59:52,820 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 11:59:52,820 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 11:59:52,820 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 submitted to persistence 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Moving last applied index from -1 to 0 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config39: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2351445} is already disabled 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Moving last applied index from 0 to 1 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Applying state for log index 1 data Simple{size=175} 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-63-0 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-63-0: commit - successfulFromPrevious: [] 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 changing state from COMMIT_PENDING to COMMITTED 11:59:52,821 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 committed as 0, sending response to Actor[akka://test/system/testProbe-180#425764749] 11:59:52,822 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit] 11:59:52,822 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config39: Created publisher actor Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config39-DTCL-publisher#-695312722] with name member-1-shard-inventory-config39-DTCL-publisher 11:59:52,822 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config39-DTCL-publisher#-695312722] 11:59:52,822 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: fakeSnapshot purging log to 0 for term 1 11:59:52,822 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Persisting ApplyJournalEntries with index=0 11:59:52,822 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config39: Persisting ApplyJournalEntries with index=1 11:59:52,822 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config39: publishChanges: rootPath: / 11:59:52,822 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config39: Elapsed time for generation of change events for member-1-shard-inventory-config39-DTCL-publisher: 89.43 μs [WARN] [03/26/2024 11:59:52.822] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config39-DTCL-publisher#-695312722]: org.opendaylight.controller.cluster.common.actor.Monitor@130b4326 11:59:52,832 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config39 11:59:52,832 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config39 (Leader)_slicer-id-254: Closing 11:59:52,832 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Aborting 0 pending queued transactions 11:59:52,835 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config40, persistent : true 11:59:52,836 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config40 with journal batch size 3 [WARN] [03/26/2024 11:59:52.836] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain#-1736367848]: org.opendaylight.controller.cluster.common.actor.Monitor@20eb65ee 11:59:52,836 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testCreateTransactionOnChain/member-1-shard-inventory-config40-notifier#-1489405426 created and ready for shard:member-1-shard-inventory-config40 11:59:52,836 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateTransactionOnChain/shard-member-1:snapshot-read#-1184264343] [WARN] [03/26/2024 11:59:52.837] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/member-1-shard-inventory-config40-notifier#-1489405426]: org.opendaylight.controller.cluster.common.actor.Monitor@504105ef [WARN] [03/26/2024 11:59:52.837] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/shard-member-1:snapshot-read#-1184264343]: org.opendaylight.controller.cluster.common.actor.Monitor@6dc9945e 11:59:52,838 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:52,838 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config40: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:52,838 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,838 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config40 is no longer the leader [WARN] [03/26/2024 11:59:52.838] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=Actor[akka://test/user/testCreateTransactionOnChain#-1736367848]] 11:59:52,838 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from null to Follower 11:59:52,839 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40 (Follower): Received TimeoutNow - switching to Candidate 11:59:52,839 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40 (Candidate): Election: Candidate has following voting peers: [] 11:59:52,839 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Set currentTerm=1, votedFor=member-1-shard-inventory-config40 11:59:52,839 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config40 (Candidate): Starting new election term 1 11:59:52,839 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config40 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:52,839 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config40 (Follower): Closing 11:59:52,839 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,839 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config40 is no longer the leader 11:59:52,839 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from Follower to Candidate 11:59:52,845 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40 (Candidate): Received ElectionTimeout 11:59:52,845 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40 (Leader): Election: Leader has following peers: [] 11:59:52,845 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config40 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:52,845 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: true, hasLeader : true 11:59:52,845 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config40: became leader with frontend state for [] 11:59:52,845 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from Candidate to Leader 11:59:52,899 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:52,899 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,899 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,900 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Creating transaction : member-1-ShardTransactionTest-fe-0-txn-64-0 11:59:52,901 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testCreateTransactionOnChain/shard-inventory-member-1:ShardTransactionTest@0:64_3#-1619970947] 11:59:52,901 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testCreateTransactionOnChain#-1736367848] [WARN] [03/26/2024 11:59:52.901] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/shard-inventory-member-1:ShardTransactionTest@0:64_3#-1619970947]: org.opendaylight.controller.cluster.common.actor.Monitor@373f139b 11:59:52,901 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:52,901 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Moving last applied index from -1 to 0 11:59:52,901 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:52,901 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:52,901 AM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config40: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:52,901 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1937745} is already disabled 11:59:52,901 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Persisting ApplyJournalEntries with index=0 11:59:52,912 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config40 11:59:52,912 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config40 (Leader)_slicer-id-256: Closing 11:59:52,912 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Aborting 0 pending queued transactions 11:59:52,913 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config41, persistent : true [WARN] [03/26/2024 11:59:52.913] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRegisterDataTreeChangeListener]: org.opendaylight.controller.cluster.common.actor.Monitor@3c3379f8 11:59:52,914 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-notifier#-1288044005 created and ready for shard:member-1-shard-inventory-config41 [WARN] [03/26/2024 11:59:52.914] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-notifier#-1288044005]: org.opendaylight.controller.cluster.common.actor.Monitor@2ce39e34 11:59:52,914 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/shard-member-1:snapshot-read#-1007464243] [WARN] [03/26/2024 11:59:52.915] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/shard-member-1:snapshot-read#-1007464243]: org.opendaylight.controller.cluster.common.actor.Monitor@232002f1 11:59:52,915 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config41 with journal batch size 3 11:59:52,916 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:52,916 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config41: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:52,916 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,916 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config41 is no longer the leader 11:59:52,916 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from null to Follower 11:59:52,917 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41 (Follower): Received TimeoutNow - switching to Candidate 11:59:52,917 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41 (Candidate): Election: Candidate has following voting peers: [] 11:59:52,917 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: Set currentTerm=1, votedFor=member-1-shard-inventory-config41 [WARN] [03/26/2024 11:59:52.917] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 11:59:52,917 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config41 (Candidate): Starting new election term 1 11:59:52,917 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config41 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:52,917 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config41 (Follower): Closing 11:59:52,917 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: false, hasLeader : false 11:59:52,917 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config41: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config41 is no longer the leader 11:59:52,917 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from Follower to Candidate 11:59:52,918 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41 (Candidate): Received ElectionTimeout 11:59:52,918 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41 (Leader): Election: Leader has following peers: [] 11:59:52,918 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config41 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:52,918 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: true, hasLeader : true 11:59:52,918 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: became leader with frontend state for [] 11:59:52,918 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from Candidate to Leader 11:59:53,15 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#934616179] [WARN] [03/26/2024 11:59:53.015] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#934616179]: org.opendaylight.controller.cluster.common.actor.Monitor@1a05db8c 11:59:53,26 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#934616179]], isLeader: true, hasLeader: true 11:59:53,26 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/$a#1341002188] 11:59:53,26 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test [WARN] [03/26/2024 11:59:53.026] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/$a#1341002188]: org.opendaylight.controller.cluster.common.actor.Monitor@3961c3c9 11:59:53,27 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config41: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@60c46fb7 11:59:53,27 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config41: Created publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-DTCL-publisher#-1653412510] with name member-1-shard-inventory-config41-DTCL-publisher 11:59:53,27 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config41: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] to publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-DTCL-publisher#-1653412510] 11:59:53,27 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-DTCL-publisher#-1653412510] 11:59:53,27 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testRegisterDataTreeChangeListener/$a 11:59:53,27 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config41: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] 11:59:53,27 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] [WARN] [03/26/2024 11:59:53.027] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-DTCL-publisher#-1653412510]: org.opendaylight.controller.cluster.common.actor.Monitor@5bff9805 11:59:53,27 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ForwardingDataTreeChangeListener - Sending OnInitialData to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] 11:59:53,27 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 11:59:53,27 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config41: Notifying onInitialData to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@60c46fb7 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-65-0 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Readying Tx member-1-ShardTransactionTest-fe-0-txn-65-0 of 1 operations, client version 13 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: readying transaction member-1-ShardTransactionTest-fe-0-txn-65-0 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: transaction member-1-ShardTransactionTest-fe-0-txn-65-0 ready 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Validating transaction member-1-ShardTransactionTest-fe-0-txn-65-0 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-65-0 validated 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-65-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: canCommit for member-1-ShardTransactionTest-fe-0-txn-65-0: success 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Committing transaction member-1-ShardTransactionTest-fe-0-txn-65-0 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-65-0 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-65-0 candidate ready 11:59:53,28 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-65-0: canCommit - candidate rootPath: / 11:59:53,29 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-65-0: canCommit - messages: [] 11:59:53,29 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-65-0: preCommit - successfulFromPrevious: [] 11:59:53,29 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-65-0 prepared 11:59:53,29 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-65-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:53,29 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-65-0 11:59:53,29 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-65-0 11:59:53,29 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:53,29 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:53,29 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:53,29 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-65-0 submitted to persistence 11:59:53,29 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:53,29 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Moving last applied index from -1 to 0 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config41: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1957416} is already disabled 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Moving last applied index from 0 to 1 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Applying state for log index 1 data Simple{size=143} 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-65-0 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-65-0: commit - successfulFromPrevious: [] 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-65-0 changing state from COMMIT_PENDING to COMMITTED 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-65-0 committed as 0, sending response to Actor[akka://test/temp/testRegisterDataTreeChangeListener$h] 11:59:53,30 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: publishChanges: rootPath: / 11:59:53,30 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: fakeSnapshot purging log to 0 for term 1 11:59:53,30 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Persisting ApplyJournalEntries with index=0 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config41: Persisting ApplyJournalEntries with index=1 11:59:53,30 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config41: Elapsed time for generation of change events for member-1-shard-inventory-config41-DTCL-publisher: 270.1 μs 11:59:53,30 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config41: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@60c46fb7 11:59:53,31 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#-1919609599] [WARN] [03/26/2024 11:59:53.031] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#-1919609599]: org.opendaylight.controller.cluster.common.actor.Monitor@7ff9c75a 11:59:53,32 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#-1919609599]], isLeader: true, hasLeader: true 11:59:53,32 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/$b#1575028114] 11:59:53,32 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test [WARN] [03/26/2024 11:59:53.032] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/$b#1575028114]: org.opendaylight.controller.cluster.common.actor.Monitor@6da5b92d 11:59:53,32 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config41: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] to publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config41-DTCL-publisher#-1653412510] 11:59:53,32 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config41: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@68459827 11:59:53,32 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testRegisterDataTreeChangeListener/$b 11:59:53,32 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config41: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] 11:59:53,32 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 11:59:53,32 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 11:59:53,32 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)] 11:59:53,33 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 11:59:53,33 AM [test-akka.actor.default-dispatcher-11] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config41: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@68459827 11:59:53,533 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testRegisterDataTreeChangeListener] 11:59:53,544 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config41 11:59:53,544 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config41 (Leader)_slicer-id-258: Closing 11:59:53,544 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config41: Aborting 0 pending queued transactions 11:59:53,545 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#934616179] 11:59:53,545 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#-1919609599] 11:59:53,547 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener8#1656674878] [WARN] [03/26/2024 11:59:53.547] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener8#1656674878]: org.opendaylight.controller.cluster.common.actor.Monitor@4163f57f 11:59:53,550 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Shard created : member-1-shard-inventory-config42, persistent : true [WARN] [03/26/2024 11:59:53.550] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9]: org.opendaylight.controller.cluster.common.actor.Monitor@7950d2ff 11:59:53,551 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config42-notifier#-840682777 created and ready for shard:member-1-shard-inventory-config42 [WARN] [03/26/2024 11:59:53.551] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config42-notifier#-840682777]: org.opendaylight.controller.cluster.common.actor.Monitor@4f422708 11:59:53,551 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/shard-member-1:snapshot-read#1158309141] [WARN] [03/26/2024 11:59:53.551] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/shard-member-1:snapshot-read#1158309141]: org.opendaylight.controller.cluster.common.actor.Monitor@601654f9 11:59:53,551 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Starting recovery for member-1-shard-inventory-config42 with journal batch size 3 11:59:53,552 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config42: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1978765765] 11:59:53,552 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config42: SnapshotOffer called. 11:59:53,552 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config42: Moving last applied index from -1 to -1 11:59:53,552 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config42: Set currentTerm=1, votedFor=null 11:59:53,552 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config42: Applying recovered snapshot 11:59:53,552 AM [test-akka.actor.default-dispatcher-11] [DEBUG] FrontendMetadata - member-1-shard-inventory-config42: clearing clients {} 11:59:53,553 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config42: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config42-DTCL-publisher#1015011332] with name member-1-shard-inventory-config42-DTCL-publisher 11:59:53,553 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config42-DTCL-publisher#1015011332] 11:59:53,553 AM [test-akka.actor.default-dispatcher-11] [DEBUG] ShardDataTree - member-1-shard-inventory-config42: state snapshot applied in 773.6 μs 11:59:53,553 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Recovery snapshot applied for member-1-shard-inventory-config42 in 895.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 11:59:53,553 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config42: publishChanges: rootPath: / 11:59:53,553 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config42: Elapsed time for generation of change events for member-1-shard-inventory-config42-DTCL-publisher: 120.9 μs [WARN] [03/26/2024 11:59:53.553] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config42-DTCL-publisher#1015011332]: org.opendaylight.controller.cluster.common.actor.Monitor@326f02b6 11:59:53,554 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:53,554 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config42: Recovery completed in 1.770 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:53,554 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: false, hasLeader : false 11:59:53,554 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config42 is no longer the leader 11:59:53,554 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from null to Follower 11:59:53,554 AM [test-akka.actor.default-dispatcher-12] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [03/26/2024 11:59:53.554] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9]] 11:59:53,660 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener8#1656674878]], isLeader: false, hasLeader: false 11:59:53,660 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: Shard does not have a leader - delaying registration 11:59:53,660 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/$a 11:59:53,660 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/$a#320313492] [WARN] [03/26/2024 11:59:53.660] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/$a#320313492]: org.opendaylight.controller.cluster.common.actor.Monitor@6ff8e58 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig null 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: Re-initializing to Follower with previous leaderId null 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config42 (Follower): Closing 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: false, hasLeader : false 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config42 is no longer the leader 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42 (Follower): Received TimeoutNow - switching to Candidate 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42 (Candidate): Election: Candidate has following voting peers: [] 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: Set currentTerm=2, votedFor=member-1-shard-inventory-config42 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config42 (Candidate): Starting new election term 2 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config42 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config42 (Follower): Closing 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: false, hasLeader : false 11:59:53,661 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config42: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config42 is no longer the leader 11:59:53,661 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from Follower to Candidate 11:59:53,662 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config42 (Candidate): Received ElectionTimeout 11:59:53,662 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config42 (Leader): Election: Leader has following peers: [] 11:59:53,662 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config42 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 11:59:53,662 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: true, hasLeader : true 11:59:53,662 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config42: became leader with frontend state for [] 11:59:53,662 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from Candidate to Leader 11:59:54,161 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener8#1656674878] 11:59:54,172 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9] 11:59:54,173 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Stopping Shard member-1-shard-inventory-config42 11:59:54,173 AM [test-akka.actor.default-dispatcher-11] [DEBUG] MessageSlicer - member-1-shard-inventory-config42 (Leader)_slicer-id-260: Closing 11:59:54,173 AM [test-akka.actor.default-dispatcher-11] [DEBUG] Shard - member-1-shard-inventory-config42: Aborting 0 pending queued transactions 11:59:54,175 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Shard created : member-1-shard-inventory-config43, persistent : true [WARN] [03/26/2024 11:59:54.175] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@7b95c1 11:59:54,177 AM [test-akka.actor.default-dispatcher-11] [INFO] Shard - Starting recovery for member-1-shard-inventory-config43 with journal batch size 3 11:59:54,177 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/shard-member-1:snapshot-read#-351798362] 11:59:54,177 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config43-notifier#1267936515 created and ready for shard:member-1-shard-inventory-config43 [WARN] [03/26/2024 11:59:54.177] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config43-notifier#1267936515]: org.opendaylight.controller.cluster.common.actor.Monitor@1a2a3abc [WARN] [03/26/2024 11:59:54.177] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/shard-member-1:snapshot-read#-351798362]: org.opendaylight.controller.cluster.common.actor.Monitor@1a7a2252 11:59:54,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:54,178 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config43: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:54,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: false, hasLeader : false 11:59:54,178 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config43 is no longer the leader [WARN] [03/26/2024 11:59:54.179] [test-akka.actor.default-dispatcher-11] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit]] 11:59:54,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43 (Follower): Received TimeoutNow - switching to Candidate 11:59:54,179 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from null to Follower 11:59:54,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43 (Candidate): Election: Candidate has following voting peers: [] 11:59:54,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Set currentTerm=1, votedFor=member-1-shard-inventory-config43 11:59:54,179 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config43 (Candidate): Starting new election term 1 11:59:54,179 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config43 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:54,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config43 (Follower): Closing 11:59:54,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: false, hasLeader : false 11:59:54,179 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config43 is no longer the leader 11:59:54,179 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from Follower to Candidate 11:59:54,179 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config43 (Candidate): Received ElectionTimeout 11:59:54,179 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config43 (Leader): Election: Leader has following peers: [] 11:59:54,179 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config43 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:54,179 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: true, hasLeader : true 11:59:54,179 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config43: became leader with frontend state for [] 11:59:54,179 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from Candidate to Leader 11:59:54,241 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-66-0 11:59:54,241 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:54,241 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:54,241 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:54,241 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-66-0 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-66-0 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Validating transaction member-1-ShardTransactionTest-fe-0-txn-66-0 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 validated 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: canCommit for member-1-ShardTransactionTest-fe-0-txn-66-0: success 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Committing transaction member-1-ShardTransactionTest-fe-0-txn-66-0 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-66-0 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 candidate ready 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-66-0: canCommit - candidate rootPath: / 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-66-0: canCommit - messages: [] 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-66-0: preCommit - successfulFromPrevious: [] 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 prepared 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-66-0 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-66-0 11:59:54,242 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 submitted to persistence 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Moving last applied index from -1 to 0 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config43: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1839224} is already disabled 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Persisting ApplyJournalEntries with index=0 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Moving last applied index from 0 to 1 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Applying state for log index 1 data Simple{size=175} 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-66-0 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-66-0: commit - successfulFromPrevious: [] 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 changing state from COMMIT_PENDING to COMMITTED 11:59:54,243 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 committed as 0, sending response to Actor[akka://test/system/testProbe-188#-2117294557] 11:59:54,244 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config43: Created publisher actor Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config43-DTCL-publisher#-1617507178] with name member-1-shard-inventory-config43-DTCL-publisher 11:59:54,244 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config43-DTCL-publisher#-1617507178] 11:59:54,244 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: fakeSnapshot purging log to 0 for term 1 11:59:54,244 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config43: Persisting ApplyJournalEntries with index=1 11:59:54,244 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config43: publishChanges: rootPath: / 11:59:54,244 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit] [WARN] [03/26/2024 11:59:54.244] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config43-DTCL-publisher#-1617507178]: org.opendaylight.controller.cluster.common.actor.Monitor@3b138e10 11:59:54,244 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config43: Elapsed time for generation of change events for member-1-shard-inventory-config43-DTCL-publisher: 210.5 μs 11:59:54,255 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Stopping Shard member-1-shard-inventory-config43 11:59:54,255 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageSlicer - member-1-shard-inventory-config43 (Leader)_slicer-id-262: Closing 11:59:54,255 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config43: Aborting 0 pending queued transactions 11:59:54,257 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Shard created : member-1-shard-inventory-config44, persistent : true [WARN] [03/26/2024 11:59:54.257] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry]: org.opendaylight.controller.cluster.common.actor.Monitor@2ddaddb3 11:59:54,259 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - Starting recovery for member-1-shard-inventory-config44 with journal batch size 3 11:59:54,259 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config44-notifier#-23045478 created and ready for shard:member-1-shard-inventory-config44 11:59:54,259 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/shard-member-1:snapshot-read#-715328331] [WARN] [03/26/2024 11:59:54.259] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config44-notifier#-23045478]: org.opendaylight.controller.cluster.common.actor.Monitor@2dc8221b [WARN] [03/26/2024 11:59:54.259] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/shard-member-1:snapshot-read#-715328331]: org.opendaylight.controller.cluster.common.actor.Monitor@7360cb81 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config44: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: false, hasLeader : false 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config44 is no longer the leader 11:59:54,261 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from null to Follower 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44 (Follower): Received TimeoutNow - switching to Candidate 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44 (Candidate): Election: Candidate has following voting peers: [] 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: Set currentTerm=1, votedFor=member-1-shard-inventory-config44 [WARN] [03/26/2024 11:59:54.261] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry]] 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config44 (Candidate): Starting new election term 1 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config44 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config44 (Follower): Closing 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: false, hasLeader : false 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config44: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config44 is no longer the leader 11:59:54,261 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from Follower to Candidate 11:59:54,262 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44 (Candidate): Received ElectionTimeout 11:59:54,262 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44 (Leader): Election: Leader has following peers: [] 11:59:54,262 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config44 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:54,262 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: true, hasLeader : true 11:59:54,262 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: became leader with frontend state for [] 11:59:54,262 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from Candidate to Leader 11:59:54,368 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:54,368 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:54,368 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:54,369 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-67-0 11:59:54,369 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: Readying Tx member-1-ShardTransactionTest-fe-0-txn-67-0 of 1 operations, client version 13 11:59:54,369 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: readying transaction member-1-ShardTransactionTest-fe-0-txn-67-0 11:59:54,369 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: transaction member-1-ShardTransactionTest-fe-0-txn-67-0 ready 11:59:54,369 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-67-0 11:59:54,369 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Validating transaction member-1-ShardTransactionTest-fe-0-txn-67-0 11:59:54,369 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 validated 11:59:54,369 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:54,369 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: canCommit for member-1-ShardTransactionTest-fe-0-txn-67-0: success 11:59:54,369 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-68-0 11:59:54,370 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: Readying Tx member-1-ShardTransactionTest-fe-0-txn-68-0 of 1 operations, client version 13 11:59:54,370 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: readying transaction member-1-ShardTransactionTest-fe-0-txn-68-0 11:59:54,370 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: transaction member-1-ShardTransactionTest-fe-0-txn-68-0 ready 11:59:54,370 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:54,370 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from -1 to 0 11:59:54,370 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:54,370 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:54,370 AM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config44: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:54,370 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1554667} is already disabled 11:59:54,370 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=0 11:59:54,370 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-69-0 11:59:54,370 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-69-0 11:59:54,370 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Tx member-1-ShardTransactionTest-fe-0-txn-69-0 is scheduled for canCommit step 11:59:54,370 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Committing transaction member-1-ShardTransactionTest-fe-0-txn-67-0 11:59:54,370 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-67-0 11:59:54,371 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 candidate ready 11:59:54,371 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-67-0: canCommit - candidate rootPath: / 11:59:54,371 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-67-0: canCommit - messages: [] 11:59:54,371 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-67-0: preCommit - successfulFromPrevious: [] 11:59:54,371 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 prepared 11:59:54,371 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:54,371 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-67-0 11:59:54,371 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-67-0 11:59:54,371 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 11:59:54,371 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:54,371 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:54,371 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 submitted to persistence 11:59:54,379 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 11:59:54,379 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from 0 to 1 11:59:54,379 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 1 data Simple{size=143} 11:59:54,379 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-67-0 11:59:54,379 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-67-0: commit - successfulFromPrevious: [] 11:59:54,379 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 changing state from COMMIT_PENDING to COMMITTED 11:59:54,379 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 committed as 0, sending response to Actor[akka://test/system/testProbe-190#-394856811] 11:59:54,379 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config44: Created publisher actor Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config44-DTCL-publisher#-1885287854] with name member-1-shard-inventory-config44-DTCL-publisher 11:59:54,379 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config44-DTCL-publisher#-1885287854] 11:59:54,379 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: fakeSnapshot purging log to 0 for term 1 11:59:54,379 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=1 11:59:54,380 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config44: publishChanges: rootPath: / 11:59:54,380 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config44: Elapsed time for generation of change events for member-1-shard-inventory-config44-DTCL-publisher: 102.3 μs [WARN] [03/26/2024 11:59:54.380] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config44-DTCL-publisher#-1885287854]: org.opendaylight.controller.cluster.common.actor.Monitor@196f3e7d 11:59:54,935 AM [test-akka.actor.default-dispatcher-12] [WARN] ShardDataTree - member-1-shard-inventory-config44: Current transaction member-1-ShardTransactionTest-fe-0-txn-68-0 has timed out after 565 ms in state READY 11:59:54,935 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Validating transaction member-1-ShardTransactionTest-fe-0-txn-69-0 11:59:54,935 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 validated 11:59:54,935 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:54,935 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: canCommit for member-1-ShardTransactionTest-fe-0-txn-69-0: success 11:59:54,935 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Committing transaction member-1-ShardTransactionTest-fe-0-txn-69-0 11:59:54,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-69-0 11:59:54,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 candidate ready 11:59:54,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-69-0: canCommit - candidate rootPath: / 11:59:54,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-69-0: canCommit - messages: [] 11:59:54,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-69-0: preCommit - successfulFromPrevious: [] 11:59:54,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 prepared 11:59:54,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 11:59:54,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-69-0 11:59:54,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-69-0 11:59:54,936 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 144 11:59:54,937 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=144}] 11:59:54,937 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=144}] 11:59:54,937 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 submitted to persistence 11:59:54,938 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=144}] 11:59:54,938 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from 1 to 2 11:59:54,938 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 2 data Simple{size=144} 11:59:54,939 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-69-0 11:59:54,939 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-69-0: commit - successfulFromPrevious: [] 11:59:54,939 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 changing state from COMMIT_PENDING to COMMITTED 11:59:54,939 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 committed as 0, sending response to Actor[akka://test/system/testProbe-190#-394856811] 11:59:54,939 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config44: publishChanges: rootPath: / 11:59:54,939 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config44: Elapsed time for generation of change events for member-1-shard-inventory-config44-DTCL-publisher: 174.2 μs 11:59:54,939 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: fakeSnapshot purging log to 1 for term 1 11:59:54,939 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=2 11:59:54,939 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry] 11:59:54,950 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config44 11:59:54,950 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config44 (Leader)_slicer-id-264: Closing 11:59:54,951 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Aborting 0 pending queued transactions 11:59:54,955 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config45, persistent : true 11:59:54,956 AM [test-akka.actor.default-dispatcher-15] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.73:25520/user/testPreCommitPhaseFailure/member-1-shard-inventory-config45-notifier#1626721383 created and ready for shard:member-1-shard-inventory-config45 11:59:54,956 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPreCommitPhaseFailure/shard-member-1:snapshot-read#-1895653259] 11:59:54,956 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config45 with journal batch size 3 [WARN] [03/26/2024 11:59:54.955] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPreCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@284d982c [WARN] [03/26/2024 11:59:54.956] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPreCommitPhaseFailure/member-1-shard-inventory-config45-notifier#1626721383]: org.opendaylight.controller.cluster.common.actor.Monitor@316f338e [WARN] [03/26/2024 11:59:54.957] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPreCommitPhaseFailure/shard-member-1:snapshot-read#-1895653259]: org.opendaylight.controller.cluster.common.actor.Monitor@6de67dff 11:59:54,957 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 11:59:54,957 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config45: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 11:59:54,958 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: false, hasLeader : false 11:59:54,958 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config45 is no longer the leader 11:59:54,958 AM [test-akka.actor.default-dispatcher-11] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from null to Follower [WARN] [03/26/2024 11:59:54.958] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testPreCommitPhaseFailure]] 11:59:54,958 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45 (Follower): Received TimeoutNow - switching to Candidate 11:59:54,958 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45 (Candidate): Election: Candidate has following voting peers: [] 11:59:54,958 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Set currentTerm=1, votedFor=member-1-shard-inventory-config45 11:59:54,958 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config45 (Candidate): Starting new election term 1 11:59:54,958 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config45 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 11:59:54,958 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config45 (Follower): Closing 11:59:54,958 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: false, hasLeader : false 11:59:54,958 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config45 is no longer the leader 11:59:54,958 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from Follower to Candidate 11:59:54,959 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config45 (Candidate): Received ElectionTimeout 11:59:54,959 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config45 (Leader): Election: Leader has following peers: [] 11:59:54,959 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config45 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 11:59:54,959 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: true, hasLeader : true 11:59:54,959 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config45: became leader with frontend state for [] 11:59:54,959 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from Candidate to Leader 11:59:55,19 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 11:59:55,19 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:55,19 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:55,19 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-70-0 11:59:55,20 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Readying Tx member-1-ShardTransactionTest-fe-0-txn-70-0 of 1 operations, client version 13 11:59:55,20 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: readying transaction member-1-ShardTransactionTest-fe-0-txn-70-0 11:59:55,20 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: transaction member-1-ShardTransactionTest-fe-0-txn-70-0 ready 11:59:55,20 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 11:59:55,20 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Moving last applied index from -1 to 0 11:59:55,20 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 11:59:55,20 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 11:59:55,21 AM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config45: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 11:59:55,21 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1445794} is already disabled 11:59:55,21 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Persisting ApplyJournalEntries with index=0 11:59:55,21 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-71-0 11:59:55,21 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Readying Tx member-1-ShardTransactionTest-fe-0-txn-71-0 of 1 operations, client version 13 11:59:55,21 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: readying transaction member-1-ShardTransactionTest-fe-0-txn-71-0 11:59:55,21 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: transaction member-1-ShardTransactionTest-fe-0-txn-71-0 ready 11:59:55,22 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-70-0 11:59:55,22 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Validating transaction member-1-ShardTransactionTest-fe-0-txn-70-0 11:59:55,22 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Transaction member-1-ShardTransactionTest-fe-0-txn-70-0 validated 11:59:55,22 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-70-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:55,22 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: canCommit for member-1-ShardTransactionTest-fe-0-txn-70-0: success 11:59:55,22 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-71-0 11:59:55,22 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Tx member-1-ShardTransactionTest-fe-0-txn-71-0 is scheduled for canCommit step 11:59:55,22 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Committing transaction member-1-ShardTransactionTest-fe-0-txn-70-0 11:59:55,22 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-70-0 11:59:55,23 AM [test-akka.actor.default-dispatcher-12] [ERROR] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-70-0 failed to prepare java.lang.RuntimeException: mock preCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1030) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:113) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:117) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:302) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:365) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:715) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:416) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:55,23 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-70-0: abort - successfulFromPrevious: [] 11:59:55,23 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-70-0 changing state from PRE_COMMIT_PENDING to FAILED 11:59:55,23 AM [test-akka.actor.default-dispatcher-12] [ERROR] Shard - member-1-shard-inventory-config45 An exception occurred while preCommitting transaction member-1-ShardTransactionTest-fe-0-txn-70-0 java.lang.RuntimeException: mock preCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1030) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:113) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:117) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:302) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:365) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:715) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:416) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 11:59:55,23 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Validating transaction member-1-ShardTransactionTest-fe-0-txn-71-0 11:59:55,23 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config45: Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 validated 11:59:55,23 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 11:59:55,23 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: canCommit for member-1-ShardTransactionTest-fe-0-txn-71-0: success 11:59:55,26 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPreCommitPhaseFailure] 11:59:55,36 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config45 11:59:55,36 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config45 (Leader)_slicer-id-266: Closing 11:59:55,36 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config45: Aborting 1 pending queued transactions [WARN] [03/26/2024 11:59:55.036] [test-akka.actor.default-dispatcher-7] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testPreCommitPhaseFailure]: Failure(java.lang.RuntimeException: Transaction aborted due to shutdown.) [INFO] [03/26/2024 11:59:55.038] [test-akka.remote.default-remote-dispatcher-10] [akka://test@10.30.171.73:25520/system/remoting-terminator] Shutting down remote daemon. [INFO] [03/26/2024 11:59:55.038] [test-akka.remote.default-remote-dispatcher-10] [akka://test@10.30.171.73:25520/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. 11:59:55,38 AM [test-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 11:59:55,38 AM [test-akka.actor.default-dispatcher-14] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [03/26/2024 11:59:55.041] [test-akka.remote.default-remote-dispatcher-8] [akka://test@10.30.171.73:25520/system/remoting-terminator] Remoting shut down. 11:59:55,41 AM [test-akka.actor.default-dispatcher-7] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down.