[DEBUG] [03/11/2024 13:49:31.948] [main] [EventStream(akka://test)] logger log1-TestEventListener started 01:49:31,949 PM [test-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [03/11/2024 13:49:31.949] [main] [EventStream(akka://test)] logger log2-Slf4jLogger started [DEBUG] [03/11/2024 13:49:31.949] [main] [EventStream(akka://test)] Default Loggers started [INFO] [03/11/2024 13:49:31.969] [main] [ArteryTransport(akka://test)] Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.170.233:25520] with UID [-4569309100099914020] [INFO] [03/11/2024 13:49:31.970] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.233:25520] - Starting up, Akka version [2.6.21] ... 01:49:31,970 PM [test-akka.actor.default-dispatcher-7] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.170.233:25520] with UID [-4569309100099914020] 01:49:31,970 PM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.170.233:25520] - Starting up, Akka version [2.6.21] ... [INFO] [03/11/2024 13:49:31.971] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.233:25520] - Registered cluster JMX MBean [akka:type=Cluster] [INFO] [03/11/2024 13:49:31.971] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.233:25520] - Started up successfully 01:49:31,972 PM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.170.233:25520] - Registered cluster JMX MBean [akka:type=Cluster] 01:49:31,972 PM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.170.233:25520] - Started up successfully 01:49:31,974 PM [test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://test@10.30.170.233:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing 01:49:31,974 PM [test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://test@10.30.170.233:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining 01:49:31,985 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config5, persistent : true [INFO] [03/11/2024 13:49:31.972] [test-akka.actor.internal-dispatcher-4] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.233:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing [INFO] [03/11/2024 13:49:31.972] [test-akka.actor.internal-dispatcher-4] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.233:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining 01:49:31,986 PM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [03/11/2024 13:49:31.986] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testApplySnapshot]: org.opendaylight.controller.cluster.common.actor.Monitor@39353c31 [INFO] [akkaDeadLetter][03/11/2024 13:49:31.985] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:31,986 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testApplySnapshot/member-1-shard-inventory-config5-notifier#-1683844507 created and ready for shard:member-1-shard-inventory-config5 [WARN] [03/11/2024 13:49:31.986] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-notifier#-1683844507]: org.opendaylight.controller.cluster.common.actor.Monitor@33cd5741 [INFO] [akkaDeadLetter][03/11/2024 13:49:31.987] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-notifier#-1683844507] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:31,987 PM [test-akka.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-notifier#-1683844507] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:31,988 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#-974000227] [WARN] [03/11/2024 13:49:31.988] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#-974000227]: org.opendaylight.controller.cluster.common.actor.Monitor@78929092 [INFO] [akkaDeadLetter][03/11/2024 13:49:31.988] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#-974000227] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:31,989 PM [test-akka.actor.default-dispatcher-14] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#-974000227] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:31,990 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config5 with journal batch size 3 01:49:31,994 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config5: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:31,994 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config5: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:31,994 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config5: onLeadershipChange, isLeader: false, hasLeader : false 01:49:31,994 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config5: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config5 is no longer the leader [WARN] [03/11/2024 13:49:31.994] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from TestActor[akka://test/user/testApplySnapshot]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@505cc24b [INFO] [akkaDeadLetter][03/11/2024 13:49:31.994] [test-akka.actor.default-dispatcher-6] [akka://test/user] Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:31,994 PM [test-akka.actor.default-dispatcher-6] [INFO] LocalActorRef - Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:31,994 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config5 , received role change from null to Follower 01:49:31,994 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config5 (Follower): Received TimeoutNow - switching to Candidate 01:49:31,995 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config5 (Candidate): Election: Candidate has following voting peers: [] 01:49:31,995 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config5: Set currentTerm=1, votedFor=member-1-shard-inventory-config5 01:49:31,995 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config5 (Candidate): Starting new election term 1 01:49:31,995 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config5 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:31,995 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config5 (Follower): Closing 01:49:31,995 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config5: onLeadershipChange, isLeader: false, hasLeader : false 01:49:31,995 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config5: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config5 is no longer the leader 01:49:31,995 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config5 , received role change from Follower to Candidate 01:49:31,997 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config5 (Candidate): Received ElectionTimeout 01:49:31,997 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config5 (Leader): Election: Leader has following peers: [] 01:49:31,997 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config5 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:31,997 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config5: onLeadershipChange, isLeader: true, hasLeader : true 01:49:31,997 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config5: became leader with frontend state for [] 01:49:31,997 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config5 , received role change from Candidate to Leader 01:49:32,85 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config5: Applying snapshot on follower: Snapshot [lastIndex=1, lastTerm=2, lastAppliedIndex=3, lastAppliedTerm=4, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@b01d657, electionTerm=-1, electionVotedFor=null, ServerConfigPayload=null] 01:49:32,85 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - lastSequenceNumber prior to persisting applied snapshot: 1 01:49:32,86 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config5: SaveSnapshotSuccess received for snapshot, sequenceNr: 1 01:49:32,86 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config5: Snapshot success - sequence number: 1 01:49:32,86 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config5: Moving last applied index from -1 to 3 01:49:32,86 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config5: Set currentTerm=-1, votedFor=null 01:49:32,87 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config5: Applying snapshot 01:49:32,87 PM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config5: clearing clients {} 01:49:32,88 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config5: Created publisher actor Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-DTCL-publisher#-1756662383] with name member-1-shard-inventory-config5-DTCL-publisher 01:49:32,88 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config5: state snapshot applied in 994.5 μs 01:49:32,88 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config5: Done applying snapshot 01:49:32,88 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-DTCL-publisher#-1756662383] 01:49:32,89 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config5: publishChanges: rootPath: / [WARN] [03/11/2024 13:49:32.089] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-DTCL-publisher#-1756662383]: org.opendaylight.controller.cluster.common.actor.Monitor@76cfdf5c [INFO] [akkaDeadLetter][03/11/2024 13:49:32.089] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-DTCL-publisher#-1756662383] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:32,89 PM [test-akka.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-DTCL-publisher#-1756662383] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:32,89 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config5: Elapsed time for generation of change events for member-1-shard-inventory-config5-DTCL-publisher: 198.1 μs 01:49:32,90 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config5: handled a snapshot response 01:49:32,90 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config5: SnapshotComplete received 01:49:32,95 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config5: handled a journal response 01:49:32,160 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testApplySnapshot] 01:49:32,172 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config5 01:49:32,172 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config5 (Leader)_slicer-id-243: Closing 01:49:32,172 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config5: Aborting 0 pending queued transactions 01:49:32,175 PM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config6, persistent : true [WARN] [03/11/2024 13:49:32.175] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPersistence1]: org.opendaylight.controller.cluster.common.actor.Monitor@236a0f69 [INFO] [akkaDeadLetter][03/11/2024 13:49:32.175] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence1] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:32,175 PM [test-akka.actor.default-dispatcher-13] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence1] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:32,176 PM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config6 with journal batch size 3 01:49:32,176 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#-575657396] 01:49:32,176 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testPersistence1/member-1-shard-inventory-config6-notifier#-1353723317 created and ready for shard:member-1-shard-inventory-config6 [WARN] [03/11/2024 13:49:32.176] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config6-notifier#-1353723317]: org.opendaylight.controller.cluster.common.actor.Monitor@76283a64 [WARN] [03/11/2024 13:49:32.176] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#-575657396]: org.opendaylight.controller.cluster.common.actor.Monitor@65767393 01:49:32,177 PM [test-akka.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#-575657396] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/11/2024 13:49:32.176] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#-575657396] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/11/2024 13:49:32.177] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config6-notifier#-1353723317] to Actor[akka://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:32,177 PM [test-akka.actor.default-dispatcher-6] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config6-notifier#-1353723317] to Actor[akka://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:32,177 PM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config6, persistent : false 01:49:32,180 PM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config6 with journal batch size 3 01:49:32,182 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] [WARN] [03/11/2024 13:49:32.182] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPersistence2]: org.opendaylight.controller.cluster.common.actor.Monitor@4c44d36a 01:49:32,182 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config6: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [INFO] [akkaDeadLetter][03/11/2024 13:49:32.182] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence2] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:32,182 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: false, hasLeader : false [WARN] [03/11/2024 13:49:32.182] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testPersistence1]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@75c47222 01:49:32,182 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config6 is no longer the leader 01:49:32,182 PM [test-akka.actor.default-dispatcher-13] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence2] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 01:49:32,182 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6 (Follower): Received TimeoutNow - switching to Candidate 01:49:32,183 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6 (Candidate): Election: Candidate has following voting peers: [] 01:49:32,183 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6: Set currentTerm=1, votedFor=member-1-shard-inventory-config6 01:49:32,183 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config6 (Candidate): Starting new election term 1 01:49:32,183 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config6 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:32,183 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config6 (Follower): Closing 01:49:32,183 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,183 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config6: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config6 is no longer the leader 01:49:32,183 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPersistence2/shard-member-1:snapshot-read#-1695975645] 01:49:32,183 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from null to Follower 01:49:32,183 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from Follower to Candidate 01:49:32,183 PM [test-akka.actor.default-dispatcher-6] [INFO] LocalActorRef - Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] from TestActor[akka://test/user/testPersistence1] to Actor[akka://test/user] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [03/11/2024 13:49:32.183] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence2/member-1-shard-inventory-config6-notifier#-1029290636]: org.opendaylight.controller.cluster.common.actor.Monitor@6ca428c0 [INFO] [akkaDeadLetter][03/11/2024 13:49:32.183] [test-akka.actor.default-dispatcher-12] [akka://test/user] Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] from TestActor[akka://test/user/testPersistence1] to Actor[akka://test/user] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [03/11/2024 13:49:32.183] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence2/shard-member-1:snapshot-read#-1695975645]: org.opendaylight.controller.cluster.common.actor.Monitor@2cb19e9 01:49:32,185 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config6: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.UpdateElectionTerm from Actor[akka://test/deadLetters] 01:49:32,185 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config6: Set currentTerm=1, votedFor=member-1-shard-inventory-config6 01:49:32,185 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config6: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:32,185 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config6: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:32,186 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,186 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config6: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config6 is no longer the leader 01:49:32,186 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config6 (Follower): Received TimeoutNow - switching to Candidate 01:49:32,186 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config6 (Candidate): Election: Candidate has following voting peers: [] 01:49:32,186 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config6: Set currentTerm=2, votedFor=member-1-shard-inventory-config6 01:49:32,186 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config6 (Candidate): Starting new election term 2 01:49:32,186 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config6 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 01:49:32,186 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config6 (Follower): Closing 01:49:32,186 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,186 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config6: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config6 is no longer the leader [WARN] [03/11/2024 13:49:32.186] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from TestActor[akka://test/user/testPersistence2]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@6fab1fd7 01:49:32,186 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testPersistence2/member-1-shard-inventory-config6-notifier#-1029290636 created and ready for shard:member-1-shard-inventory-config6 01:49:32,186 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from null to Follower 01:49:32,186 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from Follower to Candidate 01:49:32,281 PM [main] [DEBUG] Shard - member-1-shard-inventory-config6 (Candidate): Received ElectionTimeout 01:49:32,281 PM [main] [DEBUG] Shard - member-1-shard-inventory-config6 (Leader): Election: Leader has following peers: [] 01:49:32,281 PM [main] [INFO] Shard - member-1-shard-inventory-config6 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 01:49:32,281 PM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: true, hasLeader : true 01:49:32,281 PM [main] [DEBUG] Shard - member-1-shard-inventory-config6: became leader with frontend state for [] 01:49:32,281 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from Candidate to Leader 01:49:32,281 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPersistence1] 01:49:32,291 PM [main] [DEBUG] Shard - member-1-shard-inventory-config6 (Candidate): Received ElectionTimeout 01:49:32,291 PM [main] [DEBUG] Shard - member-1-shard-inventory-config6 (Leader): Election: Leader has following peers: [] 01:49:32,291 PM [main] [INFO] Shard - member-1-shard-inventory-config6 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:32,291 PM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: true, hasLeader : true 01:49:32,291 PM [main] [DEBUG] Shard - member-1-shard-inventory-config6: became leader with frontend state for [] 01:49:32,292 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from Candidate to Leader 01:49:32,292 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Stopping Shard member-1-shard-inventory-config6 01:49:32,292 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageSlicer - member-1-shard-inventory-config6 (Leader)_slicer-id-247: Closing 01:49:32,292 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config6: Aborting 0 pending queued transactions 01:49:32,292 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPersistence2] 01:49:32,292 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config6 01:49:32,292 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config6 (Leader)_slicer-id-246: Closing 01:49:32,293 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config6: Aborting 0 pending queued transactions 01:49:32,295 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$5 - Shard created : member-1-shard-inventory-config7, persistent : true [WARN] [03/11/2024 13:49:32.295] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortWithCommitPending]: org.opendaylight.controller.cluster.common.actor.Monitor@51239c7c [WARN] [03/11/2024 13:49:32.296] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config7-notifier#-1997081522]: org.opendaylight.controller.cluster.common.actor.Monitor@31bd28ed 01:49:32,296 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testAbortWithCommitPending/member-1-shard-inventory-config7-notifier#-1997081522 created and ready for shard:member-1-shard-inventory-config7 01:49:32,296 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortWithCommitPending/shard-member-1:snapshot-read#806927756] [WARN] [03/11/2024 13:49:32.296] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/shard-member-1:snapshot-read#806927756]: org.opendaylight.controller.cluster.common.actor.Monitor@3213737e 01:49:32,297 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$5 - Starting recovery for member-1-shard-inventory-config7 with journal batch size 3 01:49:32,298 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:32,298 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$5 - member-1-shard-inventory-config7: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:32,298 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config7: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,298 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config7 is no longer the leader 01:49:32,298 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config7 , received role change from null to Follower [WARN] [03/11/2024 13:49:32.298] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testAbortWithCommitPending]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@bc213f5 01:49:32,298 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7 (Follower): Received TimeoutNow - switching to Candidate 01:49:32,298 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7 (Candidate): Election: Candidate has following voting peers: [] 01:49:32,298 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Set currentTerm=1, votedFor=member-1-shard-inventory-config7 01:49:32,298 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$5 - member-1-shard-inventory-config7 (Candidate): Starting new election term 1 01:49:32,298 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$5 - member-1-shard-inventory-config7 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:32,298 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config7 (Follower): Closing 01:49:32,298 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config7: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,298 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config7 is no longer the leader 01:49:32,298 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config7 , received role change from Follower to Candidate 01:49:32,299 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7 (Candidate): Received ElectionTimeout 01:49:32,299 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7 (Leader): Election: Leader has following peers: [] 01:49:32,299 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$5 - member-1-shard-inventory-config7 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:32,299 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config7: onLeadershipChange, isLeader: true, hasLeader : true 01:49:32,299 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: became leader with frontend state for [] 01:49:32,299 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config7 , received role change from Candidate to Leader 01:49:32,405 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:32,411 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:32,411 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:32,413 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-49-0 01:49:32,414 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Readying Tx member-1-ShardTransactionTest-fe-0-txn-49-0 of 1 operations, client version 13 01:49:32,414 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: readying transaction member-1-ShardTransactionTest-fe-0-txn-49-0 01:49:32,414 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: transaction member-1-ShardTransactionTest-fe-0-txn-49-0 ready 01:49:32,414 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-49-0 01:49:32,415 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Validating transaction member-1-ShardTransactionTest-fe-0-txn-49-0 01:49:32,415 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-49-0 validated 01:49:32,415 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-49-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:32,415 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: canCommit for member-1-ShardTransactionTest-fe-0-txn-49-0: success 01:49:32,415 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Committing transaction member-1-ShardTransactionTest-fe-0-txn-49-0 01:49:32,416 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-49-0 01:49:32,416 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-49-0 candidate ready 01:49:32,416 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-49-0: canCommit - candidate rootPath: / 01:49:32,416 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-49-0: canCommit - messages: [] 01:49:32,416 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-49-0: preCommit - successfulFromPrevious: [] 01:49:32,416 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-49-0 prepared 01:49:32,417 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-49-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:32,417 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-49-0 01:49:32,417 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-49-0 01:49:32,417 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:32,417 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-49-0 01:49:32,418 PM [test-akka.actor.default-dispatcher-13] [WARN] ShardDataTree - member-1-shard-inventory-config7: transaction member-1-ShardTransactionTest-fe-0-txn-49-0 is committing, skipping abort 01:49:32,418 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:32,418 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:32,418 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-49-0 submitted to persistence 01:49:32,418 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:32,418 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Moving last applied index from -1 to 0 01:49:32,419 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:32,419 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:32,419 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config7: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:32,419 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=12543884} is already disabled 01:49:32,419 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Persisting ApplyJournalEntries with index=0 01:49:32,419 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:32,419 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Moving last applied index from 0 to 1 01:49:32,419 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Applying state for log index 1 data Simple{size=143} 01:49:32,419 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-49-0 01:49:32,420 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-49-0: commit - successfulFromPrevious: [] 01:49:32,420 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-49-0 changing state from COMMIT_PENDING to COMMITTED 01:49:32,420 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-49-0 committed as 0, sending response to Actor[akka://test/system/testProbe-640#-1121135283] 01:49:32,420 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortWithCommitPending] 01:49:32,420 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config7: Created publisher actor Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config7-DTCL-publisher#-514651564] with name member-1-shard-inventory-config7-DTCL-publisher 01:49:32,420 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config7-DTCL-publisher#-514651564] 01:49:32,421 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config7: publishChanges: rootPath: / 01:49:32,421 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: fakeSnapshot purging log to 0 for term 1 01:49:32,421 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Persisting ApplyJournalEntries with index=1 [WARN] [03/11/2024 13:49:32.421] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config7-DTCL-publisher#-514651564]: org.opendaylight.controller.cluster.common.actor.Monitor@1382373b 01:49:32,421 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config7: Elapsed time for generation of change events for member-1-shard-inventory-config7-DTCL-publisher: 70.25 μs 01:49:32,431 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$5 - Stopping Shard member-1-shard-inventory-config7 01:49:32,431 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config7 (Leader)_slicer-id-249: Closing 01:49:32,431 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Aborting 0 pending queued transactions 01:49:32,432 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config8, persistent : true [WARN] [03/11/2024 13:49:32.432] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.common.actor.Monitor@56a75a84 01:49:32,433 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testAbortAfterReady/member-1-shard-inventory-config8-notifier#1963443298 created and ready for shard:member-1-shard-inventory-config8 01:49:32,433 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#456173554] [WARN] [03/11/2024 13:49:32.433] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config8-notifier#1963443298]: org.opendaylight.controller.cluster.common.actor.Monitor@75be3b3d [WARN] [03/11/2024 13:49:32.433] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#456173554]: org.opendaylight.controller.cluster.common.actor.Monitor@a64c2e4 01:49:32,434 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config8 with journal batch size 3 01:49:32,434 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:32,434 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config8: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [03/11/2024 13:49:32.435] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@2c050344 01:49:32,435 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config8: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,435 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config8 is no longer the leader 01:49:32,435 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config8 , received role change from null to Follower 01:49:32,435 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8 (Follower): Received TimeoutNow - switching to Candidate 01:49:32,435 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8 (Candidate): Election: Candidate has following voting peers: [] 01:49:32,435 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Set currentTerm=1, votedFor=member-1-shard-inventory-config8 01:49:32,435 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config8 (Candidate): Starting new election term 1 01:49:32,435 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config8 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:32,435 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config8 (Follower): Closing 01:49:32,435 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config8: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,435 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config8 is no longer the leader 01:49:32,435 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config8 , received role change from Follower to Candidate 01:49:32,436 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config8 (Candidate): Received ElectionTimeout 01:49:32,436 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config8 (Leader): Election: Leader has following peers: [] 01:49:32,436 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config8 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:32,436 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config8: onLeadershipChange, isLeader: true, hasLeader : true 01:49:32,436 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config8: became leader with frontend state for [] 01:49:32,436 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config8 , received role change from Candidate to Leader 01:49:32,543 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:32,543 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:32,543 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:32,543 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-50-0 01:49:32,544 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Readying Tx member-1-ShardTransactionTest-fe-0-txn-50-0 of 1 operations, client version 13 01:49:32,544 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: readying transaction member-1-ShardTransactionTest-fe-0-txn-50-0 01:49:32,544 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: transaction member-1-ShardTransactionTest-fe-0-txn-50-0 ready 01:49:32,544 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-50-0 01:49:32,544 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: aborting head of queue member-1-ShardTransactionTest-fe-0-txn-50-0 in state member-1-ShardTransactionTest-fe-0-txn-50-0 01:49:32,544 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-50-0: abort - successfulFromPrevious: [] 01:49:32,544 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:32,544 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Moving last applied index from -1 to 0 01:49:32,544 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:32,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:32,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config8: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:32,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1429235} is already disabled 01:49:32,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Persisting ApplyJournalEntries with index=0 01:49:32,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-50-0 01:49:32,545 PM [test-akka.actor.default-dispatcher-13] [ERROR] Shard - member-1-shard-inventory-config8: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-50-0 canCommit java.lang.IllegalStateException: member-1-shard-inventory-config8: Cannot canCommit transaction member-1-ShardTransactionTest-fe-0-txn-50-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:282) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:727) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:379) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:32,546 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-51-0 01:49:32,546 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Readying Tx member-1-ShardTransactionTest-fe-0-txn-51-0 of 1 operations, client version 13 01:49:32,546 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: readying transaction member-1-ShardTransactionTest-fe-0-txn-51-0 01:49:32,546 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: transaction member-1-ShardTransactionTest-fe-0-txn-51-0 ready 01:49:32,546 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-51-0 01:49:32,546 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Validating transaction member-1-ShardTransactionTest-fe-0-txn-51-0 01:49:32,546 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-51-0 validated 01:49:32,546 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-51-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:32,546 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: canCommit for member-1-ShardTransactionTest-fe-0-txn-51-0: success 01:49:32,546 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterReady] 01:49:32,557 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config8 01:49:32,557 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config8 (Leader)_slicer-id-251: Closing 01:49:32,557 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config8: Aborting 1 pending queued transactions 01:49:32,561 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$2$1 - Shard created : member-1-shard-inventory-config9, persistent : true [WARN] [03/11/2024 13:49:32.561] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader]: org.opendaylight.controller.cluster.common.actor.Monitor@50161dcd 01:49:32,562 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testOnBatchedModificationsWhenNotLeader/member-1-shard-inventory-config9-notifier#-464814032 created and ready for shard:member-1-shard-inventory-config9 [WARN] [03/11/2024 13:49:32.562] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/member-1-shard-inventory-config9-notifier#-464814032]: org.opendaylight.controller.cluster.common.actor.Monitor@1b562cc8 01:49:32,562 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/shard-member-1:snapshot-read#433586684] [WARN] [03/11/2024 13:49:32.562] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/shard-member-1:snapshot-read#433586684]: org.opendaylight.controller.cluster.common.actor.Monitor@1fecbbe8 01:49:32,562 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$2$1 - Starting recovery for member-1-shard-inventory-config9 with journal batch size 3 01:49:32,563 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:32,563 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$2$1 - member-1-shard-inventory-config9: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:32,563 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,563 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config9 is no longer the leader 01:49:32,563 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from null to Follower 01:49:32,564 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9 (Follower): Received TimeoutNow - switching to Candidate 01:49:32,564 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9 (Candidate): Election: Candidate has following voting peers: [] 01:49:32,564 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: Set currentTerm=1, votedFor=member-1-shard-inventory-config9 01:49:32,564 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$2$1 - member-1-shard-inventory-config9 (Candidate): Starting new election term 1 01:49:32,564 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$2$1 - member-1-shard-inventory-config9 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:32,564 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config9 (Follower): Closing 01:49:32,564 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,564 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config9 is no longer the leader 01:49:32,564 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:32.564] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@332a6927 01:49:32,565 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9 (Candidate): Received ElectionTimeout 01:49:32,565 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9 (Leader): Election: Leader has following peers: [] 01:49:32,565 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$2$1 - member-1-shard-inventory-config9 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:32,565 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: true, hasLeader : true 01:49:32,565 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: became leader with frontend state for [] 01:49:32,565 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from Candidate to Leader 01:49:32,671 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: Forwarding 1 BatchedModifications to leader ActorSelection[Anchor(akka://test/), Path(/system/testProbe-644)] 01:49:32,673 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader] 01:49:32,683 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$2$1 - Stopping Shard member-1-shard-inventory-config9 01:49:32,683 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config9 (Leader)_slicer-id-253: Closing 01:49:32,683 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: Aborting 0 pending queued transactions 01:49:32,685 PM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config10, persistent : true [WARN] [03/11/2024 13:49:32.685] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testOnDatastoreContext]: org.opendaylight.controller.cluster.common.actor.Monitor@107336fb 01:49:32,686 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testOnDatastoreContext/member-1-shard-inventory-config10-notifier#889460437 created and ready for shard:member-1-shard-inventory-config10 [WARN] [03/11/2024 13:49:32.686] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnDatastoreContext/member-1-shard-inventory-config10-notifier#889460437]: org.opendaylight.controller.cluster.common.actor.Monitor@53140270 01:49:32,686 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testOnDatastoreContext/shard-member-1:snapshot-read#-1178017426] [WARN] [03/11/2024 13:49:32.686] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnDatastoreContext/shard-member-1:snapshot-read#-1178017426]: org.opendaylight.controller.cluster.common.actor.Monitor@68a4bced 01:49:32,687 PM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config10 with journal batch size 3 01:49:32,689 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config10: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:32,689 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config10: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:32,689 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,689 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config10: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config10 is no longer the leader 01:49:32,689 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config10 (Follower): Received TimeoutNow - switching to Candidate [WARN] [03/11/2024 13:49:32.689] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from TestActor[akka://test/user/testOnDatastoreContext]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@3113bb96 01:49:32,689 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config10 (Candidate): Election: Candidate has following voting peers: [] 01:49:32,689 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config10: Set currentTerm=1, votedFor=member-1-shard-inventory-config10 01:49:32,689 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from null to Follower 01:49:32,689 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config10 (Candidate): Starting new election term 1 01:49:32,689 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config10 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:32,689 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config10 (Follower): Closing 01:49:32,689 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,689 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config10: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config10 is no longer the leader 01:49:32,689 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from Follower to Candidate 01:49:32,839 PM [main] [DEBUG] Shard - member-1-shard-inventory-config10 (Candidate): Received ElectionTimeout 01:49:32,839 PM [main] [DEBUG] Shard - member-1-shard-inventory-config10 (Leader): Election: Leader has following peers: [] 01:49:32,839 PM [main] [INFO] Shard - member-1-shard-inventory-config10 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:32,839 PM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: true, hasLeader : true 01:49:32,840 PM [main] [DEBUG] Shard - member-1-shard-inventory-config10: became leader with frontend state for [] 01:49:32,840 PM [main] [DEBUG] Shard - member-1-shard-inventory-config10: RaftPolicy used with prev.config null, RaftPolicy used with newConfig null 01:49:32,840 PM [main] [INFO] Shard - member-1-shard-inventory-config10: Persistence has been enabled - capturing snapshot 01:49:32,840 PM [main] [DEBUG] Shard - Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1 01:49:32,840 PM [main] [DEBUG] Shard - member-1-shard-inventory-config10: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 01:49:32,840 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from Candidate to Leader [WARN] [03/11/2024 13:49:32.840] [test-akka.actor.default-dispatcher-7] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testOnDatastoreContext]: org.opendaylight.controller.cluster.raft.client.messages.FindLeaderReply@1cb666fb 01:49:32,845 PM [main] [INFO] Shard - member-1-shard-inventory-config10: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true] 01:49:32,845 PM [main] [DEBUG] Shard - member-1-shard-inventory-config10: lastSequenceNumber prior to capture: 1 01:49:32,845 PM [main] [DEBUG] Shard - member-1-shard-inventory-config10: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}} 01:49:32,845 PM [main] [DEBUG] Shard - member-1-shard-inventory-config10: RaftPolicy used with prev.config null, RaftPolicy used with newConfig null 01:49:32,846 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testOnDatastoreContext] 01:49:32,846 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config10: CaptureSnapshotReply received by actor 01:49:32,846 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config10: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@448f71cd, electionTerm=1, electionVotedFor=member-1-shard-inventory-config10, ServerConfigPayload=null] 01:49:32,846 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config10: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1 01:49:32,846 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config10: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 01:49:32,846 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-16] [INFO] Shard - member-1-shard-inventory-config10: SaveSnapshotSuccess received for snapshot, sequenceNr: 1 01:49:32,846 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: Snapshot success - sequence number: 1 01:49:32,846 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: SnapshotComplete received 01:49:32,847 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: handled a snapshot response 01:49:32,847 PM [test-akka.persistence.dispatchers.default-plugin-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config10: handled a journal response 01:49:32,856 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config10 01:49:32,856 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config10 (Leader)_slicer-id-255: Closing 01:49:32,856 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config10: Aborting 0 pending queued transactions 01:49:32,860 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config11, persistent : true [WARN] [03/11/2024 13:49:32.860] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCanCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@1055fb5d 01:49:32,861 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testCanCommitPhaseFailure/member-1-shard-inventory-config11-notifier#-976801919 created and ready for shard:member-1-shard-inventory-config11 01:49:32,861 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCanCommitPhaseFailure/shard-member-1:snapshot-read#439160881] [WARN] [03/11/2024 13:49:32.861] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitPhaseFailure/member-1-shard-inventory-config11-notifier#-976801919]: org.opendaylight.controller.cluster.common.actor.Monitor@38bb3bcb [WARN] [03/11/2024 13:49:32.861] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitPhaseFailure/shard-member-1:snapshot-read#439160881]: org.opendaylight.controller.cluster.common.actor.Monitor@1fabfdeb 01:49:32,862 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config11 with journal batch size 3 01:49:32,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:32,863 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config11: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:32,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config11 is no longer the leader 01:49:32,863 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from null to Follower 01:49:32,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11 (Follower): Received TimeoutNow - switching to Candidate 01:49:32,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11 (Candidate): Election: Candidate has following voting peers: [] 01:49:32,863 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: Set currentTerm=1, votedFor=member-1-shard-inventory-config11 01:49:32,863 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config11 (Candidate): Starting new election term 1 01:49:32,864 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config11 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:32,864 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config11 (Follower): Closing 01:49:32,864 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,864 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config11 is no longer the leader 01:49:32,864 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:32.864] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testCanCommitPhaseFailure]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@7d1bec19 01:49:32,864 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11 (Candidate): Received ElectionTimeout 01:49:32,865 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11 (Leader): Election: Leader has following peers: [] 01:49:32,865 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config11 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:32,865 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: true, hasLeader : true 01:49:32,865 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: became leader with frontend state for [] 01:49:32,865 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from Candidate to Leader 01:49:32,972 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:32,972 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:32,972 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:32,973 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-53-0 01:49:32,973 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Readying Tx member-1-ShardTransactionTest-fe-0-txn-53-0 of 1 operations, client version 13 01:49:32,973 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: readying transaction member-1-ShardTransactionTest-fe-0-txn-53-0 01:49:32,973 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: transaction member-1-ShardTransactionTest-fe-0-txn-53-0 ready 01:49:32,974 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-53-0 01:49:32,974 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Validating transaction member-1-ShardTransactionTest-fe-0-txn-53-0 01:49:32,975 PM [test-akka.actor.default-dispatcher-6] [WARN] ShardDataTree - member-1-shard-inventory-config11: Store Tx member-1-ShardTransactionTest-fe-0-txn-53-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:986) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:112) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:242) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:291) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:727) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:379) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:32,975 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Store Tx member-1-ShardTransactionTest-fe-0-txn-53-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 01:49:32,975 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-53-0 changing state from CAN_COMMIT_PENDING to FAILED 01:49:32,975 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-53-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:855) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:986) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:112) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:242) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:291) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:727) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:379) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) ... 34 more 01:49:32,976 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:32,976 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Moving last applied index from -1 to 0 01:49:32,976 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:32,976 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:32,976 PM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config11: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:32,976 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=4144484} is already disabled 01:49:32,976 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-54-0 01:49:32,976 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Readying Tx member-1-ShardTransactionTest-fe-0-txn-54-0 of 1 operations, client version 13 01:49:32,976 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: readying transaction member-1-ShardTransactionTest-fe-0-txn-54-0 01:49:32,976 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: transaction member-1-ShardTransactionTest-fe-0-txn-54-0 ready 01:49:32,977 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Persisting ApplyJournalEntries with index=0 01:49:32,977 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-54-0 01:49:32,977 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Validating transaction member-1-ShardTransactionTest-fe-0-txn-54-0 01:49:32,977 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-54-0 validated 01:49:32,977 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-54-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:32,977 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: canCommit for member-1-ShardTransactionTest-fe-0-txn-54-0: success 01:49:32,977 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCanCommitPhaseFailure] 01:49:32,988 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config11 01:49:32,988 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config11 (Leader)_slicer-id-257: Closing 01:49:32,988 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config11: Aborting 1 pending queued transactions 01:49:32,990 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config12, persistent : true [WARN] [03/11/2024 13:49:32.990] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterCanCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@17f96219 01:49:32,991 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterCanCommit/shard-member-1:snapshot-read#115660185] 01:49:32,991 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testAbortAfterCanCommit/member-1-shard-inventory-config12-notifier#1563285538 created and ready for shard:member-1-shard-inventory-config12 [WARN] [03/11/2024 13:49:32.991] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterCanCommit/member-1-shard-inventory-config12-notifier#1563285538]: org.opendaylight.controller.cluster.common.actor.Monitor@c0e90f6 01:49:32,991 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config12 with journal batch size 3 [WARN] [03/11/2024 13:49:32.991] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterCanCommit/shard-member-1:snapshot-read#115660185]: org.opendaylight.controller.cluster.common.actor.Monitor@4fec04f6 01:49:32,992 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:32,992 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config12: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:32,992 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,992 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config12 is no longer the leader [WARN] [03/11/2024 13:49:32.992] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testAbortAfterCanCommit]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@f55da33 01:49:32,993 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from null to Follower 01:49:32,993 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12 (Follower): Received TimeoutNow - switching to Candidate 01:49:32,993 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12 (Candidate): Election: Candidate has following voting peers: [] 01:49:32,993 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Set currentTerm=1, votedFor=member-1-shard-inventory-config12 01:49:32,993 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config12 (Candidate): Starting new election term 1 01:49:32,993 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config12 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:32,993 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config12 (Follower): Closing 01:49:32,993 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: false, hasLeader : false 01:49:32,993 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config12 is no longer the leader 01:49:32,993 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from Follower to Candidate 01:49:32,994 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12 (Candidate): Received ElectionTimeout 01:49:32,994 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12 (Leader): Election: Leader has following peers: [] 01:49:32,994 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config12 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:32,994 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: true, hasLeader : true 01:49:32,994 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: became leader with frontend state for [] 01:49:32,994 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from Candidate to Leader 01:49:33,101 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config12: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:33,101 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config12: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,101 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config12: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,101 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config12: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-55-0 01:49:33,101 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config12: Readying Tx member-1-ShardTransactionTest-fe-0-txn-55-0 of 1 operations, client version 13 01:49:33,101 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: readying transaction member-1-ShardTransactionTest-fe-0-txn-55-0 01:49:33,101 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: transaction member-1-ShardTransactionTest-fe-0-txn-55-0 ready 01:49:33,102 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config12: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-56-0 01:49:33,102 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config12: Readying Tx member-1-ShardTransactionTest-fe-0-txn-56-0 of 1 operations, client version 13 01:49:33,102 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: readying transaction member-1-ShardTransactionTest-fe-0-txn-56-0 01:49:33,102 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: transaction member-1-ShardTransactionTest-fe-0-txn-56-0 ready 01:49:33,102 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config12: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-55-0 01:49:33,102 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Validating transaction member-1-ShardTransactionTest-fe-0-txn-55-0 01:49:33,102 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-txn-55-0 validated 01:49:33,102 PM [test-akka.actor.default-dispatcher-19] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-55-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:33,102 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config12: canCommit for member-1-ShardTransactionTest-fe-0-txn-55-0: success 01:49:33,103 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-56-0 01:49:33,103 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Tx member-1-ShardTransactionTest-fe-0-txn-56-0 is scheduled for canCommit step 01:49:33,103 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-55-0 01:49:33,103 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: aborting head of queue member-1-ShardTransactionTest-fe-0-txn-55-0 in state member-1-ShardTransactionTest-fe-0-txn-55-0 01:49:33,103 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Validating transaction member-1-ShardTransactionTest-fe-0-txn-56-0 01:49:33,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-txn-56-0 validated 01:49:33,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-56-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:33,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: canCommit for member-1-ShardTransactionTest-fe-0-txn-56-0: success 01:49:33,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-55-0: abort - successfulFromPrevious: [] 01:49:33,104 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterCanCommit] 01:49:33,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Moving last applied index from -1 to 0 01:49:33,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:33,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:33,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config12: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:33,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3661381} is already disabled 01:49:33,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Persisting ApplyJournalEntries with index=0 01:49:33,115 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config12 01:49:33,115 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config12 (Leader)_slicer-id-259: Closing 01:49:33,115 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config12: Aborting 1 pending queued transactions [WARN] [03/11/2024 13:49:33.115] [test-akka.actor.default-dispatcher-19] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testAbortAfterCanCommit]: Failure(java.lang.RuntimeException: Transaction aborted due to shutdown.) 01:49:33,117 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config13, persistent : true [WARN] [03/11/2024 13:49:33.117] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testConcurrentThreePhaseCommits]: org.opendaylight.controller.cluster.common.actor.Monitor@a30d332 01:49:33,118 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config13-notifier#-804227439 created and ready for shard:member-1-shard-inventory-config13 [WARN] [03/11/2024 13:49:33.119] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config13-notifier#-804227439]: org.opendaylight.controller.cluster.common.actor.Monitor@2f040564 01:49:33,119 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testConcurrentThreePhaseCommits/shard-member-1:snapshot-read#-887859496] [WARN] [03/11/2024 13:49:33.119] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/shard-member-1:snapshot-read#-887859496]: org.opendaylight.controller.cluster.common.actor.Monitor@608629e0 01:49:33,119 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config13 with journal batch size 3 01:49:33,120 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:33,120 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config13: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:33,120 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: false, hasLeader : false 01:49:33,120 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config13 is no longer the leader 01:49:33,120 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from null to Follower 01:49:33,120 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13 (Follower): Received TimeoutNow - switching to Candidate 01:49:33,121 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13 (Candidate): Election: Candidate has following voting peers: [] 01:49:33,121 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Set currentTerm=1, votedFor=member-1-shard-inventory-config13 01:49:33,121 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config13 (Candidate): Starting new election term 1 01:49:33,121 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config13 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:33,121 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config13 (Follower): Closing 01:49:33,121 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: false, hasLeader : false 01:49:33,121 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config13 is no longer the leader 01:49:33,121 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:33.121] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from TestActor[akka://test/user/testConcurrentThreePhaseCommits]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@1d24561f 01:49:33,121 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13 (Candidate): Received ElectionTimeout 01:49:33,121 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13 (Leader): Election: Leader has following peers: [] 01:49:33,122 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config13 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:33,122 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: true, hasLeader : true 01:49:33,122 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: became leader with frontend state for [] 01:49:33,122 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from Candidate to Leader 01:49:33,230 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config13: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:33,230 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config13: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,230 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config13: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,230 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config13: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-57-0 01:49:33,231 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config13: Readying Tx member-1-ShardTransactionTest-fe-0-txn-57-0 of 1 operations, client version 13 01:49:33,231 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: readying transaction member-1-ShardTransactionTest-fe-0-txn-57-0 01:49:33,231 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: transaction member-1-ShardTransactionTest-fe-0-txn-57-0 ready 01:49:33,232 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-57-0 01:49:33,237 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Validating transaction member-1-ShardTransactionTest-fe-0-txn-57-0 01:49:33,237 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-57-0 validated 01:49:33,237 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-57-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:33,237 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: canCommit for member-1-ShardTransactionTest-fe-0-txn-57-0: success 01:49:33,238 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-58-0 01:49:33,238 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Readying Tx member-1-ShardTransactionTest-fe-0-txn-58-0 of 1 operations, client version 13 01:49:33,238 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: readying transaction member-1-ShardTransactionTest-fe-0-txn-58-0 01:49:33,238 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: transaction member-1-ShardTransactionTest-fe-0-txn-58-0 ready 01:49:33,238 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,238 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Moving last applied index from -1 to 0 01:49:33,238 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:33,238 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:33,238 PM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config13: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:33,238 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=8433281} is already disabled 01:49:33,238 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-59-0 01:49:33,239 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Readying Tx member-1-ShardTransactionTest-fe-0-txn-59-0 of 1 operations, client version 13 01:49:33,239 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: readying transaction member-1-ShardTransactionTest-fe-0-txn-59-0 01:49:33,239 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: transaction member-1-ShardTransactionTest-fe-0-txn-59-0 ready 01:49:33,239 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Persisting ApplyJournalEntries with index=0 01:49:33,239 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-58-0 01:49:33,239 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Tx member-1-ShardTransactionTest-fe-0-txn-58-0 is scheduled for canCommit step 01:49:33,239 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-59-0 01:49:33,239 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Tx member-1-ShardTransactionTest-fe-0-txn-59-0 is scheduled for canCommit step 01:49:33,239 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Committing transaction member-1-ShardTransactionTest-fe-0-txn-57-0 01:49:33,239 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-57-0 01:49:33,239 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-57-0 candidate ready 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-57-0: canCommit - candidate rootPath: / 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-57-0: canCommit - messages: [] 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-57-0: preCommit - successfulFromPrevious: [] 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-57-0 prepared 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-57-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-57-0 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-57-0 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Validating transaction member-1-ShardTransactionTest-fe-0-txn-58-0 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 validated 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: canCommit for member-1-ShardTransactionTest-fe-0-txn-58-0: success 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:33,240 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-57-0 submitted to persistence 01:49:33,246 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:33,246 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Moving last applied index from 0 to 1 01:49:33,246 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Applying state for log index 1 data Simple{size=143} 01:49:33,246 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-57-0 01:49:33,246 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-57-0: commit - successfulFromPrevious: [] 01:49:33,246 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-57-0 changing state from COMMIT_PENDING to COMMITTED 01:49:33,247 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-57-0 committed as 0, sending response to Actor[akka://test/system/testProbe-651#-1580176245] 01:49:33,247 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config13: Created publisher actor Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config13-DTCL-publisher#4234049] with name member-1-shard-inventory-config13-DTCL-publisher 01:49:33,247 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: fakeSnapshot purging log to 0 for term 1 01:49:33,247 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config13: Persisting ApplyJournalEntries with index=1 01:49:33,247 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config13-DTCL-publisher#4234049] 01:49:33,248 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config13: publishChanges: rootPath: / 01:49:33,248 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config13: Elapsed time for generation of change events for member-1-shard-inventory-config13-DTCL-publisher: 112.7 μs [WARN] [03/11/2024 13:49:33.248] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config13-DTCL-publisher#4234049]: org.opendaylight.controller.cluster.common.actor.Monitor@378824fc 01:49:33,249 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Committing transaction member-1-ShardTransactionTest-fe-0-txn-58-0 01:49:33,250 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-58-0 01:49:33,250 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 candidate ready 01:49:33,250 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-58-0: canCommit - candidate rootPath: / 01:49:33,250 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-58-0: canCommit - messages: [] 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-58-0: preCommit - successfulFromPrevious: [] 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 prepared 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-58-0 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-58-0 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Validating transaction member-1-ShardTransactionTest-fe-0-txn-59-0 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-59-0 validated 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-59-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: canCommit for member-1-ShardTransactionTest-fe-0-txn-59-0: success 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 01:49:33,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 01:49:33,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 submitted to persistence 01:49:33,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Committing transaction member-1-ShardTransactionTest-fe-0-txn-59-0 01:49:33,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-59-0 01:49:33,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-59-0 candidate ready 01:49:33,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-59-0: canCommit - candidate rootPath: / 01:49:33,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-59-0: canCommit - messages: [] 01:49:33,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-59-0: preCommit - successfulFromPrevious: [] 01:49:33,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-59-0 prepared 01:49:33,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-59-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:33,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-59-0 01:49:33,253 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-59-0 01:49:33,253 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:33,253 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Persist data SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 01:49:33,253 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 01:49:33,253 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-59-0 submitted to persistence 01:49:33,253 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 01:49:33,253 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Moving last applied index from 1 to 2 01:49:33,253 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Applying state for log index 2 data Simple{size=45} 01:49:33,253 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-58-0 01:49:33,253 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-58-0: commit - successfulFromPrevious: [] 01:49:33,253 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 changing state from COMMIT_PENDING to COMMITTED 01:49:33,254 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-58-0 committed as 0, sending response to Actor[akka://test/temp/testConcurrentThreePhaseCommits$a] 01:49:33,254 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config13: publishChanges: rootPath: / 01:49:33,254 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: fakeSnapshot purging log to 1 for term 1 01:49:33,254 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config13: Elapsed time for generation of change events for member-1-shard-inventory-config13-DTCL-publisher: 66.31 μs 01:49:33,254 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Persisting ApplyJournalEntries with index=2 01:49:33,254 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: persist complete SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 01:49:33,254 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Moving last applied index from 2 to 3 01:49:33,254 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Applying state for log index 3 data Simple{size=184} 01:49:33,254 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-59-0 01:49:33,254 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-59-0: commit - successfulFromPrevious: [] 01:49:33,254 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-59-0 changing state from COMMIT_PENDING to COMMITTED 01:49:33,254 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-59-0 committed as 0, sending response to Actor[akka://test/temp/testConcurrentThreePhaseCommits$b] 01:49:33,254 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config13: publishChanges: rootPath: / 01:49:33,255 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config13: Elapsed time for generation of change events for member-1-shard-inventory-config13-DTCL-publisher: 97.74 μs 01:49:33,255 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: fakeSnapshot purging log to 2 for term 1 01:49:33,255 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Persisting ApplyJournalEntries with index=3 01:49:33,259 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testConcurrentThreePhaseCommits] 01:49:33,270 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config13 01:49:33,270 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config13 (Leader)_slicer-id-261: Closing 01:49:33,270 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config13: Aborting 0 pending queued transactions 01:49:33,272 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config14, persistent : true [WARN] [03/11/2024 13:49:33.272] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true]: org.opendaylight.controller.cluster.common.actor.Monitor@11acd3c8 01:49:33,273 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config14-notifier#1212834391 created and ready for shard:member-1-shard-inventory-config14 [WARN] [03/11/2024 13:49:33.273] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config14-notifier#1212834391]: org.opendaylight.controller.cluster.common.actor.Monitor@7cff6e8d 01:49:33,274 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/shard-member-1:snapshot-read#2129022995] [WARN] [03/11/2024 13:49:33.274] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/shard-member-1:snapshot-read#2129022995]: org.opendaylight.controller.cluster.common.actor.Monitor@74d343dd 01:49:33,274 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config14 with journal batch size 3 01:49:33,275 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:33,275 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config14: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:33,276 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 01:49:33,276 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 01:49:33,276 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from null to Follower 01:49:33,276 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14 (Follower): Received TimeoutNow - switching to Candidate 01:49:33,276 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14 (Candidate): Election: Candidate has following voting peers: [] 01:49:33,276 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Set currentTerm=1, votedFor=member-1-shard-inventory-config14 01:49:33,276 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config14 (Candidate): Starting new election term 1 01:49:33,276 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config14 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:33,276 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config14 (Follower): Closing 01:49:33,276 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 01:49:33,276 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 01:49:33,276 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:33.276] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@1b648c83 01:49:33,277 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14 (Candidate): Received ElectionTimeout 01:49:33,277 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14 (Leader): Election: Leader has following peers: [] 01:49:33,277 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config14 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:33,277 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: true, hasLeader : true 01:49:33,277 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: became leader with frontend state for [] 01:49:33,277 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Candidate to Leader 01:49:33,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-60-0 01:49:33,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:33,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Readying transaction member-1-ShardTransactionTest-fe-0-txn-60-0, client version 13 01:49:33,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: readying transaction member-1-ShardTransactionTest-fe-0-txn-60-0 01:49:33,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: transaction member-1-ShardTransactionTest-fe-0-txn-60-0 ready 01:49:33,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Validating transaction member-1-ShardTransactionTest-fe-0-txn-60-0 01:49:33,386 PM [test-akka.actor.default-dispatcher-14] [WARN] ShardDataTree - member-1-shard-inventory-config14: Store Tx member-1-ShardTransactionTest-fe-0-txn-60-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:986) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:112) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:242) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleForwardedReadyTransaction(ShardCommitCoordinator.java:116) at org.opendaylight.controller.cluster.datastore.Shard.handleForwardedReadyTransaction(Shard.java:842) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:375) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:33,386 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Store Tx member-1-ShardTransactionTest-fe-0-txn-60-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 01:49:33,386 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-60-0 changing state from CAN_COMMIT_PENDING to FAILED 01:49:33,386 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-60-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:855) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:986) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:112) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:242) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleForwardedReadyTransaction(ShardCommitCoordinator.java:116) at org.opendaylight.controller.cluster.datastore.Shard.handleForwardedReadyTransaction(Shard.java:842) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:375) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) ... 34 more 01:49:33,387 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-61-0 01:49:33,387 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Readying transaction member-1-ShardTransactionTest-fe-0-txn-61-0, client version 13 01:49:33,387 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: readying transaction member-1-ShardTransactionTest-fe-0-txn-61-0 01:49:33,387 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: transaction member-1-ShardTransactionTest-fe-0-txn-61-0 ready 01:49:33,387 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Validating transaction member-1-ShardTransactionTest-fe-0-txn-61-0 01:49:33,387 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 validated 01:49:33,387 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:33,387 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: canCommit for member-1-ShardTransactionTest-fe-0-txn-61-0: success 01:49:33,387 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Committing transaction member-1-ShardTransactionTest-fe-0-txn-61-0 01:49:33,387 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-61-0 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 candidate ready 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-61-0: canCommit - candidate rootPath: / 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-61-0: canCommit - messages: [] 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-61-0: preCommit - successfulFromPrevious: [] 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 prepared 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-61-0 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-61-0 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 submitted to persistence 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from -1 to 0 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:33,388 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config14: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:33,389 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3859927} is already disabled 01:49:33,389 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Persisting ApplyJournalEntries with index=0 01:49:33,389 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:33,389 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from 0 to 1 01:49:33,389 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Applying state for log index 1 data Simple{size=143} 01:49:33,389 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-61-0 01:49:33,389 PM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-61-0: commit - successfulFromPrevious: [] 01:49:33,389 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 changing state from COMMIT_PENDING to COMMITTED 01:49:33,389 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-61-0 committed as 0, sending response to Actor[akka://test/system/testProbe-653#-1805603556] 01:49:33,390 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config14: Created publisher actor Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config14-DTCL-publisher#1266163685] with name member-1-shard-inventory-config14-DTCL-publisher 01:49:33,390 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config14-DTCL-publisher#1266163685] 01:49:33,390 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config14: publishChanges: rootPath: / 01:49:33,390 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: fakeSnapshot purging log to 0 for term 1 01:49:33,390 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Persisting ApplyJournalEntries with index=1 01:49:33,390 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config14: Elapsed time for generation of change events for member-1-shard-inventory-config14-DTCL-publisher: 133.3 μs [WARN] [03/11/2024 13:49:33.390] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config14-DTCL-publisher#1266163685]: org.opendaylight.controller.cluster.common.actor.Monitor@70d4ff44 01:49:33,392 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config14, persistent : true [WARN] [03/11/2024 13:49:33.392] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false]: org.opendaylight.controller.cluster.common.actor.Monitor@6ed1dd71 01:49:33,393 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config14-notifier#1595768783 created and ready for shard:member-1-shard-inventory-config14 [WARN] [03/11/2024 13:49:33.393] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config14-notifier#1595768783]: org.opendaylight.controller.cluster.common.actor.Monitor@6d943570 01:49:33,393 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/shard-member-1:snapshot-read#-103097642] [WARN] [03/11/2024 13:49:33.394] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/shard-member-1:snapshot-read#-103097642]: org.opendaylight.controller.cluster.common.actor.Monitor@48564e5c 01:49:33,394 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config14 with journal batch size 3 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.UpdateElectionTerm from Actor[akka://test/deadLetters] 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: Set currentTerm=1, votedFor=member-1-shard-inventory-config14 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: Received ReplicatedLogEntry for recovery: index: 0, size: 37 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: Received ReplicatedLogEntry for recovery: index: 1, size: 143 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: Received apply journal entries for recovery, applying to state: 0 to 0 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: starting log recovery batch with max size 3 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: ignoring unhandled payload DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from -1 to 0 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 01:49:33,396 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: Received apply journal entries for recovery, applying to state: 1 to 1 01:49:33,400 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config14: Added client Enabled{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@6c8ef2b6}, purged=MutableUnsignedLongSet{size=0}} 01:49:33,400 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config14: Committed transaction member-1-ShardTransactionTest-fe-0-txn-61-0 01:49:33,400 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from 0 to 1 01:49:33,400 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:33,400 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config14: Recovery completed in 4.050 ms - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 2 01:49:33,401 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 01:49:33,401 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 01:49:33,401 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from null to Follower 01:49:33,401 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14 (Follower): Received TimeoutNow - switching to Candidate 01:49:33,401 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14 (Candidate): Election: Candidate has following voting peers: [] 01:49:33,401 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: Set currentTerm=2, votedFor=member-1-shard-inventory-config14 01:49:33,401 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config14 (Candidate): Starting new election term 2 01:49:33,401 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config14 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 01:49:33,401 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config14 (Follower): Closing 01:49:33,401 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 01:49:33,401 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 01:49:33,401 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:33.401] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@2be9c7a2 01:49:33,402 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14 (Candidate): Received ElectionTimeout 01:49:33,402 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14 (Leader): Election: Leader has following peers: [] 01:49:33,402 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config14 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 01:49:33,402 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: true, hasLeader : true 01:49:33,410 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: became leader with frontend state for [member-1-frontend-ShardTransactionTest] 01:49:33,410 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Candidate to Leader 01:49:33,504 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:33,504 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Persist data SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,504 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,505 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-62-0 01:49:33,505 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Readying Tx member-1-ShardTransactionTest-fe-0-txn-62-0 of 1 operations, client version 13 01:49:33,505 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: readying transaction member-1-ShardTransactionTest-fe-0-txn-62-0 01:49:33,505 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: transaction member-1-ShardTransactionTest-fe-0-txn-62-0 ready 01:49:33,505 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Validating transaction member-1-ShardTransactionTest-fe-0-txn-62-0 01:49:33,505 PM [test-akka.actor.default-dispatcher-6] [WARN] ShardDataTree - member-1-shard-inventory-config14: Store Tx member-1-ShardTransactionTest-fe-0-txn-62-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:986) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:112) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:242) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:173) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:745) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:768) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:373) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:33,506 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Store Tx member-1-ShardTransactionTest-fe-0-txn-62-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 01:49:33,506 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-62-0 changing state from CAN_COMMIT_PENDING to FAILED 01:49:33,506 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-62-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:855) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:986) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:99) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:112) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:242) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:173) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:745) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:768) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:373) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) ... 35 more 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-63-0 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Readying Tx member-1-ShardTransactionTest-fe-0-txn-63-0 of 1 operations, client version 13 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: readying transaction member-1-ShardTransactionTest-fe-0-txn-63-0 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: transaction member-1-ShardTransactionTest-fe-0-txn-63-0 ready 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Validating transaction member-1-ShardTransactionTest-fe-0-txn-63-0 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 validated 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: canCommit for member-1-ShardTransactionTest-fe-0-txn-63-0: success 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Committing transaction member-1-ShardTransactionTest-fe-0-txn-63-0 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-63-0 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 candidate ready 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-63-0: canCommit - candidate rootPath: / 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-63-0: canCommit - messages: [] 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-63-0: preCommit - successfulFromPrevious: [] 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 prepared 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-63-0 01:49:33,507 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-63-0 01:49:33,508 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:33,508 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Persist data SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 01:49:33,508 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 01:49:33,508 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 submitted to persistence 01:49:33,509 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: persist complete SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,509 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from 1 to 2 01:49:33,509 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Applying state for log index 2 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:33,509 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:33,509 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=4631006} is already disabled 01:49:33,509 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: fakeSnapshot purging log to 1 for term 2 01:49:33,509 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Persisting ApplyJournalEntries with index=2 01:49:33,510 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: persist complete SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 01:49:33,510 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from 2 to 3 01:49:33,510 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Applying state for log index 3 data Simple{size=143} 01:49:33,510 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-63-0 01:49:33,510 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-63-0: commit - successfulFromPrevious: [] 01:49:33,510 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 changing state from COMMIT_PENDING to COMMITTED 01:49:33,510 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-63-0 committed as 0, sending response to Actor[akka://test/system/testProbe-654#-1336115190] 01:49:33,510 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true] 01:49:33,511 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config14: Created publisher actor Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config14-DTCL-publisher#152161639] with name member-1-shard-inventory-config14-DTCL-publisher 01:49:33,511 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config14-DTCL-publisher#152161639] 01:49:33,511 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: fakeSnapshot purging log to 2 for term 2 01:49:33,511 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config14: Persisting ApplyJournalEntries with index=3 01:49:33,511 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config14: publishChanges: rootPath: / [WARN] [03/11/2024 13:49:33.511] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config14-DTCL-publisher#152161639]: org.opendaylight.controller.cluster.common.actor.Monitor@2abea790 01:49:33,511 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config14: Elapsed time for generation of change events for member-1-shard-inventory-config14-DTCL-publisher: 160.3 μs 01:49:33,521 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config14 01:49:33,521 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config14 (Leader)_slicer-id-263: Closing 01:49:33,521 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Aborting 0 pending queued transactions 01:49:33,521 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false] 01:49:33,521 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config14 01:49:33,521 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config14 (Leader)_slicer-id-265: Closing 01:49:33,522 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Aborting 0 pending queued transactions 01:49:33,523 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config15, persistent : true [WARN] [03/11/2024 13:49:33.523] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@2f3004ab 01:49:33,524 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testCommitPhaseFailure/member-1-shard-inventory-config15-notifier#2121918824 created and ready for shard:member-1-shard-inventory-config15 [WARN] [03/11/2024 13:49:33.524] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitPhaseFailure/member-1-shard-inventory-config15-notifier#2121918824]: org.opendaylight.controller.cluster.common.actor.Monitor@67ded47 01:49:33,525 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitPhaseFailure/shard-member-1:snapshot-read#-1815019036] [WARN] [03/11/2024 13:49:33.525] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitPhaseFailure/shard-member-1:snapshot-read#-1815019036]: org.opendaylight.controller.cluster.common.actor.Monitor@2acd4b3e 01:49:33,525 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config15 with journal batch size 3 01:49:33,526 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:33,526 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config15: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:33,527 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: false, hasLeader : false 01:49:33,527 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config15 is no longer the leader 01:49:33,527 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from null to Follower 01:49:33,527 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15 (Follower): Received TimeoutNow - switching to Candidate 01:49:33,527 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15 (Candidate): Election: Candidate has following voting peers: [] 01:49:33,527 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: Set currentTerm=1, votedFor=member-1-shard-inventory-config15 01:49:33,527 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config15 (Candidate): Starting new election term 1 01:49:33,527 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config15 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:33,527 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config15 (Follower): Closing 01:49:33,527 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: false, hasLeader : false 01:49:33,527 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config15 is no longer the leader 01:49:33,527 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:33.527] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testCommitPhaseFailure]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@40df0b3a 01:49:33,528 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config15 (Candidate): Received ElectionTimeout 01:49:33,528 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config15 (Leader): Election: Leader has following peers: [] 01:49:33,528 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config15 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:33,528 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: true, hasLeader : true 01:49:33,528 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config15: became leader with frontend state for [] 01:49:33,528 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from Candidate to Leader 01:49:33,596 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:33,596 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,596 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,596 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-64-0 01:49:33,597 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: Readying Tx member-1-ShardTransactionTest-fe-0-txn-64-0 of 1 operations, client version 13 01:49:33,597 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: readying transaction member-1-ShardTransactionTest-fe-0-txn-64-0 01:49:33,597 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: transaction member-1-ShardTransactionTest-fe-0-txn-64-0 ready 01:49:33,597 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-65-0 01:49:33,597 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: Readying Tx member-1-ShardTransactionTest-fe-0-txn-65-0 of 1 operations, client version 13 01:49:33,597 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: readying transaction member-1-ShardTransactionTest-fe-0-txn-65-0 01:49:33,597 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: transaction member-1-ShardTransactionTest-fe-0-txn-65-0 ready 01:49:33,598 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-64-0 01:49:33,598 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Validating transaction member-1-ShardTransactionTest-fe-0-txn-64-0 01:49:33,599 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Transaction member-1-ShardTransactionTest-fe-0-txn-64-0 validated 01:49:33,599 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-64-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:33,599 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: canCommit for member-1-ShardTransactionTest-fe-0-txn-64-0: success 01:49:33,599 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-65-0 01:49:33,599 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Tx member-1-ShardTransactionTest-fe-0-txn-65-0 is scheduled for canCommit step 01:49:33,599 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: Committing transaction member-1-ShardTransactionTest-fe-0-txn-64-0 01:49:33,599 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-64-0 01:49:33,599 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Transaction member-1-ShardTransactionTest-fe-0-txn-64-0 candidate ready 01:49:33,599 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-64-0: canCommit - candidate rootPath: / 01:49:33,599 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-64-0: canCommit - messages: [] 01:49:33,599 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-64-0: preCommit - successfulFromPrevious: [] 01:49:33,599 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Transaction member-1-ShardTransactionTest-fe-0-txn-64-0 prepared 01:49:33,600 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-64-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:33,600 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-64-0 01:49:33,600 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-64-0 01:49:33,600 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:33,600 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Validating transaction member-1-ShardTransactionTest-fe-0-txn-65-0 01:49:33,600 PM [test-akka.actor.default-dispatcher-13] [WARN] ShardDataTree - member-1-shard-inventory-config15: Store Tx member-1-ShardTransactionTest-fe-0-txn-65-0: Conflicting modification for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test. 01:49:33,600 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-65-0 changing state from CAN_COMMIT_PENDING to FAILED 01:49:33,600 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-65-0 OptimisticLockFailedException{message=Optimistic lock failed for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, errorList=[RpcError [message=Optimistic lock failed for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, severity=ERROR, errorType=APPLICATION, tag=resource-denied, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.ConflictingModificationAppliedException: Node was created by other transaction.]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:846) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:884) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:831) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCommit(ShardDataTree.java:1134) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.commit(SimpleShardDataTreeCohort.java:150) at org.opendaylight.controller.cluster.datastore.CohortEntry.commit(CohortEntry.java:120) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.finishCommit(ShardCommitCoordinator.java:321) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator$3.onSuccess(ShardCommitCoordinator.java:304) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator$3.onSuccess(ShardCommitCoordinator.java:301) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.successfulPreCommit(SimpleShardDataTreeCohort.java:222) at org.opendaylight.controller.cluster.datastore.ShardDataTree$1.onSuccess(ShardDataTree.java:1052) at org.opendaylight.controller.cluster.datastore.ShardDataTree$1.onSuccess(ShardDataTree.java:1039) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.doUserPreCommit(SimpleShardDataTreeCohort.java:206) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.userPreCommit(SimpleShardDataTreeCohort.java:190) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1039) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:112) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:116) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:301) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:364) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:709) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:381) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.ConflictingModificationAppliedException: Node was created by other transaction. at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkConflicting(SchemaAwareApplyOperation.java:74) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkWriteApplicable(SchemaAwareApplyOperation.java:181) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:111) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.checkChildPreconditions(AbstractNodeContainerModificationStrategy.java:409) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.checkTouchApplicable(AbstractNodeContainerModificationStrategy.java:368) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:110) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractDataTreeTip.validate(AbstractDataTreeTip.java:31) at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:838) ... 45 more 01:49:33,601 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:33,601 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:33,601 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Transaction member-1-ShardTransactionTest-fe-0-txn-64-0 submitted to persistence 01:49:33,601 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,601 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: Moving last applied index from -1 to 0 01:49:33,601 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:33,601 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:33,601 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config15: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:33,601 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=5582740} is already disabled 01:49:33,602 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: Persisting ApplyJournalEntries with index=0 01:49:33,603 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:33,603 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: Moving last applied index from 0 to 1 01:49:33,603 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: Applying state for log index 1 data Simple{size=143} 01:49:33,603 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-64-0 01:49:33,603 PM [test-akka.actor.default-dispatcher-13] [ERROR] ShardDataTree - member-1-shard-inventory-config15: Failed to commit transaction member-1-ShardTransactionTest-fe-0-txn-64-0 java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1083) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:539) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:447) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:996) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:33,603 PM [test-akka.actor.default-dispatcher-13] [ERROR] SimpleShardDataTreeCohort - Transaction failed to commit java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1083) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:539) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:447) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:996) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:33,603 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-64-0: abort - successfulFromPrevious: [] 01:49:33,603 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-64-0 changing state from COMMIT_PENDING to FAILED 01:49:33,603 PM [test-akka.actor.default-dispatcher-13] [ERROR] Shard - member-1-shard-inventory-config15, An exception occurred while committing transaction member-1-ShardTransactionTest-fe-0-txn-64-0 java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1083) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:539) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:447) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:996) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:33,604 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: fakeSnapshot purging log to 0 for term 1 01:49:33,604 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config15: Persisting ApplyJournalEntries with index=1 01:49:33,605 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitPhaseFailure] 01:49:33,616 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config15 01:49:33,616 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config15 (Leader)_slicer-id-267: Closing 01:49:33,616 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config15: Aborting 0 pending queued transactions 01:49:33,618 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config16, persistent : true [WARN] [03/11/2024 13:49:33.618] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitTimeout]: org.opendaylight.controller.cluster.common.actor.Monitor@6bfba5ca 01:49:33,619 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testTransactionCommitTimeout/member-1-shard-inventory-config16-notifier#-1431325269 created and ready for shard:member-1-shard-inventory-config16 [WARN] [03/11/2024 13:49:33.619] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config16-notifier#-1431325269]: org.opendaylight.controller.cluster.common.actor.Monitor@37fc5698 01:49:33,619 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitTimeout/shard-member-1:snapshot-read#-2056731109] [WARN] [03/11/2024 13:49:33.619] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/shard-member-1:snapshot-read#-2056731109]: org.opendaylight.controller.cluster.common.actor.Monitor@63e65e78 01:49:33,620 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config16 with journal batch size 3 01:49:33,621 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:33,621 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config16: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:33,621 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: false, hasLeader : false 01:49:33,621 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config16 is no longer the leader 01:49:33,622 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from null to Follower 01:49:33,622 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16 (Follower): Received TimeoutNow - switching to Candidate 01:49:33,622 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16 (Candidate): Election: Candidate has following voting peers: [] 01:49:33,622 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Set currentTerm=1, votedFor=member-1-shard-inventory-config16 01:49:33,622 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config16 (Candidate): Starting new election term 1 01:49:33,622 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config16 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:33,622 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config16 (Follower): Closing 01:49:33,622 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: false, hasLeader : false 01:49:33,622 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config16 is no longer the leader 01:49:33,622 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:33.623] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testTransactionCommitTimeout]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@6f43f040 01:49:33,623 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16 (Candidate): Received ElectionTimeout 01:49:33,623 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16 (Leader): Election: Leader has following peers: [] 01:49:33,623 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config16 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:33,623 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: true, hasLeader : true 01:49:33,623 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: became leader with frontend state for [] 01:49:33,623 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from Candidate to Leader 01:49:33,719 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:33,719 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,719 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-66-0 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Readying Tx member-1-ShardTransactionTest-fe-0-txn-66-0 of 1 operations, client version 13 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: readying transaction member-1-ShardTransactionTest-fe-0-txn-66-0 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: transaction member-1-ShardTransactionTest-fe-0-txn-66-0 ready 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Validating transaction member-1-ShardTransactionTest-fe-0-txn-66-0 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 validated 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: canCommit for member-1-ShardTransactionTest-fe-0-txn-66-0: success 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Committing transaction member-1-ShardTransactionTest-fe-0-txn-66-0 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-66-0 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 candidate ready 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-66-0: canCommit - candidate rootPath: / 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-66-0: canCommit - messages: [] 01:49:33,720 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-66-0: preCommit - successfulFromPrevious: [] 01:49:33,721 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 prepared 01:49:33,721 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:33,721 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-66-0 01:49:33,721 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-66-0 01:49:33,721 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:33,721 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:33,721 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:33,721 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 submitted to persistence 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Moving last applied index from -1 to 0 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config16: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3666182} is already disabled 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Moving last applied index from 0 to 1 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Applying state for log index 1 data Simple{size=143} 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-66-0 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-66-0: commit - successfulFromPrevious: [] 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 changing state from COMMIT_PENDING to COMMITTED 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-66-0 committed as 0, sending response to Actor[akka://test/temp/testTransactionCommitTimeout$c] 01:49:33,723 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config16: Created publisher actor Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config16-DTCL-publisher#-826752197] with name member-1-shard-inventory-config16-DTCL-publisher 01:49:33,724 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config16-DTCL-publisher#-826752197] 01:49:33,724 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config16: publishChanges: rootPath: / 01:49:33,724 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: fakeSnapshot purging log to 0 for term 1 01:49:33,724 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Persisting ApplyJournalEntries with index=0 [WARN] [03/11/2024 13:49:33.724] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config16-DTCL-publisher#-826752197]: org.opendaylight.controller.cluster.common.actor.Monitor@1b652e82 01:49:33,724 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-67-0 01:49:33,724 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config16: Elapsed time for generation of change events for member-1-shard-inventory-config16-DTCL-publisher: 167.5 μs 01:49:33,724 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Readying Tx member-1-ShardTransactionTest-fe-0-txn-67-0 of 1 operations, client version 13 01:49:33,724 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: readying transaction member-1-ShardTransactionTest-fe-0-txn-67-0 01:49:33,724 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: transaction member-1-ShardTransactionTest-fe-0-txn-67-0 ready 01:49:33,724 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Validating transaction member-1-ShardTransactionTest-fe-0-txn-67-0 01:49:33,724 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 validated 01:49:33,724 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:33,724 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: canCommit for member-1-ShardTransactionTest-fe-0-txn-67-0: success 01:49:33,724 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Committing transaction member-1-ShardTransactionTest-fe-0-txn-67-0 01:49:33,724 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-67-0 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 candidate ready 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-67-0: canCommit - candidate rootPath: / 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-67-0: canCommit - messages: [] 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-67-0: preCommit - successfulFromPrevious: [] 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 prepared 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-67-0 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-67-0 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 submitted to persistence 01:49:33,725 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Persisting ApplyJournalEntries with index=1 01:49:33,727 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 01:49:33,727 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Moving last applied index from 1 to 2 01:49:33,727 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Applying state for log index 2 data Simple{size=45} 01:49:33,727 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-67-0 01:49:33,727 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-67-0: commit - successfulFromPrevious: [] 01:49:33,727 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 changing state from COMMIT_PENDING to COMMITTED 01:49:33,727 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-67-0 committed as 0, sending response to Actor[akka://test/temp/testTransactionCommitTimeout$d] 01:49:33,727 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: fakeSnapshot purging log to 1 for term 1 01:49:33,727 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config16: publishChanges: rootPath: / 01:49:33,727 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config16: Persisting ApplyJournalEntries with index=2 01:49:33,727 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config16: Elapsed time for generation of change events for member-1-shard-inventory-config16-DTCL-publisher: 36.17 μs 01:49:33,737 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-68-0 01:49:33,738 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Readying Tx member-1-ShardTransactionTest-fe-0-txn-68-0 of 1 operations, client version 13 01:49:33,738 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: readying transaction member-1-ShardTransactionTest-fe-0-txn-68-0 01:49:33,738 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: transaction member-1-ShardTransactionTest-fe-0-txn-68-0 ready 01:49:33,738 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-69-0 01:49:33,738 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Readying Tx member-1-ShardTransactionTest-fe-0-txn-69-0 of 1 operations, client version 13 01:49:33,738 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: readying transaction member-1-ShardTransactionTest-fe-0-txn-69-0 01:49:33,738 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: transaction member-1-ShardTransactionTest-fe-0-txn-69-0 ready 01:49:33,738 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-68-0 01:49:33,738 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Validating transaction member-1-ShardTransactionTest-fe-0-txn-68-0 01:49:33,738 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-68-0 validated 01:49:33,738 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-68-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:33,738 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: canCommit for member-1-ShardTransactionTest-fe-0-txn-68-0: success 01:49:33,739 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-69-0 01:49:33,739 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Tx member-1-ShardTransactionTest-fe-0-txn-69-0 is scheduled for canCommit step 01:49:34,295 PM [test-akka.actor.default-dispatcher-13] [WARN] ShardDataTree - member-1-shard-inventory-config16: Current transaction member-1-ShardTransactionTest-fe-0-txn-68-0 has timed out after 556 ms in state CAN_COMMIT_COMPLETE 01:49:34,296 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Validating transaction member-1-ShardTransactionTest-fe-0-txn-69-0 01:49:34,297 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 validated 01:49:34,297 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:34,297 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config16: canCommit for member-1-ShardTransactionTest-fe-0-txn-69-0: success 01:49:34,297 PM [test-akka.actor.default-dispatcher-13] [ERROR] Shard - member-1-shard-inventory-config16: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-68-0 commit java.lang.IllegalStateException: member-1-shard-inventory-config16: Cannot commit transaction member-1-ShardTransactionTest-fe-0-txn-68-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:357) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:709) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:381) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:34,298 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config16: Committing transaction member-1-ShardTransactionTest-fe-0-txn-69-0 01:49:34,298 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-69-0 01:49:34,298 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 candidate ready 01:49:34,298 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-69-0: canCommit - candidate rootPath: / 01:49:34,298 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-69-0: canCommit - messages: [] 01:49:34,298 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-69-0: preCommit - successfulFromPrevious: [] 01:49:34,298 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 prepared 01:49:34,298 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:34,298 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config16: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-69-0 01:49:34,298 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-69-0 01:49:34,299 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:34,299 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config16: Persist data SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 01:49:34,299 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config16: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 01:49:34,299 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 submitted to persistence 01:49:34,300 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: persist complete SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 01:49:34,300 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Moving last applied index from 2 to 3 01:49:34,300 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Applying state for log index 3 data Simple{size=184} 01:49:34,300 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-69-0 01:49:34,300 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-69-0: commit - successfulFromPrevious: [] 01:49:34,300 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 changing state from COMMIT_PENDING to COMMITTED 01:49:34,300 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-69-0 committed as 0, sending response to Actor[akka://test/system/testProbe-658#1591209970] 01:49:34,300 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config16: publishChanges: rootPath: / 01:49:34,300 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: fakeSnapshot purging log to 2 for term 1 01:49:34,300 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Persisting ApplyJournalEntries with index=3 01:49:34,301 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitTimeout] 01:49:34,301 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config16: Elapsed time for generation of change events for member-1-shard-inventory-config16-DTCL-publisher: 112.3 μs 01:49:34,311 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config16 01:49:34,311 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config16 (Leader)_slicer-id-269: Closing 01:49:34,311 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config16: Aborting 0 pending queued transactions 01:49:34,313 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config17, persistent : true 01:49:34,314 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config17 with journal batch size 3 [WARN] [03/11/2024 13:49:34.314] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsOnTransactionChain]: org.opendaylight.controller.cluster.common.actor.Monitor@76e85231 01:49:34,314 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config17-notifier#728133995 created and ready for shard:member-1-shard-inventory-config17 01:49:34,314 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-member-1:snapshot-read#586448575] [WARN] [03/11/2024 13:49:34.314] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config17-notifier#728133995]: org.opendaylight.controller.cluster.common.actor.Monitor@6c674bd2 [WARN] [03/11/2024 13:49:34.314] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-member-1:snapshot-read#586448575]: org.opendaylight.controller.cluster.common.actor.Monitor@7cfbfc71 01:49:34,316 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:34,316 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config17: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:34,316 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,316 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config17 is no longer the leader 01:49:34,316 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17 (Follower): Received TimeoutNow - switching to Candidate 01:49:34,316 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from null to Follower 01:49:34,316 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17 (Candidate): Election: Candidate has following voting peers: [] 01:49:34,316 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: Set currentTerm=1, votedFor=member-1-shard-inventory-config17 [WARN] [03/11/2024 13:49:34.316] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from TestActor[akka://test/user/testBatchedModificationsOnTransactionChain]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@27b64832 01:49:34,316 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config17 (Candidate): Starting new election term 1 01:49:34,316 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config17 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:34,316 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config17 (Follower): Closing 01:49:34,316 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,316 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config17 is no longer the leader 01:49:34,316 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from Follower to Candidate 01:49:34,318 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17 (Candidate): Received ElectionTimeout 01:49:34,318 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17 (Leader): Election: Leader has following peers: [] 01:49:34,318 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config17 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:34,318 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: true, hasLeader : true 01:49:34,318 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: became leader with frontend state for [] 01:49:34,318 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from Candidate to Leader 01:49:34,377 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:34,377 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,377 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,379 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 01:49:34,379 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 01:49:34,379 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeTransactionChain - Opening an unchained snapshot in LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} 01:49:34,379 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeTransactionChain - Allocated read-write transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 snapshot org.opendaylight.yangtools.yang.data.tree.impl.node.Version@22d5e361 01:49:34,380 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 01:49:34,380 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: Readying Tx member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 of 1 operations, client version 13 01:49:34,380 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: readying transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 01:49:34,380 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 ready 01:49:34,380 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeTransactionChain - Committing transaction ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0, closed=true, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]} 01:49:34,382 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Creating transaction : member-1-ShardTransactionTest-fe-0-chn-2-txn-1-0 01:49:34,383 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeTransactionChain - Reusing a chained snapshot in LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} 01:49:34,383 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeTransactionChain - Allocated read-only transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-1-0 snapshot MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 01:49:34,384 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-inventory-member-1:ShardTransactionTest@0:2-1_1#111095665] 01:49:34,384 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,384 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Moving last applied index from -1 to 0 01:49:34,384 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:34,384 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:34,384 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config17: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. [WARN] [03/11/2024 13:49:34.384] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-inventory-member-1:ShardTransactionTest@0:2-1_1#111095665]: org.opendaylight.controller.cluster.common.actor.Monitor@3a6558fe 01:49:34,384 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=7257681} is already disabled 01:49:34,384 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 01:49:34,384 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Moving last applied index from 0 to 1 01:49:34,384 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Applying state for log index 1 data CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39} 01:49:34,385 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: replication of LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} has no callback 01:49:34,385 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: fakeSnapshot purging log to 0 for term 1 01:49:34,385 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Persisting ApplyJournalEntries with index=0 01:49:34,385 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config17: Persisting ApplyJournalEntries with index=1 01:49:34,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config17: Can committing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 01:49:34,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Validating transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 01:49:34,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 validated 01:49:34,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:34,385 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config17: canCommit for member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: success 01:49:34,386 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Committing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 01:49:34,386 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Preparing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 01:49:34,386 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 candidate ready 01:49:34,386 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: canCommit - candidate rootPath: / 01:49:34,386 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: canCommit - messages: [] 01:49:34,386 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: preCommit - successfulFromPrevious: [] 01:49:34,386 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 prepared 01:49:34,386 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:34,386 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 01:49:34,387 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Starting commit for transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 01:49:34,387 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:34,388 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 01:49:34,388 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 01:49:34,388 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 submitted to persistence 01:49:34,388 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 01:49:34,388 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: Moving last applied index from 1 to 2 01:49:34,388 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: Applying state for log index 2 data Simple{size=143} 01:49:34,388 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 01:49:34,388 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: commit - successfulFromPrevious: [] 01:49:34,388 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from COMMIT_PENDING to COMMITTED 01:49:34,388 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ChainedCommitCohort - Committed transaction ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0, closed=true, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, modificationType=SUBTREE_MODIFIED, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE, modificationType=WRITE}}}]} 01:49:34,388 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 committed as 0, sending response to Actor[akka://test/system/testProbe-660#-296071188] 01:49:34,388 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsOnTransactionChain] 01:49:34,388 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config17: Created publisher actor Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config17-DTCL-publisher#-1244746561] with name member-1-shard-inventory-config17-DTCL-publisher 01:49:34,389 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config17-DTCL-publisher#-1244746561] 01:49:34,389 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: fakeSnapshot purging log to 1 for term 1 01:49:34,389 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config17: Persisting ApplyJournalEntries with index=2 01:49:34,389 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config17: publishChanges: rootPath: / [WARN] [03/11/2024 13:49:34.389] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config17-DTCL-publisher#-1244746561]: org.opendaylight.controller.cluster.common.actor.Monitor@500930a6 01:49:34,389 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config17: Elapsed time for generation of change events for member-1-shard-inventory-config17-DTCL-publisher: 124.6 μs 01:49:34,399 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config17 01:49:34,399 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config17 (Leader)_slicer-id-271: Closing 01:49:34,399 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Aborting 0 pending queued transactions 01:49:34,400 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config18, persistent : true [WARN] [03/11/2024 13:49:34.400] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCanCommitBeforeReadyFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@24e883af 01:49:34,401 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testCanCommitBeforeReadyFailure/member-1-shard-inventory-config18-notifier#264982589 created and ready for shard:member-1-shard-inventory-config18 [WARN] [03/11/2024 13:49:34.401] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitBeforeReadyFailure/member-1-shard-inventory-config18-notifier#264982589]: org.opendaylight.controller.cluster.common.actor.Monitor@5411e59e 01:49:34,401 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCanCommitBeforeReadyFailure/shard-member-1:snapshot-read#529897523] 01:49:34,401 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config18 with journal batch size 3 [WARN] [03/11/2024 13:49:34.401] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitBeforeReadyFailure/shard-member-1:snapshot-read#529897523]: org.opendaylight.controller.cluster.common.actor.Monitor@79c98bf7 01:49:34,402 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:34,402 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config18: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:34,402 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config18: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,402 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config18 is no longer the leader 01:49:34,402 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config18 , received role change from null to Follower 01:49:34,402 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18 (Follower): Received TimeoutNow - switching to Candidate 01:49:34,402 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18 (Candidate): Election: Candidate has following voting peers: [] 01:49:34,402 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Set currentTerm=1, votedFor=member-1-shard-inventory-config18 01:49:34,402 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config18 (Candidate): Starting new election term 1 01:49:34,402 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config18 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:34,402 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config18 (Follower): Closing 01:49:34,403 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config18: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,403 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config18 is no longer the leader 01:49:34,403 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config18 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:34.403] [test-akka.actor.default-dispatcher-19] [akka://test/user] unhandled message from TestActor[akka://test/user/testCanCommitBeforeReadyFailure]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@5138aaa2 01:49:34,403 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18 (Candidate): Received ElectionTimeout 01:49:34,403 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18 (Leader): Election: Leader has following peers: [] 01:49:34,403 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config18 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:34,403 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config18: onLeadershipChange, isLeader: true, hasLeader : true 01:49:34,403 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config18: became leader with frontend state for [] 01:49:34,403 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config18 , received role change from Candidate to Leader 01:49:34,412 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-70-0 01:49:34,412 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:34,412 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,412 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,412 PM [test-akka.actor.default-dispatcher-14] [ERROR] Shard - member-1-shard-inventory-config18: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-70-0 canCommit java.lang.IllegalStateException: member-1-shard-inventory-config18: Cannot canCommit transaction member-1-ShardTransactionTest-fe-0-txn-70-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:282) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:727) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:379) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:34,412 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCanCommitBeforeReadyFailure] 01:49:34,413 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,413 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Moving last applied index from -1 to 0 01:49:34,413 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:34,413 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:34,413 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config18: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:34,413 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1293882} is already disabled 01:49:34,413 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Persisting ApplyJournalEntries with index=0 01:49:34,423 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config18 01:49:34,423 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config18 (Leader)_slicer-id-273: Closing 01:49:34,423 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Aborting 0 pending queued transactions 01:49:34,425 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config19, persistent : true 01:49:34,426 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config19 with journal batch size 3 [WARN] [03/11/2024 13:49:34.426] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady]: org.opendaylight.controller.cluster.common.actor.Monitor@204ef6b1 01:49:34,426 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config19-notifier#-1002835167 created and ready for shard:member-1-shard-inventory-config19 01:49:34,426 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/shard-member-1:snapshot-read#-728033747] [WARN] [03/11/2024 13:49:34.427] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config19-notifier#-1002835167]: org.opendaylight.controller.cluster.common.actor.Monitor@7dee85d3 [WARN] [03/11/2024 13:49:34.427] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/shard-member-1:snapshot-read#-728033747]: org.opendaylight.controller.cluster.common.actor.Monitor@649254fc 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config19: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config19: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config19: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config19 is no longer the leader 01:49:34,430 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from null to Follower 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config19 (Follower): Received TimeoutNow - switching to Candidate 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config19 (Candidate): Election: Candidate has following voting peers: [] 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config19: Set currentTerm=1, votedFor=member-1-shard-inventory-config19 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config19 (Candidate): Starting new election term 1 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config19 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config19 (Follower): Closing 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config19: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config19 is no longer the leader [WARN] [03/11/2024 13:49:34.430] [test-akka.actor.default-dispatcher-19] [akka://test/user] unhandled message from TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@796b4227 01:49:34,430 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from Follower to Candidate 01:49:34,431 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config19 (Candidate): Received ElectionTimeout 01:49:34,431 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config19 (Leader): Election: Leader has following peers: [] 01:49:34,431 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config19 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:34,431 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: true, hasLeader : true 01:49:34,431 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config19: became leader with frontend state for [] 01:49:34,431 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from Candidate to Leader 01:49:34,491 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:34,491 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,491 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,491 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-71-0 01:49:34,492 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-71-0 01:49:34,492 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-71-0 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Readying Tx member-1-ShardTransactionTest-fe-0-txn-71-0 of 3 operations, client version 13 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: readying transaction member-1-ShardTransactionTest-fe-0-txn-71-0 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: transaction member-1-ShardTransactionTest-fe-0-txn-71-0 ready 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Validating transaction member-1-ShardTransactionTest-fe-0-txn-71-0 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 validated 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: canCommit for member-1-ShardTransactionTest-fe-0-txn-71-0: success 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Committing transaction member-1-ShardTransactionTest-fe-0-txn-71-0 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-71-0 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 candidate ready 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-71-0: canCommit - candidate rootPath: / 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-71-0: canCommit - messages: [] 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-71-0: preCommit - successfulFromPrevious: [] 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 prepared 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-71-0 01:49:34,493 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-71-0 01:49:34,494 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 01:49:34,494 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 01:49:34,494 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 01:49:34,494 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 submitted to persistence 01:49:34,494 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,494 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Moving last applied index from -1 to 0 01:49:34,494 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:34,494 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:34,494 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config19: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:34,494 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3112768} is already disabled 01:49:34,494 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Persisting ApplyJournalEntries with index=0 01:49:34,494 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 01:49:34,495 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Moving last applied index from 0 to 1 01:49:34,495 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Applying state for log index 1 data Simple{size=175} 01:49:34,495 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-71-0 01:49:34,495 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-71-0: commit - successfulFromPrevious: [] 01:49:34,495 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 changing state from COMMIT_PENDING to COMMITTED 01:49:34,495 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-71-0 committed as 0, sending response to Actor[akka://test/system/testProbe-664#1836193562] 01:49:34,495 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady] 01:49:34,495 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config19: Created publisher actor Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config19-DTCL-publisher#189090287] with name member-1-shard-inventory-config19-DTCL-publisher 01:49:34,496 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: fakeSnapshot purging log to 0 for term 1 01:49:34,496 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config19: Persisting ApplyJournalEntries with index=1 01:49:34,496 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config19-DTCL-publisher#189090287] 01:49:34,496 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config19: publishChanges: rootPath: / 01:49:34,496 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config19: Elapsed time for generation of change events for member-1-shard-inventory-config19-DTCL-publisher: 142.3 μs [WARN] [03/11/2024 13:49:34.497] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config19-DTCL-publisher#189090287]: org.opendaylight.controller.cluster.common.actor.Monitor@6f0aa5fd 01:49:34,505 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Stopping Shard member-1-shard-inventory-config19 01:49:34,505 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageSlicer - member-1-shard-inventory-config19 (Leader)_slicer-id-275: Closing 01:49:34,506 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config19: Aborting 0 pending queued transactions 01:49:34,508 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config20, persistent : true [WARN] [03/11/2024 13:49:34.509] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testApplyState]: org.opendaylight.controller.cluster.common.actor.Monitor@38aab856 01:49:34,509 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testApplyState/member-1-shard-inventory-config20-notifier#2048359512 created and ready for shard:member-1-shard-inventory-config20 [WARN] [03/11/2024 13:49:34.509] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/member-1-shard-inventory-config20-notifier#2048359512]: org.opendaylight.controller.cluster.common.actor.Monitor@1e613bc 01:49:34,509 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testApplyState/shard-member-1:snapshot-read#-192392863] [WARN] [03/11/2024 13:49:34.509] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/shard-member-1:snapshot-read#-192392863]: org.opendaylight.controller.cluster.common.actor.Monitor@bb8ac90 01:49:34,509 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config20 with journal batch size 3 01:49:34,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config20: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:34,519 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config20: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:34,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config20: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config20 is no longer the leader 01:49:34,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config20 (Follower): Received TimeoutNow - switching to Candidate 01:49:34,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config20 (Candidate): Election: Candidate has following voting peers: [] 01:49:34,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config20: Set currentTerm=1, votedFor=member-1-shard-inventory-config20 01:49:34,519 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config20 (Candidate): Starting new election term 1 01:49:34,519 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config20 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:34,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config20 (Follower): Closing 01:49:34,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config20: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config20 is no longer the leader 01:49:34,519 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from null to Follower 01:49:34,519 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:34.519] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testApplyState]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@2434a0f9 01:49:34,520 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config20 (Candidate): Received ElectionTimeout 01:49:34,520 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config20 (Leader): Election: Leader has following peers: [] 01:49:34,520 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config20 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:34,520 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: true, hasLeader : true 01:49:34,520 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config20: became leader with frontend state for [] 01:49:34,520 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from Candidate to Leader 01:49:34,609 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:34,609 PM [main] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Applying foreign transaction member-1-ShardTransactionTest-fe-0-txn-72-0 01:49:34,609 PM [main] [DEBUG] FrontendMetadata - member-1-shard-inventory-config20: Added client Enabled{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@3ba4b2b6}, purged=MutableUnsignedLongSet{size=0}} 01:49:34,609 PM [main] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config20: Committed transaction member-1-ShardTransactionTest-fe-0-txn-72-0 01:49:34,610 PM [main] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config20: Created publisher actor Actor[akka://test/user/testApplyState/member-1-shard-inventory-config20-DTCL-publisher#383155590] with name member-1-shard-inventory-config20-DTCL-publisher 01:49:34,610 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testApplyState/member-1-shard-inventory-config20-DTCL-publisher#383155590] 01:49:34,610 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config20: publishChanges: rootPath: / [WARN] [03/11/2024 13:49:34.610] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/member-1-shard-inventory-config20-DTCL-publisher#383155590]: org.opendaylight.controller.cluster.common.actor.Monitor@7fe47594 01:49:34,611 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config20: Elapsed time for generation of change events for member-1-shard-inventory-config20-DTCL-publisher: 247.0 μs 01:49:34,686 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testApplyState] 01:49:34,696 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config20 01:49:34,696 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config20 (Leader)_slicer-id-277: Closing 01:49:34,696 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config20: Aborting 0 pending queued transactions 01:49:34,699 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config21, persistent : true [WARN] [03/11/2024 13:49:34.699] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$u/testServerRemoved#949104655]: org.opendaylight.controller.cluster.common.actor.Monitor@265c689f 01:49:34,700 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/$$u/testServerRemoved/member-1-shard-inventory-config21-notifier#815267094 created and ready for shard:member-1-shard-inventory-config21 [WARN] [03/11/2024 13:49:34.700] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$u/testServerRemoved/member-1-shard-inventory-config21-notifier#815267094]: org.opendaylight.controller.cluster.common.actor.Monitor@2447043b 01:49:34,700 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$$u/testServerRemoved/shard-member-1:snapshot-read#1438648988] [WARN] [03/11/2024 13:49:34.700] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$u/testServerRemoved/shard-member-1:snapshot-read#1438648988]: org.opendaylight.controller.cluster.common.actor.Monitor@113efb64 01:49:34,700 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config21 with journal batch size 3 01:49:34,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config21: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:34,701 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config21: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:34,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,701 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config21: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config21 is no longer the leader 01:49:34,701 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from null to Follower 01:49:34,703 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config21 (Follower): Received TimeoutNow - switching to Candidate 01:49:34,703 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config21 (Candidate): Election: Candidate has following voting peers: [] 01:49:34,703 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config21: Set currentTerm=1, votedFor=member-1-shard-inventory-config21 01:49:34,703 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config21 (Candidate): Starting new election term 1 01:49:34,703 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config21 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:34,703 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config21 (Follower): Closing 01:49:34,703 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,703 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config21: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config21 is no longer the leader 01:49:34,703 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from Follower to Candidate 01:49:34,704 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21 (Candidate): Received ElectionTimeout 01:49:34,704 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21 (Leader): Election: Leader has following peers: [] 01:49:34,704 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config21 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:34,704 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: true, hasLeader : true 01:49:34,704 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config21: became leader with frontend state for [] 01:49:34,704 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from Candidate to Leader 01:49:34,748 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$u] 01:49:34,759 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Stopping Shard member-1-shard-inventory-config21 01:49:34,759 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageSlicer - member-1-shard-inventory-config21 (Leader)_slicer-id-279: Closing 01:49:34,759 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config21: Aborting 0 pending queued transactions 01:49:34,761 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Shard created : member-1-shard-inventory-config22, persistent : true [WARN] [03/11/2024 13:49:34.761] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithOperationFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@6936ffe0 01:49:34,762 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testBatchedModificationsWithOperationFailure/member-1-shard-inventory-config22-notifier#752485973 created and ready for shard:member-1-shard-inventory-config22 [WARN] [03/11/2024 13:49:34.762] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithOperationFailure/member-1-shard-inventory-config22-notifier#752485973]: org.opendaylight.controller.cluster.common.actor.Monitor@1a369c43 01:49:34,762 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithOperationFailure/shard-member-1:snapshot-read#898856812] [WARN] [03/11/2024 13:49:34.762] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithOperationFailure/shard-member-1:snapshot-read#898856812]: org.opendaylight.controller.cluster.common.actor.Monitor@52fd5ecd 01:49:34,762 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Starting recovery for member-1-shard-inventory-config22 with journal batch size 3 01:49:34,766 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:34,766 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config22: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [03/11/2024 13:49:34.766] [test-akka.actor.default-dispatcher-19] [akka://test/user] unhandled message from TestActor[akka://test/user/testBatchedModificationsWithOperationFailure]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@1d0bdc8 01:49:34,766 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,766 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 01:49:34,766 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from null to Follower 01:49:34,766 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22 (Follower): Received TimeoutNow - switching to Candidate 01:49:34,766 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Election: Candidate has following voting peers: [] 01:49:34,766 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Set currentTerm=1, votedFor=member-1-shard-inventory-config22 01:49:34,766 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config22 (Candidate): Starting new election term 1 01:49:34,766 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config22 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:34,766 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config22 (Follower): Closing 01:49:34,767 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,767 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 01:49:34,767 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Follower to Candidate 01:49:34,767 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Received ElectionTimeout 01:49:34,767 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Election: Leader has following peers: [] 01:49:34,767 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config22 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:34,767 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: true, hasLeader : true 01:49:34,767 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config22: became leader with frontend state for [] 01:49:34,768 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Candidate to Leader 01:49:34,872 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:34,872 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,872 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,872 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-73-0 01:49:34,873 PM [test-akka.actor.default-dispatcher-14] [ERROR] Shard - member-1-shard-inventory-config22: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-73-0 org.opendaylight.yangtools.yang.data.tree.api.SchemaValidationFailedException: Node (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:junk?revision=2014-03-13)junk is not a valid child of (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test according to the schema. at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.recursivelyVerifyStructure(AbstractNodeContainerModificationStrategy.java:157) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.mergeIntoModifiedNode(AbstractNodeContainerModificationStrategy.java:263) at org.opendaylight.yangtools.yang.data.tree.impl.OperationWithModification.merge(OperationWithModification.java:48) at org.opendaylight.yangtools.yang.data.tree.impl.InMemoryDataTreeModification.merge(InMemoryDataTreeModification.java:108) at org.opendaylight.controller.cluster.datastore.modification.MergeModification.apply(MergeModification.java:48) at org.opendaylight.controller.cluster.datastore.CohortEntry.applyModifications(CohortEntry.java:102) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:147) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:745) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:768) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:373) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:34,874 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Applying 0 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-73-0 01:49:34,874 PM [test-akka.actor.default-dispatcher-14] [ERROR] Shard - member-1-shard-inventory-config22: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-73-0 org.opendaylight.yangtools.yang.data.tree.api.SchemaValidationFailedException: Node (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:junk?revision=2014-03-13)junk is not a valid child of (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test according to the schema. at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.recursivelyVerifyStructure(AbstractNodeContainerModificationStrategy.java:157) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.mergeIntoModifiedNode(AbstractNodeContainerModificationStrategy.java:263) at org.opendaylight.yangtools.yang.data.tree.impl.OperationWithModification.merge(OperationWithModification.java:48) at org.opendaylight.yangtools.yang.data.tree.impl.InMemoryDataTreeModification.merge(InMemoryDataTreeModification.java:108) at org.opendaylight.controller.cluster.datastore.modification.MergeModification.apply(MergeModification.java:48) at org.opendaylight.controller.cluster.datastore.CohortEntry.applyModifications(CohortEntry.java:102) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:147) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:745) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:768) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:373) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:34,874 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithOperationFailure] 01:49:34,874 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,874 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Moving last applied index from -1 to 0 01:49:34,874 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:34,874 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:34,874 PM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config22: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:34,874 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2589175} is already disabled 01:49:34,875 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Persisting ApplyJournalEntries with index=0 01:49:34,885 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config22 01:49:34,885 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config22 (Leader)_slicer-id-281: Closing 01:49:34,885 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Aborting 0 pending queued transactions 01:49:34,888 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - Shard created : member-1-shard-inventory-config24, persistent : true [WARN] [03/11/2024 13:49:34.888] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCreateSnapshot]: org.opendaylight.controller.cluster.common.actor.Monitor@1473cbfe 01:49:34,889 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testCreateSnapshot/member-1-shard-inventory-config24-notifier#-1444090973 created and ready for shard:member-1-shard-inventory-config24 [WARN] [03/11/2024 13:49:34.889] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config24-notifier#-1444090973]: org.opendaylight.controller.cluster.common.actor.Monitor@2d580d2a 01:49:34,889 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateSnapshot/shard-member-1:snapshot-read#807212905] [WARN] [03/11/2024 13:49:34.889] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/shard-member-1:snapshot-read#807212905]: org.opendaylight.controller.cluster.common.actor.Monitor@1f9bedf7 01:49:34,890 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - Starting recovery for member-1-shard-inventory-config24 with journal batch size 3 01:49:34,891 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:34,891 PM [test-akka.actor.default-dispatcher-19] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:34,891 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config24: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,891 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config24 is no longer the leader 01:49:34,891 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config24 , received role change from null to Follower 01:49:34,891 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24 (Follower): Received TimeoutNow - switching to Candidate 01:49:34,891 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24 (Candidate): Election: Candidate has following voting peers: [] 01:49:34,892 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Set currentTerm=1, votedFor=member-1-shard-inventory-config24 01:49:34,892 PM [test-akka.actor.default-dispatcher-19] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24 (Candidate): Starting new election term 1 01:49:34,892 PM [test-akka.actor.default-dispatcher-19] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:34,892 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageAssembler - member-1-shard-inventory-config24 (Follower): Closing 01:49:34,892 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config24: onLeadershipChange, isLeader: false, hasLeader : false 01:49:34,892 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config24 is no longer the leader 01:49:34,892 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config24 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:34.892] [test-akka.actor.default-dispatcher-19] [akka://test/user] unhandled message from TestActor[akka://test/user/testCreateSnapshot]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@477540e0 01:49:34,892 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24 (Candidate): Received ElectionTimeout 01:49:34,892 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24 (Leader): Election: Leader has following peers: [] 01:49:34,893 PM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:34,893 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config24: onLeadershipChange, isLeader: true, hasLeader : true 01:49:34,893 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: became leader with frontend state for [] 01:49:34,893 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config24 , received role change from Candidate to Leader 01:49:34,988 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:34,988 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,988 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-74-0 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Readying Tx member-1-ShardTransactionTest-fe-0-txn-74-0 of 1 operations, client version 13 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: readying transaction member-1-ShardTransactionTest-fe-0-txn-74-0 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: transaction member-1-ShardTransactionTest-fe-0-txn-74-0 ready 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Validating transaction member-1-ShardTransactionTest-fe-0-txn-74-0 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 validated 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: canCommit for member-1-ShardTransactionTest-fe-0-txn-74-0: success 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Committing transaction member-1-ShardTransactionTest-fe-0-txn-74-0 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-74-0 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 candidate ready 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-74-0: canCommit - candidate rootPath: / 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-74-0: canCommit - messages: [] 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-74-0: preCommit - successfulFromPrevious: [] 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 prepared 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-74-0 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-74-0 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:34,989 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:34,990 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 submitted to persistence 01:49:34,995 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:34,995 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Moving last applied index from -1 to 0 01:49:34,995 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:34,995 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:34,995 PM [test-akka.actor.default-dispatcher-19] [DEBUG] FrontendMetadata - member-1-shard-inventory-config24: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:34,995 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=7094718} is already disabled 01:49:34,995 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:34,995 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Moving last applied index from 0 to 1 01:49:34,995 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Applying state for log index 1 data Simple{size=143} 01:49:34,995 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-74-0 01:49:34,995 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-74-0: commit - successfulFromPrevious: [] 01:49:34,995 PM [test-akka.actor.default-dispatcher-19] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 changing state from COMMIT_PENDING to COMMITTED 01:49:34,996 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-74-0 committed as 0, sending response to Actor[akka://test/temp/testCreateSnapshot$e] 01:49:34,996 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config24: Created publisher actor Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config24-DTCL-publisher#1268175363] with name member-1-shard-inventory-config24-DTCL-publisher 01:49:34,996 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config24-DTCL-publisher#1268175363] 01:49:34,996 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: fakeSnapshot purging log to 0 for term 1 01:49:34,996 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config24: publishChanges: rootPath: / [WARN] [03/11/2024 13:49:34.996] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config24-DTCL-publisher#1268175363]: org.opendaylight.controller.cluster.common.actor.Monitor@73fbde3c 01:49:34,997 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Persisting ApplyJournalEntries with index=0 01:49:34,997 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config24: Elapsed time for generation of change events for member-1-shard-inventory-config24-DTCL-publisher: 206.2 μs 01:49:34,997 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Persisting ApplyJournalEntries with index=1 01:49:35,80 PM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 01:49:35,80 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: lastSequenceNumber prior to capture: 5 01:49:35,80 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{identifer=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 01:49:35,81 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: CaptureSnapshotReply received by actor 01:49:35,81 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=1, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@17fdcd81, electionTerm=1, electionVotedFor=member-1-shard-inventory-config24, ServerConfigPayload=null] 01:49:35,81 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 0 and term: 1 01:49:35,83 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: SaveSnapshotSuccess received for snapshot, sequenceNr: 5 01:49:35,83 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Snapshot success - sequence number: 5 01:49:35,83 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: SnapshotComplete received 01:49:35,84 PM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 01:49:35,84 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: lastSequenceNumber prior to capture: 5 01:49:35,84 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{identifer=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 01:49:35,84 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: handled a snapshot response 01:49:35,84 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: handled a journal response 01:49:35,84 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: CaptureSnapshotReply received by actor 01:49:35,84 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=1, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@1aef34e, electionTerm=1, electionVotedFor=member-1-shard-inventory-config24, ServerConfigPayload=null] 01:49:35,84 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 0 and term: 1 01:49:35,90 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: SaveSnapshotSuccess received for snapshot, sequenceNr: 5 01:49:35,90 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Snapshot success - sequence number: 5 01:49:35,90 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: SnapshotComplete received 01:49:35,90 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCreateSnapshot] 01:49:35,90 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: handled a snapshot response 01:49:35,91 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: handled a journal response 01:49:35,101 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1TestShard - Stopping Shard member-1-shard-inventory-config24 01:49:35,101 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config24 (Leader)_slicer-id-283: Closing 01:49:35,101 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Aborting 0 pending queued transactions 01:49:35,104 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config25, persistent : true [WARN] [03/11/2024 13:49:35.104] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries]: org.opendaylight.controller.cluster.common.actor.Monitor@72c296f3 01:49:35,105 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testTransactionCommitWithPriorExpiredCohortEntries/member-1-shard-inventory-config25-notifier#1129580965 created and ready for shard:member-1-shard-inventory-config25 [WARN] [03/11/2024 13:49:35.105] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/member-1-shard-inventory-config25-notifier#1129580965]: org.opendaylight.controller.cluster.common.actor.Monitor@384d87e 01:49:35,105 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/shard-member-1:snapshot-read#-244650691] [WARN] [03/11/2024 13:49:35.105] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/shard-member-1:snapshot-read#-244650691]: org.opendaylight.controller.cluster.common.actor.Monitor@7e4229b3 01:49:35,105 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config25 with journal batch size 3 01:49:35,107 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config25: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:35,107 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config25: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:35,107 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config25: onLeadershipChange, isLeader: false, hasLeader : false 01:49:35,107 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config25: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config25 is no longer the leader [WARN] [03/11/2024 13:49:35.107] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@6748c5c4 01:49:35,107 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config25 , received role change from null to Follower 01:49:35,107 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config25 (Follower): Received TimeoutNow - switching to Candidate 01:49:35,107 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config25 (Candidate): Election: Candidate has following voting peers: [] 01:49:35,107 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config25: Set currentTerm=1, votedFor=member-1-shard-inventory-config25 01:49:35,107 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config25 (Candidate): Starting new election term 1 01:49:35,107 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config25 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:35,107 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageAssembler - member-1-shard-inventory-config25 (Follower): Closing 01:49:35,107 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config25: onLeadershipChange, isLeader: false, hasLeader : false 01:49:35,107 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config25: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config25 is no longer the leader 01:49:35,107 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config25 , received role change from Follower to Candidate 01:49:35,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config25 (Candidate): Received ElectionTimeout 01:49:35,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config25 (Leader): Election: Leader has following peers: [] 01:49:35,108 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config25 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:35,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config25: onLeadershipChange, isLeader: true, hasLeader : true 01:49:35,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config25: became leader with frontend state for [] 01:49:35,108 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config25 , received role change from Candidate to Leader 01:49:35,119 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config25: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:35,120 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config25: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:35,120 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config25: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:35,120 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config25: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-75-0 01:49:35,120 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config25: Readying Tx member-1-ShardTransactionTest-fe-0-txn-75-0 of 1 operations, client version 13 01:49:35,120 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: readying transaction member-1-ShardTransactionTest-fe-0-txn-75-0 01:49:35,120 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: transaction member-1-ShardTransactionTest-fe-0-txn-75-0 ready 01:49:35,121 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config25: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:35,121 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config25: Moving last applied index from -1 to 0 01:49:35,121 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config25: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:35,121 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config25: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:35,121 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config25: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:35,121 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config25: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1527328} is already disabled 01:49:35,121 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config25: Persisting ApplyJournalEntries with index=0 01:49:35,122 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config25: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-76-0 01:49:35,122 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config25: Readying Tx member-1-ShardTransactionTest-fe-0-txn-76-0 of 1 operations, client version 13 01:49:35,122 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: readying transaction member-1-ShardTransactionTest-fe-0-txn-76-0 01:49:35,122 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: transaction member-1-ShardTransactionTest-fe-0-txn-76-0 ready 01:49:35,122 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config25: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-77-0 01:49:35,122 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config25: Readying Tx member-1-ShardTransactionTest-fe-0-txn-77-0 of 1 operations, client version 13 01:49:35,122 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: readying transaction member-1-ShardTransactionTest-fe-0-txn-77-0 01:49:35,122 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: transaction member-1-ShardTransactionTest-fe-0-txn-77-0 ready 01:49:35,122 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config25: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-77-0 01:49:35,122 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: Tx member-1-ShardTransactionTest-fe-0-txn-77-0 is scheduled for canCommit step 01:49:35,786 PM [test-akka.actor.default-dispatcher-12] [WARN] ShardDataTree - member-1-shard-inventory-config25: Current transaction member-1-ShardTransactionTest-fe-0-txn-75-0 has timed out after 665 ms in state READY 01:49:35,956 PM [test-akka.actor.default-dispatcher-12] [WARN] ShardDataTree - member-1-shard-inventory-config25: Current transaction member-1-ShardTransactionTest-fe-0-txn-76-0 has timed out after 833 ms in state READY 01:49:35,956 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: Validating transaction member-1-ShardTransactionTest-fe-0-txn-77-0 01:49:35,956 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: Transaction member-1-ShardTransactionTest-fe-0-txn-77-0 validated 01:49:35,956 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-77-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:35,956 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config25: canCommit for member-1-ShardTransactionTest-fe-0-txn-77-0: success 01:49:35,956 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries] 01:49:35,967 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config25 01:49:35,967 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config25 (Leader)_slicer-id-285: Closing 01:49:35,967 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config25: Aborting 1 pending queued transactions 01:49:35,970 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config26, persistent : true 01:49:35,971 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config26 with journal batch size 3 [WARN] [03/11/2024 13:49:35.971] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyWithImmediateCommit-true]: org.opendaylight.controller.cluster.common.actor.Monitor@2855831b 01:49:35,971 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config26-notifier#1139898869 created and ready for shard:member-1-shard-inventory-config26 01:49:35,971 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-true/shard-member-1:snapshot-read#1788309115] [WARN] [03/11/2024 13:49:35.971] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config26-notifier#1139898869]: org.opendaylight.controller.cluster.common.actor.Monitor@69efa47b [WARN] [03/11/2024 13:49:35.971] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/shard-member-1:snapshot-read#1788309115]: org.opendaylight.controller.cluster.common.actor.Monitor@4481f3f6 01:49:35,972 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config26: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:35,972 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config26: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:35,973 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: false, hasLeader : false 01:49:35,973 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config26: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config26 is no longer the leader [WARN] [03/11/2024 13:49:35.973] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testReadyWithImmediateCommit-true]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@552d5ac4 01:49:35,973 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from null to Follower 01:49:35,973 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config26 (Follower): Received TimeoutNow - switching to Candidate 01:49:35,973 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config26 (Candidate): Election: Candidate has following voting peers: [] 01:49:35,973 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config26: Set currentTerm=1, votedFor=member-1-shard-inventory-config26 01:49:35,973 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config26 (Candidate): Starting new election term 1 01:49:35,973 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config26 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:35,973 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config26 (Follower): Closing 01:49:35,973 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: false, hasLeader : false 01:49:35,973 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config26: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config26 is no longer the leader 01:49:35,973 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from Follower to Candidate 01:49:35,974 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config26 (Candidate): Received ElectionTimeout 01:49:35,974 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config26 (Leader): Election: Leader has following peers: [] 01:49:35,974 PM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config26 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:35,974 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: true, hasLeader : true 01:49:35,974 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config26: became leader with frontend state for [] 01:49:35,974 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from Candidate to Leader 01:49:36,35 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-78-0 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: Readying transaction member-1-ShardTransactionTest-fe-0-txn-78-0, client version 13 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: readying transaction member-1-ShardTransactionTest-fe-0-txn-78-0 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: transaction member-1-ShardTransactionTest-fe-0-txn-78-0 ready 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Validating transaction member-1-ShardTransactionTest-fe-0-txn-78-0 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Transaction member-1-ShardTransactionTest-fe-0-txn-78-0 validated 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-78-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: canCommit for member-1-ShardTransactionTest-fe-0-txn-78-0: success 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: Committing transaction member-1-ShardTransactionTest-fe-0-txn-78-0 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-78-0 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Transaction member-1-ShardTransactionTest-fe-0-txn-78-0 candidate ready 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-78-0: canCommit - candidate rootPath: / 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-78-0: canCommit - messages: [] 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-78-0: preCommit - successfulFromPrevious: [] 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Transaction member-1-ShardTransactionTest-fe-0-txn-78-0 prepared 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-78-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-78-0 01:49:36,36 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-78-0 01:49:36,37 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:36,37 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:36,37 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:36,37 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Transaction member-1-ShardTransactionTest-fe-0-txn-78-0 submitted to persistence 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Moving last applied index from -1 to 0 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config26: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3085578} is already disabled 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Moving last applied index from 0 to 1 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Applying state for log index 1 data Simple{size=143} 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-78-0 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-78-0: commit - successfulFromPrevious: [] 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-78-0 changing state from COMMIT_PENDING to COMMITTED 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Transaction member-1-ShardTransactionTest-fe-0-txn-78-0 committed as 0, sending response to Actor[akka://test/system/testProbe-673#-174796436] 01:49:36,39 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config26: Created publisher actor Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config26-DTCL-publisher#1208243519] with name member-1-shard-inventory-config26-DTCL-publisher 01:49:36,40 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: fakeSnapshot purging log to 0 for term 1 01:49:36,40 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Persisting ApplyJournalEntries with index=0 01:49:36,40 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config26-DTCL-publisher#1208243519] 01:49:36,40 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Persisting ApplyJournalEntries with index=1 01:49:36,40 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config26: publishChanges: rootPath: / [WARN] [03/11/2024 13:49:36.040] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config26-DTCL-publisher#1208243519]: org.opendaylight.controller.cluster.common.actor.Monitor@32f7a1ce 01:49:36,41 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config26: Elapsed time for generation of change events for member-1-shard-inventory-config26-DTCL-publisher: 139.7 μs 01:49:36,41 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyWithImmediateCommit-true] 01:49:36,51 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config26 01:49:36,51 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config26 (Leader)_slicer-id-287: Closing 01:49:36,51 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config26: Aborting 0 pending queued transactions 01:49:36,53 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config27, persistent : true [WARN] [03/11/2024 13:49:36.053] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRegisterRoleChangeListener]: org.opendaylight.controller.cluster.common.actor.Monitor@59711cc7 01:49:36,53 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRegisterRoleChangeListener/shard-member-1:snapshot-read#-727865143] 01:49:36,54 PM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testRegisterRoleChangeListener/member-1-shard-inventory-config27-notifier#-1339700527 created and ready for shard:member-1-shard-inventory-config27 01:49:36,54 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config27 with journal batch size 3 [WARN] [03/11/2024 13:49:36.054] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterRoleChangeListener/member-1-shard-inventory-config27-notifier#-1339700527]: org.opendaylight.controller.cluster.common.actor.Monitor@9e5e04c [WARN] [03/11/2024 13:49:36.054] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterRoleChangeListener/shard-member-1:snapshot-read#-727865143]: org.opendaylight.controller.cluster.common.actor.Monitor@362160ce 01:49:36,54 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config27: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config27: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config27 (Follower): Received TimeoutNow - switching to Candidate 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Election: Candidate has following voting peers: [] 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config27: Set currentTerm=1, votedFor=member-1-shard-inventory-config27 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config27 (Candidate): Starting new election term 1 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config27 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageAssembler - member-1-shard-inventory-config27 (Follower): Closing 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from null to Follower 01:49:36,55 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:36.055] [test-akka.actor.default-dispatcher-19] [akka://test/user] unhandled message from TestActor[akka://test/user/testRegisterRoleChangeListener]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@516cbbd2 01:49:36,56 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Received ElectionTimeout 01:49:36,56 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Election: Leader has following peers: [] 01:49:36,56 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config27 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:36,56 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: true, hasLeader : true 01:49:36,56 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config27: became leader with frontend state for [] 01:49:36,56 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Candidate to Leader 01:49:36,107 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , registered listener akka://test/user/$a 01:49:36,169 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:49:36,169 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Cluster state: [] 01:49:36,173 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Candidate in requestVote:RequestVote [term=10000, candidateId=member2, lastLogIndex=50, lastLogTerm=50] with higher term appears reachable, updating term. 01:49:36,173 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config27 (Leader): Term 10000 in "RequestVote [term=10000, candidateId=member2, lastLogIndex=50, lastLogTerm=50]" message is greater than leader's term 1 - switching to Follower 01:49:36,173 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config27: Set currentTerm=10000, votedFor=null 01:49:36,173 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config27 (Leader) :- Switching from behavior Leader to Follower, election term: 10000 01:49:36,173 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageSlicer - member-1-shard-inventory-config27 (Leader)_slicer-id-289: Closing 01:49:36,173 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,173 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 01:49:36,173 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageAssembler - member-1-shard-inventory-config27: Closing 01:49:36,173 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Leader to Follower 01:49:36,174 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27 (Follower): Received TimeoutNow - switching to Candidate 01:49:36,174 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Election: Candidate has following voting peers: [] 01:49:36,174 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Set currentTerm=10001, votedFor=member-1-shard-inventory-config27 01:49:36,174 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config27 (Candidate): Starting new election term 10001 01:49:36,174 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config27 (Follower) :- Switching from behavior Follower to Candidate, election term: 10001 01:49:36,174 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config27 (Follower): Closing 01:49:36,174 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,174 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 01:49:36,174 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Follower to Candidate 01:49:36,175 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Received ElectionTimeout 01:49:36,175 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Election: Leader has following peers: [] 01:49:36,175 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config27 (Candidate) :- Switching from behavior Candidate to Leader, election term: 10001 01:49:36,175 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: true, hasLeader : true 01:49:36,175 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27: became leader with frontend state for [] 01:49:36,175 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Candidate to Leader 01:49:36,219 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testRegisterRoleChangeListener] 01:49:36,230 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config27 01:49:36,230 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config27 (Leader)_slicer-id-290: Closing 01:49:36,230 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config27: Aborting 0 pending queued transactions 01:49:36,232 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3#1828914892] [WARN] [03/11/2024 13:49:36.232] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3#1828914892]: org.opendaylight.controller.cluster.common.actor.Monitor@6fcd3e00 01:49:36,234 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Shard created : member-1-shard-inventory-config28, persistent : true [WARN] [03/11/2024 13:49:36.234] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]: org.opendaylight.controller.cluster.common.actor.Monitor@207826 01:49:36,234 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config28-notifier#-1687501360 created and ready for shard:member-1-shard-inventory-config28 [WARN] [03/11/2024 13:49:36.234] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config28-notifier#-1687501360]: org.opendaylight.controller.cluster.common.actor.Monitor@44f17411 01:49:36,235 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/shard-member-1:snapshot-read#-2092063776] 01:49:36,235 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Starting recovery for member-1-shard-inventory-config28 with journal batch size 3 01:49:36,235 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1185280395] 01:49:36,235 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: SnapshotOffer called. 01:49:36,235 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: Moving last applied index from -1 to -1 01:49:36,235 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: Set currentTerm=1, votedFor=null 01:49:36,235 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: Applying recovered snapshot [WARN] [03/11/2024 13:49:36.236] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/shard-member-1:snapshot-read#-2092063776]: org.opendaylight.controller.cluster.common.actor.Monitor@42ca7fb1 01:49:36,236 PM [test-akka.actor.default-dispatcher-19] [DEBUG] FrontendMetadata - member-1-shard-inventory-config28: clearing clients {} 01:49:36,236 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config28: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config28-DTCL-publisher#-388519444] with name member-1-shard-inventory-config28-DTCL-publisher 01:49:36,236 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config28-DTCL-publisher#-388519444] 01:49:36,237 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: state snapshot applied in 372.6 μs 01:49:36,237 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config28: publishChanges: rootPath: / [WARN] [03/11/2024 13:49:36.237] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config28-DTCL-publisher#-388519444]: org.opendaylight.controller.cluster.common.actor.Monitor@27e77881 01:49:36,237 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Recovery snapshot applied for member-1-shard-inventory-config28 in 1.100 ms: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:49:36,237 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config28: Elapsed time for generation of change events for member-1-shard-inventory-config28-DTCL-publisher: 141.6 μs 01:49:36,237 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:36,237 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config28: Recovery completed in 1.810 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:36,237 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,237 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config28 is no longer the leader 01:49:36,238 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config28 , received role change from null to Follower 01:49:36,238 PM [test-akka.actor.default-dispatcher-19] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [03/11/2024 13:49:36.238] [test-akka.actor.default-dispatcher-19] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@33204767 01:49:36,248 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3#1828914892]], isLeader: false, hasLeader: false 01:49:36,248 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: Shard does not have a leader - delaying registration 01:49:36,248 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/$a#1796468645] [WARN] [03/11/2024 13:49:36.249] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/$a#1796468645]: org.opendaylight.controller.cluster.common.actor.Monitor@143f92d8 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/$a 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig null 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: Re-initializing to Follower with previous leaderId null 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageAssembler - member-1-shard-inventory-config28 (Follower): Closing 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config28 is no longer the leader 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28 (Follower): Received TimeoutNow - switching to Candidate 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28 (Candidate): Election: Candidate has following voting peers: [] 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: Set currentTerm=2, votedFor=member-1-shard-inventory-config28 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config28 (Candidate): Starting new election term 2 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config28 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageAssembler - member-1-shard-inventory-config28 (Follower): Closing 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,250 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config28 is no longer the leader 01:49:36,250 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config28 , received role change from Follower to Candidate 01:49:36,251 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28 (Candidate): Received ElectionTimeout 01:49:36,251 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28 (Leader): Election: Leader has following peers: [] 01:49:36,251 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config28 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 01:49:36,251 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: true, hasLeader : true 01:49:36,251 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config28: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@1ba50330 01:49:36,251 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 01:49:36,252 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config28: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]], initialState present=true] to publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4/member-1-shard-inventory-config28-DTCL-publisher#-388519444] 01:49:36,252 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: became leader with frontend state for [] 01:49:36,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config28: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]], initialState present=true] 01:49:36,252 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config28 , received role change from Candidate to Leader 01:49:36,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config28: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]] 01:49:36,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config28: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]] 01:49:36,252 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)] 01:49:36,253 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config28: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4]] 01:49:36,253 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config28: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@1ba50330 01:49:36,253 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener3#1828914892] 01:49:36,263 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard4] 01:49:36,264 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Stopping Shard member-1-shard-inventory-config28 01:49:36,264 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageSlicer - member-1-shard-inventory-config28 (Leader)_slicer-id-292: Closing 01:49:36,264 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config28: Aborting 0 pending queued transactions 01:49:36,267 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Shard created : testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config, persistent : true [WARN] [03/11/2024 13:49:36.267] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]: org.opendaylight.controller.cluster.common.actor.Monitor@dccaff0 01:49:36,268 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-notifier#-997192142 created and ready for shard:testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config [WARN] [03/11/2024 13:49:36.268] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-notifier#-997192142]: org.opendaylight.controller.cluster.common.actor.Monitor@5c01569a 01:49:36,268 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-follower5:snapshot-read#-1763294705] [WARN] [03/11/2024 13:49:36.268] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-follower5:snapshot-read#-1763294705]: org.opendaylight.controller.cluster.common.actor.Monitor@7dea5717 01:49:36,268 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Starting recovery for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config with journal batch size 3 01:49:36,269 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:36,269 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:36,270 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,270 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config is no longer the leader [WARN] [03/11/2024 13:49:36.270] [test-akka.actor.default-dispatcher-19] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@85c327c 01:49:36,270 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config , received role change from null to Follower 01:49:36,368 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, persistent : true [WARN] [03/11/2024 13:49:36.369] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config]: org.opendaylight.controller.cluster.common.actor.Monitor@57adbc39 01:49:36,369 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-leader6:snapshot-read#-1020821168] 01:49:36,369 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-notifier#-1563154970 created and ready for shard:testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config [WARN] [03/11/2024 13:49:36.369] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-notifier#-1563154970]: org.opendaylight.controller.cluster.common.actor.Monitor@6995498f [WARN] [03/11/2024 13:49:36.369] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-leader6:snapshot-read#-1020821168]: org.opendaylight.controller.cluster.common.actor.Monitor@4186df4e 01:49:36,369 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config with journal batch size 3 01:49:36,371 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:36,371 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:36,371 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,371 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config is no longer the leader 01:49:36,371 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config , received role change from null to Follower [WARN] [03/11/2024 13:49:36.371] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@3fb3b41 01:49:36,468 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Follower): Received TimeoutNow - switching to Candidate 01:49:36,468 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): Election: Candidate has following voting peers: [testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config] 01:49:36,468 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Set currentTerm=1, votedFor=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 01:49:36,468 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): Starting new election term 1 01:49:36,469 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): Sending RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] to peer testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 01:49:36,469 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:36,469 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Follower): Closing 01:49:36,469 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,469 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config is no longer the leader 01:49:36,469 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 01:49:36,469 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Cluster state: [] 01:49:36,469 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Candidate in requestVote:RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 01:49:36,469 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Term 1 in "RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 0 - updating term 01:49:36,469 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Set currentTerm=1, votedFor=null 01:49:36,469 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config , received role change from Follower to Candidate 01:49:36,470 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): In requestVote: RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 01:49:36,471 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Set currentTerm=1, votedFor=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 01:49:36,474 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): requestVote returning: RequestVoteReply [term=1, voteGranted=true] 01:49:36,474 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): RaftRPC message received RequestVoteReply [term=1, voteGranted=true], my term is 1 01:49:36,474 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate): handleRequestVoteReply: RequestVoteReply [term=1, voteGranted=true], current voteCount: 1 01:49:36,474 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Election: Leader has following peers: [testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config] 01:49:36,474 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:49:36,475 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:36,475 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: onLeadershipChange, isLeader: true, hasLeader : true 01:49:36,475 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: became leader with frontend state for [] 01:49:36,475 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config , received role change from Candidate to Leader 01:49:36,476 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config updated: matchIndex: -1, nextIndex: 0 01:49:36,476 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 01:49:36,477 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Closing 01:49:36,477 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config [WARN] [03/11/2024 13:49:36.477] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@5054416e 01:49:36,518 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 01:49:36,519 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7#970030559] [WARN] [03/11/2024 13:49:36.519] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7#970030559]: org.opendaylight.controller.cluster.common.actor.Monitor@376a187d 01:49:36,530 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7#970030559]], isLeader: false, hasLeader: true 01:49:36,530 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/$a#2055865475] 01:49:36,530 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@357ebe4b 01:49:36,530 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test [WARN] [03/11/2024 13:49:36.530] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/$a#2055865475]: org.opendaylight.controller.cluster.common.actor.Monitor@352976ed 01:49:36,530 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher#1646081343] with name testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher 01:49:36,530 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher#1646081343] 01:49:36,530 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]], initialState present=true] to publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher#1646081343] 01:49:36,530 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/$a 01:49:36,531 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]], initialState present=true] [WARN] [03/11/2024 13:49:36.531] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher#1646081343]: org.opendaylight.controller.cluster.common.actor.Monitor@1d33f141 01:49:36,531 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]] 01:49:36,531 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ForwardingDataTreeChangeListener - Sending OnInitialData to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)] 01:49:36,531 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]] 01:49:36,531 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Notifying onInitialData to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@357ebe4b 01:49:36,531 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 01:49:36,531 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Forwarding 1 BatchedModifications to leader ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config)] 01:49:36,531 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:36,531 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,532 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,532 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Replicate message: identifier: ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, logIndex: 0, payload: class org.opendaylight.controller.cluster.datastore.persisted.DisableTrackingPayload, isSendImmediate: true 01:49:36,533 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 01:49:36,533 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): sendAppendEntries: 0 is present for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 01:49:36,538 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Sending AppendEntries to follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}]]] 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-79-0 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Readying Tx member-1-ShardTransactionTest-fe-0-txn-79-0 of 1 operations, client version 13 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: readying transaction member-1-ShardTransactionTest-fe-0-txn-79-0 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: transaction member-1-ShardTransactionTest-fe-0-txn-79-0 ready 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Validating transaction member-1-ShardTransactionTest-fe-0-txn-79-0 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-79-0 validated 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-79-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: canCommit for member-1-ShardTransactionTest-fe-0-txn-79-0: success 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Committing transaction member-1-ShardTransactionTest-fe-0-txn-79-0 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-79-0 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-79-0 candidate ready 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-79-0: canCommit - candidate rootPath: / 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-79-0: canCommit - messages: [] 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-79-0: preCommit - successfulFromPrevious: [] 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-79-0 prepared 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-79-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-79-0 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-79-0 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Replicate message: identifier: member-1-ShardTransactionTest-fe-0-txn-79-0, logIndex: 1, payload: class org.opendaylight.controller.cluster.datastore.persisted.CommitTransactionPayload$Simple, isSendImmediate: true 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): sendAppendEntries: 0 is present for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 01:49:36,539 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-79-0 submitted to persistence 01:49:36,540 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): handleAppendEntries: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}]]] 01:49:36,540 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Number of entries to be appended = 1 01:49:36,540 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 01:49:36,540 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Append entry to log DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:36,540 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,540 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Log size is now 1 01:49:36,541 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,542 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:36,545 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=13, raftVersion=5, recipientRaftVersion=5] 01:49:36,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config updated: matchIndex: 0, nextIndex: 1 01:49:36,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 01:49:36,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Setting last applied to 0 01:49:36,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Moving last applied index from -1 to 0 01:49:36,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:36,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:36,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:36,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=13427496} is already disabled 01:49:36,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 01:49:36,545 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): sendAppendEntries: 1 is present for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 01:49:36,546 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Sending AppendEntries to follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}]]] 01:49:36,546 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Persisting ApplyJournalEntries with index=0 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): handleAppendEntries: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config, prevLogIndex=0, prevLogTerm=1, leaderCommit=0, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}]]] 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Number of entries to be appended = 1 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Append entry to log Simple{size=143} 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Log size is now 2 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Commit index set to 0 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=13, raftVersion=5, recipientRaftVersion=5] 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 0, context.getLastApplied(): -1, lastIndex(): 1 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Setting last applied to 0 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Moving last applied index from -1 to 0 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:36,547 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:36,547 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config updated: matchIndex: 1, nextIndex: 2 01:49:36,547 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 01:49:36,547 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Setting last applied to 1 01:49:36,547 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Moving last applied index from 0 to 1 01:49:36,547 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Applying state for log index 1 data Simple{size=143} 01:49:36,547 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-79-0 01:49:36,547 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-79-0: commit - successfulFromPrevious: [] 01:49:36,547 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-79-0 changing state from COMMIT_PENDING to COMMITTED [WARN] [03/11/2024 13:49:36.547] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@19c7666c 01:49:36,547 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-79-0 committed as 0, sending response to Actor[akka://test/temp/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config$f] 01:49:36,548 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher#1543423610] with name testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher 01:49:36,548 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher#1543423610] 01:49:36,548 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: publishChanges: rootPath: / 01:49:36,548 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: fakeSnapshot purging log to 0 for term 1 01:49:36,548 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: 0 01:49:36,548 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Persisting ApplyJournalEntries with index=1 01:49:36,548 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Elapsed time for generation of change events for testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher: 86.62 μs [WARN] [03/11/2024 13:49:36.548] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config-DTCL-publisher#1543423610]: org.opendaylight.controller.cluster.common.actor.Monitor@369e30d2 01:49:36,548 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:36,549 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Persisting ApplyJournalEntries with index=0 01:49:36,549 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Commit index set to 1 01:49:36,549 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): 0, lastIndex(): 1 01:49:36,549 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Setting last applied to 1 01:49:36,549 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Moving last applied index from 0 to 1 01:49:36,549 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Applying state for log index 1 data Simple{size=143} 01:49:36,549 PM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Applying foreign transaction member-1-ShardTransactionTest-fe-0-txn-79-0 01:49:36,549 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: publishChanges: rootPath: / 01:49:36,549 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: fakeSnapshot purging log to 0 for term 1 01:49:36,549 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config]] 01:49:36,549 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7)] 01:49:36,549 PM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Persisting ApplyJournalEntries with index=1 01:49:36,549 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@357ebe4b 01:49:36,549 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Elapsed time for generation of change events for testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config-DTCL-publisher: 142.8 μs 01:49:36,549 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config] 01:49:36,560 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config 01:49:36,560 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config (Follower): Closing 01:49:36,560 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower5-shard-inventory-config: Aborting 0 pending queued transactions 01:49:36,560 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config] 01:49:36,560 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Stopping Shard testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config 01:49:36,560 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageSlicer - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config (Leader)_slicer-id-295: Closing 01:49:36,561 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader6-shard-inventory-config: Aborting 0 pending queued transactions 01:49:36,561 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener7#970030559] 01:49:36,562 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config30, persistent : true 01:49:36,563 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config30 with journal batch size 3 [WARN] [03/11/2024 13:49:36.563] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPeerAddressResolved]: org.opendaylight.controller.cluster.common.actor.Monitor@5a38458e 01:49:36,563 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPeerAddressResolved/shard-member-1:snapshot-read#213965564] 01:49:36,563 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testPeerAddressResolved/member-1-shard-inventory-config30-notifier#-1780514077 created and ready for shard:member-1-shard-inventory-config30 [WARN] [03/11/2024 13:49:36.563] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPeerAddressResolved/member-1-shard-inventory-config30-notifier#-1780514077]: org.opendaylight.controller.cluster.common.actor.Monitor@27c4956c [WARN] [03/11/2024 13:49:36.564] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPeerAddressResolved/shard-member-1:snapshot-read#213965564]: org.opendaylight.controller.cluster.common.actor.Monitor@39bf74ad 01:49:36,564 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config30: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:36,564 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config30: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:36,565 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config30: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,565 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config30: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config30 is no longer the leader 01:49:36,565 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config30 , received role change from null to Follower 01:49:36,565 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Peer address for peer member-2-shard-inventory-config set to akka://foobar [WARN] [03/11/2024 13:49:36.565] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from TestActor[akka://test/user/testPeerAddressResolved]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@50c93eff 01:49:36,574 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPeerAddressResolved] 01:49:36,584 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Stopping Shard member-1-shard-inventory-config30 01:49:36,584 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config30 (Follower): Closing 01:49:36,584 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config30: Aborting 0 pending queued transactions 01:49:36,586 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Shard created : member-1-shard-inventory-config31, persistent : true [WARN] [03/11/2024 13:49:36.586] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount]: org.opendaylight.controller.cluster.common.actor.Monitor@3c21b416 01:49:36,587 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/member-1-shard-inventory-config31-notifier#-978497029 created and ready for shard:member-1-shard-inventory-config31 [WARN] [03/11/2024 13:49:36.587] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/member-1-shard-inventory-config31-notifier#-978497029]: org.opendaylight.controller.cluster.common.actor.Monitor@3588aabd 01:49:36,587 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/shard-member-1:snapshot-read#-1397295801] 01:49:36,587 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Starting recovery for member-1-shard-inventory-config31 with journal batch size 3 [WARN] [03/11/2024 13:49:36.587] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/shard-member-1:snapshot-read#-1397295801]: org.opendaylight.controller.cluster.common.actor.Monitor@2a960c76 01:49:36,588 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config31: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:36,588 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config31: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:36,588 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,588 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config31: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config31 is no longer the leader 01:49:36,588 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config31 (Follower): Received TimeoutNow - switching to Candidate 01:49:36,588 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config31 (Candidate): Election: Candidate has following voting peers: [] 01:49:36,588 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config31: Set currentTerm=1, votedFor=member-1-shard-inventory-config31 01:49:36,589 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config31 (Candidate): Starting new election term 1 01:49:36,589 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config31 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:36,589 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageAssembler - member-1-shard-inventory-config31 (Follower): Closing 01:49:36,589 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,589 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config31: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config31 is no longer the leader 01:49:36,589 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from null to Follower 01:49:36,589 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:36.589] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@53b5987c 01:49:36,590 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config31 (Candidate): Received ElectionTimeout 01:49:36,590 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config31 (Leader): Election: Leader has following peers: [] 01:49:36,590 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config31 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:36,590 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: true, hasLeader : true 01:49:36,590 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config31: became leader with frontend state for [] 01:49:36,590 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from Candidate to Leader 01:49:36,649 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config31: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:36,649 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config31: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,649 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config31: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,649 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config31: Applying 0 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-80-0 01:49:36,649 PM [test-akka.actor.default-dispatcher-5] [ERROR] Shard - member-1-shard-inventory-config31: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-80-0 java.lang.IllegalStateException: The total number of batched messages received 1 does not match the number sent 2 at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:157) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:745) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:768) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:373) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:36,650 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount] 01:49:36,651 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config31: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,651 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config31: Moving last applied index from -1 to 0 01:49:36,651 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config31: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:36,651 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config31: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:36,651 PM [test-akka.actor.default-dispatcher-19] [DEBUG] FrontendMetadata - member-1-shard-inventory-config31: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:36,651 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config31: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1917098} is already disabled 01:49:36,651 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config31: Persisting ApplyJournalEntries with index=0 01:49:36,661 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config31 01:49:36,661 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config31 (Leader)_slicer-id-298: Closing 01:49:36,661 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config31: Aborting 0 pending queued transactions 01:49:36,664 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config32, persistent : true [WARN] [03/11/2024 13:49:36.664] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true]: org.opendaylight.controller.cluster.common.actor.Monitor@65ec4b3f 01:49:36,664 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config32-notifier#80035020 created and ready for shard:member-1-shard-inventory-config32 01:49:36,664 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/shard-member-1:snapshot-read#-857447433] [WARN] [03/11/2024 13:49:36.664] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config32-notifier#80035020]: org.opendaylight.controller.cluster.common.actor.Monitor@6c33d67d [WARN] [03/11/2024 13:49:36.665] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/shard-member-1:snapshot-read#-857447433]: org.opendaylight.controller.cluster.common.actor.Monitor@36dd631a 01:49:36,686 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config32 with journal batch size 3 01:49:36,686 PM [com.google.common.base.internal.Finalizer] [DEBUG] RemoteTransactionContext - Tx mock-member-TransactionProxyTest-fe-0-txn-0-0 closeTransaction called 01:49:36,687 PM [com.google.common.base.internal.Finalizer] [DEBUG] RemoteTransactionContext - Tx mock-member-TransactionProxyTest-fe-0-txn-0-0 closeTransaction called 01:49:36,687 PM [com.google.common.base.internal.Finalizer] [DEBUG] RemoteTransactionContext - Tx mock-member-TransactionProxyTest-fe-0-txn-0-0 closeTransaction called 01:49:36,687 PM [com.google.common.base.internal.Finalizer] [DEBUG] RemoteTransactionContext - Tx mock-member-TransactionProxyTest-fe-0-txn-0-0 closeTransaction called 01:49:36,687 PM [com.google.common.base.internal.Finalizer] [DEBUG] RemoteTransactionContext - Tx mock-member-TransactionProxyTest-fe-0-txn-0-0 closeTransaction called 01:49:36,687 PM [com.google.common.base.internal.Finalizer] [DEBUG] RemoteTransactionContext - Tx mock-member-TransactionProxyTest-fe-0-txn-0-0 closeTransaction called 01:49:36,687 PM [com.google.common.base.internal.Finalizer] [DEBUG] RemoteTransactionContext - Tx mock-member-TransactionProxyTest-fe-0-txn-0-0 closeTransaction called 01:49:36,687 PM [com.google.common.base.internal.Finalizer] [DEBUG] RemoteTransactionContext - Tx mock-member-TransactionProxyTest-fe-0-txn-0-0 closeTransaction called 01:49:36,687 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:36,687 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config32: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:36,688 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,688 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config32 is no longer the leader 01:49:36,688 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from null to Follower 01:49:36,688 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32 (Follower): Received TimeoutNow - switching to Candidate 01:49:36,688 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32 (Candidate): Election: Candidate has following voting peers: [] 01:49:36,688 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Set currentTerm=1, votedFor=member-1-shard-inventory-config32 01:49:36,688 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config32 (Candidate): Starting new election term 1 01:49:36,688 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config32 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:36,688 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config32 (Follower): Closing 01:49:36,688 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,688 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config32 is no longer the leader 01:49:36,688 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:36.688] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@7f247ce4 01:49:36,688 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config32 (Candidate): Received ElectionTimeout 01:49:36,689 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config32 (Leader): Election: Leader has following peers: [] 01:49:36,689 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config32 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:36,689 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: true, hasLeader : true 01:49:36,689 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config32: became leader with frontend state for [] 01:49:36,689 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Candidate to Leader 01:49:36,775 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-81-0 01:49:36,775 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:36,775 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,775 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,775 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Readying transaction member-1-ShardTransactionTest-fe-0-txn-81-0, client version 13 01:49:36,775 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: readying transaction member-1-ShardTransactionTest-fe-0-txn-81-0 01:49:36,775 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: transaction member-1-ShardTransactionTest-fe-0-txn-81-0 ready 01:49:36,775 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-81-0 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Validating transaction member-1-ShardTransactionTest-fe-0-txn-81-0 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-81-0 validated 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-81-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: canCommit for member-1-ShardTransactionTest-fe-0-txn-81-0: success 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Committing transaction member-1-ShardTransactionTest-fe-0-txn-81-0 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-81-0 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-81-0 candidate ready 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-81-0: canCommit - candidate rootPath: / 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-81-0: canCommit - messages: [] 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-81-0: preCommit - successfulFromPrevious: [] 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-81-0 prepared 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-81-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-81-0 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-81-0 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:36,776 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:36,777 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-81-0 submitted to persistence 01:49:36,777 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:36,777 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Moving last applied index from -1 to 0 01:49:36,777 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:36,777 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:36,777 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config32: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:36,777 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2005370} is already disabled 01:49:36,777 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Persisting ApplyJournalEntries with index=0 01:49:36,778 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config32: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:36,778 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config32: Moving last applied index from 0 to 1 01:49:36,778 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config32: Applying state for log index 1 data Simple{size=143} 01:49:36,778 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-81-0 01:49:36,778 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-81-0: commit - successfulFromPrevious: [] 01:49:36,778 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-81-0 changing state from COMMIT_PENDING to COMMITTED 01:49:36,778 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-81-0 committed as 0, sending response to Actor[akka://test/system/testProbe-685#2037168439] 01:49:36,778 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config32: Created publisher actor Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config32-DTCL-publisher#-1285494081] with name member-1-shard-inventory-config32-DTCL-publisher 01:49:36,778 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config32-DTCL-publisher#-1285494081] 01:49:36,778 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config32: publishChanges: rootPath: / 01:49:36,778 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: fakeSnapshot purging log to 0 for term 1 01:49:36,779 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Persisting ApplyJournalEntries with index=1 [WARN] [03/11/2024 13:49:36.779] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config32-DTCL-publisher#-1285494081]: org.opendaylight.controller.cluster.common.actor.Monitor@456c8685 01:49:36,779 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config32: Elapsed time for generation of change events for member-1-shard-inventory-config32-DTCL-publisher: 104.8 μs 01:49:36,981 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true] 01:49:36,991 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config32 01:49:36,991 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config32 (Leader)_slicer-id-300: Closing 01:49:36,992 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Aborting 0 pending queued transactions 01:49:36,993 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config33, persistent : true [WARN] [03/11/2024 13:49:36.994] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady]: org.opendaylight.controller.cluster.common.actor.Monitor@3c342e78 01:49:36,994 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config33-notifier#-1824499950 created and ready for shard:member-1-shard-inventory-config33 01:49:36,994 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/shard-member-1:snapshot-read#-151069806] [WARN] [03/11/2024 13:49:36.994] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config33-notifier#-1824499950]: org.opendaylight.controller.cluster.common.actor.Monitor@34115da 01:49:36,995 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config33 with journal batch size 3 [WARN] [03/11/2024 13:49:36.995] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/shard-member-1:snapshot-read#-151069806]: org.opendaylight.controller.cluster.common.actor.Monitor@235ba912 01:49:36,996 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:36,996 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config33: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:36,996 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,996 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config33 is no longer the leader [WARN] [03/11/2024 13:49:36.996] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@71ad4707 01:49:36,996 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from null to Follower 01:49:36,996 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33 (Follower): Received TimeoutNow - switching to Candidate 01:49:36,996 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33 (Candidate): Election: Candidate has following voting peers: [] 01:49:36,996 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: Set currentTerm=1, votedFor=member-1-shard-inventory-config33 01:49:36,996 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config33 (Candidate): Starting new election term 1 01:49:36,996 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config33 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:36,996 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config33 (Follower): Closing 01:49:36,996 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: false, hasLeader : false 01:49:36,996 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config33 is no longer the leader 01:49:36,997 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from Follower to Candidate 01:49:36,997 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33 (Candidate): Received ElectionTimeout 01:49:36,997 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33 (Leader): Election: Leader has following peers: [] 01:49:36,997 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config33 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:36,997 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: true, hasLeader : true 01:49:36,997 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: became leader with frontend state for [] 01:49:36,997 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from Candidate to Leader 01:49:37,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:37,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:37,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:37,104 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-82-0 01:49:37,105 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-82-0 01:49:37,106 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-82-0 01:49:37,106 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: Readying Tx member-1-ShardTransactionTest-fe-0-txn-82-0 of 3 operations, client version 13 01:49:37,106 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: readying transaction member-1-ShardTransactionTest-fe-0-txn-82-0 01:49:37,106 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: transaction member-1-ShardTransactionTest-fe-0-txn-82-0 ready 01:49:37,106 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:37,106 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: Moving last applied index from -1 to 0 01:49:37,106 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:37,107 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:37,107 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config33: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:37,107 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2411752} is already disabled 01:49:37,107 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: Persisting ApplyJournalEntries with index=0 01:49:37,107 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-82-0 01:49:37,107 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Validating transaction member-1-ShardTransactionTest-fe-0-txn-82-0 01:49:37,107 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Transaction member-1-ShardTransactionTest-fe-0-txn-82-0 validated 01:49:37,107 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-82-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:37,107 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config33: canCommit for member-1-ShardTransactionTest-fe-0-txn-82-0: success 01:49:37,107 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config33: Committing transaction member-1-ShardTransactionTest-fe-0-txn-82-0 01:49:37,107 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-82-0 01:49:37,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Transaction member-1-ShardTransactionTest-fe-0-txn-82-0 candidate ready 01:49:37,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-82-0: canCommit - candidate rootPath: / 01:49:37,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-82-0: canCommit - messages: [] 01:49:37,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-82-0: preCommit - successfulFromPrevious: [] 01:49:37,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Transaction member-1-ShardTransactionTest-fe-0-txn-82-0 prepared 01:49:37,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-82-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:37,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config33: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-82-0 01:49:37,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-82-0 01:49:37,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 01:49:37,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config33: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 01:49:37,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config33: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 01:49:37,108 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Transaction member-1-ShardTransactionTest-fe-0-txn-82-0 submitted to persistence 01:49:37,109 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 01:49:37,109 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: Moving last applied index from 0 to 1 01:49:37,109 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: Applying state for log index 1 data Simple{size=175} 01:49:37,109 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-82-0 01:49:37,109 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-82-0: commit - successfulFromPrevious: [] 01:49:37,109 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-82-0 changing state from COMMIT_PENDING to COMMITTED 01:49:37,109 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: Transaction member-1-ShardTransactionTest-fe-0-txn-82-0 committed as 0, sending response to Actor[akka://test/system/testProbe-687#872203426] 01:49:37,110 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady] 01:49:37,110 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config33: Created publisher actor Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config33-DTCL-publisher#-1344112725] with name member-1-shard-inventory-config33-DTCL-publisher 01:49:37,110 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config33-DTCL-publisher#-1344112725] 01:49:37,110 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config33: publishChanges: rootPath: / 01:49:37,110 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: fakeSnapshot purging log to 0 for term 1 01:49:37,110 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: Persisting ApplyJournalEntries with index=1 [WARN] [03/11/2024 13:49:37.110] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config33-DTCL-publisher#-1344112725]: org.opendaylight.controller.cluster.common.actor.Monitor@5316fc32 01:49:37,110 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config33: Elapsed time for generation of change events for member-1-shard-inventory-config33-DTCL-publisher: 140.2 μs 01:49:37,120 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Stopping Shard member-1-shard-inventory-config33 01:49:37,120 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageSlicer - member-1-shard-inventory-config33 (Leader)_slicer-id-302: Closing 01:49:37,120 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config33: Aborting 0 pending queued transactions 01:49:37,122 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config34, persistent : true 01:49:37,123 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config34 with journal batch size 3 [WARN] [03/11/2024 13:49:37.123] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionMessagesWithNoLeader]: org.opendaylight.controller.cluster.common.actor.Monitor@2e3b304f 01:49:37,123 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testTransactionMessagesWithNoLeader/member-1-shard-inventory-config34-notifier#1744472255 created and ready for shard:member-1-shard-inventory-config34 01:49:37,123 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionMessagesWithNoLeader/shard-member-1:snapshot-read#1470127638] [WARN] [03/11/2024 13:49:37.123] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionMessagesWithNoLeader/member-1-shard-inventory-config34-notifier#1744472255]: org.opendaylight.controller.cluster.common.actor.Monitor@54a2d863 [WARN] [03/11/2024 13:49:37.123] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionMessagesWithNoLeader/shard-member-1:snapshot-read#1470127638]: org.opendaylight.controller.cluster.common.actor.Monitor@724f49b8 01:49:37,124 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:37,124 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config34: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:37,124 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config34: onLeadershipChange, isLeader: false, hasLeader : false 01:49:37,124 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config34: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config34 is no longer the leader 01:49:37,125 PM [test-akka.actor.default-dispatcher-6] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 01:49:37,125 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config34 , received role change from null to Follower [WARN] [03/11/2024 13:49:37.125] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testTransactionMessagesWithNoLeader]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@1dac077f 01:49:37,234 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config34: Adding message BatchedModifications [transactionId=member-1-ShardTransactionTest-fe-0-txn-83-0, ready=false, participatingShardNames=null, totalMessagesSent=0, modifications size=0] to retry 01:49:37,346 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config34: Timer expired for message BatchedModifications [transactionId=member-1-ShardTransactionTest-fe-0-txn-83-0, ready=false, participatingShardNames=null, totalMessagesSent=0, modifications size=0] 01:49:37,347 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config34: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-83-0 01:49:37,351 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config34: Adding message ForwardedReadyTransaction [transactionId=member-1-ShardTransactionTest-fe-0-txn-83-0, transaction=ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-txn-83-0, closed=false, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]}, doImmediateCommit=true, participatingShardNames=null, txnClientVersion=13] to retry 01:49:37,466 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config34: Timer expired for message ForwardedReadyTransaction [transactionId=member-1-ShardTransactionTest-fe-0-txn-83-0, transaction=ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-txn-83-0, closed=false, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]}, doImmediateCommit=true, participatingShardNames=null, txnClientVersion=13] 01:49:37,467 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config34: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-83-0 01:49:37,467 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config34: Adding message org.opendaylight.controller.cluster.datastore.messages.ReadyLocalTransaction@67404e5a to retry 01:49:37,586 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config34: Timer expired for message org.opendaylight.controller.cluster.datastore.messages.ReadyLocalTransaction@67404e5a 01:49:37,587 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionMessagesWithNoLeader] 01:49:37,600 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Stopping Shard member-1-shard-inventory-config34 01:49:37,600 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageAssembler - member-1-shard-inventory-config34 (Follower): Closing 01:49:37,600 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config34: Aborting 0 pending queued transactions 01:49:37,602 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Shard created : member-1-shard-inventory-config35, persistent : true 01:49:37,602 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Starting recovery for member-1-shard-inventory-config35 with journal batch size 3 [WARN] [03/11/2024 13:49:37.602] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction#1486337581]: org.opendaylight.controller.cluster.common.actor.Monitor@3d07fcb9 01:49:37,603 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateTransaction/shard-member-1:snapshot-read#115736941] [WARN] [03/11/2024 13:49:37.603] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/shard-member-1:snapshot-read#115736941]: org.opendaylight.controller.cluster.common.actor.Monitor@341e05b4 [WARN] [03/11/2024 13:49:37.603] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/member-1-shard-inventory-config35-notifier#-940598815]: org.opendaylight.controller.cluster.common.actor.Monitor@322199aa 01:49:37,603 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testCreateTransaction/member-1-shard-inventory-config35-notifier#-940598815 created and ready for shard:member-1-shard-inventory-config35 01:49:37,603 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:37,603 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config35: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:37,604 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: false, hasLeader : false [WARN] [03/11/2024 13:49:37.604] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from Actor[akka://test/user/testCreateTransaction#1486337581]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@24cd1571 01:49:37,604 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config35 is no longer the leader 01:49:37,604 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from null to Follower 01:49:37,604 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35 (Follower): Received TimeoutNow - switching to Candidate 01:49:37,604 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35 (Candidate): Election: Candidate has following voting peers: [] 01:49:37,604 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: Set currentTerm=1, votedFor=member-1-shard-inventory-config35 01:49:37,604 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config35 (Candidate): Starting new election term 1 01:49:37,604 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config35 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:37,604 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config35 (Follower): Closing 01:49:37,604 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: false, hasLeader : false 01:49:37,604 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config35: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config35 is no longer the leader 01:49:37,604 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from Follower to Candidate 01:49:37,610 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35 (Candidate): Received ElectionTimeout 01:49:37,610 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35 (Leader): Election: Leader has following peers: [] 01:49:37,610 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config35 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:37,610 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: true, hasLeader : true 01:49:37,610 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: became leader with frontend state for [] 01:49:37,610 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from Candidate to Leader 01:49:37,681 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:37,681 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:37,681 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:37,681 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: Creating transaction : member-1-ShardTransactionTest-fe-0-txn-84-0 01:49:37,682 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testCreateTransaction/shard-inventory-member-1:ShardTransactionTest@0:84_2#-1722798987] 01:49:37,682 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testCreateTransaction#1486337581] [WARN] [03/11/2024 13:49:37.682] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/shard-inventory-member-1:ShardTransactionTest@0:84_2#-1722798987]: org.opendaylight.controller.cluster.common.actor.Monitor@796eef97 01:49:37,683 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config35: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:37,683 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config35: Moving last applied index from -1 to 0 01:49:37,683 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config35: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:37,683 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config35: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:37,683 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config35: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:37,683 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config35: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2175815} is already disabled 01:49:37,683 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config35: Persisting ApplyJournalEntries with index=0 01:49:37,693 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config35 01:49:37,693 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config35 (Leader)_slicer-id-305: Closing 01:49:37,693 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config35: Aborting 0 pending queued transactions 01:49:37,694 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config36, persistent : false [WARN] [03/11/2024 13:49:37.695] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWithPersistenceDisabled]: org.opendaylight.controller.cluster.common.actor.Monitor@212af66 01:49:37,695 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWithPersistenceDisabled/shard-member-1:snapshot-read#-1837119925] [WARN] [03/11/2024 13:49:37.695] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/shard-member-1:snapshot-read#-1837119925]: org.opendaylight.controller.cluster.common.actor.Monitor@17dfbdd0 [WARN] [03/11/2024 13:49:37.695] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config36-notifier#-546489503]: org.opendaylight.controller.cluster.common.actor.Monitor@3761bb70 01:49:37,695 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config36-notifier#-546489503 created and ready for shard:member-1-shard-inventory-config36 01:49:37,696 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config36 with journal batch size 3 01:49:37,697 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:37,697 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config36: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:37,697 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: false, hasLeader : false 01:49:37,697 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config36 is no longer the leader 01:49:37,697 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36 (Follower): Received TimeoutNow - switching to Candidate 01:49:37,697 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36 (Candidate): Election: Candidate has following voting peers: [] [WARN] [03/11/2024 13:49:37.697] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testCommitWithPersistenceDisabled]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@27b365bc 01:49:37,697 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: Set currentTerm=1, votedFor=member-1-shard-inventory-config36 01:49:37,697 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from null to Follower 01:49:37,697 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config36 (Candidate): Starting new election term 1 01:49:37,697 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config36 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:37,697 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config36 (Follower): Closing 01:49:37,697 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: false, hasLeader : false 01:49:37,697 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config36 is no longer the leader 01:49:37,697 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from Follower to Candidate 01:49:37,698 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config36 (Candidate): Received ElectionTimeout 01:49:37,698 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config36 (Leader): Election: Leader has following peers: [] 01:49:37,698 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config36 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:37,698 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: true, hasLeader : true 01:49:37,698 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config36: became leader with frontend state for [] 01:49:37,698 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from Candidate to Leader 01:49:37,805 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:37,805 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:37,805 PM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendMetadata - member-1-shard-inventory-config36: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:37,805 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=119863} is already disabled 01:49:37,806 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-85-0 01:49:37,806 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: Readying Tx member-1-ShardTransactionTest-fe-0-txn-85-0 of 1 operations, client version 13 01:49:37,806 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: readying transaction member-1-ShardTransactionTest-fe-0-txn-85-0 01:49:37,806 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: transaction member-1-ShardTransactionTest-fe-0-txn-85-0 ready 01:49:37,806 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-85-0 01:49:37,806 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Validating transaction member-1-ShardTransactionTest-fe-0-txn-85-0 01:49:37,806 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-85-0 validated 01:49:37,806 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-85-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:37,806 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: canCommit for member-1-ShardTransactionTest-fe-0-txn-85-0: success 01:49:37,806 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: Committing transaction member-1-ShardTransactionTest-fe-0-txn-85-0 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-85-0 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-85-0 candidate ready 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-85-0: canCommit - candidate rootPath: / 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-85-0: canCommit - messages: [] 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-85-0: preCommit - successfulFromPrevious: [] 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-85-0 prepared 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-85-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-85-0 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-85-0 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-85-0 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-85-0: commit - successfulFromPrevious: [] 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-85-0 changing state from COMMIT_PENDING to COMMITTED 01:49:37,807 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-85-0 committed as 0, sending response to Actor[akka://test/system/testProbe-693#-1422249988] 01:49:37,808 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config36: Created publisher actor Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config36-DTCL-publisher#-784320057] with name member-1-shard-inventory-config36-DTCL-publisher 01:49:37,808 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-85-0 submitted to persistence 01:49:37,808 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config36-DTCL-publisher#-784320057] 01:49:37,808 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config36: publishChanges: rootPath: / [WARN] [03/11/2024 13:49:37.808] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config36-DTCL-publisher#-784320057]: org.opendaylight.controller.cluster.common.actor.Monitor@45fd5ff5 01:49:37,809 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config36: Elapsed time for generation of change events for member-1-shard-inventory-config36-DTCL-publisher: 109.7 μs 01:49:37,809 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWithPersistenceDisabled] 01:49:37,819 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config36 01:49:37,819 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config36 (Leader)_slicer-id-307: Closing 01:49:37,819 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config36: Aborting 0 pending queued transactions 01:49:37,821 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Shard created : member-1-shard-inventory-config37, persistent : true 01:49:37,822 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Starting recovery for member-1-shard-inventory-config37 with journal batch size 3 [WARN] [03/11/2024 13:49:37.823] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyWithImmediateCommit-false]: org.opendaylight.controller.cluster.common.actor.Monitor@28243e3b 01:49:37,823 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config37-notifier#1160723832 created and ready for shard:member-1-shard-inventory-config37 01:49:37,823 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-false/shard-member-1:snapshot-read#-1996441362] [WARN] [03/11/2024 13:49:37.823] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config37-notifier#1160723832]: org.opendaylight.controller.cluster.common.actor.Monitor@21b3e747 [WARN] [03/11/2024 13:49:37.823] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/shard-member-1:snapshot-read#-1996441362]: org.opendaylight.controller.cluster.common.actor.Monitor@33595e41 01:49:37,824 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config37: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:37,824 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config37: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:37,825 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: false, hasLeader : false 01:49:37,825 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config37: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config37 is no longer the leader 01:49:37,825 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config37 (Follower): Received TimeoutNow - switching to Candidate 01:49:37,825 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config37 (Candidate): Election: Candidate has following voting peers: [] 01:49:37,825 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config37: Set currentTerm=1, votedFor=member-1-shard-inventory-config37 01:49:37,825 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config37 (Candidate): Starting new election term 1 01:49:37,825 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config37 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:37,825 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config37 (Follower): Closing 01:49:37,825 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: false, hasLeader : false 01:49:37,825 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config37: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config37 is no longer the leader 01:49:37,825 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from null to Follower 01:49:37,825 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:37.826] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from TestActor[akka://test/user/testReadyWithImmediateCommit-false]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@1da3eb02 01:49:37,826 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config37 (Candidate): Received ElectionTimeout 01:49:37,826 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config37 (Leader): Election: Leader has following peers: [] 01:49:37,826 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config37 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:37,826 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: true, hasLeader : true 01:49:37,826 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config37: became leader with frontend state for [] 01:49:37,826 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from Candidate to Leader 01:49:37,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:37,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:37,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:37,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-86-0 01:49:37,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Readying Tx member-1-ShardTransactionTest-fe-0-txn-86-0 of 1 operations, client version 13 01:49:37,932 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: readying transaction member-1-ShardTransactionTest-fe-0-txn-86-0 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: transaction member-1-ShardTransactionTest-fe-0-txn-86-0 ready 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Validating transaction member-1-ShardTransactionTest-fe-0-txn-86-0 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-86-0 validated 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-86-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: canCommit for member-1-ShardTransactionTest-fe-0-txn-86-0: success 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Committing transaction member-1-ShardTransactionTest-fe-0-txn-86-0 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-86-0 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-86-0 candidate ready 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-86-0: canCommit - candidate rootPath: / 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-86-0: canCommit - messages: [] 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-86-0: preCommit - successfulFromPrevious: [] 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-86-0 prepared 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-86-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-86-0 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-86-0 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:37,933 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-86-0 submitted to persistence 01:49:37,934 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Moving last applied index from -1 to 0 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config37: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2992217} is already disabled 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Moving last applied index from 0 to 1 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Applying state for log index 1 data Simple{size=143} 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-86-0 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-86-0: commit - successfulFromPrevious: [] 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-86-0 changing state from COMMIT_PENDING to COMMITTED 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-86-0 committed as 0, sending response to Actor[akka://test/system/testProbe-695#1527145002] 01:49:37,935 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyWithImmediateCommit-false] 01:49:37,935 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config37: Created publisher actor Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config37-DTCL-publisher#681901266] with name member-1-shard-inventory-config37-DTCL-publisher 01:49:37,936 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config37-DTCL-publisher#681901266] 01:49:37,936 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config37: publishChanges: rootPath: / 01:49:37,936 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config37: Elapsed time for generation of change events for member-1-shard-inventory-config37-DTCL-publisher: 175.4 μs 01:49:37,936 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: fakeSnapshot purging log to 0 for term 1 01:49:37,936 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Persisting ApplyJournalEntries with index=0 01:49:37,937 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Persisting ApplyJournalEntries with index=1 [WARN] [03/11/2024 13:49:37.937] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config37-DTCL-publisher#681901266]: org.opendaylight.controller.cluster.common.actor.Monitor@3b6c09d1 01:49:37,946 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config37 01:49:37,946 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config37 (Leader)_slicer-id-309: Closing 01:49:37,946 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config37: Aborting 0 pending queued transactions 01:49:37,948 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 01:49:37,949 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,949 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,950 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,950 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,950 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,951 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,951 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,951 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,952 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,952 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,952 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,953 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,953 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,953 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,954 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,954 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 01:49:37,956 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - Shard created : member-1-shard-inventory-config38, persistent : true [WARN] [03/11/2024 13:49:37.956] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRecovery]: org.opendaylight.controller.cluster.common.actor.Monitor@2fa65ba7 [WARN] [03/11/2024 13:49:37.957] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config38-notifier#-631705772]: org.opendaylight.controller.cluster.common.actor.Monitor@2197968f 01:49:37,957 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testRecovery/member-1-shard-inventory-config38-notifier#-631705772 created and ready for shard:member-1-shard-inventory-config38 01:49:37,957 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#-534883647] 01:49:37,957 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - Starting recovery for member-1-shard-inventory-config38 with journal batch size 3 [WARN] [03/11/2024 13:49:37.957] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#-534883647]: org.opendaylight.controller.cluster.common.actor.Monitor@51c6a002 01:49:37,957 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1185280395] 01:49:37,957 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: SnapshotOffer called. 01:49:37,957 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Moving last applied index from -1 to -1 01:49:37,957 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Set currentTerm=1, votedFor=null 01:49:37,957 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Applying recovered snapshot 01:49:37,957 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config38: clearing clients {} 01:49:37,958 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config38: Created publisher actor Actor[akka://test/user/testRecovery/member-1-shard-inventory-config38-DTCL-publisher#-1518221980] with name member-1-shard-inventory-config38-DTCL-publisher 01:49:37,958 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testRecovery/member-1-shard-inventory-config38-DTCL-publisher#-1518221980] 01:49:37,958 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: state snapshot applied in 760.7 μs [WARN] [03/11/2024 13:49:37.958] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config38-DTCL-publisher#-1518221980]: org.opendaylight.controller.cluster.common.actor.Monitor@1f3331c9 01:49:37,958 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config38: publishChanges: rootPath: / 01:49:37,958 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - Recovery snapshot applied for member-1-shard-inventory-config38 in 1.050 ms: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:49:37,959 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config38: Elapsed time for generation of change events for member-1-shard-inventory-config38-DTCL-publisher: 160.9 μs 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 0, size: 45 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 1, size: 184 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 2, size: 184 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 3, size: 184 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 4, size: 184 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 5, size: 184 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 6, size: 184 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 7, size: 184 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 8, size: 184 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 9, size: 184 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,965 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 10, size: 184 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 11, size: 184 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 12, size: 184 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 13, size: 184 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 14, size: 184 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 15, size: 184 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 16, size: 184 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received apply journal entries for recovery, applying to state: 0 to 16 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: starting log recovery batch with max size 3 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config38: Added client Enabled{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@14e9ee2f}, purged=MutableUnsignedLongSet{size=0}} 01:49:37,966 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-87-0 01:49:37,967 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-88-0 01:49:37,967 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-89-0 01:49:37,967 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: starting log recovery batch with max size 3 01:49:37,968 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-90-0 01:49:37,968 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-91-0 01:49:37,968 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-92-0 01:49:37,968 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: starting log recovery batch with max size 3 01:49:37,969 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-93-0 01:49:37,969 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-94-0 01:49:37,969 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-95-0 01:49:37,969 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: starting log recovery batch with max size 3 01:49:37,970 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-96-0 01:49:37,970 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-97-0 01:49:37,970 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-98-0 01:49:37,970 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: starting log recovery batch with max size 3 01:49:37,971 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-99-0 01:49:37,971 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-100-0 01:49:37,971 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-101-0 01:49:37,971 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: starting log recovery batch with max size 3 01:49:37,972 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-102-0 01:49:37,972 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-103-0 01:49:37,972 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Moving last applied index from -1 to 16 01:49:37,972 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:37,972 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config38: Recovery completed in 14.94 ms - Switching actor to Follower - last log index = 16, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 17 01:49:37,973 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: false, hasLeader : false 01:49:37,973 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config38 is no longer the leader [WARN] [03/11/2024 13:49:37.973] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testRecovery]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@3e6026e2 01:49:37,973 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38 (Follower): Received TimeoutNow - switching to Candidate 01:49:37,973 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38 (Candidate): Election: Candidate has following voting peers: [] 01:49:37,973 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from null to Follower 01:49:37,973 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Set currentTerm=2, votedFor=member-1-shard-inventory-config38 01:49:37,973 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config38 (Candidate): Starting new election term 2 01:49:37,973 PM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config38 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 01:49:37,973 PM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config38 (Follower): Closing 01:49:37,973 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: false, hasLeader : false 01:49:37,973 PM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config38 is no longer the leader 01:49:37,973 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from Follower to Candidate 01:49:37,974 PM [test-akka.actor.default-dispatcher-19] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38 (Candidate): Received ElectionTimeout 01:49:37,974 PM [test-akka.actor.default-dispatcher-19] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38 (Leader): Election: Leader has following peers: [] 01:49:37,974 PM [test-akka.actor.default-dispatcher-19] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config38 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 01:49:37,974 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: true, hasLeader : true 01:49:37,974 PM [test-akka.actor.default-dispatcher-19] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: became leader with frontend state for [member-1-frontend-ShardTransactionTest] 01:49:37,974 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from Candidate to Leader 01:49:37,975 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config39, persistent : true 01:49:37,975 PM [test-akka.actor.default-dispatcher-19] [INFO] AbstractShardTest$1 - Stopping Shard member-1-shard-inventory-config38 01:49:37,975 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageSlicer - member-1-shard-inventory-config38 (Leader)_slicer-id-311: Closing [WARN] [03/11/2024 13:49:37.975] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.common.actor.Monitor@5e016eb5 01:49:37,976 PM [test-akka.actor.default-dispatcher-19] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Aborting 0 pending queued transactions 01:49:37,976 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-1124300749] 01:49:37,976 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testAbortAfterReady/member-1-shard-inventory-config39-notifier#-1442431692 created and ready for shard:member-1-shard-inventory-config39 [WARN] [03/11/2024 13:49:37.976] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config39-notifier#-1442431692]: org.opendaylight.controller.cluster.common.actor.Monitor@2d9e191c 01:49:37,976 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config39 with journal batch size 3 [WARN] [03/11/2024 13:49:37.976] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-1124300749]: org.opendaylight.controller.cluster.common.actor.Monitor@2b8b3086 01:49:37,977 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:37,977 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config39: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [03/11/2024 13:49:37.977] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@1056f7d7 01:49:37,977 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: false, hasLeader : false 01:49:37,977 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config39 is no longer the leader 01:49:37,977 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from null to Follower 01:49:37,977 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39 (Follower): Received TimeoutNow - switching to Candidate 01:49:37,977 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39 (Candidate): Election: Candidate has following voting peers: [] 01:49:37,977 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Set currentTerm=1, votedFor=member-1-shard-inventory-config39 01:49:37,977 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config39 (Candidate): Starting new election term 1 01:49:37,977 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config39 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:37,977 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageAssembler - member-1-shard-inventory-config39 (Follower): Closing 01:49:37,977 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: false, hasLeader : false 01:49:37,977 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config39 is no longer the leader 01:49:37,977 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from Follower to Candidate 01:49:37,978 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39 (Candidate): Received ElectionTimeout 01:49:37,978 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39 (Leader): Election: Leader has following peers: [] 01:49:37,978 PM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config39 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:37,978 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: true, hasLeader : true 01:49:37,978 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: became leader with frontend state for [] 01:49:37,978 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from Candidate to Leader 01:49:38,86 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:38,86 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,87 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,87 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-104-0 01:49:38,87 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Readying Tx member-1-ShardTransactionTest-fe-0-txn-104-0 of 1 operations, client version 13 01:49:38,87 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: readying transaction member-1-ShardTransactionTest-fe-0-txn-104-0 01:49:38,87 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: transaction member-1-ShardTransactionTest-fe-0-txn-104-0 ready 01:49:38,87 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-105-0 01:49:38,87 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Readying Tx member-1-ShardTransactionTest-fe-0-txn-105-0 of 1 operations, client version 13 01:49:38,87 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: readying transaction member-1-ShardTransactionTest-fe-0-txn-105-0 01:49:38,87 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: transaction member-1-ShardTransactionTest-fe-0-txn-105-0 ready 01:49:38,88 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-106-0 01:49:38,88 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Readying Tx member-1-ShardTransactionTest-fe-0-txn-106-0 of 1 operations, client version 13 01:49:38,88 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: readying transaction member-1-ShardTransactionTest-fe-0-txn-106-0 01:49:38,88 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: transaction member-1-ShardTransactionTest-fe-0-txn-106-0 ready 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-105-0 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: aborting queued transaction member-1-ShardTransactionTest-fe-0-txn-105-0 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-105-0: abort - successfulFromPrevious: [] 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Moving last applied index from -1 to 0 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config39: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2300309} is already disabled 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-104-0 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Validating transaction member-1-ShardTransactionTest-fe-0-txn-104-0 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-104-0 validated 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-104-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: canCommit for member-1-ShardTransactionTest-fe-0-txn-104-0: success 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Persisting ApplyJournalEntries with index=0 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Committing transaction member-1-ShardTransactionTest-fe-0-txn-104-0 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-104-0 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-104-0 candidate ready 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-104-0: canCommit - candidate rootPath: / 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-104-0: canCommit - messages: [] 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-104-0: preCommit - successfulFromPrevious: [] 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-104-0 prepared 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-104-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-104-0 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-104-0 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:38,89 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-104-0 submitted to persistence 01:49:38,91 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:38,91 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Moving last applied index from 0 to 1 01:49:38,91 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Applying state for log index 1 data Simple{size=143} 01:49:38,91 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-104-0 01:49:38,91 PM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-104-0: commit - successfulFromPrevious: [] 01:49:38,91 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-104-0 changing state from COMMIT_PENDING to COMMITTED 01:49:38,91 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-104-0 committed as 0, sending response to Actor[akka://test/system/testProbe-697#602076125] 01:49:38,92 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config39: Created publisher actor Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config39-DTCL-publisher#-1398032887] with name member-1-shard-inventory-config39-DTCL-publisher 01:49:38,92 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config39-DTCL-publisher#-1398032887] 01:49:38,92 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-106-0 01:49:38,92 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Validating transaction member-1-ShardTransactionTest-fe-0-txn-106-0 01:49:38,92 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-106-0 validated 01:49:38,92 PM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-106-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:38,92 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: canCommit for member-1-ShardTransactionTest-fe-0-txn-106-0: success 01:49:38,92 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: fakeSnapshot purging log to 0 for term 1 01:49:38,92 PM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Persisting ApplyJournalEntries with index=1 01:49:38,92 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config39: publishChanges: rootPath: / [WARN] [03/11/2024 13:49:38.092] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config39-DTCL-publisher#-1398032887]: org.opendaylight.controller.cluster.common.actor.Monitor@69f99db6 01:49:38,92 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config39: Elapsed time for generation of change events for member-1-shard-inventory-config39-DTCL-publisher: 199.2 μs 01:49:38,92 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Committing transaction member-1-ShardTransactionTest-fe-0-txn-106-0 01:49:38,92 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-106-0 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-106-0 candidate ready 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-106-0: canCommit - candidate rootPath: / 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-106-0: canCommit - messages: [] 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-106-0: preCommit - successfulFromPrevious: [] 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-106-0 prepared 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-106-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-106-0 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-106-0 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 01:49:38,93 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-106-0 submitted to persistence 01:49:38,94 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 01:49:38,94 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Moving last applied index from 1 to 2 01:49:38,94 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Applying state for log index 2 data Simple{size=45} 01:49:38,94 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-106-0 01:49:38,94 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-106-0: commit - successfulFromPrevious: [] 01:49:38,94 PM [test-akka.actor.default-dispatcher-19] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-106-0 changing state from COMMIT_PENDING to COMMITTED 01:49:38,94 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-106-0 committed as 0, sending response to Actor[akka://test/system/testProbe-697#602076125] 01:49:38,94 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config39: publishChanges: rootPath: / 01:49:38,94 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: fakeSnapshot purging log to 1 for term 1 01:49:38,94 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config39: Persisting ApplyJournalEntries with index=2 01:49:38,94 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config39: Elapsed time for generation of change events for member-1-shard-inventory-config39-DTCL-publisher: 25.50 μs 01:49:38,94 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterReady] 01:49:38,105 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config39 01:49:38,105 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config39 (Leader)_slicer-id-313: Closing 01:49:38,105 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config39: Aborting 0 pending queued transactions 01:49:38,107 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Shard created : member-1-shard-inventory-config40, persistent : true 01:49:38,108 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Starting recovery for member-1-shard-inventory-config40 with journal batch size 3 [WARN] [03/11/2024 13:49:38.108] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false]: org.opendaylight.controller.cluster.common.actor.Monitor@24e5c2a 01:49:38,109 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/shard-member-1:snapshot-read#-983535988] 01:49:38,109 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config40-notifier#-1480718237 created and ready for shard:member-1-shard-inventory-config40 [WARN] [03/11/2024 13:49:38.109] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config40-notifier#-1480718237]: org.opendaylight.controller.cluster.common.actor.Monitor@2577db01 [WARN] [03/11/2024 13:49:38.109] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/shard-member-1:snapshot-read#-983535988]: org.opendaylight.controller.cluster.common.actor.Monitor@3354ea87 01:49:38,111 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:38,111 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config40: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:38,111 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,111 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config40 is no longer the leader 01:49:38,111 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from null to Follower 01:49:38,111 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40 (Follower): Received TimeoutNow - switching to Candidate 01:49:38,111 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40 (Candidate): Election: Candidate has following voting peers: [] 01:49:38,111 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40: Set currentTerm=1, votedFor=member-1-shard-inventory-config40 01:49:38,111 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config40 (Candidate): Starting new election term 1 01:49:38,111 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config40 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:38,111 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config40 (Follower): Closing 01:49:38,111 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,111 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config40 is no longer the leader 01:49:38,111 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:38.112] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@54fcbc2 01:49:38,112 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40 (Candidate): Received ElectionTimeout 01:49:38,112 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40 (Leader): Election: Leader has following peers: [] 01:49:38,112 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config40 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:38,112 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: true, hasLeader : true 01:49:38,113 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: became leader with frontend state for [] 01:49:38,113 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from Candidate to Leader 01:49:38,173 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:38,173 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,173 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,174 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-107-0 01:49:38,174 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Readying Tx member-1-ShardTransactionTest-fe-0-txn-107-0 of 1 operations, client version 13 01:49:38,174 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: readying transaction member-1-ShardTransactionTest-fe-0-txn-107-0 01:49:38,174 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: transaction member-1-ShardTransactionTest-fe-0-txn-107-0 ready 01:49:38,174 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-107-0 01:49:38,174 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Validating transaction member-1-ShardTransactionTest-fe-0-txn-107-0 01:49:38,174 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Transaction member-1-ShardTransactionTest-fe-0-txn-107-0 validated 01:49:38,174 PM [test-akka.actor.default-dispatcher-19] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-107-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:38,174 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: canCommit for member-1-ShardTransactionTest-fe-0-txn-107-0: success 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Committing transaction member-1-ShardTransactionTest-fe-0-txn-107-0 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-107-0 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Transaction member-1-ShardTransactionTest-fe-0-txn-107-0 candidate ready 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-107-0: canCommit - candidate rootPath: / 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-107-0: canCommit - messages: [] 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-107-0: preCommit - successfulFromPrevious: [] 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Transaction member-1-ShardTransactionTest-fe-0-txn-107-0 prepared 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-107-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-107-0 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-107-0 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:38,175 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Transaction member-1-ShardTransactionTest-fe-0-txn-107-0 submitted to persistence 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Moving last applied index from -1 to 0 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] FrontendMetadata - member-1-shard-inventory-config40: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2844443} is already disabled 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Persisting ApplyJournalEntries with index=0 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Moving last applied index from 0 to 1 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Applying state for log index 1 data Simple{size=143} 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-107-0 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-107-0: commit - successfulFromPrevious: [] 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-107-0 changing state from COMMIT_PENDING to COMMITTED 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Transaction member-1-ShardTransactionTest-fe-0-txn-107-0 committed as 0, sending response to Actor[akka://test/system/testProbe-699#-169476004] 01:49:38,176 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config40: Created publisher actor Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config40-DTCL-publisher#1813411988] with name member-1-shard-inventory-config40-DTCL-publisher 01:49:38,176 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config40-DTCL-publisher#1813411988] 01:49:38,177 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config40: publishChanges: rootPath: / 01:49:38,177 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: fakeSnapshot purging log to 0 for term 1 01:49:38,177 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Persisting ApplyJournalEntries with index=1 01:49:38,177 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config40: Elapsed time for generation of change events for member-1-shard-inventory-config40-DTCL-publisher: 168.1 μs [WARN] [03/11/2024 13:49:38.177] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config40-DTCL-publisher#1813411988]: org.opendaylight.controller.cluster.common.actor.Monitor@5fda3207 01:49:38,379 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false] 01:49:38,390 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Stopping Shard member-1-shard-inventory-config40 01:49:38,390 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageSlicer - member-1-shard-inventory-config40 (Leader)_slicer-id-315: Closing 01:49:38,390 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config40: Aborting 0 pending queued transactions 01:49:38,392 PM [test-akka.actor.default-dispatcher-19] [INFO] ShardTest$1TestShard - Shard created : member-1-shard-inventory-config41, persistent : false [WARN] [03/11/2024 13:49:38.392] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData]: org.opendaylight.controller.cluster.common.actor.Monitor@50ee6918 01:49:38,393 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config41-notifier#730433103 created and ready for shard:member-1-shard-inventory-config41 [WARN] [03/11/2024 13:49:38.393] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config41-notifier#730433103]: org.opendaylight.controller.cluster.common.actor.Monitor@3e8280b3 01:49:38,393 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/shard-member-1:snapshot-read#-921451163] [WARN] [03/11/2024 13:49:38.393] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/shard-member-1:snapshot-read#-921451163]: org.opendaylight.controller.cluster.common.actor.Monitor@3a19b8db 01:49:38,394 PM [test-akka.actor.default-dispatcher-19] [INFO] ShardTest$1TestShard - Starting recovery for member-1-shard-inventory-config41 with journal batch size 3 01:49:38,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:38,395 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:38,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config41 is no longer the leader [WARN] [03/11/2024 13:49:38.395] [test-akka.actor.default-dispatcher-19] [akka://test/user] unhandled message from TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@476c8171 01:49:38,395 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from null to Follower 01:49:38,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41 (Follower): Received TimeoutNow - switching to Candidate 01:49:38,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41 (Candidate): Election: Candidate has following voting peers: [] 01:49:38,395 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Set currentTerm=1, votedFor=member-1-shard-inventory-config41 01:49:38,396 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41 (Candidate): Starting new election term 1 01:49:38,396 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:38,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config41 (Follower): Closing 01:49:38,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,396 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config41 is no longer the leader 01:49:38,396 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from Follower to Candidate 01:49:38,396 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41 (Candidate): Received ElectionTimeout 01:49:38,396 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41 (Leader): Election: Leader has following peers: [] 01:49:38,396 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:38,396 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: true, hasLeader : true 01:49:38,397 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: became leader with frontend state for [] 01:49:38,397 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from Candidate to Leader 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config41: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=70222} is already disabled 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-108-0 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Readying Tx member-1-ShardTransactionTest-fe-0-txn-108-0 of 1 operations, client version 13 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: readying transaction member-1-ShardTransactionTest-fe-0-txn-108-0 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: transaction member-1-ShardTransactionTest-fe-0-txn-108-0 ready 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Validating transaction member-1-ShardTransactionTest-fe-0-txn-108-0 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-108-0 validated 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-108-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: canCommit for member-1-ShardTransactionTest-fe-0-txn-108-0: success 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Committing transaction member-1-ShardTransactionTest-fe-0-txn-108-0 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-108-0 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-108-0 candidate ready 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-108-0: canCommit - candidate rootPath: / 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-108-0: canCommit - messages: [] 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-108-0: preCommit - successfulFromPrevious: [] 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-108-0 prepared 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-108-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-108-0 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-108-0 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-108-0 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-108-0: commit - successfulFromPrevious: [] 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-108-0 changing state from COMMIT_PENDING to COMMITTED 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-108-0 committed as 0, sending response to Actor[akka://test/temp/testCreateSnapshotWithNonPersistentData$g] 01:49:38,493 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config41: Created publisher actor Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config41-DTCL-publisher#-2019773508] with name member-1-shard-inventory-config41-DTCL-publisher 01:49:38,494 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config41-DTCL-publisher#-2019773508] 01:49:38,494 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-108-0 submitted to persistence 01:49:38,494 PM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 01:49:38,494 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: lastSequenceNumber prior to capture: -1 01:49:38,494 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: publishChanges: rootPath: / [WARN] [03/11/2024 13:49:38.494] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config41-DTCL-publisher#-2019773508]: org.opendaylight.controller.cluster.common.actor.Monitor@1a5cbd8a 01:49:38,494 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config41: Elapsed time for generation of change events for member-1-shard-inventory-config41-DTCL-publisher: 119.8 μs 01:49:38,494 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{identifer=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 01:49:38,496 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: CaptureSnapshotReply received by actor 01:49:38,496 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@2945e55a, electionTerm=1, electionVotedFor=member-1-shard-inventory-config41, ServerConfigPayload=null] 01:49:38,496 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 01:49:38,496 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Snapshot success - sequence number: -1 01:49:38,496 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: SnapshotComplete received 01:49:38,496 PM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 01:49:38,496 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: lastSequenceNumber prior to capture: -1 01:49:38,497 PM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{identifer=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 01:49:38,497 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: CaptureSnapshotReply received by actor 01:49:38,497 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@5d362bfd, electionTerm=1, electionVotedFor=member-1-shard-inventory-config41, ServerConfigPayload=null] 01:49:38,497 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 01:49:38,497 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Snapshot success - sequence number: -1 01:49:38,497 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: SnapshotComplete received 01:49:38,497 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData] 01:49:38,507 PM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$1TestShard - Stopping Shard member-1-shard-inventory-config41 01:49:38,507 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageSlicer - member-1-shard-inventory-config41 (Leader)_slicer-id-317: Closing 01:49:38,508 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Aborting 0 pending queued transactions 01:49:38,514 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Shard created : member-1-shard-inventory-config42, persistent : true 01:49:38,515 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testFollowerInitialSyncStatus/shard-member-1:snapshot-read#918758422] 01:49:38,515 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testFollowerInitialSyncStatus/member-1-shard-inventory-config42-notifier#-2054018432 created and ready for shard:member-1-shard-inventory-config42 [WARN] [03/11/2024 13:49:38.514] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.common.actor.Monitor@6ebc930e [WARN] [03/11/2024 13:49:38.515] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testFollowerInitialSyncStatus/member-1-shard-inventory-config42-notifier#-2054018432]: org.opendaylight.controller.cluster.common.actor.Monitor@728e85d8 01:49:38,515 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Starting recovery for member-1-shard-inventory-config42 with journal batch size 3 [WARN] [03/11/2024 13:49:38.515] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testFollowerInitialSyncStatus/shard-member-1:snapshot-read#918758422]: org.opendaylight.controller.cluster.common.actor.Monitor@51caf5f1 01:49:38,516 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config42: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:38,516 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config42: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:38,516 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,516 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config42: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config42 is no longer the leader 01:49:38,517 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config42 (Follower): Received TimeoutNow - switching to Candidate 01:49:38,517 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config42 (Candidate): Election: Candidate has following voting peers: [] 01:49:38,517 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config42: Set currentTerm=1, votedFor=member-1-shard-inventory-config42 01:49:38,517 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config42 (Candidate): Starting new election term 1 01:49:38,517 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config42 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:38,517 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config42 (Follower): Closing 01:49:38,517 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,517 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config42: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config42 is no longer the leader 01:49:38,517 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from null to Follower 01:49:38,517 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from Follower to Candidate 01:49:38,517 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42 (Candidate): Received ElectionTimeout 01:49:38,517 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42 (Leader): Election: Leader has following peers: [] 01:49:38,517 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config42 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:38,517 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: true, hasLeader : true 01:49:38,517 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config42: became leader with frontend state for [] 01:49:38,517 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from Candidate to Leader [WARN] [03/11/2024 13:49:38.518] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@682c5912 01:49:38,609 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testFollowerInitialSyncStatus] [WARN] [03/11/2024 13:49:38.610] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@7b38ce5f [WARN] [03/11/2024 13:49:38.610] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@7294aa61 01:49:38,620 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Stopping Shard member-1-shard-inventory-config42 01:49:38,620 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageSlicer - member-1-shard-inventory-config42 (Leader)_slicer-id-319: Closing 01:49:38,620 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config42: Aborting 0 pending queued transactions 01:49:38,624 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#-565695844] [WARN] [03/11/2024 13:49:38.624] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#-565695844]: org.opendaylight.controller.cluster.common.actor.Monitor@101d3d63 01:49:38,626 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1$1 - Shard created : member-1-shard-inventory-config43, persistent : true [WARN] [03/11/2024 13:49:38.626] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]: org.opendaylight.controller.cluster.common.actor.Monitor@5755f727 01:49:38,626 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/shard-member-1:snapshot-read#1835737710] [WARN] [03/11/2024 13:49:38.626] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/shard-member-1:snapshot-read#1835737710]: org.opendaylight.controller.cluster.common.actor.Monitor@2e20db02 [WARN] [03/11/2024 13:49:38.626] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config43-notifier#-1088181814]: org.opendaylight.controller.cluster.common.actor.Monitor@36d17bfc 01:49:38,626 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config43-notifier#-1088181814 created and ready for shard:member-1-shard-inventory-config43 01:49:38,627 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1$1 - Starting recovery for member-1-shard-inventory-config43 with journal batch size 3 01:49:38,629 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1185280395] 01:49:38,629 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: SnapshotOffer called. 01:49:38,629 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: Moving last applied index from -1 to -1 01:49:38,629 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: Set currentTerm=1, votedFor=null 01:49:38,629 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: Applying recovered snapshot 01:49:38,629 PM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config43: clearing clients {} 01:49:38,629 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config43: Created publisher actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config43-DTCL-publisher#-1217762817] with name member-1-shard-inventory-config43-DTCL-publisher 01:49:38,630 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: state snapshot applied in 522.6 μs 01:49:38,630 PM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$1$1 - Recovery snapshot applied for member-1-shard-inventory-config43 in 788.6 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:49:38,630 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config43-DTCL-publisher#-1217762817] 01:49:38,630 PM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config43: publishChanges: rootPath: / 01:49:38,630 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:38,631 PM [test-akka.actor.default-dispatcher-19] [INFO] ShardTest$1$1 - member-1-shard-inventory-config43: Recovery completed in 1.703 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:38,631 PM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config43: Elapsed time for generation of change events for member-1-shard-inventory-config43-DTCL-publisher: 136.8 μs 01:49:38,631 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,631 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config43 is no longer the leader 01:49:38,631 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43 (Follower): Received TimeoutNow - switching to Candidate 01:49:38,631 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43 (Candidate): Election: Candidate has following voting peers: [] 01:49:38,631 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: Set currentTerm=2, votedFor=member-1-shard-inventory-config43 01:49:38,631 PM [test-akka.actor.default-dispatcher-19] [INFO] ShardTest$1$1 - member-1-shard-inventory-config43 (Candidate): Starting new election term 2 01:49:38,631 PM [test-akka.actor.default-dispatcher-19] [INFO] ShardTest$1$1 - member-1-shard-inventory-config43 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 01:49:38,631 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageAssembler - member-1-shard-inventory-config43 (Follower): Closing 01:49:38,631 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: false, hasLeader : false [WARN] [03/11/2024 13:49:38.631] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config43-DTCL-publisher#-1217762817]: org.opendaylight.controller.cluster.common.actor.Monitor@1d30fae8 01:49:38,631 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config43 is no longer the leader 01:49:38,631 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from null to Follower 01:49:38,631 PM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:38.632] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@33216555 01:49:38,642 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#-565695844]], isLeader: false, hasLeader: false 01:49:38,642 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: Shard does not have a leader - delaying registration 01:49:38,642 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a#-1811241587] 01:49:38,642 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a [WARN] [03/11/2024 13:49:38.643] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a#-1811241587]: org.opendaylight.controller.cluster.common.actor.Monitor@73867052 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43 (Candidate): Received ElectionTimeout 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43 (Leader): Election: Leader has following peers: [] 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1$1 - member-1-shard-inventory-config43 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: true, hasLeader : true 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config43: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]], initialState present=true] to publisher actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config43-DTCL-publisher#-1217762817] 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: became leader with frontend state for [] 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config43: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@18fe7ce7 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config43: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]], initialState present=true] 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config43: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config43: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)] 01:49:38,643 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config43: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 01:49:38,644 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from Candidate to Leader 01:49:38,644 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config43: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@18fe7ce7 01:49:38,644 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#-565695844] 01:49:38,655 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration] 01:49:38,655 PM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1$1 - Stopping Shard member-1-shard-inventory-config43 01:49:38,655 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config43 (Leader)_slicer-id-321: Closing 01:49:38,656 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: Aborting 0 pending queued transactions 01:49:38,657 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config44, persistent : true 01:49:38,658 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config44 with journal batch size 3 [WARN] [03/11/2024 13:49:38.658] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@57ffc0fb 01:49:38,658 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config44-notifier#2022682893 created and ready for shard:member-1-shard-inventory-config44 01:49:38,658 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/shard-member-1:snapshot-read#1666689812] [WARN] [03/11/2024 13:49:38.659] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config44-notifier#2022682893]: org.opendaylight.controller.cluster.common.actor.Monitor@29d55780 [WARN] [03/11/2024 13:49:38.659] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/shard-member-1:snapshot-read#1666689812]: org.opendaylight.controller.cluster.common.actor.Monitor@3c34aac4 01:49:38,661 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config44: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:38,661 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config44: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:38,662 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,662 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config44: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config44 is no longer the leader [WARN] [03/11/2024 13:49:38.662] [test-akka.actor.default-dispatcher-19] [akka://test/user] unhandled message from TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@301d0c36 01:49:38,662 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from null to Follower 01:49:38,662 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config44 (Follower): Received TimeoutNow - switching to Candidate 01:49:38,662 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config44 (Candidate): Election: Candidate has following voting peers: [] 01:49:38,662 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config44: Set currentTerm=1, votedFor=member-1-shard-inventory-config44 01:49:38,662 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config44 (Candidate): Starting new election term 1 01:49:38,662 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config44 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:38,662 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config44 (Follower): Closing 01:49:38,662 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,662 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config44: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config44 is no longer the leader 01:49:38,662 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from Follower to Candidate 01:49:38,663 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config44 (Candidate): Received ElectionTimeout 01:49:38,663 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config44 (Leader): Election: Leader has following peers: [] 01:49:38,663 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config44 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:38,663 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: true, hasLeader : true 01:49:38,663 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config44: became leader with frontend state for [] 01:49:38,663 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from Candidate to Leader 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-109-0 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-109-0 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Validating transaction member-1-ShardTransactionTest-fe-0-txn-109-0 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-109-0 validated 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-109-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: canCommit for member-1-ShardTransactionTest-fe-0-txn-109-0: success 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Committing transaction member-1-ShardTransactionTest-fe-0-txn-109-0 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-109-0 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-109-0 candidate ready 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-109-0: canCommit - candidate rootPath: / 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-109-0: canCommit - messages: [] 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-109-0: preCommit - successfulFromPrevious: [] 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-109-0 prepared 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-109-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-109-0 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-109-0 01:49:38,769 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-109-0 submitted to persistence 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from -1 to 0 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] FrontendMetadata - member-1-shard-inventory-config44: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1131389} is already disabled 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from 0 to 1 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 1 data Simple{size=175} 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-109-0 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-109-0: commit - successfulFromPrevious: [] 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-109-0 changing state from COMMIT_PENDING to COMMITTED 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-109-0 committed as 0, sending response to Actor[akka://test/system/testProbe-705#-2048176026] 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config44: Created publisher actor Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config44-DTCL-publisher#537827246] with name member-1-shard-inventory-config44-DTCL-publisher 01:49:38,770 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit] 01:49:38,770 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config44-DTCL-publisher#537827246] 01:49:38,770 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: fakeSnapshot purging log to 0 for term 1 01:49:38,771 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=0 01:49:38,771 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=1 01:49:38,771 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config44: publishChanges: rootPath: / [WARN] [03/11/2024 13:49:38.771] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config44-DTCL-publisher#537827246]: org.opendaylight.controller.cluster.common.actor.Monitor@686e6a29 01:49:38,771 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config44: Elapsed time for generation of change events for member-1-shard-inventory-config44-DTCL-publisher: 137.5 μs 01:49:38,781 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config44 01:49:38,781 PM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config44 (Leader)_slicer-id-323: Closing 01:49:38,781 PM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config44: Aborting 0 pending queued transactions 01:49:38,783 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config45, persistent : true [WARN] [03/11/2024 13:49:38.783] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain#-1654396743]: org.opendaylight.controller.cluster.common.actor.Monitor@5fb7437 01:49:38,783 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testCreateTransactionOnChain/member-1-shard-inventory-config45-notifier#1700590354 created and ready for shard:member-1-shard-inventory-config45 01:49:38,783 PM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config45 with journal batch size 3 [WARN] [03/11/2024 13:49:38.783] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/member-1-shard-inventory-config45-notifier#1700590354]: org.opendaylight.controller.cluster.common.actor.Monitor@552b7842 01:49:38,783 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateTransactionOnChain/shard-member-1:snapshot-read#-677003281] [WARN] [03/11/2024 13:49:38.783] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/shard-member-1:snapshot-read#-677003281]: org.opendaylight.controller.cluster.common.actor.Monitor@5b53302d 01:49:38,784 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config45: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:38,784 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config45: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:38,784 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,784 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config45: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config45 is no longer the leader [WARN] [03/11/2024 13:49:38.784] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/user/testCreateTransactionOnChain#-1654396743]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@6130ba8a 01:49:38,784 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config45 (Follower): Received TimeoutNow - switching to Candidate 01:49:38,784 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from null to Follower 01:49:38,784 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config45 (Candidate): Election: Candidate has following voting peers: [] 01:49:38,784 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config45: Set currentTerm=1, votedFor=member-1-shard-inventory-config45 01:49:38,784 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config45 (Candidate): Starting new election term 1 01:49:38,784 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config45 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:38,784 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageAssembler - member-1-shard-inventory-config45 (Follower): Closing 01:49:38,784 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,784 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config45: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config45 is no longer the leader 01:49:38,784 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from Follower to Candidate 01:49:38,785 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config45 (Candidate): Received ElectionTimeout 01:49:38,785 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config45 (Leader): Election: Leader has following peers: [] 01:49:38,785 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config45 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:38,785 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: true, hasLeader : true 01:49:38,785 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config45: became leader with frontend state for [] 01:49:38,785 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from Candidate to Leader 01:49:38,845 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config45: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:38,845 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config45: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,845 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config45: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,845 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config45: Creating transaction : member-1-ShardTransactionTest-fe-0-txn-110-0 01:49:38,846 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testCreateTransactionOnChain/shard-inventory-member-1:ShardTransactionTest@0:110_3#231351002] 01:49:38,846 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testCreateTransactionOnChain#-1654396743] [WARN] [03/11/2024 13:49:38.846] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/shard-inventory-member-1:ShardTransactionTest@0:110_3#231351002]: org.opendaylight.controller.cluster.common.actor.Monitor@7d0d6f45 01:49:38,847 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config45: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,847 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config45: Moving last applied index from -1 to 0 01:49:38,847 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config45: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:38,847 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config45: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:38,847 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config45: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:38,847 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config45: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1876867} is already disabled 01:49:38,847 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config45: Persisting ApplyJournalEntries with index=0 01:49:38,857 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config45 01:49:38,857 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config45 (Leader)_slicer-id-325: Closing 01:49:38,857 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config45: Aborting 0 pending queued transactions 01:49:38,858 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config46, persistent : true [WARN] [03/11/2024 13:49:38.858] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRegisterDataTreeChangeListener]: org.opendaylight.controller.cluster.common.actor.Monitor@1944f9ac 01:49:38,859 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-notifier#-391727587 created and ready for shard:member-1-shard-inventory-config46 [WARN] [03/11/2024 13:49:38.859] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-notifier#-391727587]: org.opendaylight.controller.cluster.common.actor.Monitor@48e5b291 01:49:38,859 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/shard-member-1:snapshot-read#714453649] [WARN] [03/11/2024 13:49:38.859] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/shard-member-1:snapshot-read#714453649]: org.opendaylight.controller.cluster.common.actor.Monitor@51975b5f 01:49:38,859 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config46 with journal batch size 3 01:49:38,861 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:38,861 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config46: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:38,861 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,861 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config46 is no longer the leader [WARN] [03/11/2024 13:49:38.861] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testRegisterDataTreeChangeListener]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@69ff78ee 01:49:38,861 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config46 , received role change from null to Follower 01:49:38,861 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46 (Follower): Received TimeoutNow - switching to Candidate 01:49:38,861 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46 (Candidate): Election: Candidate has following voting peers: [] 01:49:38,861 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Set currentTerm=1, votedFor=member-1-shard-inventory-config46 01:49:38,861 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config46 (Candidate): Starting new election term 1 01:49:38,861 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config46 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:38,861 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config46 (Follower): Closing 01:49:38,861 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onLeadershipChange, isLeader: false, hasLeader : false 01:49:38,861 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config46 is no longer the leader 01:49:38,861 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config46 , received role change from Follower to Candidate 01:49:38,866 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config46 (Candidate): Received ElectionTimeout 01:49:38,866 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config46 (Leader): Election: Leader has following peers: [] 01:49:38,866 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config46 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:38,866 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onLeadershipChange, isLeader: true, hasLeader : true 01:49:38,866 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config46: became leader with frontend state for [] 01:49:38,866 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config46 , received role change from Candidate to Leader 01:49:38,959 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#-1551710782] [WARN] [03/11/2024 13:49:38.959] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#-1551710782]: org.opendaylight.controller.cluster.common.actor.Monitor@5c136a37 01:49:38,970 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#-1551710782]], isLeader: true, hasLeader: true 01:49:38,970 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/$a#1967937813] 01:49:38,970 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 01:49:38,970 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config46: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@210b889d [WARN] [03/11/2024 13:49:38.970] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/$a#1967937813]: org.opendaylight.controller.cluster.common.actor.Monitor@1bcc6a06 01:49:38,970 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config46: Created publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-DTCL-publisher#313426701] with name member-1-shard-inventory-config46-DTCL-publisher 01:49:38,970 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-DTCL-publisher#313426701] 01:49:38,970 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config46: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] to publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-DTCL-publisher#313426701] 01:49:38,970 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testRegisterDataTreeChangeListener/$a 01:49:38,971 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config46: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] 01:49:38,971 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] [WARN] [03/11/2024 13:49:38.971] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-DTCL-publisher#313426701]: org.opendaylight.controller.cluster.common.actor.Monitor@68884fef 01:49:38,971 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ForwardingDataTreeChangeListener - Sending OnInitialData to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] 01:49:38,971 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 01:49:38,971 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config46: Notifying onInitialData to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@210b889d 01:49:38,971 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:38,971 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,971 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,971 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-111-0 01:49:38,971 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Readying Tx member-1-ShardTransactionTest-fe-0-txn-111-0 of 1 operations, client version 13 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: readying transaction member-1-ShardTransactionTest-fe-0-txn-111-0 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: transaction member-1-ShardTransactionTest-fe-0-txn-111-0 ready 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Validating transaction member-1-ShardTransactionTest-fe-0-txn-111-0 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-111-0 validated 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-111-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: canCommit for member-1-ShardTransactionTest-fe-0-txn-111-0: success 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Committing transaction member-1-ShardTransactionTest-fe-0-txn-111-0 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-111-0 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-111-0 candidate ready 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-111-0: canCommit - candidate rootPath: / 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-111-0: canCommit - messages: [] 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-111-0: preCommit - successfulFromPrevious: [] 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-111-0 prepared 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-111-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-111-0 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-111-0 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:38,972 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-111-0 submitted to persistence 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Moving last applied index from -1 to 0 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config46: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2725160} is already disabled 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Moving last applied index from 0 to 1 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Applying state for log index 1 data Simple{size=143} 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-111-0 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-111-0: commit - successfulFromPrevious: [] 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-111-0 changing state from COMMIT_PENDING to COMMITTED 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-111-0 committed as 0, sending response to Actor[akka://test/temp/testRegisterDataTreeChangeListener$h] 01:49:38,974 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: publishChanges: rootPath: / 01:49:38,974 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 01:49:38,974 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] 01:49:38,974 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config46: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@210b889d 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: fakeSnapshot purging log to 0 for term 1 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Persisting ApplyJournalEntries with index=0 01:49:38,974 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config46: Elapsed time for generation of change events for member-1-shard-inventory-config46-DTCL-publisher: 129.6 μs 01:49:38,974 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config46: Persisting ApplyJournalEntries with index=1 01:49:38,975 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#2020913377] [WARN] [03/11/2024 13:49:38.975] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#2020913377]: org.opendaylight.controller.cluster.common.actor.Monitor@656a9dc4 01:49:38,975 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#2020913377]], isLeader: true, hasLeader: true 01:49:38,975 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/$b#128693412] 01:49:38,975 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 01:49:38,975 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config46: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] to publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-DTCL-publisher#313426701] 01:49:38,975 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testRegisterDataTreeChangeListener/$b 01:49:38,975 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config46: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@e8ebd06 01:49:38,975 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config46: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] 01:49:38,975 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] [WARN] [03/11/2024 13:49:38.975] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/$b#128693412]: org.opendaylight.controller.cluster.common.actor.Monitor@2d83b5fa 01:49:38,975 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 01:49:38,975 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)] 01:49:38,975 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 01:49:38,975 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config46: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@e8ebd06 01:49:39,476 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testRegisterDataTreeChangeListener] 01:49:39,487 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Stopping Shard member-1-shard-inventory-config46 01:49:39,487 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageSlicer - member-1-shard-inventory-config46 (Leader)_slicer-id-327: Closing 01:49:39,487 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config46: Aborting 0 pending queued transactions 01:49:39,487 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#-1551710782] 01:49:39,487 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#2020913377] 01:49:39,489 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener8#424523953] [WARN] [03/11/2024 13:49:39.489] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener8#424523953]: org.opendaylight.controller.cluster.common.actor.Monitor@6c2be477 [WARN] [03/11/2024 13:49:39.490] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9]: org.opendaylight.controller.cluster.common.actor.Monitor@5f529c51 01:49:39,490 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Shard created : member-1-shard-inventory-config47, persistent : true 01:49:39,492 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Starting recovery for member-1-shard-inventory-config47 with journal batch size 3 01:49:39,492 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config47-notifier#-984553708 created and ready for shard:member-1-shard-inventory-config47 01:49:39,492 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/shard-member-1:snapshot-read#1794685237] [WARN] [03/11/2024 13:49:39.492] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config47-notifier#-984553708]: org.opendaylight.controller.cluster.common.actor.Monitor@2519cf7e [WARN] [03/11/2024 13:49:39.492] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/shard-member-1:snapshot-read#1794685237]: org.opendaylight.controller.cluster.common.actor.Monitor@19ee4e56 01:49:39,493 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config47: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1185280395] 01:49:39,493 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config47: SnapshotOffer called. 01:49:39,493 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config47: Moving last applied index from -1 to -1 01:49:39,493 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config47: Set currentTerm=1, votedFor=null 01:49:39,493 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config47: Applying recovered snapshot 01:49:39,493 PM [test-akka.actor.default-dispatcher-19] [DEBUG] FrontendMetadata - member-1-shard-inventory-config47: clearing clients {} 01:49:39,493 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config47: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config47-DTCL-publisher#-1010179848] with name member-1-shard-inventory-config47-DTCL-publisher 01:49:39,494 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTree - member-1-shard-inventory-config47: state snapshot applied in 475.5 μs 01:49:39,494 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - Recovery snapshot applied for member-1-shard-inventory-config47 in 999.8 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 01:49:39,494 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config47-DTCL-publisher#-1010179848] 01:49:39,495 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config47: publishChanges: rootPath: / 01:49:39,495 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config47: Elapsed time for generation of change events for member-1-shard-inventory-config47-DTCL-publisher: 144.0 μs [WARN] [03/11/2024 13:49:39.495] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/member-1-shard-inventory-config47-DTCL-publisher#-1010179848]: org.opendaylight.controller.cluster.common.actor.Monitor@7fbb05ac 01:49:39,495 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config47: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:39,495 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config47: Recovery completed in 2.471 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:39,496 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onLeadershipChange, isLeader: false, hasLeader : false 01:49:39,496 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config47: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config47 is no longer the leader 01:49:39,496 PM [test-akka.actor.default-dispatcher-19] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config47 , received role change from null to Follower 01:49:39,496 PM [test-akka.actor.default-dispatcher-6] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [03/11/2024 13:49:39.496] [test-akka.actor.default-dispatcher-6] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@1bf019b9 01:49:39,601 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener8#424523953]], isLeader: false, hasLeader: false 01:49:39,601 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: Shard does not have a leader - delaying registration 01:49:39,601 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/$a 01:49:39,601 PM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/$a#1147960504] [WARN] [03/11/2024 13:49:39.602] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9/$a#1147960504]: org.opendaylight.controller.cluster.common.actor.Monitor@27e17053 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config47: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig null 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config47: Re-initializing to Follower with previous leaderId null 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config47 (Follower): Closing 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onLeadershipChange, isLeader: false, hasLeader : false 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config47: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config47 is no longer the leader 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config47 (Follower): Received TimeoutNow - switching to Candidate 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config47 (Candidate): Election: Candidate has following voting peers: [] 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config47: Set currentTerm=2, votedFor=member-1-shard-inventory-config47 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config47 (Candidate): Starting new election term 2 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config47 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageAssembler - member-1-shard-inventory-config47 (Follower): Closing 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onLeadershipChange, isLeader: false, hasLeader : false 01:49:39,602 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config47: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config47 is no longer the leader 01:49:39,603 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config47 , received role change from Follower to Candidate 01:49:39,603 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config47 (Candidate): Received ElectionTimeout 01:49:39,603 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config47 (Leader): Election: Leader has following peers: [] 01:49:39,603 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config47 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 01:49:39,603 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onLeadershipChange, isLeader: true, hasLeader : true 01:49:39,603 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config47: became leader with frontend state for [] 01:49:39,603 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config47 , received role change from Candidate to Leader 01:49:40,102 PM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener8#424523953] 01:49:40,113 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard9] 01:49:40,113 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Stopping Shard member-1-shard-inventory-config47 01:49:40,113 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageSlicer - member-1-shard-inventory-config47 (Leader)_slicer-id-329: Closing 01:49:40,113 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config47: Aborting 0 pending queued transactions 01:49:40,115 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Shard created : member-1-shard-inventory-config48, persistent : true [WARN] [03/11/2024 13:49:40.115] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@6017e270 01:49:40,116 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config48-notifier#2058290844 created and ready for shard:member-1-shard-inventory-config48 01:49:40,116 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/shard-member-1:snapshot-read#-1849794929] [WARN] [03/11/2024 13:49:40.116] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config48-notifier#2058290844]: org.opendaylight.controller.cluster.common.actor.Monitor@1b53e28b [WARN] [03/11/2024 13:49:40.116] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/shard-member-1:snapshot-read#-1849794929]: org.opendaylight.controller.cluster.common.actor.Monitor@3c620228 01:49:40,116 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Starting recovery for member-1-shard-inventory-config48 with journal batch size 3 01:49:40,117 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:40,118 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config48: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:40,118 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: onLeadershipChange, isLeader: false, hasLeader : false 01:49:40,118 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config48 is no longer the leader 01:49:40,118 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config48 , received role change from null to Follower 01:49:40,118 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48 (Follower): Received TimeoutNow - switching to Candidate 01:49:40,118 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48 (Candidate): Election: Candidate has following voting peers: [] 01:49:40,118 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Set currentTerm=1, votedFor=member-1-shard-inventory-config48 01:49:40,118 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config48 (Candidate): Starting new election term 1 01:49:40,118 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config48 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:40,118 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config48 (Follower): Closing 01:49:40,118 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: onLeadershipChange, isLeader: false, hasLeader : false 01:49:40,118 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config48 is no longer the leader 01:49:40,118 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config48 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:40.119] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@3adb6a8c 01:49:40,119 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48 (Candidate): Received ElectionTimeout 01:49:40,119 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48 (Leader): Election: Leader has following peers: [] 01:49:40,119 PM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config48 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:40,119 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: onLeadershipChange, isLeader: true, hasLeader : true 01:49:40,119 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: became leader with frontend state for [] 01:49:40,119 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config48 , received role change from Candidate to Leader 01:49:40,179 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config48: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-112-0 01:49:40,180 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config48: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:40,180 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config48: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:40,180 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config48: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:40,180 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config48: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-112-0 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-112-0 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Validating transaction member-1-ShardTransactionTest-fe-0-txn-112-0 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Transaction member-1-ShardTransactionTest-fe-0-txn-112-0 validated 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-112-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: canCommit for member-1-ShardTransactionTest-fe-0-txn-112-0: success 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Committing transaction member-1-ShardTransactionTest-fe-0-txn-112-0 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-112-0 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Transaction member-1-ShardTransactionTest-fe-0-txn-112-0 candidate ready 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-112-0: canCommit - candidate rootPath: / 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-112-0: canCommit - messages: [] 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-112-0: preCommit - successfulFromPrevious: [] 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Transaction member-1-ShardTransactionTest-fe-0-txn-112-0 prepared 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-112-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-112-0 01:49:40,181 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-112-0 01:49:40,182 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 01:49:40,182 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 01:49:40,182 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 01:49:40,182 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Transaction member-1-ShardTransactionTest-fe-0-txn-112-0 submitted to persistence 01:49:40,182 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:40,182 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Moving last applied index from -1 to 0 01:49:40,182 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:40,182 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:40,182 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config48: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:40,182 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2593697} is already disabled 01:49:40,182 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Persisting ApplyJournalEntries with index=0 01:49:40,183 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 01:49:40,183 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Moving last applied index from 0 to 1 01:49:40,183 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Applying state for log index 1 data Simple{size=175} 01:49:40,183 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-112-0 01:49:40,183 PM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-112-0: commit - successfulFromPrevious: [] 01:49:40,183 PM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-112-0 changing state from COMMIT_PENDING to COMMITTED 01:49:40,183 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Transaction member-1-ShardTransactionTest-fe-0-txn-112-0 committed as 0, sending response to Actor[akka://test/system/testProbe-713#23958090] 01:49:40,183 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit] 01:49:40,183 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config48: Created publisher actor Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config48-DTCL-publisher#-294590264] with name member-1-shard-inventory-config48-DTCL-publisher 01:49:40,183 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config48-DTCL-publisher#-294590264] 01:49:40,184 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: fakeSnapshot purging log to 0 for term 1 01:49:40,184 PM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config48: Persisting ApplyJournalEntries with index=1 01:49:40,184 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config48: publishChanges: rootPath: / [WARN] [03/11/2024 13:49:40.184] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config48-DTCL-publisher#-294590264]: org.opendaylight.controller.cluster.common.actor.Monitor@40ba8b65 01:49:40,184 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config48: Elapsed time for generation of change events for member-1-shard-inventory-config48-DTCL-publisher: 159.8 μs 01:49:40,194 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config48 01:49:40,194 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config48 (Leader)_slicer-id-331: Closing 01:49:40,194 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config48: Aborting 0 pending queued transactions 01:49:40,196 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config49, persistent : true [WARN] [03/11/2024 13:49:40.196] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry]: org.opendaylight.controller.cluster.common.actor.Monitor@189737ea 01:49:40,197 PM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config49-notifier#-1908268173 created and ready for shard:member-1-shard-inventory-config49 [WARN] [03/11/2024 13:49:40.197] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config49-notifier#-1908268173]: org.opendaylight.controller.cluster.common.actor.Monitor@792a6bb2 01:49:40,197 PM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/shard-member-1:snapshot-read#-2083154954] [WARN] [03/11/2024 13:49:40.197] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/shard-member-1:snapshot-read#-2083154954]: org.opendaylight.controller.cluster.common.actor.Monitor@1a94df9b 01:49:40,197 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config49 with journal batch size 3 01:49:40,204 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:40,204 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config49: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:40,204 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config49: onLeadershipChange, isLeader: false, hasLeader : false 01:49:40,204 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config49 is no longer the leader [WARN] [03/11/2024 13:49:40.204] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@2cccd3ff 01:49:40,204 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config49 , received role change from null to Follower 01:49:40,204 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49 (Follower): Received TimeoutNow - switching to Candidate 01:49:40,204 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49 (Candidate): Election: Candidate has following voting peers: [] 01:49:40,204 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: Set currentTerm=1, votedFor=member-1-shard-inventory-config49 01:49:40,204 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config49 (Candidate): Starting new election term 1 01:49:40,204 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config49 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:40,204 PM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config49 (Follower): Closing 01:49:40,204 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config49: onLeadershipChange, isLeader: false, hasLeader : false 01:49:40,204 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config49 is no longer the leader 01:49:40,205 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config49 , received role change from Follower to Candidate 01:49:40,205 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49 (Candidate): Received ElectionTimeout 01:49:40,205 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49 (Leader): Election: Leader has following peers: [] 01:49:40,205 PM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config49 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:40,205 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config49: onLeadershipChange, isLeader: true, hasLeader : true 01:49:40,205 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: became leader with frontend state for [] 01:49:40,205 PM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config49 , received role change from Candidate to Leader 01:49:40,265 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:40,266 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:40,266 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:40,266 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-113-0 01:49:40,266 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: Readying Tx member-1-ShardTransactionTest-fe-0-txn-113-0 of 1 operations, client version 13 01:49:40,266 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: readying transaction member-1-ShardTransactionTest-fe-0-txn-113-0 01:49:40,266 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: transaction member-1-ShardTransactionTest-fe-0-txn-113-0 ready 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-113-0 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Validating transaction member-1-ShardTransactionTest-fe-0-txn-113-0 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-113-0 validated 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-113-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: canCommit for member-1-ShardTransactionTest-fe-0-txn-113-0: success 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-114-0 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: Readying Tx member-1-ShardTransactionTest-fe-0-txn-114-0 of 1 operations, client version 13 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: readying transaction member-1-ShardTransactionTest-fe-0-txn-114-0 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: transaction member-1-ShardTransactionTest-fe-0-txn-114-0 ready 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: Moving last applied index from -1 to 0 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendMetadata - member-1-shard-inventory-config49: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1786186} is already disabled 01:49:40,267 PM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config49: Persisting ApplyJournalEntries with index=0 01:49:40,268 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-115-0 01:49:40,268 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-115-0 01:49:40,268 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Tx member-1-ShardTransactionTest-fe-0-txn-115-0 is scheduled for canCommit step 01:49:40,268 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Committing transaction member-1-ShardTransactionTest-fe-0-txn-113-0 01:49:40,268 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-113-0 01:49:40,268 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-113-0 candidate ready 01:49:40,268 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-113-0: canCommit - candidate rootPath: / 01:49:40,269 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-113-0: canCommit - messages: [] 01:49:40,269 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-113-0: preCommit - successfulFromPrevious: [] 01:49:40,269 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-113-0 prepared 01:49:40,269 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-113-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:40,269 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-113-0 01:49:40,269 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-113-0 01:49:40,269 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 01:49:40,269 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:40,269 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:40,269 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-113-0 submitted to persistence 01:49:40,270 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 01:49:40,270 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Moving last applied index from 0 to 1 01:49:40,270 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Applying state for log index 1 data Simple{size=143} 01:49:40,270 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-113-0 01:49:40,270 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-113-0: commit - successfulFromPrevious: [] 01:49:40,270 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-113-0 changing state from COMMIT_PENDING to COMMITTED 01:49:40,270 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-113-0 committed as 0, sending response to Actor[akka://test/system/testProbe-715#349984851] 01:49:40,270 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config49: Created publisher actor Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config49-DTCL-publisher#-1010435992] with name member-1-shard-inventory-config49-DTCL-publisher 01:49:40,270 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config49-DTCL-publisher#-1010435992] 01:49:40,271 PM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config49: publishChanges: rootPath: / 01:49:40,271 PM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config49: Elapsed time for generation of change events for member-1-shard-inventory-config49-DTCL-publisher: 149.0 μs 01:49:40,271 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: fakeSnapshot purging log to 0 for term 1 01:49:40,271 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Persisting ApplyJournalEntries with index=1 [WARN] [03/11/2024 13:49:40.271] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config49-DTCL-publisher#-1010435992]: org.opendaylight.controller.cluster.common.actor.Monitor@16ab61dc 01:49:40,886 PM [test-akka.actor.default-dispatcher-6] [WARN] ShardDataTree - member-1-shard-inventory-config49: Current transaction member-1-ShardTransactionTest-fe-0-txn-114-0 has timed out after 619 ms in state READY 01:49:40,886 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Validating transaction member-1-ShardTransactionTest-fe-0-txn-115-0 01:49:40,886 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-115-0 validated 01:49:40,886 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-115-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:40,886 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config49: canCommit for member-1-ShardTransactionTest-fe-0-txn-115-0: success 01:49:40,886 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config49: Committing transaction member-1-ShardTransactionTest-fe-0-txn-115-0 01:49:40,886 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-115-0 01:49:40,887 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-115-0 candidate ready 01:49:40,887 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-115-0: canCommit - candidate rootPath: / 01:49:40,887 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-115-0: canCommit - messages: [] 01:49:40,887 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-115-0: preCommit - successfulFromPrevious: [] 01:49:40,887 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-115-0 prepared 01:49:40,887 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-115-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 01:49:40,887 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config49: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-115-0 01:49:40,887 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-115-0 01:49:40,887 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 144 01:49:40,887 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config49: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=144}] 01:49:40,887 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config49: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=144}] 01:49:40,888 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-115-0 submitted to persistence 01:49:40,888 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config49: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=144}] 01:49:40,888 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config49: Moving last applied index from 1 to 2 01:49:40,888 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config49: Applying state for log index 2 data Simple{size=144} 01:49:40,889 PM [test-akka.actor.default-dispatcher-6] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-115-0 01:49:40,889 PM [test-akka.actor.default-dispatcher-6] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-115-0: commit - successfulFromPrevious: [] 01:49:40,889 PM [test-akka.actor.default-dispatcher-6] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-115-0 changing state from COMMIT_PENDING to COMMITTED 01:49:40,889 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-115-0 committed as 0, sending response to Actor[akka://test/system/testProbe-715#349984851] 01:49:40,889 PM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config49: publishChanges: rootPath: / 01:49:40,890 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config49: Elapsed time for generation of change events for member-1-shard-inventory-config49-DTCL-publisher: 148.9 μs 01:49:40,890 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config49: fakeSnapshot purging log to 1 for term 1 01:49:40,890 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config49: Persisting ApplyJournalEntries with index=2 01:49:40,890 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry] 01:49:40,901 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config49 01:49:40,901 PM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config49 (Leader)_slicer-id-333: Closing 01:49:40,901 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Aborting 0 pending queued transactions 01:49:40,903 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config50, persistent : true [WARN] [03/11/2024 13:49:40.903] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPreCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@18df46a4 01:49:40,904 PM [test-akka.actor.default-dispatcher-6] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.233:25520/user/testPreCommitPhaseFailure/member-1-shard-inventory-config50-notifier#-899942731 created and ready for shard:member-1-shard-inventory-config50 [WARN] [03/11/2024 13:49:40.904] [test-akka.actor.default-dispatcher-6] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPreCommitPhaseFailure/member-1-shard-inventory-config50-notifier#-899942731]: org.opendaylight.controller.cluster.common.actor.Monitor@50a029d4 01:49:40,904 PM [test-akka.actor.default-dispatcher-19] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPreCommitPhaseFailure/shard-member-1:snapshot-read#-1412115264] 01:49:40,904 PM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config50 with journal batch size 3 [WARN] [03/11/2024 13:49:40.905] [test-akka.actor.default-dispatcher-19] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPreCommitPhaseFailure/shard-member-1:snapshot-read#-1412115264]: org.opendaylight.controller.cluster.common.actor.Monitor@6e8d7b4f 01:49:40,906 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config50: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 01:49:40,906 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config50: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 01:49:40,906 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config50: onLeadershipChange, isLeader: false, hasLeader : false 01:49:40,906 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config50 is no longer the leader 01:49:40,906 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config50 , received role change from null to Follower 01:49:40,906 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config50 (Follower): Received TimeoutNow - switching to Candidate 01:49:40,906 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config50 (Candidate): Election: Candidate has following voting peers: [] 01:49:40,906 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config50: Set currentTerm=1, votedFor=member-1-shard-inventory-config50 01:49:40,906 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config50 (Candidate): Starting new election term 1 01:49:40,906 PM [test-akka.actor.default-dispatcher-19] [INFO] Shard - member-1-shard-inventory-config50 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 01:49:40,906 PM [test-akka.actor.default-dispatcher-19] [DEBUG] MessageAssembler - member-1-shard-inventory-config50 (Follower): Closing 01:49:40,906 PM [test-akka.actor.default-dispatcher-19] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config50: onLeadershipChange, isLeader: false, hasLeader : false 01:49:40,906 PM [test-akka.actor.default-dispatcher-19] [DEBUG] Shard - member-1-shard-inventory-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config50 is no longer the leader 01:49:40,906 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config50 , received role change from Follower to Candidate [WARN] [03/11/2024 13:49:40.907] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testPreCommitPhaseFailure]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@19fc33dc 01:49:40,907 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config50 (Candidate): Received ElectionTimeout 01:49:40,907 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config50 (Leader): Election: Leader has following peers: [] 01:49:40,907 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - member-1-shard-inventory-config50 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 01:49:40,907 PM [test-akka.actor.default-dispatcher-6] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config50: onLeadershipChange, isLeader: true, hasLeader : true 01:49:40,907 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config50: became leader with frontend state for [] 01:49:40,907 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config50 , received role change from Candidate to Leader 01:49:40,975 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 01:49:40,975 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:40,976 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:40,976 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-116-0 01:49:40,976 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Readying Tx member-1-ShardTransactionTest-fe-0-txn-116-0 of 1 operations, client version 13 01:49:40,976 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: readying transaction member-1-ShardTransactionTest-fe-0-txn-116-0 01:49:40,976 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: transaction member-1-ShardTransactionTest-fe-0-txn-116-0 ready 01:49:40,977 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-117-0 01:49:40,977 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Readying Tx member-1-ShardTransactionTest-fe-0-txn-117-0 of 1 operations, client version 13 01:49:40,977 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: readying transaction member-1-ShardTransactionTest-fe-0-txn-117-0 01:49:40,977 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: transaction member-1-ShardTransactionTest-fe-0-txn-117-0 ready 01:49:40,977 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-116-0 01:49:40,977 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: Validating transaction member-1-ShardTransactionTest-fe-0-txn-116-0 01:49:40,977 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: Transaction member-1-ShardTransactionTest-fe-0-txn-116-0 validated 01:49:40,977 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-116-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:40,977 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: canCommit for member-1-ShardTransactionTest-fe-0-txn-116-0: success 01:49:40,978 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 01:49:40,978 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Moving last applied index from -1 to 0 01:49:40,978 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 01:49:40,978 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 01:49:40,978 PM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config50: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 01:49:40,978 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2407941} is already disabled 01:49:40,978 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-117-0 01:49:40,978 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: Tx member-1-ShardTransactionTest-fe-0-txn-117-0 is scheduled for canCommit step 01:49:40,978 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Committing transaction member-1-ShardTransactionTest-fe-0-txn-116-0 01:49:40,978 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-116-0 01:49:40,978 PM [test-akka.actor.default-dispatcher-13] [ERROR] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-116-0 failed to prepare java.lang.RuntimeException: mock preCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1032) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:112) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:116) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:301) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:364) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:709) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:381) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:40,979 PM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-116-0: abort - successfulFromPrevious: [] 01:49:40,979 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-116-0 changing state from PRE_COMMIT_PENDING to FAILED 01:49:40,979 PM [test-akka.actor.default-dispatcher-13] [ERROR] Shard - member-1-shard-inventory-config50 An exception occurred while preCommitting transaction member-1-ShardTransactionTest-fe-0-txn-116-0 java.lang.RuntimeException: mock preCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1032) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:112) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:116) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:301) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:364) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:709) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:381) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 01:49:40,979 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: Validating transaction member-1-ShardTransactionTest-fe-0-txn-117-0 01:49:40,979 PM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: Transaction member-1-ShardTransactionTest-fe-0-txn-117-0 validated 01:49:40,979 PM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-117-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 01:49:40,979 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: canCommit for member-1-ShardTransactionTest-fe-0-txn-117-0: success 01:49:40,979 PM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Persisting ApplyJournalEntries with index=0 01:49:40,981 PM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPreCommitPhaseFailure] 01:49:40,991 PM [test-akka.actor.default-dispatcher-6] [INFO] Shard - Stopping Shard member-1-shard-inventory-config50 01:49:40,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] MessageSlicer - member-1-shard-inventory-config50 (Leader)_slicer-id-335: Closing 01:49:40,992 PM [test-akka.actor.default-dispatcher-6] [DEBUG] Shard - member-1-shard-inventory-config50: Aborting 1 pending queued transactions [WARN] [03/11/2024 13:49:40.992] [test-akka.actor.default-dispatcher-18] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testPreCommitPhaseFailure]: Failure(java.lang.RuntimeException: Transaction aborted due to shutdown.) [INFO] [03/11/2024 13:49:40.993] [test-akka.remote.default-remote-dispatcher-8] [akka://test@10.30.170.233:25520/system/remoting-terminator] Shutting down remote daemon. 01:49:40,993 PM [test-akka.actor.default-dispatcher-18] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. [INFO] [03/11/2024 13:49:40.993] [test-akka.remote.default-remote-dispatcher-8] [akka://test@10.30.170.233:25520/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. 01:49:40,993 PM [test-akka.actor.default-dispatcher-18] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [03/11/2024 13:49:40.995] [test-akka.remote.default-remote-dispatcher-8] [akka://test@10.30.170.233:25520/system/remoting-terminator] Remoting shut down. 01:49:40,995 PM [test-akka.actor.default-dispatcher-18] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. [DEBUG] [03/11/2024 13:49:40.995] [test-akka.actor.internal-dispatcher-2] [EventStream] shutting down: StandardOutLogger