[DEBUG] [01/22/2024 07:04:34.128] [main] [EventStream(akka://test)] logger log1-TestEventListener started 07:04:34,129 AM [test-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [01/22/2024 07:04:34.129] [main] [EventStream(akka://test)] logger log2-Slf4jLogger started [DEBUG] [01/22/2024 07:04:34.129] [main] [EventStream(akka://test)] Default Loggers started [INFO] [01/22/2024 07:04:34.135] [main] [ArteryTransport(akka://test)] Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.171.69:25520] with UID [-1191421823418066440] 07:04:34,136 AM [test-akka.actor.default-dispatcher-8] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.171.69:25520] with UID [-1191421823418066440] [INFO] [01/22/2024 07:04:34.136] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.69:25520] - Starting up, Akka version [2.6.21] ... 07:04:34,136 AM [test-akka.actor.default-dispatcher-7] [INFO] Cluster - Cluster Node [akka://test@10.30.171.69:25520] - Starting up, Akka version [2.6.21] ... [INFO] [01/22/2024 07:04:34.137] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.69:25520] - Registered cluster JMX MBean [akka:type=Cluster] [INFO] [01/22/2024 07:04:34.137] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.69:25520] - Started up successfully 07:04:34,137 AM [test-akka.actor.default-dispatcher-8] [INFO] Cluster - Cluster Node [akka://test@10.30.171.69:25520] - Registered cluster JMX MBean [akka:type=Cluster] 07:04:34,137 AM [test-akka.actor.default-dispatcher-8] [INFO] Cluster - Cluster Node [akka://test@10.30.171.69:25520] - Started up successfully 07:04:34,141 AM [test-akka.actor.default-dispatcher-8] [INFO] Cluster - Cluster Node [akka://test@10.30.171.69:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing 07:04:34,141 AM [test-akka.actor.default-dispatcher-8] [INFO] Cluster - Cluster Node [akka://test@10.30.171.69:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining [INFO] [01/22/2024 07:04:34.141] [test-akka.actor.internal-dispatcher-10] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.69:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing [INFO] [01/22/2024 07:04:34.141] [test-akka.actor.internal-dispatcher-10] [Cluster(akka://test)] Cluster Node [akka://test@10.30.171.69:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining 07:04:34,150 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config5, persistent : true [WARN] [01/22/2024 07:04:34.150] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testApplySnapshot]: org.opendaylight.controller.cluster.common.actor.Monitor@a0e4c2b [INFO] [akkaDeadLetter][01/22/2024 07:04:34.150] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,151 AM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testApplySnapshot] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [01/22/2024 07:04:34.151] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-notifier#1630705426]: org.opendaylight.controller.cluster.common.actor.Monitor@72454aa9 07:04:34,151 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testApplySnapshot/member-1-shard-inventory-config5-notifier#1630705426 created and ready for shard:member-1-shard-inventory-config5 07:04:34,151 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#1698462178] [WARN] [01/22/2024 07:04:34.152] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#1698462178]: org.opendaylight.controller.cluster.common.actor.Monitor@620c85b6 [INFO] [akkaDeadLetter][01/22/2024 07:04:34.152] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-notifier#1630705426] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,152 AM [test-akka.actor.default-dispatcher-8] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-notifier#1630705426] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][01/22/2024 07:04:34.152] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#1698462178] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,152 AM [test-akka.actor.default-dispatcher-8] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/shard-member-1:snapshot-read#1698462178] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,154 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config5 with journal batch size 3 07:04:34,156 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config5: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config5: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config5 is no longer the leader 07:04:34,157 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config5 , received role change from null to Follower 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5 (Follower): Received TimeoutNow - switching to Candidate 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5 (Candidate): Election: Candidate has following voting peers: [] 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5: Set currentTerm=1, votedFor=member-1-shard-inventory-config5 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config5 (Candidate): Starting new election term 1 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config5 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageAssembler - member-1-shard-inventory-config5 (Follower): Closing 07:04:34,157 AM [test-akka.actor.default-dispatcher-5] [INFO] LocalActorRef - Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] to Actor[akka://test/user] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config5: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config5 is no longer the leader [WARN] [01/22/2024 07:04:34.157] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testApplySnapshot]] 07:04:34,157 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config5 , received role change from Follower to Candidate [INFO] [akkaDeadLetter][01/22/2024 07:04:34.157] [test-akka.actor.default-dispatcher-5] [akka://test/user] Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] to Actor[akka://test/user] was unhandled. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5 (Candidate): Received ElectionTimeout 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5 (Leader): Election: Leader has following peers: [] 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config5 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config5: onLeadershipChange, isLeader: true, hasLeader : true 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5: became leader with frontend state for [] 07:04:34,157 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config5 , received role change from Candidate to Leader 07:04:34,249 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config5: Applying snapshot on follower: Snapshot [lastIndex=1, lastTerm=2, lastAppliedIndex=3, lastAppliedTerm=4, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@543bab9b, electionTerm=-1, electionVotedFor=null, ServerConfigPayload=null] 07:04:34,249 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - lastSequenceNumber prior to persisting applied snapshot: 1 07:04:34,249 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config5: SaveSnapshotSuccess received for snapshot, sequenceNr: 1 07:04:34,249 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5: Snapshot success - sequence number: 1 07:04:34,249 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5: Moving last applied index from -1 to 3 07:04:34,249 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5: Set currentTerm=-1, votedFor=null 07:04:34,249 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config5: Applying snapshot 07:04:34,249 AM [test-akka.actor.default-dispatcher-8] [DEBUG] FrontendMetadata - member-1-shard-inventory-config5: clearing clients {} 07:04:34,250 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config5: Created publisher actor Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-DTCL-publisher#-1390361286] with name member-1-shard-inventory-config5-DTCL-publisher 07:04:34,250 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-DTCL-publisher#-1390361286] 07:04:34,250 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config5: state snapshot applied in 582.0 μs 07:04:34,250 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config5: Done applying snapshot 07:04:34,250 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config5: publishChanges: rootPath: / 07:04:34,250 AM [test-akka.actor.default-dispatcher-15] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config5: Elapsed time for generation of change events for member-1-shard-inventory-config5-DTCL-publisher: 62.15 μs 07:04:34,250 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5: SnapshotComplete received [WARN] [01/22/2024 07:04:34.250] [test-akka.actor.default-dispatcher-15] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-DTCL-publisher#-1390361286]: org.opendaylight.controller.cluster.common.actor.Monitor@3b095285 [INFO] [akkaDeadLetter][01/22/2024 07:04:34.250] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-DTCL-publisher#-1390361286] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,250 AM [test-akka.actor.default-dispatcher-8] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testApplySnapshot/member-1-shard-inventory-config5-DTCL-publisher#-1390361286] to Actor[akka://test/user/termination-monitor] was not delivered. [5] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,251 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5: handled a snapshot response 07:04:34,251 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5: handled a journal response 07:04:34,324 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testApplySnapshot] 07:04:34,335 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - Stopping Shard member-1-shard-inventory-config5 07:04:34,335 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageSlicer - member-1-shard-inventory-config5 (Leader)_slicer-id-595: Closing 07:04:34,335 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config5: Aborting 0 pending queued transactions 07:04:34,338 AM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config6, persistent : true 07:04:34,338 AM [test-akka.actor.default-dispatcher-5] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence1] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [01/22/2024 07:04:34.338] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPersistence1]: org.opendaylight.controller.cluster.common.actor.Monitor@2353507b [INFO] [akkaDeadLetter][01/22/2024 07:04:34.338] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence1] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,338 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testPersistence1/member-1-shard-inventory-config6-notifier#-24520565 created and ready for shard:member-1-shard-inventory-config6 [WARN] [01/22/2024 07:04:34.338] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config6-notifier#-24520565]: org.opendaylight.controller.cluster.common.actor.Monitor@26887748 07:04:34,338 AM [test-akka.actor.default-dispatcher-8] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config6-notifier#-24520565] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][01/22/2024 07:04:34.338] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/member-1-shard-inventory-config6-notifier#-24520565] to Actor[akka://test/user/termination-monitor] was not delivered. [7] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,339 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#-2016711581] [WARN] [01/22/2024 07:04:34.339] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#-2016711581]: org.opendaylight.controller.cluster.common.actor.Monitor@bf40821 07:04:34,339 AM [test-akka.actor.default-dispatcher-15] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#-2016711581] to Actor[akka://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][01/22/2024 07:04:34.339] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testPersistence1/shard-member-1:snapshot-read#-2016711581] to Actor[akka://test/user/termination-monitor] was not delivered. [8] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,339 AM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config6 with journal batch size 3 07:04:34,340 AM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config6, persistent : false [WARN] [01/22/2024 07:04:34.340] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPersistence2]: org.opendaylight.controller.cluster.common.actor.Monitor@2df67dbc 07:04:34,340 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:34,340 AM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence2] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][01/22/2024 07:04:34.340] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testPersistence2] to Actor[akka://test/user/termination-monitor] was not delivered. [9] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,340 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config6: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:34,340 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,340 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config6 is no longer the leader 07:04:34,340 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6 (Follower): Received TimeoutNow - switching to Candidate 07:04:34,340 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6 (Candidate): Election: Candidate has following voting peers: [] 07:04:34,340 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6: Set currentTerm=1, votedFor=member-1-shard-inventory-config6 07:04:34,340 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config6 (Candidate): Starting new election term 1 07:04:34,340 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testPersistence2/member-1-shard-inventory-config6-notifier#-1426789418 created and ready for shard:member-1-shard-inventory-config6 07:04:34,340 AM [test-akka.actor.default-dispatcher-15] [INFO] Shard - member-1-shard-inventory-config6 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:34,340 AM [test-akka.actor.default-dispatcher-15] [DEBUG] MessageAssembler - member-1-shard-inventory-config6 (Follower): Closing 07:04:34,340 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from null to Follower 07:04:34,340 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPersistence2/shard-member-1:snapshot-read#561487094] 07:04:34,340 AM [test-akka.actor.default-dispatcher-15] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,340 AM [test-akka.actor.default-dispatcher-15] [DEBUG] Shard - member-1-shard-inventory-config6: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config6 is no longer the leader 07:04:34,340 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from Follower to Candidate 07:04:34,341 AM [test-akka.actor.default-dispatcher-5] [INFO] LocalActorRef - Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] to Actor[akka://test/user] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [01/22/2024 07:04:34.341] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testPersistence1]] [WARN] [01/22/2024 07:04:34.341] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence2/member-1-shard-inventory-config6-notifier#-1426789418]: org.opendaylight.controller.cluster.common.actor.Monitor@471b4319 [WARN] [01/22/2024 07:04:34.341] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPersistence2/shard-member-1:snapshot-read#561487094]: org.opendaylight.controller.cluster.common.actor.Monitor@17bf66db [INFO] [akkaDeadLetter][01/22/2024 07:04:34.341] [test-akka.actor.default-dispatcher-5] [akka://test/user] Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] to Actor[akka://test/user] was unhandled. [10] dead letters encountered, no more dead letters will be logged in next [5.000 min]. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 07:04:34,342 AM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config6 with journal batch size 3 07:04:34,342 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPersistence1] 07:04:34,343 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config6: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:34,343 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config6: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:34,343 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,343 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config6: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config6 is no longer the leader 07:04:34,343 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config6 (Follower): Received TimeoutNow - switching to Candidate 07:04:34,343 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config6 (Candidate): Election: Candidate has following voting peers: [] 07:04:34,343 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config6: Set currentTerm=1, votedFor=member-1-shard-inventory-config6 [WARN] [01/22/2024 07:04:34.343] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testPersistence2]] 07:04:34,343 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config6 (Candidate): Starting new election term 1 07:04:34,343 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from null to Follower 07:04:34,343 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config6 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:34,343 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageAssembler - member-1-shard-inventory-config6 (Follower): Closing 07:04:34,343 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,343 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config6: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config6 is no longer the leader 07:04:34,343 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config6 , received role change from Follower to Candidate 07:04:34,352 AM [main] [DEBUG] Shard - member-1-shard-inventory-config6 (Candidate): Received ElectionTimeout 07:04:34,352 AM [main] [DEBUG] Shard - member-1-shard-inventory-config6 (Leader): Election: Leader has following peers: [] 07:04:34,352 AM [main] [INFO] Shard - member-1-shard-inventory-config6 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:34,352 AM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: true, hasLeader : true 07:04:34,352 AM [main] [DEBUG] Shard - member-1-shard-inventory-config6: became leader with frontend state for [] [WARN] [01/22/2024 07:04:34.352] [test-akka.actor.default-dispatcher-18] [akka://test/user/testPersistence1/member-1-shard-inventory-config6-notifier] received dead letter from TestActor[akka://test/user/testPersistence1]: LeaderStateChanged [memberId=member-1-shard-inventory-config6, leaderId=member-1-shard-inventory-config6, leaderPayloadVersion=13] 07:04:34,353 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config6 07:04:34,353 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config6 (Leader)_slicer-id-598: Closing 07:04:34,353 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config6: Aborting 0 pending queued transactions [WARN] [01/22/2024 07:04:34.353] [test-akka.actor.default-dispatcher-18] [akka://test/user/testPersistence1/member-1-shard-inventory-config6-notifier] received dead letter from TestActor[akka://test/user/testPersistence1]: RoleChanged [memberId=member-1-shard-inventory-config6, oldRole=Candidate, newRole=Leader] 07:04:34,353 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPersistence2] 07:04:34,353 AM [main] [DEBUG] Shard - member-1-shard-inventory-config6 (Candidate): Received ElectionTimeout 07:04:34,353 AM [main] [DEBUG] Shard - member-1-shard-inventory-config6 (Leader): Election: Leader has following peers: [] 07:04:34,353 AM [main] [INFO] Shard - member-1-shard-inventory-config6 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:34,353 AM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config6: onLeadershipChange, isLeader: true, hasLeader : true 07:04:34,353 AM [main] [DEBUG] Shard - member-1-shard-inventory-config6: became leader with frontend state for [] [WARN] [01/22/2024 07:04:34.356] [test-akka.actor.default-dispatcher-18] [akka://test/user/testPersistence2/member-1-shard-inventory-config6-notifier] received dead letter from TestActor[akka://test/user/testPersistence2]: LeaderStateChanged [memberId=member-1-shard-inventory-config6, leaderId=member-1-shard-inventory-config6, leaderPayloadVersion=13] 07:04:34,356 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config6 07:04:34,356 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config6 (Leader)_slicer-id-599: Closing [WARN] [01/22/2024 07:04:34.356] [test-akka.actor.default-dispatcher-18] [akka://test/user/testPersistence2/member-1-shard-inventory-config6-notifier] received dead letter from TestActor[akka://test/user/testPersistence2]: RoleChanged [memberId=member-1-shard-inventory-config6, oldRole=Candidate, newRole=Leader] 07:04:34,356 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config6: Aborting 0 pending queued transactions 07:04:34,358 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$5 - Shard created : member-1-shard-inventory-config7, persistent : true 07:04:34,359 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$5 - Starting recovery for member-1-shard-inventory-config7 with journal batch size 3 [WARN] [01/22/2024 07:04:34.359] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortWithCommitPending]: org.opendaylight.controller.cluster.common.actor.Monitor@36f075bb 07:04:34,359 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortWithCommitPending/shard-member-1:snapshot-read#1179511682] 07:04:34,359 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testAbortWithCommitPending/member-1-shard-inventory-config7-notifier#-1204643654 created and ready for shard:member-1-shard-inventory-config7 [WARN] [01/22/2024 07:04:34.359] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config7-notifier#-1204643654]: org.opendaylight.controller.cluster.common.actor.Monitor@34217f63 [WARN] [01/22/2024 07:04:34.359] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/shard-member-1:snapshot-read#1179511682]: org.opendaylight.controller.cluster.common.actor.Monitor@6046c01d 07:04:34,360 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:34,360 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$5 - member-1-shard-inventory-config7: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:34,360 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config7: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,360 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config7 is no longer the leader 07:04:34,360 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config7 , received role change from null to Follower [WARN] [01/22/2024 07:04:34.360] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testAbortWithCommitPending]] 07:04:34,360 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7 (Follower): Received TimeoutNow - switching to Candidate 07:04:34,360 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7 (Candidate): Election: Candidate has following voting peers: [] 07:04:34,360 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Set currentTerm=1, votedFor=member-1-shard-inventory-config7 07:04:34,360 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$5 - member-1-shard-inventory-config7 (Candidate): Starting new election term 1 07:04:34,360 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$5 - member-1-shard-inventory-config7 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:34,360 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config7 (Follower): Closing 07:04:34,360 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config7: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,360 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config7 is no longer the leader 07:04:34,360 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config7 , received role change from Follower to Candidate 07:04:34,361 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7 (Candidate): Received ElectionTimeout 07:04:34,361 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7 (Leader): Election: Leader has following peers: [] 07:04:34,361 AM [test-akka.actor.default-dispatcher-18] [INFO] ShardTest$5 - member-1-shard-inventory-config7 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:34,361 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config7: onLeadershipChange, isLeader: true, hasLeader : true 07:04:34,361 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: became leader with frontend state for [] 07:04:34,361 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config7 , received role change from Candidate to Leader 07:04:34,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:34,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:34,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:34,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-132-0 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Readying Tx member-1-ShardTransactionTest-fe-0-txn-132-0 of 1 operations, client version 13 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: readying transaction member-1-ShardTransactionTest-fe-0-txn-132-0 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: transaction member-1-ShardTransactionTest-fe-0-txn-132-0 ready 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-132-0 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Validating transaction member-1-ShardTransactionTest-fe-0-txn-132-0 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-132-0 validated 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-132-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: canCommit for member-1-ShardTransactionTest-fe-0-txn-132-0: success 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Committing transaction member-1-ShardTransactionTest-fe-0-txn-132-0 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-132-0 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-132-0 candidate ready 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-132-0: canCommit - candidate rootPath: / 07:04:34,422 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-132-0: canCommit - messages: [] 07:04:34,423 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-132-0: preCommit - successfulFromPrevious: [] 07:04:34,423 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-132-0 prepared 07:04:34,423 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-132-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:34,423 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-132-0 07:04:34,423 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-132-0 07:04:34,423 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:34,423 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-132-0 07:04:34,424 AM [test-akka.actor.default-dispatcher-14] [WARN] ShardDataTree - member-1-shard-inventory-config7: transaction member-1-ShardTransactionTest-fe-0-txn-132-0 is committing, skipping abort 07:04:34,424 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:34,424 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:34,424 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-132-0 submitted to persistence 07:04:34,424 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:34,424 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Moving last applied index from -1 to 0 07:04:34,424 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:34,424 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:34,424 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config7: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:34,425 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3426793} is already disabled 07:04:34,425 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Persisting ApplyJournalEntries with index=0 07:04:34,425 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:34,425 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Moving last applied index from 0 to 1 07:04:34,425 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Applying state for log index 1 data Simple{size=143} 07:04:34,425 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config7: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-132-0 07:04:34,425 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-132-0: commit - successfulFromPrevious: [] 07:04:34,425 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-132-0 changing state from COMMIT_PENDING to COMMITTED 07:04:34,425 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Transaction member-1-ShardTransactionTest-fe-0-txn-132-0 committed as 0, sending response to Actor[akka://test/system/testProbe-172#-2135849573] 07:04:34,425 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config7: Created publisher actor Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config7-DTCL-publisher#-1195116339] with name member-1-shard-inventory-config7-DTCL-publisher 07:04:34,425 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config7-DTCL-publisher#-1195116339] 07:04:34,425 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: fakeSnapshot purging log to 0 for term 1 07:04:34,425 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config7: publishChanges: rootPath: / 07:04:34,425 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Persisting ApplyJournalEntries with index=1 07:04:34,426 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config7: Elapsed time for generation of change events for member-1-shard-inventory-config7-DTCL-publisher: 81.83 μs [WARN] [01/22/2024 07:04:34.425] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortWithCommitPending/member-1-shard-inventory-config7-DTCL-publisher#-1195116339]: org.opendaylight.controller.cluster.common.actor.Monitor@2784bc21 07:04:34,426 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortWithCommitPending] 07:04:34,436 AM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$5 - Stopping Shard member-1-shard-inventory-config7 07:04:34,436 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config7 (Leader)_slicer-id-601: Closing 07:04:34,436 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$5 - member-1-shard-inventory-config7: Aborting 0 pending queued transactions 07:04:34,437 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config8, persistent : true [WARN] [01/22/2024 07:04:34.437] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.common.actor.Monitor@685b1d26 07:04:34,438 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testAbortAfterReady/member-1-shard-inventory-config8-notifier#-2030546188 created and ready for shard:member-1-shard-inventory-config8 [WARN] [01/22/2024 07:04:34.438] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config8-notifier#-2030546188]: org.opendaylight.controller.cluster.common.actor.Monitor@44b9c526 07:04:34,438 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-1730809635] [WARN] [01/22/2024 07:04:34.438] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-1730809635]: org.opendaylight.controller.cluster.common.actor.Monitor@60682d4f 07:04:34,438 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config8 with journal batch size 3 07:04:34,441 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:34,441 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config8: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:34,441 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config8: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,441 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config8 is no longer the leader 07:04:34,441 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config8 , received role change from null to Follower 07:04:34,441 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8 (Follower): Received TimeoutNow - switching to Candidate 07:04:34,441 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8 (Candidate): Election: Candidate has following voting peers: [] 07:04:34,441 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Set currentTerm=1, votedFor=member-1-shard-inventory-config8 07:04:34,441 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config8 (Candidate): Starting new election term 1 [WARN] [01/22/2024 07:04:34.441] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testAbortAfterReady]] 07:04:34,441 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config8 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:34,441 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config8 (Follower): Closing 07:04:34,441 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config8: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,441 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config8 is no longer the leader 07:04:34,441 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config8 , received role change from Follower to Candidate 07:04:34,442 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8 (Candidate): Received ElectionTimeout 07:04:34,442 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8 (Leader): Election: Leader has following peers: [] 07:04:34,442 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config8 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:34,442 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config8: onLeadershipChange, isLeader: true, hasLeader : true 07:04:34,442 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: became leader with frontend state for [] 07:04:34,442 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config8 , received role change from Candidate to Leader 07:04:34,548 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:34,548 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:34,548 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:34,548 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-133-0 07:04:34,548 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Readying Tx member-1-ShardTransactionTest-fe-0-txn-133-0 of 1 operations, client version 13 07:04:34,548 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: readying transaction member-1-ShardTransactionTest-fe-0-txn-133-0 07:04:34,548 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: transaction member-1-ShardTransactionTest-fe-0-txn-133-0 ready 07:04:34,549 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-133-0 07:04:34,549 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: aborting head of queue member-1-ShardTransactionTest-fe-0-txn-133-0 in state member-1-ShardTransactionTest-fe-0-txn-133-0 07:04:34,549 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-133-0: abort - successfulFromPrevious: [] 07:04:34,549 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-133-0 07:04:34,549 AM [test-akka.actor.default-dispatcher-14] [ERROR] Shard - member-1-shard-inventory-config8: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-133-0 canCommit java.lang.IllegalStateException: member-1-shard-inventory-config8: Cannot canCommit transaction member-1-ShardTransactionTest-fe-0-txn-133-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:283) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:734) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:414) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:34,549 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:34,549 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Moving last applied index from -1 to 0 07:04:34,549 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:34,549 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:34,549 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config8: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:34,549 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1394502} is already disabled 07:04:34,549 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config8: Persisting ApplyJournalEntries with index=0 07:04:34,550 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config8: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-134-0 07:04:34,550 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config8: Readying Tx member-1-ShardTransactionTest-fe-0-txn-134-0 of 1 operations, client version 13 07:04:34,550 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: readying transaction member-1-ShardTransactionTest-fe-0-txn-134-0 07:04:34,550 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: transaction member-1-ShardTransactionTest-fe-0-txn-134-0 ready 07:04:34,550 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config8: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-134-0 07:04:34,550 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Validating transaction member-1-ShardTransactionTest-fe-0-txn-134-0 07:04:34,550 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config8: Transaction member-1-ShardTransactionTest-fe-0-txn-134-0 validated 07:04:34,550 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-134-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:34,550 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config8: canCommit for member-1-ShardTransactionTest-fe-0-txn-134-0: success 07:04:34,550 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterReady] 07:04:34,561 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config8 07:04:34,561 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config8 (Leader)_slicer-id-603: Closing 07:04:34,561 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config8: Aborting 1 pending queued transactions 07:04:34,568 AM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$2$1 - Shard created : member-1-shard-inventory-config9, persistent : true [WARN] [01/22/2024 07:04:34.568] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader]: org.opendaylight.controller.cluster.common.actor.Monitor@1161835a 07:04:34,569 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testOnBatchedModificationsWhenNotLeader/member-1-shard-inventory-config9-notifier#-2132827336 created and ready for shard:member-1-shard-inventory-config9 [WARN] [01/22/2024 07:04:34.569] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/member-1-shard-inventory-config9-notifier#-2132827336]: org.opendaylight.controller.cluster.common.actor.Monitor@11b39ff2 07:04:34,569 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/shard-member-1:snapshot-read#-1598621942] 07:04:34,569 AM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$2$1 - Starting recovery for member-1-shard-inventory-config9 with journal batch size 3 [WARN] [01/22/2024 07:04:34.569] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnBatchedModificationsWhenNotLeader/shard-member-1:snapshot-read#-1598621942]: org.opendaylight.controller.cluster.common.actor.Monitor@55513e3c 07:04:34,570 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:34,570 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$2$1 - member-1-shard-inventory-config9: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:34,570 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,570 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config9 is no longer the leader 07:04:34,570 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from null to Follower 07:04:34,570 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9 (Follower): Received TimeoutNow - switching to Candidate 07:04:34,570 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9 (Candidate): Election: Candidate has following voting peers: [] 07:04:34,570 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: Set currentTerm=1, votedFor=member-1-shard-inventory-config9 07:04:34,570 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$2$1 - member-1-shard-inventory-config9 (Candidate): Starting new election term 1 07:04:34,570 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$2$1 - member-1-shard-inventory-config9 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:34,570 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config9 (Follower): Closing 07:04:34,571 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,571 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config9 is no longer the leader 07:04:34,571 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:34.571] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader]] 07:04:34,571 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9 (Candidate): Received ElectionTimeout 07:04:34,571 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9 (Leader): Election: Leader has following peers: [] 07:04:34,571 AM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$2$1 - member-1-shard-inventory-config9 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:34,571 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config9: onLeadershipChange, isLeader: true, hasLeader : true 07:04:34,571 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: became leader with frontend state for [] 07:04:34,571 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config9 , received role change from Candidate to Leader 07:04:34,676 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: Forwarding 1 BatchedModifications to leader ActorSelection[Anchor(akka://test/), Path(/system/testProbe-176)] 07:04:34,677 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testOnBatchedModificationsWhenNotLeader] 07:04:34,688 AM [test-akka.actor.default-dispatcher-7] [INFO] ShardTest$2$1 - Stopping Shard member-1-shard-inventory-config9 07:04:34,688 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config9 (Leader)_slicer-id-605: Closing 07:04:34,688 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTest$2$1 - member-1-shard-inventory-config9: Aborting 0 pending queued transactions 07:04:34,689 AM [main] [INFO] Shard - Shard created : member-1-shard-inventory-config10, persistent : true 07:04:34,690 AM [main] [INFO] Shard - Starting recovery for member-1-shard-inventory-config10 with journal batch size 3 [WARN] [01/22/2024 07:04:34.691] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testOnDatastoreContext]: org.opendaylight.controller.cluster.common.actor.Monitor@572d5e79 07:04:34,691 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testOnDatastoreContext/member-1-shard-inventory-config10-notifier#503759069 created and ready for shard:member-1-shard-inventory-config10 [WARN] [01/22/2024 07:04:34.691] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnDatastoreContext/member-1-shard-inventory-config10-notifier#503759069]: org.opendaylight.controller.cluster.common.actor.Monitor@69106636 07:04:34,691 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testOnDatastoreContext/shard-member-1:snapshot-read#509449832] [WARN] [01/22/2024 07:04:34.691] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testOnDatastoreContext/shard-member-1:snapshot-read#509449832]: org.opendaylight.controller.cluster.common.actor.Monitor@6ae06b79 07:04:34,693 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:34,693 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config10: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:34,693 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,693 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config10 is no longer the leader 07:04:34,693 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from null to Follower 07:04:34,693 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10 (Follower): Received TimeoutNow - switching to Candidate 07:04:34,693 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10 (Candidate): Election: Candidate has following voting peers: [] 07:04:34,693 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: Set currentTerm=1, votedFor=member-1-shard-inventory-config10 07:04:34,693 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config10 (Candidate): Starting new election term 1 07:04:34,693 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config10 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:34,693 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config10 (Follower): Closing 07:04:34,693 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,693 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config10 is no longer the leader 07:04:34,693 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:34.693] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testOnDatastoreContext]] 07:04:34,791 AM [main] [DEBUG] Shard - member-1-shard-inventory-config10 (Candidate): Received ElectionTimeout 07:04:34,791 AM [main] [DEBUG] Shard - member-1-shard-inventory-config10 (Leader): Election: Leader has following peers: [] 07:04:34,791 AM [main] [INFO] Shard - member-1-shard-inventory-config10 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:34,791 AM [main] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config10: onLeadershipChange, isLeader: true, hasLeader : true 07:04:34,791 AM [main] [DEBUG] Shard - member-1-shard-inventory-config10: became leader with frontend state for [] 07:04:34,791 AM [main] [DEBUG] Shard - member-1-shard-inventory-config10: RaftPolicy used with prev.config null, RaftPolicy used with newConfig null 07:04:34,791 AM [main] [INFO] Shard - member-1-shard-inventory-config10: Persistence has been enabled - capturing snapshot 07:04:34,791 AM [main] [DEBUG] Shard - Take a snapshot of current state. lastReplicatedLog is null and replicatedToAllIndex is -1 07:04:34,791 AM [main] [DEBUG] Shard - member-1-shard-inventory-config10: Capturing Snapshot : lastLogEntry is null. Using snapshot values lastAppliedIndex -1 and lastAppliedTerm -1 instead. 07:04:34,791 AM [main] [INFO] Shard - member-1-shard-inventory-config10: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=-1, lastAppliedTerm=-1, lastIndex=-1, lastTerm=-1, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=true] 07:04:34,791 AM [main] [DEBUG] Shard - member-1-shard-inventory-config10: lastSequenceNumber prior to capture: 1 07:04:34,792 AM [main] [DEBUG] Shard - member-1-shard-inventory-config10: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[]}}} 07:04:34,792 AM [main] [DEBUG] Shard - member-1-shard-inventory-config10: RaftPolicy used with prev.config null, RaftPolicy used with newConfig null 07:04:34,792 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testOnDatastoreContext] 07:04:34,792 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config10 , received role change from Candidate to Leader 07:04:34,792 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: CaptureSnapshotReply received by actor 07:04:34,792 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config10: Persisting of snapshot done: Snapshot [lastIndex=-1, lastTerm=-1, lastAppliedIndex=-1, lastAppliedTerm=-1, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@3c7399e7, electionTerm=1, electionVotedFor=member-1-shard-inventory-config10, ServerConfigPayload=null] 07:04:34,792 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: user triggered or root overwrite snapshot encountered, trimming log up to last applied index -1 07:04:34,792 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config10: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 07:04:34,793 AM [test-akka.persistence.dispatchers.default-plugin-dispatcher-17] [INFO] Shard - member-1-shard-inventory-config10: SaveSnapshotSuccess received for snapshot, sequenceNr: 1 07:04:34,793 AM [test-akka.persistence.dispatchers.default-plugin-dispatcher-17] [DEBUG] Shard - member-1-shard-inventory-config10: Snapshot success - sequence number: 1 07:04:34,793 AM [test-akka.persistence.dispatchers.default-plugin-dispatcher-17] [DEBUG] Shard - member-1-shard-inventory-config10: SnapshotComplete received 07:04:34,793 AM [test-akka.persistence.dispatchers.default-plugin-dispatcher-17] [DEBUG] Shard - member-1-shard-inventory-config10: handled a snapshot response 07:04:34,793 AM [test-akka.persistence.dispatchers.default-plugin-dispatcher-16] [DEBUG] Shard - member-1-shard-inventory-config10: handled a journal response 07:04:34,802 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config10 07:04:34,802 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config10 (Leader)_slicer-id-607: Closing 07:04:34,802 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config10: Aborting 0 pending queued transactions [WARN] [01/22/2024 07:04:34.807] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCanCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@66912558 07:04:34,807 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config11, persistent : true 07:04:34,808 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testCanCommitPhaseFailure/member-1-shard-inventory-config11-notifier#842392115 created and ready for shard:member-1-shard-inventory-config11 [WARN] [01/22/2024 07:04:34.808] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitPhaseFailure/member-1-shard-inventory-config11-notifier#842392115]: org.opendaylight.controller.cluster.common.actor.Monitor@3632ca0 07:04:34,808 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCanCommitPhaseFailure/shard-member-1:snapshot-read#425122018] 07:04:34,808 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config11 with journal batch size 3 [WARN] [01/22/2024 07:04:34.808] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitPhaseFailure/shard-member-1:snapshot-read#425122018]: org.opendaylight.controller.cluster.common.actor.Monitor@7de2bed0 07:04:34,813 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config11: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config11 is no longer the leader 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11 (Follower): Received TimeoutNow - switching to Candidate 07:04:34,814 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from null to Follower 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11 (Candidate): Election: Candidate has following voting peers: [] 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: Set currentTerm=1, votedFor=member-1-shard-inventory-config11 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config11 (Candidate): Starting new election term 1 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config11 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config11 (Follower): Closing 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config11 is no longer the leader 07:04:34,814 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:34.814] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCanCommitPhaseFailure]] 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11 (Candidate): Received ElectionTimeout 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11 (Leader): Election: Leader has following peers: [] 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config11 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:34,814 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config11: onLeadershipChange, isLeader: true, hasLeader : true 07:04:34,815 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config11: became leader with frontend state for [] 07:04:34,815 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config11 , received role change from Candidate to Leader 07:04:34,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:34,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:34,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:34,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-136-0 07:04:34,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Readying Tx member-1-ShardTransactionTest-fe-0-txn-136-0 of 1 operations, client version 13 07:04:34,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: readying transaction member-1-ShardTransactionTest-fe-0-txn-136-0 07:04:34,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: transaction member-1-ShardTransactionTest-fe-0-txn-136-0 ready 07:04:34,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-136-0 07:04:34,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Validating transaction member-1-ShardTransactionTest-fe-0-txn-136-0 07:04:34,920 AM [test-akka.actor.default-dispatcher-7] [WARN] ShardDataTree - member-1-shard-inventory-config11: Store Tx member-1-ShardTransactionTest-fe-0-txn-136-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:292) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:734) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:414) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:34,920 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Store Tx member-1-ShardTransactionTest-fe-0-txn-136-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 07:04:34,920 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-136-0 changing state from CAN_COMMIT_PENDING to FAILED 07:04:34,920 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-136-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:853) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:292) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:734) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:414) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) ... 34 more 07:04:34,920 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:34,920 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Moving last applied index from -1 to 0 07:04:34,920 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:34,920 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:34,920 AM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config11: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:34,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2620531} is already disabled 07:04:34,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Persisting ApplyJournalEntries with index=0 07:04:34,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-137-0 07:04:34,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Readying Tx member-1-ShardTransactionTest-fe-0-txn-137-0 of 1 operations, client version 13 07:04:34,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: readying transaction member-1-ShardTransactionTest-fe-0-txn-137-0 07:04:34,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: transaction member-1-ShardTransactionTest-fe-0-txn-137-0 ready 07:04:34,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-137-0 07:04:34,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Validating transaction member-1-ShardTransactionTest-fe-0-txn-137-0 07:04:34,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config11: Transaction member-1-ShardTransactionTest-fe-0-txn-137-0 validated 07:04:34,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-137-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:34,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: canCommit for member-1-ShardTransactionTest-fe-0-txn-137-0: success 07:04:34,922 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCanCommitPhaseFailure] 07:04:34,932 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config11 07:04:34,932 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config11 (Leader)_slicer-id-609: Closing 07:04:34,932 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config11: Aborting 1 pending queued transactions 07:04:34,933 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config12, persistent : true [WARN] [01/22/2024 07:04:34.934] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterCanCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@7e54dcc7 07:04:34,934 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testAbortAfterCanCommit/member-1-shard-inventory-config12-notifier#-113299097 created and ready for shard:member-1-shard-inventory-config12 07:04:34,934 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterCanCommit/shard-member-1:snapshot-read#1843657790] [WARN] [01/22/2024 07:04:34.934] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterCanCommit/member-1-shard-inventory-config12-notifier#-113299097]: org.opendaylight.controller.cluster.common.actor.Monitor@509b9d94 [WARN] [01/22/2024 07:04:34.934] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterCanCommit/shard-member-1:snapshot-read#1843657790]: org.opendaylight.controller.cluster.common.actor.Monitor@4ad9a3cb 07:04:34,934 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config12 with journal batch size 3 07:04:34,935 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config12: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:34,935 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config12: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:34,935 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,935 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config12: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config12 is no longer the leader 07:04:34,935 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from null to Follower 07:04:34,935 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config12 (Follower): Received TimeoutNow - switching to Candidate 07:04:34,935 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config12 (Candidate): Election: Candidate has following voting peers: [] 07:04:34,935 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config12: Set currentTerm=1, votedFor=member-1-shard-inventory-config12 07:04:34,935 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config12 (Candidate): Starting new election term 1 07:04:34,935 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config12 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:34,935 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config12 (Follower): Closing 07:04:34,935 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: false, hasLeader : false 07:04:34,935 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config12: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config12 is no longer the leader 07:04:34,935 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:34.936] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testAbortAfterCanCommit]] 07:04:34,936 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12 (Candidate): Received ElectionTimeout 07:04:34,936 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12 (Leader): Election: Leader has following peers: [] 07:04:34,936 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config12 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:34,936 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config12: onLeadershipChange, isLeader: true, hasLeader : true 07:04:34,936 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: became leader with frontend state for [] 07:04:34,936 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config12 , received role change from Candidate to Leader 07:04:35,44 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:35,44 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,44 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,44 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-138-0 07:04:35,44 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Readying Tx member-1-ShardTransactionTest-fe-0-txn-138-0 of 1 operations, client version 13 07:04:35,44 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: readying transaction member-1-ShardTransactionTest-fe-0-txn-138-0 07:04:35,44 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: transaction member-1-ShardTransactionTest-fe-0-txn-138-0 ready 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-139-0 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Readying Tx member-1-ShardTransactionTest-fe-0-txn-139-0 of 1 operations, client version 13 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: readying transaction member-1-ShardTransactionTest-fe-0-txn-139-0 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: transaction member-1-ShardTransactionTest-fe-0-txn-139-0 ready 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Moving last applied index from -1 to 0 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config12: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1056347} is already disabled 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Persisting ApplyJournalEntries with index=0 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-138-0 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Validating transaction member-1-ShardTransactionTest-fe-0-txn-138-0 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-txn-138-0 validated 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-138-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:35,45 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: canCommit for member-1-ShardTransactionTest-fe-0-txn-138-0: success 07:04:35,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-139-0 07:04:35,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Tx member-1-ShardTransactionTest-fe-0-txn-139-0 is scheduled for canCommit step 07:04:35,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-138-0 07:04:35,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: aborting head of queue member-1-ShardTransactionTest-fe-0-txn-138-0 in state member-1-ShardTransactionTest-fe-0-txn-138-0 07:04:35,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Validating transaction member-1-ShardTransactionTest-fe-0-txn-139-0 07:04:35,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config12: Transaction member-1-ShardTransactionTest-fe-0-txn-139-0 validated 07:04:35,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-139-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:35,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: canCommit for member-1-ShardTransactionTest-fe-0-txn-139-0: success 07:04:35,46 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-138-0: abort - successfulFromPrevious: [] 07:04:35,46 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterCanCommit] 07:04:35,57 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config12 07:04:35,57 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config12 (Leader)_slicer-id-611: Closing 07:04:35,57 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config12: Aborting 1 pending queued transactions [WARN] [01/22/2024 07:04:35.057] [test-akka.actor.default-dispatcher-8] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testAbortAfterCanCommit]: Failure(java.lang.RuntimeException: Transaction aborted due to shutdown.) 07:04:35,58 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config13, persistent : true 07:04:35,59 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config13 with journal batch size 3 [WARN] [01/22/2024 07:04:35.059] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testConcurrentThreePhaseCommits]: org.opendaylight.controller.cluster.common.actor.Monitor@61101c9a 07:04:35,60 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config13-notifier#1040562115 created and ready for shard:member-1-shard-inventory-config13 07:04:35,60 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testConcurrentThreePhaseCommits/shard-member-1:snapshot-read#-230859852] [WARN] [01/22/2024 07:04:35.060] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config13-notifier#1040562115]: org.opendaylight.controller.cluster.common.actor.Monitor@746ee697 [WARN] [01/22/2024 07:04:35.060] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/shard-member-1:snapshot-read#-230859852]: org.opendaylight.controller.cluster.common.actor.Monitor@534f51e3 07:04:35,61 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:35,61 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config13: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:35,61 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: false, hasLeader : false [WARN] [01/22/2024 07:04:35.061] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testConcurrentThreePhaseCommits]] 07:04:35,61 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config13 is no longer the leader 07:04:35,61 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from null to Follower 07:04:35,61 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13 (Follower): Received TimeoutNow - switching to Candidate 07:04:35,61 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13 (Candidate): Election: Candidate has following voting peers: [] 07:04:35,61 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Set currentTerm=1, votedFor=member-1-shard-inventory-config13 07:04:35,61 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config13 (Candidate): Starting new election term 1 07:04:35,61 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config13 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:35,61 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageAssembler - member-1-shard-inventory-config13 (Follower): Closing 07:04:35,61 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: false, hasLeader : false 07:04:35,61 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config13 is no longer the leader 07:04:35,62 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from Follower to Candidate 07:04:35,62 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13 (Candidate): Received ElectionTimeout 07:04:35,62 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13 (Leader): Election: Leader has following peers: [] 07:04:35,62 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config13 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:35,62 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config13: onLeadershipChange, isLeader: true, hasLeader : true 07:04:35,62 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: became leader with frontend state for [] 07:04:35,62 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config13 , received role change from Candidate to Leader 07:04:35,171 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:35,171 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,171 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,171 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-140-0 07:04:35,171 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Readying Tx member-1-ShardTransactionTest-fe-0-txn-140-0 of 1 operations, client version 13 07:04:35,171 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: readying transaction member-1-ShardTransactionTest-fe-0-txn-140-0 07:04:35,171 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: transaction member-1-ShardTransactionTest-fe-0-txn-140-0 ready 07:04:35,172 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,172 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Moving last applied index from -1 to 0 07:04:35,172 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:35,172 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:35,172 AM [test-akka.actor.default-dispatcher-8] [DEBUG] FrontendMetadata - member-1-shard-inventory-config13: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:35,172 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1346742} is already disabled 07:04:35,172 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Persisting ApplyJournalEntries with index=0 07:04:35,174 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-140-0 07:04:35,179 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Validating transaction member-1-ShardTransactionTest-fe-0-txn-140-0 07:04:35,179 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-140-0 validated 07:04:35,179 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-140-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:35,179 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: canCommit for member-1-ShardTransactionTest-fe-0-txn-140-0: success 07:04:35,179 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-141-0 07:04:35,180 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Readying Tx member-1-ShardTransactionTest-fe-0-txn-141-0 of 1 operations, client version 13 07:04:35,180 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: readying transaction member-1-ShardTransactionTest-fe-0-txn-141-0 07:04:35,180 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: transaction member-1-ShardTransactionTest-fe-0-txn-141-0 ready 07:04:35,180 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-142-0 07:04:35,180 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Readying Tx member-1-ShardTransactionTest-fe-0-txn-142-0 of 1 operations, client version 13 07:04:35,180 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: readying transaction member-1-ShardTransactionTest-fe-0-txn-142-0 07:04:35,180 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: transaction member-1-ShardTransactionTest-fe-0-txn-142-0 ready 07:04:35,180 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-141-0 07:04:35,181 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Tx member-1-ShardTransactionTest-fe-0-txn-141-0 is scheduled for canCommit step 07:04:35,181 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-142-0 07:04:35,181 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Tx member-1-ShardTransactionTest-fe-0-txn-142-0 is scheduled for canCommit step 07:04:35,181 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Committing transaction member-1-ShardTransactionTest-fe-0-txn-140-0 07:04:35,181 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-140-0 07:04:35,181 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-140-0 candidate ready 07:04:35,181 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-140-0: canCommit - candidate rootPath: / 07:04:35,181 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-140-0: canCommit - messages: [] 07:04:35,181 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-140-0: preCommit - successfulFromPrevious: [] 07:04:35,181 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-140-0 prepared 07:04:35,181 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-140-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:35,181 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-140-0 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-140-0 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Validating transaction member-1-ShardTransactionTest-fe-0-txn-141-0 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-141-0 validated 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-141-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: canCommit for member-1-ShardTransactionTest-fe-0-txn-141-0: success 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-140-0 submitted to persistence 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Moving last applied index from 0 to 1 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Applying state for log index 1 data Simple{size=143} 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-140-0 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-140-0: commit - successfulFromPrevious: [] 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-140-0 changing state from COMMIT_PENDING to COMMITTED 07:04:35,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-140-0 committed as 0, sending response to Actor[akka://test/system/testProbe-183#-902583521] 07:04:35,183 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config13: Created publisher actor Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config13-DTCL-publisher#373847950] with name member-1-shard-inventory-config13-DTCL-publisher 07:04:35,183 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config13-DTCL-publisher#373847950] 07:04:35,183 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: fakeSnapshot purging log to 0 for term 1 07:04:35,183 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Persisting ApplyJournalEntries with index=1 07:04:35,183 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config13: publishChanges: rootPath: / [WARN] [01/22/2024 07:04:35.183] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testConcurrentThreePhaseCommits/member-1-shard-inventory-config13-DTCL-publisher#373847950]: org.opendaylight.controller.cluster.common.actor.Monitor@44935767 07:04:35,183 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config13: Elapsed time for generation of change events for member-1-shard-inventory-config13-DTCL-publisher: 77.33 μs 07:04:35,186 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Committing transaction member-1-ShardTransactionTest-fe-0-txn-141-0 07:04:35,186 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-141-0 07:04:35,186 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-141-0 candidate ready 07:04:35,186 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-141-0: canCommit - candidate rootPath: / 07:04:35,186 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 07:04:35,186 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-141-0: canCommit - messages: [] 07:04:35,186 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-141-0: preCommit - successfulFromPrevious: [] 07:04:35,186 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-141-0 prepared 07:04:35,186 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-141-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:35,186 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-141-0 07:04:35,187 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-141-0 07:04:35,187 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 07:04:35,187 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Validating transaction member-1-ShardTransactionTest-fe-0-txn-142-0 07:04:35,187 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-142-0 validated 07:04:35,187 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-142-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:35,187 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: canCommit for member-1-ShardTransactionTest-fe-0-txn-142-0: success 07:04:35,187 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 07:04:35,187 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config13: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 07:04:35,187 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-141-0 submitted to persistence 07:04:35,187 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Committing transaction member-1-ShardTransactionTest-fe-0-txn-142-0 07:04:35,187 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-142-0 07:04:35,187 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-142-0 candidate ready 07:04:35,187 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-142-0: canCommit - candidate rootPath: / 07:04:35,187 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-142-0: canCommit - messages: [] 07:04:35,187 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-142-0: preCommit - successfulFromPrevious: [] 07:04:35,187 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-142-0 prepared 07:04:35,187 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-142-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-142-0 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-142-0 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Persist data SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-142-0 submitted to persistence 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Moving last applied index from 1 to 2 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Applying state for log index 2 data Simple{size=45} 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-141-0 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-141-0: commit - successfulFromPrevious: [] 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-141-0 changing state from COMMIT_PENDING to COMMITTED 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-141-0 committed as 0, sending response to Actor[akka://test/temp/testConcurrentThreePhaseCommits$a] 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config13: publishChanges: rootPath: / 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config13: Elapsed time for generation of change events for member-1-shard-inventory-config13-DTCL-publisher: 11.65 μs 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: fakeSnapshot purging log to 1 for term 1 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Persisting ApplyJournalEntries with index=2 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: persist complete SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Moving last applied index from 2 to 3 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Applying state for log index 3 data Simple{size=184} 07:04:35,188 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config13: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-142-0 07:04:35,189 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-142-0: commit - successfulFromPrevious: [] 07:04:35,189 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-142-0 changing state from COMMIT_PENDING to COMMITTED 07:04:35,189 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Transaction member-1-ShardTransactionTest-fe-0-txn-142-0 committed as 0, sending response to Actor[akka://test/temp/testConcurrentThreePhaseCommits$b] 07:04:35,189 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config13: publishChanges: rootPath: / 07:04:35,189 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: fakeSnapshot purging log to 2 for term 1 07:04:35,189 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config13: Persisting ApplyJournalEntries with index=3 07:04:35,189 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config13: Elapsed time for generation of change events for member-1-shard-inventory-config13-DTCL-publisher: 44.03 μs 07:04:35,190 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testConcurrentThreePhaseCommits] 07:04:35,200 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config13 07:04:35,200 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config13 (Leader)_slicer-id-613: Closing 07:04:35,200 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config13: Aborting 0 pending queued transactions 07:04:35,202 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config14, persistent : true 07:04:35,204 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config14 with journal batch size 3 [WARN] [01/22/2024 07:04:35.204] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true]: org.opendaylight.controller.cluster.common.actor.Monitor@51c406f8 07:04:35,204 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config14-notifier#1908251045 created and ready for shard:member-1-shard-inventory-config14 07:04:35,204 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/shard-member-1:snapshot-read#1377958674] [WARN] [01/22/2024 07:04:35.204] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config14-notifier#1908251045]: org.opendaylight.controller.cluster.common.actor.Monitor@4a3afebb [WARN] [01/22/2024 07:04:35.204] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/shard-member-1:snapshot-read#1377958674]: org.opendaylight.controller.cluster.common.actor.Monitor@a756be2 07:04:35,205 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:35,205 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config14: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:35,205 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 07:04:35,205 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 07:04:35,205 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from null to Follower 07:04:35,205 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14 (Follower): Received TimeoutNow - switching to Candidate 07:04:35,205 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14 (Candidate): Election: Candidate has following voting peers: [] 07:04:35,205 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Set currentTerm=1, votedFor=member-1-shard-inventory-config14 07:04:35,205 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config14 (Candidate): Starting new election term 1 07:04:35,205 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config14 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:35,205 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config14 (Follower): Closing 07:04:35,205 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 07:04:35,205 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 07:04:35,205 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:35.206] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true]] 07:04:35,206 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14 (Candidate): Received ElectionTimeout 07:04:35,206 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14 (Leader): Election: Leader has following peers: [] 07:04:35,206 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config14 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:35,206 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: true, hasLeader : true 07:04:35,206 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: became leader with frontend state for [] 07:04:35,206 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Candidate to Leader 07:04:35,314 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-143-0 07:04:35,314 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:35,314 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,314 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,314 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Readying transaction member-1-ShardTransactionTest-fe-0-txn-143-0, client version 13 07:04:35,314 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: readying transaction member-1-ShardTransactionTest-fe-0-txn-143-0 07:04:35,314 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: transaction member-1-ShardTransactionTest-fe-0-txn-143-0 ready 07:04:35,315 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Validating transaction member-1-ShardTransactionTest-fe-0-txn-143-0 07:04:35,315 AM [test-akka.actor.default-dispatcher-7] [WARN] ShardDataTree - member-1-shard-inventory-config14: Store Tx member-1-ShardTransactionTest-fe-0-txn-143-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleForwardedReadyTransaction(ShardCommitCoordinator.java:116) at org.opendaylight.controller.cluster.datastore.Shard.handleForwardedReadyTransaction(Shard.java:852) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:410) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:35,315 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Store Tx member-1-ShardTransactionTest-fe-0-txn-143-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 07:04:35,315 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-143-0 changing state from CAN_COMMIT_PENDING to FAILED 07:04:35,315 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-143-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:853) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleForwardedReadyTransaction(ShardCommitCoordinator.java:116) at org.opendaylight.controller.cluster.datastore.Shard.handleForwardedReadyTransaction(Shard.java:852) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:410) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) ... 34 more 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-144-0 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Readying transaction member-1-ShardTransactionTest-fe-0-txn-144-0, client version 13 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: readying transaction member-1-ShardTransactionTest-fe-0-txn-144-0 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: transaction member-1-ShardTransactionTest-fe-0-txn-144-0 ready 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Validating transaction member-1-ShardTransactionTest-fe-0-txn-144-0 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-144-0 validated 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-144-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: canCommit for member-1-ShardTransactionTest-fe-0-txn-144-0: success 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Committing transaction member-1-ShardTransactionTest-fe-0-txn-144-0 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-144-0 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-144-0 candidate ready 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-144-0: canCommit - candidate rootPath: / 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-144-0: canCommit - messages: [] 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-144-0: preCommit - successfulFromPrevious: [] 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-144-0 prepared 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-144-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-144-0 07:04:35,316 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-144-0 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-144-0 submitted to persistence 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from -1 to 0 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config14: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2542480} is already disabled 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Persisting ApplyJournalEntries with index=0 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from 0 to 1 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Applying state for log index 1 data Simple{size=143} 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-144-0 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-144-0: commit - successfulFromPrevious: [] 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-144-0 changing state from COMMIT_PENDING to COMMITTED 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-144-0 committed as 0, sending response to Actor[akka://test/system/testProbe-185#1177541552] 07:04:35,317 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config14: Created publisher actor Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config14-DTCL-publisher#-637747419] with name member-1-shard-inventory-config14-DTCL-publisher 07:04:35,318 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config14-DTCL-publisher#-637747419] 07:04:35,318 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: fakeSnapshot purging log to 0 for term 1 07:04:35,318 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config14: Persisting ApplyJournalEntries with index=1 07:04:35,318 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config14: publishChanges: rootPath: / [WARN] [01/22/2024 07:04:35.318] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true/member-1-shard-inventory-config14-DTCL-publisher#-637747419]: org.opendaylight.controller.cluster.common.actor.Monitor@7c42f984 07:04:35,318 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config14: Elapsed time for generation of change events for member-1-shard-inventory-config14-DTCL-publisher: 62.65 μs 07:04:35,319 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config14, persistent : true 07:04:35,320 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config14 with journal batch size 3 [WARN] [01/22/2024 07:04:35.320] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false]: org.opendaylight.controller.cluster.common.actor.Monitor@35e85936 07:04:35,320 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config14-notifier#1552533591 created and ready for shard:member-1-shard-inventory-config14 07:04:35,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/shard-member-1:snapshot-read#494272638] [WARN] [01/22/2024 07:04:35.320] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config14-notifier#1552533591]: org.opendaylight.controller.cluster.common.actor.Monitor@6857086a [WARN] [01/22/2024 07:04:35.320] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/shard-member-1:snapshot-read#494272638]: org.opendaylight.controller.cluster.common.actor.Monitor@31615448 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.UpdateElectionTerm from Actor[akka://test/deadLetters] 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Set currentTerm=1, votedFor=member-1-shard-inventory-config14 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Received ReplicatedLogEntry for recovery: index: 0, size: 37 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Received ReplicatedLogEntry for recovery: index: 1, size: 143 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Received apply journal entries for recovery, applying to state: 0 to 0 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: starting log recovery batch with max size 3 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: ignoring unhandled payload DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from -1 to 0 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 07:04:35,321 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Received apply journal entries for recovery, applying to state: 1 to 1 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] FrontendMetadata - member-1-shard-inventory-config14: Added client Enabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@65f7b2c0}, purged=MutableUnsignedLongSet{size=0}} 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config14: Committed transaction member-1-ShardTransactionTest-fe-0-txn-144-0 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from 0 to 1 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config14: Recovery completed in 776.0 μs - Switching actor to Follower - last log index = 1, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 2 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader [WARN] [01/22/2024 07:04:35.322] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false]] 07:04:35,322 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from null to Follower 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14 (Follower): Received TimeoutNow - switching to Candidate 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14 (Candidate): Election: Candidate has following voting peers: [] 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Set currentTerm=2, votedFor=member-1-shard-inventory-config14 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config14 (Candidate): Starting new election term 2 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config14 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageAssembler - member-1-shard-inventory-config14 (Follower): Closing 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: false, hasLeader : false 07:04:35,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config14 is no longer the leader 07:04:35,322 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Follower to Candidate 07:04:35,323 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14 (Candidate): Received ElectionTimeout 07:04:35,323 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14 (Leader): Election: Leader has following peers: [] 07:04:35,323 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config14 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 07:04:35,323 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config14: onLeadershipChange, isLeader: true, hasLeader : true 07:04:35,323 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: became leader with frontend state for [member-1-frontend-ShardTransactionTest] 07:04:35,323 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config14 , received role change from Candidate to Leader 07:04:35,383 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:35,383 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: Persist data SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,383 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,384 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-145-0 07:04:35,384 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: Readying Tx member-1-ShardTransactionTest-fe-0-txn-145-0 of 1 operations, client version 13 07:04:35,384 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: readying transaction member-1-ShardTransactionTest-fe-0-txn-145-0 07:04:35,384 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: transaction member-1-ShardTransactionTest-fe-0-txn-145-0 ready 07:04:35,384 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Validating transaction member-1-ShardTransactionTest-fe-0-txn-145-0 07:04:35,384 AM [test-akka.actor.default-dispatcher-5] [WARN] ShardDataTree - member-1-shard-inventory-config14: Store Tx member-1-ShardTransactionTest-fe-0-txn-145-0: Data validation failed for path /. org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:173) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:35,384 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Store Tx member-1-ShardTransactionTest-fe-0-txn-145-0: modifications: MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 07:04:35,384 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-145-0 changing state from CAN_COMMIT_PENDING to FAILED 07:04:35,384 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config14: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-145-0 TransactionCommitFailedException{message=Data did not pass validation for path /, errorList=[RpcError [message=Data did not pass validation for path /, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:853) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:984) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:100) at org.opendaylight.controller.cluster.datastore.CohortEntry.canCommit(CohortEntry.java:113) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:243) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:173) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.DataValidationFailedException: mock canCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) ... 35 more 07:04:35,385 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-146-0 07:04:35,385 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Readying Tx member-1-ShardTransactionTest-fe-0-txn-146-0 of 1 operations, client version 13 07:04:35,385 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: readying transaction member-1-ShardTransactionTest-fe-0-txn-146-0 07:04:35,385 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: transaction member-1-ShardTransactionTest-fe-0-txn-146-0 ready 07:04:35,385 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Validating transaction member-1-ShardTransactionTest-fe-0-txn-146-0 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-146-0 validated 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-146-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: canCommit for member-1-ShardTransactionTest-fe-0-txn-146-0: success 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Committing transaction member-1-ShardTransactionTest-fe-0-txn-146-0 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-146-0 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-146-0 candidate ready 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-146-0: canCommit - candidate rootPath: / 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-146-0: canCommit - messages: [] 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-146-0: preCommit - successfulFromPrevious: [] 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-146-0 prepared 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-146-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-146-0 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-146-0 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Persist data SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-146-0 submitted to persistence 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: persist complete SimpleReplicatedLogEntry [index=2, term=2, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from 1 to 2 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Applying state for log index 2 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3032277} is already disabled 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: fakeSnapshot purging log to 1 for term 2 07:04:35,386 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config14: Persisting ApplyJournalEntries with index=2 07:04:35,387 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: persist complete SimpleReplicatedLogEntry [index=3, term=2, payload=Simple{size=143}] 07:04:35,387 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Moving last applied index from 2 to 3 07:04:35,387 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Applying state for log index 3 data Simple{size=143} 07:04:35,387 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config14: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-146-0 07:04:35,387 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-146-0: commit - successfulFromPrevious: [] 07:04:35,387 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-146-0 changing state from COMMIT_PENDING to COMMITTED 07:04:35,387 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Transaction member-1-ShardTransactionTest-fe-0-txn-146-0 committed as 0, sending response to Actor[akka://test/system/testProbe-186#-145199640] 07:04:35,387 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-true] 07:04:35,388 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config14: Created publisher actor Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config14-DTCL-publisher#399136736] with name member-1-shard-inventory-config14-DTCL-publisher 07:04:35,388 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config14-DTCL-publisher#399136736] 07:04:35,388 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: fakeSnapshot purging log to 2 for term 2 07:04:35,388 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Persisting ApplyJournalEntries with index=3 07:04:35,388 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config14: publishChanges: rootPath: / [WARN] [01/22/2024 07:04:35.388] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false/member-1-shard-inventory-config14-DTCL-publisher#399136736]: org.opendaylight.controller.cluster.common.actor.Monitor@6e4b67c9 07:04:35,388 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config14: Elapsed time for generation of change events for member-1-shard-inventory-config14-DTCL-publisher: 70.67 μs 07:04:35,398 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config14 07:04:35,398 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config14 (Leader)_slicer-id-615: Closing 07:04:35,398 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config14: Aborting 0 pending queued transactions 07:04:35,399 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testImmediateCommitWithCanCommitPhaseFailure-false] 07:04:35,399 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config14 07:04:35,399 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config14 (Leader)_slicer-id-617: Closing 07:04:35,399 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config14: Aborting 0 pending queued transactions 07:04:35,401 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config15, persistent : true 07:04:35,402 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config15 with journal batch size 3 [WARN] [01/22/2024 07:04:35.402] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@590c67de 07:04:35,402 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testCommitPhaseFailure/member-1-shard-inventory-config15-notifier#1346986643 created and ready for shard:member-1-shard-inventory-config15 07:04:35,402 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitPhaseFailure/shard-member-1:snapshot-read#377433185] [WARN] [01/22/2024 07:04:35.402] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitPhaseFailure/member-1-shard-inventory-config15-notifier#1346986643]: org.opendaylight.controller.cluster.common.actor.Monitor@11fbc212 [WARN] [01/22/2024 07:04:35.402] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitPhaseFailure/shard-member-1:snapshot-read#377433185]: org.opendaylight.controller.cluster.common.actor.Monitor@69c7834c 07:04:35,403 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:35,403 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config15: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:35,403 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: false, hasLeader : false 07:04:35,403 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config15 is no longer the leader 07:04:35,404 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from null to Follower 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15 (Follower): Received TimeoutNow - switching to Candidate 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15 (Candidate): Election: Candidate has following voting peers: [] [WARN] [01/22/2024 07:04:35.404] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCommitPhaseFailure]] 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Set currentTerm=1, votedFor=member-1-shard-inventory-config15 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config15 (Candidate): Starting new election term 1 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config15 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config15 (Follower): Closing 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: false, hasLeader : false 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config15 is no longer the leader 07:04:35,404 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from Follower to Candidate 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15 (Candidate): Received ElectionTimeout 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15 (Leader): Election: Leader has following peers: [] 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config15 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config15: onLeadershipChange, isLeader: true, hasLeader : true 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: became leader with frontend state for [] 07:04:35,404 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config15 , received role change from Candidate to Leader 07:04:35,465 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config15: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:35,465 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config15: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,465 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config15: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,465 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config15: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-147-0 07:04:35,465 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config15: Readying Tx member-1-ShardTransactionTest-fe-0-txn-147-0 of 1 operations, client version 13 07:04:35,465 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: readying transaction member-1-ShardTransactionTest-fe-0-txn-147-0 07:04:35,465 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: transaction member-1-ShardTransactionTest-fe-0-txn-147-0 ready 07:04:35,466 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-148-0 07:04:35,466 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Readying Tx member-1-ShardTransactionTest-fe-0-txn-148-0 of 1 operations, client version 13 07:04:35,466 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: readying transaction member-1-ShardTransactionTest-fe-0-txn-148-0 07:04:35,466 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: transaction member-1-ShardTransactionTest-fe-0-txn-148-0 ready 07:04:35,466 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,466 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Moving last applied index from -1 to 0 07:04:35,466 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:35,466 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:35,466 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config15: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:35,466 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1550945} is already disabled 07:04:35,466 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-147-0 07:04:35,466 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Validating transaction member-1-ShardTransactionTest-fe-0-txn-147-0 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Transaction member-1-ShardTransactionTest-fe-0-txn-147-0 validated 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-147-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: canCommit for member-1-ShardTransactionTest-fe-0-txn-147-0: success 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Persisting ApplyJournalEntries with index=0 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-148-0 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Tx member-1-ShardTransactionTest-fe-0-txn-148-0 is scheduled for canCommit step 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Committing transaction member-1-ShardTransactionTest-fe-0-txn-147-0 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-147-0 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Transaction member-1-ShardTransactionTest-fe-0-txn-147-0 candidate ready 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-147-0: canCommit - candidate rootPath: / 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-147-0: canCommit - messages: [] 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-147-0: preCommit - successfulFromPrevious: [] 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Transaction member-1-ShardTransactionTest-fe-0-txn-147-0 prepared 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-147-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-147-0 07:04:35,467 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-147-0 07:04:35,469 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:35,469 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Validating transaction member-1-ShardTransactionTest-fe-0-txn-148-0 07:04:35,469 AM [test-akka.actor.default-dispatcher-14] [WARN] ShardDataTree - member-1-shard-inventory-config15: Store Tx member-1-ShardTransactionTest-fe-0-txn-148-0: Conflicting modification for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test. 07:04:35,469 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-148-0 changing state from CAN_COMMIT_PENDING to FAILED 07:04:35,469 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: An exception occurred during canCommit for member-1-ShardTransactionTest-fe-0-txn-148-0 OptimisticLockFailedException{message=Optimistic lock failed for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, errorList=[RpcError [message=Optimistic lock failed for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, severity=ERROR, errorType=APPLICATION, tag=resource-denied, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.tree.api.ConflictingModificationAppliedException: Node was created by other transaction.]]} at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:844) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:882) at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:829) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCommit(ShardDataTree.java:1132) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.commit(SimpleShardDataTreeCohort.java:151) at org.opendaylight.controller.cluster.datastore.CohortEntry.commit(CohortEntry.java:121) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.finishCommit(ShardCommitCoordinator.java:322) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator$3.onSuccess(ShardCommitCoordinator.java:305) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator$3.onSuccess(ShardCommitCoordinator.java:302) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.successfulPreCommit(SimpleShardDataTreeCohort.java:223) at org.opendaylight.controller.cluster.datastore.ShardDataTree$1.onSuccess(ShardDataTree.java:1050) at org.opendaylight.controller.cluster.datastore.ShardDataTree$1.onSuccess(ShardDataTree.java:1037) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.doUserPreCommit(SimpleShardDataTreeCohort.java:207) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.userPreCommit(SimpleShardDataTreeCohort.java:191) at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1037) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:113) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:117) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:302) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:365) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:715) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:416) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) Caused by: org.opendaylight.yangtools.yang.data.tree.api.ConflictingModificationAppliedException: Node was created by other transaction. at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkConflicting(SchemaAwareApplyOperation.java:77) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkWriteApplicable(SchemaAwareApplyOperation.java:180) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:110) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.checkChildPreconditions(AbstractNodeContainerModificationStrategy.java:409) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.checkTouchApplicable(AbstractNodeContainerModificationStrategy.java:368) at org.opendaylight.yangtools.yang.data.tree.impl.SchemaAwareApplyOperation.checkApplicable(SchemaAwareApplyOperation.java:109) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractDataTreeTip.validate(AbstractDataTreeTip.java:31) at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$4(ShardDataTree.java:836) ... 45 more 07:04:35,470 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:35,470 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:35,470 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Transaction member-1-ShardTransactionTest-fe-0-txn-147-0 submitted to persistence 07:04:35,470 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:35,470 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Moving last applied index from 0 to 1 07:04:35,470 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Applying state for log index 1 data Simple{size=143} 07:04:35,470 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config15: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-147-0 07:04:35,471 AM [test-akka.actor.default-dispatcher-14] [ERROR] ShardDataTree - member-1-shard-inventory-config15: Failed to commit transaction member-1-ShardTransactionTest-fe-0-txn-147-0 java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1081) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:538) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:445) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:1013) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:35,471 AM [test-akka.actor.default-dispatcher-14] [ERROR] SimpleShardDataTreeCohort - Transaction failed to commit java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1081) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:538) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:445) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:1013) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:35,471 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-147-0: abort - successfulFromPrevious: [] 07:04:35,471 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-147-0 changing state from COMMIT_PENDING to FAILED 07:04:35,471 AM [test-akka.actor.default-dispatcher-14] [ERROR] Shard - member-1-shard-inventory-config15, An exception occurred while committing transaction member-1-ShardTransactionTest-fe-0-txn-147-0 java.lang.RuntimeException: mock commit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.finishCommit(ShardDataTree.java:1081) at org.opendaylight.controller.cluster.datastore.ShardDataTree.payloadReplicationComplete(ShardDataTree.java:538) at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyReplicatedPayload(ShardDataTree.java:445) at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:1013) at org.opendaylight.controller.cluster.raft.RaftActor.handleApplyState(RaftActor.java:547) at org.opendaylight.controller.cluster.raft.RaftActor.lambda$persistData$1(RaftActor.java:606) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.syncPersistCallback(ReplicatedLogImpl.java:129) at org.opendaylight.controller.cluster.raft.ReplicatedLogImpl.lambda$persistCallback$2(ReplicatedLogImpl.java:119) at org.opendaylight.controller.cluster.common.actor.ExecuteInSelfMessage.run(ExecuteInSelfMessage.java:28) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:35,471 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: fakeSnapshot purging log to 0 for term 1 07:04:35,471 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Persisting ApplyJournalEntries with index=1 07:04:35,474 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitPhaseFailure] 07:04:35,485 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config15 07:04:35,485 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config15 (Leader)_slicer-id-619: Closing 07:04:35,485 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config15: Aborting 0 pending queued transactions 07:04:35,487 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config16, persistent : true [WARN] [01/22/2024 07:04:35.487] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitTimeout]: org.opendaylight.controller.cluster.common.actor.Monitor@269f9ca2 07:04:35,488 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testTransactionCommitTimeout/member-1-shard-inventory-config16-notifier#401390997 created and ready for shard:member-1-shard-inventory-config16 [WARN] [01/22/2024 07:04:35.488] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config16-notifier#401390997]: org.opendaylight.controller.cluster.common.actor.Monitor@7052db25 07:04:35,488 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitTimeout/shard-member-1:snapshot-read#1108355945] [WARN] [01/22/2024 07:04:35.489] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/shard-member-1:snapshot-read#1108355945]: org.opendaylight.controller.cluster.common.actor.Monitor@51eb944c 07:04:35,489 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config16 with journal batch size 3 07:04:35,490 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:35,490 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config16: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:35,490 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: false, hasLeader : false 07:04:35,490 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config16 is no longer the leader 07:04:35,490 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from null to Follower 07:04:35,490 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16 (Follower): Received TimeoutNow - switching to Candidate 07:04:35,490 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16 (Candidate): Election: Candidate has following voting peers: [] 07:04:35,490 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Set currentTerm=1, votedFor=member-1-shard-inventory-config16 07:04:35,490 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config16 (Candidate): Starting new election term 1 07:04:35,490 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config16 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:35,490 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config16 (Follower): Closing 07:04:35,490 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: false, hasLeader : false 07:04:35,490 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config16 is no longer the leader 07:04:35,490 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from Follower to Candidate 07:04:35,491 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config16 (Candidate): Received ElectionTimeout [WARN] [01/22/2024 07:04:35.491] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testTransactionCommitTimeout]] 07:04:35,491 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config16 (Leader): Election: Leader has following peers: [] 07:04:35,491 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config16 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:35,491 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config16: onLeadershipChange, isLeader: true, hasLeader : true 07:04:35,491 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config16: became leader with frontend state for [] 07:04:35,491 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config16 , received role change from Candidate to Leader 07:04:35,540 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:35,540 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,540 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,540 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-149-0 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Readying Tx member-1-ShardTransactionTest-fe-0-txn-149-0 of 1 operations, client version 13 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: readying transaction member-1-ShardTransactionTest-fe-0-txn-149-0 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: transaction member-1-ShardTransactionTest-fe-0-txn-149-0 ready 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Validating transaction member-1-ShardTransactionTest-fe-0-txn-149-0 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-149-0 validated 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-149-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: canCommit for member-1-ShardTransactionTest-fe-0-txn-149-0: success 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Committing transaction member-1-ShardTransactionTest-fe-0-txn-149-0 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-149-0 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-149-0 candidate ready 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-149-0: canCommit - candidate rootPath: / 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-149-0: canCommit - messages: [] 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-149-0: preCommit - successfulFromPrevious: [] 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-149-0 prepared 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-149-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-149-0 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-149-0 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:35,541 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-149-0 submitted to persistence 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Moving last applied index from -1 to 0 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config16: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1346961} is already disabled 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Moving last applied index from 0 to 1 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Applying state for log index 1 data Simple{size=143} 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-149-0 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-149-0: commit - successfulFromPrevious: [] 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-149-0 changing state from COMMIT_PENDING to COMMITTED 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-149-0 committed as 0, sending response to Actor[akka://test/temp/testTransactionCommitTimeout$c] 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config16: Created publisher actor Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config16-DTCL-publisher#1974379617] with name member-1-shard-inventory-config16-DTCL-publisher 07:04:35,542 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config16-DTCL-publisher#1974379617] 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: fakeSnapshot purging log to 0 for term 1 07:04:35,542 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config16: publishChanges: rootPath: / 07:04:35,542 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Persisting ApplyJournalEntries with index=0 07:04:35,543 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config16: Elapsed time for generation of change events for member-1-shard-inventory-config16-DTCL-publisher: 53.16 μs 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-150-0 [WARN] [01/22/2024 07:04:35.543] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitTimeout/member-1-shard-inventory-config16-DTCL-publisher#1974379617]: org.opendaylight.controller.cluster.common.actor.Monitor@78b09e7e 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Readying Tx member-1-ShardTransactionTest-fe-0-txn-150-0 of 1 operations, client version 13 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: readying transaction member-1-ShardTransactionTest-fe-0-txn-150-0 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: transaction member-1-ShardTransactionTest-fe-0-txn-150-0 ready 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Validating transaction member-1-ShardTransactionTest-fe-0-txn-150-0 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-150-0 validated 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-150-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: canCommit for member-1-ShardTransactionTest-fe-0-txn-150-0: success 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Committing transaction member-1-ShardTransactionTest-fe-0-txn-150-0 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-150-0 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-150-0 candidate ready 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-150-0: canCommit - candidate rootPath: / 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-150-0: canCommit - messages: [] 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-150-0: preCommit - successfulFromPrevious: [] 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-150-0 prepared 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-150-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-150-0 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-150-0 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-150-0 submitted to persistence 07:04:35,543 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Persisting ApplyJournalEntries with index=1 07:04:35,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 07:04:35,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Moving last applied index from 1 to 2 07:04:35,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Applying state for log index 2 data Simple{size=45} 07:04:35,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-150-0 07:04:35,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-150-0: commit - successfulFromPrevious: [] 07:04:35,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-150-0 changing state from COMMIT_PENDING to COMMITTED 07:04:35,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-150-0 committed as 0, sending response to Actor[akka://test/temp/testTransactionCommitTimeout$d] 07:04:35,544 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config16: publishChanges: rootPath: / 07:04:35,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: fakeSnapshot purging log to 1 for term 1 07:04:35,544 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config16: Persisting ApplyJournalEntries with index=2 07:04:35,544 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config16: Elapsed time for generation of change events for member-1-shard-inventory-config16-DTCL-publisher: 27.34 μs 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-151-0 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Readying Tx member-1-ShardTransactionTest-fe-0-txn-151-0 of 1 operations, client version 13 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: readying transaction member-1-ShardTransactionTest-fe-0-txn-151-0 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: transaction member-1-ShardTransactionTest-fe-0-txn-151-0 ready 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-152-0 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Readying Tx member-1-ShardTransactionTest-fe-0-txn-152-0 of 1 operations, client version 13 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: readying transaction member-1-ShardTransactionTest-fe-0-txn-152-0 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: transaction member-1-ShardTransactionTest-fe-0-txn-152-0 ready 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-151-0 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Validating transaction member-1-ShardTransactionTest-fe-0-txn-151-0 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-151-0 validated 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-151-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: canCommit for member-1-ShardTransactionTest-fe-0-txn-151-0: success 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-152-0 07:04:35,555 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Tx member-1-ShardTransactionTest-fe-0-txn-152-0 is scheduled for canCommit step 07:04:36,165 AM [test-akka.actor.default-dispatcher-8] [WARN] ShardDataTree - member-1-shard-inventory-config16: Current transaction member-1-ShardTransactionTest-fe-0-txn-151-0 has timed out after 609 ms in state CAN_COMMIT_COMPLETE 07:04:36,166 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Validating transaction member-1-ShardTransactionTest-fe-0-txn-152-0 07:04:36,166 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-152-0 validated 07:04:36,166 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-152-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:36,166 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: canCommit for member-1-ShardTransactionTest-fe-0-txn-152-0: success 07:04:36,166 AM [test-akka.actor.default-dispatcher-8] [ERROR] Shard - member-1-shard-inventory-config16: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-151-0 commit java.lang.IllegalStateException: member-1-shard-inventory-config16: Cannot commit transaction member-1-ShardTransactionTest-fe-0-txn-151-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:358) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:715) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:416) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Committing transaction member-1-ShardTransactionTest-fe-0-txn-152-0 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-152-0 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-152-0 candidate ready 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-152-0: canCommit - candidate rootPath: / 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-152-0: canCommit - messages: [] 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-152-0: preCommit - successfulFromPrevious: [] 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-152-0 prepared 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-152-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-152-0 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-152-0 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Persist data SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Append log entry and persist SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 07:04:36,167 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-152-0 submitted to persistence 07:04:36,168 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: persist complete SimpleReplicatedLogEntry [index=3, term=1, payload=Simple{size=184}] 07:04:36,168 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Moving last applied index from 2 to 3 07:04:36,168 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Applying state for log index 3 data Simple{size=184} 07:04:36,168 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config16: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-152-0 07:04:36,168 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-152-0: commit - successfulFromPrevious: [] 07:04:36,168 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-152-0 changing state from COMMIT_PENDING to COMMITTED 07:04:36,168 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Transaction member-1-ShardTransactionTest-fe-0-txn-152-0 committed as 0, sending response to Actor[akka://test/system/testProbe-190#967764159] 07:04:36,168 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config16: publishChanges: rootPath: / 07:04:36,168 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: fakeSnapshot purging log to 2 for term 1 07:04:36,168 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Persisting ApplyJournalEntries with index=3 07:04:36,168 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config16: Elapsed time for generation of change events for member-1-shard-inventory-config16-DTCL-publisher: 48.97 μs 07:04:36,169 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitTimeout] 07:04:36,179 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - Stopping Shard member-1-shard-inventory-config16 07:04:36,179 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageSlicer - member-1-shard-inventory-config16 (Leader)_slicer-id-621: Closing 07:04:36,179 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config16: Aborting 0 pending queued transactions 07:04:36,181 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - Shard created : member-1-shard-inventory-config17, persistent : true [WARN] [01/22/2024 07:04:36.181] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsOnTransactionChain]: org.opendaylight.controller.cluster.common.actor.Monitor@7c5ca563 07:04:36,182 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - Starting recovery for member-1-shard-inventory-config17 with journal batch size 3 07:04:36,182 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config17-notifier#-1899388979 created and ready for shard:member-1-shard-inventory-config17 07:04:36,182 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-member-1:snapshot-read#1645738801] [WARN] [01/22/2024 07:04:36.182] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config17-notifier#-1899388979]: org.opendaylight.controller.cluster.common.actor.Monitor@436c8ae4 [WARN] [01/22/2024 07:04:36.182] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-member-1:snapshot-read#1645738801]: org.opendaylight.controller.cluster.common.actor.Monitor@c83aa14 07:04:36,183 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config17: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:36,183 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config17: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:36,184 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,184 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config17: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config17 is no longer the leader 07:04:36,184 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from null to Follower 07:04:36,184 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config17 (Follower): Received TimeoutNow - switching to Candidate 07:04:36,184 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config17 (Candidate): Election: Candidate has following voting peers: [] 07:04:36,184 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config17: Set currentTerm=1, votedFor=member-1-shard-inventory-config17 07:04:36,184 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config17 (Candidate): Starting new election term 1 07:04:36,184 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config17 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:36,184 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config17 (Follower): Closing 07:04:36,184 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,184 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config17: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config17 is no longer the leader 07:04:36,184 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from Follower to Candidate 07:04:36,184 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config17 (Candidate): Received ElectionTimeout 07:04:36,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config17 (Leader): Election: Leader has following peers: [] 07:04:36,185 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config17 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 [WARN] [01/22/2024 07:04:36.185] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsOnTransactionChain]] 07:04:36,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config17: onLeadershipChange, isLeader: true, hasLeader : true 07:04:36,185 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config17: became leader with frontend state for [] 07:04:36,185 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config17 , received role change from Candidate to Leader 07:04:36,292 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:36,292 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,292 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,292 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 07:04:36,292 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 07:04:36,292 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeTransactionChain - Opening an unchained snapshot in LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} 07:04:36,292 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeTransactionChain - Allocated read-write transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 snapshot org.opendaylight.yangtools.yang.data.tree.impl.node.Version@6ed3587f 07:04:36,292 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 07:04:36,293 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Readying Tx member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 of 1 operations, client version 13 07:04:36,293 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: readying transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 07:04:36,293 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 ready 07:04:36,293 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeTransactionChain - Committing transaction ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0, closed=true, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]} 07:04:36,293 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Creating transaction : member-1-ShardTransactionTest-fe-0-chn-2-txn-1-0 07:04:36,294 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeTransactionChain - Reusing a chained snapshot in LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} 07:04:36,294 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeTransactionChain - Allocated read-only transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-1-0 snapshot MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}] 07:04:36,295 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-inventory-member-1:ShardTransactionTest@0:2-1_1#1230008154] 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Moving last applied index from -1 to 0 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config17: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3069499} is already disabled 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39}] 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Moving last applied index from 0 to 1 [WARN] [01/22/2024 07:04:36.295] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/shard-inventory-member-1:ShardTransactionTest@0:2-1_1#1230008154]: org.opendaylight.controller.cluster.common.actor.Monitor@30e93838 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Applying state for log index 1 data CreateLocalHistoryPayload{identifier=LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0}, size=39} 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: replication of LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=2, cookie=0} has no callback 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: fakeSnapshot purging log to 0 for term 1 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Persisting ApplyJournalEntries with index=0 07:04:36,295 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Persisting ApplyJournalEntries with index=1 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Can committing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Validating transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 validated 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: canCommit for member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: success 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Committing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Preparing transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 candidate ready 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: canCommit - candidate rootPath: / 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: canCommit - messages: [] 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: preCommit - successfulFromPrevious: [] 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 prepared 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Starting commit for transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 07:04:36,296 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 submitted to persistence 07:04:36,297 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=143}] 07:04:36,297 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Moving last applied index from 1 to 2 07:04:36,297 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Applying state for log index 2 data Simple{size=143} 07:04:36,297 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config17: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 07:04:36,297 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0: commit - successfulFromPrevious: [] 07:04:36,297 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 changing state from COMMIT_PENDING to COMMITTED 07:04:36,297 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ChainedCommitCohort - Committed transaction ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0, closed=true, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, modificationType=SUBTREE_MODIFIED, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE, modificationType=WRITE}}}]} 07:04:36,297 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Transaction member-1-ShardTransactionTest-fe-0-chn-2-txn-0-0 committed as 0, sending response to Actor[akka://test/system/testProbe-192#1522147874] 07:04:36,297 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsOnTransactionChain] 07:04:36,297 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config17: Created publisher actor Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config17-DTCL-publisher#1870227460] with name member-1-shard-inventory-config17-DTCL-publisher 07:04:36,297 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config17-DTCL-publisher#1870227460] 07:04:36,297 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: fakeSnapshot purging log to 1 for term 1 07:04:36,297 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config17: Persisting ApplyJournalEntries with index=2 07:04:36,297 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config17: publishChanges: rootPath: / [WARN] [01/22/2024 07:04:36.297] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsOnTransactionChain/member-1-shard-inventory-config17-DTCL-publisher#1870227460]: org.opendaylight.controller.cluster.common.actor.Monitor@25e4de28 07:04:36,297 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config17: Elapsed time for generation of change events for member-1-shard-inventory-config17-DTCL-publisher: 78.24 μs 07:04:36,308 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config17 07:04:36,308 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config17 (Leader)_slicer-id-623: Closing 07:04:36,308 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config17: Aborting 0 pending queued transactions 07:04:36,309 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config18, persistent : true [WARN] [01/22/2024 07:04:36.309] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCanCommitBeforeReadyFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@500ea909 07:04:36,310 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testCanCommitBeforeReadyFailure/member-1-shard-inventory-config18-notifier#-848913689 created and ready for shard:member-1-shard-inventory-config18 [WARN] [01/22/2024 07:04:36.310] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitBeforeReadyFailure/member-1-shard-inventory-config18-notifier#-848913689]: org.opendaylight.controller.cluster.common.actor.Monitor@1378dfa8 07:04:36,310 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCanCommitBeforeReadyFailure/shard-member-1:snapshot-read#1975365840] [WARN] [01/22/2024 07:04:36.310] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCanCommitBeforeReadyFailure/shard-member-1:snapshot-read#1975365840]: org.opendaylight.controller.cluster.common.actor.Monitor@156519e1 07:04:36,310 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config18 with journal batch size 3 07:04:36,312 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config18: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config18: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config18: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config18: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config18 is no longer the leader 07:04:36,313 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config18 , received role change from null to Follower [WARN] [01/22/2024 07:04:36.313] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCanCommitBeforeReadyFailure]] 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config18 (Follower): Received TimeoutNow - switching to Candidate 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config18 (Candidate): Election: Candidate has following voting peers: [] 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config18: Set currentTerm=1, votedFor=member-1-shard-inventory-config18 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config18 (Candidate): Starting new election term 1 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config18 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config18 (Follower): Closing 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config18: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config18: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config18 is no longer the leader 07:04:36,313 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config18 , received role change from Follower to Candidate 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config18 (Candidate): Received ElectionTimeout 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config18 (Leader): Election: Leader has following peers: [] 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config18 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config18: onLeadershipChange, isLeader: true, hasLeader : true 07:04:36,313 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config18: became leader with frontend state for [] 07:04:36,313 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config18 , received role change from Candidate to Leader 07:04:36,420 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-153-0 07:04:36,420 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:36,420 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,420 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,420 AM [test-akka.actor.default-dispatcher-14] [ERROR] Shard - member-1-shard-inventory-config18: Inconsistency during transaction member-1-ShardTransactionTest-fe-0-txn-153-0 canCommit java.lang.IllegalStateException: member-1-shard-inventory-config18: Cannot canCommit transaction member-1-ShardTransactionTest-fe-0-txn-153-0 - no cohort entry found at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCanCommit(ShardCommitCoordinator.java:283) at org.opendaylight.controller.cluster.datastore.Shard.handleCanCommitTransaction(Shard.java:734) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:414) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:36,421 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCanCommitBeforeReadyFailure] 07:04:36,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Moving last applied index from -1 to 0 07:04:36,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:36,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:36,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config18: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:36,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=797794} is already disabled 07:04:36,421 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Persisting ApplyJournalEntries with index=0 07:04:36,431 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config18 07:04:36,431 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config18 (Leader)_slicer-id-625: Closing 07:04:36,431 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config18: Aborting 0 pending queued transactions 07:04:36,433 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config19, persistent : true [WARN] [01/22/2024 07:04:36.433] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady]: org.opendaylight.controller.cluster.common.actor.Monitor@51d2f2fb 07:04:36,433 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config19-notifier#217534405 created and ready for shard:member-1-shard-inventory-config19 07:04:36,433 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/shard-member-1:snapshot-read#226913721] [WARN] [01/22/2024 07:04:36.433] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config19-notifier#217534405]: org.opendaylight.controller.cluster.common.actor.Monitor@43e46f71 [WARN] [01/22/2024 07:04:36.434] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/shard-member-1:snapshot-read#226913721]: org.opendaylight.controller.cluster.common.actor.Monitor@16ee22be 07:04:36,434 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config19 with journal batch size 3 07:04:36,434 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:36,434 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config19: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:36,435 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,435 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config19 is no longer the leader 07:04:36,435 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from null to Follower 07:04:36,435 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19 (Follower): Received TimeoutNow - switching to Candidate 07:04:36,435 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19 (Candidate): Election: Candidate has following voting peers: [] 07:04:36,435 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Set currentTerm=1, votedFor=member-1-shard-inventory-config19 [WARN] [01/22/2024 07:04:36.435] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady]] 07:04:36,435 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config19 (Candidate): Starting new election term 1 07:04:36,435 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config19 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:36,435 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageAssembler - member-1-shard-inventory-config19 (Follower): Closing 07:04:36,435 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,435 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config19 is no longer the leader 07:04:36,435 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from Follower to Candidate 07:04:36,435 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config19 (Candidate): Received ElectionTimeout 07:04:36,435 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config19 (Leader): Election: Leader has following peers: [] 07:04:36,435 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config19 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:36,435 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config19: onLeadershipChange, isLeader: true, hasLeader : true 07:04:36,435 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config19: became leader with frontend state for [] 07:04:36,435 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config19 , received role change from Candidate to Leader 07:04:36,496 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:36,496 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,496 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,496 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-154-0 07:04:36,496 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-154-0 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Moving last applied index from -1 to 0 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] FrontendMetadata - member-1-shard-inventory-config19: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=928526} is already disabled 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Persisting ApplyJournalEntries with index=0 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-154-0 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Readying Tx member-1-ShardTransactionTest-fe-0-txn-154-0 of 3 operations, client version 13 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: readying transaction member-1-ShardTransactionTest-fe-0-txn-154-0 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: transaction member-1-ShardTransactionTest-fe-0-txn-154-0 ready 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Validating transaction member-1-ShardTransactionTest-fe-0-txn-154-0 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-154-0 validated 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-154-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: canCommit for member-1-ShardTransactionTest-fe-0-txn-154-0: success 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Committing transaction member-1-ShardTransactionTest-fe-0-txn-154-0 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-154-0 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-154-0 candidate ready 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-154-0: canCommit - candidate rootPath: / 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-154-0: canCommit - messages: [] 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-154-0: preCommit - successfulFromPrevious: [] 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-154-0 prepared 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-154-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-154-0 07:04:36,497 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-154-0 07:04:36,498 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 07:04:36,498 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 07:04:36,498 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 07:04:36,498 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-154-0 submitted to persistence 07:04:36,498 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 07:04:36,498 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Moving last applied index from 0 to 1 07:04:36,498 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Applying state for log index 1 data Simple{size=175} 07:04:36,498 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTree - member-1-shard-inventory-config19: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-154-0 07:04:36,498 AM [test-akka.actor.default-dispatcher-12] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-154-0: commit - successfulFromPrevious: [] 07:04:36,498 AM [test-akka.actor.default-dispatcher-12] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-154-0 changing state from COMMIT_PENDING to COMMITTED 07:04:36,498 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Transaction member-1-ShardTransactionTest-fe-0-txn-154-0 committed as 0, sending response to Actor[akka://test/system/testProbe-196#175257016] 07:04:36,498 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config19: Created publisher actor Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config19-DTCL-publisher#-1831054308] with name member-1-shard-inventory-config19-DTCL-publisher 07:04:36,498 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config19-DTCL-publisher#-1831054308] 07:04:36,498 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config19: publishChanges: rootPath: / 07:04:36,499 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: fakeSnapshot purging log to 0 for term 1 07:04:36,499 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config19: Persisting ApplyJournalEntries with index=1 07:04:36,499 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config19: Elapsed time for generation of change events for member-1-shard-inventory-config19-DTCL-publisher: 42.43 μs [WARN] [01/22/2024 07:04:36.499] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithCommitOnReady/member-1-shard-inventory-config19-DTCL-publisher#-1831054308]: org.opendaylight.controller.cluster.common.actor.Monitor@3dda186 07:04:36,499 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithCommitOnReady] 07:04:36,509 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config19 07:04:36,510 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config19 (Leader)_slicer-id-627: Closing 07:04:36,510 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config19: Aborting 0 pending queued transactions 07:04:36,512 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config20, persistent : true [WARN] [01/22/2024 07:04:36.512] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testApplyState]: org.opendaylight.controller.cluster.common.actor.Monitor@5c5c9ac7 07:04:36,512 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testApplyState/member-1-shard-inventory-config20-notifier#1549118905 created and ready for shard:member-1-shard-inventory-config20 [WARN] [01/22/2024 07:04:36.512] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/member-1-shard-inventory-config20-notifier#1549118905]: org.opendaylight.controller.cluster.common.actor.Monitor@21721675 07:04:36,512 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testApplyState/shard-member-1:snapshot-read#-2078930057] [WARN] [01/22/2024 07:04:36.513] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/shard-member-1:snapshot-read#-2078930057]: org.opendaylight.controller.cluster.common.actor.Monitor@1362d7a4 07:04:36,513 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config20 with journal batch size 3 07:04:36,514 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config20: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:36,514 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config20: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:36,514 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,514 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config20: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config20 is no longer the leader 07:04:36,514 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from null to Follower 07:04:36,514 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config20 (Follower): Received TimeoutNow - switching to Candidate 07:04:36,514 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config20 (Candidate): Election: Candidate has following voting peers: [] 07:04:36,514 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config20: Set currentTerm=1, votedFor=member-1-shard-inventory-config20 07:04:36,514 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config20 (Candidate): Starting new election term 1 07:04:36,514 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config20 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:36,514 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config20 (Follower): Closing 07:04:36,514 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,514 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config20: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config20 is no longer the leader 07:04:36,514 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:36.514] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testApplyState]] 07:04:36,514 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20 (Candidate): Received ElectionTimeout 07:04:36,514 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20 (Leader): Election: Leader has following peers: [] 07:04:36,514 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config20 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:36,514 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config20: onLeadershipChange, isLeader: true, hasLeader : true 07:04:36,515 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: became leader with frontend state for [] 07:04:36,515 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config20 , received role change from Candidate to Leader 07:04:36,565 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:36,565 AM [main] [DEBUG] ShardDataTree - member-1-shard-inventory-config20: Applying foreign transaction member-1-ShardTransactionTest-fe-0-txn-155-0 07:04:36,565 AM [main] [DEBUG] FrontendMetadata - member-1-shard-inventory-config20: Added client Enabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@2a4131fb}, purged=MutableUnsignedLongSet{size=0}} 07:04:36,565 AM [main] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config20: Committed transaction member-1-ShardTransactionTest-fe-0-txn-155-0 07:04:36,565 AM [main] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config20: Created publisher actor Actor[akka://test/user/testApplyState/member-1-shard-inventory-config20-DTCL-publisher#-757089709] with name member-1-shard-inventory-config20-DTCL-publisher 07:04:36,566 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testApplyState/member-1-shard-inventory-config20-DTCL-publisher#-757089709] 07:04:36,566 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config20: publishChanges: rootPath: / 07:04:36,566 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config20: Elapsed time for generation of change events for member-1-shard-inventory-config20-DTCL-publisher: 54.40 μs [WARN] [01/22/2024 07:04:36.566] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testApplyState/member-1-shard-inventory-config20-DTCL-publisher#-757089709]: org.opendaylight.controller.cluster.common.actor.Monitor@6290a01f 07:04:36,641 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testApplyState] 07:04:36,651 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Stopping Shard member-1-shard-inventory-config20 07:04:36,651 AM [test-akka.actor.default-dispatcher-12] [DEBUG] MessageSlicer - member-1-shard-inventory-config20 (Leader)_slicer-id-629: Closing 07:04:36,652 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config20: Aborting 0 pending queued transactions 07:04:36,653 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config21, persistent : true [WARN] [01/22/2024 07:04:36.653] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$M/testServerRemoved#-1296365831]: org.opendaylight.controller.cluster.common.actor.Monitor@794ad13a 07:04:36,654 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/$$M/testServerRemoved/member-1-shard-inventory-config21-notifier#130723685 created and ready for shard:member-1-shard-inventory-config21 [WARN] [01/22/2024 07:04:36.654] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$M/testServerRemoved/member-1-shard-inventory-config21-notifier#130723685]: org.opendaylight.controller.cluster.common.actor.Monitor@4974e24b 07:04:36,654 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/$$M/testServerRemoved/shard-member-1:snapshot-read#-1207732453] [WARN] [01/22/2024 07:04:36.654] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/$$M/testServerRemoved/shard-member-1:snapshot-read#-1207732453]: org.opendaylight.controller.cluster.common.actor.Monitor@4382a8b9 07:04:36,654 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config21 with journal batch size 3 07:04:36,655 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:36,655 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config21: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:36,655 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,655 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config21 is no longer the leader 07:04:36,655 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from null to Follower 07:04:36,655 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21 (Follower): Received TimeoutNow - switching to Candidate 07:04:36,655 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21 (Candidate): Election: Candidate has following voting peers: [] 07:04:36,656 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Set currentTerm=1, votedFor=member-1-shard-inventory-config21 07:04:36,656 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config21 (Candidate): Starting new election term 1 07:04:36,656 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config21 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:36,656 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config21 (Follower): Closing 07:04:36,656 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,656 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config21 is no longer the leader 07:04:36,656 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from Follower to Candidate 07:04:36,656 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21 (Candidate): Received ElectionTimeout 07:04:36,656 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21 (Leader): Election: Leader has following peers: [] 07:04:36,656 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config21 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:36,656 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config21: onLeadershipChange, isLeader: true, hasLeader : true 07:04:36,656 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: became leader with frontend state for [] 07:04:36,656 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config21 , received role change from Candidate to Leader 07:04:36,703 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/$$M] 07:04:36,714 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config21 07:04:36,714 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config21 (Leader)_slicer-id-631: Closing 07:04:36,714 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config21: Aborting 0 pending queued transactions 07:04:36,715 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config22, persistent : true [WARN] [01/22/2024 07:04:36.715] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithOperationFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@36a6a97b 07:04:36,716 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testBatchedModificationsWithOperationFailure/member-1-shard-inventory-config22-notifier#-384410984 created and ready for shard:member-1-shard-inventory-config22 [WARN] [01/22/2024 07:04:36.716] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithOperationFailure/member-1-shard-inventory-config22-notifier#-384410984]: org.opendaylight.controller.cluster.common.actor.Monitor@733fc9e9 07:04:36,716 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithOperationFailure/shard-member-1:snapshot-read#-1064926178] [WARN] [01/22/2024 07:04:36.716] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithOperationFailure/shard-member-1:snapshot-read#-1064926178]: org.opendaylight.controller.cluster.common.actor.Monitor@2b314958 07:04:36,716 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config22 with journal batch size 3 07:04:36,717 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config22: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:36,717 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config22: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:36,717 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,717 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 07:04:36,717 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from null to Follower 07:04:36,717 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config22 (Follower): Received TimeoutNow - switching to Candidate 07:04:36,717 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Election: Candidate has following voting peers: [] 07:04:36,717 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config22: Set currentTerm=1, votedFor=member-1-shard-inventory-config22 07:04:36,717 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config22 (Candidate): Starting new election term 1 07:04:36,717 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config22 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:36,717 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config22 (Follower): Closing 07:04:36,718 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,718 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config22: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config22 is no longer the leader 07:04:36,718 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:36.718] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsWithOperationFailure]] 07:04:36,718 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22 (Candidate): Received ElectionTimeout 07:04:36,718 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22 (Leader): Election: Leader has following peers: [] 07:04:36,718 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config22 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:36,718 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config22: onLeadershipChange, isLeader: true, hasLeader : true 07:04:36,718 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22: became leader with frontend state for [] 07:04:36,718 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config22 , received role change from Candidate to Leader 07:04:36,778 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:36,779 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,779 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,779 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-156-0 07:04:36,779 AM [test-akka.actor.default-dispatcher-5] [ERROR] Shard - member-1-shard-inventory-config22: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-156-0 org.opendaylight.yangtools.yang.data.tree.api.SchemaValidationFailedException: Node (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:junk?revision=2014-03-13)junk is not a valid child of (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test according to the schema. at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.recursivelyVerifyStructure(AbstractNodeContainerModificationStrategy.java:157) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.mergeIntoModifiedNode(AbstractNodeContainerModificationStrategy.java:263) at org.opendaylight.yangtools.yang.data.tree.impl.OperationWithModification.merge(OperationWithModification.java:48) at org.opendaylight.yangtools.yang.data.tree.impl.InMemoryDataTreeModification.merge(InMemoryDataTreeModification.java:106) at org.opendaylight.controller.cluster.datastore.modification.MergeModification.apply(MergeModification.java:49) at org.opendaylight.controller.cluster.datastore.CohortEntry.applyModifications(CohortEntry.java:103) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:147) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:36,780 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config22: Applying 0 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-156-0 07:04:36,780 AM [test-akka.actor.default-dispatcher-5] [ERROR] Shard - member-1-shard-inventory-config22: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-156-0 org.opendaylight.yangtools.yang.data.tree.api.SchemaValidationFailedException: Node (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:junk?revision=2014-03-13)junk is not a valid child of (urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test according to the schema. at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.recursivelyVerifyStructure(AbstractNodeContainerModificationStrategy.java:157) at org.opendaylight.yangtools.yang.data.tree.impl.AbstractNodeContainerModificationStrategy.mergeIntoModifiedNode(AbstractNodeContainerModificationStrategy.java:263) at org.opendaylight.yangtools.yang.data.tree.impl.OperationWithModification.merge(OperationWithModification.java:48) at org.opendaylight.yangtools.yang.data.tree.impl.InMemoryDataTreeModification.merge(InMemoryDataTreeModification.java:106) at org.opendaylight.controller.cluster.datastore.modification.MergeModification.apply(MergeModification.java:49) at org.opendaylight.controller.cluster.datastore.CohortEntry.applyModifications(CohortEntry.java:103) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:147) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:36,780 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithOperationFailure] 07:04:36,780 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,780 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Moving last applied index from -1 to 0 07:04:36,781 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:36,781 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:36,781 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config22: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:36,781 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2168495} is already disabled 07:04:36,781 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Persisting ApplyJournalEntries with index=0 07:04:36,791 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config22 07:04:36,791 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config22 (Leader)_slicer-id-633: Closing 07:04:36,791 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config22: Aborting 0 pending queued transactions 07:04:36,799 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - Shard created : member-1-shard-inventory-config24, persistent : true [WARN] [01/22/2024 07:04:36.799] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCreateSnapshot]: org.opendaylight.controller.cluster.common.actor.Monitor@77279f7c 07:04:36,800 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testCreateSnapshot/member-1-shard-inventory-config24-notifier#-314059853 created and ready for shard:member-1-shard-inventory-config24 07:04:36,800 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateSnapshot/shard-member-1:snapshot-read#-1388291938] [WARN] [01/22/2024 07:04:36.800] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config24-notifier#-314059853]: org.opendaylight.controller.cluster.common.actor.Monitor@5bee7535 [WARN] [01/22/2024 07:04:36.800] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/shard-member-1:snapshot-read#-1388291938]: org.opendaylight.controller.cluster.common.actor.Monitor@5c54990a 07:04:36,802 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - Starting recovery for member-1-shard-inventory-config24 with journal batch size 3 07:04:36,802 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:36,803 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 [WARN] [01/22/2024 07:04:36.803] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCreateSnapshot]] 07:04:36,803 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config24: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,803 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config24 is no longer the leader 07:04:36,803 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config24 , received role change from null to Follower 07:04:36,803 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24 (Follower): Received TimeoutNow - switching to Candidate 07:04:36,803 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24 (Candidate): Election: Candidate has following voting peers: [] 07:04:36,803 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Set currentTerm=1, votedFor=member-1-shard-inventory-config24 07:04:36,803 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24 (Candidate): Starting new election term 1 07:04:36,803 AM [test-akka.actor.default-dispatcher-13] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:36,803 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config24 (Follower): Closing 07:04:36,804 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config24: onLeadershipChange, isLeader: false, hasLeader : false 07:04:36,804 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config24 is no longer the leader 07:04:36,804 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config24 , received role change from Follower to Candidate 07:04:36,804 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24 (Candidate): Received ElectionTimeout 07:04:36,804 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24 (Leader): Election: Leader has following peers: [] 07:04:36,804 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:36,804 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config24: onLeadershipChange, isLeader: true, hasLeader : true 07:04:36,804 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: became leader with frontend state for [] 07:04:36,804 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config24 , received role change from Candidate to Leader 07:04:36,854 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:36,854 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,854 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,854 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-157-0 07:04:36,854 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Readying Tx member-1-ShardTransactionTest-fe-0-txn-157-0 of 1 operations, client version 13 07:04:36,854 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: readying transaction member-1-ShardTransactionTest-fe-0-txn-157-0 07:04:36,854 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: transaction member-1-ShardTransactionTest-fe-0-txn-157-0 ready 07:04:36,854 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Validating transaction member-1-ShardTransactionTest-fe-0-txn-157-0 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-157-0 validated 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-157-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: canCommit for member-1-ShardTransactionTest-fe-0-txn-157-0: success 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Committing transaction member-1-ShardTransactionTest-fe-0-txn-157-0 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-157-0 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-157-0 candidate ready 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-157-0: canCommit - candidate rootPath: / 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-157-0: canCommit - messages: [] 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-157-0: preCommit - successfulFromPrevious: [] 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-157-0 prepared 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-157-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-157-0 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-157-0 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:36,855 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-157-0 submitted to persistence 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Moving last applied index from -1 to 0 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config24: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=6981251} is already disabled 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Moving last applied index from 0 to 1 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Applying state for log index 1 data Simple{size=143} 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config24: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-157-0 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-157-0: commit - successfulFromPrevious: [] 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-157-0 changing state from COMMIT_PENDING to COMMITTED 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Transaction member-1-ShardTransactionTest-fe-0-txn-157-0 committed as 0, sending response to Actor[akka://test/temp/testCreateSnapshot$e] 07:04:36,861 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config24: Created publisher actor Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config24-DTCL-publisher#9743555] with name member-1-shard-inventory-config24-DTCL-publisher 07:04:36,861 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config24-DTCL-publisher#9743555] 07:04:36,862 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config24: publishChanges: rootPath: / 07:04:36,862 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: fakeSnapshot purging log to 0 for term 1 07:04:36,862 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Persisting ApplyJournalEntries with index=0 [WARN] [01/22/2024 07:04:36.862] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshot/member-1-shard-inventory-config24-DTCL-publisher#9743555]: org.opendaylight.controller.cluster.common.actor.Monitor@61601102 07:04:36,862 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Persisting ApplyJournalEntries with index=1 07:04:36,862 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config24: Elapsed time for generation of change events for member-1-shard-inventory-config24-DTCL-publisher: 115.0 μs 07:04:36,992 AM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 07:04:36,992 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: lastSequenceNumber prior to capture: 5 07:04:36,993 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 07:04:36,993 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: CaptureSnapshotReply received by actor 07:04:36,993 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=1, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@5eb4655a, electionTerm=1, electionVotedFor=member-1-shard-inventory-config24, ServerConfigPayload=null] 07:04:36,993 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 0 and term: 1 07:04:36,993 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: SaveSnapshotSuccess received for snapshot, sequenceNr: 5 07:04:36,993 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Snapshot success - sequence number: 5 07:04:36,993 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: SnapshotComplete received 07:04:36,993 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: handled a journal response 07:04:36,995 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: handled a snapshot response 07:04:36,995 AM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=1, mandatoryTrim=false] 07:04:36,995 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: lastSequenceNumber prior to capture: 5 07:04:36,995 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 07:04:36,996 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: CaptureSnapshotReply received by actor 07:04:36,996 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=1, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@6eea95ba, electionTerm=1, electionVotedFor=member-1-shard-inventory-config24, ServerConfigPayload=null] 07:04:36,996 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: Removed in-memory snapshotted entries, adjusted snaphsotIndex: 0 and term: 1 07:04:36,996 AM [test-akka.actor.default-dispatcher-12] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config24: SaveSnapshotSuccess received for snapshot, sequenceNr: 5 07:04:36,996 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Snapshot success - sequence number: 5 07:04:36,996 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: SnapshotComplete received 07:04:36,996 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: handled a snapshot response 07:04:36,996 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: handled a journal response 07:04:36,996 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCreateSnapshot] 07:04:37,7 AM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1TestShard - Stopping Shard member-1-shard-inventory-config24 07:04:37,7 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config24 (Leader)_slicer-id-635: Closing 07:04:37,7 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config24: Aborting 0 pending queued transactions 07:04:37,8 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Shard created : member-1-shard-inventory-config25, persistent : true 07:04:37,9 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - Starting recovery for member-1-shard-inventory-config25 with journal batch size 3 [WARN] [01/22/2024 07:04:37.009] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries]: org.opendaylight.controller.cluster.common.actor.Monitor@1d06d76e 07:04:37,9 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testTransactionCommitWithPriorExpiredCohortEntries/member-1-shard-inventory-config25-notifier#1613394654 created and ready for shard:member-1-shard-inventory-config25 07:04:37,9 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/shard-member-1:snapshot-read#1538624416] [WARN] [01/22/2024 07:04:37.009] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/member-1-shard-inventory-config25-notifier#1613394654]: org.opendaylight.controller.cluster.common.actor.Monitor@7c074ca [WARN] [01/22/2024 07:04:37.009] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries/shard-member-1:snapshot-read#1538624416]: org.opendaylight.controller.cluster.common.actor.Monitor@3f40efdf 07:04:37,10 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config25: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:37,10 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config25: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:37,10 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config25: onLeadershipChange, isLeader: false, hasLeader : false 07:04:37,10 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config25: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config25 is no longer the leader 07:04:37,10 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config25 (Follower): Received TimeoutNow - switching to Candidate 07:04:37,10 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config25 (Candidate): Election: Candidate has following voting peers: [] 07:04:37,10 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config25: Set currentTerm=1, votedFor=member-1-shard-inventory-config25 07:04:37,10 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config25 (Candidate): Starting new election term 1 [WARN] [01/22/2024 07:04:37.010] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries]] 07:04:37,10 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config25 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:37,10 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config25 (Follower): Closing 07:04:37,10 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config25: onLeadershipChange, isLeader: false, hasLeader : false 07:04:37,10 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config25: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config25 is no longer the leader 07:04:37,10 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config25 , received role change from null to Follower 07:04:37,10 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config25 , received role change from Follower to Candidate 07:04:37,11 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config25 (Candidate): Received ElectionTimeout 07:04:37,11 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config25 (Leader): Election: Leader has following peers: [] 07:04:37,11 AM [test-akka.actor.default-dispatcher-12] [INFO] Shard - member-1-shard-inventory-config25 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:37,11 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config25: onLeadershipChange, isLeader: true, hasLeader : true 07:04:37,11 AM [test-akka.actor.default-dispatcher-12] [DEBUG] Shard - member-1-shard-inventory-config25: became leader with frontend state for [] 07:04:37,11 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config25 , received role change from Candidate to Leader 07:04:37,71 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:37,71 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:37,71 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:37,71 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-158-0 07:04:37,71 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Readying Tx member-1-ShardTransactionTest-fe-0-txn-158-0 of 1 operations, client version 13 07:04:37,71 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: readying transaction member-1-ShardTransactionTest-fe-0-txn-158-0 07:04:37,71 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: transaction member-1-ShardTransactionTest-fe-0-txn-158-0 ready 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-159-0 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Readying Tx member-1-ShardTransactionTest-fe-0-txn-159-0 of 1 operations, client version 13 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: readying transaction member-1-ShardTransactionTest-fe-0-txn-159-0 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: transaction member-1-ShardTransactionTest-fe-0-txn-159-0 ready 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-160-0 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Readying Tx member-1-ShardTransactionTest-fe-0-txn-160-0 of 1 operations, client version 13 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: readying transaction member-1-ShardTransactionTest-fe-0-txn-160-0 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: transaction member-1-ShardTransactionTest-fe-0-txn-160-0 ready 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Moving last applied index from -1 to 0 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] FrontendMetadata - member-1-shard-inventory-config25: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1407881} is already disabled 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-160-0 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: Tx member-1-ShardTransactionTest-fe-0-txn-160-0 is scheduled for canCommit step 07:04:37,72 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Persisting ApplyJournalEntries with index=0 07:04:37,685 AM [test-akka.actor.default-dispatcher-8] [WARN] ShardDataTree - member-1-shard-inventory-config25: Current transaction member-1-ShardTransactionTest-fe-0-txn-158-0 has timed out after 613 ms in state READY 07:04:37,854 AM [test-akka.actor.default-dispatcher-8] [WARN] ShardDataTree - member-1-shard-inventory-config25: Current transaction member-1-ShardTransactionTest-fe-0-txn-159-0 has timed out after 782 ms in state READY 07:04:37,854 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: Validating transaction member-1-ShardTransactionTest-fe-0-txn-160-0 07:04:37,854 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config25: Transaction member-1-ShardTransactionTest-fe-0-txn-160-0 validated 07:04:37,854 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-160-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:37,854 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: canCommit for member-1-ShardTransactionTest-fe-0-txn-160-0: success 07:04:37,855 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitWithPriorExpiredCohortEntries] 07:04:37,865 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - Stopping Shard member-1-shard-inventory-config25 07:04:37,866 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageSlicer - member-1-shard-inventory-config25 (Leader)_slicer-id-637: Closing 07:04:37,866 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config25: Aborting 1 pending queued transactions 07:04:37,867 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - Shard created : member-1-shard-inventory-config26, persistent : true [WARN] [01/22/2024 07:04:37.868] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyWithImmediateCommit-true]: org.opendaylight.controller.cluster.common.actor.Monitor@5b8b1c04 07:04:37,868 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-true/shard-member-1:snapshot-read#-319047618] 07:04:37,868 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config26-notifier#572712046 created and ready for shard:member-1-shard-inventory-config26 [WARN] [01/22/2024 07:04:37.868] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config26-notifier#572712046]: org.opendaylight.controller.cluster.common.actor.Monitor@47561123 [WARN] [01/22/2024 07:04:37.868] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/shard-member-1:snapshot-read#-319047618]: org.opendaylight.controller.cluster.common.actor.Monitor@31c4f49b 07:04:37,869 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - Starting recovery for member-1-shard-inventory-config26 with journal batch size 3 07:04:37,877 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:37,878 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config26: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:37,878 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: false, hasLeader : false 07:04:37,878 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config26 is no longer the leader 07:04:37,878 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from null to Follower 07:04:37,878 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26 (Follower): Received TimeoutNow - switching to Candidate 07:04:37,878 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26 (Candidate): Election: Candidate has following voting peers: [] 07:04:37,878 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: Set currentTerm=1, votedFor=member-1-shard-inventory-config26 07:04:37,878 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config26 (Candidate): Starting new election term 1 07:04:37,878 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config26 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:37,878 AM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config26 (Follower): Closing 07:04:37,878 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: false, hasLeader : false 07:04:37,878 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config26 is no longer the leader 07:04:37,878 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:37.878] [test-akka.actor.default-dispatcher-8] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testReadyWithImmediateCommit-true]] 07:04:37,879 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26 (Candidate): Received ElectionTimeout 07:04:37,879 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26 (Leader): Election: Leader has following peers: [] 07:04:37,879 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config26 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:37,879 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config26: onLeadershipChange, isLeader: true, hasLeader : true 07:04:37,879 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config26: became leader with frontend state for [] 07:04:37,879 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config26 , received role change from Candidate to Leader 07:04:37,979 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-161-0 07:04:37,979 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:37,979 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:37,979 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:37,979 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Readying transaction member-1-ShardTransactionTest-fe-0-txn-161-0, client version 13 07:04:37,979 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: readying transaction member-1-ShardTransactionTest-fe-0-txn-161-0 07:04:37,979 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: transaction member-1-ShardTransactionTest-fe-0-txn-161-0 ready 07:04:37,979 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Validating transaction member-1-ShardTransactionTest-fe-0-txn-161-0 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Transaction member-1-ShardTransactionTest-fe-0-txn-161-0 validated 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-161-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: canCommit for member-1-ShardTransactionTest-fe-0-txn-161-0: success 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Committing transaction member-1-ShardTransactionTest-fe-0-txn-161-0 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-161-0 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Transaction member-1-ShardTransactionTest-fe-0-txn-161-0 candidate ready 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-161-0: canCommit - candidate rootPath: / 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-161-0: canCommit - messages: [] 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-161-0: preCommit - successfulFromPrevious: [] 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Transaction member-1-ShardTransactionTest-fe-0-txn-161-0 prepared 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-161-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-161-0 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-161-0 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:37,980 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Transaction member-1-ShardTransactionTest-fe-0-txn-161-0 submitted to persistence 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Moving last applied index from -1 to 0 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] FrontendMetadata - member-1-shard-inventory-config26: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2143614} is already disabled 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Moving last applied index from 0 to 1 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Applying state for log index 1 data Simple{size=143} 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config26: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-161-0 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-161-0: commit - successfulFromPrevious: [] 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-161-0 changing state from COMMIT_PENDING to COMMITTED 07:04:37,981 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Transaction member-1-ShardTransactionTest-fe-0-txn-161-0 committed as 0, sending response to Actor[akka://test/system/testProbe-205#-871540509] 07:04:37,982 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyWithImmediateCommit-true] 07:04:37,982 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config26: Created publisher actor Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config26-DTCL-publisher#1167119380] with name member-1-shard-inventory-config26-DTCL-publisher 07:04:37,982 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config26-DTCL-publisher#1167119380] 07:04:37,982 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config26: publishChanges: rootPath: / [WARN] [01/22/2024 07:04:37.982] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-true/member-1-shard-inventory-config26-DTCL-publisher#1167119380]: org.opendaylight.controller.cluster.common.actor.Monitor@26bec7e1 07:04:37,983 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config26: Elapsed time for generation of change events for member-1-shard-inventory-config26-DTCL-publisher: 76.39 μs 07:04:37,983 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: fakeSnapshot purging log to 0 for term 1 07:04:37,983 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Persisting ApplyJournalEntries with index=0 07:04:37,983 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config26: Persisting ApplyJournalEntries with index=1 07:04:37,992 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config26 07:04:37,992 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config26 (Leader)_slicer-id-639: Closing 07:04:37,993 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config26: Aborting 0 pending queued transactions 07:04:37,995 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config27, persistent : true [WARN] [01/22/2024 07:04:37.995] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRegisterRoleChangeListener]: org.opendaylight.controller.cluster.common.actor.Monitor@1505d223 07:04:37,995 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testRegisterRoleChangeListener/member-1-shard-inventory-config27-notifier#-487499272 created and ready for shard:member-1-shard-inventory-config27 [WARN] [01/22/2024 07:04:37.995] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterRoleChangeListener/member-1-shard-inventory-config27-notifier#-487499272]: org.opendaylight.controller.cluster.common.actor.Monitor@6486e38c 07:04:37,995 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRegisterRoleChangeListener/shard-member-1:snapshot-read#1513506439] [WARN] [01/22/2024 07:04:37.996] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterRoleChangeListener/shard-member-1:snapshot-read#1513506439]: org.opendaylight.controller.cluster.common.actor.Monitor@253286bd 07:04:37,996 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config27 with journal batch size 3 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config27: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27 (Follower): Received TimeoutNow - switching to Candidate 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Election: Candidate has following voting peers: [] 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27: Set currentTerm=1, votedFor=member-1-shard-inventory-config27 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config27 (Candidate): Starting new election term 1 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config27 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config27 (Follower): Closing 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from null to Follower 07:04:37,997 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Follower to Candidate 07:04:37,997 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Received ElectionTimeout 07:04:37,997 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Election: Leader has following peers: [] [WARN] [01/22/2024 07:04:37.997] [test-akka.actor.default-dispatcher-12] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testRegisterRoleChangeListener]] 07:04:37,997 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config27 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:37,997 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: true, hasLeader : true 07:04:37,997 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: became leader with frontend state for [] 07:04:37,998 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Candidate to Leader 07:04:38,95 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , registered listener akka://test/user/$a 07:04:38,156 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 07:04:38,156 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Cluster state: [] 07:04:38,156 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Candidate in requestVote:RequestVote [term=10000, candidateId=member2, lastLogIndex=50, lastLogTerm=50] with higher term appears reachable, updating term. 07:04:38,156 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config27 (Leader): Term 10000 in "RequestVote [term=10000, candidateId=member2, lastLogIndex=50, lastLogTerm=50]" message is greater than leader's term 1 - switching to Follower 07:04:38,156 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: Set currentTerm=10000, votedFor=null 07:04:38,156 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config27 (Leader) :- Switching from behavior Leader to Follower, election term: 10000 07:04:38,156 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config27 (Leader)_slicer-id-641: Closing 07:04:38,156 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,156 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 07:04:38,156 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config27: Closing 07:04:38,156 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Leader to Follower 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config27 (Follower): Received TimeoutNow - switching to Candidate 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Election: Candidate has following voting peers: [] 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config27: Set currentTerm=10001, votedFor=member-1-shard-inventory-config27 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config27 (Candidate): Starting new election term 10001 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config27 (Follower) :- Switching from behavior Follower to Candidate, election term: 10001 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config27 (Follower): Closing 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config27: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config27 is no longer the leader 07:04:38,157 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Follower to Candidate 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config27 (Candidate): Received ElectionTimeout 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config27 (Leader): Election: Leader has following peers: [] 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config27 (Candidate) :- Switching from behavior Candidate to Leader, election term: 10001 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config27: onLeadershipChange, isLeader: true, hasLeader : true 07:04:38,157 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config27: became leader with frontend state for [] 07:04:38,158 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config27 , received role change from Candidate to Leader 07:04:38,207 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testRegisterRoleChangeListener] 07:04:38,218 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config27 07:04:38,218 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config27 (Leader)_slicer-id-642: Closing 07:04:38,218 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config27: Aborting 0 pending queued transactions 07:04:38,219 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22#-969529457] [WARN] [01/22/2024 07:04:38.219] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22#-969529457]: org.opendaylight.controller.cluster.common.actor.Monitor@762d11e0 07:04:38,221 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Shard created : member-1-shard-inventory-config28, persistent : true 07:04:38,222 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Starting recovery for member-1-shard-inventory-config28 with journal batch size 3 [WARN] [01/22/2024 07:04:38.223] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]: org.opendaylight.controller.cluster.common.actor.Monitor@371fa2d1 07:04:38,223 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/shard-member-1:snapshot-read#36129942] 07:04:38,223 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/member-1-shard-inventory-config28-notifier#-2076462292 created and ready for shard:member-1-shard-inventory-config28 [WARN] [01/22/2024 07:04:38.223] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/member-1-shard-inventory-config28-notifier#-2076462292]: org.opendaylight.controller.cluster.common.actor.Monitor@1430d24b [WARN] [01/22/2024 07:04:38.223] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/shard-member-1:snapshot-read#36129942]: org.opendaylight.controller.cluster.common.actor.Monitor@269a739d 07:04:38,223 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config28: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#1546461747] 07:04:38,223 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config28: SnapshotOffer called. 07:04:38,223 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config28: Moving last applied index from -1 to -1 07:04:38,223 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config28: Set currentTerm=1, votedFor=null 07:04:38,223 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config28: Applying recovered snapshot 07:04:38,223 AM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config28: clearing clients {} 07:04:38,224 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config28: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/member-1-shard-inventory-config28-DTCL-publisher#-600786971] with name member-1-shard-inventory-config28-DTCL-publisher 07:04:38,224 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/member-1-shard-inventory-config28-DTCL-publisher#-600786971] 07:04:38,224 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config28: state snapshot applied in 544.7 μs 07:04:38,224 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Recovery snapshot applied for member-1-shard-inventory-config28 in 690.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 07:04:38,224 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config28: publishChanges: rootPath: / [WARN] [01/22/2024 07:04:38.224] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/member-1-shard-inventory-config28-DTCL-publisher#-600786971]: org.opendaylight.controller.cluster.common.actor.Monitor@67cead52 07:04:38,224 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config28: Elapsed time for generation of change events for member-1-shard-inventory-config28-DTCL-publisher: 74.43 μs 07:04:38,225 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config28: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:38,225 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config28: Recovery completed in 1.773 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:38,225 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,225 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config28: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config28 is no longer the leader 07:04:38,225 AM [test-akka.actor.default-dispatcher-13] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 07:04:38,225 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config28 , received role change from null to Follower [WARN] [01/22/2024 07:04:38.225] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]] 07:04:38,236 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22#-969529457]], isLeader: false, hasLeader: false 07:04:38,236 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: Shard does not have a leader - delaying registration 07:04:38,237 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/$a#-612992706] [WARN] [01/22/2024 07:04:38.237] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/$a#-612992706]: org.opendaylight.controller.cluster.common.actor.Monitor@237cc1fa 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/$a 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config28: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig null 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config28: Re-initializing to Follower with previous leaderId null 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config28 (Follower): Closing 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config28: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config28 is no longer the leader 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config28 (Follower): Received TimeoutNow - switching to Candidate 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config28 (Candidate): Election: Candidate has following voting peers: [] 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config28: Set currentTerm=2, votedFor=member-1-shard-inventory-config28 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config28 (Candidate): Starting new election term 2 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config28 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config28 (Follower): Closing 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,238 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config28: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config28 is no longer the leader 07:04:38,238 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config28 , received role change from Follower to Candidate 07:04:38,239 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config28 (Candidate): Received ElectionTimeout 07:04:38,239 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config28 (Leader): Election: Leader has following peers: [] 07:04:38,239 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config28 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 07:04:38,239 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: onLeadershipChange, isLeader: true, hasLeader : true 07:04:38,239 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config28: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@5a5a6319 07:04:38,239 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config28: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 07:04:38,239 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config28: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]], initialState present=true] to publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23/member-1-shard-inventory-config28-DTCL-publisher#-600786971] 07:04:38,239 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config28: became leader with frontend state for [] 07:04:38,239 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config28 , received role change from Candidate to Leader 07:04:38,240 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config28: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]], initialState present=true] 07:04:38,240 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config28: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]] 07:04:38,240 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config28: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]] 07:04:38,240 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)] 07:04:38,240 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config28: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@5a5a6319 07:04:38,240 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config28: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23]] 07:04:38,240 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-DataTreeChangeListener22#-969529457] 07:04:38,251 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistration-shard23] 07:04:38,251 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config28 07:04:38,251 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config28 (Leader)_slicer-id-644: Closing 07:04:38,251 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config28: Aborting 0 pending queued transactions 07:04:38,253 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config, persistent : true [WARN] [01/22/2024 07:04:38.253] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]: org.opendaylight.controller.cluster.common.actor.Monitor@4186b4c8 07:04:38,253 AM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-notifier#-1461267705 created and ready for shard:testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config [WARN] [01/22/2024 07:04:38.253] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-notifier#-1461267705]: org.opendaylight.controller.cluster.common.actor.Monitor@49bbc39d 07:04:38,253 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-follower24:snapshot-read#35907607] [WARN] [01/22/2024 07:04:38.253] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-follower24:snapshot-read#35907607]: org.opendaylight.controller.cluster.common.actor.Monitor@4fa140f3 07:04:38,253 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config with journal batch size 3 07:04:38,254 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:38,254 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:38,255 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,255 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config is no longer the leader 07:04:38,255 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config , received role change from null to Follower 07:04:38,255 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - Shard created : testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, persistent : true [WARN] [01/22/2024 07:04:38.255] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config]: org.opendaylight.controller.cluster.common.actor.Monitor@59189a2c [WARN] [01/22/2024 07:04:38.255] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]] 07:04:38,256 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-notifier#-1796213615 created and ready for shard:testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config [WARN] [01/22/2024 07:04:38.256] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-notifier#-1796213615]: org.opendaylight.controller.cluster.common.actor.Monitor@4357bce0 07:04:38,256 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-leader25:snapshot-read#-1695841495] [WARN] [01/22/2024 07:04:38.256] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/shard-testClusteredDataTreeChangeListenerRegistration-leader25:snapshot-read#-1695841495]: org.opendaylight.controller.cluster.common.actor.Monitor@182fce5f 07:04:38,256 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - Starting recovery for testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config with journal batch size 3 07:04:38,257 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:38,257 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:38,257 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,257 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config is no longer the leader 07:04:38,258 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Follower): Received TimeoutNow - switching to Candidate [WARN] [01/22/2024 07:04:38.258] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config]] 07:04:38,258 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Candidate): Election: Candidate has following voting peers: [testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config] 07:04:38,258 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Set currentTerm=1, votedFor=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config 07:04:38,258 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config , received role change from null to Follower 07:04:38,258 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Candidate): Starting new election term 1 07:04:38,258 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Candidate): Sending RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] to peer testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config 07:04:38,258 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:38,258 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Follower): Closing 07:04:38,258 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,258 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: onStateChanged: Closing all transaction chains because shard testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config is no longer the leader 07:04:38,258 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Found higher term in RequestVote rpc, verifying whether it's safe to update term. 07:04:38,258 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config , received role change from Follower to Candidate 07:04:38,258 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Cluster state: [] 07:04:38,258 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Candidate in requestVote:RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] with higher term appears reachable, updating term. 07:04:38,258 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Term 1 in "RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1]" message is greater than follower's term 0 - updating term 07:04:38,258 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Set currentTerm=1, votedFor=null 07:04:38,259 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): In requestVote: RequestVote [term=1, candidateId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, lastLogIndex=-1, lastLogTerm=-1] - currentTerm: 1, votedFor: null, lastIndex: -1, lastTerm: -1 07:04:38,259 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Set currentTerm=1, votedFor=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config 07:04:38,259 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): requestVote returning: RequestVoteReply [term=1, voteGranted=true] 07:04:38,259 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Candidate): RaftRPC message received RequestVoteReply [term=1, voteGranted=true], my term is 1 07:04:38,259 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Candidate): handleRequestVoteReply: RequestVoteReply [term=1, voteGranted=true], current voteCount: 1 07:04:38,259 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Election: Leader has following peers: [testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config] 07:04:38,259 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: active: false, followerNextIndex: -1, leaderLastIndex: -1, leaderSnapShotIndex: -1 07:04:38,259 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:38,259 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: onLeadershipChange, isLeader: true, hasLeader : true 07:04:38,260 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: became leader with frontend state for [] 07:04:38,260 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config , received role change from Candidate to Leader 07:04:38,260 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Closing 07:04:38,260 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config 07:04:38,260 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config updated: matchIndex: -1, nextIndex: 0 07:04:38,260 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: -1, leaderSnapShotIndex: -1 [WARN] [01/22/2024 07:04:38.264] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@d5c4c62 07:04:38,307 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config 07:04:38,308 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26#-426064857] [WARN] [01/22/2024 07:04:38.308] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26#-426064857]: org.opendaylight.controller.cluster.common.actor.Monitor@5e6fbbf9 07:04:38,318 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26#-426064857]], isLeader: false, hasLeader: true 07:04:38,319 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 07:04:38,319 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/$a#679001727] 07:04:38,319 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-DTCL-publisher#-530756249] with name testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-DTCL-publisher 07:04:38,319 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]], initialState present=true] to publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-DTCL-publisher#-530756249] [WARN] [01/22/2024 07:04:38.319] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/$a#679001727]: org.opendaylight.controller.cluster.common.actor.Monitor@78cfab50 07:04:38,319 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/$a 07:04:38,319 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@51b08b1f 07:04:38,319 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-DTCL-publisher#-530756249] 07:04:38,319 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]], initialState present=true] [WARN] [01/22/2024 07:04:38.319] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-DTCL-publisher#-530756249]: org.opendaylight.controller.cluster.common.actor.Monitor@c645000 07:04:38,319 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]] 07:04:38,319 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ForwardingDataTreeChangeListener - Sending OnInitialData to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)] 07:04:38,319 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: getLeaderAddress leaderId = testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config peerAddress = akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config 07:04:38,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Forwarding 1 BatchedModifications to leader ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config)] 07:04:38,320 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]] 07:04:38,320 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Notifying onInitialData to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@51b08b1f 07:04:38,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:38,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Replicate message: identifier: ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, logIndex: 0, isSendImmediate: true 07:04:38,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: 0, leaderSnapShotIndex: -1 07:04:38,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): sendAppendEntries: 0 is present for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config 07:04:38,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Sending AppendEntries to follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}]]] 07:04:38,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-162-0 07:04:38,320 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): handleAppendEntries: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, prevLogIndex=-1, prevLogTerm=-1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}]]] 07:04:38,320 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Number of entries to be appended = 1 07:04:38,320 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): After cleanup, lastIndex: -1, entries to be added from: 0 07:04:38,320 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Append entry to log DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:38,320 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Readying Tx member-1-ShardTransactionTest-fe-0-txn-162-0 of 1 operations, client version 13 07:04:38,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: readying transaction member-1-ShardTransactionTest-fe-0-txn-162-0 07:04:38,320 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: transaction member-1-ShardTransactionTest-fe-0-txn-162-0 ready 07:04:38,320 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Log size is now 1 07:04:38,321 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config, logLastIndex=0, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=13, raftVersion=5, recipientRaftVersion=5] 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Validating transaction member-1-ShardTransactionTest-fe-0-txn-162-0 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-162-0 validated 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-162-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: canCommit for member-1-ShardTransactionTest-fe-0-txn-162-0: success 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Committing transaction member-1-ShardTransactionTest-fe-0-txn-162-0 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-162-0 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-162-0 candidate ready 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-162-0: canCommit - candidate rootPath: / 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-162-0: canCommit - messages: [] 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-162-0: preCommit - successfulFromPrevious: [] 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-162-0 prepared 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-162-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-162-0 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-162-0 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:38,321 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Replicate message: identifier: member-1-ShardTransactionTest-fe-0-txn-162-0, logIndex: 1, isSendImmediate: true 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: active: true, followerNextIndex: 0, leaderLastIndex: 1, leaderSnapShotIndex: -1 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): sendAppendEntries: 0 is present for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-162-0 submitted to persistence 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config updated: matchIndex: 0, nextIndex: 1 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: active: true, followerNextIndex: 1, leaderLastIndex: 1, leaderSnapShotIndex: -1 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): sendAppendEntries: 1 is present for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config 07:04:38,321 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Sending AppendEntries to follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}]]] [WARN] [01/22/2024 07:04:38.321] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@74fdd02 07:04:38,322 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): handleAppendEntries: AppendEntries [leaderId=testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config, prevLogIndex=0, prevLogTerm=1, leaderCommit=-1, replicatedToAllIndex=-1, payloadVersion=13, recipientRaftVersion=5, leaderRaftVersion=5, leaderAddress=null, entries=[SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}]]] 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,322 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Number of entries to be appended = 1 07:04:38,322 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): After cleanup, lastIndex: 0, entries to be added from: 0 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Applying to log - commitIndex: 0, lastAppliedIndex: -1 07:04:38,322 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Append entry to log Simple{size=143} 07:04:38,322 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Setting last applied to 0 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Moving last applied index from -1 to 0 07:04:38,322 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Log size is now 2 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:38,322 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): handleAppendEntries returning : AppendEntriesReply [term=1, success=true, followerId=testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config, logLastIndex=1, logLastTerm=1, forceInstallSnapshot=false, needsLeaderAddress=false, payloadVersion=13, raftVersion=5, recipientRaftVersion=5] 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2148492} is already disabled 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): handleAppendEntriesReply - FollowerLogInformation for testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config updated: matchIndex: 1, nextIndex: 2 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Applying to log - commitIndex: 1, lastAppliedIndex: 0 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Setting last applied to 1 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Moving last applied index from 0 to 1 07:04:38,322 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Applying state for log index 1 data Simple{size=143} 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-162-0 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-162-0: commit - successfulFromPrevious: [] 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-162-0 changing state from COMMIT_PENDING to COMMITTED 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Transaction member-1-ShardTransactionTest-fe-0-txn-162-0 committed as 0, sending response to Actor[akka://test/temp/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config$f] 07:04:38,322 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-DTCL-publisher#-15095792] with name testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-DTCL-publisher 07:04:38,322 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-DTCL-publisher#-15095792] 07:04:38,323 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: fakeSnapshot purging log to 0 for term 1 07:04:38,323 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: publishChanges: rootPath: / 07:04:38,323 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader): Checking sendAppendEntries for follower testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: active: true, followerNextIndex: 2, leaderLastIndex: 1, leaderSnapShotIndex: 0 07:04:38,323 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Elapsed time for generation of change events for testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-DTCL-publisher: 65.13 μs 07:04:38,323 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Persisting ApplyJournalEntries with index=0 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Commit index set to 1 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): applyLogToStateMachine, appendEntries.getLeaderCommit(): 1, context.getLastApplied(): -1, lastIndex(): 1 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Setting last applied to 0 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Moving last applied index from -1 to 0 [WARN] [01/22/2024 07:04:38.323] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config-DTCL-publisher#-15095792]: org.opendaylight.controller.cluster.common.actor.Monitor@77e8b52b 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendMetadata - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Setting last applied to 1 07:04:38,323 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Persisting ApplyJournalEntries with index=1 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Moving last applied index from 0 to 1 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Applying state for log index 1 data Simple{size=143} 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Applying foreign transaction member-1-ShardTransactionTest-fe-0-txn-162-0 07:04:38,323 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: publishChanges: rootPath: / 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: fakeSnapshot purging log to 0 for term 1 07:04:38,323 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Persisting ApplyJournalEntries with index=1 07:04:38,323 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)], sending actor=TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config]] 07:04:38,323 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26)] 07:04:38,323 AM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardDataTreeChangePublisherActor - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Elapsed time for generation of change events for testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config-DTCL-publisher: 176.2 μs 07:04:38,323 AM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerActor - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@51b08b1f 07:04:38,324 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config] 07:04:38,334 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config 07:04:38,334 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config (Follower): Closing 07:04:38,334 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-follower24-shard-inventory-config: Aborting 0 pending queued transactions 07:04:38,335 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config] 07:04:38,335 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config 07:04:38,335 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config (Leader)_slicer-id-647: Closing 07:04:38,335 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - testClusteredDataTreeChangeListenerRegistration-leader25-shard-inventory-config: Aborting 0 pending queued transactions 07:04:38,335 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerRegistration-DataTreeChangeListener26#-426064857] 07:04:38,337 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config30, persistent : true 07:04:38,338 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config30 with journal batch size 3 [WARN] [01/22/2024 07:04:38.338] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPeerAddressResolved]: org.opendaylight.controller.cluster.common.actor.Monitor@1fbea247 07:04:38,338 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testPeerAddressResolved/member-1-shard-inventory-config30-notifier#-1630248425 created and ready for shard:member-1-shard-inventory-config30 07:04:38,338 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPeerAddressResolved/shard-member-1:snapshot-read#-1785527393] [WARN] [01/22/2024 07:04:38.338] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPeerAddressResolved/member-1-shard-inventory-config30-notifier#-1630248425]: org.opendaylight.controller.cluster.common.actor.Monitor@6a14be47 [WARN] [01/22/2024 07:04:38.338] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPeerAddressResolved/shard-member-1:snapshot-read#-1785527393]: org.opendaylight.controller.cluster.common.actor.Monitor@6b37915 07:04:38,339 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config30: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:38,339 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config30: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:38,339 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config30: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,339 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config30: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config30 is no longer the leader [WARN] [01/22/2024 07:04:38.339] [test-akka.actor.default-dispatcher-18] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testPeerAddressResolved]] 07:04:38,339 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config30 , received role change from null to Follower 07:04:38,437 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Peer address for peer member-2-shard-inventory-config set to akka://foobar 07:04:38,447 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPeerAddressResolved] 07:04:38,458 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config30 07:04:38,458 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config30 (Follower): Closing 07:04:38,458 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config30: Aborting 0 pending queued transactions 07:04:38,460 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config31, persistent : true [WARN] [01/22/2024 07:04:38.460] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount]: org.opendaylight.controller.cluster.common.actor.Monitor@7a103f06 07:04:38,460 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/member-1-shard-inventory-config31-notifier#-1665921593 created and ready for shard:member-1-shard-inventory-config31 [WARN] [01/22/2024 07:04:38.460] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/member-1-shard-inventory-config31-notifier#-1665921593]: org.opendaylight.controller.cluster.common.actor.Monitor@32e01a6a 07:04:38,461 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/shard-member-1:snapshot-read#312832859] [WARN] [01/22/2024 07:04:38.461] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount/shard-member-1:snapshot-read#312832859]: org.opendaylight.controller.cluster.common.actor.Monitor@2709cca7 07:04:38,461 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config31 with journal batch size 3 07:04:38,462 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config31: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:38,462 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config31: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:38,462 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,462 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config31: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config31 is no longer the leader [WARN] [01/22/2024 07:04:38.462] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount]] 07:04:38,462 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config31 (Follower): Received TimeoutNow - switching to Candidate 07:04:38,462 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from null to Follower 07:04:38,462 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config31 (Candidate): Election: Candidate has following voting peers: [] 07:04:38,462 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config31: Set currentTerm=1, votedFor=member-1-shard-inventory-config31 07:04:38,462 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config31 (Candidate): Starting new election term 1 07:04:38,462 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config31 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:38,462 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config31 (Follower): Closing 07:04:38,462 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,462 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config31: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config31 is no longer the leader 07:04:38,463 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from Follower to Candidate 07:04:38,463 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31 (Candidate): Received ElectionTimeout 07:04:38,463 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31 (Leader): Election: Leader has following peers: [] 07:04:38,463 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config31 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:38,463 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config31: onLeadershipChange, isLeader: true, hasLeader : true 07:04:38,463 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31: became leader with frontend state for [] 07:04:38,463 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config31 , received role change from Candidate to Leader 07:04:38,525 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:38,525 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,525 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,526 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31: Applying 0 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-163-0 07:04:38,526 AM [test-akka.actor.default-dispatcher-8] [ERROR] Shard - member-1-shard-inventory-config31: Error handling BatchedModifications for Tx member-1-ShardTransactionTest-fe-0-txn-163-0 java.lang.IllegalStateException: The total number of batched messages received 1 does not match the number sent 2 at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleBatchedModifications(ShardCommitCoordinator.java:157) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModificationsLocal(Shard.java:753) at org.opendaylight.controller.cluster.datastore.Shard.handleBatchedModifications(Shard.java:777) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:408) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:38,526 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,526 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31: Moving last applied index from -1 to 0 07:04:38,526 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:38,526 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:38,526 AM [test-akka.actor.default-dispatcher-8] [DEBUG] FrontendMetadata - member-1-shard-inventory-config31: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:38,526 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1115137} is already disabled 07:04:38,527 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config31: Persisting ApplyJournalEntries with index=0 07:04:38,527 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsReadyWithIncorrectTotalMessageCount] 07:04:38,538 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config31 07:04:38,538 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config31 (Leader)_slicer-id-650: Closing 07:04:38,538 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config31: Aborting 0 pending queued transactions 07:04:38,540 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config32, persistent : true [WARN] [01/22/2024 07:04:38.540] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true]: org.opendaylight.controller.cluster.common.actor.Monitor@7e6c718d 07:04:38,541 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config32-notifier#-236228738 created and ready for shard:member-1-shard-inventory-config32 [WARN] [01/22/2024 07:04:38.541] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config32-notifier#-236228738]: org.opendaylight.controller.cluster.common.actor.Monitor@133c562c 07:04:38,542 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/shard-member-1:snapshot-read#-701245415] [WARN] [01/22/2024 07:04:38.542] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/shard-member-1:snapshot-read#-701245415]: org.opendaylight.controller.cluster.common.actor.Monitor@2b2e9437 07:04:38,542 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config32 with journal batch size 3 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config32: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config32 is no longer the leader 07:04:38,543 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from null to Follower [WARN] [01/22/2024 07:04:38.543] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true]] 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32 (Follower): Received TimeoutNow - switching to Candidate 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32 (Candidate): Election: Candidate has following voting peers: [] 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Set currentTerm=1, votedFor=member-1-shard-inventory-config32 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config32 (Candidate): Starting new election term 1 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config32 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config32 (Follower): Closing 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config32 is no longer the leader 07:04:38,543 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Follower to Candidate 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32 (Candidate): Received ElectionTimeout 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32 (Leader): Election: Leader has following peers: [] 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config32 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:38,543 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config32: onLeadershipChange, isLeader: true, hasLeader : true 07:04:38,544 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: became leader with frontend state for [] 07:04:38,544 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config32 , received role change from Candidate to Leader 07:04:38,604 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-164-0 07:04:38,604 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:38,604 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,604 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,604 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Readying transaction member-1-ShardTransactionTest-fe-0-txn-164-0, client version 13 07:04:38,605 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: readying transaction member-1-ShardTransactionTest-fe-0-txn-164-0 07:04:38,605 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: transaction member-1-ShardTransactionTest-fe-0-txn-164-0 ready 07:04:38,605 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,605 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Moving last applied index from -1 to 0 07:04:38,605 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:38,605 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:38,605 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendMetadata - member-1-shard-inventory-config32: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:38,605 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=915144} is already disabled 07:04:38,605 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Persisting ApplyJournalEntries with index=0 07:04:38,605 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-164-0 07:04:38,605 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Validating transaction member-1-ShardTransactionTest-fe-0-txn-164-0 07:04:38,606 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-164-0 validated 07:04:38,606 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-164-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:38,606 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: canCommit for member-1-ShardTransactionTest-fe-0-txn-164-0: success 07:04:38,607 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Committing transaction member-1-ShardTransactionTest-fe-0-txn-164-0 07:04:38,607 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-164-0 07:04:38,607 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-164-0 candidate ready 07:04:38,607 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-164-0: canCommit - candidate rootPath: / 07:04:38,607 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-164-0: canCommit - messages: [] 07:04:38,607 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-164-0: preCommit - successfulFromPrevious: [] 07:04:38,607 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-164-0 prepared 07:04:38,608 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-164-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:38,608 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-164-0 07:04:38,608 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-164-0 07:04:38,608 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:38,608 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:38,608 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:38,608 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-164-0 submitted to persistence 07:04:38,609 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:38,609 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Moving last applied index from 0 to 1 07:04:38,609 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Applying state for log index 1 data Simple{size=143} 07:04:38,609 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config32: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-164-0 07:04:38,609 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-164-0: commit - successfulFromPrevious: [] 07:04:38,609 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-164-0 changing state from COMMIT_PENDING to COMMITTED 07:04:38,609 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Transaction member-1-ShardTransactionTest-fe-0-txn-164-0 committed as 0, sending response to Actor[akka://test/system/testProbe-217#-1390064267] 07:04:38,610 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config32: Created publisher actor Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config32-DTCL-publisher#-1932501576] with name member-1-shard-inventory-config32-DTCL-publisher 07:04:38,610 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config32-DTCL-publisher#-1932501576] 07:04:38,610 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: fakeSnapshot purging log to 0 for term 1 07:04:38,610 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config32: Persisting ApplyJournalEntries with index=1 07:04:38,610 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config32: publishChanges: rootPath: / [WARN] [01/22/2024 07:04:38.610] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-true/member-1-shard-inventory-config32-DTCL-publisher#-1932501576]: org.opendaylight.controller.cluster.common.actor.Monitor@35cbc576 07:04:38,610 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config32: Elapsed time for generation of change events for member-1-shard-inventory-config32-DTCL-publisher: 54.77 μs 07:04:38,812 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWhenTransactionHasModifications-true] 07:04:38,822 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config32 07:04:38,822 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config32 (Leader)_slicer-id-652: Closing 07:04:38,822 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config32: Aborting 0 pending queued transactions 07:04:38,824 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config33, persistent : true [WARN] [01/22/2024 07:04:38.824] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady]: org.opendaylight.controller.cluster.common.actor.Monitor@f91a6f9 07:04:38,825 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config33-notifier#-2055954554 created and ready for shard:member-1-shard-inventory-config33 [WARN] [01/22/2024 07:04:38.825] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config33-notifier#-2055954554]: org.opendaylight.controller.cluster.common.actor.Monitor@47551d6 07:04:38,825 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/shard-member-1:snapshot-read#255478872] [WARN] [01/22/2024 07:04:38.825] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/shard-member-1:snapshot-read#255478872]: org.opendaylight.controller.cluster.common.actor.Monitor@72c65c73 07:04:38,825 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config33 with journal batch size 3 07:04:38,826 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:38,826 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config33: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:38,826 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,826 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config33 is no longer the leader 07:04:38,826 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from null to Follower 07:04:38,827 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33 (Follower): Received TimeoutNow - switching to Candidate [WARN] [01/22/2024 07:04:38.827] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady]] 07:04:38,827 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33 (Candidate): Election: Candidate has following voting peers: [] 07:04:38,827 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: Set currentTerm=1, votedFor=member-1-shard-inventory-config33 07:04:38,827 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config33 (Candidate): Starting new election term 1 07:04:38,827 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config33 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:38,827 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config33 (Follower): Closing 07:04:38,827 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,827 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config33 is no longer the leader 07:04:38,827 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from Follower to Candidate 07:04:38,832 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33 (Candidate): Received ElectionTimeout 07:04:38,832 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33 (Leader): Election: Leader has following peers: [] 07:04:38,832 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config33 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:38,832 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config33: onLeadershipChange, isLeader: true, hasLeader : true 07:04:38,832 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: became leader with frontend state for [] 07:04:38,832 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config33 , received role change from Candidate to Leader 07:04:38,888 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:38,888 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,888 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,888 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-165-0 07:04:38,888 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-165-0 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Moving last applied index from -1 to 0 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config33: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1039777} is already disabled 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-165-0 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Readying Tx member-1-ShardTransactionTest-fe-0-txn-165-0 of 3 operations, client version 13 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: readying transaction member-1-ShardTransactionTest-fe-0-txn-165-0 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: transaction member-1-ShardTransactionTest-fe-0-txn-165-0 ready 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Persisting ApplyJournalEntries with index=0 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-165-0 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Validating transaction member-1-ShardTransactionTest-fe-0-txn-165-0 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Transaction member-1-ShardTransactionTest-fe-0-txn-165-0 validated 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-165-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:38,889 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: canCommit for member-1-ShardTransactionTest-fe-0-txn-165-0: success 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Committing transaction member-1-ShardTransactionTest-fe-0-txn-165-0 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-165-0 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Transaction member-1-ShardTransactionTest-fe-0-txn-165-0 candidate ready 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-165-0: canCommit - candidate rootPath: / 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-165-0: canCommit - messages: [] 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-165-0: preCommit - successfulFromPrevious: [] 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Transaction member-1-ShardTransactionTest-fe-0-txn-165-0 prepared 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-165-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-165-0 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-165-0 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Transaction member-1-ShardTransactionTest-fe-0-txn-165-0 submitted to persistence 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Moving last applied index from 0 to 1 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Applying state for log index 1 data Simple{size=175} 07:04:38,890 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config33: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-165-0 07:04:38,891 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-165-0: commit - successfulFromPrevious: [] 07:04:38,891 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-165-0 changing state from COMMIT_PENDING to COMMITTED 07:04:38,891 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Transaction member-1-ShardTransactionTest-fe-0-txn-165-0 committed as 0, sending response to Actor[akka://test/system/testProbe-219#410482819] 07:04:38,891 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config33: Created publisher actor Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config33-DTCL-publisher#-6810231] with name member-1-shard-inventory-config33-DTCL-publisher 07:04:38,891 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config33-DTCL-publisher#-6810231] 07:04:38,891 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config33: publishChanges: rootPath: / 07:04:38,891 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: fakeSnapshot purging log to 0 for term 1 07:04:38,891 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config33: Persisting ApplyJournalEntries with index=1 07:04:38,891 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config33: Elapsed time for generation of change events for member-1-shard-inventory-config33-DTCL-publisher: 73.36 μs [WARN] [01/22/2024 07:04:38.891] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testBatchedModificationsWithNoCommitOnReady/member-1-shard-inventory-config33-DTCL-publisher#-6810231]: org.opendaylight.controller.cluster.common.actor.Monitor@1287a5ba 07:04:38,892 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testBatchedModificationsWithNoCommitOnReady] 07:04:38,903 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config33 07:04:38,903 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config33 (Leader)_slicer-id-654: Closing 07:04:38,903 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config33: Aborting 0 pending queued transactions 07:04:38,905 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config34, persistent : true [WARN] [01/22/2024 07:04:38.905] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionMessagesWithNoLeader]: org.opendaylight.controller.cluster.common.actor.Monitor@374d4d5c 07:04:38,905 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testTransactionMessagesWithNoLeader/member-1-shard-inventory-config34-notifier#-1432451278 created and ready for shard:member-1-shard-inventory-config34 [WARN] [01/22/2024 07:04:38.905] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionMessagesWithNoLeader/member-1-shard-inventory-config34-notifier#-1432451278]: org.opendaylight.controller.cluster.common.actor.Monitor@35cde12c 07:04:38,905 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionMessagesWithNoLeader/shard-member-1:snapshot-read#126452078] [WARN] [01/22/2024 07:04:38.906] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionMessagesWithNoLeader/shard-member-1:snapshot-read#126452078]: org.opendaylight.controller.cluster.common.actor.Monitor@1e53d2d2 07:04:38,906 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config34 with journal batch size 3 07:04:38,907 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:38,907 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config34: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:38,907 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config34: onLeadershipChange, isLeader: false, hasLeader : false 07:04:38,907 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config34: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config34 is no longer the leader 07:04:38,907 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config34 , received role change from null to Follower 07:04:38,907 AM [test-akka.actor.default-dispatcher-13] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy [WARN] [01/22/2024 07:04:38.907] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testTransactionMessagesWithNoLeader]] 07:04:39,15 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config34: Adding message BatchedModifications [transactionId=member-1-ShardTransactionTest-fe-0-txn-166-0, ready=false, participatingShardNames=null, totalMessagesSent=0, modifications size=0] to retry 07:04:39,135 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config34: Timer expired for message BatchedModifications [transactionId=member-1-ShardTransactionTest-fe-0-txn-166-0, ready=false, participatingShardNames=null, totalMessagesSent=0, modifications size=0] 07:04:39,136 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: handleForwardedReadyTransaction for member-1-ShardTransactionTest-fe-0-txn-166-0 07:04:39,139 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config34: Adding message ForwardedReadyTransaction [transactionId=member-1-ShardTransactionTest-fe-0-txn-166-0, transaction=ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-txn-166-0, closed=false, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]}, doImmediateCommit=true, participatingShardNames=null, txnClientVersion=13] to retry 07:04:39,254 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config34: Timer expired for message ForwardedReadyTransaction [transactionId=member-1-ShardTransactionTest-fe-0-txn-166-0, transaction=ReadWriteShardDataTreeTransaction{id=member-1-ShardTransactionTest-fe-0-txn-166-0, closed=false, snapshot=MutableDataTree [modification=ModifiedNode{identifier=(urn:ietf:params:xml:ns:netconf:base:1.0)data, operation=TOUCH, childModification={(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test=ModifiedNode{identifier=(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, operation=WRITE}}}]}, doImmediateCommit=true, participatingShardNames=null, txnClientVersion=13] 07:04:39,255 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config34: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-166-0 07:04:39,255 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config34: Adding message org.opendaylight.controller.cluster.datastore.messages.ReadyLocalTransaction@307ed2c9 to retry 07:04:39,374 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardTransactionMessageRetrySupport - member-1-shard-inventory-config34: Timer expired for message org.opendaylight.controller.cluster.datastore.messages.ReadyLocalTransaction@307ed2c9 07:04:39,375 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionMessagesWithNoLeader] 07:04:39,385 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config34 07:04:39,386 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config34 (Follower): Closing 07:04:39,386 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config34: Aborting 0 pending queued transactions 07:04:39,388 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config35, persistent : true [WARN] [01/22/2024 07:04:39.388] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction#-863682378]: org.opendaylight.controller.cluster.common.actor.Monitor@61741970 07:04:39,389 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testCreateTransaction/member-1-shard-inventory-config35-notifier#-1839875209 created and ready for shard:member-1-shard-inventory-config35 [WARN] [01/22/2024 07:04:39.389] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/member-1-shard-inventory-config35-notifier#-1839875209]: org.opendaylight.controller.cluster.common.actor.Monitor@19e80a6a 07:04:39,389 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateTransaction/shard-member-1:snapshot-read#-1083820761] [WARN] [01/22/2024 07:04:39.389] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/shard-member-1:snapshot-read#-1083820761]: org.opendaylight.controller.cluster.common.actor.Monitor@1cbdace5 07:04:39,389 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config35 with journal batch size 3 07:04:39,390 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:39,390 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config35: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:39,391 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: false, hasLeader : false 07:04:39,391 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config35 is no longer the leader 07:04:39,391 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from null to Follower 07:04:39,391 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35 (Follower): Received TimeoutNow - switching to Candidate 07:04:39,391 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35 (Candidate): Election: Candidate has following voting peers: [] 07:04:39,391 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: Set currentTerm=1, votedFor=member-1-shard-inventory-config35 07:04:39,391 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config35 (Candidate): Starting new election term 1 07:04:39,391 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config35 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:39,391 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageAssembler - member-1-shard-inventory-config35 (Follower): Closing 07:04:39,391 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: false, hasLeader : false 07:04:39,391 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config35: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config35 is no longer the leader 07:04:39,391 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:39.391] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=Actor[akka://test/user/testCreateTransaction#-863682378]] 07:04:39,391 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config35 (Candidate): Received ElectionTimeout 07:04:39,391 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config35 (Leader): Election: Leader has following peers: [] 07:04:39,392 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config35 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:39,392 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config35: onLeadershipChange, isLeader: true, hasLeader : true 07:04:39,392 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config35: became leader with frontend state for [] 07:04:39,392 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config35 , received role change from Candidate to Leader 07:04:39,463 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config35: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:39,463 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config35: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:39,463 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config35: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:39,463 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config35: Creating transaction : member-1-ShardTransactionTest-fe-0-txn-167-0 07:04:39,464 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testCreateTransaction/shard-inventory-member-1:ShardTransactionTest@0:167_2#-1713526673] [WARN] [01/22/2024 07:04:39.464] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransaction/shard-inventory-member-1:ShardTransactionTest@0:167_2#-1713526673]: org.opendaylight.controller.cluster.common.actor.Monitor@496cf5b2 07:04:39,465 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testCreateTransaction#-863682378] 07:04:39,466 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config35: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:39,466 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config35: Moving last applied index from -1 to 0 07:04:39,466 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config35: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:39,466 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config35: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:39,466 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendMetadata - member-1-shard-inventory-config35: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:39,466 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config35: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=3536915} is already disabled 07:04:39,466 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config35: Persisting ApplyJournalEntries with index=0 07:04:39,476 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Stopping Shard member-1-shard-inventory-config35 07:04:39,476 AM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageSlicer - member-1-shard-inventory-config35 (Leader)_slicer-id-657: Closing 07:04:39,476 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config35: Aborting 0 pending queued transactions 07:04:39,478 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config36, persistent : false 07:04:39,478 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config36 with journal batch size 3 [WARN] [01/22/2024 07:04:39.479] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWithPersistenceDisabled]: org.opendaylight.controller.cluster.common.actor.Monitor@45eb5752 07:04:39,479 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config36-notifier#-414408163 created and ready for shard:member-1-shard-inventory-config36 07:04:39,479 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWithPersistenceDisabled/shard-member-1:snapshot-read#-794549219] [WARN] [01/22/2024 07:04:39.479] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config36-notifier#-414408163]: org.opendaylight.controller.cluster.common.actor.Monitor@2579f3e9 [WARN] [01/22/2024 07:04:39.479] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/shard-member-1:snapshot-read#-794549219]: org.opendaylight.controller.cluster.common.actor.Monitor@f80fe6f 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config36: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: false, hasLeader : false 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config36 is no longer the leader 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36 (Follower): Received TimeoutNow - switching to Candidate 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36 (Candidate): Election: Candidate has following voting peers: [] 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: Set currentTerm=1, votedFor=member-1-shard-inventory-config36 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config36 (Candidate): Starting new election term 1 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config36 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config36 (Follower): Closing 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: false, hasLeader : false 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config36: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config36 is no longer the leader 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from null to Follower 07:04:39,480 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:39.480] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCommitWithPersistenceDisabled]] 07:04:39,481 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config36 (Candidate): Received ElectionTimeout 07:04:39,481 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config36 (Leader): Election: Leader has following peers: [] 07:04:39,481 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config36 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:39,481 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config36: onLeadershipChange, isLeader: true, hasLeader : true 07:04:39,481 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config36: became leader with frontend state for [] 07:04:39,481 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config36 , received role change from Candidate to Leader 07:04:39,588 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:39,588 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:39,588 AM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config36: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:39,588 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=86221} is already disabled 07:04:39,588 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-168-0 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: Readying Tx member-1-ShardTransactionTest-fe-0-txn-168-0 of 1 operations, client version 13 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: readying transaction member-1-ShardTransactionTest-fe-0-txn-168-0 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: transaction member-1-ShardTransactionTest-fe-0-txn-168-0 ready 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-168-0 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Validating transaction member-1-ShardTransactionTest-fe-0-txn-168-0 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-168-0 validated 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-168-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: canCommit for member-1-ShardTransactionTest-fe-0-txn-168-0: success 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: Committing transaction member-1-ShardTransactionTest-fe-0-txn-168-0 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-168-0 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-168-0 candidate ready 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-168-0: canCommit - candidate rootPath: / 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-168-0: canCommit - messages: [] 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-168-0: preCommit - successfulFromPrevious: [] 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-168-0 prepared 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-168-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-168-0 07:04:39,589 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-168-0 07:04:39,590 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:39,590 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-168-0 07:04:39,590 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-168-0: commit - successfulFromPrevious: [] 07:04:39,590 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-168-0 changing state from COMMIT_PENDING to COMMITTED 07:04:39,590 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-168-0 committed as 0, sending response to Actor[akka://test/system/testProbe-225#-2013510100] 07:04:39,590 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWithPersistenceDisabled] 07:04:39,598 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config36: Created publisher actor Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config36-DTCL-publisher#-2043773877] with name member-1-shard-inventory-config36-DTCL-publisher 07:04:39,598 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config36: Transaction member-1-ShardTransactionTest-fe-0-txn-168-0 submitted to persistence 07:04:39,598 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config36-DTCL-publisher#-2043773877] 07:04:39,598 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config36: publishChanges: rootPath: / 07:04:39,599 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config36: Elapsed time for generation of change events for member-1-shard-inventory-config36-DTCL-publisher: 68.18 μs [WARN] [01/22/2024 07:04:39.599] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWithPersistenceDisabled/member-1-shard-inventory-config36-DTCL-publisher#-2043773877]: org.opendaylight.controller.cluster.common.actor.Monitor@42e11767 07:04:39,609 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config36 07:04:39,609 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config36 (Leader)_slicer-id-659: Closing 07:04:39,610 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config36: Aborting 0 pending queued transactions 07:04:39,612 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config37, persistent : true 07:04:39,613 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config37 with journal batch size 3 [WARN] [01/22/2024 07:04:39.613] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyWithImmediateCommit-false]: org.opendaylight.controller.cluster.common.actor.Monitor@4d113119 07:04:39,613 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-false/shard-member-1:snapshot-read#1035958665] 07:04:39,613 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config37-notifier#-753040692 created and ready for shard:member-1-shard-inventory-config37 [WARN] [01/22/2024 07:04:39.613] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config37-notifier#-753040692]: org.opendaylight.controller.cluster.common.actor.Monitor@c8cda85 [WARN] [01/22/2024 07:04:39.613] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/shard-member-1:snapshot-read#1035958665]: org.opendaylight.controller.cluster.common.actor.Monitor@52865f59 07:04:39,614 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:39,614 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config37: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:39,614 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: false, hasLeader : false 07:04:39,614 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config37 is no longer the leader 07:04:39,615 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37 (Follower): Received TimeoutNow - switching to Candidate 07:04:39,615 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37 (Candidate): Election: Candidate has following voting peers: [] 07:04:39,615 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37: Set currentTerm=1, votedFor=member-1-shard-inventory-config37 07:04:39,615 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config37 (Candidate): Starting new election term 1 07:04:39,615 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config37 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:39,615 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config37 (Follower): Closing 07:04:39,615 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: false, hasLeader : false 07:04:39,615 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config37 is no longer the leader 07:04:39,615 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from null to Follower 07:04:39,615 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:39.615] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testReadyWithImmediateCommit-false]] 07:04:39,615 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config37 (Candidate): Received ElectionTimeout 07:04:39,615 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config37 (Leader): Election: Leader has following peers: [] 07:04:39,615 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config37 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:39,615 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config37: onLeadershipChange, isLeader: true, hasLeader : true 07:04:39,616 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config37: became leader with frontend state for [] 07:04:39,616 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config37 , received role change from Candidate to Leader 07:04:39,692 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:39,692 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:39,692 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:39,692 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-169-0 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Readying Tx member-1-ShardTransactionTest-fe-0-txn-169-0 of 1 operations, client version 13 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: readying transaction member-1-ShardTransactionTest-fe-0-txn-169-0 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: transaction member-1-ShardTransactionTest-fe-0-txn-169-0 ready 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Validating transaction member-1-ShardTransactionTest-fe-0-txn-169-0 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-169-0 validated 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-169-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: canCommit for member-1-ShardTransactionTest-fe-0-txn-169-0: success 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Committing transaction member-1-ShardTransactionTest-fe-0-txn-169-0 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-169-0 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-169-0 candidate ready 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-169-0: canCommit - candidate rootPath: / 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-169-0: canCommit - messages: [] 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-169-0: preCommit - successfulFromPrevious: [] 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-169-0 prepared 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-169-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-169-0 07:04:39,693 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-169-0 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-169-0 submitted to persistence 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Moving last applied index from -1 to 0 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] FrontendMetadata - member-1-shard-inventory-config37: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2183394} is already disabled 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Moving last applied index from 0 to 1 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Applying state for log index 1 data Simple{size=143} 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config37: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-169-0 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-169-0: commit - successfulFromPrevious: [] 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-169-0 changing state from COMMIT_PENDING to COMMITTED 07:04:39,694 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Transaction member-1-ShardTransactionTest-fe-0-txn-169-0 committed as 0, sending response to Actor[akka://test/system/testProbe-227#-364822166] 07:04:39,695 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyWithImmediateCommit-false] 07:04:39,695 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config37: Created publisher actor Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config37-DTCL-publisher#-1924593623] with name member-1-shard-inventory-config37-DTCL-publisher 07:04:39,695 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config37-DTCL-publisher#-1924593623] 07:04:39,695 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config37: publishChanges: rootPath: / 07:04:39,695 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config37: Elapsed time for generation of change events for member-1-shard-inventory-config37-DTCL-publisher: 42.73 μs 07:04:39,696 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: fakeSnapshot purging log to 0 for term 1 07:04:39,696 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Persisting ApplyJournalEntries with index=0 07:04:39,696 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config37: Persisting ApplyJournalEntries with index=1 [WARN] [01/22/2024 07:04:39.696] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyWithImmediateCommit-false/member-1-shard-inventory-config37-DTCL-publisher#-1924593623]: org.opendaylight.controller.cluster.common.actor.Monitor@76bfeee5 07:04:39,705 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config37 07:04:39,705 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config37 (Leader)_slicer-id-661: Closing 07:04:39,705 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config37: Aborting 0 pending queued transactions 07:04:39,708 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 07:04:39,708 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,709 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,709 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,709 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,709 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,710 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,710 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,710 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,710 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,710 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,711 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,711 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,711 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,711 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,712 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,712 AM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 07:04:39,713 AM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - Shard created : member-1-shard-inventory-config38, persistent : true 07:04:39,713 AM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - Starting recovery for member-1-shard-inventory-config38 with journal batch size 3 [WARN] [01/22/2024 07:04:39.713] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRecovery]: org.opendaylight.controller.cluster.common.actor.Monitor@6c5369d0 07:04:39,714 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testRecovery/member-1-shard-inventory-config38-notifier#-1756487785 created and ready for shard:member-1-shard-inventory-config38 07:04:39,714 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#1583419339] [WARN] [01/22/2024 07:04:39.714] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config38-notifier#-1756487785]: org.opendaylight.controller.cluster.common.actor.Monitor@1e65596b [WARN] [01/22/2024 07:04:39.714] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#1583419339]: org.opendaylight.controller.cluster.common.actor.Monitor@5e56c65f 07:04:39,714 AM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#1546461747] 07:04:39,714 AM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: SnapshotOffer called. 07:04:39,714 AM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Moving last applied index from -1 to -1 07:04:39,714 AM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Set currentTerm=1, votedFor=null 07:04:39,714 AM [test-akka.actor.default-dispatcher-13] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Applying recovered snapshot 07:04:39,714 AM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config38: clearing clients {} 07:04:39,715 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config38: Created publisher actor Actor[akka://test/user/testRecovery/member-1-shard-inventory-config38-DTCL-publisher#396117248] with name member-1-shard-inventory-config38-DTCL-publisher 07:04:39,715 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config38: state snapshot applied in 413.6 μs 07:04:39,715 AM [test-akka.actor.default-dispatcher-13] [INFO] AbstractShardTest$1 - Recovery snapshot applied for member-1-shard-inventory-config38 in 534.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 07:04:39,715 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testRecovery/member-1-shard-inventory-config38-DTCL-publisher#396117248] 07:04:39,715 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config38: publishChanges: rootPath: / 07:04:39,715 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config38: Elapsed time for generation of change events for member-1-shard-inventory-config38-DTCL-publisher: 60.51 μs [WARN] [01/22/2024 07:04:39.715] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config38-DTCL-publisher#396117248]: org.opendaylight.controller.cluster.common.actor.Monitor@5f12ffd2 07:04:39,717 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,717 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 0, size: 45 07:04:39,717 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,717 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 1, size: 184 07:04:39,717 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,717 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 2, size: 184 07:04:39,717 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,717 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 3, size: 184 07:04:39,717 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,717 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 4, size: 184 07:04:39,717 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,717 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 5, size: 184 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 6, size: 184 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 7, size: 184 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 8, size: 184 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 9, size: 184 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 10, size: 184 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 11, size: 184 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 12, size: 184 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 13, size: 184 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 14, size: 184 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 15, size: 184 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received ReplicatedLogEntry for recovery: index: 16, size: 184 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Received apply journal entries for recovery, applying to state: 0 to 16 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: starting log recovery batch with max size 3 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendMetadata - member-1-shard-inventory-config38: Added client Enabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@6cdccdc7}, purged=MutableUnsignedLongSet{size=0}} 07:04:39,719 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-170-0 07:04:39,720 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-171-0 07:04:39,720 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-172-0 07:04:39,720 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: starting log recovery batch with max size 3 07:04:39,720 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-173-0 07:04:39,720 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-174-0 07:04:39,720 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-175-0 07:04:39,720 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: starting log recovery batch with max size 3 07:04:39,720 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-176-0 07:04:39,720 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-177-0 07:04:39,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-178-0 07:04:39,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: starting log recovery batch with max size 3 07:04:39,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-179-0 07:04:39,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-180-0 07:04:39,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-181-0 07:04:39,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: starting log recovery batch with max size 3 07:04:39,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-182-0 07:04:39,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-183-0 07:04:39,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-184-0 07:04:39,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: starting log recovery batch with max size 3 07:04:39,721 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-185-0 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config38: Committed transaction member-1-ShardTransactionTest-fe-0-txn-186-0 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Moving last applied index from -1 to 16 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config38: Recovery completed in 7.530 ms - Switching actor to Follower - last log index = 16, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 17 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: false, hasLeader : false 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config38 is no longer the leader 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38 (Follower): Received TimeoutNow - switching to Candidate 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38 (Candidate): Election: Candidate has following voting peers: [] 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Set currentTerm=2, votedFor=member-1-shard-inventory-config38 07:04:39,722 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from null to Follower 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config38 (Candidate): Starting new election term 2 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config38 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config38 (Follower): Closing 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: false, hasLeader : false 07:04:39,722 AM [test-akka.actor.default-dispatcher-18] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config38 is no longer the leader 07:04:39,722 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:39.722] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testRecovery]] 07:04:39,722 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38 (Candidate): Received ElectionTimeout 07:04:39,722 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38 (Leader): Election: Leader has following peers: [] 07:04:39,722 AM [test-akka.actor.default-dispatcher-7] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config38 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 07:04:39,722 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config38: onLeadershipChange, isLeader: true, hasLeader : true 07:04:39,723 AM [test-akka.actor.default-dispatcher-7] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: became leader with frontend state for [member-1-frontend-ShardTransactionTest] 07:04:39,723 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config38 , received role change from Candidate to Leader 07:04:39,723 AM [test-akka.actor.default-dispatcher-8] [INFO] AbstractShardTest$1 - Stopping Shard member-1-shard-inventory-config38 07:04:39,723 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageSlicer - member-1-shard-inventory-config38 (Leader)_slicer-id-663: Closing 07:04:39,723 AM [test-akka.actor.default-dispatcher-8] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config38: Aborting 0 pending queued transactions 07:04:39,724 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Shard created : member-1-shard-inventory-config39, persistent : true 07:04:39,724 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - Starting recovery for member-1-shard-inventory-config39 with journal batch size 3 [WARN] [01/22/2024 07:04:39.725] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testAbortAfterReady]: org.opendaylight.controller.cluster.common.actor.Monitor@7dd39021 07:04:39,725 AM [test-akka.actor.default-dispatcher-18] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testAbortAfterReady/member-1-shard-inventory-config39-notifier#1694047118 created and ready for shard:member-1-shard-inventory-config39 07:04:39,725 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-1237556176] [WARN] [01/22/2024 07:04:39.725] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config39-notifier#1694047118]: org.opendaylight.controller.cluster.common.actor.Monitor@7bbf1d35 [WARN] [01/22/2024 07:04:39.725] [test-akka.actor.default-dispatcher-18] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/shard-member-1:snapshot-read#-1237556176]: org.opendaylight.controller.cluster.common.actor.Monitor@6f861890 07:04:39,725 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config39: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:39,725 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config39: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:39,725 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: false, hasLeader : false 07:04:39,725 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config39: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config39 is no longer the leader 07:04:39,725 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from null to Follower 07:04:39,725 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config39 (Follower): Received TimeoutNow - switching to Candidate 07:04:39,725 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config39 (Candidate): Election: Candidate has following voting peers: [] 07:04:39,725 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config39: Set currentTerm=1, votedFor=member-1-shard-inventory-config39 07:04:39,725 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config39 (Candidate): Starting new election term 1 07:04:39,725 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config39 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:39,725 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config39 (Follower): Closing 07:04:39,725 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: false, hasLeader : false 07:04:39,725 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config39: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config39 is no longer the leader 07:04:39,725 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:39.725] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testAbortAfterReady]] 07:04:39,726 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config39 (Candidate): Received ElectionTimeout 07:04:39,726 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config39 (Leader): Election: Leader has following peers: [] 07:04:39,726 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config39 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:39,726 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config39: onLeadershipChange, isLeader: true, hasLeader : true 07:04:39,726 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config39: became leader with frontend state for [] 07:04:39,726 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config39 , received role change from Candidate to Leader 07:04:39,786 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:39,786 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:39,786 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:39,786 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-187-0 07:04:39,786 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Readying Tx member-1-ShardTransactionTest-fe-0-txn-187-0 of 1 operations, client version 13 07:04:39,786 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: readying transaction member-1-ShardTransactionTest-fe-0-txn-187-0 07:04:39,786 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: transaction member-1-ShardTransactionTest-fe-0-txn-187-0 ready 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-188-0 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Readying Tx member-1-ShardTransactionTest-fe-0-txn-188-0 of 1 operations, client version 13 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: readying transaction member-1-ShardTransactionTest-fe-0-txn-188-0 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: transaction member-1-ShardTransactionTest-fe-0-txn-188-0 ready 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-189-0 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Readying Tx member-1-ShardTransactionTest-fe-0-txn-189-0 of 1 operations, client version 13 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: readying transaction member-1-ShardTransactionTest-fe-0-txn-189-0 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: transaction member-1-ShardTransactionTest-fe-0-txn-189-0 ready 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Moving last applied index from -1 to 0 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendMetadata - member-1-shard-inventory-config39: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:39,787 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1357290} is already disabled 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Aborting transaction member-1-ShardTransactionTest-fe-0-txn-188-0 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: aborting queued transaction member-1-ShardTransactionTest-fe-0-txn-188-0 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-188-0: abort - successfulFromPrevious: [] 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Persisting ApplyJournalEntries with index=0 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-187-0 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Validating transaction member-1-ShardTransactionTest-fe-0-txn-187-0 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-187-0 validated 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-187-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: canCommit for member-1-ShardTransactionTest-fe-0-txn-187-0: success 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Committing transaction member-1-ShardTransactionTest-fe-0-txn-187-0 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-187-0 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-187-0 candidate ready 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-187-0: canCommit - candidate rootPath: / 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-187-0: canCommit - messages: [] 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-187-0: preCommit - successfulFromPrevious: [] 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-187-0 prepared 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-187-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-187-0 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-187-0 07:04:39,788 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-187-0 submitted to persistence 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Moving last applied index from 0 to 1 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Applying state for log index 1 data Simple{size=143} 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-187-0 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-187-0: commit - successfulFromPrevious: [] 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-187-0 changing state from COMMIT_PENDING to COMMITTED 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-187-0 committed as 0, sending response to Actor[akka://test/system/testProbe-229#408939854] 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config39: Created publisher actor Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config39-DTCL-publisher#1690209777] with name member-1-shard-inventory-config39-DTCL-publisher 07:04:39,789 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config39-DTCL-publisher#1690209777] 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-189-0 07:04:39,789 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Validating transaction member-1-ShardTransactionTest-fe-0-txn-189-0 07:04:39,789 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config39: publishChanges: rootPath: / 07:04:39,790 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-189-0 validated 07:04:39,790 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-189-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:39,790 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: canCommit for member-1-ShardTransactionTest-fe-0-txn-189-0: success 07:04:39,790 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: fakeSnapshot purging log to 0 for term 1 07:04:39,790 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config39: Elapsed time for generation of change events for member-1-shard-inventory-config39-DTCL-publisher: 91.75 μs 07:04:39,790 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config39: Persisting ApplyJournalEntries with index=1 [WARN] [01/22/2024 07:04:39.790] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testAbortAfterReady/member-1-shard-inventory-config39-DTCL-publisher#1690209777]: org.opendaylight.controller.cluster.common.actor.Monitor@7aff5e97 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config39: Committing transaction member-1-ShardTransactionTest-fe-0-txn-189-0 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-189-0 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-189-0 candidate ready 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-189-0: canCommit - candidate rootPath: / 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeCohortActorRegistry - Skipping unmodified candidate / 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-189-0: canCommit - messages: [] 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-189-0: preCommit - successfulFromPrevious: [] 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-189-0 prepared 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-189-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config39: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-189-0 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-189-0 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config39: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config39: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 07:04:39,792 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-189-0 submitted to persistence 07:04:39,793 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=45}] 07:04:39,793 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Moving last applied index from 1 to 2 07:04:39,793 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Applying state for log index 2 data Simple{size=45} 07:04:39,793 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config39: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-189-0 07:04:39,793 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-189-0: commit - successfulFromPrevious: [] 07:04:39,793 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-189-0 changing state from COMMIT_PENDING to COMMITTED 07:04:39,793 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Transaction member-1-ShardTransactionTest-fe-0-txn-189-0 committed as 0, sending response to Actor[akka://test/system/testProbe-229#408939854] 07:04:39,793 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testAbortAfterReady] 07:04:39,793 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config39: publishChanges: rootPath: / 07:04:39,793 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: fakeSnapshot purging log to 1 for term 1 07:04:39,793 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config39: Elapsed time for generation of change events for member-1-shard-inventory-config39-DTCL-publisher: 19.63 μs 07:04:39,793 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Persisting ApplyJournalEntries with index=2 07:04:39,804 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config39 07:04:39,804 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config39 (Leader)_slicer-id-665: Closing 07:04:39,804 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config39: Aborting 0 pending queued transactions 07:04:39,807 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config40, persistent : true [WARN] [01/22/2024 07:04:39.807] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false]: org.opendaylight.controller.cluster.common.actor.Monitor@6bb8c0b6 07:04:39,808 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config40-notifier#787381741 created and ready for shard:member-1-shard-inventory-config40 [WARN] [01/22/2024 07:04:39.808] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config40-notifier#787381741]: org.opendaylight.controller.cluster.common.actor.Monitor@452e9fb2 07:04:39,808 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/shard-member-1:snapshot-read#1324276726] [WARN] [01/22/2024 07:04:39.808] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/shard-member-1:snapshot-read#1324276726]: org.opendaylight.controller.cluster.common.actor.Monitor@249c7760 07:04:39,808 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config40 with journal batch size 3 07:04:39,809 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:39,809 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config40: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:39,809 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: false, hasLeader : false 07:04:39,809 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config40 is no longer the leader 07:04:39,810 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from null to Follower 07:04:39,810 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40 (Follower): Received TimeoutNow - switching to Candidate 07:04:39,810 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40 (Candidate): Election: Candidate has following voting peers: [] 07:04:39,810 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: Set currentTerm=1, votedFor=member-1-shard-inventory-config40 07:04:39,810 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config40 (Candidate): Starting new election term 1 07:04:39,810 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config40 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:39,810 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config40 (Follower): Closing 07:04:39,810 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: false, hasLeader : false 07:04:39,810 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config40 is no longer the leader 07:04:39,810 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:39.810] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false]] 07:04:39,810 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40 (Candidate): Received ElectionTimeout 07:04:39,810 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40 (Leader): Election: Leader has following peers: [] 07:04:39,810 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config40 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:39,810 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config40: onLeadershipChange, isLeader: true, hasLeader : true 07:04:39,810 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: became leader with frontend state for [] 07:04:39,810 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config40 , received role change from Candidate to Leader 07:04:39,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:39,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:39,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:39,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-190-0 07:04:39,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Readying Tx member-1-ShardTransactionTest-fe-0-txn-190-0 of 1 operations, client version 13 07:04:39,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: readying transaction member-1-ShardTransactionTest-fe-0-txn-190-0 07:04:39,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: transaction member-1-ShardTransactionTest-fe-0-txn-190-0 ready 07:04:39,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-190-0 07:04:39,918 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Validating transaction member-1-ShardTransactionTest-fe-0-txn-190-0 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Transaction member-1-ShardTransactionTest-fe-0-txn-190-0 validated 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-190-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: canCommit for member-1-ShardTransactionTest-fe-0-txn-190-0: success 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Committing transaction member-1-ShardTransactionTest-fe-0-txn-190-0 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-190-0 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Transaction member-1-ShardTransactionTest-fe-0-txn-190-0 candidate ready 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-190-0: canCommit - candidate rootPath: / 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-190-0: canCommit - messages: [] 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-190-0: preCommit - successfulFromPrevious: [] 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Transaction member-1-ShardTransactionTest-fe-0-txn-190-0 prepared 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-190-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-190-0 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-190-0 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Transaction member-1-ShardTransactionTest-fe-0-txn-190-0 submitted to persistence 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Moving last applied index from -1 to 0 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config40: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:39,919 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config40: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1802388} is already disabled 07:04:39,919 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40: Persisting ApplyJournalEntries with index=0 07:04:39,920 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:39,920 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40: Moving last applied index from 0 to 1 07:04:39,920 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40: Applying state for log index 1 data Simple{size=143} 07:04:39,920 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config40: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-190-0 07:04:39,920 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-190-0: commit - successfulFromPrevious: [] 07:04:39,920 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-190-0 changing state from COMMIT_PENDING to COMMITTED 07:04:39,920 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40: Transaction member-1-ShardTransactionTest-fe-0-txn-190-0 committed as 0, sending response to Actor[akka://test/system/testProbe-231#486498337] 07:04:39,920 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config40: Created publisher actor Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config40-DTCL-publisher#1319612121] with name member-1-shard-inventory-config40-DTCL-publisher 07:04:39,920 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config40-DTCL-publisher#1319612121] 07:04:39,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config40: publishChanges: rootPath: / 07:04:39,921 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40: fakeSnapshot purging log to 0 for term 1 07:04:39,921 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config40: Persisting ApplyJournalEntries with index=1 07:04:39,921 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config40: Elapsed time for generation of change events for member-1-shard-inventory-config40-DTCL-publisher: 44.22 μs [WARN] [01/22/2024 07:04:39.921] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCommitWhenTransactionHasModifications-false/member-1-shard-inventory-config40-DTCL-publisher#1319612121]: org.opendaylight.controller.cluster.common.actor.Monitor@6bb8e04a 07:04:40,122 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCommitWhenTransactionHasModifications-false] 07:04:40,133 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Stopping Shard member-1-shard-inventory-config40 07:04:40,133 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config40 (Leader)_slicer-id-667: Closing 07:04:40,133 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config40: Aborting 0 pending queued transactions 07:04:40,135 AM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1TestShard - Shard created : member-1-shard-inventory-config41, persistent : false [WARN] [01/22/2024 07:04:40.135] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData]: org.opendaylight.controller.cluster.common.actor.Monitor@786049d1 07:04:40,136 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config41-notifier#-1057880171 created and ready for shard:member-1-shard-inventory-config41 [WARN] [01/22/2024 07:04:40.136] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config41-notifier#-1057880171]: org.opendaylight.controller.cluster.common.actor.Monitor@5802b15 07:04:40,136 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/shard-member-1:snapshot-read#-1366448400] [WARN] [01/22/2024 07:04:40.136] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/shard-member-1:snapshot-read#-1366448400]: org.opendaylight.controller.cluster.common.actor.Monitor@bacd3ec 07:04:40,136 AM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1TestShard - Starting recovery for member-1-shard-inventory-config41 with journal batch size 3 07:04:40,137 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:40,137 AM [test-akka.actor.default-dispatcher-8] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:40,137 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: false, hasLeader : false 07:04:40,137 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config41 is no longer the leader 07:04:40,137 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from null to Follower 07:04:40,137 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41 (Follower): Received TimeoutNow - switching to Candidate 07:04:40,138 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41 (Candidate): Election: Candidate has following voting peers: [] 07:04:40,138 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Set currentTerm=1, votedFor=member-1-shard-inventory-config41 07:04:40,138 AM [test-akka.actor.default-dispatcher-8] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41 (Candidate): Starting new election term 1 07:04:40,138 AM [test-akka.actor.default-dispatcher-8] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:40,138 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageAssembler - member-1-shard-inventory-config41 (Follower): Closing 07:04:40,138 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: false, hasLeader : false 07:04:40,138 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config41 is no longer the leader 07:04:40,138 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from Follower to Candidate 07:04:40,138 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41 (Candidate): Received ElectionTimeout 07:04:40,138 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41 (Leader): Election: Leader has following peers: [] 07:04:40,138 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:40,138 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config41: onLeadershipChange, isLeader: true, hasLeader : true 07:04:40,138 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: became leader with frontend state for [] 07:04:40,138 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config41 , received role change from Candidate to Leader [WARN] [01/22/2024 07:04:40.139] [test-akka.actor.default-dispatcher-8] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData]] 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config41: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=96852} is already disabled 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-191-0 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Readying Tx member-1-ShardTransactionTest-fe-0-txn-191-0 of 1 operations, client version 13 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: readying transaction member-1-ShardTransactionTest-fe-0-txn-191-0 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: transaction member-1-ShardTransactionTest-fe-0-txn-191-0 ready 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Validating transaction member-1-ShardTransactionTest-fe-0-txn-191-0 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-191-0 validated 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-191-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: canCommit for member-1-ShardTransactionTest-fe-0-txn-191-0: success 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Committing transaction member-1-ShardTransactionTest-fe-0-txn-191-0 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-191-0 07:04:40,142 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-191-0 candidate ready 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-191-0: canCommit - candidate rootPath: / 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-191-0: canCommit - messages: [] 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-191-0: preCommit - successfulFromPrevious: [] 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-191-0 prepared 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-191-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-191-0 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-191-0 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-191-0 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-191-0: commit - successfulFromPrevious: [] 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-191-0 changing state from COMMIT_PENDING to COMMITTED 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-191-0 committed as 0, sending response to Actor[akka://test/temp/testCreateSnapshotWithNonPersistentData$g] 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config41: Created publisher actor Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config41-DTCL-publisher#207240616] with name member-1-shard-inventory-config41-DTCL-publisher 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config41: Transaction member-1-ShardTransactionTest-fe-0-txn-191-0 submitted to persistence 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config41-DTCL-publisher#207240616] 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config41: publishChanges: rootPath: / 07:04:40,143 AM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 07:04:40,143 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config41: Elapsed time for generation of change events for member-1-shard-inventory-config41-DTCL-publisher: 31.01 μs 07:04:40,143 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: lastSequenceNumber prior to capture: -1 [WARN] [01/22/2024 07:04:40.143] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateSnapshotWithNonPersistentData/member-1-shard-inventory-config41-DTCL-publisher#207240616]: org.opendaylight.controller.cluster.common.actor.Monitor@64a466b4 07:04:40,144 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 07:04:40,144 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: CaptureSnapshotReply received by actor 07:04:40,144 AM [test-akka.actor.default-dispatcher-8] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@18289e63, electionTerm=1, electionVotedFor=member-1-shard-inventory-config41, ServerConfigPayload=null] 07:04:40,144 AM [test-akka.actor.default-dispatcher-8] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 07:04:40,144 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Snapshot success - sequence number: -1 07:04:40,144 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: SnapshotComplete received 07:04:40,144 AM [main] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Initiating snapshot capture CaptureSnapshot [lastAppliedIndex=0, lastAppliedTerm=0, lastIndex=0, lastTerm=0, installSnapshotInitiated=, replicatedToAllIndex=-1, replicatedToAllTerm=-1, unAppliedEntries size=0, mandatoryTrim=false] 07:04:40,144 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: lastSequenceNumber prior to capture: -1 07:04:40,144 AM [main] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: requesting serialization of snapshot MetadataShardDataTreeSnapshot{metadata={class org.opendaylight.controller.cluster.datastore.persisted.FrontendShardDataTreeSnapshotMetadata=FrontendShardDataTreeSnapshotMetadata{clients=[FrontendClientMetadata{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current=[], purged=ImmutableUnsignedLongSet{size=0}}]}}} 07:04:40,144 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: CaptureSnapshotReply received by actor 07:04:40,144 AM [test-akka.actor.default-dispatcher-8] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Persisting of snapshot done: Snapshot [lastIndex=0, lastTerm=0, lastAppliedIndex=0, lastAppliedTerm=0, unAppliedEntries size=0, state=org.opendaylight.controller.cluster.datastore.persisted.ShardSnapshotState@f22ee76, electionTerm=1, electionVotedFor=member-1-shard-inventory-config41, ServerConfigPayload=null] 07:04:40,144 AM [test-akka.actor.default-dispatcher-8] [INFO] ShardTest$1TestShard - member-1-shard-inventory-config41: Removed in-memory snapshotted entries, adjusted snaphsotIndex: -1 and term: -1 07:04:40,144 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Snapshot success - sequence number: -1 07:04:40,144 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: SnapshotComplete received 07:04:40,144 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testCreateSnapshotWithNonPersistentData] 07:04:40,155 AM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1TestShard - Stopping Shard member-1-shard-inventory-config41 07:04:40,155 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageSlicer - member-1-shard-inventory-config41 (Leader)_slicer-id-669: Closing 07:04:40,155 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1TestShard - member-1-shard-inventory-config41: Aborting 0 pending queued transactions 07:04:40,156 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config42, persistent : true [WARN] [01/22/2024 07:04:40.156] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.common.actor.Monitor@6ac8115c 07:04:40,157 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testFollowerInitialSyncStatus/member-1-shard-inventory-config42-notifier#1039224862 created and ready for shard:member-1-shard-inventory-config42 [WARN] [01/22/2024 07:04:40.157] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testFollowerInitialSyncStatus/member-1-shard-inventory-config42-notifier#1039224862]: org.opendaylight.controller.cluster.common.actor.Monitor@3d46fd8a 07:04:40,157 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testFollowerInitialSyncStatus/shard-member-1:snapshot-read#-1777747580] [WARN] [01/22/2024 07:04:40.157] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testFollowerInitialSyncStatus/shard-member-1:snapshot-read#-1777747580]: org.opendaylight.controller.cluster.common.actor.Monitor@4cc78dc6 07:04:40,157 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config42 with journal batch size 3 07:04:40,158 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testFollowerInitialSyncStatus] [WARN] [01/22/2024 07:04:40.158] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@6b8f7942 [WARN] [01/22/2024 07:04:40.158] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from TestActor[akka://test/user/testFollowerInitialSyncStatus]: org.opendaylight.controller.cluster.raft.base.messages.FollowerInitialSyncUpStatus@3b959fdf 07:04:40,159 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config42: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:40,159 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config42: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:40,159 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: false, hasLeader : false 07:04:40,159 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config42: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config42 is no longer the leader [WARN] [01/22/2024 07:04:40.159] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testFollowerInitialSyncStatus]] 07:04:40,159 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from null to Follower 07:04:40,159 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config42 (Follower): Received TimeoutNow - switching to Candidate 07:04:40,159 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config42 (Candidate): Election: Candidate has following voting peers: [] 07:04:40,159 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config42: Set currentTerm=1, votedFor=member-1-shard-inventory-config42 07:04:40,159 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config42 (Candidate): Starting new election term 1 07:04:40,159 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config42 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:40,159 AM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config42 (Follower): Closing 07:04:40,159 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: false, hasLeader : false 07:04:40,159 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config42: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config42 is no longer the leader 07:04:40,160 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from Follower to Candidate 07:04:40,166 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config42 (Candidate): Received ElectionTimeout 07:04:40,166 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config42 (Leader): Election: Leader has following peers: [] 07:04:40,166 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config42 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:40,166 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config42: onLeadershipChange, isLeader: true, hasLeader : true 07:04:40,167 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config42: became leader with frontend state for [] 07:04:40,167 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config42 , received role change from Candidate to Leader 07:04:40,173 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - Stopping Shard member-1-shard-inventory-config42 07:04:40,173 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageSlicer - member-1-shard-inventory-config42 (Leader)_slicer-id-671: Closing 07:04:40,173 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config42: Aborting 0 pending queued transactions 07:04:40,176 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#-1456224635] [WARN] [01/22/2024 07:04:40.177] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#-1456224635]: org.opendaylight.controller.cluster.common.actor.Monitor@24e4ab0b [WARN] [01/22/2024 07:04:40.177] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]: org.opendaylight.controller.cluster.common.actor.Monitor@54bdbbec 07:04:40,177 AM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1$1 - Shard created : member-1-shard-inventory-config43, persistent : true 07:04:40,178 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config43-notifier#1224267717 created and ready for shard:member-1-shard-inventory-config43 [WARN] [01/22/2024 07:04:40.178] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config43-notifier#1224267717]: org.opendaylight.controller.cluster.common.actor.Monitor@70de6f18 07:04:40,178 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/shard-member-1:snapshot-read#-1934670394] [WARN] [01/22/2024 07:04:40.178] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/shard-member-1:snapshot-read#-1934670394]: org.opendaylight.controller.cluster.common.actor.Monitor@22ebf8aa 07:04:40,178 AM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1$1 - Starting recovery for member-1-shard-inventory-config43 with journal batch size 3 07:04:40,178 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#1546461747] 07:04:40,178 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: SnapshotOffer called. 07:04:40,178 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: Moving last applied index from -1 to -1 07:04:40,178 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: Set currentTerm=1, votedFor=null 07:04:40,178 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: Applying recovered snapshot 07:04:40,178 AM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config43: clearing clients {} 07:04:40,178 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config43: Created publisher actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config43-DTCL-publisher#-830983145] with name member-1-shard-inventory-config43-DTCL-publisher 07:04:40,179 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config43-DTCL-publisher#-830983145] 07:04:40,179 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config43: publishChanges: rootPath: / 07:04:40,179 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config43: state snapshot applied in 229.9 μs 07:04:40,179 AM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1$1 - Recovery snapshot applied for member-1-shard-inventory-config43 in 333.4 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 07:04:40,179 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config43: Elapsed time for generation of change events for member-1-shard-inventory-config43-DTCL-publisher: 51.39 μs [WARN] [01/22/2024 07:04:40.179] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config43-DTCL-publisher#-830983145]: org.opendaylight.controller.cluster.common.actor.Monitor@4ecfd1ca 07:04:40,179 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:40,179 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1$1 - member-1-shard-inventory-config43: Recovery completed in 715.2 μs - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:40,179 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: false, hasLeader : false 07:04:40,179 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config43 is no longer the leader 07:04:40,179 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from null to Follower 07:04:40,179 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43 (Follower): Received TimeoutNow - switching to Candidate 07:04:40,179 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43 (Candidate): Election: Candidate has following voting peers: [] 07:04:40,179 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: Set currentTerm=2, votedFor=member-1-shard-inventory-config43 07:04:40,179 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1$1 - member-1-shard-inventory-config43 (Candidate): Starting new election term 2 07:04:40,179 AM [test-akka.actor.default-dispatcher-14] [INFO] ShardTest$1$1 - member-1-shard-inventory-config43 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 07:04:40,179 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config43 (Follower): Closing 07:04:40,179 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: false, hasLeader : false 07:04:40,179 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config43 is no longer the leader 07:04:40,179 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:40.179] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 07:04:40,190 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#-1456224635]], isLeader: false, hasLeader: false 07:04:40,190 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: Shard does not have a leader - delaying registration 07:04:40,190 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a 07:04:40,191 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a#1597794103] [WARN] [01/22/2024 07:04:40.191] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/$a#1597794103]: org.opendaylight.controller.cluster.common.actor.Monitor@8bca93b 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43 (Candidate): Received ElectionTimeout 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43 (Leader): Election: Leader has following peers: [] 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [INFO] ShardTest$1$1 - member-1-shard-inventory-config43 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: onLeadershipChange, isLeader: true, hasLeader : true 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config43: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config43: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]], initialState present=true] to publisher actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration/member-1-shard-inventory-config43-DTCL-publisher#-830983145] 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: became leader with frontend state for [] 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config43: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@a0ecc50 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config43: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]], initialState present=true] 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config43: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config43: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)] 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config43: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener)], sending actor=TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration]] 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config43 , received role change from Candidate to Leader 07:04:40,191 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config43: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@a0ecc50 07:04:40,191 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration-DataChangeListener#-1456224635] 07:04:40,202 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testDataTreeChangeListenerNotifiedWhenNotTheLeaderOnRegistration] 07:04:40,202 AM [test-akka.actor.default-dispatcher-8] [INFO] ShardTest$1$1 - Stopping Shard member-1-shard-inventory-config43 07:04:40,202 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageSlicer - member-1-shard-inventory-config43 (Leader)_slicer-id-673: Closing 07:04:40,202 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardTest$1$1 - member-1-shard-inventory-config43: Aborting 0 pending queued transactions 07:04:40,203 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Shard created : member-1-shard-inventory-config44, persistent : true 07:04:40,204 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - Starting recovery for member-1-shard-inventory-config44 with journal batch size 3 [WARN] [01/22/2024 07:04:40.204] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@58cc94e 07:04:40,205 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config44-notifier#-576985441 created and ready for shard:member-1-shard-inventory-config44 07:04:40,205 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/shard-member-1:snapshot-read#726384454] [WARN] [01/22/2024 07:04:40.205] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config44-notifier#-576985441]: org.opendaylight.controller.cluster.common.actor.Monitor@387daea0 [WARN] [01/22/2024 07:04:40.205] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/shard-member-1:snapshot-read#726384454]: org.opendaylight.controller.cluster.common.actor.Monitor@1993b6be 07:04:40,205 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config44: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:40,205 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config44: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:40,205 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: false, hasLeader : false 07:04:40,205 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config44: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config44 is no longer the leader 07:04:40,205 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from null to Follower 07:04:40,205 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config44 (Follower): Received TimeoutNow - switching to Candidate 07:04:40,206 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config44 (Candidate): Election: Candidate has following voting peers: [] 07:04:40,206 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config44: Set currentTerm=1, votedFor=member-1-shard-inventory-config44 07:04:40,206 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config44 (Candidate): Starting new election term 1 07:04:40,206 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config44 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:40,206 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageAssembler - member-1-shard-inventory-config44 (Follower): Closing 07:04:40,206 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: false, hasLeader : false 07:04:40,206 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config44: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config44 is no longer the leader 07:04:40,206 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:40.206] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit]] 07:04:40,206 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config44 (Candidate): Received ElectionTimeout 07:04:40,206 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config44 (Leader): Election: Leader has following peers: [] 07:04:40,206 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config44 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:40,206 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config44: onLeadershipChange, isLeader: true, hasLeader : true 07:04:40,206 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config44: became leader with frontend state for [] 07:04:40,206 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config44 , received role change from Candidate to Leader 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-192-0 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-192-0 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Validating transaction member-1-ShardTransactionTest-fe-0-txn-192-0 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-192-0 validated 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-192-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: canCommit for member-1-ShardTransactionTest-fe-0-txn-192-0: success 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Committing transaction member-1-ShardTransactionTest-fe-0-txn-192-0 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-192-0 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-192-0 candidate ready 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-192-0: canCommit - candidate rootPath: / 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-192-0: canCommit - messages: [] 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-192-0: preCommit - successfulFromPrevious: [] 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-192-0 prepared 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-192-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-192-0 07:04:40,267 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-192-0 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-192-0 submitted to persistence 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from -1 to 0 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config44: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=890853} is already disabled 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Moving last applied index from 0 to 1 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Applying state for log index 1 data Simple{size=175} 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTree - member-1-shard-inventory-config44: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-192-0 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-192-0: commit - successfulFromPrevious: [] 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-192-0 changing state from COMMIT_PENDING to COMMITTED 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Transaction member-1-ShardTransactionTest-fe-0-txn-192-0 committed as 0, sending response to Actor[akka://test/system/testProbe-237#1851695328] 07:04:40,268 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyLocalTransactionWithImmediateCommit] 07:04:40,268 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config44: Created publisher actor Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config44-DTCL-publisher#878368984] with name member-1-shard-inventory-config44-DTCL-publisher 07:04:40,268 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config44-DTCL-publisher#878368984] 07:04:40,269 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: fakeSnapshot purging log to 0 for term 1 07:04:40,269 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config44: publishChanges: rootPath: / 07:04:40,269 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=0 07:04:40,269 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config44: Persisting ApplyJournalEntries with index=1 [WARN] [01/22/2024 07:04:40.269] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithImmediateCommit/member-1-shard-inventory-config44-DTCL-publisher#878368984]: org.opendaylight.controller.cluster.common.actor.Monitor@185800cd 07:04:40,269 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config44: Elapsed time for generation of change events for member-1-shard-inventory-config44-DTCL-publisher: 90.28 μs 07:04:40,279 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config44 07:04:40,279 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config44 (Leader)_slicer-id-675: Closing 07:04:40,279 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config44: Aborting 0 pending queued transactions 07:04:40,281 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Shard created : member-1-shard-inventory-config45, persistent : true [WARN] [01/22/2024 07:04:40.281] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain#782150297]: org.opendaylight.controller.cluster.common.actor.Monitor@6fa7a3a9 07:04:40,281 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testCreateTransactionOnChain/member-1-shard-inventory-config45-notifier#-526041567 created and ready for shard:member-1-shard-inventory-config45 [WARN] [01/22/2024 07:04:40.281] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/member-1-shard-inventory-config45-notifier#-526041567]: org.opendaylight.controller.cluster.common.actor.Monitor@4ae083b7 07:04:40,281 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testCreateTransactionOnChain/shard-member-1:snapshot-read#-901742634] [WARN] [01/22/2024 07:04:40.281] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/shard-member-1:snapshot-read#-901742634]: org.opendaylight.controller.cluster.common.actor.Monitor@5ee43d46 07:04:40,282 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Starting recovery for member-1-shard-inventory-config45 with journal batch size 3 07:04:40,282 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config45: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:40,282 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config45: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:40,282 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: false, hasLeader : false 07:04:40,282 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config45: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config45 is no longer the leader 07:04:40,282 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config45 (Follower): Received TimeoutNow - switching to Candidate [WARN] [01/22/2024 07:04:40.282] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=Actor[akka://test/user/testCreateTransactionOnChain#782150297]] 07:04:40,282 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from null to Follower 07:04:40,283 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config45 (Candidate): Election: Candidate has following voting peers: [] 07:04:40,283 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config45: Set currentTerm=1, votedFor=member-1-shard-inventory-config45 07:04:40,283 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config45 (Candidate): Starting new election term 1 07:04:40,283 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config45 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:40,283 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageAssembler - member-1-shard-inventory-config45 (Follower): Closing 07:04:40,283 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: false, hasLeader : false 07:04:40,283 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config45: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config45 is no longer the leader 07:04:40,283 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from Follower to Candidate 07:04:40,283 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config45 (Candidate): Received ElectionTimeout 07:04:40,283 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config45 (Leader): Election: Leader has following peers: [] 07:04:40,283 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config45 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:40,283 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config45: onLeadershipChange, isLeader: true, hasLeader : true 07:04:40,283 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config45: became leader with frontend state for [] 07:04:40,283 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config45 , received role change from Candidate to Leader 07:04:40,343 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config45: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:40,343 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config45: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:40,343 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config45: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:40,344 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config45: Creating transaction : member-1-ShardTransactionTest-fe-0-txn-193-0 07:04:40,344 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardReadTransaction - Actor created Actor[akka://test/user/testCreateTransactionOnChain/shard-inventory-member-1:ShardTransactionTest@0:193_3#560268536] [WARN] [01/22/2024 07:04:40.344] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testCreateTransactionOnChain/shard-inventory-member-1:ShardTransactionTest@0:193_3#560268536]: org.opendaylight.controller.cluster.common.actor.Monitor@645810d9 07:04:40,345 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testCreateTransactionOnChain#782150297] 07:04:40,345 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:40,345 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Moving last applied index from -1 to 0 07:04:40,345 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:40,345 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:40,345 AM [test-akka.actor.default-dispatcher-14] [DEBUG] FrontendMetadata - member-1-shard-inventory-config45: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:40,345 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1497943} is already disabled 07:04:40,345 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Persisting ApplyJournalEntries with index=0 07:04:40,355 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config45 07:04:40,355 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config45 (Leader)_slicer-id-677: Closing 07:04:40,355 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config45: Aborting 0 pending queued transactions 07:04:40,357 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Shard created : member-1-shard-inventory-config46, persistent : true [WARN] [01/22/2024 07:04:40.357] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRegisterDataTreeChangeListener]: org.opendaylight.controller.cluster.common.actor.Monitor@23bedea1 07:04:40,358 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-notifier#-725917882 created and ready for shard:member-1-shard-inventory-config46 [WARN] [01/22/2024 07:04:40.358] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-notifier#-725917882]: org.opendaylight.controller.cluster.common.actor.Monitor@503c620c 07:04:40,358 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/shard-member-1:snapshot-read#1379832348] [WARN] [01/22/2024 07:04:40.358] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/shard-member-1:snapshot-read#1379832348]: org.opendaylight.controller.cluster.common.actor.Monitor@2d07d76c 07:04:40,358 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Starting recovery for member-1-shard-inventory-config46 with journal batch size 3 07:04:40,359 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:40,359 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config46: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:40,359 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onLeadershipChange, isLeader: false, hasLeader : false 07:04:40,359 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config46 is no longer the leader 07:04:40,359 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config46 , received role change from null to Follower 07:04:40,359 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46 (Follower): Received TimeoutNow - switching to Candidate 07:04:40,359 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46 (Candidate): Election: Candidate has following voting peers: [] 07:04:40,359 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Set currentTerm=1, votedFor=member-1-shard-inventory-config46 07:04:40,359 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config46 (Candidate): Starting new election term 1 07:04:40,359 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config46 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:40,359 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageAssembler - member-1-shard-inventory-config46 (Follower): Closing 07:04:40,359 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onLeadershipChange, isLeader: false, hasLeader : false 07:04:40,359 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config46 is no longer the leader 07:04:40,359 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config46 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:40.360] [test-akka.actor.default-dispatcher-5] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 07:04:40,360 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config46 (Candidate): Received ElectionTimeout 07:04:40,360 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config46 (Leader): Election: Leader has following peers: [] 07:04:40,360 AM [test-akka.actor.default-dispatcher-5] [INFO] Shard - member-1-shard-inventory-config46 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:40,360 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onLeadershipChange, isLeader: true, hasLeader : true 07:04:40,360 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config46: became leader with frontend state for [] 07:04:40,360 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config46 , received role change from Candidate to Leader 07:04:40,458 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#-695464030] [WARN] [01/22/2024 07:04:40.458] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#-695464030]: org.opendaylight.controller.cluster.common.actor.Monitor@6de2a862 07:04:40,469 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#-695464030]], isLeader: true, hasLeader: true 07:04:40,469 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 07:04:40,469 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config46: Created publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-DTCL-publisher#703342065] with name member-1-shard-inventory-config46-DTCL-publisher 07:04:40,470 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config46: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] to publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-DTCL-publisher#703342065] 07:04:40,470 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testRegisterDataTreeChangeListener/$a 07:04:40,470 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/$a#-1339684596] 07:04:40,470 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config46: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@c8f1f02 07:04:40,470 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-DTCL-publisher#703342065] 07:04:40,470 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config46: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] 07:04:40,470 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] [WARN] [01/22/2024 07:04:40.470] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/$a#-1339684596]: org.opendaylight.controller.cluster.common.actor.Monitor@5ab56b8 [WARN] [01/22/2024 07:04:40.470] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-DTCL-publisher#703342065]: org.opendaylight.controller.cluster.common.actor.Monitor@40e73de 07:04:40,470 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ForwardingDataTreeChangeListener - Sending OnInitialData to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] 07:04:40,470 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 07:04:40,470 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config46: Notifying onInitialData to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@c8f1f02 07:04:40,470 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-194-0 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Readying Tx member-1-ShardTransactionTest-fe-0-txn-194-0 of 1 operations, client version 13 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: readying transaction member-1-ShardTransactionTest-fe-0-txn-194-0 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: transaction member-1-ShardTransactionTest-fe-0-txn-194-0 ready 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Validating transaction member-1-ShardTransactionTest-fe-0-txn-194-0 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-194-0 validated 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-194-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: canCommit for member-1-ShardTransactionTest-fe-0-txn-194-0: success 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Committing transaction member-1-ShardTransactionTest-fe-0-txn-194-0 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-194-0 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-194-0 candidate ready 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-194-0: canCommit - candidate rootPath: / 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-194-0: canCommit - messages: [] 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-194-0: preCommit - successfulFromPrevious: [] 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-194-0 prepared 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-194-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-194-0 07:04:40,471 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-194-0 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-194-0 submitted to persistence 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Moving last applied index from -1 to 0 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] FrontendMetadata - member-1-shard-inventory-config46: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1702358} is already disabled 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Moving last applied index from 0 to 1 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Applying state for log index 1 data Simple{size=143} 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTree - member-1-shard-inventory-config46: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-194-0 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-194-0: commit - successfulFromPrevious: [] 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-194-0 changing state from COMMIT_PENDING to COMMITTED 07:04:40,472 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Transaction member-1-ShardTransactionTest-fe-0-txn-194-0 committed as 0, sending response to Actor[akka://test/temp/testRegisterDataTreeChangeListener$h] 07:04:40,472 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: publishChanges: rootPath: / 07:04:40,473 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 07:04:40,473 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener)] 07:04:40,473 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: fakeSnapshot purging log to 0 for term 1 07:04:40,473 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Persisting ApplyJournalEntries with index=0 07:04:40,473 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config46: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@c8f1f02 07:04:40,473 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config46: Elapsed time for generation of change events for member-1-shard-inventory-config46-DTCL-publisher: 197.5 μs 07:04:40,473 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config46: Persisting ApplyJournalEntries with index=1 07:04:40,474 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#1256305952] [WARN] [01/22/2024 07:04:40.474] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#1256305952]: org.opendaylight.controller.cluster.common.actor.Monitor@698cfed 07:04:40,474 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=false, dataTreeChangeListenerPath=Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#1256305952]], isLeader: true, hasLeader: true 07:04:40,474 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testRegisterDataTreeChangeListener/$b#1092495840] 07:04:40,474 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config46: Enabled notifications for listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@46cb9906 07:04:40,474 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: Registering listenerActor ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)] for path /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test 07:04:40,474 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config46: Sending RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] to publisher actor Actor[akka://test/user/testRegisterDataTreeChangeListener/member-1-shard-inventory-config46-DTCL-publisher#703342065] 07:04:40,474 AM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config46: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testRegisterDataTreeChangeListener/$b [WARN] [01/22/2024 07:04:40.474] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRegisterDataTreeChangeListener/$b#1092495840]: org.opendaylight.controller.cluster.common.actor.Monitor@4491015c 07:04:40,474 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config46: Received RegisterListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener=ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]], initialState present=true] 07:04:40,474 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: notifySingleListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 07:04:40,475 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: notifyListener: listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 07:04:40,475 AM [test-akka.actor.default-dispatcher-14] [DEBUG] ForwardingDataTreeChangeListener - Sending DataTreeChanged to ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)] 07:04:40,475 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config46: registerTreeChangeListener: path: /(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, listener: ForwardingDataTreeChangeListener [actor=ActorSelection[Anchor(akka://test/), Path(/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2)], sending actor=TestActor[akka://test/user/testRegisterDataTreeChangeListener]] 07:04:40,475 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerActor - member-1-shard-inventory-config46: Sending 1 change notification(s) to listener org.opendaylight.controller.cluster.datastore.utils.MockDataTreeChangeListener@46cb9906 07:04:40,982 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testRegisterDataTreeChangeListener] 07:04:40,993 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - Stopping Shard member-1-shard-inventory-config46 07:04:40,993 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config46 (Leader)_slicer-id-679: Closing 07:04:40,993 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config46: Aborting 0 pending queued transactions 07:04:40,993 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener#-695464030] 07:04:40,994 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testRegisterDataTreeChangeListener-DataTreeChangeListener2#1256305952] 07:04:40,995 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener27#1894603509] [WARN] [01/22/2024 07:04:40.995] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener27#1894603509]: org.opendaylight.controller.cluster.common.actor.Monitor@bb12f 07:04:40,997 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config47, persistent : true [WARN] [01/22/2024 07:04:40.996] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28]: org.opendaylight.controller.cluster.common.actor.Monitor@924e8f 07:04:40,997 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/member-1-shard-inventory-config47-notifier#-1314117020 created and ready for shard:member-1-shard-inventory-config47 07:04:40,997 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/shard-member-1:snapshot-read#1655994205] [WARN] [01/22/2024 07:04:40.997] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/member-1-shard-inventory-config47-notifier#-1314117020]: org.opendaylight.controller.cluster.common.actor.Monitor@1e90ffd1 [WARN] [01/22/2024 07:04:40.997] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/shard-member-1:snapshot-read#1655994205]: org.opendaylight.controller.cluster.common.actor.Monitor@63023a80 07:04:40,998 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config47 with journal batch size 3 07:04:40,998 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config47: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#1546461747] 07:04:40,998 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config47: SnapshotOffer called. 07:04:40,998 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config47: Moving last applied index from -1 to -1 07:04:40,998 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config47: Set currentTerm=1, votedFor=null 07:04:40,998 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config47: Applying recovered snapshot 07:04:40,998 AM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config47: clearing clients {} 07:04:40,999 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config47: Created publisher actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/member-1-shard-inventory-config47-DTCL-publisher#1550424362] with name member-1-shard-inventory-config47-DTCL-publisher 07:04:40,999 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/member-1-shard-inventory-config47-DTCL-publisher#1550424362] 07:04:40,999 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config47: state snapshot applied in 531.0 μs 07:04:40,999 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Recovery snapshot applied for member-1-shard-inventory-config47 in 662.5 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 07:04:40,999 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config47: publishChanges: rootPath: / [WARN] [01/22/2024 07:04:40.999] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/member-1-shard-inventory-config47-DTCL-publisher#1550424362]: org.opendaylight.controller.cluster.common.actor.Monitor@4f0641ae 07:04:40,999 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config47: Elapsed time for generation of change events for member-1-shard-inventory-config47-DTCL-publisher: 95.79 μs 07:04:41,0 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config47: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:41,0 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config47: Recovery completed in 1.568 ms - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:41,0 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onLeadershipChange, isLeader: false, hasLeader : false 07:04:41,0 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config47: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config47 is no longer the leader [WARN] [01/22/2024 07:04:41.000] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28]] 07:04:41,0 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config47 , received role change from null to Follower 07:04:41,0 AM [test-akka.actor.default-dispatcher-18] [INFO] DefaultConfigParamsImpl - Trying to use custom RaftPolicy org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy 07:04:41,107 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onMessage RegisterDataTreeChangeListener [path=/(urn:opendaylight:params:xml:ns:yang:controller:md:sal:dom:store:test?revision=2014-03-13)test, registerOnAllInstances=true, dataTreeChangeListenerPath=Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener27#1894603509]], isLeader: false, hasLeader: false 07:04:41,107 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: Shard does not have a leader - delaying registration 07:04:41,107 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: sending RegisterDataTreeNotificationListenerReply, listenerRegistrationPath = akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/$a 07:04:41,108 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeNotificationListenerRegistrationActor - Actor created Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/$a#1198419179] [WARN] [01/22/2024 07:04:41.108] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28/$a#1198419179]: org.opendaylight.controller.cluster.common.actor.Monitor@8892def 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config47: RaftPolicy used with prev.config org.opendaylight.controller.cluster.raft.policy.DisableElectionsRaftPolicy, RaftPolicy used with newConfig null 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config47: Re-initializing to Follower with previous leaderId null 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config47 (Follower): Closing 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onLeadershipChange, isLeader: false, hasLeader : false 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config47: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config47 is no longer the leader 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config47 (Follower): Received TimeoutNow - switching to Candidate 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config47 (Candidate): Election: Candidate has following voting peers: [] 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config47: Set currentTerm=2, votedFor=member-1-shard-inventory-config47 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config47 (Candidate): Starting new election term 2 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config47 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageAssembler - member-1-shard-inventory-config47 (Follower): Closing 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onLeadershipChange, isLeader: false, hasLeader : false 07:04:41,116 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config47: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config47 is no longer the leader 07:04:41,116 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config47 , received role change from Follower to Candidate 07:04:41,117 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config47 (Candidate): Received ElectionTimeout 07:04:41,117 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config47 (Leader): Election: Leader has following peers: [] 07:04:41,117 AM [test-akka.actor.default-dispatcher-14] [INFO] Shard - member-1-shard-inventory-config47 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 07:04:41,117 AM [test-akka.actor.default-dispatcher-14] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config47: onLeadershipChange, isLeader: true, hasLeader : true 07:04:41,117 AM [test-akka.actor.default-dispatcher-14] [DEBUG] Shard - member-1-shard-inventory-config47: became leader with frontend state for [] 07:04:41,117 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config47 , received role change from Candidate to Leader 07:04:41,616 AM [main] [INFO] TestActorFactory - Killing actor Actor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-DataTreeChangeListener27#1894603509] 07:04:41,627 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testClusteredDataTreeChangeListenerWithDelayedRegistrationClosed-shard28] 07:04:41,627 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config47 07:04:41,627 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config47 (Leader)_slicer-id-681: Closing 07:04:41,627 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config47: Aborting 0 pending queued transactions 07:04:41,629 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config48, persistent : true [WARN] [01/22/2024 07:04:41.629] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit]: org.opendaylight.controller.cluster.common.actor.Monitor@71c0c37c 07:04:41,630 AM [test-akka.actor.default-dispatcher-14] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config48-notifier#-169584966 created and ready for shard:member-1-shard-inventory-config48 [WARN] [01/22/2024 07:04:41.630] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config48-notifier#-169584966]: org.opendaylight.controller.cluster.common.actor.Monitor@3c2b8853 07:04:41,630 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/shard-member-1:snapshot-read#-235277107] [WARN] [01/22/2024 07:04:41.630] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/shard-member-1:snapshot-read#-235277107]: org.opendaylight.controller.cluster.common.actor.Monitor@216109f4 07:04:41,630 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config48 with journal batch size 3 07:04:41,631 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:41,631 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config48: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:41,631 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: onLeadershipChange, isLeader: false, hasLeader : false 07:04:41,631 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config48 is no longer the leader 07:04:41,631 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config48 , received role change from null to Follower 07:04:41,631 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48 (Follower): Received TimeoutNow - switching to Candidate [WARN] [01/22/2024 07:04:41.631] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit]] 07:04:41,631 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48 (Candidate): Election: Candidate has following voting peers: [] 07:04:41,631 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Set currentTerm=1, votedFor=member-1-shard-inventory-config48 07:04:41,631 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config48 (Candidate): Starting new election term 1 07:04:41,631 AM [test-akka.actor.default-dispatcher-18] [INFO] Shard - member-1-shard-inventory-config48 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:41,631 AM [test-akka.actor.default-dispatcher-18] [DEBUG] MessageAssembler - member-1-shard-inventory-config48 (Follower): Closing 07:04:41,631 AM [test-akka.actor.default-dispatcher-18] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: onLeadershipChange, isLeader: false, hasLeader : false 07:04:41,631 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config48 is no longer the leader 07:04:41,631 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config48 , received role change from Follower to Candidate 07:04:41,632 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config48 (Candidate): Received ElectionTimeout 07:04:41,632 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config48 (Leader): Election: Leader has following peers: [] 07:04:41,632 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - member-1-shard-inventory-config48 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:41,632 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config48: onLeadershipChange, isLeader: true, hasLeader : true 07:04:41,632 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config48: became leader with frontend state for [] 07:04:41,632 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config48 , received role change from Candidate to Leader 07:04:41,740 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-195-0 07:04:41,740 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:41,740 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:41,740 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-195-0 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-195-0 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Validating transaction member-1-ShardTransactionTest-fe-0-txn-195-0 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Transaction member-1-ShardTransactionTest-fe-0-txn-195-0 validated 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-195-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: canCommit for member-1-ShardTransactionTest-fe-0-txn-195-0: success 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Committing transaction member-1-ShardTransactionTest-fe-0-txn-195-0 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-195-0 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Transaction member-1-ShardTransactionTest-fe-0-txn-195-0 candidate ready 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-195-0: canCommit - candidate rootPath: / 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-195-0: canCommit - messages: [] 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-195-0: preCommit - successfulFromPrevious: [] 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Transaction member-1-ShardTransactionTest-fe-0-txn-195-0 prepared 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-195-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-195-0 07:04:41,741 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-195-0 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 175 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Transaction member-1-ShardTransactionTest-fe-0-txn-195-0 submitted to persistence 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Moving last applied index from -1 to 0 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] FrontendMetadata - member-1-shard-inventory-config48: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1534343} is already disabled 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Persisting ApplyJournalEntries with index=0 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=175}] 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Moving last applied index from 0 to 1 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Applying state for log index 1 data Simple{size=175} 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTree - member-1-shard-inventory-config48: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-195-0 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-195-0: commit - successfulFromPrevious: [] 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-195-0 changing state from COMMIT_PENDING to COMMITTED 07:04:41,742 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Transaction member-1-ShardTransactionTest-fe-0-txn-195-0 committed as 0, sending response to Actor[akka://test/system/testProbe-245#-629247155] 07:04:41,742 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit] 07:04:41,743 AM [test-akka.actor.default-dispatcher-18] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config48: Created publisher actor Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config48-DTCL-publisher#-496512305] with name member-1-shard-inventory-config48-DTCL-publisher 07:04:41,743 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config48-DTCL-publisher#-496512305] 07:04:41,743 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config48: publishChanges: rootPath: / 07:04:41,743 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: fakeSnapshot purging log to 0 for term 1 07:04:41,743 AM [test-akka.actor.default-dispatcher-18] [DEBUG] Shard - member-1-shard-inventory-config48: Persisting ApplyJournalEntries with index=1 07:04:41,743 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config48: Elapsed time for generation of change events for member-1-shard-inventory-config48-DTCL-publisher: 82.25 μs [WARN] [01/22/2024 07:04:41.743] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testReadyLocalTransactionWithThreePhaseCommit/member-1-shard-inventory-config48-DTCL-publisher#-496512305]: org.opendaylight.controller.cluster.common.actor.Monitor@55159d15 07:04:41,753 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - Stopping Shard member-1-shard-inventory-config48 07:04:41,753 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageSlicer - member-1-shard-inventory-config48 (Leader)_slicer-id-683: Closing 07:04:41,753 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config48: Aborting 0 pending queued transactions 07:04:41,755 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config49, persistent : true 07:04:41,756 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config49 with journal batch size 3 [WARN] [01/22/2024 07:04:41.756] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry]: org.opendaylight.controller.cluster.common.actor.Monitor@4e2c44e6 07:04:41,756 AM [test-akka.actor.default-dispatcher-7] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config49-notifier#-956929037 created and ready for shard:member-1-shard-inventory-config49 07:04:41,756 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/shard-member-1:snapshot-read#-1064835153] [WARN] [01/22/2024 07:04:41.756] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config49-notifier#-956929037]: org.opendaylight.controller.cluster.common.actor.Monitor@425ec194 [WARN] [01/22/2024 07:04:41.756] [test-akka.actor.default-dispatcher-7] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/shard-member-1:snapshot-read#-1064835153]: org.opendaylight.controller.cluster.common.actor.Monitor@49ee503f 07:04:41,757 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config49: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:41,757 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config49: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:41,757 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config49: onLeadershipChange, isLeader: false, hasLeader : false 07:04:41,757 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config49: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config49 is no longer the leader 07:04:41,757 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config49 , received role change from null to Follower 07:04:41,757 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config49 (Follower): Received TimeoutNow - switching to Candidate 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config49 (Candidate): Election: Candidate has following voting peers: [] 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config49: Set currentTerm=1, votedFor=member-1-shard-inventory-config49 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config49 (Candidate): Starting new election term 1 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config49 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [DEBUG] MessageAssembler - member-1-shard-inventory-config49 (Follower): Closing 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config49: onLeadershipChange, isLeader: false, hasLeader : false 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config49: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config49 is no longer the leader 07:04:41,758 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config49 , received role change from Follower to Candidate [WARN] [01/22/2024 07:04:41.758] [test-akka.actor.default-dispatcher-13] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry]] 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config49 (Candidate): Received ElectionTimeout 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config49 (Leader): Election: Leader has following peers: [] 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config49 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config49: onLeadershipChange, isLeader: true, hasLeader : true 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config49: became leader with frontend state for [] 07:04:41,758 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config49 , received role change from Candidate to Leader 07:04:41,866 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config49: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:41,866 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config49: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:41,866 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config49: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:41,866 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config49: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-196-0 07:04:41,866 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config49: Readying Tx member-1-ShardTransactionTest-fe-0-txn-196-0 of 1 operations, client version 13 07:04:41,866 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: readying transaction member-1-ShardTransactionTest-fe-0-txn-196-0 07:04:41,866 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: transaction member-1-ShardTransactionTest-fe-0-txn-196-0 ready 07:04:41,867 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config49: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:41,867 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config49: Moving last applied index from -1 to 0 07:04:41,867 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config49: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:41,867 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config49: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:41,867 AM [test-akka.actor.default-dispatcher-7] [DEBUG] FrontendMetadata - member-1-shard-inventory-config49: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:41,867 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config49: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=1105588} is already disabled 07:04:41,867 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config49: Persisting ApplyJournalEntries with index=0 07:04:41,867 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-196-0 07:04:41,867 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Validating transaction member-1-ShardTransactionTest-fe-0-txn-196-0 07:04:41,867 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-196-0 validated 07:04:41,867 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-196-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:41,867 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: canCommit for member-1-ShardTransactionTest-fe-0-txn-196-0: success 07:04:41,868 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-197-0 07:04:41,868 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: Readying Tx member-1-ShardTransactionTest-fe-0-txn-197-0 of 1 operations, client version 13 07:04:41,868 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: readying transaction member-1-ShardTransactionTest-fe-0-txn-197-0 07:04:41,868 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: transaction member-1-ShardTransactionTest-fe-0-txn-197-0 ready 07:04:41,868 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: handleReadyLocalTransaction for member-1-ShardTransactionTest-fe-0-txn-198-0 07:04:41,868 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: Applying local modifications for Tx member-1-ShardTransactionTest-fe-0-txn-198-0 07:04:41,868 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Tx member-1-ShardTransactionTest-fe-0-txn-198-0 is scheduled for canCommit step 07:04:41,868 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: Committing transaction member-1-ShardTransactionTest-fe-0-txn-196-0 07:04:41,868 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-196-0 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-196-0 candidate ready 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-196-0: canCommit - candidate rootPath: / 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-196-0: canCommit - messages: [] 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-196-0: preCommit - successfulFromPrevious: [] 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-196-0 prepared 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-196-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-196-0 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-196-0 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 143 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: Persist data SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: Append log entry and persist SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-196-0 submitted to persistence 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: persist complete SimpleReplicatedLogEntry [index=1, term=1, payload=Simple{size=143}] 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: Moving last applied index from 0 to 1 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: Applying state for log index 1 data Simple{size=143} 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-196-0 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-196-0: commit - successfulFromPrevious: [] 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-196-0 changing state from COMMIT_PENDING to COMMITTED 07:04:41,869 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-196-0 committed as 0, sending response to Actor[akka://test/system/testProbe-247#-1880149327] 07:04:41,870 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config49: Created publisher actor Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config49-DTCL-publisher#-1590186267] with name member-1-shard-inventory-config49-DTCL-publisher 07:04:41,870 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config49-DTCL-publisher#-1590186267] 07:04:41,870 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: fakeSnapshot purging log to 0 for term 1 07:04:41,870 AM [test-akka.actor.default-dispatcher-7] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config49: publishChanges: rootPath: / 07:04:41,870 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config49: Persisting ApplyJournalEntries with index=1 [WARN] [01/22/2024 07:04:41.870] [test-akka.actor.default-dispatcher-5] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry/member-1-shard-inventory-config49-DTCL-publisher#-1590186267]: org.opendaylight.controller.cluster.common.actor.Monitor@2c843e1c 07:04:41,870 AM [test-akka.actor.default-dispatcher-7] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config49: Elapsed time for generation of change events for member-1-shard-inventory-config49-DTCL-publisher: 58.35 μs 07:04:42,435 AM [test-akka.actor.default-dispatcher-13] [WARN] ShardDataTree - member-1-shard-inventory-config49: Current transaction member-1-ShardTransactionTest-fe-0-txn-197-0 has timed out after 566 ms in state READY 07:04:42,435 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Validating transaction member-1-ShardTransactionTest-fe-0-txn-198-0 07:04:42,435 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-198-0 validated 07:04:42,435 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-198-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:42,435 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: canCommit for member-1-ShardTransactionTest-fe-0-txn-198-0: success 07:04:42,435 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Committing transaction member-1-ShardTransactionTest-fe-0-txn-198-0 07:04:42,435 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-198-0 07:04:42,436 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-198-0 candidate ready 07:04:42,436 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-198-0: canCommit - candidate rootPath: / 07:04:42,436 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-198-0: canCommit - messages: [] 07:04:42,436 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-198-0: preCommit - successfulFromPrevious: [] 07:04:42,436 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-198-0 prepared 07:04:42,436 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-198-0 changing state from PRE_COMMIT_PENDING to PRE_COMMIT_COMPLETE 07:04:42,436 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Finishing commit for transaction member-1-ShardTransactionTest-fe-0-txn-198-0 07:04:42,436 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Starting commit for transaction member-1-ShardTransactionTest-fe-0-txn-198-0 07:04:42,436 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 144 07:04:42,436 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Persist data SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=144}] 07:04:42,436 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Append log entry and persist SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=144}] 07:04:42,436 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-198-0 submitted to persistence 07:04:42,437 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: persist complete SimpleReplicatedLogEntry [index=2, term=1, payload=Simple{size=144}] 07:04:42,437 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Moving last applied index from 1 to 2 07:04:42,437 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Applying state for log index 2 data Simple{size=144} 07:04:42,437 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config49: Resuming commit of transaction member-1-ShardTransactionTest-fe-0-txn-198-0 07:04:42,437 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-198-0: commit - successfulFromPrevious: [] 07:04:42,437 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-198-0 changing state from COMMIT_PENDING to COMMITTED 07:04:42,437 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Transaction member-1-ShardTransactionTest-fe-0-txn-198-0 committed as 0, sending response to Actor[akka://test/system/testProbe-247#-1880149327] 07:04:42,438 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testTransactionCommitWithSubsequentExpiredCohortEntry] 07:04:42,438 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: fakeSnapshot purging log to 1 for term 1 07:04:42,438 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config49: Persisting ApplyJournalEntries with index=2 07:04:42,438 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config49: publishChanges: rootPath: / 07:04:42,438 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config49: Elapsed time for generation of change events for member-1-shard-inventory-config49-DTCL-publisher: 39.98 μs 07:04:42,448 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Stopping Shard member-1-shard-inventory-config49 07:04:42,448 AM [test-akka.actor.default-dispatcher-7] [DEBUG] MessageSlicer - member-1-shard-inventory-config49 (Leader)_slicer-id-685: Closing 07:04:42,449 AM [test-akka.actor.default-dispatcher-7] [DEBUG] Shard - member-1-shard-inventory-config49: Aborting 0 pending queued transactions 07:04:42,451 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Shard created : member-1-shard-inventory-config50, persistent : true [WARN] [01/22/2024 07:04:42.451] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testPreCommitPhaseFailure]: org.opendaylight.controller.cluster.common.actor.Monitor@3f3059ef 07:04:42,452 AM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.171.69:25520/user/testPreCommitPhaseFailure/member-1-shard-inventory-config50-notifier#-2102507297 created and ready for shard:member-1-shard-inventory-config50 [WARN] [01/22/2024 07:04:42.452] [test-akka.actor.default-dispatcher-13] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPreCommitPhaseFailure/member-1-shard-inventory-config50-notifier#-2102507297]: org.opendaylight.controller.cluster.common.actor.Monitor@7b6f80a7 07:04:42,452 AM [test-akka.actor.default-dispatcher-8] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testPreCommitPhaseFailure/shard-member-1:snapshot-read#2145319470] [WARN] [01/22/2024 07:04:42.452] [test-akka.actor.default-dispatcher-8] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testPreCommitPhaseFailure/shard-member-1:snapshot-read#2145319470]: org.opendaylight.controller.cluster.common.actor.Monitor@52e7f94b 07:04:42,453 AM [test-akka.actor.default-dispatcher-7] [INFO] Shard - Starting recovery for member-1-shard-inventory-config50 with journal batch size 3 07:04:42,453 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 07:04:42,453 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config50: Recovery completed - Switching actor to Follower - last log index = -1, last log term = -1, snapshot index = -1, snapshot term = -1, journal size = 0 07:04:42,454 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config50: onLeadershipChange, isLeader: false, hasLeader : false 07:04:42,454 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config50 is no longer the leader 07:04:42,454 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50 (Follower): Received TimeoutNow - switching to Candidate [WARN] [01/22/2024 07:04:42.454] [test-akka.actor.default-dispatcher-7] [akka://test/user] unhandled message from Actor[akka://test/deadLetters]: ActorInitialized[actorRef=TestActor[akka://test/user/testPreCommitPhaseFailure]] 07:04:42,454 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50 (Candidate): Election: Candidate has following voting peers: [] 07:04:42,454 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Set currentTerm=1, votedFor=member-1-shard-inventory-config50 07:04:42,454 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config50 , received role change from null to Follower 07:04:42,454 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config50 (Candidate): Starting new election term 1 07:04:42,454 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - member-1-shard-inventory-config50 (Follower) :- Switching from behavior Follower to Candidate, election term: 1 07:04:42,454 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageAssembler - member-1-shard-inventory-config50 (Follower): Closing 07:04:42,454 AM [test-akka.actor.default-dispatcher-13] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config50: onLeadershipChange, isLeader: false, hasLeader : false 07:04:42,454 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config50 is no longer the leader 07:04:42,454 AM [test-akka.actor.default-dispatcher-5] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config50 , received role change from Follower to Candidate 07:04:42,454 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config50 (Candidate): Received ElectionTimeout 07:04:42,454 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config50 (Leader): Election: Leader has following peers: [] 07:04:42,454 AM [test-akka.actor.default-dispatcher-8] [INFO] Shard - member-1-shard-inventory-config50 (Candidate) :- Switching from behavior Candidate to Leader, election term: 1 07:04:42,454 AM [test-akka.actor.default-dispatcher-8] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config50: onLeadershipChange, isLeader: true, hasLeader : true 07:04:42,454 AM [test-akka.actor.default-dispatcher-8] [DEBUG] Shard - member-1-shard-inventory-config50: became leader with frontend state for [] 07:04:42,454 AM [test-akka.actor.default-dispatcher-8] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config50 , received role change from Candidate to Leader 07:04:42,515 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50: encountered ask-based client ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, disabling transaction tracking 07:04:42,515 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50: Persist data SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:42,515 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50: Append log entry and persist SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:42,516 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-199-0 07:04:42,516 AM [test-akka.actor.default-dispatcher-5] [DEBUG] Shard - member-1-shard-inventory-config50: Readying Tx member-1-ShardTransactionTest-fe-0-txn-199-0 of 1 operations, client version 13 07:04:42,516 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: readying transaction member-1-ShardTransactionTest-fe-0-txn-199-0 07:04:42,516 AM [test-akka.actor.default-dispatcher-5] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: transaction member-1-ShardTransactionTest-fe-0-txn-199-0 ready 07:04:42,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Applying 1 batched modifications for Tx member-1-ShardTransactionTest-fe-0-txn-200-0 07:04:42,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Readying Tx member-1-ShardTransactionTest-fe-0-txn-200-0 of 1 operations, client version 13 07:04:42,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: readying transaction member-1-ShardTransactionTest-fe-0-txn-200-0 07:04:42,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: transaction member-1-ShardTransactionTest-fe-0-txn-200-0 ready 07:04:42,517 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-199-0 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: Validating transaction member-1-ShardTransactionTest-fe-0-txn-199-0 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: Transaction member-1-ShardTransactionTest-fe-0-txn-199-0 validated 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-199-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: canCommit for member-1-ShardTransactionTest-fe-0-txn-199-0: success 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: persist complete SimpleReplicatedLogEntry [index=0, term=1, payload=DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37}] 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Moving last applied index from -1 to 0 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Applying state for log index 0 data DisableTrackingPayload{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, size=37} 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: disabling tracking of ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] FrontendMetadata - member-1-shard-inventory-config50: disableTracking ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0} does not match any client, pre-disabling client. 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: leader state Disabled{clientId=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, nanosAgo=2554860} is already disabled 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Can committing transaction member-1-ShardTransactionTest-fe-0-txn-200-0 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: Tx member-1-ShardTransactionTest-fe-0-txn-200-0 is scheduled for canCommit step 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Committing transaction member-1-ShardTransactionTest-fe-0-txn-199-0 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: Preparing transaction member-1-ShardTransactionTest-fe-0-txn-199-0 07:04:42,518 AM [test-akka.actor.default-dispatcher-13] [ERROR] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-199-0 failed to prepare java.lang.RuntimeException: mock preCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1030) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:113) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:117) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:302) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:365) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:715) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:416) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:42,519 AM [test-akka.actor.default-dispatcher-13] [DEBUG] CompositeDataTreeCohort - member-1-ShardTransactionTest-fe-0-txn-199-0: abort - successfulFromPrevious: [] 07:04:42,519 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-199-0 changing state from PRE_COMMIT_PENDING to FAILED 07:04:42,519 AM [test-akka.actor.default-dispatcher-13] [ERROR] Shard - member-1-shard-inventory-config50 An exception occurred while preCommitting transaction member-1-ShardTransactionTest-fe-0-txn-199-0 java.lang.RuntimeException: mock preCommit failure at org.opendaylight.controller.cluster.datastore.ShardDataTree.startPreCommit(ShardDataTree.java:1030) at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.preCommit(SimpleShardDataTreeCohort.java:113) at org.opendaylight.controller.cluster.datastore.CohortEntry.preCommit(CohortEntry.java:117) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.doCommit(ShardCommitCoordinator.java:302) at org.opendaylight.controller.cluster.datastore.ShardCommitCoordinator.handleCommit(ShardCommitCoordinator.java:365) at org.opendaylight.controller.cluster.datastore.Shard.handleCommitTransaction(Shard.java:715) at org.opendaylight.controller.cluster.datastore.Shard.handleNonRaftCommand(Shard.java:416) at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:270) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) at scala.PartialFunction.applyOrElse(PartialFunction.scala:214) at scala.PartialFunction.applyOrElse$(PartialFunction.scala:213) at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:269) at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:270) at akka.actor.Actor.aroundReceive(Actor.scala:537) at akka.actor.Actor.aroundReceive$(Actor.scala:535) at akka.persistence.AbstractPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(PersistentActor.scala:295) at akka.persistence.Eventsourced$$anon$4.stateReceive(Eventsourced.scala:917) at akka.persistence.Eventsourced.aroundReceive(Eventsourced.scala:245) at akka.persistence.Eventsourced.aroundReceive$(Eventsourced.scala:244) at akka.persistence.AbstractPersistentActor.aroundReceive(PersistentActor.scala:295) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) at akka.actor.ActorCell.invoke(ActorCell.scala:547) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) at akka.dispatch.Mailbox.run(Mailbox.scala:231) at akka.dispatch.Mailbox.exec(Mailbox.scala:243) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373) at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182) at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655) at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622) at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165) 07:04:42,519 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: Validating transaction member-1-ShardTransactionTest-fe-0-txn-200-0 07:04:42,519 AM [test-akka.actor.default-dispatcher-13] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: Transaction member-1-ShardTransactionTest-fe-0-txn-200-0 validated 07:04:42,519 AM [test-akka.actor.default-dispatcher-13] [DEBUG] SimpleShardDataTreeCohort - Transaction member-1-ShardTransactionTest-fe-0-txn-200-0 changing state from CAN_COMMIT_PENDING to CAN_COMMIT_COMPLETE 07:04:42,519 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: canCommit for member-1-ShardTransactionTest-fe-0-txn-200-0: success 07:04:42,519 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Persisting ApplyJournalEntries with index=0 07:04:42,521 AM [main] [INFO] TestActorFactory - Killing actor TestActor[akka://test/user/testPreCommitPhaseFailure] 07:04:42,532 AM [test-akka.actor.default-dispatcher-13] [INFO] Shard - Stopping Shard member-1-shard-inventory-config50 07:04:42,532 AM [test-akka.actor.default-dispatcher-13] [DEBUG] MessageSlicer - member-1-shard-inventory-config50 (Leader)_slicer-id-687: Closing 07:04:42,532 AM [test-akka.actor.default-dispatcher-13] [DEBUG] Shard - member-1-shard-inventory-config50: Aborting 1 pending queued transactions [WARN] [01/22/2024 07:04:42.532] [test-akka.actor.default-dispatcher-5] [akka://test/deadLetters] received dead letter from TestActor[akka://test/user/testPreCommitPhaseFailure]: Failure(java.lang.RuntimeException: Transaction aborted due to shutdown.) [INFO] [01/22/2024 07:04:42.533] [test-akka.remote.default-remote-dispatcher-6] [akka://test@10.30.171.69:25520/system/remoting-terminator] Shutting down remote daemon. [INFO] [01/22/2024 07:04:42.533] [test-akka.remote.default-remote-dispatcher-6] [akka://test@10.30.171.69:25520/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports. 07:04:42,534 AM [test-akka.actor.default-dispatcher-13] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 07:04:42,534 AM [test-akka.actor.default-dispatcher-13] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [01/22/2024 07:04:42.535] [test-akka.remote.default-remote-dispatcher-6] [akka://test@10.30.171.69:25520/system/remoting-terminator] Remoting shut down. 07:04:42,535 AM [test-akka.actor.default-dispatcher-8] [INFO] RemoteActorRefProvider$RemotingTerminator - Remoting shut down. [DEBUG] [01/22/2024 07:04:42.535] [test-akka.actor.internal-dispatcher-4] [EventStream] shutting down: StandardOutLogger