03:05:32,518 PM [Cleaner-1] [DEBUG] ProxyHistory - Proxy org.opendaylight.controller.cluster.databroker.actors.dds.ProxyHistory$LocalSingle@3ba36c56 aborted transaction LocalReadOnlyProxyTransaction{identifier=member-1-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-3-1, state=OPEN} 03:05:32,518 PM [Cleaner-1] [DEBUG] AbstractProxyTransaction - Transaction proxy LocalReadOnlyProxyTransaction{identifier=member-1-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-3-1, state=OPEN} sending request AbortLocalTransactionRequest{target=member-1-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-3-1, sequence=0, replyTo=Actor[akka://cluster-test/user/$a#166028413]} callback org.opendaylight.controller.cluster.databroker.actors.dds.AbstractProxyTransaction$$Lambda$2084/0x00000008016bea50@57398c58 03:05:32,518 PM [Cleaner-1] [DEBUG] TransmitQueue - Queue org.opendaylight.controller.cluster.access.client.TransmitQueue$Transmitting@14183178 transmitting entry ConnectionEntry{request=AbortLocalTransactionRequest{target=member-1-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-3-1, sequence=0, replyTo=Actor[akka://cluster-test/user/$a#166028413]}, enqueuedTicks=978924399585} 03:05:32,518 PM [Cleaner-1] [DEBUG] ProxyHistory - Proxy org.opendaylight.controller.cluster.databroker.actors.dds.ProxyHistory$LocalSingle@68353219 aborted transaction LocalReadOnlyProxyTransaction{identifier=member-1-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-3-2, state=OPEN} 03:05:32,518 PM [Cleaner-1] [DEBUG] AbstractProxyTransaction - Transaction proxy LocalReadOnlyProxyTransaction{identifier=member-1-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-3-2, state=OPEN} sending request AbortLocalTransactionRequest{target=member-1-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-3-2, sequence=0, replyTo=Actor[akka://cluster-test/user/$a#166028413]} callback org.opendaylight.controller.cluster.databroker.actors.dds.AbstractProxyTransaction$$Lambda$2084/0x00000008016bea50@10bba519 03:05:32,518 PM [Cleaner-1] [DEBUG] TransmitQueue - Queue org.opendaylight.controller.cluster.access.client.TransmitQueue$Transmitting@608655ab transmitting entry ConnectionEntry{request=AbortLocalTransactionRequest{target=member-1-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-3-2, sequence=0, replyTo=Actor[akka://cluster-test/user/$a#166028413]}, enqueuedTicks=978924503718} 03:05:32,518 PM [Cleaner-1] [INFO] ClientBackedTransaction - Aborted orphan transaction ClientSnapshot{identifier=member-1-datastore-testWriteTransactionWithMultipleShards-fe-0-txn-3-0} 03:05:32,534 PM [test-akka.actor.default-dispatcher-5] [INFO] Slf4jLogger - Slf4jLogger started [DEBUG] [03/07/2024 15:05:32.534] [main] [EventStream(akka://test)] logger log1-TestEventListener started [DEBUG] [03/07/2024 15:05:32.535] [main] [EventStream(akka://test)] logger log2-Slf4jLogger started [DEBUG] [03/07/2024 15:05:32.535] [main] [EventStream(akka://test)] Default Loggers started [INFO] [03/07/2024 15:05:32.550] [main] [ArteryTransport(akka://test)] Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.170.169:25520] with UID [1393770671321334956] 03:05:32,550 PM [test-akka.actor.default-dispatcher-4] [INFO] ArteryTransport - Remoting started with transport [Artery tcp]; listening on address [akka://test@10.30.170.169:25520] with UID [1393770671321334956] [INFO] [03/07/2024 15:05:32.550] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.169:25520] - Starting up, Akka version [2.6.21] ... 03:05:32,550 PM [test-akka.actor.default-dispatcher-5] [INFO] Cluster - Cluster Node [akka://test@10.30.170.169:25520] - Starting up, Akka version [2.6.21] ... [INFO] [03/07/2024 15:05:32.552] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.169:25520] - Registered cluster JMX MBean [akka:type=Cluster] [INFO] [03/07/2024 15:05:32.552] [main] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.169:25520] - Started up successfully 03:05:32,552 PM [test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://test@10.30.170.169:25520] - Registered cluster JMX MBean [akka:type=Cluster] 03:05:32,552 PM [test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://test@10.30.170.169:25520] - Started up successfully [INFO] [03/07/2024 15:05:32.558] [test-akka.actor.internal-dispatcher-9] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.169:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing [INFO] [03/07/2024 15:05:32.558] [test-akka.actor.internal-dispatcher-9] [Cluster(akka://test)] Cluster Node [akka://test@10.30.170.169:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining 03:05:32,558 PM [test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://test@10.30.170.169:25520] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing 03:05:32,558 PM [test-akka.actor.default-dispatcher-4] [INFO] Cluster - Cluster Node [akka://test@10.30.170.169:25520] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#joining 03:05:32,566 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 45 03:05:32,566 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,567 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 03:05:32,568 PM [main] [DEBUG] CommitTransactionPayload - Initial buffer capacity 512, actual serialized size 184 [WARN] [03/07/2024 15:05:32.569] [test-akka.actor.default-dispatcher-4] [akka://test/user/termination-monitor] received dead letter from TestActor[akka://test/user/testRecovery]: org.opendaylight.controller.cluster.common.actor.Monitor@5167f86f [INFO] [akkaDeadLetter][03/07/2024 15:05:32.570] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testRecovery] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:05:32,572 PM [test-akka.actor.default-dispatcher-4] [DEBUG] JsonExportActor - Actor created Actor[akka://test/user/testRecovery/$a#1953717782] 03:05:32,573 PM [test-akka.actor.default-dispatcher-12] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from TestActor[akka://test/user/testRecovery] to Actor[akka://test/user/termination-monitor] was not delivered. [1] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [WARN] [03/07/2024 15:05:32.573] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/$a#1953717782]: org.opendaylight.controller.cluster.common.actor.Monitor@118904f0 03:05:32,577 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractShardTest$1 - Shard created : member-1-shard-inventory-config50, persistent : true 03:05:32,577 PM [test-akka.actor.default-dispatcher-12] [DEBUG] ShardSnapshotActor - Actor created Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#-706431229] [WARN] [03/07/2024 15:05:32.577] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config50-notifier#-518884723]: org.opendaylight.controller.cluster.common.actor.Monitor@3e5c0dc5 [WARN] [03/07/2024 15:05:32.578] [test-akka.actor.default-dispatcher-12] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#-706431229]: org.opendaylight.controller.cluster.common.actor.Monitor@1f60d47d 03:05:32,579 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractShardTest$1 - Starting recovery for member-1-shard-inventory-config50 with journal batch size 1 03:05:32,581 PM [test-akka.actor.default-dispatcher-13] [INFO] RoleChangeNotifier - RoleChangeNotifier:akka://test@10.30.170.169:25520/user/testRecovery/member-1-shard-inventory-config50-notifier#-518884723 created and ready for shard:member-1-shard-inventory-config50 03:05:32,586 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class akka.persistence.SnapshotOffer from Actor[akka://test/system/in-memory-snapshot-store#-1254556987] 03:05:32,586 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: SnapshotOffer called. 03:05:32,586 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Moving last applied index from -1 to -1 03:05:32,586 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Set currentTerm=1, votedFor=null 03:05:32,586 PM [test-akka.actor.default-dispatcher-16] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Applying recovered snapshot 03:05:32,586 PM [test-akka.actor.default-dispatcher-16] [DEBUG] FrontendMetadata - member-1-shard-inventory-config50: clearing clients {} 03:05:32,587 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangeListenerPublisherActorProxy - member-1-shard-inventory-config50: Created publisher actor Actor[akka://test/user/testRecovery/member-1-shard-inventory-config50-DTCL-publisher#1038326132] with name member-1-shard-inventory-config50-DTCL-publisher 03:05:32,587 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTree - member-1-shard-inventory-config50: state snapshot applied in 343.9 μs 03:05:32,587 PM [test-akka.actor.default-dispatcher-16] [INFO] AbstractShardTest$1 - Recovery snapshot applied for member-1-shard-inventory-config50 in 455.5 μs: snapshotIndex=-1, snapshotTerm=-1, journal-size=0 03:05:32,588 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - Actor created Actor[akka://test/user/testRecovery/member-1-shard-inventory-config50-DTCL-publisher#1038326132] 03:05:32,588 PM [test-akka.actor.default-dispatcher-16] [DEBUG] DefaultShardDataTreeChangeListenerPublisher - member-1-shard-inventory-config50: publishChanges: rootPath: / 03:05:32,588 PM [test-akka.actor.default-dispatcher-16] [DEBUG] ShardDataTreeChangePublisherActor - member-1-shard-inventory-config50: Elapsed time for generation of change events for member-1-shard-inventory-config50-DTCL-publisher: 52.54 μs [WARN] [03/07/2024 15:05:32.588] [test-akka.actor.default-dispatcher-16] [akka://test/user/termination-monitor] received dead letter from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config50-DTCL-publisher#1038326132]: org.opendaylight.controller.cluster.common.actor.Monitor@30273f16 03:05:32,590 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,590 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 0, size: 45 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 1, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 2, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 3, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 4, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 5, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 6, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 7, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 8, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 9, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 10, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 11, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 12, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 13, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 14, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 15, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.SimpleReplicatedLogEntry from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received ReplicatedLogEntry for recovery: index: 16, size: 184 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class org.opendaylight.controller.cluster.raft.persisted.ApplyJournalEntries from Actor[akka://test/deadLetters] 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Received apply journal entries for recovery, applying to state: 0 to 16 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendMetadata - member-1-shard-inventory-config50: Added client Enabled{identifier=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, current={LocalHistoryIdentifier{client=ClientIdentifier{frontend=member-1-frontend-ShardTransactionTest, generation=0}, history=0, cookie=0}=org.opendaylight.controller.cluster.datastore.FrontendHistoryMetadataBuilder@34453577}, purged=MutableUnsignedLongSet{size=0}} 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-187-0 03:05:32,592 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-188-0 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-189-0 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-190-0 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-191-0 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-192-0 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-193-0 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-194-0 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-195-0 03:05:32,593 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-196-0 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-197-0 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-198-0 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-199-0 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 [INFO] [akkaDeadLetter][03/07/2024 15:05:32.594] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#-706431229] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/07/2024 15:05:32.594] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config50-notifier#-518884723] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/07/2024 15:05:32.594] [test-akka.actor.default-dispatcher-11] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config50-DTCL-publisher#1038326132] to Actor[akka://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-200-0 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,594 PM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testRecovery/shard-member-1:snapshot-read#-706431229] to Actor[akka://test/user/termination-monitor] was not delivered. [2] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:05:32,594 PM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config50-notifier#-518884723] to Actor[akka://test/user/termination-monitor] was not delivered. [3] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:05:32,594 PM [test-akka.actor.default-dispatcher-11] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testRecovery/member-1-shard-inventory-config50-DTCL-publisher#1038326132] to Actor[akka://test/user/termination-monitor] was not delivered. [4] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-201-0 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-202-0 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: starting log recovery batch with max size 1 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] FrontendClientMetadataBuilder - member-1-shard-inventory-config50: Committed transaction member-1-ShardTransactionTest-fe-0-txn-203-0 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Moving last applied index from -1 to 16 03:05:32,594 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onReceiveRecover: Received message class akka.persistence.RecoveryCompleted$ from Actor[akka://test/deadLetters] 03:05:32,595 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config50: Recovery completed in 8.117 ms - Switching actor to Follower - last log index = 16, last log term = 1, snapshot index = -1, snapshot term = -1, journal size = 17 03:05:32,595 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config50: onLeadershipChange, isLeader: false, hasLeader : false 03:05:32,595 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config50 is no longer the leader 03:05:32,595 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config50 , received role change from null to Follower 03:05:32,595 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50 (Follower): Received TimeoutNow - switching to Candidate 03:05:32,595 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50 (Candidate): Election: Candidate has following voting peers: [] 03:05:32,595 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Set currentTerm=2, votedFor=member-1-shard-inventory-config50 03:05:32,595 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config50 (Candidate): Starting new election term 2 03:05:32,595 PM [test-akka.actor.default-dispatcher-5] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config50 (Follower) :- Switching from behavior Follower to Candidate, election term: 2 03:05:32,595 PM [test-akka.actor.default-dispatcher-5] [DEBUG] MessageAssembler - member-1-shard-inventory-config50 (Follower): Closing 03:05:32,596 PM [test-akka.actor.default-dispatcher-5] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config50: onLeadershipChange, isLeader: false, hasLeader : false 03:05:32,596 PM [test-akka.actor.default-dispatcher-5] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: onStateChanged: Closing all transaction chains because shard member-1-shard-inventory-config50 is no longer the leader 03:05:32,596 PM [test-akka.actor.default-dispatcher-16] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config50 , received role change from Follower to Candidate [WARN] [03/07/2024 15:05:32.596] [test-akka.actor.default-dispatcher-14] [akka://test/user] unhandled message from TestActor[akka://test/user/testRecovery]: org.opendaylight.controller.cluster.datastore.messages.ActorInitialized@1f951a10 [INFO] [akkaDeadLetter][03/07/2024 15:05:32.596] [test-akka.actor.default-dispatcher-14] [akka://test/user] Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] from TestActor[akka://test/user/testRecovery] to Actor[akka://test/user] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [INFO] [akkaDeadLetter][03/07/2024 15:05:32.596] [test-akka.actor.default-dispatcher-14] [akka://test/user/termination-monitor] Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testRecovery/$a#1953717782] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:05:32,596 PM [test-akka.actor.default-dispatcher-14] [INFO] LocalActorRef - Message [org.opendaylight.controller.cluster.datastore.messages.ActorInitialized] from TestActor[akka://test/user/testRecovery] to Actor[akka://test/user] was unhandled. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:05:32,596 PM [test-akka.actor.default-dispatcher-4] [DEBUG] JsonExportActor - Creating JSON file : /tmp/junit3321560391360026237/persistence-export/snapshots/member-1-shard-inventory-config50-snapshot.json 03:05:32,596 PM [test-akka.actor.default-dispatcher-14] [INFO] EmptyLocalActorRef - Message [org.opendaylight.controller.cluster.common.actor.Monitor] from Actor[akka://test/user/testRecovery/$a#1953717782] to Actor[akka://test/user/termination-monitor] was not delivered. [6] dead letters encountered. If this is not an expected behavior then Actor[akka://test/user/termination-monitor] may have terminated unexpectedly. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. 03:05:32,598 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50 (Candidate): Received ElectionTimeout 03:05:32,598 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50 (Leader): Election: Leader has following peers: [] 03:05:32,598 PM [test-akka.actor.default-dispatcher-12] [INFO] AbstractShardTest$1 - member-1-shard-inventory-config50 (Candidate) :- Switching from behavior Candidate to Leader, election term: 2 03:05:32,598 PM [test-akka.actor.default-dispatcher-12] [DEBUG] DataTreeChangeListenerSupport - member-1-shard-inventory-config50: onLeadershipChange, isLeader: true, hasLeader : true 03:05:32,598 PM [test-akka.actor.default-dispatcher-12] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: became leader with frontend state for [member-1-frontend-ShardTransactionTest] 03:05:32,598 PM [test-akka.actor.default-dispatcher-12] [INFO] RoleChangeNotifier - RoleChangeNotifier for member-1-shard-inventory-config50 , received role change from Candidate to Leader 03:05:32,630 PM [test-akka.actor.default-dispatcher-4] [DEBUG] JsonExportActor - Created JSON file: /tmp/junit3321560391360026237/persistence-export/snapshots/member-1-shard-inventory-config50-snapshot.json 03:05:32,630 PM [test-akka.actor.default-dispatcher-4] [DEBUG] JsonExportActor - Creating JSON file : /tmp/junit3321560391360026237/persistence-export/journals/member-1-shard-inventory-config50-journal.json 03:05:32,633 PM [test-akka.actor.default-dispatcher-4] [DEBUG] JsonExportActor - Created JSON file: /tmp/junit3321560391360026237/persistence-export/journals/member-1-shard-inventory-config50-journal.json 03:05:32,805 PM [test-akka.actor.default-dispatcher-14] [INFO] AbstractShardTest$1 - Stopping Shard member-1-shard-inventory-config50 03:05:32,805 PM [test-akka.actor.default-dispatcher-14] [DEBUG] MessageSlicer - member-1-shard-inventory-config50 (Leader)_slicer-id-844: Closing 03:05:32,805 PM [test-akka.actor.default-dispatcher-14] [DEBUG] AbstractShardTest$1 - member-1-shard-inventory-config50: Aborting 0 pending queued transactions 03:05:32,805 PM [test-akka.actor.default-dispatcher-16] [INFO] RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. 03:05:32,805 PM [test-akka.actor.default-dispatcher-16] [INFO] RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [INFO] [03/07/2024 15:05:32.805] [test-akka.remote.default-remote-dispatcher-8] [akka://test@10.30.170.169:25520/system/remoting-terminator] Shutting down remote daemon. [INFO] [03/07/2024 15:05:32.805] [test-akka.remote.default-remote-dispatcher-8] [akka://test@10.30.170.169:25520/system/remoting-terminator] Remote daemon shut down; proceeding with flushing remote transports.