Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
20918623000:24:18
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
https://bugs.opendaylight.org/show_bug.cgi?id=6177
303000:01:02
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
openflowplugin-clustering.txt
20918623000:24:49
openflowplugin-clustering . txt . Cluster HA Owner Failover
51474000:04:38
openflowplugin-clustering . txt . Cluster HA Owner Restart
51501000:03:23
openflowplugin-clustering . txt . Cluster HA Data Recovery Leader Follower Failover
21210000:05:36
openflowplugin-clustering . txt . 010 Group Flows
72657000:09:31
openflowplugin-clustering . txt . 010 Switch Disconnect
303000:00:05
openflowplugin-clustering . txt . 020 Cluster Node Failure
303000:00:04
openflowplugin-clustering . txt . 030 Cluster Sync Problems
505000:01:24
openflowplugin-clustering . txt . 9145
330000:00:08

Test Execution Log

00:24:49.305 SUITE openflowplugin-clustering.txt
Full Name: openflowplugin-clustering.txt
Start / End / Elapsed: 20250127 01:22:01.225 / 20250127 01:46:50.530 / 00:24:49.305
Status: 209 tests total, 186 passed, 23 failed, 0 skipped
00:04:37.586 SUITE Cluster HA Owner Failover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover
Documentation:

Test suite for Cluster HA - Device Owner failover
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot
Start / End / Elapsed: 20250127 01:22:01.248 / 20250127 01:26:38.834 / 00:04:37.586
Status: 51 tests total, 47 passed, 4 failed, 0 skipped
00:00:05.321 SETUP SetupUtils . Setup_Utils_For_Setup_And_Teardown  
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20250127 01:22:01.759 / 20250127 01:22:07.080 / 00:00:05.321
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
Documentation:

Removes all the session objects
Start / End / Elapsed: 20250127 01:26:38.833 / 20250127 01:26:38.833 / 00:00:00.000
00:00:10.521 TEST Check Shards Status Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Shards Status Before Fail
Documentation:

Check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20250127 01:22:07.081 / 20250127 01:22:17.602 / 00:00:10.521
Status: PASS
00:00:08.962 TEST Start Mininet Multiple Connections
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Start Mininet Multiple Connections
Documentation:

Start mininet tree,2 with connection to all cluster instances.
Start / End / Elapsed: 20250127 01:22:17.602 / 20250127 01:22:26.564 / 00:00:08.962
Status: PASS
00:00:00.198 TEST Check Entity Owner Status And Find Owner and Successor Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Entity Owner Status And Find Owner and Successor Before Fail
Documentation:

Check Entity Owner Status and identify owner and successor for first switch s1.
Start / End / Elapsed: 20250127 01:22:26.565 / 20250127 01:22:26.763 / 00:00:00.198
Status: PASS
00:00:05.008 TEST Reconnect Extra Switches To Successors And Check OVS Connections
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Reconnect Extra Switches To Successors And Check OVS Connections
Documentation:

Connect switches s2 and s3 to successor instances.
Start / End / Elapsed: 20250127 01:22:26.763 / 20250127 01:22:31.771 / 00:00:05.008
Status: PASS
00:00:00.528 TEST Check Network Operational Information Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Network Operational Information Before Fail
Documentation:

Check devices in operational inventory and topology in all cluster instances.
Start / End / Elapsed: 20250127 01:22:31.771 / 20250127 01:22:32.299 / 00:00:00.528
Status: PASS
00:00:03.577 TEST Add Configuration In Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Owner and Verify Before Fail
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:22:32.300 / 20250127 01:22:35.877 / 00:00:03.577
Status: PASS
00:00:02.487 TEST Modify Configuration In Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Owner and Verify Before Fail
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:22:35.878 / 20250127 01:22:38.365 / 00:00:02.487
Status: PASS
00:00:03.392 TEST Delete Configuration In Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Owner and Verify Before Fail
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:22:38.365 / 20250127 01:22:41.757 / 00:00:03.392
Status: PASS
00:00:02.504 TEST Add Configuration In Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Successor and Verify Before Fail
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:22:41.757 / 20250127 01:22:44.261 / 00:00:02.504
Status: PASS
00:00:03.631 TEST Modify Configuration In Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Successor and Verify Before Fail
Documentation:

Modify Flow in successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:22:44.262 / 20250127 01:22:47.893 / 00:00:03.631
Status: PASS
00:00:02.346 TEST Delete Configuration In Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Successor and Verify Before Fail
Documentation:

Delete Flow in Successor and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:22:47.893 / 20250127 01:22:50.239 / 00:00:02.346
Status: PASS
00:00:03.898 TEST Send RPC Add to Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Owner and Verify Before Fail
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:22:50.240 / 20250127 01:22:54.138 / 00:00:03.898
Status: PASS
00:00:02.853 TEST Send RPC Delete to Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Owner and Verify Before Fail
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:22:54.138 / 20250127 01:22:56.991 / 00:00:02.853
Status: PASS
00:00:02.891 TEST Send RPC Add to Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Successor and Verify Before Fail
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:22:56.991 / 20250127 01:22:59.882 / 00:00:02.891
Status: PASS
00:00:02.498 TEST Send RPC Delete to Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Successor and Verify Before Fail
Documentation:

Delete Flow in Successor and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:22:59.882 / 20250127 01:23:02.380 / 00:00:02.498
Status: PASS
00:00:20.833 TEST Modify Network And Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Network And Verify Before Fail
Documentation:

Take a link down and verify port status in all instances.
Start / End / Elapsed: 20250127 01:23:02.380 / 20250127 01:23:23.213 / 00:00:20.833
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:3\']"}]},{"node-id":"openflow:3","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/nod... [ Message content over the limit has been removed. ] ...3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}],"link":[{"link-id":"openflow:2:3","source":{"source-node":"openflow:2","source-tp":"openflow:2:3"},"destination":{"dest-tp":"openflow:1:1","dest-node":"openflow:1"}},{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow:1' 21 times, not 16 times.
00:00:20.828 KEYWORD ClusterOpenFlow . Take OpenFlow Device Link Down and Verify  
Documentation:

Take a link down and verify port status in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250127 01:23:02.384 / 20250127 01:23:23.212 / 00:00:20.828
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   "link-down":true=1
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250127 01:23:02.386 / 20250127 01:23:02.386 / 00:00:00.000
00:00:00.008 KEYWORD ${ouput} = MininetKeywords . Send Mininet Command   ${mininet_conn_id} link s1 s2 down
Documentation:

Sends Command ${cmd} to Mininet session ${mininet_conn} and returns read buffer response.
Start / End / Elapsed: 20250127 01:23:02.394 / 20250127 01:23:02.402 / 00:00:00.008
00:00:00.152 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${operational_port_1} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250127 01:23:02.403 / 20250127 01:23:02.555 / 00:00:00.152
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   openflow:1=16 openflow:2=14 openflow:3=19
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250127 01:23:02.555 / 20250127 01:23:02.555 / 00:00:00.000
00:00:20.658 KEYWORD BuiltIn . Wait Until Keyword Succeeds   20s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250127 01:23:02.555 / 20250127 01:23:23.213 / 00:00:20.658
Message: 10 failing items removed using the --remove-keywords option.
00:00:00.050 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary {'openflow:1': '16', 'openflow:2': '14', 'openflow:3': '19'}.
Start / End / Elapsed: 20250127 01:23:23.163 / 20250127 01:23:23.213 / 00:00:00.050
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250127 01:23:23.163 / 20250127 01:23:23.164 / 00:00:00.001
00:00:00.047 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250127 01:23:23.165 / 20250127 01:23:23.212 / 00:00:00.047
00:00:00.047 ITERATION ${index} = 1  
Start / End / Elapsed: 20250127 01:23:23.165 / 20250127 01:23:23.212 / 00:00:00.047
00:00:00.041 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
Documentation:

Send a GET with the supplied uri to member ${member_index}.
Start / End / Elapsed: 20250127 01:23:23.169 / 20250127 01:23:23.210 / 00:00:00.041
00:00:00.001 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
Documentation:

Check string for occurrences of items expressed in a list of dictionaries {item=occurrences}. 0 occurences means item is not present.
Start / End / Elapsed: 20250127 01:23:23.211 / 20250127 01:23:23.212 / 00:00:00.001
00:00:00.001 FOR ${item} IN @{dictionary_item_occurrence}  
Start / End / Elapsed: 20250127 01:23:23.211 / 20250127 01:23:23.212 / 00:00:00.001
00:00:00.001 ITERATION ${item} = openflow:1  
Start / End / Elapsed: 20250127 01:23:23.211 / 20250127 01:23:23.212 / 00:00:00.001
00:00:00.000 KEYWORD BuiltIn . Should Contain X Times   ${string} ${item} ${dictionary_item_occurrence}[${item}]
Documentation:

Fails if container does not contain item count times.
Start / End / Elapsed: 20250127 01:23:23.211 / 20250127 01:23:23.211 / 00:00:00.000
01:23:23.211 INFO Item found from container 21 times.
01:23:23.212 FAIL '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:3\']"}]},{"node-id":"openflow:3","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}],"link":[{"link-id":"openflow:2:3","source":{"source-node":"openflow:2","source-tp":"openflow:2:3"},"destination":{"dest-tp":"openflow:1:1","dest-node":"openflow:1"}},{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow:1' 21 times, not 16 times.
01:23:23.213 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:3\']"}]},{"node-id":"openflow:3","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-n... [ Message content over the limit has been removed. ] ...3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}],"link":[{"link-id":"openflow:2:3","source":{"source-node":"openflow:2","source-tp":"openflow:2:3"},"destination":{"dest-tp":"openflow:1:1","dest-node":"openflow:1"}},{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow:1' 21 times, not 16 times.
00:00:00.282 TEST Restore Network And Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Restore Network And Verify Before Fail
Documentation:

Take the link up and verify port status in all instances.
Start / End / Elapsed: 20250127 01:23:23.213 / 20250127 01:23:23.495 / 00:00:00.282
Status: PASS
00:00:04.241 TEST Kill Owner Instance
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Kill Owner Instance
Documentation:

Kill Owner Instance and verify it is dead
Start / End / Elapsed: 20250127 01:23:23.495 / 20250127 01:23:27.736 / 00:00:04.241
Status: PASS
00:00:02.277 TEST Check Shards Status After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Shards Status After Fail
Documentation:

Create original cluster list and check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20250127 01:23:27.736 / 20250127 01:23:30.013 / 00:00:02.277
Status: PASS
00:00:13.696 TEST Check Entity Owner Status And Find Owner and Successor After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Entity Owner Status And Find Owner and Successor After Fail
Documentation:

Check Entity Owner Status and identify owner and successor.
Start / End / Elapsed: 20250127 01:23:30.013 / 20250127 01:23:43.709 / 00:00:13.696
Status: PASS
00:00:00.253 TEST Check Network Operational Information After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Network Operational Information After Fail
Documentation:

Check devices in operational inventory and topology in all cluster instances.
Start / End / Elapsed: 20250127 01:23:43.709 / 20250127 01:23:43.962 / 00:00:00.253
Status: PASS
00:00:03.452 TEST Add Configuration In Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Owner and Verify After Fail
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:23:43.963 / 20250127 01:23:47.415 / 00:00:03.452
Status: PASS
00:00:03.439 TEST Modify Configuration In Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Owner and Verify After Fail
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:23:47.415 / 20250127 01:23:50.854 / 00:00:03.439
Status: PASS
00:00:02.260 TEST Delete Configuration In Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Owner and Verify After Fail
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:23:50.854 / 20250127 01:23:53.114 / 00:00:02.260
Status: PASS
00:00:03.455 TEST Add Configuration In Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Successor and Verify After Fail
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:23:53.114 / 20250127 01:23:56.569 / 00:00:03.455
Status: PASS
00:00:02.410 TEST Modify Configuration In Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Successor and Verify After Fail
Documentation:

Modify Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:23:56.569 / 20250127 01:23:58.979 / 00:00:02.410
Status: PASS
00:00:03.286 TEST Delete Configuration In Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Successor and Verify After Fail
Documentation:

Delete Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:23:58.980 / 20250127 01:24:02.266 / 00:00:03.286
Status: PASS
00:00:02.778 TEST Send RPC Add to Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Owner and Verify After Fail
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:24:02.266 / 20250127 01:24:05.044 / 00:00:02.778
Status: PASS
00:00:03.617 TEST Send RPC Delete to Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Owner and Verify After Fail
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:24:05.045 / 20250127 01:24:08.662 / 00:00:03.617
Status: PASS
00:00:02.451 TEST Send RPC Add to Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Successor and Verify After Fail
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:24:08.662 / 20250127 01:24:11.113 / 00:00:02.451
Status: PASS
00:00:03.563 TEST Send RPC Delete to Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Successor and Verify After Fail
Documentation:

Delete Flow in Successor and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:24:11.113 / 20250127 01:24:14.676 / 00:00:03.563
Status: PASS
00:00:20.743 TEST Modify Network and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Network and Verify After Fail
Documentation:

Take a link down and verify port status in all instances.
Start / End / Elapsed: 20250127 01:24:14.676 / 20250127 01:24:35.419 / 00:00:20.743
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:3\']"}]},{"node-id":"openflow:3","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/nod... [ Message content over the limit has been removed. ] ...ogy-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}],"link":[{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow:1' 19 times, not 16 times.
00:00:20.738 KEYWORD ClusterOpenFlow . Take OpenFlow Device Link Down and Verify   ${new_cluster_list}
Documentation:

Take a link down and verify port status in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250127 01:24:14.681 / 20250127 01:24:35.419 / 00:00:20.738
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   "link-down":true=1
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250127 01:24:14.681 / 20250127 01:24:14.681 / 00:00:00.000
00:00:00.007 KEYWORD ${ouput} = MininetKeywords . Send Mininet Command   ${mininet_conn_id} link s1 s2 down
Documentation:

Sends Command ${cmd} to Mininet session ${mininet_conn} and returns read buffer response.
Start / End / Elapsed: 20250127 01:24:14.688 / 20250127 01:24:14.695 / 00:00:00.007
00:00:00.085 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${operational_port_1} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250127 01:24:14.695 / 20250127 01:24:14.780 / 00:00:00.085
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   openflow:1=16 openflow:2=14 openflow:3=19
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250127 01:24:14.780 / 20250127 01:24:14.780 / 00:00:00.000
00:00:20.638 KEYWORD BuiltIn . Wait Until Keyword Succeeds   20s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250127 01:24:14.781 / 20250127 01:24:35.419 / 00:00:20.638
Message: 10 failing items removed using the --remove-keywords option.
00:00:00.039 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary {'openflow:1': '16', 'openflow:2': '14', 'openflow:3': '19'}.
Start / End / Elapsed: 20250127 01:24:35.379 / 20250127 01:24:35.418 / 00:00:00.039
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250127 01:24:35.380 / 20250127 01:24:35.381 / 00:00:00.001
00:00:00.037 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250127 01:24:35.381 / 20250127 01:24:35.418 / 00:00:00.037
00:00:00.036 ITERATION ${index} = 2  
Start / End / Elapsed: 20250127 01:24:35.382 / 20250127 01:24:35.418 / 00:00:00.036
00:00:00.031 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
Documentation:

Send a GET with the supplied uri to member ${member_index}.
Start / End / Elapsed: 20250127 01:24:35.386 / 20250127 01:24:35.417 / 00:00:00.031
00:00:00.001 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
Documentation:

Check string for occurrences of items expressed in a list of dictionaries {item=occurrences}. 0 occurences means item is not present.
Start / End / Elapsed: 20250127 01:24:35.417 / 20250127 01:24:35.418 / 00:00:00.001
00:00:00.001 FOR ${item} IN @{dictionary_item_occurrence}  
Start / End / Elapsed: 20250127 01:24:35.417 / 20250127 01:24:35.418 / 00:00:00.001
00:00:00.001 ITERATION ${item} = openflow:1  
Start / End / Elapsed: 20250127 01:24:35.417 / 20250127 01:24:35.418 / 00:00:00.001
00:00:00.000 KEYWORD BuiltIn . Should Contain X Times   ${string} ${item} ${dictionary_item_occurrence}[${item}]
Documentation:

Fails if container does not contain item count times.
Start / End / Elapsed: 20250127 01:24:35.417 / 20250127 01:24:35.417 / 00:00:00.000
01:24:35.417 INFO Item found from container 19 times.
01:24:35.418 FAIL '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:3\']"}]},{"node-id":"openflow:3","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}],"link":[{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow:1' 19 times, not 16 times.
01:24:35.418 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:3\']"}]},{"node-id":"openflow:3","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}],"link":[{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow:1' 19 times, not 16 times.
00:00:05.496 TEST Restore Network and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Restore Network and Verify After Fail
Documentation:

Take the link up and verify port status in all instances.
Start / End / Elapsed: 20250127 01:24:35.419 / 20250127 01:24:40.915 / 00:00:05.496
Status: PASS
00:00:35.069 TEST Start Old Owner Instance
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Start Old Owner Instance
Documentation:

Start old Owner Instance and verify it is up
Start / End / Elapsed: 20250127 01:24:40.916 / 20250127 01:25:15.985 / 00:00:35.069
Status: PASS
00:00:03.431 TEST Check Shards Status After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Shards Status After Recover
Documentation:

Create original cluster list and check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20250127 01:25:15.985 / 20250127 01:25:19.416 / 00:00:03.431
Status: PASS
00:00:00.254 TEST Check Entity Owner Status After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Entity Owner Status After Recover
Documentation:

Check Entity Owner Status and identify owner and successor.
Start / End / Elapsed: 20250127 01:25:19.416 / 20250127 01:25:19.670 / 00:00:00.254
Status: PASS
00:00:00.456 TEST Check Network Operational Information After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Network Operational Information After Recover
Documentation:

Check devices in operational inventory and topology in all cluster instances.
Start / End / Elapsed: 20250127 01:25:19.670 / 20250127 01:25:20.126 / 00:00:00.456
Status: PASS
00:00:01.448 TEST Add Configuration In Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Owner and Verify After Recover
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:25:20.126 / 20250127 01:25:21.574 / 00:00:01.448
Status: PASS
00:00:02.495 TEST Modify Configuration In Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Owner and Verify After Recover
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:25:21.575 / 20250127 01:25:24.070 / 00:00:02.495
Status: PASS
00:00:03.410 TEST Delete Configuration In Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Owner and Verify After Recover
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:25:24.070 / 20250127 01:25:27.480 / 00:00:03.410
Status: PASS
00:00:02.501 TEST Add Configuration In Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Old Owner and Verify After Recover
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:25:27.480 / 20250127 01:25:29.981 / 00:00:02.501
Status: PASS
00:00:03.559 TEST Modify Configuration In Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Old Owner and Verify After Recover
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:25:29.981 / 20250127 01:25:33.540 / 00:00:03.559
Status: PASS
00:00:03.390 TEST Delete Configuration In Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Old Owner and Verify After Recover
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:25:33.541 / 20250127 01:25:36.931 / 00:00:03.390
Status: PASS
00:00:02.896 TEST Send RPC Add to Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Owner and Verify After Recover
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:25:36.931 / 20250127 01:25:39.827 / 00:00:02.896
Status: PASS
00:00:02.831 TEST Send RPC Delete to Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Owner and Verify After Recover
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:25:39.827 / 20250127 01:25:42.658 / 00:00:02.831
Status: PASS
00:00:02.480 TEST Send RPC Add to Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Old Owner and Verify After Recover
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:25:42.659 / 20250127 01:25:45.139 / 00:00:02.480
Status: PASS
00:00:03.595 TEST Send RPC Delete to Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Old Owner and Verify After Recover
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:25:45.139 / 20250127 01:25:48.734 / 00:00:03.595
Status: PASS
00:00:21.815 TEST Modify Network and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Network and Verify After Recover
Documentation:

Take a link down and verify port status in all instances.
Start / End / Elapsed: 20250127 01:25:48.734 / 20250127 01:26:10.549 / 00:00:21.815
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}],"node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'... [ Message content over the limit has been removed. ] ...ndaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}]}]}}' contains 'openflow:1' 19 times, not 16 times.
00:00:21.811 KEYWORD ClusterOpenFlow . Take OpenFlow Device Link Down and Verify  
Documentation:

Take a link down and verify port status in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250127 01:25:48.738 / 20250127 01:26:10.549 / 00:00:21.811
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   "link-down":true=1
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250127 01:25:48.740 / 20250127 01:25:48.740 / 00:00:00.000
00:00:00.052 KEYWORD ${ouput} = MininetKeywords . Send Mininet Command   ${mininet_conn_id} link s1 s2 down
Documentation:

Sends Command ${cmd} to Mininet session ${mininet_conn} and returns read buffer response.
Start / End / Elapsed: 20250127 01:25:48.747 / 20250127 01:25:48.799 / 00:00:00.052
00:00:00.129 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${operational_port_1} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250127 01:25:48.799 / 20250127 01:25:48.928 / 00:00:00.129
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   openflow:1=16 openflow:2=14 openflow:3=19
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250127 01:25:48.928 / 20250127 01:25:48.928 / 00:00:00.000
00:00:21.621 KEYWORD BuiltIn . Wait Until Keyword Succeeds   20s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250127 01:25:48.928 / 20250127 01:26:10.549 / 00:00:21.621
Message: 10 failing items removed using the --remove-keywords option.
00:00:00.422 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary {'openflow:1': '16', 'openflow:2': '14', 'openflow:3': '19'}.
Start / End / Elapsed: 20250127 01:26:10.126 / 20250127 01:26:10.548 / 00:00:00.422
00:00:00.002 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250127 01:26:10.127 / 20250127 01:26:10.129 / 00:00:00.002
00:00:00.419 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250127 01:26:10.129 / 20250127 01:26:10.548 / 00:00:00.419
00:00:00.419 ITERATION ${index} = 1  
Start / End / Elapsed: 20250127 01:26:10.129 / 20250127 01:26:10.548 / 00:00:00.419
00:00:00.412 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
Documentation:

Send a GET with the supplied uri to member ${member_index}.
Start / End / Elapsed: 20250127 01:26:10.135 / 20250127 01:26:10.547 / 00:00:00.412
00:00:00.001 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
Documentation:

Check string for occurrences of items expressed in a list of dictionaries {item=occurrences}. 0 occurences means item is not present.
Start / End / Elapsed: 20250127 01:26:10.547 / 20250127 01:26:10.548 / 00:00:00.001
00:00:00.001 FOR ${item} IN @{dictionary_item_occurrence}  
Start / End / Elapsed: 20250127 01:26:10.547 / 20250127 01:26:10.548 / 00:00:00.001
00:00:00.001 ITERATION ${item} = openflow:1  
Start / End / Elapsed: 20250127 01:26:10.547 / 20250127 01:26:10.548 / 00:00:00.001
00:00:00.000 KEYWORD BuiltIn . Should Contain X Times   ${string} ${item} ${dictionary_item_occurrence}[${item}]
Documentation:

Fails if container does not contain item count times.
Start / End / Elapsed: 20250127 01:26:10.547 / 20250127 01:26:10.547 / 00:00:00.000
01:26:10.547 INFO Item found from container 19 times.
01:26:10.548 FAIL '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}],"node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:3\']"}]},{"node-id":"openflow:3","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}]}]}}' contains 'openflow:1' 19 times, not 16 times.
01:26:10.548 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}],"node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:3\']"}]},{"node-id":"openflow:3","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}]}]}}' contains 'openflow:1' 19 times, not 16 times.
00:00:04.908 TEST Restore Network and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Restore Network and Verify After Recover
Documentation:

Take the link up and verify port status in all instances.
Start / End / Elapsed: 20250127 01:26:10.549 / 20250127 01:26:15.457 / 00:00:04.908
Status: PASS
00:00:02.471 TEST Stop Mininet and Exit
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Stop Mininet and Exit
Documentation:

Stop mininet and exit connection.
Start / End / Elapsed: 20250127 01:26:15.457 / 20250127 01:26:17.928 / 00:00:02.471
Status: PASS
00:00:20.904 TEST Check No Network Operational Information
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check No Network Operational Information
Documentation:

Check device is not in operational inventory or topology in all cluster instances.
Start / End / Elapsed: 20250127 01:26:17.929 / 20250127 01:26:38.833 / 00:00:20.904
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow' 10 times, not 0 times.
00:00:20.898 KEYWORD ClusterOpenFlow . Check No OpenFlow Network Operational Information  
Documentation:

Check device is not in operational inventory or topology in all cluster instances in ${controller_index_list}.
Start / End / Elapsed: 20250127 01:26:17.934 / 20250127 01:26:38.832 / 00:00:20.898
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   openflow=0
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250127 01:26:17.937 / 20250127 01:26:17.937 / 00:00:00.000
00:00:00.224 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_No_Content_Member_List_Or_All uri=${RFC8040_OPERATIONAL_NODES_API} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250127 01:26:17.938 / 20250127 01:26:18.162 / 00:00:00.224
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   openflow=0
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250127 01:26:18.162 / 20250127 01:26:18.162 / 00:00:00.000
00:00:20.669 KEYWORD BuiltIn . Wait Until Keyword Succeeds   20s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250127 01:26:18.163 / 20250127 01:26:38.832 / 00:00:20.669
Message: 10 failing items removed using the --remove-keywords option.
00:00:00.052 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary {'openflow': '0'}.
Start / End / Elapsed: 20250127 01:26:38.780 / 20250127 01:26:38.832 / 00:00:00.052
00:00:00.002 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250127 01:26:38.781 / 20250127 01:26:38.783 / 00:00:00.002
00:00:00.049 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250127 01:26:38.783 / 20250127 01:26:38.832 / 00:00:00.049
00:00:00.048 ITERATION ${index} = 1  
Start / End / Elapsed: 20250127 01:26:38.784 / 20250127 01:26:38.832 / 00:00:00.048
00:00:00.041 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
Documentation:

Send a GET with the supplied uri to member ${member_index}.
Start / End / Elapsed: 20250127 01:26:38.789 / 20250127 01:26:38.830 / 00:00:00.041
00:00:00.002 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
Documentation:

Check string for occurrences of items expressed in a list of dictionaries {item=occurrences}. 0 occurences means item is not present.
Start / End / Elapsed: 20250127 01:26:38.830 / 20250127 01:26:38.832 / 00:00:00.002
00:00:00.001 FOR ${item} IN @{dictionary_item_occurrence}  
Start / End / Elapsed: 20250127 01:26:38.831 / 20250127 01:26:38.832 / 00:00:00.001
00:00:00.001 ITERATION ${item} = openflow  
Start / End / Elapsed: 20250127 01:26:38.831 / 20250127 01:26:38.832 / 00:00:00.001
00:00:00.001 KEYWORD BuiltIn . Should Contain X Times   ${string} ${item} ${dictionary_item_occurrence}[${item}]
Documentation:

Fails if container does not contain item count times.
Start / End / Elapsed: 20250127 01:26:38.831 / 20250127 01:26:38.832 / 00:00:00.001
01:26:38.831 INFO Item found from container 10 times.
01:26:38.831 FAIL '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow' 10 times, not 0 times.
01:26:38.832 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow' 10 times, not 0 times.
00:03:22.625 SUITE Cluster HA Owner Restart
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart
Documentation:

Test suite for Cluster HA - Device Owner Stop and Start
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot
Start / End / Elapsed: 20250127 01:26:38.834 / 20250127 01:30:01.459 / 00:03:22.625
Status: 51 tests total, 50 passed, 1 failed, 0 skipped
00:00:03.920 SETUP SetupUtils . Setup_Utils_For_Setup_And_Teardown  
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20250127 01:26:38.901 / 20250127 01:26:42.821 / 00:00:03.920
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
Documentation:

Removes all the session objects
Start / End / Elapsed: 20250127 01:30:01.459 / 20250127 01:30:01.459 / 00:00:00.000
00:00:04.397 TEST Check Shards Status Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Check Shards Status Before Stop
Documentation:

Check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20250127 01:26:42.821 / 20250127 01:26:47.218 / 00:00:04.397
Status: PASS
00:00:08.664 TEST Start Mininet Multiple Connections
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Start Mininet Multiple Connections
Documentation:

Start mininet tree,2 with connection to all cluster instances.
Start / End / Elapsed: 20250127 01:26:47.218 / 20250127 01:26:55.882 / 00:00:08.664
Status: PASS
00:00:00.154 TEST Check Entity Owner Status And Find Owner and Successor Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Check Entity Owner Status And Find Owner and Successor Before Stop
Documentation:

Check Entity Owner Status and identify owner and successor for first switch s1.
Start / End / Elapsed: 20250127 01:26:55.883 / 20250127 01:26:56.037 / 00:00:00.154
Status: PASS
00:00:04.759 TEST Reconnect Extra Switches To Successors And Check OVS Connections
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Reconnect Extra Switches To Successors And Check OVS Connections
Documentation:

Connect switches s2 and s3 to successor instances.
Start / End / Elapsed: 20250127 01:26:56.037 / 20250127 01:27:00.796 / 00:00:04.759
Status: PASS
00:00:00.394 TEST Check Network Operational Information Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Check Network Operational Information Before Stop
Documentation:

Check devices in operational inventory and topology in all cluster instances.
Start / End / Elapsed: 20250127 01:27:00.796 / 20250127 01:27:01.190 / 00:00:00.394
Status: PASS
00:00:02.501 TEST Add Configuration In Owner and Verify Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Add Configuration In Owner and Verify Before Stop
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:27:01.191 / 20250127 01:27:03.692 / 00:00:02.501
Status: PASS
00:00:03.557 TEST Modify Configuration In Owner and Verify Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Modify Configuration In Owner and Verify Before Stop
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:27:03.693 / 20250127 01:27:07.250 / 00:00:03.557
Status: PASS
00:00:02.373 TEST Delete Configuration In Owner and Verify Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Delete Configuration In Owner and Verify Before Stop
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:27:07.250 / 20250127 01:27:09.623 / 00:00:02.373
Status: PASS
00:00:03.548 TEST Add Configuration In Successor and Verify Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Add Configuration In Successor and Verify Before Stop
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:27:09.623 / 20250127 01:27:13.171 / 00:00:03.548
Status: PASS
00:00:02.485 TEST Modify Configuration In Successor and Verify Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Modify Configuration In Successor and Verify Before Stop
Documentation:

Modify Flow in successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:27:13.171 / 20250127 01:27:15.656 / 00:00:02.485
Status: PASS
00:00:03.373 TEST Delete Configuration In Successor and Verify Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Delete Configuration In Successor and Verify Before Stop
Documentation:

Delete Flow in Successor and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:27:15.656 / 20250127 01:27:19.029 / 00:00:03.373
Status: PASS
00:00:02.637 TEST Send RPC Add to Owner and Verify Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Send RPC Add to Owner and Verify Before Stop
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:27:19.029 / 20250127 01:27:21.666 / 00:00:02.637
Status: PASS
00:00:03.580 TEST Send RPC Delete to Owner and Verify Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Send RPC Delete to Owner and Verify Before Stop
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:27:21.667 / 20250127 01:27:25.247 / 00:00:03.580
Status: PASS
00:00:02.471 TEST Send RPC Add to Successor and Verify Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Send RPC Add to Successor and Verify Before Stop
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:27:25.247 / 20250127 01:27:27.718 / 00:00:02.471
Status: PASS
00:00:03.570 TEST Send RPC Delete to Successor and Verify Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Send RPC Delete to Successor and Verify Before Stop
Documentation:

Delete Flow in Successor and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:27:27.718 / 20250127 01:27:31.288 / 00:00:03.570
Status: PASS
00:00:20.795 TEST Modify Network And Verify Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Modify Network And Verify Before Stop
Documentation:

Take a link down and verify port status in all instances.
Start / End / Elapsed: 20250127 01:27:31.288 / 20250127 01:27:52.083 / 00:00:20.795
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}],"node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'... [ Message content over the limit has been removed. ] ...ndaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}]}]}}' contains 'openflow:1' 19 times, not 16 times.
00:00:20.791 KEYWORD ClusterOpenFlow . Take OpenFlow Device Link Down and Verify  
Documentation:

Take a link down and verify port status in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250127 01:27:31.292 / 20250127 01:27:52.083 / 00:00:20.791
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   "link-down":true=1
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250127 01:27:31.294 / 20250127 01:27:31.294 / 00:00:00.000
00:00:00.008 KEYWORD ${ouput} = MininetKeywords . Send Mininet Command   ${mininet_conn_id} link s1 s2 down
Documentation:

Sends Command ${cmd} to Mininet session ${mininet_conn} and returns read buffer response.
Start / End / Elapsed: 20250127 01:27:31.300 / 20250127 01:27:31.308 / 00:00:00.008
00:00:00.113 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${operational_port_1} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250127 01:27:31.308 / 20250127 01:27:31.421 / 00:00:00.113
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   openflow:1=16 openflow:2=14 openflow:3=19
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250127 01:27:31.422 / 20250127 01:27:31.422 / 00:00:00.000
00:00:20.660 KEYWORD BuiltIn . Wait Until Keyword Succeeds   20s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250127 01:27:31.422 / 20250127 01:27:52.082 / 00:00:20.660
Message: 10 failing items removed using the --remove-keywords option.
00:00:00.058 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary {'openflow:1': '16', 'openflow:2': '14', 'openflow:3': '19'}.
Start / End / Elapsed: 20250127 01:27:52.025 / 20250127 01:27:52.083 / 00:00:00.058
00:00:00.002 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250127 01:27:52.025 / 20250127 01:27:52.027 / 00:00:00.002
00:00:00.055 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250127 01:27:52.027 / 20250127 01:27:52.082 / 00:00:00.055
00:00:00.054 ITERATION ${index} = 1  
Start / End / Elapsed: 20250127 01:27:52.028 / 20250127 01:27:52.082 / 00:00:00.054
00:00:00.041 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
Documentation:

Send a GET with the supplied uri to member ${member_index}.
Start / End / Elapsed: 20250127 01:27:52.039 / 20250127 01:27:52.080 / 00:00:00.041
00:00:00.001 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
Documentation:

Check string for occurrences of items expressed in a list of dictionaries {item=occurrences}. 0 occurences means item is not present.
Start / End / Elapsed: 20250127 01:27:52.080 / 20250127 01:27:52.081 / 00:00:00.001
00:00:00.001 FOR ${item} IN @{dictionary_item_occurrence}  
Start / End / Elapsed: 20250127 01:27:52.081 / 20250127 01:27:52.082 / 00:00:00.001
01:27:52.082 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}],"node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:3\']"}]},{"node-id":"openflow:3","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}]}]}}' contains 'openflow:1' 19 times, not 16 times.
00:00:01.366 TEST Restore Network And Verify Before Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Restore Network And Verify Before Stop
Documentation:

Take the link up and verify port status in all instances.
Start / End / Elapsed: 20250127 01:27:52.083 / 20250127 01:27:53.449 / 00:00:01.366
Status: PASS
00:00:08.773 TEST Stop Owner Instance
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Stop Owner Instance
Documentation:

Stop Owner Instance and verify it is dead
Start / End / Elapsed: 20250127 01:27:53.449 / 20250127 01:28:02.222 / 00:00:08.773
Status: PASS
00:00:02.259 TEST Check Shards Status After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Check Shards Status After Stop
Documentation:

Create original cluster list and check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20250127 01:28:02.221 / 20250127 01:28:04.480 / 00:00:02.259
Status: PASS
00:00:00.166 TEST Check Entity Owner Status And Find Owner and Successor After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Check Entity Owner Status And Find Owner and Successor After Stop
Documentation:

Check Entity Owner Status and identify owner and successor.
Start / End / Elapsed: 20250127 01:28:04.480 / 20250127 01:28:04.646 / 00:00:00.166
Status: PASS
00:00:00.248 TEST Check Network Operational Information After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Check Network Operational Information After Stop
Documentation:

Check devices in operational inventory and topology in all cluster instances.
Start / End / Elapsed: 20250127 01:28:04.646 / 20250127 01:28:04.894 / 00:00:00.248
Status: PASS
00:00:03.487 TEST Add Configuration In Owner and Verify After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Add Configuration In Owner and Verify After Stop
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:28:04.895 / 20250127 01:28:08.382 / 00:00:03.487
Status: PASS
00:00:02.397 TEST Modify Configuration In Owner and Verify After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Modify Configuration In Owner and Verify After Stop
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:28:08.382 / 20250127 01:28:10.779 / 00:00:02.397
Status: PASS
00:00:03.303 TEST Delete Configuration In Owner and Verify After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Delete Configuration In Owner and Verify After Stop
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:28:10.779 / 20250127 01:28:14.082 / 00:00:03.303
Status: PASS
00:00:04.716 TEST Add Configuration In Successor and Verify After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Add Configuration In Successor and Verify After Stop
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:28:14.082 / 20250127 01:28:18.798 / 00:00:04.716
Status: PASS
00:00:02.409 TEST Modify Configuration In Successor and Verify After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Modify Configuration In Successor and Verify After Stop
Documentation:

Modify Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:28:18.799 / 20250127 01:28:21.208 / 00:00:02.409
Status: PASS
00:00:02.255 TEST Delete Configuration In Successor and Verify After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Delete Configuration In Successor and Verify After Stop
Documentation:

Delete Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:28:21.208 / 20250127 01:28:23.463 / 00:00:02.255
Status: PASS
00:00:06.502 TEST Send RPC Add to Owner and Verify After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Send RPC Add to Owner and Verify After Stop
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:28:23.463 / 20250127 01:28:29.965 / 00:00:06.502
Status: PASS
00:00:02.793 TEST Send RPC Delete to Owner and Verify After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Send RPC Delete to Owner and Verify After Stop
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:28:29.965 / 20250127 01:28:32.758 / 00:00:02.793
Status: PASS
00:00:02.357 TEST Send RPC Add to Successor and Verify After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Send RPC Add to Successor and Verify After Stop
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:28:32.758 / 20250127 01:28:35.115 / 00:00:02.357
Status: PASS
00:00:03.577 TEST Send RPC Delete to Successor and Verify After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Send RPC Delete to Successor and Verify After Stop
Documentation:

Delete Flow in Successor and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:28:35.116 / 20250127 01:28:38.693 / 00:00:03.577
Status: PASS
00:00:00.218 TEST Modify Network and Verify After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Modify Network and Verify After Stop
Documentation:

Take a link down and verify port status in all instances.
Start / End / Elapsed: 20250127 01:28:38.692 / 20250127 01:28:38.910 / 00:00:00.218
Status: PASS
00:00:04.415 TEST Restore Network and Verify After Stop
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Restore Network and Verify After Stop
Documentation:

Take the link up and verify port status in all instances.
Start / End / Elapsed: 20250127 01:28:38.911 / 20250127 01:28:43.326 / 00:00:04.415
Status: PASS
00:00:35.183 TEST Start Old Owner Instance
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Start Old Owner Instance
Documentation:

Start old Owner Instance and verify it is up
Start / End / Elapsed: 20250127 01:28:43.326 / 20250127 01:29:18.509 / 00:00:35.183
Status: PASS
00:00:03.470 TEST Check Shards Status After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Check Shards Status After Start
Documentation:

Create original cluster list and check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20250127 01:29:18.510 / 20250127 01:29:21.980 / 00:00:03.470
Status: PASS
00:00:00.158 TEST Check Entity Owner Status After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Check Entity Owner Status After Start
Documentation:

Check Entity Owner Status and identify owner and successor.
Start / End / Elapsed: 20250127 01:29:21.980 / 20250127 01:29:22.138 / 00:00:00.158
Status: PASS
00:00:00.417 TEST Check Network Operational Information After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Check Network Operational Information After Start
Documentation:

Check devices in operational inventory and topology in all cluster instances.
Start / End / Elapsed: 20250127 01:29:22.138 / 20250127 01:29:22.555 / 00:00:00.417
Status: PASS
00:00:02.496 TEST Add Configuration In Owner and Verify After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Add Configuration In Owner and Verify After Start
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:29:22.556 / 20250127 01:29:25.052 / 00:00:02.496
Status: PASS
00:00:03.562 TEST Modify Configuration In Owner and Verify After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Modify Configuration In Owner and Verify After Start
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:29:25.053 / 20250127 01:29:28.615 / 00:00:03.562
Status: PASS
00:00:03.371 TEST Delete Configuration In Owner and Verify After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Delete Configuration In Owner and Verify After Start
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:29:28.615 / 20250127 01:29:31.986 / 00:00:03.371
Status: PASS
00:00:02.504 TEST Add Configuration In Old Owner and Verify After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Add Configuration In Old Owner and Verify After Start
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:29:31.985 / 20250127 01:29:34.489 / 00:00:02.504
Status: PASS
00:00:03.527 TEST Modify Configuration In Old Owner and Verify After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Modify Configuration In Old Owner and Verify After Start
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:29:34.489 / 20250127 01:29:38.016 / 00:00:03.527
Status: PASS
00:00:02.360 TEST Delete Configuration In Old Owner and Verify After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Delete Configuration In Old Owner and Verify After Start
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:29:38.017 / 20250127 01:29:40.377 / 00:00:02.360
Status: PASS
00:00:03.390 TEST Send RPC Add to Owner and Verify After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Send RPC Add to Owner and Verify After Start
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:29:40.377 / 20250127 01:29:43.767 / 00:00:03.390
Status: PASS
00:00:02.806 TEST Send RPC Delete to Owner and Verify After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Send RPC Delete to Owner and Verify After Start
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:29:43.768 / 20250127 01:29:46.574 / 00:00:02.806
Status: PASS
00:00:02.676 TEST Send RPC Add to Old Owner and Verify After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Send RPC Add to Old Owner and Verify After Start
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250127 01:29:46.573 / 20250127 01:29:49.249 / 00:00:02.676
Status: PASS
00:00:03.569 TEST Send RPC Delete to Old Owner and Verify After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Send RPC Delete to Old Owner and Verify After Start
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20250127 01:29:49.249 / 20250127 01:29:52.818 / 00:00:03.569
Status: PASS
00:00:01.341 TEST Modify Network and Verify After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Modify Network and Verify After Start
Documentation:

Take a link down and verify port status in all instances.
Start / End / Elapsed: 20250127 01:29:52.818 / 20250127 01:29:54.159 / 00:00:01.341
Status: PASS
00:00:04.492 TEST Restore Network and Verify After Start
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Restore Network and Verify After Start
Documentation:

Take the link up and verify port status in all instances.
Start / End / Elapsed: 20250127 01:29:54.159 / 20250127 01:29:58.651 / 00:00:04.492
Status: PASS
00:00:02.609 TEST Stop Mininet and Exit
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Stop Mininet and Exit
Documentation:

Stop mininet and exit connection.
Start / End / Elapsed: 20250127 01:29:58.652 / 20250127 01:30:01.261 / 00:00:02.609
Status: PASS
00:00:00.198 TEST Check No Network Operational Information
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart.Check No Network Operational Information
Documentation:

Check device is not in operational inventory or topology in all cluster instances.
Start / End / Elapsed: 20250127 01:30:01.261 / 20250127 01:30:01.459 / 00:00:00.198
Status: PASS
00:05:36.332 SUITE Cluster HA Data Recovery Leader Follower Failover
Full Name: openflowplugin-clustering.txt.Cluster HA Data Recovery Leader Follower Failover
Documentation:

Test suite for Cluster HA - Data Recovery at Leader Follower failover and cluster restart
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot
Start / End / Elapsed: 20250127 01:30:01.460 / 20250127 01:35:37.792 / 00:05:36.332
Status: 21 tests total, 21 passed, 0 failed, 0 skipped
00:09:30.958 SUITE 010 Group Flows
Full Name: openflowplugin-clustering.txt.010 Group Flows
Documentation:

Switch connections and cluster are restarted.
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot
Start / End / Elapsed: 20250127 01:35:37.794 / 20250127 01:45:08.752 / 00:09:30.958
Status: 72 tests total, 65 passed, 7 failed, 0 skipped
00:00:04.809 SUITE 010 Switch Disconnect
Full Name: openflowplugin-clustering.txt.010 Switch Disconnect
Documentation:

Test suite for entity ownership service and openflowplugin. Makes changes on switch side.
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot
Start / End / Elapsed: 20250127 01:45:08.754 / 20250127 01:45:13.563 / 00:00:04.809
Status: 3 tests total, 0 passed, 3 failed, 0 skipped
Message: Suite setup failed: Dictionary does not contain key 's1'.
00:00:04.353 SUITE 020 Cluster Node Failure
Full Name: openflowplugin-clustering.txt.020 Cluster Node Failure
Documentation:

Test suite for entity ownership service and openflowplugin. Makes changes on controller side (restart karaf)
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot
Start / End / Elapsed: 20250127 01:45:13.564 / 20250127 01:45:17.917 / 00:00:04.353
Status: 3 tests total, 0 passed, 3 failed, 0 skipped
Message: Suite setup failed: Dictionary does not contain key 's1'.
00:01:24.269 SUITE 030 Cluster Sync Problems
Full Name: openflowplugin-clustering.txt.030 Cluster Sync Problems
Documentation:

Test suite for entity ownership service and openflowplugin. Makes changes on controller side (isolating cluster node)
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot
Start / End / Elapsed: 20250127 01:45:17.918 / 20250127 01:46:42.187 / 00:01:24.269
Status: 5 tests total, 0 passed, 5 failed, 0 skipped
00:00:08.341 SUITE 9145
Full Name: openflowplugin-clustering.txt.9145
Documentation:

Switch connections and cluster are restarted.
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot
Start / End / Elapsed: 20250127 01:46:42.188 / 20250127 01:46:50.529 / 00:00:08.341
Status: 3 tests total, 3 passed, 0 failed, 0 skipped