Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
20918524000:24:22
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
https://bugs.opendaylight.org/show_bug.cgi?id=6177
303000:01:02
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
openflowplugin-clustering.txt
20918524000:24:54
openflowplugin-clustering . txt . Cluster HA Owner Failover
51492000:03:59
openflowplugin-clustering . txt . Cluster HA Owner Restart
51474000:04:12
openflowplugin-clustering . txt . Cluster HA Data Recovery Leader Follower Failover
21210000:05:38
openflowplugin-clustering . txt . 010 Group Flows
72657000:09:22
openflowplugin-clustering . txt . 010 Switch Disconnect
303000:00:05
openflowplugin-clustering . txt . 020 Cluster Node Failure
303000:00:04
openflowplugin-clustering . txt . 030 Cluster Sync Problems
505000:01:25
openflowplugin-clustering . txt . 9145
330000:00:09

Test Execution Log

00:24:53.769 SUITE openflowplugin-clustering.txt
Full Name: openflowplugin-clustering.txt
Start / End / Elapsed: 20241202 04:49:11.732 / 20241202 05:14:05.501 / 00:24:53.769
Status: 209 tests total, 185 passed, 24 failed, 0 skipped
00:03:58.925 SUITE Cluster HA Owner Failover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover
Documentation:

Test suite for Cluster HA - Device Owner failover
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-calcium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot
Start / End / Elapsed: 20241202 04:49:11.754 / 20241202 04:53:10.679 / 00:03:58.925
Status: 51 tests total, 49 passed, 2 failed, 0 skipped
00:00:05.340 SETUP SetupUtils . Setup_Utils_For_Setup_And_Teardown  
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20241202 04:49:12.273 / 20241202 04:49:17.613 / 00:00:05.340
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
Documentation:

Removes all the session objects
Start / End / Elapsed: 20241202 04:53:10.679 / 20241202 04:53:10.679 / 00:00:00.000
00:00:10.491 TEST Check Shards Status Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Shards Status Before Fail
Documentation:

Check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20241202 04:49:17.613 / 20241202 04:49:28.104 / 00:00:10.491
Status: PASS
00:00:08.757 TEST Start Mininet Multiple Connections
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Start Mininet Multiple Connections
Documentation:

Start mininet tree,2 with connection to all cluster instances.
Start / End / Elapsed: 20241202 04:49:28.104 / 20241202 04:49:36.861 / 00:00:08.757
Status: PASS
00:00:00.192 TEST Check Entity Owner Status And Find Owner and Successor Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Entity Owner Status And Find Owner and Successor Before Fail
Documentation:

Check Entity Owner Status and identify owner and successor for first switch s1.
Start / End / Elapsed: 20241202 04:49:36.861 / 20241202 04:49:37.053 / 00:00:00.192
Status: PASS
00:00:04.777 TEST Reconnect Extra Switches To Successors And Check OVS Connections
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Reconnect Extra Switches To Successors And Check OVS Connections
Documentation:

Connect switches s2 and s3 to successor instances.
Start / End / Elapsed: 20241202 04:49:37.054 / 20241202 04:49:41.831 / 00:00:04.777
Status: PASS
00:00:00.523 TEST Check Network Operational Information Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Network Operational Information Before Fail
Documentation:

Check devices in operational inventory and topology in all cluster instances.
Start / End / Elapsed: 20241202 04:49:41.832 / 20241202 04:49:42.355 / 00:00:00.523
Status: PASS
00:00:03.592 TEST Add Configuration In Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Owner and Verify Before Fail
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:49:42.355 / 20241202 04:49:45.947 / 00:00:03.592
Status: PASS
00:00:02.501 TEST Modify Configuration In Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Owner and Verify Before Fail
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:49:45.947 / 20241202 04:49:48.448 / 00:00:02.501
Status: PASS
00:00:03.426 TEST Delete Configuration In Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Owner and Verify Before Fail
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:49:48.448 / 20241202 04:49:51.874 / 00:00:03.426
Status: PASS
00:00:02.569 TEST Add Configuration In Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Successor and Verify Before Fail
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:49:51.874 / 20241202 04:49:54.443 / 00:00:02.569
Status: PASS
00:00:03.561 TEST Modify Configuration In Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Successor and Verify Before Fail
Documentation:

Modify Flow in successor and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:49:54.443 / 20241202 04:49:58.004 / 00:00:03.561
Status: PASS
00:00:03.375 TEST Delete Configuration In Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Successor and Verify Before Fail
Documentation:

Delete Flow in Successor and verify it gets removed from all instances.
Start / End / Elapsed: 20241202 04:49:58.004 / 20241202 04:50:01.379 / 00:00:03.375
Status: PASS
00:00:02.880 TEST Send RPC Add to Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Owner and Verify Before Fail
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:50:01.379 / 20241202 04:50:04.259 / 00:00:02.880
Status: PASS
00:00:02.877 TEST Send RPC Delete to Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Owner and Verify Before Fail
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20241202 04:50:04.260 / 20241202 04:50:07.137 / 00:00:02.877
Status: PASS
00:00:02.411 TEST Send RPC Add to Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Successor and Verify Before Fail
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:50:07.137 / 20241202 04:50:09.548 / 00:00:02.411
Status: PASS
00:00:03.571 TEST Send RPC Delete to Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Successor and Verify Before Fail
Documentation:

Delete Flow in Successor and verify it gets removed from all instances.
Start / End / Elapsed: 20241202 04:50:09.549 / 20241202 04:50:13.120 / 00:00:03.571
Status: PASS
00:00:00.353 TEST Modify Network And Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Network And Verify Before Fail
Documentation:

Take a link down and verify port status in all instances.
Start / End / Elapsed: 20241202 04:50:13.120 / 20241202 04:50:13.473 / 00:00:00.353
Status: PASS
00:00:05.603 TEST Restore Network And Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Restore Network And Verify Before Fail
Documentation:

Take the link up and verify port status in all instances.
Start / End / Elapsed: 20241202 04:50:13.473 / 20241202 04:50:19.076 / 00:00:05.603
Status: PASS
00:00:04.090 TEST Kill Owner Instance
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Kill Owner Instance
Documentation:

Kill Owner Instance and verify it is dead
Start / End / Elapsed: 20241202 04:50:19.076 / 20241202 04:50:23.166 / 00:00:04.090
Status: PASS
00:00:21.291 TEST Check Shards Status After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Shards Status After Fail
Documentation:

Create original cluster list and check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20241202 04:50:23.167 / 20241202 04:50:44.458 / 00:00:21.291
Status: PASS
00:00:00.178 TEST Check Entity Owner Status And Find Owner and Successor After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Entity Owner Status And Find Owner and Successor After Fail
Documentation:

Check Entity Owner Status and identify owner and successor.
Start / End / Elapsed: 20241202 04:50:44.458 / 20241202 04:50:44.636 / 00:00:00.178
Status: PASS
00:00:00.263 TEST Check Network Operational Information After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Network Operational Information After Fail
Documentation:

Check devices in operational inventory and topology in all cluster instances.
Start / End / Elapsed: 20241202 04:50:44.636 / 20241202 04:50:44.899 / 00:00:00.263
Status: PASS
00:00:02.444 TEST Add Configuration In Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Owner and Verify After Fail
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:50:44.899 / 20241202 04:50:47.343 / 00:00:02.444
Status: PASS
00:00:02.405 TEST Modify Configuration In Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Owner and Verify After Fail
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:50:47.343 / 20241202 04:50:49.748 / 00:00:02.405
Status: PASS
00:00:03.333 TEST Delete Configuration In Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Owner and Verify After Fail
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:50:49.748 / 20241202 04:50:53.081 / 00:00:03.333
Status: PASS
00:00:02.434 TEST Add Configuration In Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Successor and Verify After Fail
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:50:53.082 / 20241202 04:50:55.516 / 00:00:02.434
Status: PASS
00:00:03.468 TEST Modify Configuration In Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Successor and Verify After Fail
Documentation:

Modify Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:50:55.516 / 20241202 04:50:58.984 / 00:00:03.468
Status: PASS
00:00:03.328 TEST Delete Configuration In Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Successor and Verify After Fail
Documentation:

Delete Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:50:58.984 / 20241202 04:51:02.312 / 00:00:03.328
Status: PASS
00:00:02.820 TEST Send RPC Add to Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Owner and Verify After Fail
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:51:02.313 / 20241202 04:51:05.133 / 00:00:02.820
Status: PASS
00:00:02.593 TEST Send RPC Delete to Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Owner and Verify After Fail
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20241202 04:51:05.133 / 20241202 04:51:07.726 / 00:00:02.593
Status: PASS
00:00:03.520 TEST Send RPC Add to Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Successor and Verify After Fail
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:51:07.726 / 20241202 04:51:11.246 / 00:00:03.520
Status: PASS
00:00:02.462 TEST Send RPC Delete to Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Successor and Verify After Fail
Documentation:

Delete Flow in Successor and verify it gets removed from all instances.
Start / End / Elapsed: 20241202 04:51:11.247 / 20241202 04:51:13.709 / 00:00:02.462
Status: PASS
00:00:01.285 TEST Modify Network and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Network and Verify After Fail
Documentation:

Take a link down and verify port status in all instances.
Start / End / Elapsed: 20241202 04:51:13.709 / 20241202 04:51:14.994 / 00:00:01.285
Status: PASS
00:00:04.462 TEST Restore Network and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Restore Network and Verify After Fail
Documentation:

Take the link up and verify port status in all instances.
Start / End / Elapsed: 20241202 04:51:14.995 / 20241202 04:51:19.457 / 00:00:04.462
Status: PASS
00:00:34.872 TEST Start Old Owner Instance
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Start Old Owner Instance
Documentation:

Start old Owner Instance and verify it is up
Start / End / Elapsed: 20241202 04:51:19.457 / 20241202 04:51:54.329 / 00:00:34.872
Status: PASS
00:00:03.676 TEST Check Shards Status After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Shards Status After Recover
Documentation:

Create original cluster list and check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20241202 04:51:54.330 / 20241202 04:51:58.006 / 00:00:03.676
Status: PASS
00:00:00.226 TEST Check Entity Owner Status After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Entity Owner Status After Recover
Documentation:

Check Entity Owner Status and identify owner and successor.
Start / End / Elapsed: 20241202 04:51:58.006 / 20241202 04:51:58.232 / 00:00:00.226
Status: PASS
00:00:00.424 TEST Check Network Operational Information After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Network Operational Information After Recover
Documentation:

Check devices in operational inventory and topology in all cluster instances.
Start / End / Elapsed: 20241202 04:51:58.232 / 20241202 04:51:58.656 / 00:00:00.424
Status: PASS
00:00:01.454 TEST Add Configuration In Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Owner and Verify After Recover
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:51:58.657 / 20241202 04:52:00.111 / 00:00:01.454
Status: PASS
00:00:02.515 TEST Modify Configuration In Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Owner and Verify After Recover
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:52:00.111 / 20241202 04:52:02.626 / 00:00:02.515
Status: PASS
00:00:03.388 TEST Delete Configuration In Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Owner and Verify After Recover
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:52:02.626 / 20241202 04:52:06.014 / 00:00:03.388
Status: PASS
00:00:02.527 TEST Add Configuration In Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Old Owner and Verify After Recover
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:52:06.014 / 20241202 04:52:08.541 / 00:00:02.527
Status: PASS
00:00:03.566 TEST Modify Configuration In Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Old Owner and Verify After Recover
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:52:08.541 / 20241202 04:52:12.107 / 00:00:03.566
Status: PASS
00:00:02.343 TEST Delete Configuration In Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Old Owner and Verify After Recover
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:52:12.108 / 20241202 04:52:14.451 / 00:00:02.343
Status: PASS
00:00:03.461 TEST Send RPC Add to Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Owner and Verify After Recover
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:52:14.451 / 20241202 04:52:17.912 / 00:00:03.461
Status: PASS
00:00:02.493 TEST Send RPC Delete to Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Owner and Verify After Recover
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20241202 04:52:17.912 / 20241202 04:52:20.405 / 00:00:02.493
Status: PASS
00:00:03.552 TEST Send RPC Add to Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Old Owner and Verify After Recover
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20241202 04:52:20.405 / 20241202 04:52:23.957 / 00:00:03.552
Status: PASS
00:00:02.459 TEST Send RPC Delete to Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Old Owner and Verify After Recover
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20241202 04:52:23.957 / 20241202 04:52:26.416 / 00:00:02.459
Status: PASS
00:00:20.838 TEST Modify Network and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Network and Verify After Recover
Documentation:

Take a link down and verify port status in all instances.
Start / End / Elapsed: 20241202 04:52:26.416 / 20241202 04:52:47.254 / 00:00:20.838
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:2:3","source":{"source-node":"openflow:2","source-tp":"openflow:2:3"},"destination":{"dest-tp":"openflow:1:1","dest-node":"openflow:1"}},{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}],"node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp... [ Message content over the limit has been removed. ] ...ndaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}]}]}}' contains 'openflow:1' 21 times, not 16 times.
00:00:20.833 KEYWORD ClusterOpenFlow . Take OpenFlow Device Link Down and Verify  
Documentation:

Take a link down and verify port status in all instances in ${controller_index_list}.
Start / End / Elapsed: 20241202 04:52:26.421 / 20241202 04:52:47.254 / 00:00:20.833
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   "link-down":true=1
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20241202 04:52:26.423 / 20241202 04:52:26.423 / 00:00:00.000
00:00:00.044 KEYWORD ${ouput} = MininetKeywords . Send Mininet Command   ${mininet_conn_id} link s1 s2 down
Documentation:

Sends Command ${cmd} to Mininet session ${mininet_conn} and returns read buffer response.
Start / End / Elapsed: 20241202 04:52:26.431 / 20241202 04:52:26.475 / 00:00:00.044
00:00:00.125 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${operational_port_1} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20241202 04:52:26.475 / 20241202 04:52:26.600 / 00:00:00.125
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   openflow:1=16 openflow:2=14 openflow:3=19
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20241202 04:52:26.601 / 20241202 04:52:26.601 / 00:00:00.000
00:00:20.653 KEYWORD BuiltIn . Wait Until Keyword Succeeds   20s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20241202 04:52:26.601 / 20241202 04:52:47.254 / 00:00:20.653
Message: 10 failing items removed using the --remove-keywords option.
00:00:00.045 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary {'openflow:1': '16', 'openflow:2': '14', 'openflow:3': '19'}.
Start / End / Elapsed: 20241202 04:52:47.209 / 20241202 04:52:47.254 / 00:00:00.045
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20241202 04:52:47.209 / 20241202 04:52:47.210 / 00:00:00.001
00:00:00.043 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20241202 04:52:47.211 / 20241202 04:52:47.254 / 00:00:00.043
00:00:00.043 ITERATION ${index} = 1  
Start / End / Elapsed: 20241202 04:52:47.211 / 20241202 04:52:47.254 / 00:00:00.043
00:00:00.037 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
Documentation:

Send a GET with the supplied uri to member ${member_index}.
Start / End / Elapsed: 20241202 04:52:47.215 / 20241202 04:52:47.252 / 00:00:00.037
00:00:00.001 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
Documentation:

Check string for occurrences of items expressed in a list of dictionaries {item=occurrences}. 0 occurences means item is not present.
Start / End / Elapsed: 20241202 04:52:47.252 / 20241202 04:52:47.253 / 00:00:00.001
00:00:00.001 FOR ${item} IN @{dictionary_item_occurrence}  
Start / End / Elapsed: 20241202 04:52:47.253 / 20241202 04:52:47.254 / 00:00:00.001
00:00:00.001 ITERATION ${item} = openflow:1  
Start / End / Elapsed: 20241202 04:52:47.253 / 20241202 04:52:47.254 / 00:00:00.001
00:00:00.000 KEYWORD BuiltIn . Should Contain X Times   ${string} ${item} ${dictionary_item_occurrence}[${item}]
Documentation:

Fails if container does not contain item count times.
Start / End / Elapsed: 20241202 04:52:47.253 / 20241202 04:52:47.253 / 00:00:00.000
04:52:47.254 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:2:3","source":{"source-node":"openflow:2","source-tp":"openflow:2:3"},"destination":{"dest-tp":"openflow:1:1","dest-node":"openflow:1"}},{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}],"node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'ope... [ Message content over the limit has been removed. ] ...ndaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}]}]}}' contains 'openflow:1' 21 times, not 16 times.
00:00:00.296 TEST Restore Network and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Restore Network and Verify After Recover
Documentation:

Take the link up and verify port status in all instances.
Start / End / Elapsed: 20241202 04:52:47.255 / 20241202 04:52:47.551 / 00:00:00.296
Status: PASS
00:00:02.371 TEST Stop Mininet and Exit
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Stop Mininet and Exit
Documentation:

Stop mininet and exit connection.
Start / End / Elapsed: 20241202 04:52:47.551 / 20241202 04:52:49.922 / 00:00:02.371
Status: PASS
00:00:20.755 TEST Check No Network Operational Information
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check No Network Operational Information
Documentation:

Check device is not in operational inventory or topology in all cluster instances.
Start / End / Elapsed: 20241202 04:52:49.923 / 20241202 04:53:10.678 / 00:00:20.755
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:2:3","source":{"source-node":"openflow:2","source-tp":"openflow:2:3"},"destination":{"dest-tp":"openflow:1:1","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}}]}]}}' contains 'openflow' 10 times, not 0 times.
00:04:11.638 SUITE Cluster HA Owner Restart
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart
Documentation:

Test suite for Cluster HA - Device Owner Stop and Start
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-calcium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot
Start / End / Elapsed: 20241202 04:53:10.680 / 20241202 04:57:22.318 / 00:04:11.638
Status: 51 tests total, 47 passed, 4 failed, 0 skipped
00:05:38.422 SUITE Cluster HA Data Recovery Leader Follower Failover
Full Name: openflowplugin-clustering.txt.Cluster HA Data Recovery Leader Follower Failover
Documentation:

Test suite for Cluster HA - Data Recovery at Leader Follower failover and cluster restart
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-calcium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot
Start / End / Elapsed: 20241202 04:57:22.319 / 20241202 05:03:00.741 / 00:05:38.422
Status: 21 tests total, 21 passed, 0 failed, 0 skipped
00:09:22.172 SUITE 010 Group Flows
Full Name: openflowplugin-clustering.txt.010 Group Flows
Documentation:

Switch connections and cluster are restarted.
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-calcium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot
Start / End / Elapsed: 20241202 05:03:00.742 / 20241202 05:12:22.914 / 00:09:22.172
Status: 72 tests total, 65 passed, 7 failed, 0 skipped
00:00:04.817 SUITE 010 Switch Disconnect
Full Name: openflowplugin-clustering.txt.010 Switch Disconnect
Documentation:

Test suite for entity ownership service and openflowplugin. Makes changes on switch side.
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-calcium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot
Start / End / Elapsed: 20241202 05:12:22.916 / 20241202 05:12:27.733 / 00:00:04.817
Status: 3 tests total, 0 passed, 3 failed, 0 skipped
Message: Suite setup failed: Dictionary does not contain key 's1'.
00:00:04.346 SUITE 020 Cluster Node Failure
Full Name: openflowplugin-clustering.txt.020 Cluster Node Failure
Documentation:

Test suite for entity ownership service and openflowplugin. Makes changes on controller side (restart karaf)
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-calcium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot
Start / End / Elapsed: 20241202 05:12:27.734 / 20241202 05:12:32.080 / 00:00:04.346
Status: 3 tests total, 0 passed, 3 failed, 0 skipped
Message: Suite setup failed: Dictionary does not contain key 's1'.
00:01:24.634 SUITE 030 Cluster Sync Problems
Full Name: openflowplugin-clustering.txt.030 Cluster Sync Problems
Documentation:

Test suite for entity ownership service and openflowplugin. Makes changes on controller side (isolating cluster node)
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-calcium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot
Start / End / Elapsed: 20241202 05:12:32.081 / 20241202 05:13:56.715 / 00:01:24.634
Status: 5 tests total, 0 passed, 5 failed, 0 skipped
00:00:08.784 SUITE 9145
Full Name: openflowplugin-clustering.txt.9145
Documentation:

Switch connections and cluster are restarted.
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-calcium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot
Start / End / Elapsed: 20241202 05:13:56.716 / 20241202 05:14:05.500 / 00:00:08.784
Status: 3 tests total, 3 passed, 0 failed, 0 skipped