Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
20918326000:24:56
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
https://bugs.opendaylight.org/show_bug.cgi?id=6177
303000:01:03
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
openflowplugin-clustering.txt
20918326000:25:30
openflowplugin-clustering . txt . Cluster HA Owner Failover
51474000:04:37
openflowplugin-clustering . txt . Cluster HA Owner Restart
51474000:04:08
openflowplugin-clustering . txt . Cluster HA Data Recovery Leader Follower Failover
21210000:05:40
openflowplugin-clustering . txt . 010 Group Flows
72657000:09:20
openflowplugin-clustering . txt . 010 Switch Disconnect
303000:00:05
openflowplugin-clustering . txt . 020 Cluster Node Failure
303000:00:04
openflowplugin-clustering . txt . 030 Cluster Sync Problems
505000:01:28
openflowplugin-clustering . txt . 9145
330000:00:08

Test Execution Log

00:25:30.155 SUITE openflowplugin-clustering.txt
Full Name: openflowplugin-clustering.txt
Start / End / Elapsed: 20250313 02:15:03.258 / 20250313 02:40:33.413 / 00:25:30.155
Status: 209 tests total, 183 passed, 26 failed, 0 skipped
00:04:36.742 SUITE Cluster HA Owner Failover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover
Documentation:

Test suite for Cluster HA - Device Owner failover
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-titanium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot
Start / End / Elapsed: 20250313 02:15:03.283 / 20250313 02:19:40.025 / 00:04:36.742
Status: 51 tests total, 47 passed, 4 failed, 0 skipped
00:00:05.292 SETUP SetupUtils . Setup_Utils_For_Setup_And_Teardown  
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20250313 02:15:03.823 / 20250313 02:15:09.115 / 00:00:05.292
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
Documentation:

Removes all the session objects
Start / End / Elapsed: 20250313 02:19:40.025 / 20250313 02:19:40.025 / 00:00:00.000
00:00:09.745 TEST Check Shards Status Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Shards Status Before Fail
Documentation:

Check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20250313 02:15:09.115 / 20250313 02:15:18.860 / 00:00:09.745
Status: PASS
00:00:09.394 TEST Start Mininet Multiple Connections
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Start Mininet Multiple Connections
Documentation:

Start mininet tree,2 with connection to all cluster instances.
Start / End / Elapsed: 20250313 02:15:18.860 / 20250313 02:15:28.254 / 00:00:09.394
Status: PASS
00:00:00.228 TEST Check Entity Owner Status And Find Owner and Successor Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Entity Owner Status And Find Owner and Successor Before Fail
Documentation:

Check Entity Owner Status and identify owner and successor for first switch s1.
Start / End / Elapsed: 20250313 02:15:28.255 / 20250313 02:15:28.483 / 00:00:00.228
Status: PASS
00:00:05.063 TEST Reconnect Extra Switches To Successors And Check OVS Connections
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Reconnect Extra Switches To Successors And Check OVS Connections
Documentation:

Connect switches s2 and s3 to successor instances.
Start / End / Elapsed: 20250313 02:15:28.483 / 20250313 02:15:33.546 / 00:00:05.063
Status: PASS
00:00:00.471 TEST Check Network Operational Information Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Network Operational Information Before Fail
Documentation:

Check devices in operational inventory and topology in all cluster instances.
Start / End / Elapsed: 20250313 02:15:33.546 / 20250313 02:15:34.017 / 00:00:00.471
Status: PASS
00:00:02.531 TEST Add Configuration In Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Owner and Verify Before Fail
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:15:34.017 / 20250313 02:15:36.548 / 00:00:02.531
Status: PASS
00:00:03.614 TEST Modify Configuration In Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Owner and Verify Before Fail
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:15:36.549 / 20250313 02:15:40.163 / 00:00:03.614
Status: PASS
00:00:03.409 TEST Delete Configuration In Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Owner and Verify Before Fail
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:15:40.163 / 20250313 02:15:43.572 / 00:00:03.409
Status: PASS
00:00:02.556 TEST Add Configuration In Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Successor and Verify Before Fail
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:15:43.571 / 20250313 02:15:46.127 / 00:00:02.556
Status: PASS
00:00:02.532 TEST Modify Configuration In Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Successor and Verify Before Fail
Documentation:

Modify Flow in successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:15:46.128 / 20250313 02:15:48.660 / 00:00:02.532
Status: PASS
00:00:03.387 TEST Delete Configuration In Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Successor and Verify Before Fail
Documentation:

Delete Flow in Successor and verify it gets removed from all instances.
Start / End / Elapsed: 20250313 02:15:48.660 / 20250313 02:15:52.047 / 00:00:03.387
Status: PASS
00:00:03.561 TEST Send RPC Add to Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Owner and Verify Before Fail
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:15:52.047 / 20250313 02:15:55.608 / 00:00:03.561
Status: PASS
00:00:02.852 TEST Send RPC Delete to Owner and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Owner and Verify Before Fail
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20250313 02:15:55.609 / 20250313 02:15:58.461 / 00:00:02.852
Status: PASS
00:00:02.909 TEST Send RPC Add to Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Successor and Verify Before Fail
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:15:58.461 / 20250313 02:16:01.370 / 00:00:02.909
Status: PASS
00:00:02.437 TEST Send RPC Delete to Successor and Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Successor and Verify Before Fail
Documentation:

Delete Flow in Successor and verify it gets removed from all instances.
Start / End / Elapsed: 20250313 02:16:01.370 / 20250313 02:16:03.807 / 00:00:02.437
Status: PASS
00:00:20.844 TEST Modify Network And Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Network And Verify Before Fail
Documentation:

Take a link down and verify port status in all instances.
Start / End / Elapsed: 20250313 02:16:03.807 / 20250313 02:16:24.651 / 00:00:20.844
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:3\']"}]},{"node-id":"openflow:3","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/nod... [ Message content over the limit has been removed. ] ...3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}],"link":[{"link-id":"openflow:2:3","source":{"source-node":"openflow:2","source-tp":"openflow:2:3"},"destination":{"dest-tp":"openflow:1:1","dest-node":"openflow:1"}},{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow:1' 21 times, not 16 times.
00:00:20.839 KEYWORD ClusterOpenFlow . Take OpenFlow Device Link Down and Verify  
Documentation:

Take a link down and verify port status in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250313 02:16:03.811 / 20250313 02:16:24.650 / 00:00:20.839
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   "link-down":true=1
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250313 02:16:03.814 / 20250313 02:16:03.814 / 00:00:00.000
00:00:00.021 KEYWORD ${ouput} = MininetKeywords . Send Mininet Command   ${mininet_conn_id} link s1 s2 down
Documentation:

Sends Command ${cmd} to Mininet session ${mininet_conn} and returns read buffer response.
Start / End / Elapsed: 20250313 02:16:03.821 / 20250313 02:16:03.842 / 00:00:00.021
00:00:00.135 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${operational_port_1} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250313 02:16:03.842 / 20250313 02:16:03.977 / 00:00:00.135
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   openflow:1=16 openflow:2=14 openflow:3=19
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250313 02:16:03.977 / 20250313 02:16:03.977 / 00:00:00.000
00:00:20.673 KEYWORD BuiltIn . Wait Until Keyword Succeeds   20s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250313 02:16:03.977 / 20250313 02:16:24.650 / 00:00:20.673
Message: 10 failing items removed using the --remove-keywords option.
00:00:00.058 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary {'openflow:1': '16', 'openflow:2': '14', 'openflow:3': '19'}.
Start / End / Elapsed: 20250313 02:16:24.592 / 20250313 02:16:24.650 / 00:00:00.058
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250313 02:16:24.593 / 20250313 02:16:24.594 / 00:00:00.001
00:00:00.055 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250313 02:16:24.594 / 20250313 02:16:24.649 / 00:00:00.055
00:00:00.055 ITERATION ${index} = 1  
Start / End / Elapsed: 20250313 02:16:24.595 / 20250313 02:16:24.650 / 00:00:00.055
02:16:24.650 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:3\']"}]},{"node-id":"openflow:3","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-n... [ Message content over the limit has been removed. ] ...3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}],"link":[{"link-id":"openflow:2:3","source":{"source-node":"openflow:2","source-tp":"openflow:2:3"},"destination":{"dest-tp":"openflow:1:1","dest-node":"openflow:1"}},{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow:1' 21 times, not 16 times.
00:00:00.402 TEST Restore Network And Verify Before Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Restore Network And Verify Before Fail
Documentation:

Take the link up and verify port status in all instances.
Start / End / Elapsed: 20250313 02:16:24.651 / 20250313 02:16:25.053 / 00:00:00.402
Status: PASS
00:00:04.154 TEST Kill Owner Instance
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Kill Owner Instance
Documentation:

Kill Owner Instance and verify it is dead
Start / End / Elapsed: 20250313 02:16:25.054 / 20250313 02:16:29.208 / 00:00:04.154
Status: PASS
00:00:02.308 TEST Check Shards Status After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Shards Status After Fail
Documentation:

Create original cluster list and check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20250313 02:16:29.208 / 20250313 02:16:31.516 / 00:00:02.308
Status: PASS
00:00:14.168 TEST Check Entity Owner Status And Find Owner and Successor After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Entity Owner Status And Find Owner and Successor After Fail
Documentation:

Check Entity Owner Status and identify owner and successor.
Start / End / Elapsed: 20250313 02:16:31.517 / 20250313 02:16:45.685 / 00:00:14.168
Status: PASS
00:00:00.266 TEST Check Network Operational Information After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Network Operational Information After Fail
Documentation:

Check devices in operational inventory and topology in all cluster instances.
Start / End / Elapsed: 20250313 02:16:45.685 / 20250313 02:16:45.951 / 00:00:00.266
Status: PASS
00:00:03.438 TEST Add Configuration In Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Owner and Verify After Fail
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:16:45.951 / 20250313 02:16:49.389 / 00:00:03.438
Status: PASS
00:00:03.499 TEST Modify Configuration In Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Owner and Verify After Fail
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:16:49.390 / 20250313 02:16:52.889 / 00:00:03.499
Status: PASS
00:00:02.249 TEST Delete Configuration In Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Owner and Verify After Fail
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:16:52.889 / 20250313 02:16:55.138 / 00:00:02.249
Status: PASS
00:00:03.845 TEST Add Configuration In Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Successor and Verify After Fail
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:16:55.138 / 20250313 02:16:58.983 / 00:00:03.845
Status: PASS
00:00:02.386 TEST Modify Configuration In Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Successor and Verify After Fail
Documentation:

Modify Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:16:58.983 / 20250313 02:17:01.369 / 00:00:02.386
Status: PASS
00:00:03.296 TEST Delete Configuration In Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Successor and Verify After Fail
Documentation:

Delete Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:17:01.369 / 20250313 02:17:04.665 / 00:00:03.296
Status: PASS
00:00:02.487 TEST Send RPC Add to Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Owner and Verify After Fail
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:17:04.665 / 20250313 02:17:07.152 / 00:00:02.487
Status: PASS
00:00:03.628 TEST Send RPC Delete to Owner and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Owner and Verify After Fail
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20250313 02:17:07.152 / 20250313 02:17:10.780 / 00:00:03.628
Status: PASS
00:00:02.431 TEST Send RPC Add to Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Successor and Verify After Fail
Documentation:

Add Flow in Successor and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:17:10.780 / 20250313 02:17:13.211 / 00:00:02.431
Status: PASS
00:00:03.550 TEST Send RPC Delete to Successor and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Successor and Verify After Fail
Documentation:

Delete Flow in Successor and verify it gets removed from all instances.
Start / End / Elapsed: 20250313 02:17:13.211 / 20250313 02:17:16.761 / 00:00:03.550
Status: PASS
00:00:20.766 TEST Modify Network and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Network and Verify After Fail
Documentation:

Take a link down and verify port status in all instances.
Start / End / Elapsed: 20250313 02:17:16.762 / 20250313 02:17:37.528 / 00:00:20.766
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:3\']"}]},{"node-id":"openflow:3","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/nod... [ Message content over the limit has been removed. ] ...ogy-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}],"link":[{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow:1' 19 times, not 16 times.
00:00:04.466 TEST Restore Network and Verify After Fail
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Restore Network and Verify After Fail
Documentation:

Take the link up and verify port status in all instances.
Start / End / Elapsed: 20250313 02:17:37.529 / 20250313 02:17:41.995 / 00:00:04.466
Status: PASS
00:00:35.068 TEST Start Old Owner Instance
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Start Old Owner Instance
Documentation:

Start old Owner Instance and verify it is up
Start / End / Elapsed: 20250313 02:17:41.995 / 20250313 02:18:17.063 / 00:00:35.068
Status: PASS
00:00:03.548 TEST Check Shards Status After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Shards Status After Recover
Documentation:

Create original cluster list and check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20250313 02:18:17.063 / 20250313 02:18:20.611 / 00:00:03.548
Status: PASS
00:00:00.212 TEST Check Entity Owner Status After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Entity Owner Status After Recover
Documentation:

Check Entity Owner Status and identify owner and successor.
Start / End / Elapsed: 20250313 02:18:20.611 / 20250313 02:18:20.823 / 00:00:00.212
Status: PASS
00:00:00.423 TEST Check Network Operational Information After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check Network Operational Information After Recover
Documentation:

Check devices in operational inventory and topology in all cluster instances.
Start / End / Elapsed: 20250313 02:18:20.823 / 20250313 02:18:21.246 / 00:00:00.423
Status: PASS
00:00:02.491 TEST Add Configuration In Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Owner and Verify After Recover
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:18:21.246 / 20250313 02:18:23.737 / 00:00:02.491
Status: PASS
00:00:03.549 TEST Modify Configuration In Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Owner and Verify After Recover
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:18:23.737 / 20250313 02:18:27.286 / 00:00:03.549
Status: PASS
00:00:02.353 TEST Delete Configuration In Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Owner and Verify After Recover
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:18:27.286 / 20250313 02:18:29.639 / 00:00:02.353
Status: PASS
00:00:03.562 TEST Add Configuration In Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Add Configuration In Old Owner and Verify After Recover
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:18:29.639 / 20250313 02:18:33.201 / 00:00:03.562
Status: PASS
00:00:02.678 TEST Modify Configuration In Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Configuration In Old Owner and Verify After Recover
Documentation:

Modify Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:18:33.202 / 20250313 02:18:35.880 / 00:00:02.678
Status: PASS
00:00:03.387 TEST Delete Configuration In Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Delete Configuration In Old Owner and Verify After Recover
Documentation:

Delete Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:18:35.880 / 20250313 02:18:39.267 / 00:00:03.387
Status: PASS
00:00:03.791 TEST Send RPC Add to Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Owner and Verify After Recover
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:18:39.267 / 20250313 02:18:43.058 / 00:00:03.791
Status: PASS
00:00:02.883 TEST Send RPC Delete to Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Owner and Verify After Recover
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20250313 02:18:43.059 / 20250313 02:18:45.942 / 00:00:02.883
Status: PASS
00:00:02.846 TEST Send RPC Add to Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Add to Old Owner and Verify After Recover
Documentation:

Add Flow in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250313 02:18:45.942 / 20250313 02:18:48.788 / 00:00:02.846
Status: PASS
00:00:02.424 TEST Send RPC Delete to Old Owner and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Send RPC Delete to Old Owner and Verify After Recover
Documentation:

Delete Flow in Owner and verify it gets removed from all instances.
Start / End / Elapsed: 20250313 02:18:48.788 / 20250313 02:18:51.212 / 00:00:02.424
Status: PASS
00:00:20.838 TEST Modify Network and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Modify Network and Verify After Recover
Documentation:

Take a link down and verify port status in all instances.
Start / End / Elapsed: 20250313 02:18:51.212 / 20250313 02:19:12.050 / 00:00:20.838
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:3:3","source":{"source-node":"openflow:3","source-tp":"openflow:3:3"},"destination":{"dest-tp":"openflow:1:2","dest-node":"openflow:1"}},{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}],"node":[{"node-id":"openflow:2","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']","termination-point":[{"tp-id":"openflow:2:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:LOCAL\']"},{"tp-id":"openflow:2:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:1\']"},{"tp-id":"openflow:2:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'openflow:2:2\']"},{"tp-id":"openflow:2:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:2\']/node-connector[id=\'... [ Message content over the limit has been removed. ] ...ndaylight-inventory:nodes/node[id=\'openflow:3\']","termination-point":[{"tp-id":"openflow:3:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:LOCAL\']"},{"tp-id":"openflow:3:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:1\']"},{"tp-id":"openflow:3:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:2\']"},{"tp-id":"openflow:3:3","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:3\']/node-connector[id=\'openflow:3:3\']"}]},{"node-id":"openflow:1","opendaylight-topology-inventory:inventory-node-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']","termination-point":[{"tp-id":"openflow:1:2","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:2\']"},{"tp-id":"openflow:1:LOCAL","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:LOCAL\']"},{"tp-id":"openflow:1:1","opendaylight-topology-inventory:inventory-node-connector-ref":"/opendaylight-inventory:nodes/node[id=\'openflow:1\']/node-connector[id=\'openflow:1:1\']"}]}]}]}}' contains 'openflow:1' 19 times, not 16 times.
00:00:04.560 TEST Restore Network and Verify After Recover
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Restore Network and Verify After Recover
Documentation:

Take the link up and verify port status in all instances.
Start / End / Elapsed: 20250313 02:19:12.050 / 20250313 02:19:16.610 / 00:00:04.560
Status: PASS
00:00:02.521 TEST Stop Mininet and Exit
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Stop Mininet and Exit
Documentation:

Stop mininet and exit connection.
Start / End / Elapsed: 20250313 02:19:16.610 / 20250313 02:19:19.131 / 00:00:02.521
Status: PASS
00:00:20.893 TEST Check No Network Operational Information
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Failover.Check No Network Operational Information
Documentation:

Check device is not in operational inventory or topology in all cluster instances.
Start / End / Elapsed: 20250313 02:19:19.132 / 20250313 02:19:40.025 / 00:00:20.893
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 20 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"flow:1","link":[{"link-id":"openflow:1:1","source":{"source-node":"openflow:1","source-tp":"openflow:1:1"},"destination":{"dest-tp":"openflow:2:3","dest-node":"openflow:2"}},{"link-id":"openflow:1:2","source":{"source-node":"openflow:1","source-tp":"openflow:1:2"},"destination":{"dest-tp":"openflow:3:3","dest-node":"openflow:3"}}]}]}}' contains 'openflow' 10 times, not 0 times.
00:04:08.402 SUITE Cluster HA Owner Restart
Full Name: openflowplugin-clustering.txt.Cluster HA Owner Restart
Documentation:

Test suite for Cluster HA - Device Owner Stop and Start
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-titanium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot
Start / End / Elapsed: 20250313 02:19:40.026 / 20250313 02:23:48.428 / 00:04:08.402
Status: 51 tests total, 47 passed, 4 failed, 0 skipped
00:05:40.028 SUITE Cluster HA Data Recovery Leader Follower Failover
Full Name: openflowplugin-clustering.txt.Cluster HA Data Recovery Leader Follower Failover
Documentation:

Test suite for Cluster HA - Data Recovery at Leader Follower failover and cluster restart
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-titanium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot
Start / End / Elapsed: 20250313 02:23:48.429 / 20250313 02:29:28.457 / 00:05:40.028
Status: 21 tests total, 21 passed, 0 failed, 0 skipped
00:09:19.600 SUITE 010 Group Flows
Full Name: openflowplugin-clustering.txt.010 Group Flows
Documentation:

Switch connections and cluster are restarted.
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-titanium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot
Start / End / Elapsed: 20250313 02:29:28.459 / 20250313 02:38:48.059 / 00:09:19.600
Status: 72 tests total, 65 passed, 7 failed, 0 skipped
00:00:04.980 SUITE 010 Switch Disconnect
Full Name: openflowplugin-clustering.txt.010 Switch Disconnect
Documentation:

Test suite for entity ownership service and openflowplugin. Makes changes on switch side.
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-titanium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot
Start / End / Elapsed: 20250313 02:38:48.060 / 20250313 02:38:53.040 / 00:00:04.980
Status: 3 tests total, 0 passed, 3 failed, 0 skipped
Message: Suite setup failed: Dictionary does not contain key 's1'.
00:00:04.374 SUITE 020 Cluster Node Failure
Full Name: openflowplugin-clustering.txt.020 Cluster Node Failure
Documentation:

Test suite for entity ownership service and openflowplugin. Makes changes on controller side (restart karaf)
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-titanium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot
Start / End / Elapsed: 20250313 02:38:53.040 / 20250313 02:38:57.414 / 00:00:04.374
Status: 3 tests total, 0 passed, 3 failed, 0 skipped
Message: Suite setup failed: Dictionary does not contain key 's1'.
00:01:27.536 SUITE 030 Cluster Sync Problems
Full Name: openflowplugin-clustering.txt.030 Cluster Sync Problems
Documentation:

Test suite for entity ownership service and openflowplugin. Makes changes on controller side (isolating cluster node)
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-titanium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot
Start / End / Elapsed: 20250313 02:38:57.415 / 20250313 02:40:24.951 / 00:01:27.536
Status: 5 tests total, 0 passed, 5 failed, 0 skipped
00:00:08.460 SUITE 9145
Full Name: openflowplugin-clustering.txt.9145
Documentation:

Switch connections and cluster are restarted.
Source: /w/workspace/openflowplugin-csit-3node-clustering-only-titanium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot
Start / End / Elapsed: 20250313 02:40:24.952 / 20250313 02:40:33.412 / 00:00:08.460
Status: 3 tests total, 3 passed, 0 failed, 0 skipped