Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
16445119000:09:22
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
No Tags
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
ovsdb-upstream-clustering.txt
16445119000:09:37
ovsdb-upstream-clustering . txt . Southbound Cluster
823250000:05:22
ovsdb-upstream-clustering . txt . Southbound Cluster . Ovsdb Southbound Cluster
442717000:03:26
ovsdb-upstream-clustering . txt . Southbound Cluster . Southbound Cluster Extension
38533000:01:57
ovsdb-upstream-clustering . txt . Southbound Cluster
821369000:04:14
ovsdb-upstream-clustering . txt . Southbound Cluster . Ovsdb Southbound Cluster
44836000:02:17
ovsdb-upstream-clustering . txt . Southbound Cluster . Southbound Cluster Extension
38533000:01:57

Test Execution Log

00:09:36.733 SUITE ovsdb-upstream-clustering.txt
Full Name: ovsdb-upstream-clustering.txt
Start / End / Elapsed: 20250308 01:08:37.101 / 20250308 01:18:13.834 / 00:09:36.733
Status: 164 tests total, 45 passed, 119 failed, 0 skipped
00:05:22.444 SUITE Southbound Cluster
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster
Source: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-scandium/test/csit/suites/ovsdb/Southbound_Cluster
Start / End / Elapsed: 20250308 01:08:37.124 / 20250308 01:13:59.568 / 00:05:22.444
Status: 82 tests total, 32 passed, 50 failed, 0 skipped
00:03:25.585 SUITE Ovsdb Southbound Cluster
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster
Documentation:

Test suite for Ovsdb Southbound Cluster - Owner failover and recover
Source: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-scandium/test/csit/suites/ovsdb/Southbound_Cluster/010__Ovsdb_Southbound_Cluster.robot
Start / End / Elapsed: 20250308 01:08:37.125 / 20250308 01:12:02.710 / 00:03:25.585
Status: 44 tests total, 27 passed, 17 failed, 0 skipped
00:00:05.015 SETUP Suite Setup  
Start / End / Elapsed: 20250308 01:08:37.624 / 20250308 01:08:42.639 / 00:00:05.015
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
Documentation:

Removes all the session objects
Start / End / Elapsed: 20250308 01:12:02.710 / 20250308 01:12:02.710 / 00:00:00.000
00:00:06.240 TEST Check Shards Status Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Shards Status Before Fail
Documentation:

Check Status for all shards in Ovsdb application.
Start / End / Elapsed: 20250308 01:08:42.639 / 20250308 01:08:48.879 / 00:00:06.240
Status: PASS
00:00:04.997 TEST Start OVS Multiple Connections
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Start OVS Multiple Connections
Documentation:

Connect OVS to all cluster instances.
Start / End / Elapsed: 20250308 01:08:48.880 / 20250308 01:08:53.877 / 00:00:04.997
Status: PASS
00:00:00.694 TEST Check Entity Owner Status And Find Owner and Candidate Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Entity Owner Status And Find Owner and Candidate Before Fail
Documentation:

Check Entity Owner Status and identify owner and candidate.
Start / End / Elapsed: 20250308 01:08:53.877 / 20250308 01:08:54.571 / 00:00:00.694
Status: PASS
00:00:01.151 TEST Create Bridge Manually and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge Manually and Verify Before Fail
Documentation:

Create bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:08:54.572 / 20250308 01:08:55.723 / 00:00:01.151
Status: PASS
00:00:01.090 TEST Add Port Manually and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Port Manually and Verify Before Fail
Documentation:

Add port with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:08:55.723 / 20250308 01:08:56.813 / 00:00:01.090
Status: PASS
00:00:01.854 TEST Create Tap Device Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Tap Device Before Fail
Documentation:

Create tap devices to add to the bridge in ovs
Start / End / Elapsed: 20250308 01:08:56.813 / 20250308 01:08:58.667 / 00:00:01.854
Status: PASS
00:00:01.090 TEST Add Tap Device Manually and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Tap Device Manually and Verify Before Fail
Documentation:

Add tap devices to the bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:08:58.667 / 20250308 01:08:59.757 / 00:00:01.090
Status: PASS
00:00:01.076 TEST Delete the Bridge Manually and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete the Bridge Manually and Verify Before Fail
Documentation:

Delete bridge with OVS command and verify it gets deleted from all instances.
Start / End / Elapsed: 20250308 01:08:59.758 / 20250308 01:09:00.834 / 00:00:01.076
Status: PASS
00:00:11.012 TEST Create Bridge In Owner and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge In Owner and Verify Before Fail
Documentation:

Create Bridge in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:09:00.834 / 20250308 01:09:11.846 / 00:00:11.012
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
00:00:00.397 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250308 01:09:00.834 / 20250308 01:09:01.231 / 00:00:00.397
00:00:10.606 KEYWORD ClusterOvsdb . Create Sample Bridge And Verify   ${original_owner}
Documentation:

Create bridge br01 in controller ${controller_index} and verify it gets created in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250308 01:09:01.239 / 20250308 01:09:11.845 / 00:00:10.606
00:00:00.000 KEYWORD ${body} = OperatingSystem . Get File   /w/workspace/ovsdb-csit-3node-upstream-clustering-only-scandium/test/csit/libraries/../variables/ovsdb/create_bridge_3node.json
Documentation:

Returns the contents of a specified file.
Start / End / Elapsed: 20250308 01:09:01.241 / 20250308 01:09:01.241 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} ovsdb://127.0.0.1:61644 ovsdb://uuid/${ovsdb_uuid}
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250308 01:09:01.242 / 20250308 01:09:01.242 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} tcp:controller1:6633 tcp:${ODL_SYSTEM_1_IP}:6633
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250308 01:09:01.242 / 20250308 01:09:01.242 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} tcp:controller2:6633 tcp:${ODL_SYSTEM_2_IP}:6633
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250308 01:09:01.243 / 20250308 01:09:01.243 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} tcp:controller3:6633 tcp:${ODL_SYSTEM_3_IP}:6633
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250308 01:09:01.243 / 20250308 01:09:01.243 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} 127.0.0.1 ${TOOLS_SYSTEM_IP}
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250308 01:09:01.243 / 20250308 01:09:01.243 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} br01 ${BRIDGE}
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250308 01:09:01.244 / 20250308 01:09:01.244 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${body} 61644 ${OVSDB_PORT}
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250308 01:09:01.244 / 20250308 01:09:01.244 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   ${body}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250308 01:09:01.244 / 20250308 01:09:01.244 / 00:00:00.000
00:00:00.000 KEYWORD ${TOOLS_SYSTEM_IP1} = String . Replace String   ${TOOLS_SYSTEM_IP} ${TOOLS_SYSTEM_IP} "${TOOLS_SYSTEM_IP}"
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250308 01:09:01.245 / 20250308 01:09:01.245 / 00:00:00.000
00:00:00.000 KEYWORD ${dictionary} = BuiltIn . Create Dictionary   ${TOOLS_SYSTEM_IP1}=1 ${OVSDBPORT}=4 ${BRIDGE}=1
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250308 01:09:01.245 / 20250308 01:09:01.245 / 00:00:00.000
00:00:00.252 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Put_As_Json_And_Check_Member_List_Or_All ${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE} ${body} ${controller_index} ${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250308 01:09:01.246 / 20250308 01:09:01.498 / 00:00:00.252
00:00:10.347 KEYWORD BuiltIn . Wait Until Keyword Succeeds   10s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}?${RFC8040_OPERATIONAL_CONTENT} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250308 01:09:01.498 / 20250308 01:09:11.845 / 00:00:10.347
Message: 5 failing items removed using the --remove-keywords option.
00:00:00.049 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}?${RFC8040_OPERATIONAL_CONTENT} dictionary=${dictionary} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary {'"10.30.170.15"': '1', '6640': '4', 'br01': '1'}.
Start / End / Elapsed: 20250308 01:09:11.796 / 20250308 01:09:11.845 / 00:00:00.049
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250308 01:09:11.796 / 20250308 01:09:11.797 / 00:00:00.001
00:00:00.047 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250308 01:09:11.798 / 20250308 01:09:11.845 / 00:00:00.047
00:00:00.047 ITERATION ${index} = 1  
Start / End / Elapsed: 20250308 01:09:11.798 / 20250308 01:09:11.845 / 00:00:00.047
00:00:00.041 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
Documentation:

Send a GET with the supplied uri to member ${member_index}.
Start / End / Elapsed: 20250308 01:09:11.802 / 20250308 01:09:11.843 / 00:00:00.041
00:00:00.002 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
Documentation:

Check string for occurrences of items expressed in a list of dictionaries {item=occurrences}. 0 occurences means item is not present.
Start / End / Elapsed: 20250308 01:09:11.843 / 20250308 01:09:11.845 / 00:00:00.002
00:00:00.002 FOR ${item} IN @{dictionary_item_occurrence}  
Start / End / Elapsed: 20250308 01:09:11.843 / 20250308 01:09:11.845 / 00:00:00.002
00:00:00.000 ITERATION ${item} = "10.30.170.15"  
Start / End / Elapsed: 20250308 01:09:11.843 / 20250308 01:09:11.843 / 00:00:00.000
00:00:00.000 ITERATION ${item} = 6640  
Start / End / Elapsed: 20250308 01:09:11.844 / 20250308 01:09:11.844 / 00:00:00.000
00:00:00.001 ITERATION ${item} = br01  
Start / End / Elapsed: 20250308 01:09:11.844 / 20250308 01:09:11.845 / 00:00:00.001
00:00:00.000 KEYWORD BuiltIn . Should Contain X Times   ${string} ${item} ${dictionary_item_occurrence}[${item}]
Documentation:

Fails if container does not contain item count times.
Start / End / Elapsed: 20250308 01:09:11.844 / 20250308 01:09:11.844 / 00:00:00.000
01:09:11.844 INFO Item found from container 0 times.
01:09:11.845 FAIL '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
01:09:11.845 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
00:00:10.916 TEST Create Port In Owner and Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Port In Owner and Verify Before Fail
Documentation:

Create Port in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:09:11.846 / 20250308 01:09:22.762 / 00:00:10.916
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.388 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250308 01:09:11.847 / 20250308 01:09:12.235 / 00:00:00.388
00:00:10.518 KEYWORD ClusterOvsdb . Create Sample Port And Verify   ${original_owner}
Documentation:

Add Port vx2 to bridge br01 in controller ${controller_index} and verify it gets added in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250308 01:09:12.243 / 20250308 01:09:22.761 / 00:00:10.518
00:00:00.000 KEYWORD ${sample} = OperatingSystem . Get File   ${OVSDB_CONFIG_DIR}/create_port_3node.json
Documentation:

Returns the contents of a specified file.
Start / End / Elapsed: 20250308 01:09:12.245 / 20250308 01:09:12.245 / 00:00:00.000
00:00:00.000 KEYWORD ${body} = String . Replace String   ${sample} 192.168.1.10 ${TOOLS_SYSTEM_IP}
Documentation:

Replaces search_for in the given string with replace_with.
Start / End / Elapsed: 20250308 01:09:12.246 / 20250308 01:09:12.246 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   ${body}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250308 01:09:12.246 / 20250308 01:09:12.246 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   URL is ${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}/termination-point=vx2
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250308 01:09:12.247 / 20250308 01:09:12.247 / 00:00:00.000
00:00:00.000 KEYWORD ${port_dictionary} = BuiltIn . Create Dictionary   ${BRIDGE}=1 vx2=3
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250308 01:09:12.247 / 20250308 01:09:12.247 / 00:00:00.000
00:00:00.243 KEYWORD ClusterManagement . Put_As_Json_And_Check_Member_List_Or_All   ${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}/termination-point=vx2 ${body} ${controller_index} ${controller_index_list}
Documentation:

Send a PUT with the supplied uri ${uri} and body ${data} to member ${member_index}. Then check data is replicated in all or some members defined in ${member_index_list}.
Start / End / Elapsed: 20250308 01:09:12.261 / 20250308 01:09:12.504 / 00:00:00.243
00:00:10.258 KEYWORD BuiltIn . Wait Until Keyword Succeeds   10s 2s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}/termination-point=vx2?${RFC8040_OPERATIONAL_CONTENT} dictionary=${port_dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250308 01:09:12.504 / 20250308 01:09:22.762 / 00:00:10.258
Message: 5 failing items removed using the --remove-keywords option.
00:00:00.027 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}/termination-point=vx2?${RFC8040_OPERATIONAL_CONTENT} dictionary=${port_dictionary} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary ${dictionary}.
Start / End / Elapsed: 20250308 01:09:22.735 / 20250308 01:09:22.762 / 00:00:00.027
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250308 01:09:22.735 / 20250308 01:09:22.736 / 00:00:00.001
00:00:00.024 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250308 01:09:22.737 / 20250308 01:09:22.761 / 00:00:00.024
00:00:00.024 ITERATION ${index} = 1  
Start / End / Elapsed: 20250308 01:09:22.737 / 20250308 01:09:22.761 / 00:00:00.024
00:00:00.020 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
Documentation:

Send a GET with the supplied uri to member ${member_index}.
Start / End / Elapsed: 20250308 01:09:22.741 / 20250308 01:09:22.761 / 00:00:00.020
00:00:00.001 KEYWORD ${session} = ClusterManagement . Resolve_Http_Session_For_Member   member_index=${member_index}
Documentation:

Return RequestsLibrary session alias pointing to node of given index.
Start / End / Elapsed: 20250308 01:09:22.741 / 20250308 01:09:22.742 / 00:00:00.001
00:00:00.018 KEYWORD ${response_text} = TemplatedRequests . Get_From_Uri   uri=${uri} accept=${access} session=${session}
Documentation:

GET data from given URI, check status code and return response text. ${accept} is a Python object with headers to use. If ${normalize_json}, normalize as JSON text before returning.
Start / End / Elapsed: 20250308 01:09:22.742 / 20250308 01:09:22.760 / 00:00:00.018
00:00:00.000 KEYWORD BuiltIn . Log   ${uri}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250308 01:09:22.748 / 20250308 01:09:22.748 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   ${accept}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250308 01:09:22.748 / 20250308 01:09:22.748 / 00:00:00.000
00:00:00.010 IF """${http_timeout}""" == """${EMPTY}"""  
Start / End / Elapsed: 20250308 01:09:22.749 / 20250308 01:09:22.759 / 00:00:00.010
00:00:00.008 KEYWORD ${response} = RequestsLibrary . GET On Session   ${session} url=${uri} headers=${accept}
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250308 01:09:22.751 / 20250308 01:09:22.759 / 00:00:00.008
01:09:22.758 INFO GET Request : url=http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig path_url=/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node0sls6wyrm50q71167stbejjg2y0.node0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
01:09:22.758 INFO GET Response : url=http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+json', 'Content-Length': '242'} body={ "errors": { "error": [ { "error-tag": "data-missing", "error-message": "Request could not be completed because the relevant data model content does not exist", "error-type": "protocol" } ] } }
01:09:22.758 FAIL HTTPError: 409 Client Error: Conflict for url: http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.000 ELSE  
Start / End / Elapsed: 20250308 01:09:22.759 / 20250308 01:09:22.759 / 00:00:00.000
00:00:00.000 KEYWORD TemplatedRequests . Check_Status_Code   ${response} log_response=${log_response}
Documentation:

Log response text, check status_code is one of allowed ones. In cases where this keyword is called in a WUKS it could end up logging tons of data and it may be desired to skip the logging by passing log_response=False, but by default it remains True.
Start / End / Elapsed: 20250308 01:09:22.760 / 20250308 01:09:22.760 / 00:00:00.000
00:00:00.000 IF not ${normalize_json}  
Start / End / Elapsed: 20250308 01:09:22.760 / 20250308 01:09:22.760 / 00:00:00.000
00:00:00.000 KEYWORD ${text_normalized} = norm_json . Normalize Json Text   ${response.text} jmes_path=${jmes_path} keys_with_volatiles=${keys_with_volatiles}
Documentation:

Attempt to return sorted indented JSON string.
Start / End / Elapsed: 20250308 01:09:22.760 / 20250308 01:09:22.760 / 00:00:00.000
00:00:00.000 RETURN   ${text_normalized}
Start / End / Elapsed: 20250308 01:09:22.760 / 20250308 01:09:22.760 / 00:00:00.000
00:00:00.000 RETURN   ${response_text}
Start / End / Elapsed: 20250308 01:09:22.760 / 20250308 01:09:22.760 / 00:00:00.000
00:00:00.000 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
Documentation:

Check string for occurrences of items expressed in a list of dictionaries {item=occurrences}. 0 occurences means item is not present.
Start / End / Elapsed: 20250308 01:09:22.761 / 20250308 01:09:22.761 / 00:00:00.000
01:09:22.761 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.765 TEST Modify the destination IP of Port In Owner Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Modify the destination IP of Port In Owner Before Fail
Documentation:

Modify the dst ip of existing port in Owner.
Start / End / Elapsed: 20250308 01:09:22.762 / 20250308 01:09:23.527 / 00:00:00.765
Status: PASS
00:00:05.677 TEST Verify Port Is Modified Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Verify Port Is Modified Before Fail
Documentation:

Verify port is modified in all instances.
Start / End / Elapsed: 20250308 01:09:23.527 / 20250308 01:09:29.204 / 00:00:05.677
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:00.397 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250308 01:09:23.528 / 20250308 01:09:23.925 / 00:00:00.397
00:00:05.275 KEYWORD ClusterOvsdb . Verify Sample Port Is Modified  
Documentation:

Verify dst ip of port vx2 in bridge br01 gets modified in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250308 01:09:23.929 / 20250308 01:09:29.204 / 00:00:05.275
00:00:00.000 KEYWORD ${port_dictionary} = BuiltIn . Create Dictionary   br01=6 vx2=3 10.0.0.19=1
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250308 01:09:23.932 / 20250308 01:09:23.932 / 00:00:00.000
00:00:05.272 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}?${RFC8040_OPERATIONAL_CONTENT} dictionary=${port_dictionary} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250308 01:09:23.932 / 20250308 01:09:29.204 / 00:00:05.272
Message: 5 failing items removed using the --remove-keywords option.
00:00:00.027 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_SOUTHBOUND_NODE_API}uuid%2F${ovsdb_uuid}%2Fbridge%2F${BRIDGE}?${RFC8040_OPERATIONAL_CONTENT} dictionary=${port_dictionary} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary ${dictionary}.
Start / End / Elapsed: 20250308 01:09:29.177 / 20250308 01:09:29.204 / 00:00:00.027
00:00:00.002 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250308 01:09:29.178 / 20250308 01:09:29.180 / 00:00:00.002
00:00:00.024 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250308 01:09:29.179 / 20250308 01:09:29.203 / 00:00:00.024
00:00:00.024 ITERATION ${index} = 1  
Start / End / Elapsed: 20250308 01:09:29.179 / 20250308 01:09:29.203 / 00:00:00.024
00:00:00.019 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
Documentation:

Send a GET with the supplied uri to member ${member_index}.
Start / End / Elapsed: 20250308 01:09:29.183 / 20250308 01:09:29.202 / 00:00:00.019
00:00:00.001 KEYWORD ${session} = ClusterManagement . Resolve_Http_Session_For_Member   member_index=${member_index}
Documentation:

Return RequestsLibrary session alias pointing to node of given index.
Start / End / Elapsed: 20250308 01:09:29.184 / 20250308 01:09:29.185 / 00:00:00.001
00:00:00.018 KEYWORD ${response_text} = TemplatedRequests . Get_From_Uri   uri=${uri} accept=${access} session=${session}
Documentation:

GET data from given URI, check status code and return response text. ${accept} is a Python object with headers to use. If ${normalize_json}, normalize as JSON text before returning.
Start / End / Elapsed: 20250308 01:09:29.185 / 20250308 01:09:29.203 / 00:00:00.018
00:00:00.000 KEYWORD BuiltIn . Log   ${uri}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250308 01:09:29.190 / 20250308 01:09:29.190 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Log   ${accept}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250308 01:09:29.191 / 20250308 01:09:29.191 / 00:00:00.000
00:00:00.010 IF """${http_timeout}""" == """${EMPTY}"""  
Start / End / Elapsed: 20250308 01:09:29.191 / 20250308 01:09:29.201 / 00:00:00.010
00:00:00.008 KEYWORD ${response} = RequestsLibrary . GET On Session   ${session} url=${uri} headers=${accept}
Documentation:

Sends a GET request on a previously created HTTP Session.
Start / End / Elapsed: 20250308 01:09:29.193 / 20250308 01:09:29.201 / 00:00:00.008
01:09:29.200 INFO GET Request : url=http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig path_url=/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig headers={'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Cookie': 'JSESSIONID=node0sls6wyrm50q71167stbejjg2y0.node0', 'Authorization': 'Basic YWRtaW46YWRtaW4='} body=None
01:09:29.200 INFO GET Response : url=http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig status=409, reason=Conflict headers={'Content-Type': 'application/yang-data+json', 'Content-Length': '242'} body={ "errors": { "error": [ { "error-tag": "data-missing", "error-message": "Request could not be completed because the relevant data model content does not exist", "error-type": "protocol" } ] } }
01:09:29.201 FAIL HTTPError: 409 Client Error: Conflict for url: http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:00.000 ELSE  
Start / End / Elapsed: 20250308 01:09:29.201 / 20250308 01:09:29.201 / 00:00:00.000
00:00:00.000 KEYWORD TemplatedRequests . Check_Status_Code   ${response} log_response=${log_response}
Documentation:

Log response text, check status_code is one of allowed ones. In cases where this keyword is called in a WUKS it could end up logging tons of data and it may be desired to skip the logging by passing log_response=False, but by default it remains True.
Start / End / Elapsed: 20250308 01:09:29.202 / 20250308 01:09:29.202 / 00:00:00.000
00:00:00.000 IF not ${normalize_json}  
Start / End / Elapsed: 20250308 01:09:29.202 / 20250308 01:09:29.202 / 00:00:00.000
00:00:00.000 KEYWORD ${text_normalized} = norm_json . Normalize Json Text   ${response.text} jmes_path=${jmes_path} keys_with_volatiles=${keys_with_volatiles}
Documentation:

Attempt to return sorted indented JSON string.
Start / End / Elapsed: 20250308 01:09:29.202 / 20250308 01:09:29.202 / 00:00:00.000
00:00:00.000 RETURN   ${text_normalized}
Start / End / Elapsed: 20250308 01:09:29.202 / 20250308 01:09:29.202 / 00:00:00.000
00:00:00.000 RETURN   ${response_text}
Start / End / Elapsed: 20250308 01:09:29.202 / 20250308 01:09:29.202 / 00:00:00.000
00:00:00.000 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
Documentation:

Check string for occurrences of items expressed in a list of dictionaries {item=occurrences}. 0 occurences means item is not present.
Start / End / Elapsed: 20250308 01:09:29.203 / 20250308 01:09:29.203 / 00:00:00.000
01:09:29.204 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:00.675 TEST Delete Port In Owner Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Port In Owner Before Fail
Documentation:

Delete port in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250308 01:09:29.205 / 20250308 01:09:29.880 / 00:00:00.675
Status: PASS
00:00:00.659 TEST Delete Bridge In Owner And Verify Before Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Bridge In Owner And Verify Before Fail
Documentation:

Delete bridge in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250308 01:09:29.880 / 20250308 01:09:30.539 / 00:00:00.659
Status: PASS
00:00:03.756 TEST Kill Owner Instance
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Kill Owner Instance
Documentation:

Kill Owner Instance and verify it is dead
Start / End / Elapsed: 20250308 01:09:30.540 / 20250308 01:09:34.296 / 00:00:03.756
Status: PASS
00:00:11.799 TEST Check Shards Status After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Shards Status After Fail
Documentation:

Create original cluster list and check Status for all shards in Ovsdb application.
Start / End / Elapsed: 20250308 01:09:34.296 / 20250308 01:09:46.095 / 00:00:11.799
Status: PASS
00:00:00.417 TEST Check Entity Owner Status And Find Owner and Candidate After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Entity Owner Status And Find Owner and Candidate After Fail
Documentation:

Check Entity Owner Status and identify owner and candidate.
Start / End / Elapsed: 20250308 01:09:46.096 / 20250308 01:09:46.513 / 00:00:00.417
Status: PASS
00:00:06.323 TEST Create Bridge Manually and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge Manually and Verify After Fail
Documentation:

Create bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:09:46.514 / 20250308 01:09:52.837 / 00:00:06.323
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
00:00:00.283 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250308 01:09:46.514 / 20250308 01:09:46.797 / 00:00:00.283
00:00:06.036 KEYWORD ClusterOvsdb . Create Sample Bridge Manually And Verify   controller_index_list=${new_cluster_list}
Documentation:

Create bridge br-s1 using OVS command and verify it gets created in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250308 01:09:46.801 / 20250308 01:09:52.837 / 00:00:06.036
00:00:00.596 KEYWORD Utils . Run Command On Mininet   ${ovs_system_ip} sudo ovs-vsctl add-br br-s1
Documentation:

Call Run Comand On Remote System, but with default values suitable for Mininet machine.
Start / End / Elapsed: 20250308 01:09:46.802 / 20250308 01:09:47.398 / 00:00:00.596
00:00:00.001 KEYWORD ${dictionary_operational} = BuiltIn . Create Dictionary   br-s1=5
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250308 01:09:47.399 / 20250308 01:09:47.400 / 00:00:00.001
00:00:00.000 KEYWORD ${dictionary_config} = BuiltIn . Create Dictionary   br-s1=0
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250308 01:09:47.399 / 20250308 01:09:47.399 / 00:00:00.000
00:00:00.091 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_CONFIG_TOPO_API} dictionary=${dictionary_config} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250308 01:09:47.400 / 20250308 01:09:47.491 / 00:00:00.091
00:00:05.346 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary_operational} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250308 01:09:47.491 / 20250308 01:09:52.837 / 00:00:05.346
Message: 5 failing items removed using the --remove-keywords option.
00:00:00.046 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary_operational} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary ${dictionary}.
Start / End / Elapsed: 20250308 01:09:52.791 / 20250308 01:09:52.837 / 00:00:00.046
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${member_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250308 01:09:52.792 / 20250308 01:09:52.793 / 00:00:00.001
00:00:00.043 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250308 01:09:52.793 / 20250308 01:09:52.836 / 00:00:00.043
00:00:00.043 ITERATION ${index} = 1  
Start / End / Elapsed: 20250308 01:09:52.794 / 20250308 01:09:52.837 / 00:00:00.043
00:00:00.037 KEYWORD ${data} = ClusterManagement . Get_From_Member   uri=${uri} member_index=${index}
Documentation:

Send a GET with the supplied uri to member ${member_index}.
Start / End / Elapsed: 20250308 01:09:52.798 / 20250308 01:09:52.835 / 00:00:00.037
00:00:00.001 KEYWORD Utils . Check Item Occurrence   ${data} ${dictionary}
Documentation:

Check string for occurrences of items expressed in a list of dictionaries {item=occurrences}. 0 occurences means item is not present.
Start / End / Elapsed: 20250308 01:09:52.835 / 20250308 01:09:52.836 / 00:00:00.001
00:00:00.001 FOR ${item} IN @{dictionary_item_occurrence}  
Start / End / Elapsed: 20250308 01:09:52.836 / 20250308 01:09:52.837 / 00:00:00.001
00:00:00.001 ITERATION ${item} = br-s1  
Start / End / Elapsed: 20250308 01:09:52.836 / 20250308 01:09:52.837 / 00:00:00.001
00:00:00.000 KEYWORD BuiltIn . Should Contain X Times   ${string} ${item} ${dictionary_item_occurrence}[${item}]
Documentation:

Fails if container does not contain item count times.
Start / End / Elapsed: 20250308 01:09:52.836 / 20250308 01:09:52.836 / 00:00:00.000
01:09:52.836 INFO Item found from container 0 times.
01:09:52.836 FAIL '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
01:09:52.837 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
00:00:06.447 TEST Add Port Manually and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Port Manually and Verify After Fail
Documentation:

Add port with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:09:52.838 / 20250308 01:09:59.285 / 00:00:06.447
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
00:00:00.312 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250308 01:09:52.838 / 20250308 01:09:53.150 / 00:00:00.312
00:00:06.130 KEYWORD ClusterOvsdb . Add Sample Port To The Manual Bridge And Verify   controller_index_list=${new_cluster_list}
Documentation:

Add Port vx1 to br-s1 using OVS command and verify it gets added in all instances in ${controller_index_list}.
Start / End / Elapsed: 20250308 01:09:53.154 / 20250308 01:09:59.284 / 00:00:06.130
00:00:00.692 KEYWORD Utils . Run Command On Mininet   ${ovs_system_ip} sudo ovs-vsctl add-port br-s1 vx1 -- set Interface vx1 type=vxlan
Documentation:

Call Run Comand On Remote System, but with default values suitable for Mininet machine.
Start / End / Elapsed: 20250308 01:09:53.155 / 20250308 01:09:53.847 / 00:00:00.692
00:00:00.000 KEYWORD ${dictionary_operational} = BuiltIn . Create Dictionary   vx1=2
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250308 01:09:53.847 / 20250308 01:09:53.847 / 00:00:00.000
00:00:00.000 KEYWORD ${dictionary_config} = BuiltIn . Create Dictionary   vx1=0
Documentation:

Creates and returns a dictionary based on the given items.
Start / End / Elapsed: 20250308 01:09:53.847 / 20250308 01:09:53.847 / 00:00:00.000
00:00:00.093 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_CONFIG_TOPO_API} dictionary=${dictionary_config} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250308 01:09:53.847 / 20250308 01:09:53.940 / 00:00:00.093
00:00:05.344 KEYWORD BuiltIn . Wait Until Keyword Succeeds   5s 1s ClusterManagement.Check_Item_Occurrence_Member_List_Or_All uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary_operational} member_index_list=${controller_index_list}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250308 01:09:53.941 / 20250308 01:09:59.285 / 00:00:05.344
Message: 5 failing items removed using the --remove-keywords option.
00:00:00.056 KEYWORD ClusterManagement . Check_Item_Occurrence_Member_List_Or_All   uri=${RFC8040_OPERATIONAL_TOPO_API} dictionary=${dictionary_operational} member_index_list=${controller_index_list}
Documentation:

Send a GET with the supplied uri to all or some members defined in ${member_index_list}. Then check received for occurrences of items expressed in a dictionary ${dictionary}.
Start / End / Elapsed: 20250308 01:09:59.228 / 20250308 01:09:59.284 / 00:00:00.056
01:09:59.285 FAIL Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
00:00:01.772 TEST Create Tap Device After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Tap Device After Fail
Documentation:

Create tap devices to add to the bridge in ovs
Start / End / Elapsed: 20250308 01:09:59.285 / 20250308 01:10:01.057 / 00:00:01.772
Status: PASS
00:00:06.219 TEST Add Tap Device Manually and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Tap Device Manually and Verify After Fail
Documentation:

Add tap devices to the bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:10:01.057 / 20250308 01:10:07.276 / 00:00:06.219
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vport1' 0 times, not 2 times.
00:00:00.809 TEST Delete the Bridge Manually and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete the Bridge Manually and Verify After Fail
Documentation:

Delete bridge with OVS command and verify it gets deleted from all instances.
Start / End / Elapsed: 20250308 01:10:07.277 / 20250308 01:10:08.086 / 00:00:00.809
Status: PASS
00:00:11.294 TEST Create Bridge In Owner and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge In Owner and Verify After Fail
Documentation:

Create Bridge in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:10:08.085 / 20250308 01:10:19.379 / 00:00:11.294
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
00:00:10.778 TEST Create Port In Owner and Verify After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Port In Owner and Verify After Fail
Documentation:

Create Port in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:10:19.380 / 20250308 01:10:30.158 / 00:00:10.778
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.511 TEST Modify the destination IP of Port In Owner After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Modify the destination IP of Port In Owner After Fail
Documentation:

Modify the dst ip of existing port in Owner.
Start / End / Elapsed: 20250308 01:10:30.158 / 20250308 01:10:30.669 / 00:00:00.511
Status: PASS
00:00:05.543 TEST Verify Port Is Modified After Fail
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Verify Port Is Modified After Fail
Documentation:

Verify port is modified in all instances.
Start / End / Elapsed: 20250308 01:10:30.669 / 20250308 01:10:36.212 / 00:00:05.543
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:14.057 TEST Start Old Owner Instance
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Start Old Owner Instance
Documentation:

Start Owner Instance and verify it is active
Start / End / Elapsed: 20250308 01:10:36.212 / 20250308 01:10:50.269 / 00:00:14.057
Status: PASS
00:00:03.355 TEST Check Shards Status After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Shards Status After Recover
Documentation:

Create original cluster list and check Status for all shards in Ovsdb application.
Start / End / Elapsed: 20250308 01:10:50.269 / 20250308 01:10:53.624 / 00:00:03.355
Status: PASS
00:00:00.494 TEST Check Entity Owner Status After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Check Entity Owner Status After Recover
Documentation:

Check Entity Owner Status and identify owner and candidate.
Start / End / Elapsed: 20250308 01:10:53.625 / 20250308 01:10:54.119 / 00:00:00.494
Status: PASS
00:00:06.683 TEST Create Bridge Manually and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge Manually and Verify After Recover
Documentation:

Create bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:10:54.119 / 20250308 01:11:00.802 / 00:00:06.683
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
00:00:06.240 TEST Add Port Manually and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Port Manually and Verify After Recover
Documentation:

Add port with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:11:00.803 / 20250308 01:11:07.043 / 00:00:06.240
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
00:00:01.742 TEST Create Tap Device After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Tap Device After Recover
Documentation:

Create tap devices to add to the bridge in ovs
Start / End / Elapsed: 20250308 01:11:07.043 / 20250308 01:11:08.785 / 00:00:01.742
Status: PASS
00:00:06.249 TEST Add Tap Device Manually and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Add Tap Device Manually and Verify After Recover
Documentation:

Add tap devices to the bridge with OVS command and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:11:08.785 / 20250308 01:11:15.034 / 00:00:06.249
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vport1' 0 times, not 2 times.
00:00:00.940 TEST Delete the Bridge Manually and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete the Bridge Manually and Verify After Recover
Documentation:

Delete bridge with OVS command and verify it gets deleted from all instances.
Start / End / Elapsed: 20250308 01:11:15.034 / 20250308 01:11:15.974 / 00:00:00.940
Status: PASS
00:00:05.647 TEST Verify Modified Port After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Verify Modified Port After Recover
Documentation:

Verify modified port exists in all instances.
Start / End / Elapsed: 20250308 01:11:15.974 / 20250308 01:11:21.621 / 00:00:05.647
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:00.606 TEST Delete Port In New Owner After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Port In New Owner After Recover
Documentation:

Delete port in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250308 01:11:21.622 / 20250308 01:11:22.228 / 00:00:00.606
Status: PASS
00:00:00.670 TEST Delete Bridge In New Owner And Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Bridge In New Owner And Verify After Recover
Documentation:

Delete bridge in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250308 01:11:22.227 / 20250308 01:11:22.897 / 00:00:00.670
Status: PASS
00:00:10.947 TEST Create Bridge In Old Owner and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Bridge In Old Owner and Verify After Recover
Documentation:

Create Bridge in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:11:22.898 / 20250308 01:11:33.845 / 00:00:10.947
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
00:00:10.882 TEST Create Port In Old Owner and Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Create Port In Old Owner and Verify After Recover
Documentation:

Create Port in Owner and verify it gets applied from all instances.
Start / End / Elapsed: 20250308 01:11:33.846 / 20250308 01:11:44.728 / 00:00:10.882
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
00:00:00.691 TEST Modify the destination IP of Port In Old Owner After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Modify the destination IP of Port In Old Owner After Recover
Documentation:

Modify the dst ip of existing port in Owner.
Start / End / Elapsed: 20250308 01:11:44.728 / 20250308 01:11:45.419 / 00:00:00.691
Status: PASS
00:00:05.586 TEST Verify Port Is Modified After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Verify Port Is Modified After Recover
Documentation:

Verify port is modified in all instances.
Start / End / Elapsed: 20250308 01:11:45.418 / 20250308 01:11:51.004 / 00:00:05.586
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.179:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
00:00:00.643 TEST Delete Port In Old Owner After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Port In Old Owner After Recover
Documentation:

Delete port in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250308 01:11:51.005 / 20250308 01:11:51.648 / 00:00:00.643
Status: PASS
00:00:00.657 TEST Delete Bridge In Old Owner And Verify After Recover
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Delete Bridge In Old Owner And Verify After Recover
Documentation:

Delete bridge in Owner and verify it gets deleted from all instances.
Start / End / Elapsed: 20250308 01:11:51.648 / 20250308 01:11:52.305 / 00:00:00.657
Status: PASS
00:00:10.405 TEST Cleans Up Test Environment For Next Suite
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster.Cleans Up Test Environment For Next Suite
Documentation:

Cleans up test environment, close existing sessions in teardown.
Start / End / Elapsed: 20250308 01:11:52.305 / 20250308 01:12:02.710 / 00:00:10.405
Status: FAIL
Message: Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":44404,"local-ip":"10.30.170.103","remote-ip":"10.30.170.15"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.170.49:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.103:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.179:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'ovsdb://uuid' 1 time, not 0 times.
00:01:56.854 SUITE Southbound Cluster Extension
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluster Extension
Documentation:

Test suite for Ovsdb Southbound Cluster - Candidate failover and recover
Source: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-scandium/test/csit/suites/ovsdb/Southbound_Cluster/020__Southbound_Cluster_Extension.robot
Start / End / Elapsed: 20250308 01:12:02.711 / 20250308 01:13:59.565 / 00:01:56.854
Status: 38 tests total, 5 passed, 33 failed, 0 skipped
00:04:14.263 SUITE Southbound Cluster
Full Name: ovsdb-upstream-clustering.txt.Southbound Cluster
Source: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-scandium/test/csit/suites/ovsdb/Southbound_Cluster
Start / End / Elapsed: 20250308 01:13:59.570 / 20250308 01:18:13.833 / 00:04:14.263
Status: 82 tests total, 13 passed, 69 failed, 0 skipped