Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
1034162001:05:31
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
No Tags
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
openflowplugin-clustering-bulkomatic.txt
1034162001:05:47
openflowplugin-clustering-bulkomatic . txt . Cluster Reconcilliation Multi DPN
1899000:07:23
openflowplugin-clustering-bulkomatic . txt . Cluster HA Data Recovery BulkFlow 2Node Cluster
301119000:27:05
openflowplugin-clustering-bulkomatic . txt . Cluster HA Data Recovery BulkFlow Single Switch
432122000:31:11
openflowplugin-clustering-bulkomatic . txt . Cluster Current Term Verification 3Node Cluster
12012000:00:08

Test Execution Log

01:05:47.400 SUITE openflowplugin-clustering-bulkomatic.txt
Full Name: openflowplugin-clustering-bulkomatic.txt
Source: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic
Start / End / Elapsed: 20250121 02:20:54.904 / 20250121 03:26:42.304 / 01:05:47.400
Status: 103 tests total, 41 passed, 62 failed, 0 skipped
00:07:23.084 SUITE Cluster Reconcilliation Multi DPN
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN
Documentation:

Test suite for Cluster with Bulk Flows - Reconcilliation in a multi DPN environment
Source: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/010__Cluster_Reconcilliation_Multi_DPN.robot
Start / End / Elapsed: 20250121 02:20:54.928 / 20250121 02:28:18.012 / 00:07:23.084
Status: 18 tests total, 9 passed, 9 failed, 0 skipped
00:00:05.449 SETUP SetupUtils . Setup_Utils_For_Setup_And_Teardown  
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20250121 02:20:55.482 / 20250121 02:21:00.931 / 00:00:05.449
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
Documentation:

Removes all the session objects
Start / End / Elapsed: 20250121 02:28:18.012 / 20250121 02:28:18.012 / 00:00:00.000
00:00:00.544 TEST Check Shards Status And Initialize Variables
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Check Shards Status And Initialize Variables
Documentation:

Check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20250121 02:21:00.931 / 20250121 02:21:01.475 / 00:00:00.544
Status: FAIL
Message: Dictionary '${Stream_dict}' has no key 'titanium'.
00:00:00.520 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250121 02:21:00.932 / 20250121 02:21:01.452 / 00:00:00.520
00:00:00.021 KEYWORD ClusterOpenFlow . Check OpenFlow Shards Status  
Documentation:

Check Status for all shards in OpenFlow application.
Start / End / Elapsed: 20250121 02:21:01.453 / 20250121 02:21:01.474 / 00:00:00.021
00:00:00.009 KEYWORD CompareStream . Run_Keyword_If_At_Least_Phosphorus   Collections.Remove Values From List ${SHARD_OPER_LIST} entity-ownership
Documentation:

Compare phosphorus to titanium and in case titanium is at least phosphorus, run ${kw_name} @{varargs} &{kwargs} and return its value.
Start / End / Elapsed: 20250121 02:21:01.463 / 20250121 02:21:01.472 / 00:00:00.009
00:00:00.009 KEYWORD BuiltIn . Run Keyword And Return   Run_Keyword_If_At_Least phosphorus ${kw_name} @{varargs} &{kwargs}
Documentation:

Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed: 20250121 02:21:01.464 / 20250121 02:21:01.473 / 00:00:00.009
00:00:00.000 KEYWORD BuiltIn . Log   ${SHARD_OPER_LIST}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250121 02:21:01.473 / 20250121 02:21:01.473 / 00:00:00.000
00:00:00.000 KEYWORD ClusterManagement . Verify_Leader_Exists_For_Each_Shard   shard_name_list=${SHARD_OPER_LIST} shard_type=operational member_index_list=${controller_index_list}
Documentation:

For each shard name, call Get_Leader_And_Followers_For_Shard. Not much logic there, but single Keyword is useful when using BuiltIn.Wait_Until_Keyword_Succeeds.
Start / End / Elapsed: 20250121 02:21:01.473 / 20250121 02:21:01.473 / 00:00:00.000
00:00:00.000 KEYWORD ClusterManagement . Verify_Leader_Exists_For_Each_Shard   shard_name_list=${SHARD_CONF_LIST} shard_type=config member_index_list=${controller_index_list}
Documentation:

For each shard name, call Get_Leader_And_Followers_For_Shard. Not much logic there, but single Keyword is useful when using BuiltIn.Wait_Until_Keyword_Succeeds.
Start / End / Elapsed: 20250121 02:21:01.473 / 20250121 02:21:01.473 / 00:00:00.000
00:00:00.000 KEYWORD ${temp_json_config_add} = BulkomaticKeywords . Set DPN And Flow Count In Json Add   ${orig_json_config_add} ${switch_count} ${flow_count_per_switch}
Documentation:

Set new DPN count and flows count per DPN in the Bulkomatic Add json file.
Start / End / Elapsed: 20250121 02:21:01.474 / 20250121 02:21:01.474 / 00:00:00.000
00:00:00.000 KEYWORD ${temp_json_config_get} = BulkomaticKeywords . Set DPN And Flow Count In Json Get   ${orig_json_config_get} ${switch_count} ${flow_count_after_add}
Documentation:

Set new DPN count and flows count per DPN in the Bulkomatic Get json file.
Start / End / Elapsed: 20250121 02:21:01.474 / 20250121 02:21:01.474 / 00:00:00.000
00:00:00.000 KEYWORD ${temp_json_config_del} = BulkomaticKeywords . Set DPN And Flow Count In Json Del   ${orig_json_config_del} ${switch_count} ${flow_count_per_switch}
Documentation:

Set new DPN count and flows count per DPN in the Bulkomatic Del json file.
Start / End / Elapsed: 20250121 02:21:01.475 / 20250121 02:21:01.475 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${temp_json_config_add}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20250121 02:21:01.475 / 20250121 02:21:01.475 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${temp_json_config_get}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20250121 02:21:01.475 / 20250121 02:21:01.475 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${temp_json_config_del}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20250121 02:21:01.475 / 20250121 02:21:01.475 / 00:00:00.000
00:00:06.498 TEST Get Inventory Follower and Leader Before Cluster Restart
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Get Inventory Follower and Leader Before Cluster Restart
Documentation:

Find a follower in the inventory config shard
Start / End / Elapsed: 20250121 02:21:01.476 / 20250121 02:21:07.974 / 00:00:06.498
Status: PASS
00:00:03.278 TEST Start Mininet Connect To Follower Node1
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Start Mininet Connect To Follower Node1
Documentation:

Start mininet with connection to Follower Node1.
Start / End / Elapsed: 20250121 02:21:07.974 / 20250121 02:21:11.252 / 00:00:03.278
Status: PASS
00:00:00.386 TEST Add Bulk Flow From Follower
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Add Bulk Flow From Follower
Documentation:

10000 Flows ( 10000 per DPN) in 1 DPN added via Follower Node1 and verify it gets applied in all instances.
Start / End / Elapsed: 20250121 02:21:11.252 / 20250121 02:21:11.638 / 00:00:00.386
Status: FAIL
Message: Variable '${temp_json_config_add}' not found.
00:00:00.431 TEST Get Bulk Flows and Verify In Inventory Leader
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Get Bulk Flows and Verify In Inventory Leader
Documentation:

Initiate get operation and check flow count across cluster nodes
Start / End / Elapsed: 20250121 02:21:11.639 / 20250121 02:21:12.070 / 00:00:00.431
Status: FAIL
Message: Variable '${temp_json_config_get}' not found.
00:01:40.473 TEST Verify Flows In Switch Before Cluster Restart
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Verify Flows In Switch Before Cluster Restart
Documentation:

Verify flows are installed in switch before cluster restart.
Start / End / Elapsed: 20250121 02:21:12.070 / 20250121 02:22:52.543 / 00:01:40.473
Status: FAIL
Message: Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 10000.0
00:00:02.702 TEST Stop Mininet Connected To Follower Node1 and Exit
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Stop Mininet Connected To Follower Node1 and Exit
Documentation:

Stop mininet and exit connection.
Start / End / Elapsed: 20250121 02:22:52.543 / 20250121 02:22:55.245 / 00:00:02.702
Status: PASS
00:00:02.790 TEST Start Mininet Reconnect To Follower Node1
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Start Mininet Reconnect To Follower Node1
Documentation:

Start mininet with reconnection to follower node1.
Start / End / Elapsed: 20250121 02:22:55.246 / 20250121 02:22:58.036 / 00:00:02.790
Status: PASS
00:01:41.427 TEST Verify Flows In Switch Reconnected To Follower Node1
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Verify Flows In Switch Reconnected To Follower Node1
Documentation:

Verify 10000 flows per DPN installed in switch after it is reconnected to follower node1.
Start / End / Elapsed: 20250121 02:22:58.036 / 20250121 02:24:39.463 / 00:01:41.427
Status: FAIL
Message: Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 10000.0
00:00:02.837 TEST Stop Mininet Connected To Follower Node1
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Stop Mininet Connected To Follower Node1
Documentation:

Stop mininet and exit connection.
Start / End / Elapsed: 20250121 02:24:39.463 / 20250121 02:24:42.300 / 00:00:02.837
Status: PASS
00:00:02.971 TEST Start Mininet Connect To Follower Node2
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Start Mininet Connect To Follower Node2
Documentation:

Start mininet with connection to follower node2.
Start / End / Elapsed: 20250121 02:24:42.300 / 20250121 02:24:45.271 / 00:00:02.971
Status: PASS
00:01:41.438 TEST Verify Flows In Switch Connected To Follower Node2
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Verify Flows In Switch Connected To Follower Node2
Documentation:

Verify 10000 flows per DPN installed in switch after it is connected to follower node2.
Start / End / Elapsed: 20250121 02:24:45.272 / 20250121 02:26:26.710 / 00:01:41.438
Status: FAIL
Message: Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 10000.0
00:00:02.679 TEST Stop Mininet Connected To Follower Node2
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Stop Mininet Connected To Follower Node2
Documentation:

Stop mininet and exit connection.
Start / End / Elapsed: 20250121 02:26:26.710 / 20250121 02:26:29.389 / 00:00:02.679
Status: PASS
00:00:02.767 TEST Start Mininet Connect To Inventory Leader
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Start Mininet Connect To Inventory Leader
Documentation:

Start mininet with connection to inventroy leader.
Start / End / Elapsed: 20250121 02:26:29.389 / 20250121 02:26:32.156 / 00:00:02.767
Status: PASS
00:01:41.119 TEST Verify Flows In Switch Connected To Leader
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Verify Flows In Switch Connected To Leader
Documentation:

Verify 10000 flows per DPN installed in switch after it is connected to inventory leader.
Start / End / Elapsed: 20250121 02:26:32.156 / 20250121 02:28:13.275 / 00:01:41.119
Status: FAIL
Message: Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 10000.0
00:00:02.770 TEST Stop Mininet Connected To Inventory Leader
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Stop Mininet Connected To Inventory Leader
Documentation:

Stop mininet and exit connection.
Start / End / Elapsed: 20250121 02:28:13.275 / 20250121 02:28:16.045 / 00:00:02.770
Status: PASS
00:00:01.615 TEST Delete All Flows From Follower Node1
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Delete All Flows From Follower Node1
Documentation:

10000 Flows deleted via Follower Node1 and verify it gets applied in all instances.
Start / End / Elapsed: 20250121 02:28:16.046 / 20250121 02:28:17.661 / 00:00:01.615
Status: FAIL
Message: Variable '${temp_json_config_del}' not found.
00:00:00.350 TEST Verify No Flows In Inventory Leader
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Verify No Flows In Inventory Leader
Documentation:

Verify flow count is 0 across cluster nodes.
Start / End / Elapsed: 20250121 02:28:17.661 / 20250121 02:28:18.011 / 00:00:00.350
Status: FAIL
Message: Variable '${temp_json_config_get}' not found.
00:27:05.252 SUITE Cluster HA Data Recovery BulkFlow 2Node Cluster
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery BulkFlow 2Node Cluster
Documentation:

Test suite for 2Node Cluster HA with Bulk Flows - Cluster node convergance and Data consistency after leader and follower restart with one switch connected
Source: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/020__Cluster_HA_Data_Recovery_BulkFlow_2Node_Cluster.robot
Start / End / Elapsed: 20250121 02:28:18.013 / 20250121 02:55:23.265 / 00:27:05.252
Status: 30 tests total, 11 passed, 19 failed, 0 skipped
00:31:10.686 SUITE Cluster HA Data Recovery BulkFlow Single Switch
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery BulkFlow Single Switch
Documentation:

Test suite for Cluster HA with Bulk Flows - Data consistency after cluster restart, leader restart and follower restart with one switch connected
Source: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/030__Cluster_HA_Data_Recovery_BulkFlow_Single_Switch.robot
Start / End / Elapsed: 20250121 02:55:23.266 / 20250121 03:26:33.952 / 00:31:10.686
Status: 43 tests total, 21 passed, 22 failed, 0 skipped
00:00:08.350 SUITE Cluster Current Term Verification 3Node Cluster
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster
Documentation:

Test suite for OF-18 Spurious Leader Election verification of term change while flows are added/deleted
Source: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/040__Cluster_Current_Term_Verification_3Node_Cluster.robot
Start / End / Elapsed: 20250121 03:26:33.953 / 20250121 03:26:42.303 / 00:00:08.350
Status: 12 tests total, 0 passed, 12 failed, 0 skipped