Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
1031021000:08:38
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
No Tags
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
openflowplugin-clustering-bulkomatic.txt
1031021000:08:52
openflowplugin-clustering-bulkomatic . txt . Cluster Reconcilliation Multi DPN
18180000:01:00
openflowplugin-clustering-bulkomatic . txt . Cluster HA Data Recovery BulkFlow 2Node Cluster
30300000:02:53
openflowplugin-clustering-bulkomatic . txt . Cluster HA Data Recovery BulkFlow Single Switch
43430000:04:00
openflowplugin-clustering-bulkomatic . txt . Cluster Current Term Verification 3Node Cluster
12111000:00:58

Test Execution Log

00:08:51.790 SUITE openflowplugin-clustering-bulkomatic.txt
Full Name: openflowplugin-clustering-bulkomatic.txt
Source: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-scandium/test/csit/suites/openflowplugin/Clustering_Bulkomatic
Start / End / Elapsed: 20250224 01:08:56.612 / 20250224 01:17:48.402 / 00:08:51.790
Status: 103 tests total, 102 passed, 1 failed, 0 skipped
00:00:59.924 SUITE Cluster Reconcilliation Multi DPN
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN
Documentation:

Test suite for Cluster with Bulk Flows - Reconcilliation in a multi DPN environment
Source: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-scandium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/010__Cluster_Reconcilliation_Multi_DPN.robot
Start / End / Elapsed: 20250224 01:08:56.635 / 20250224 01:09:56.559 / 00:00:59.924
Status: 18 tests total, 18 passed, 0 failed, 0 skipped
00:02:53.289 SUITE Cluster HA Data Recovery BulkFlow 2Node Cluster
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery BulkFlow 2Node Cluster
Documentation:

Test suite for 2Node Cluster HA with Bulk Flows - Cluster node convergance and Data consistency after leader and follower restart with one switch connected
Source: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-scandium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/020__Cluster_HA_Data_Recovery_BulkFlow_2Node_Cluster.robot
Start / End / Elapsed: 20250224 01:09:56.559 / 20250224 01:12:49.848 / 00:02:53.289
Status: 30 tests total, 30 passed, 0 failed, 0 skipped
00:04:00.196 SUITE Cluster HA Data Recovery BulkFlow Single Switch
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery BulkFlow Single Switch
Documentation:

Test suite for Cluster HA with Bulk Flows - Data consistency after cluster restart, leader restart and follower restart with one switch connected
Source: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-scandium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/030__Cluster_HA_Data_Recovery_BulkFlow_Single_Switch.robot
Start / End / Elapsed: 20250224 01:12:49.849 / 20250224 01:16:50.045 / 00:04:00.196
Status: 43 tests total, 43 passed, 0 failed, 0 skipped
00:00:58.355 SUITE Cluster Current Term Verification 3Node Cluster
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster
Documentation:

Test suite for OF-18 Spurious Leader Election verification of term change while flows are added/deleted
Source: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-scandium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/040__Cluster_Current_Term_Verification_3Node_Cluster.robot
Start / End / Elapsed: 20250224 01:16:50.045 / 20250224 01:17:48.400 / 00:00:58.355
Status: 12 tests total, 11 passed, 1 failed, 0 skipped
00:00:02.331 SETUP SetupUtils . Setup_Utils_For_Setup_And_Teardown  
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20250224 01:16:50.118 / 20250224 01:16:52.449 / 00:00:02.331
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
Documentation:

Removes all the session objects
Start / End / Elapsed: 20250224 01:17:48.400 / 20250224 01:17:48.400 / 00:00:00.000
00:00:04.887 TEST Check Shard And Get Inventory
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster.Check Shard And Get Inventory
Documentation:

Check Status for all shards and Finding a leader and followers in the inventory config shard
Start / End / Elapsed: 20250224 01:16:52.449 / 20250224 01:16:57.336 / 00:00:04.887
Status: PASS
00:00:00.414 TEST Initial Current Term Verification
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster.Initial Current Term Verification
Documentation:

Verifying current term for Leader Node Before
Start / End / Elapsed: 20250224 01:16:57.336 / 20250224 01:16:57.750 / 00:00:00.414
Status: PASS
00:00:01.517 TEST Add Bulk Flow From Follower
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster.Add Bulk Flow From Follower
Documentation:

10000 Flows added via Follower Node1 and verify it gets applied in all instances.
Start / End / Elapsed: 20250224 01:16:57.750 / 20250224 01:16:59.267 / 00:00:01.517
Status: PASS
00:00:07.905 TEST Get Bulk Flows And Verify In Cluster
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster.Get Bulk Flows And Verify In Cluster
Documentation:

Initiate get operation and check flow count across cluster nodes
Start / End / Elapsed: 20250224 01:16:59.267 / 20250224 01:17:07.172 / 00:00:07.905
Status: PASS
00:00:00.449 TEST Current Term Verification After Adding Bulk Flow
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster.Current Term Verification After Adding Bulk Flow
Documentation:

Verifying current term for Leader Node after pushing the flows
Start / End / Elapsed: 20250224 01:17:07.173 / 20250224 01:17:07.622 / 00:00:00.449
Status: PASS
00:00:00.438 TEST Current Term Comparison Before And After Addition Of Flow
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster.Current Term Comparison Before And After Addition Of Flow
Documentation:

Comparison of Current Term Before and After Addition of Flows
Start / End / Elapsed: 20250224 01:17:07.622 / 20250224 01:17:08.060 / 00:00:00.438
Status: PASS
00:00:25.117 TEST Delete and Add ten percent of the flows for 5 iterations
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster.Delete and Add ten percent of the flows for 5 iterations
Documentation:

Performeing 5 iterations for Delete and Add ten Percentage of the flows
Start / End / Elapsed: 20250224 01:17:08.060 / 20250224 01:17:33.177 / 00:00:25.117
Status: FAIL
Message: 9851 != 10000
00:00:00.407 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing  
Documentation:

Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden.
Start / End / Elapsed: 20250224 01:17:08.061 / 20250224 01:17:08.468 / 00:00:00.407
00:00:24.709 FOR ${index} IN RANGE 1 6  
Start / End / Elapsed: 20250224 01:17:08.468 / 20250224 01:17:33.177 / 00:00:24.709
00:00:24.709 ITERATION ${index} = 1  
Start / End / Elapsed: 20250224 01:17:08.469 / 20250224 01:17:33.178 / 00:00:24.709
00:00:00.000 KEYWORD BuiltIn . Log   ${index}
Documentation:

Logs the given message with the given level.
Start / End / Elapsed: 20250224 01:17:08.469 / 20250224 01:17:08.469 / 00:00:00.000
00:00:00.099 KEYWORD BulkomaticKeywords . Delete Bulk Flow In Node   ${temp_json_config_del_ten_percent} ${Follower_Node_1} ${operation_timeout}
Documentation:

Delete Bulk Flow in member ${controller_index} and wait until operation is completed.
Start / End / Elapsed: 20250224 01:17:08.473 / 20250224 01:17:08.572 / 00:00:00.099
00:00:15.948 KEYWORD BulkomaticKeywords . Get Bulk Flow And Verify Count In Cluster   ${temp_json_config_get} ${operation_timeout} ${flow_count_after_del_ten_percent} ${Inventory_Leader_List}
Documentation:

Get Bulk Flow and Verify Flow Count in ${controller_index_list} matches ${flow_count}.
Start / End / Elapsed: 20250224 01:17:08.581 / 20250224 01:17:24.529 / 00:00:15.948
00:00:01.145 KEYWORD BulkomaticKeywords . Add Bulk Flow In Node   ${temp_json_config_add_ten_percent} ${Follower_Node_1} ${operation_timeout}
Documentation:

Add Bulk Flow in member ${controller_index} and wait until operation is completed.
Start / End / Elapsed: 20250224 01:17:24.534 / 20250224 01:17:25.679 / 00:00:01.145
00:00:07.490 KEYWORD BulkomaticKeywords . Get Bulk Flow And Verify Count In Cluster   ${temp_json_config_get} ${operation_timeout} ${flow_count_after_add} ${Inventory_Leader_List}
Documentation:

Get Bulk Flow and Verify Flow Count in ${controller_index_list} matches ${flow_count}.
Start / End / Elapsed: 20250224 01:17:25.687 / 20250224 01:17:33.177 / 00:00:07.490
00:00:00.001 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All   given_list=${controller_index_list}
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250224 01:17:25.688 / 20250224 01:17:25.689 / 00:00:00.001
00:00:00.061 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250224 01:17:25.689 / 20250224 01:17:25.750 / 00:00:00.061
00:00:07.385 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250224 01:17:25.750 / 20250224 01:17:33.135 / 00:00:07.385
00:00:00.043 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250224 01:17:33.134 / 20250224 01:17:33.177 / 00:00:00.043
00:00:00.043 ITERATION ${index} = 2  
Start / End / Elapsed: 20250224 01:17:33.135 / 20250224 01:17:33.178 / 00:00:00.043
00:00:00.038 KEYWORD BulkomaticKeywords . Verify Flow Count   ${flow_count} ${index}
Documentation:

Verify Flow Count in member ${controller_index} matches 10000.
Start / End / Elapsed: 20250224 01:17:33.139 / 20250224 01:17:33.177 / 00:00:00.038
00:00:00.036 KEYWORD ${data} = BulkomaticKeywords . Get Bulk Flow Count   ${controller_index}
Documentation:

Get Flow count in member 2. New Flow Count is available after Get Bulk Flow operation.
Start / End / Elapsed: 20250224 01:17:33.139 / 20250224 01:17:33.175 / 00:00:00.036
00:00:00.001 KEYWORD ${json} = Utils . Json Parse From String   ${data}
Documentation:

Parse given plain string into json (dictionary)
Start / End / Elapsed: 20250224 01:17:33.176 / 20250224 01:17:33.177 / 00:00:00.001
00:00:00.000 KEYWORD ${value} = Collections . Get From Dictionary   ${json} value
Documentation:

Returns a value from the given dictionary based on the given key.
Start / End / Elapsed: 20250224 01:17:33.177 / 20250224 01:17:33.177 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Be Equal As Strings   ${value} ${flow_count}
Documentation:

Fails if objects are unequal after converting them to strings.
Start / End / Elapsed: 20250224 01:17:33.177 / 20250224 01:17:33.177 / 00:00:00.000
01:17:33.177 INFO Argument types are: <class 'int'> <class 'str'>
01:17:33.177 FAIL 9851 != 10000
00:00:00.536 TEST Current Term Verification After Continuous Deletion and Addition Of Flows for 5 iterations
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster.Current Term Verification After Continuous Deletion and Addition Of Flows for 5 iterations
Documentation:

Verifying current term for Leader Node after continuous deletion and addition of ten percent of the flows
Start / End / Elapsed: 20250224 01:17:33.178 / 20250224 01:17:33.714 / 00:00:00.536
Status: PASS
00:00:00.539 TEST Current Term Comparison Before and After Continuous Deletion and Addition Of Flows for 5 iterations
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster.Current Term Comparison Before and After Continuous Deletion and Addition Of Flows for 5 iterations
Documentation:

Comparison Current Term Before and After Continuous Deletion and Addition Of Flows for 5 iterations
Start / End / Elapsed: 20250224 01:17:33.714 / 20250224 01:17:34.253 / 00:00:00.539
Status: PASS
00:00:01.484 TEST Delete All Flows From Follower Node
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster.Delete All Flows From Follower Node
Documentation:

10000 Flows deleted via Leader Node and verify it gets applied in all instances.
Start / End / Elapsed: 20250224 01:17:34.253 / 20250224 01:17:35.737 / 00:00:01.484
Status: PASS
00:00:12.055 TEST Verify No Flows In Cluster After Flow Deletion
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster.Verify No Flows In Cluster After Flow Deletion
Documentation:

Verifying No FLows in Cluster after Flows Deletion
Start / End / Elapsed: 20250224 01:17:35.738 / 20250224 01:17:47.793 / 00:00:12.055
Status: PASS
00:00:00.607 TEST PreLeader Verification
Full Name: openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster.PreLeader Verification
Documentation:

Verifying LastIndex and LastApplied and compare both are equal
Start / End / Elapsed: 20250224 01:17:47.793 / 20250224 01:17:48.400 / 00:00:00.607
Status: PASS