Total Statistics | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
All Tests | 103 | 41 | 62 | 0 | 01:05:16 |
Statistics by Tag | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
No Tags |
Statistics by Suite | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
103 | 41 | 62 | 0 | 01:05:33 | ||
18 | 9 | 9 | 0 | 00:07:24 | ||
30 | 11 | 19 | 0 | 00:26:58 | ||
43 | 21 | 22 | 0 | 00:31:02 | ||
12 | 0 | 12 | 0 | 00:00:08 |
Full Name: | openflowplugin-clustering-bulkomatic.txt |
---|---|
Source: | /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic |
Start / End / Elapsed: | 20241222 02:31:22.525 / 20241222 03:36:55.136 / 01:05:32.611 |
Status: | 103 tests total, 41 passed, 62 failed, 0 skipped |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN |
---|---|
Documentation: | Test suite for Cluster with Bulk Flows - Reconcilliation in a multi DPN environment |
Source: | /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/010__Cluster_Reconcilliation_Multi_DPN.robot |
Start / End / Elapsed: | 20241222 02:31:22.547 / 20241222 02:38:46.459 / 00:07:23.912 |
Status: | 18 tests total, 9 passed, 9 failed, 0 skipped |
Documentation: | Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly. |
---|---|
Start / End / Elapsed: | 20241222 02:31:23.074 / 20241222 02:31:28.733 / 00:00:05.659 |
Documentation: | Removes all the session objects |
---|---|
Start / End / Elapsed: | 20241222 02:38:46.458 / 20241222 02:38:46.458 / 00:00:00.000 |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Check Shards Status And Initialize Variables |
---|---|
Documentation: | Check Status for all shards in OpenFlow application. |
Start / End / Elapsed: | 20241222 02:31:28.732 / 20241222 02:31:29.208 / 00:00:00.476 |
Status: | FAIL |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden. |
---|---|
Start / End / Elapsed: | 20241222 02:31:28.733 / 20241222 02:31:29.186 / 00:00:00.453 |
Documentation: | Check Status for all shards in OpenFlow application. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.186 / 20241222 02:31:29.206 / 00:00:00.020 |
Documentation: | Compare phosphorus to titanium and in case titanium is at least phosphorus, run ${kw_name} @{varargs} &{kwargs} and return its value. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.197 / 20241222 02:31:29.206 / 00:00:00.009 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.197 / 20241222 02:31:29.205 / 00:00:00.008 |
Documentation: | Compare ${lower_bound} to titanium and in case titanium is at least ${lower_bound}, run Collections.Remove Values From List [['inventory', 'topology', 'default', 'entity-ownership'], 'entity-ownership'] {} and return its value. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.205 / 20241222 02:31:29.206 / 00:00:00.001 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.205 / 20241222 02:31:29.205 / 00:00:00.000 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.206 / 20241222 02:31:29.206 / 00:00:00.000 |
Documentation: | For each shard name, call Get_Leader_And_Followers_For_Shard. Not much logic there, but single Keyword is useful when using BuiltIn.Wait_Until_Keyword_Succeeds. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.206 / 20241222 02:31:29.206 / 00:00:00.000 |
Documentation: | For each shard name, call Get_Leader_And_Followers_For_Shard. Not much logic there, but single Keyword is useful when using BuiltIn.Wait_Until_Keyword_Succeeds. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.206 / 20241222 02:31:29.206 / 00:00:00.000 |
Documentation: | Set new DPN count and flows count per DPN in the Bulkomatic Add json file. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.207 / 20241222 02:31:29.207 / 00:00:00.000 |
Documentation: | Set new DPN count and flows count per DPN in the Bulkomatic Get json file. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.207 / 20241222 02:31:29.207 / 00:00:00.000 |
Documentation: | Set new DPN count and flows count per DPN in the Bulkomatic Del json file. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.207 / 20241222 02:31:29.207 / 00:00:00.000 |
Documentation: | Makes a variable available everywhere within the scope of the current suite. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.208 / 20241222 02:31:29.208 / 00:00:00.000 |
Documentation: | Makes a variable available everywhere within the scope of the current suite. |
---|---|
Start / End / Elapsed: | 20241222 02:31:29.208 / 20241222 02:31:29.208 / 00:00:00.000 |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Get Inventory Follower and Leader Before Cluster Restart |
---|---|
Documentation: | Find a follower in the inventory config shard |
Start / End / Elapsed: | 20241222 02:31:29.208 / 20241222 02:31:35.912 / 00:00:06.704 |
Status: | PASS |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Start Mininet Connect To Follower Node1 |
---|---|
Documentation: | Start mininet with connection to Follower Node1. |
Start / End / Elapsed: | 20241222 02:31:35.913 / 20241222 02:31:39.908 / 00:00:03.995 |
Status: | PASS |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Add Bulk Flow From Follower |
---|---|
Documentation: | 10000 Flows ( 10000 per DPN) in 1 DPN added via Follower Node1 and verify it gets applied in all instances. |
Start / End / Elapsed: | 20241222 02:31:39.908 / 20241222 02:31:40.274 / 00:00:00.366 |
Status: | FAIL |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden. |
---|---|
Start / End / Elapsed: | 20241222 02:31:39.909 / 20241222 02:31:40.265 / 00:00:00.356 |
Documentation: | Add Bulk Flow in member ${controller_index} and wait until operation is completed. |
---|---|
Start / End / Elapsed: | 20241222 02:31:40.269 / 20241222 02:31:40.273 / 00:00:00.004 |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Get Bulk Flows and Verify In Inventory Leader |
---|---|
Documentation: | Initiate get operation and check flow count across cluster nodes |
Start / End / Elapsed: | 20241222 02:31:40.274 / 20241222 02:31:40.706 / 00:00:00.432 |
Status: | FAIL |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden. |
---|---|
Start / End / Elapsed: | 20241222 02:31:40.274 / 20241222 02:31:40.693 / 00:00:00.419 |
Documentation: | Get Bulk Flow and Verify Flow Count in ${controller_index_list} matches ${flow_count}. |
---|---|
Start / End / Elapsed: | 20241222 02:31:40.702 / 20241222 02:31:40.706 / 00:00:00.004 |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Verify Flows In Switch Before Cluster Restart |
---|---|
Documentation: | Verify flows are installed in switch before cluster restart. |
Start / End / Elapsed: | 20241222 02:31:40.706 / 20241222 02:33:23.058 / 00:01:42.352 |
Status: | FAIL |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden. |
---|---|
Start / End / Elapsed: | 20241222 02:31:40.707 / 20241222 02:31:41.133 / 00:00:00.426 |
Documentation: | Verify flow count per switch |
---|---|
Start / End / Elapsed: | 20241222 02:31:41.133 / 20241222 02:33:23.058 / 00:01:41.925 |
Documentation: | Runs the specified keyword and retries if it fails. |
---|---|
Start / End / Elapsed: | 20241222 02:31:41.133 / 20241222 02:33:23.058 / 00:01:41.925 |
Message: |
Documentation: | Sync with mininet to match exact number of flows |
---|---|
Start / End / Elapsed: | 20241222 02:33:23.016 / 20241222 02:33:23.058 / 00:00:00.042 |
Start / End / Elapsed: | 20241222 02:33:23.017 / 20241222 02:33:23.018 / 00:00:00.001 |
---|
Documentation: | Returns the given values which can then be assigned to a variables. |
---|---|
Start / End / Elapsed: | 20241222 02:33:23.018 / 20241222 02:33:23.018 / 00:00:00.000 |
Documentation: | Sends Command dpctl dump-aggregate -O OpenFlow13 to Mininet session 32 and returns read buffer response. |
---|---|
Start / End / Elapsed: | 20241222 02:33:23.020 / 20241222 02:33:23.056 / 00:00:00.036 |
Documentation: | Returns a list of all non-overlapping matches in the given string. |
---|---|
Start / End / Elapsed: | 20241222 02:33:23.056 / 20241222 02:33:23.056 / 00:00:00.000 |
Documentation: | Evaluates the given expression in Python and returns the result. |
---|---|
Start / End / Elapsed: | 20241222 02:33:23.057 / 20241222 02:33:23.057 / 00:00:00.000 |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Stop Mininet Connected To Follower Node1 and Exit |
---|---|
Documentation: | Stop mininet and exit connection. |
Start / End / Elapsed: | 20241222 02:33:23.058 / 20241222 02:33:25.757 / 00:00:02.699 |
Status: | PASS |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Start Mininet Reconnect To Follower Node1 |
---|---|
Documentation: | Start mininet with reconnection to follower node1. |
Start / End / Elapsed: | 20241222 02:33:25.758 / 20241222 02:33:28.553 / 00:00:02.795 |
Status: | PASS |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Verify Flows In Switch Reconnected To Follower Node1 |
---|---|
Documentation: | Verify 10000 flows per DPN installed in switch after it is reconnected to follower node1. |
Start / End / Elapsed: | 20241222 02:33:28.553 / 20241222 02:35:10.968 / 00:01:42.415 |
Status: | FAIL |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden. |
---|---|
Start / End / Elapsed: | 20241222 02:33:28.554 / 20241222 02:33:29.003 / 00:00:00.449 |
Documentation: | Verify flow count per switch |
---|---|
Start / End / Elapsed: | 20241222 02:33:29.003 / 20241222 02:35:10.968 / 00:01:41.965 |
Documentation: | Runs the specified keyword and retries if it fails. |
---|---|
Start / End / Elapsed: | 20241222 02:33:29.004 / 20241222 02:35:10.968 / 00:01:41.964 |
Message: |
Documentation: | Sync with mininet to match exact number of flows |
---|---|
Start / End / Elapsed: | 20241222 02:35:10.928 / 20241222 02:35:10.968 / 00:00:00.040 |
Start / End / Elapsed: | 20241222 02:35:10.929 / 20241222 02:35:10.930 / 00:00:00.001 |
---|
Documentation: | Returns the given values which can then be assigned to a variables. |
---|---|
Start / End / Elapsed: | 20241222 02:35:10.930 / 20241222 02:35:10.930 / 00:00:00.000 |
Documentation: | Sends Command dpctl dump-aggregate -O OpenFlow13 to Mininet session 44 and returns read buffer response. |
---|---|
Start / End / Elapsed: | 20241222 02:35:10.932 / 20241222 02:35:10.966 / 00:00:00.034 |
Documentation: | Returns a list of all non-overlapping matches in the given string. |
---|---|
Start / End / Elapsed: | 20241222 02:35:10.966 / 20241222 02:35:10.966 / 00:00:00.000 |
Documentation: | Evaluates the given expression in Python and returns the result. |
---|---|
Start / End / Elapsed: | 20241222 02:35:10.967 / 20241222 02:35:10.967 / 00:00:00.000 |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Stop Mininet Connected To Follower Node1 |
---|---|
Documentation: | Stop mininet and exit connection. |
Start / End / Elapsed: | 20241222 02:35:10.969 / 20241222 02:35:13.595 / 00:00:02.626 |
Status: | PASS |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Start Mininet Connect To Follower Node2 |
---|---|
Documentation: | Start mininet with connection to follower node2. |
Start / End / Elapsed: | 20241222 02:35:13.595 / 20241222 02:35:16.402 / 00:00:02.807 |
Status: | PASS |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Verify Flows In Switch Connected To Follower Node2 |
---|---|
Documentation: | Verify 10000 flows per DPN installed in switch after it is connected to follower node2. |
Start / End / Elapsed: | 20241222 02:35:16.402 / 20241222 02:36:56.832 / 00:01:40.430 |
Status: | FAIL |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden. |
---|---|
Start / End / Elapsed: | 20241222 02:35:16.403 / 20241222 02:35:16.817 / 00:00:00.414 |
Documentation: | Verify flow count per switch |
---|---|
Start / End / Elapsed: | 20241222 02:35:16.817 / 20241222 02:36:56.832 / 00:01:40.015 |
Documentation: | Runs the specified keyword and retries if it fails. |
---|---|
Start / End / Elapsed: | 20241222 02:35:16.818 / 20241222 02:36:56.833 / 00:01:40.015 |
Message: |
Documentation: | Sync with mininet to match exact number of flows |
---|---|
Start / End / Elapsed: | 20241222 02:36:56.791 / 20241222 02:36:56.832 / 00:00:00.041 |
Start / End / Elapsed: | 20241222 02:36:56.792 / 20241222 02:36:56.793 / 00:00:00.001 |
---|
Documentation: | Returns the given values which can then be assigned to a variables. |
---|---|
Start / End / Elapsed: | 20241222 02:36:56.793 / 20241222 02:36:56.793 / 00:00:00.000 |
Documentation: | Sends Command dpctl dump-aggregate -O OpenFlow13 to Mininet session 56 and returns read buffer response. |
---|---|
Start / End / Elapsed: | 20241222 02:36:56.794 / 20241222 02:36:56.830 / 00:00:00.036 |
Documentation: | Returns a list of all non-overlapping matches in the given string. |
---|---|
Start / End / Elapsed: | 20241222 02:36:56.831 / 20241222 02:36:56.831 / 00:00:00.000 |
Documentation: | Evaluates the given expression in Python and returns the result. |
---|---|
Start / End / Elapsed: | 20241222 02:36:56.831 / 20241222 02:36:56.831 / 00:00:00.000 |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Stop Mininet Connected To Follower Node2 |
---|---|
Documentation: | Stop mininet and exit connection. |
Start / End / Elapsed: | 20241222 02:36:56.833 / 20241222 02:36:59.789 / 00:00:02.956 |
Status: | PASS |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Start Mininet Connect To Inventory Leader |
---|---|
Documentation: | Start mininet with connection to inventroy leader. |
Start / End / Elapsed: | 20241222 02:36:59.789 / 20241222 02:37:02.601 / 00:00:02.812 |
Status: | PASS |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Verify Flows In Switch Connected To Leader |
---|---|
Documentation: | Verify 10000 flows per DPN installed in switch after it is connected to inventory leader. |
Start / End / Elapsed: | 20241222 02:37:02.601 / 20241222 02:38:43.019 / 00:01:40.418 |
Status: | FAIL |
Message: |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Stop Mininet Connected To Inventory Leader |
---|---|
Documentation: | Stop mininet and exit connection. |
Start / End / Elapsed: | 20241222 02:38:43.019 / 20241222 02:38:45.660 / 00:00:02.641 |
Status: | PASS |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Delete All Flows From Follower Node1 |
---|---|
Documentation: | 10000 Flows deleted via Follower Node1 and verify it gets applied in all instances. |
Start / End / Elapsed: | 20241222 02:38:45.661 / 20241222 02:38:46.065 / 00:00:00.404 |
Status: | FAIL |
Message: |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN.Verify No Flows In Inventory Leader |
---|---|
Documentation: | Verify flow count is 0 across cluster nodes. |
Start / End / Elapsed: | 20241222 02:38:46.065 / 20241222 02:38:46.457 / 00:00:00.392 |
Status: | FAIL |
Message: |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery BulkFlow 2Node Cluster |
---|---|
Documentation: | Test suite for 2Node Cluster HA with Bulk Flows - Cluster node convergance and Data consistency after leader and follower restart with one switch connected |
Source: | /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/020__Cluster_HA_Data_Recovery_BulkFlow_2Node_Cluster.robot |
Start / End / Elapsed: | 20241222 02:38:46.460 / 20241222 03:05:44.621 / 00:26:58.161 |
Status: | 30 tests total, 11 passed, 19 failed, 0 skipped |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery BulkFlow Single Switch |
---|---|
Documentation: | Test suite for Cluster HA with Bulk Flows - Data consistency after cluster restart, leader restart and follower restart with one switch connected |
Source: | /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/030__Cluster_HA_Data_Recovery_BulkFlow_Single_Switch.robot |
Start / End / Elapsed: | 20241222 03:05:44.622 / 20241222 03:36:46.941 / 00:31:02.319 |
Status: | 43 tests total, 21 passed, 22 failed, 0 skipped |
Full Name: | openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification 3Node Cluster |
---|---|
Documentation: | Test suite for OF-18 Spurious Leader Election verification of term change while flows are added/deleted |
Source: | /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/040__Cluster_Current_Term_Verification_3Node_Cluster.robot |
Start / End / Elapsed: | 20241222 03:36:46.942 / 20241222 03:36:55.135 / 00:00:08.193 |
Status: | 12 tests total, 0 passed, 12 failed, 0 skipped |