Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
981000:03:52
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
No Tags
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
openflowplugin-clustering-perf-bulkomatic.txt
981000:03:53

Test Execution Log

00:03:52.654 SUITE openflowplugin-clustering-perf-bulkomatic.txt
Full Name: openflowplugin-clustering-perf-bulkomatic.txt
Documentation:

Test suite for 3Node Cluster - 100K flows and 10 DPNs in Cluster Scale Up scenario
Source: /w/workspace/openflowplugin-csit-3node-clustering-perf-bulkomatic-only-potassium/test/csit/suites/openflowplugin/Performance_Bulkomatic/100K_Flows_100DPN_3Node_Cluster_Perf_Test.robot
Start / End / Elapsed: 20240920 06:16:34.111 / 20240920 06:20:26.765 / 00:03:52.654
Status: 9 tests total, 8 passed, 1 failed, 0 skipped
00:00:00.026 SETUP ClusterManagement . ClusterManagement_Setup  
Documentation:

Detect repeated call, or detect number of members and initialize derived suite variables. Http sessions are created with parameters to not waste time when ODL is no accepting connections properly.
Start / End / Elapsed: 20240920 06:16:34.694 / 20240920 06:16:34.720 / 00:00:00.026
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
Documentation:

Removes all the session objects
Start / End / Elapsed: 20240920 06:20:26.764 / 20240920 06:20:26.764 / 00:00:00.000
00:00:13.616 TEST Check Shards Status And Initialize Variables
Full Name: openflowplugin-clustering-perf-bulkomatic.txt.Check Shards Status And Initialize Variables
Documentation:

Check Status for all shards in OpenFlow application and set the logs across cluster nodes.
Start / End / Elapsed: 20240920 06:16:34.721 / 20240920 06:16:48.337 / 00:00:13.616
Status: PASS
00:00:00.887 TEST Get Inventory Config Shard Follower And Leader
Full Name: openflowplugin-clustering-perf-bulkomatic.txt.Get Inventory Config Shard Follower And Leader
Documentation:

Find a leader and followers in the inventory config shard
Start / End / Elapsed: 20240920 06:16:48.337 / 20240920 06:16:49.224 / 00:00:00.887
Status: PASS
00:01:14.624 TEST Start Mininet Connect To Follower Node1
Full Name: openflowplugin-clustering-perf-bulkomatic.txt.Start Mininet Connect To Follower Node1
Documentation:

Start mininet with connection to follower node1.
Start / End / Elapsed: 20240920 06:16:49.224 / 20240920 06:18:03.848 / 00:01:14.624
Status: PASS
00:00:04.366 TEST Add Bulk Flow From Follower Node2
Full Name: openflowplugin-clustering-perf-bulkomatic.txt.Add Bulk Flow From Follower Node2
Documentation:

100K Flows (1K Flows per DPN) in 100 DPN added via Follower Node2 and verify it gets applied in all instances.
Start / End / Elapsed: 20240920 06:18:03.848 / 20240920 06:18:08.214 / 00:00:04.366
Status: PASS
00:00:04.554 TEST Verify Flows In Switch
Full Name: openflowplugin-clustering-perf-bulkomatic.txt.Verify Flows In Switch
Documentation:

Verify 100K flows are installed in 10 switches.
Start / End / Elapsed: 20240920 06:18:08.214 / 20240920 06:18:12.768 / 00:00:04.554
Status: PASS
00:00:07.862 TEST Verify Flows In Oper DS
Full Name: openflowplugin-clustering-perf-bulkomatic.txt.Verify Flows In Oper DS
Documentation:

Check Flows in Operational Datastore
Start / End / Elapsed: 20240920 06:18:12.768 / 20240920 06:18:20.630 / 00:00:07.862
Status: PASS
00:02:04.957 TEST Stop Mininet Connected To Follower Node1 After Reconcilliation
Full Name: openflowplugin-clustering-perf-bulkomatic.txt.Stop Mininet Connected To Follower Node1 After Reconcilliation
Documentation:

Stop mininet and exit connection.
Start / End / Elapsed: 20240920 06:18:20.630 / 20240920 06:20:25.587 / 00:02:04.957
Status: FAIL
Message: Keyword 'ClusterOpenFlow.Verify_Switch_Connections_Running_On_Member' failed after retrying for 2 minutes. The last error was: 0.0 != 1.0
00:00:03.632 KEYWORD MininetKeywords . Stop Mininet And Exit   ${mininet_conn_id}
Documentation:

Stops Mininet and exits session ${mininet_conn}
Start / End / Elapsed: 20240920 06:18:20.639 / 20240920 06:18:24.271 / 00:00:03.632
00:02:01.316 KEYWORD BuiltIn . Wait Until Keyword Succeeds   ${mininet_timeout} 2s ClusterOpenFlow.Verify_Switch_Connections_Running_On_Member 0 ${Inventory_Leader}
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20240920 06:18:24.271 / 20240920 06:20:25.587 / 00:02:01.316
Message: 31 failing items removed using the --remove-keywords option.
00:00:00.094 KEYWORD ClusterOpenFlow . Verify Switch Connections Running On Member   0 ${Inventory_Leader}
Documentation:

Check if number of Switch connections on member of given index is equal to 32.
Start / End / Elapsed: 20240920 06:20:25.493 / 20240920 06:20:25.587 / 00:00:00.094
00:00:00.093 KEYWORD ${count} = ScaleClient . Get Switches Count   controller=${ODL_SYSTEM_${member_index}_IP}
Documentation:

Gives the count of the switches presnt in the operational inventory nodes datastore.
Start / End / Elapsed: 20240920 06:20:25.494 / 20240920 06:20:25.587 / 00:00:00.093
00:00:00.000 KEYWORD BuiltIn . Should Be Equal As Numbers   ${switch_count} ${count}
Documentation:

Fails if objects are unequal after converting them to real numbers.
Start / End / Elapsed: 20240920 06:20:25.586 / 20240920 06:20:25.586 / 00:00:00.000
06:20:25.587 INFO Argument types are: <class 'str'> <class 'int'>
06:20:25.587 FAIL 0.0 != 1.0
06:20:25.587 FAIL Keyword 'ClusterOpenFlow.Verify_Switch_Connections_Running_On_Member' failed after retrying for 2 minutes. The last error was: 0.0 != 1.0
00:00:01.174 TEST Delete All Flows From Follower Node2
Full Name: openflowplugin-clustering-perf-bulkomatic.txt.Delete All Flows From Follower Node2
Documentation:

100K Flows deleted via Follower Node2 and verify it gets applied in all instances.
Start / End / Elapsed: 20240920 06:20:25.588 / 20240920 06:20:26.762 / 00:00:01.174
Status: PASS
00:00:00.002 TEST Log Results And Determine Status
Full Name: openflowplugin-clustering-perf-bulkomatic.txt.Log Results And Determine Status
Documentation:

Log results for plotting.
Start / End / Elapsed: 20240920 06:20:26.762 / 20240920 06:20:26.764 / 00:00:00.002
Status: PASS