Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
817000:02:16
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
NOT robot:exit (combined)
211000:02:16
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
openflowplugin-perf-bulkomatic.txt
817000:02:16

Test Execution Log

00:02:16.490 SUITE openflowplugin-perf-bulkomatic.txt
Full Name: openflowplugin-perf-bulkomatic.txt
Documentation:

Test suite for 3Node Cluster - 100K flows and 10 DPNs in Cluster Scale Up scenario
Source: /w/workspace/openflowplugin-csit-1node-perf-bulkomatic-only-scandium/test/csit/suites/openflowplugin/Performance_Bulkomatic/100K_Flows_100DPN_1Node_Perf_Test.robot
Start / End / Elapsed: 20240922 01:25:13.547 / 20240922 01:27:30.037 / 00:02:16.490
Status: 8 tests total, 1 passed, 7 failed, 0 skipped
00:00:00.016 SETUP ClusterManagement . ClusterManagement_Setup  
Documentation:

Detect repeated call, or detect number of members and initialize derived suite variables. Http sessions are created with parameters to not waste time when ODL is no accepting connections properly.
Start / End / Elapsed: 20240922 01:25:14.120 / 20240922 01:25:14.136 / 00:00:00.016
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
Documentation:

Removes all the session objects
Start / End / Elapsed: 20240922 01:27:30.037 / 20240922 01:27:30.037 / 00:00:00.000
00:00:01.150 TEST Initialize Variables
Full Name: openflowplugin-perf-bulkomatic.txt.Initialize Variables
Documentation:

Initialize Variables and set the log.
Start / End / Elapsed: 20240922 01:25:14.136 / 20240922 01:25:15.286 / 00:00:01.150
Status: PASS
00:02:14.744 TEST Start Mininet And verify Switches
Full Name: openflowplugin-perf-bulkomatic.txt.Start Mininet And verify Switches
Documentation:

Start mininet, controller OF port 6653 should be enabled for TLS while port 6633 should be for TCP.
Start / End / Elapsed: 20240922 01:25:15.286 / 20240922 01:27:30.030 / 00:02:14.744
Status: FAIL
Message: Keyword 'ClusterOpenFlow.Verify_Switch_Connections_Running_On_Member' failed after retrying for 2 minutes. The last error was: 32.0 != 0.0 Also teardown failed: AssertionError
00:00:00.000 KEYWORD ${ofport} = BuiltIn . Set Variable If   '${enable_openflow_tls}' == 'True' 6653 6633
Documentation:

Sets variable based on the given condition.
Start / End / Elapsed: 20240922 01:25:15.286 / 20240922 01:25:15.286 / 00:00:00.000
00:00:00.000 KEYWORD ${protocol} = BuiltIn . Set Variable If   '${enable_openflow_tls}' == 'True' ssl tcp
Documentation:

Sets variable based on the given condition.
Start / End / Elapsed: 20240922 01:25:15.287 / 20240922 01:25:15.287 / 00:00:00.000
00:00:14.223 KEYWORD ${mininet_conn_id} = MininetKeywords . Start Mininet Multiple Controllers   options=--topo linear,${switch_count} ofport=${ofport} protocol=${protocol}
Documentation:

Start Mininet with custom topology and connect to list of controllers in ${controller_index_list} or all if no list is provided.
Start / End / Elapsed: 20240922 01:25:15.292 / 20240922 01:25:29.515 / 00:00:14.223
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${mininet_conn_id}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20240922 01:25:29.516 / 20240922 01:25:29.516 / 00:00:00.000
00:02:00.512 KEYWORD BuiltIn . Wait Until Keyword Succeeds   ${mininet_timeout} 2s ClusterOpenFlow.Verify_Switch_Connections_Running_On_Member ${switch_count} 1
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20240922 01:25:29.516 / 20240922 01:27:30.028 / 00:02:00.512
Message: 59 failing items removed using the --remove-keywords option.
00:00:00.000 KEYWORD BuiltIn . Comment   Fail the entire suite if switches cannot connect
Documentation:

Displays the given messages in the log file as keyword arguments.
Start / End / Elapsed: 20240922 01:27:30.028 / 20240922 01:27:30.028 / 00:00:00.000
00:00:00.001 TEARDOWN BuiltIn . Run Keyword If Test Failed   Fatal Error
Documentation:

Runs the given keyword with the given arguments, if the test failed.
Start / End / Elapsed: 20240922 01:27:30.029 / 20240922 01:27:30.030 / 00:00:00.001
00:00:00.001 TEST Add Bulk Flow
Full Name: openflowplugin-perf-bulkomatic.txt.Add Bulk Flow
Documentation:

100K Flows (1K Flows per DPN) in 100 DPN added and verify it gets applied.
Tags: robot:exit
Start / End / Elapsed: 20240922 01:27:30.031 / 20240922 01:27:30.032 / 00:00:00.001
Status: FAIL
Message: Test execution stopped due to a fatal error.
00:00:00.001 TEST Verify Flows In Switch
Full Name: openflowplugin-perf-bulkomatic.txt.Verify Flows In Switch
Documentation:

Verify 100K flows are installed in 100 switches.
Tags: robot:exit
Start / End / Elapsed: 20240922 01:27:30.032 / 20240922 01:27:30.033 / 00:00:00.001
Status: FAIL
Message: Test execution stopped due to a fatal error.
00:00:00.001 TEST Verify Flows In Oper DS
Full Name: openflowplugin-perf-bulkomatic.txt.Verify Flows In Oper DS
Documentation:

Check Flows in Operational Datastore
Tags: robot:exit
Start / End / Elapsed: 20240922 01:27:30.033 / 20240922 01:27:30.034 / 00:00:00.001
Status: FAIL
Message: Test execution stopped due to a fatal error.
00:00:00.000 TEST Stop Mininet And Verify
Full Name: openflowplugin-perf-bulkomatic.txt.Stop Mininet And Verify
Documentation:

Stop mininet and exit connection.
Tags: robot:exit
Start / End / Elapsed: 20240922 01:27:30.035 / 20240922 01:27:30.035 / 00:00:00.000
Status: FAIL
Message: Test execution stopped due to a fatal error.
00:00:00.000 TEST Delete All Flows
Full Name: openflowplugin-perf-bulkomatic.txt.Delete All Flows
Documentation:

100K Flows deleted and verify.
Tags: robot:exit
Start / End / Elapsed: 20240922 01:27:30.035 / 20240922 01:27:30.035 / 00:00:00.000
Status: FAIL
Message: Test execution stopped due to a fatal error.
00:00:00.000 TEST Log Results And Determine Status
Full Name: openflowplugin-perf-bulkomatic.txt.Log Results And Determine Status
Documentation:

Log results for plotting.
Tags: robot:exit
Start / End / Elapsed: 20240922 01:27:30.036 / 20240922 01:27:30.036 / 00:00:00.000
Status: FAIL
Message: Test execution stopped due to a fatal error.