Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.132:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.132 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.45:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Mon Jun 1 01:45:07 UTC 2026 System load: 0.06 Processes: 110 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.45 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-48317-736-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.132:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.132 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.132:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.132 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.132 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.45" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.45:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Mon Jun 1 01:45:07 UTC 2026 System load: 0.06 Processes: 110 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.45 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Mon Jun 1 01:45:08 2026 from 10.30.170.141 [?2004h[jenkins@releng-48317-736-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.132 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.132. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:46:14.285 16 switches: flows: 97632 97030 95476 100593 97331 99098 96450 98057 95195 96567 93443 96490 94565 97458 93474 94393 total = 25.720867 per ms 01:47:14.386 16 switches: flows: 109367 106906 107011 108691 106476 106677 107014 106379 105681 105625 105291 104123 104247 104973 103856 102381 total = 28.197866 per ms 01:48:14.487 16 switches: flows: 109572 104792 106104 106652 105587 105102 108174 107496 103620 104206 104995 105554 105705 105939 102393 105486 total = 28.142663 per ms 01:49:14.587 16 switches: flows: 112943 106637 106755 108597 110668 107480 111882 106923 105273 106245 105947 108536 110524 110880 101621 106872 total = 28.748396 per ms 01:50:14.688 16 switches: flows: 111879 106795 105349 107134 106479 105788 109477 106953 104092 106128 107254 107779 107515 109088 102458 107001 total = 28.471973 per ms 01:51:14.788 16 switches: flows: 107246 110400 106421 111415 109298 106652 108485 107838 106628 103558 106235 105231 104696 108485 104926 107289 total = 28.532424 per ms 01:52:14.889 16 switches: flows: 111461 112977 110223 113807 113160 108581 108688 108752 111454 105740 112333 106683 104554 111133 108063 108526 total = 29.220103 per ms 01:53:14.990 16 switches: flows: 111681 114341 109601 113789 115534 109920 111121 110416 111937 108483 111541 108230 109494 113121 109510 109099 total = 29.580920 per ms 01:54:15.091 16 switches: flows: 110782 111091 109841 111909 109621 108517 109718 113590 110014 108528 110678 107184 109487 110244 108006 106450 total = 29.212229 per ms 01:55:15.192 16 switches: flows: 113597 109513 110444 114544 110136 109106 110611 114380 112145 108890 112133 108387 109922 111949 108663 106881 total = 29.472448 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 28142.66/29580.92/28842.11/9627.72 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.132. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:46:14.285 16 switches: flows: 97632 97030 95476 100593 97331 99098 96450 98057 95195 96567 93443 96490 94565 97458 93474 94393 total = 25.720867 per ms 01:47:14.386 16 switches: flows: 109367 106906 107011 108691 106476 106677 107014 106379 105681 105625 105291 104123 104247 104973 103856 102381 total = 28.197866 per ms 01:48:14.487 16 switches: flows: 109572 104792 106104 106652 105587 105102 108174 107496 103620 104206 104995 105554 105705 105939 102393 105486 total = 28.142663 per ms 01:49:14.587 16 switches: flows: 112943 106637 106755 108597 110668 107480 111882 106923 105273 106245 105947 108536 110524 110880 101621 106872 total = 28.748396 per ms 01:50:14.688 16 switches: flows: 111879 106795 105349 107134 106479 105788 109477 106953 104092 106128 107254 107779 107515 109088 102458 107001 total = 28.471973 per ms 01:51:14.788 16 switches: flows: 107246 110400 106421 111415 109298 106652 108485 107838 106628 103558 106235 105231 104696 108485 104926 107289 total = 28.532424 per ms 01:52:14.889 16 switches: flows: 111461 112977 110223 113807 113160 108581 108688 108752 111454 105740 112333 106683 104554 111133 108063 108526 total = 29.220103 per ms 01:53:14.990 16 switches: flows: 111681 114341 109601 113789 115534 109920 111121 110416 111937 108483 111541 108230 109494 113121 109510 109099 total = 29.580920 per ms 01:54:15.091 16 switches: flows: 110782 111091 109841 111909 109621 108517 109718 113590 110014 108528 110678 107184 109487 110244 108006 106450 total = 29.212229 per ms 01:55:15.192 16 switches: flows: 113597 109513 110444 114544 110136 109106 110611 114380 112145 108890 112133 108387 109922 111949 108663 106881 total = 29.472448 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 28142.66/29580.92/28842.11/9627.72 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 28142.66/29580.92/28842.11/9627.72 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 28142.66/29580.92/28842.11/9627.72 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 28142.66/29580.92/28842.11/9627.72 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 28142.66 | 29580.92 | 28842.11 | 9627.72 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 28142.66 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 29580.92 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 28842.11 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 9627.72 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 28142.66 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 29580.92 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 28842.11 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 9627.72 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-06-01 01:55:15 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-06-01 01:55:15,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,28142.66,29580.92,28842.11,9627.72 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.132 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.45" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.45:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Mon Jun 1 01:55:15 UTC 2026 System load: 1.0 Processes: 104 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.45 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Mon Jun 1 01:45:08 2026 from 10.30.170.141 [?2004h[jenkins@releng-48317-736-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.132 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.132. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:56:20.973 16 switches: flows: 493837 493344 498252 505245 497141 482671 488369 489953 494459 484036 489762 472585 489849 499995 492856 494587 total = 131.115683 per ms 01:57:21.076 16 switches: flows: 496282 496517 498465 498387 492302 494114 501978 491068 485505 497918 488404 487591 498966 491905 501872 500499 total = 131.806147 per ms 01:58:21.179 16 switches: flows: 532038 518311 530799 525540 529006 521655 523759 523853 528397 517771 521228 534380 519194 521212 526019 529692 total = 139.812821 per ms 01:59:21.279 16 switches: flows: 527603 529599 531539 525652 527603 534559 534955 529267 539075 535423 532135 538613 529970 535608 533924 534153 total = 141.757339 per ms 02:00:21.381 16 switches: flows: 510648 517646 512179 515949 512462 514840 505766 513110 516719 515268 514534 522285 512329 515759 511510 518376 total = 136.925705 per ms controller msgbuf_read() = 0: closed connection ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.132. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:56:20.973 16 switches: flows: 493837 493344 498252 505245 497141 482671 488369 489953 494459 484036 489762 472585 489849 499995 492856 494587 total = 131.115683 per ms 01:57:21.076 16 switches: flows: 496282 496517 498465 498387 492302 494114 501978 491068 485505 497918 488404 487591 498966 491905 501872 500499 total = 131.806147 per ms 01:58:21.179 16 switches: flows: 532038 518311 530799 525540 529006 521655 523759 523853 528397 517771 521228 534380 519194 521212 526019 529692 total = 139.812821 per ms 01:59:21.279 16 switches: flows: 527603 529599 531539 525652 527603 534559 534955 529267 539075 535423 532135 538613 529970 535608 533924 534153 total = 141.757339 per ms 02:00:21.381 16 switches: flows: 510648 517646 512179 515949 512462 514840 505766 513110 516719 515268 514534 522285 512329 515759 511510 518376 total = 136.925705 per ms controller msgbuf_read() = 0: closed connection ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.132. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:56:20.973 16 switches: flows: 493837 493344 498252 505245 497141 482671 488369 489953 494459 484036 489762 472585 489849 499995 492856 494587 total = 131.115683 per ms 01:57:21.076 16 switches: flows: 496282 496517 498465 498387 492302 494114 501978 491068 485505 497918 488404 487591 498966 491905 501872 500499 total = 131.806147 per ms 01:58:21.179 16 switches: flows: 532038 518311 530799 525540 529006 521655 523759 523853 528397 517771 521228 534380 519194 521212 526019 529692 total = 139.812821 per ms 01:59:21.279 16 switches: flows: 527603 529599 531539 525652 527603 534559 534955 529267 539075 535423 532135 538613 529970 535608 533924 534153 total = 141.757339 per ms 02:00:21.381 16 switches: flows: 510648 517646 512179 515949 512462 514840 505766 513110 516719 515268 514534 522285 512329 515759 511510 518376 total = 136.925705 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.132. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:56:20.973 16 switches: flows: 493837 493344 498252 505245 497141 482671 488369 489953 494459 484036 489762 472585 489849 499995 492856 494587 total = 131.115683 per ms 01:57:21.076 16 switches: flows: 496282 496517 498465 498387 492302 494114 501978 491068 485505 497918 488404 487591 498966 491905 501872 500499 total = 131.806147 per ms 01:58:21.179 16 switches: flows: 532038 518311 530799 525540 529006 521655 523759 523853 528397 517771 521228 534380 519194 521212 526019 529692 total = 139.812821 per ms 01:59:21.279 16 switches: flows: 527603 529599 531539 525652 527603 534559 534955 529267 539075 535423 532135 538613 529970 535608 533924 534153 total = 141.757339 per ms 02:00:21.381 16 switches: flows: 510648 517646 512179 515949 512462 514840 505766 513110 516719 515268 514534 522285 512329 515759 511510 518376 total = 136.925705 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.132. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:56:20.973 16 switches: flows: 493837 493344 498252 505245 497141 482671 488369 489953 494459 484036 489762 472585 489849 499995 492856 494587 total = 131.115683 per ms 01:57:21.076 16 switches: flows: 496282 496517 498465 498387 492302 494114 501978 491068 485505 497918 488404 487591 498966 491905 501872 500499 total = 131.806147 per ms 01:58:21.179 16 switches: flows: 532038 518311 530799 525540 529006 521655 523759 523853 528397 517771 521228 534380 519194 521212 526019 529692 total = 139.812821 per ms 01:59:21.279 16 switches: flows: 527603 529599 531539 525652 527603 534559 534955 529267 539075 535423 532135 538613 529970 535608 533924 534153 total = 141.757339 per ms 02:00:21.381 16 switches: flows: 510648 517646 512179 515949 512462 514840 505766 513110 516719 515268 514534 522285 512329 515759 511510 518376 total = 136.925705 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.132. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:56:20.973 16 switches: flows: 493837 493344 498252 505245 497141 482671 488369 489953 494459 484036 489762 472585 489849 499995 492856 494587 total = 131.115683 per ms 01:57:21.076 16 switches: flows: 496282 496517 498465 498387 492302 494114 501978 491068 485505 497918 488404 487591 498966 491905 501872 500499 total = 131.806147 per ms 01:58:21.179 16 switches: flows: 532038 518311 530799 525540 529006 521655 523759 523853 528397 517771 521228 534380 519194 521212 526019 529692 total = 139.812821 per ms 01:59:21.279 16 switches: flows: 527603 529599 531539 525652 527603 534559 534955 529267 539075 535423 532135 538613 529970 535608 533924 534153 total = 141.757339 per ms 02:00:21.381 16 switches: flows: 510648 517646 512179 515949 512462 514840 505766 513110 516719 515268 514534 522285 512329 515759 511510 518376 total = 136.925705 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.132 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.45" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.45:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Mon Jun 1 02:01:05 UTC 2026 System load: 0.21 Processes: 105 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.45 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Mon Jun 1 01:55:15 2026 from 10.30.170.141 [?2004h[jenkins@releng-48317-736-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.132 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.132. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:02:11.121 16 switches: flows: 109814 107295 107819 109822 109631 108960 108259 110187 106878 105694 109044 106039 105391 105385 104820 104393 total = 28.657183 per ms 02:03:11.222 16 switches: flows: 114004 108197 109746 113014 112350 111688 111800 112374 108461 109759 112167 108588 105495 106031 107339 106148 total = 29.237199 per ms 02:04:11.322 16 switches: flows: 113458 108478 107790 110606 110835 111368 112136 113207 107444 110128 111355 107016 109450 108522 106204 106834 total = 29.198388 per ms 02:05:11.423 16 switches: flows: 96164 94813 93953 95698 95091 96779 97339 96826 94476 92850 95955 94701 94471 93078 93076 92961 total = 25.261678 per ms 02:06:11.523 16 switches: flows: 105262 104586 102348 107422 104976 104799 105668 106611 105537 103945 105176 104479 102257 104135 105791 103432 total = 27.893812 per ms 02:07:11.623 16 switches: flows: 110516 109085 110604 114398 112128 110865 111028 111442 112052 110620 112597 109491 108118 111495 111626 111487 total = 29.576412 per ms 02:08:11.723 16 switches: flows: 107589 107658 108760 112379 111137 109533 107735 108649 110224 109798 111175 107168 105504 110354 108231 109190 total = 29.036253 per ms 02:09:11.824 16 switches: flows: 108692 106418 106482 110011 110022 107698 107595 108483 110235 107244 107490 106833 105378 107636 107922 108900 total = 28.735982 per ms 02:10:11.924 16 switches: flows: 108555 108000 107531 110808 109801 106685 108460 110413 110297 108749 109232 106978 106046 106309 109425 110351 total = 28.912414 per ms 02:11:12.024 16 switches: flows: 107311 105868 104373 109854 109908 105972 106234 108258 109883 109120 107689 105415 105492 107404 107322 109265 total = 28.608370 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 25261.68/29576.41/28495.61/9577.57 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.132:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.132. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:02:11.121 16 switches: flows: 109814 107295 107819 109822 109631 108960 108259 110187 106878 105694 109044 106039 105391 105385 104820 104393 total = 28.657183 per ms 02:03:11.222 16 switches: flows: 114004 108197 109746 113014 112350 111688 111800 112374 108461 109759 112167 108588 105495 106031 107339 106148 total = 29.237199 per ms 02:04:11.322 16 switches: flows: 113458 108478 107790 110606 110835 111368 112136 113207 107444 110128 111355 107016 109450 108522 106204 106834 total = 29.198388 per ms 02:05:11.423 16 switches: flows: 96164 94813 93953 95698 95091 96779 97339 96826 94476 92850 95955 94701 94471 93078 93076 92961 total = 25.261678 per ms 02:06:11.523 16 switches: flows: 105262 104586 102348 107422 104976 104799 105668 106611 105537 103945 105176 104479 102257 104135 105791 103432 total = 27.893812 per ms 02:07:11.623 16 switches: flows: 110516 109085 110604 114398 112128 110865 111028 111442 112052 110620 112597 109491 108118 111495 111626 111487 total = 29.576412 per ms 02:08:11.723 16 switches: flows: 107589 107658 108760 112379 111137 109533 107735 108649 110224 109798 111175 107168 105504 110354 108231 109190 total = 29.036253 per ms 02:09:11.824 16 switches: flows: 108692 106418 106482 110011 110022 107698 107595 108483 110235 107244 107490 106833 105378 107636 107922 108900 total = 28.735982 per ms 02:10:11.924 16 switches: flows: 108555 108000 107531 110808 109801 106685 108460 110413 110297 108749 109232 106978 106046 106309 109425 110351 total = 28.912414 per ms 02:11:12.024 16 switches: flows: 107311 105868 104373 109854 109908 105972 106234 108258 109883 109120 107689 105415 105492 107404 107322 109265 total = 28.608370 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 25261.68/29576.41/28495.61/9577.57 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 25261.68/29576.41/28495.61/9577.57 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 25261.68/29576.41/28495.61/9577.57 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 25261.68/29576.41/28495.61/9577.57 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 25261.68 | 29576.41 | 28495.61 | 9577.57 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 25261.68 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 29576.41 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 28495.61 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 9577.57 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 25261.68 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 29576.41 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 28495.61 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 9577.57 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-06-01 02:11:12 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-06-01 02:11:12,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,25261.68,29576.41,28495.61,9577.57 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt