Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.205:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.205 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.237:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed May 27 07:06:13 UTC 2026 System load: 0.13 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.237 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-48317-731-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.205:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.205 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.205:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.205 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.205 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.237" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.237:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed May 27 07:06:13 UTC 2026 System load: 0.13 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.237 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Wed May 27 07:06:13 2026 from 10.30.170.250 [?2004h[jenkins@releng-48317-731-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.205 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.205. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 07:07:19.821 16 switches: flows: 106432 105009 106828 103783 105834 104521 103897 99995 100165 100383 102286 99562 100996 100396 101307 98699 total = 27.334883 per ms 07:08:19.923 16 switches: flows: 118645 118436 118886 115957 117664 115225 116075 112824 113314 112265 112649 112448 113552 111990 114406 111705 total = 30.549681 per ms 07:09:20.024 16 switches: flows: 115756 115873 117265 114458 115774 114544 114118 110497 110575 109267 110824 109736 110473 108819 112795 110947 total = 29.978662 per ms 07:10:20.124 16 switches: flows: 112594 112973 111514 110469 111514 110026 111056 106426 106198 107328 108072 106291 106770 104955 106542 105488 total = 28.921971 per ms 07:11:20.226 16 switches: flows: 120298 121150 121110 121085 121212 119058 121223 115941 115903 116023 117280 112593 116622 113566 114271 114576 total = 31.312842 per ms 07:12:20.327 16 switches: flows: 117805 118478 118194 114903 115935 115335 117099 111498 112021 112626 112836 109622 113615 112225 111306 113038 total = 30.391492 per ms 07:13:20.428 16 switches: flows: 119671 118709 118814 117140 117137 116733 118612 112902 114181 115180 114273 112852 114556 112978 112318 113309 total = 30.771334 per ms 07:14:20.529 16 switches: flows: 119691 118483 118385 116143 117248 115995 118792 112676 112932 115041 113755 111078 113565 112079 113759 113313 total = 30.664350 per ms 07:15:20.632 16 switches: flows: 119217 118340 118818 116301 117486 117821 119188 114837 113684 114551 114272 113437 115677 113804 111507 112942 total = 30.812422 per ms 07:16:20.733 16 switches: flows: 115740 116236 115581 112331 115315 113152 115011 110736 108445 111011 111041 109385 111381 107669 108730 110085 total = 29.814338 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 28921.97/31312.84/30357.45/10140.66 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.205. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 07:07:19.821 16 switches: flows: 106432 105009 106828 103783 105834 104521 103897 99995 100165 100383 102286 99562 100996 100396 101307 98699 total = 27.334883 per ms 07:08:19.923 16 switches: flows: 118645 118436 118886 115957 117664 115225 116075 112824 113314 112265 112649 112448 113552 111990 114406 111705 total = 30.549681 per ms 07:09:20.024 16 switches: flows: 115756 115873 117265 114458 115774 114544 114118 110497 110575 109267 110824 109736 110473 108819 112795 110947 total = 29.978662 per ms 07:10:20.124 16 switches: flows: 112594 112973 111514 110469 111514 110026 111056 106426 106198 107328 108072 106291 106770 104955 106542 105488 total = 28.921971 per ms 07:11:20.226 16 switches: flows: 120298 121150 121110 121085 121212 119058 121223 115941 115903 116023 117280 112593 116622 113566 114271 114576 total = 31.312842 per ms 07:12:20.327 16 switches: flows: 117805 118478 118194 114903 115935 115335 117099 111498 112021 112626 112836 109622 113615 112225 111306 113038 total = 30.391492 per ms 07:13:20.428 16 switches: flows: 119671 118709 118814 117140 117137 116733 118612 112902 114181 115180 114273 112852 114556 112978 112318 113309 total = 30.771334 per ms 07:14:20.529 16 switches: flows: 119691 118483 118385 116143 117248 115995 118792 112676 112932 115041 113755 111078 113565 112079 113759 113313 total = 30.664350 per ms 07:15:20.632 16 switches: flows: 119217 118340 118818 116301 117486 117821 119188 114837 113684 114551 114272 113437 115677 113804 111507 112942 total = 30.812422 per ms 07:16:20.733 16 switches: flows: 115740 116236 115581 112331 115315 113152 115011 110736 108445 111011 111041 109385 111381 107669 108730 110085 total = 29.814338 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 28921.97/31312.84/30357.45/10140.66 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 28921.97/31312.84/30357.45/10140.66 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 28921.97/31312.84/30357.45/10140.66 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 28921.97/31312.84/30357.45/10140.66 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 28921.97 | 31312.84 | 30357.45 | 10140.66 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 28921.97 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 31312.84 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 30357.45 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10140.66 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 28921.97 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 31312.84 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 30357.45 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10140.66 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-27 07:16:20 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-27 07:16:20,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,28921.97,31312.84,30357.45,10140.66 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.205 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.237" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.237:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed May 27 07:16:21 UTC 2026 System load: 1.06 Processes: 105 Usage of /: 19.9% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.237 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Wed May 27 07:06:14 2026 from 10.30.170.250 [?2004h[jenkins@releng-48317-731-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.205 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.205. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 07:17:26.601 16 switches: flows: 544371 545699 537679 549114 538210 555336 555737 536700 532265 537567 515093 560531 534326 519478 537392 531279 total = 143.846283 per ms 07:18:26.703 16 switches: flows: 462408 448254 452850 449948 446723 445813 501799 463537 474697 505618 416047 436770 451766 494657 433260 483093 total = 122.581494 per ms 07:19:32.993 16 switches: flows: 530814 518626 519340 530320 529383 529144 523533 519087 521609 527738 532739 527469 531313 518455 522885 530702 total = 126.914617 per ms 07:20:33.094 16 switches: flows: 417374 542136 528104 585301 592688 410291 517294 541850 546452 378849 405482 598795 582344 558939 604064 531597 total = 138.792332 per ms 07:21:36.822 16 switches: flows: 628552 624157 627744 628412 624098 627402 626966 624864 618820 632152 620230 636612 630174 626718 636029 625349 total = 157.520038 per ms 07:22:36.924 16 switches: flows: 577260 596706 574806 605004 531046 596402 600885 574609 578157 577269 598675 577016 584093 580854 276103 598396 total = 150.200152 per ms 07:23:37.026 16 switches: flows: 488545 503280 477875 519292 517119 448720 515968 502388 448671 515086 521647 457222 512296 456754 498449 503150 total = 131.219854 per ms 07:24:37.128 16 switches: flows: 292551 487476 446943 558644 332123 464652 377489 448833 262737 259618 344778 267405 340436 408030 258595 399497 total = 98.996013 per ms 07:25:37.710 16 switches: flows: 523987 516312 273008 564287 179680 339733 334892 319229 377238 324960 524657 315850 319330 323926 474210 307635 total = 99.353100 per ms controller msgbuf_read() = 0: closed connection ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.205. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 07:17:26.601 16 switches: flows: 544371 545699 537679 549114 538210 555336 555737 536700 532265 537567 515093 560531 534326 519478 537392 531279 total = 143.846283 per ms 07:18:26.703 16 switches: flows: 462408 448254 452850 449948 446723 445813 501799 463537 474697 505618 416047 436770 451766 494657 433260 483093 total = 122.581494 per ms 07:19:32.993 16 switches: flows: 530814 518626 519340 530320 529383 529144 523533 519087 521609 527738 532739 527469 531313 518455 522885 530702 total = 126.914617 per ms 07:20:33.094 16 switches: flows: 417374 542136 528104 585301 592688 410291 517294 541850 546452 378849 405482 598795 582344 558939 604064 531597 total = 138.792332 per ms 07:21:36.822 16 switches: flows: 628552 624157 627744 628412 624098 627402 626966 624864 618820 632152 620230 636612 630174 626718 636029 625349 total = 157.520038 per ms 07:22:36.924 16 switches: flows: 577260 596706 574806 605004 531046 596402 600885 574609 578157 577269 598675 577016 584093 580854 276103 598396 total = 150.200152 per ms 07:23:37.026 16 switches: flows: 488545 503280 477875 519292 517119 448720 515968 502388 448671 515086 521647 457222 512296 456754 498449 503150 total = 131.219854 per ms 07:24:37.128 16 switches: flows: 292551 487476 446943 558644 332123 464652 377489 448833 262737 259618 344778 267405 340436 408030 258595 399497 total = 98.996013 per ms 07:25:37.710 16 switches: flows: 523987 516312 273008 564287 179680 339733 334892 319229 377238 324960 524657 315850 319330 323926 474210 307635 total = 99.353100 per ms controller msgbuf_read() = 0: closed connection ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.205. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 07:17:26.601 16 switches: flows: 544371 545699 537679 549114 538210 555336 555737 536700 532265 537567 515093 560531 534326 519478 537392 531279 total = 143.846283 per ms 07:18:26.703 16 switches: flows: 462408 448254 452850 449948 446723 445813 501799 463537 474697 505618 416047 436770 451766 494657 433260 483093 total = 122.581494 per ms 07:19:32.993 16 switches: flows: 530814 518626 519340 530320 529383 529144 523533 519087 521609 527738 532739 527469 531313 518455 522885 530702 total = 126.914617 per ms 07:20:33.094 16 switches: flows: 417374 542136 528104 585301 592688 410291 517294 541850 546452 378849 405482 598795 582344 558939 604064 531597 total = 138.792332 per ms 07:21:36.822 16 switches: flows: 628552 624157 627744 628412 624098 627402 626966 624864 618820 632152 620230 636612 630174 626718 636029 625349 total = 157.520038 per ms 07:22:36.924 16 switches: flows: 577260 596706 574806 605004 531046 596402 600885 574609 578157 577269 598675 577016 584093 580854 276103 598396 total = 150.200152 per ms 07:23:37.026 16 switches: flows: 488545 503280 477875 519292 517119 448720 515968 502388 448671 515086 521647 457222 512296 456754 498449 503150 total = 131.219854 per ms 07:24:37.128 16 switches: flows: 292551 487476 446943 558644 332123 464652 377489 448833 262737 259618 344778 267405 340436 408030 258595 399497 total = 98.996013 per ms 07:25:37.710 16 switches: flows: 523987 516312 273008 564287 179680 339733 334892 319229 377238 324960 524657 315850 319330 323926 474210 307635 total = 99.353100 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.205. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 07:17:26.601 16 switches: flows: 544371 545699 537679 549114 538210 555336 555737 536700 532265 537567 515093 560531 534326 519478 537392 531279 total = 143.846283 per ms 07:18:26.703 16 switches: flows: 462408 448254 452850 449948 446723 445813 501799 463537 474697 505618 416047 436770 451766 494657 433260 483093 total = 122.581494 per ms [ Message content over the limit has been removed. ] 07:20:33.094 16 switches: flows: 417374 542136 528104 585301 592688 410291 517294 541850 546452 378849 405482 598795 582344 558939 604064 531597 total = 138.792332 per ms 07:21:36.822 16 switches: flows: 628552 624157 627744 628412 624098 627402 626966 624864 618820 632152 620230 636612 630174 626718 636029 625349 total = 157.520038 per ms 07:22:36.924 16 switches: flows: 577260 596706 574806 605004 531046 596402 600885 574609 578157 577269 598675 577016 584093 580854 276103 598396 total = 150.200152 per ms 07:23:37.026 16 switches: flows: 488545 503280 477875 519292 517119 448720 515968 502388 448671 515086 521647 457222 512296 456754 498449 503150 total = 131.219854 per ms 07:24:37.128 16 switches: flows: 292551 487476 446943 558644 332123 464652 377489 448833 262737 259618 344778 267405 340436 408030 258595 399497 total = 98.996013 per ms 07:25:37.710 16 switches: flows: 523987 516312 273008 564287 179680 339733 334892 319229 377238 324960 524657 315850 319330 323926 474210 307635 total = 99.353100 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.205. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 07:17:26.601 16 switches: flows: 544371 545699 537679 549114 538210 555336 555737 536700 532265 537567 515093 560531 534326 519478 537392 531279 total = 143.846283 per ms 07:18:26.703 16 switches: flows: 462408 448254 452850 449948 446723 445813 501799 463537 474697 505618 416047 436770 451766 494657 433260 483093 total = 122.581494 per ms [ Message content over the limit has been removed. ] 07:20:33.094 16 switches: flows: 417374 542136 528104 585301 592688 410291 517294 541850 546452 378849 405482 598795 582344 558939 604064 531597 total = 138.792332 per ms 07:21:36.822 16 switches: flows: 628552 624157 627744 628412 624098 627402 626966 624864 618820 632152 620230 636612 630174 626718 636029 625349 total = 157.520038 per ms 07:22:36.924 16 switches: flows: 577260 596706 574806 605004 531046 596402 600885 574609 578157 577269 598675 577016 584093 580854 276103 598396 total = 150.200152 per ms 07:23:37.026 16 switches: flows: 488545 503280 477875 519292 517119 448720 515968 502388 448671 515086 521647 457222 512296 456754 498449 503150 total = 131.219854 per ms 07:24:37.128 16 switches: flows: 292551 487476 446943 558644 332123 464652 377489 448833 262737 259618 344778 267405 340436 408030 258595 399497 total = 98.996013 per ms 07:25:37.710 16 switches: flows: 523987 516312 273008 564287 179680 339733 334892 319229 377238 324960 524657 315850 319330 323926 474210 307635 total = 99.353100 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.205. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 07:17:26.601 16 switches: flows: 544371 545699 537679 549114 538210 555336 555737 536700 532265 537567 515093 560531 534326 519478 537392 531279 total = 143.846283 per ms 07:18:26.703 16 switches: flows: 462408 448254 452850 449948 446723 445813 501799 463537 474697 505618 416047 436770 451766 494657 433260 483093 total = 122.581494 per ms [ Message content over the limit has been removed. ] 07:20:33.094 16 switches: flows: 417374 542136 528104 585301 592688 410291 517294 541850 546452 378849 405482 598795 582344 558939 604064 531597 total = 138.792332 per ms 07:21:36.822 16 switches: flows: 628552 624157 627744 628412 624098 627402 626966 624864 618820 632152 620230 636612 630174 626718 636029 625349 total = 157.520038 per ms 07:22:36.924 16 switches: flows: 577260 596706 574806 605004 531046 596402 600885 574609 578157 577269 598675 577016 584093 580854 276103 598396 total = 150.200152 per ms 07:23:37.026 16 switches: flows: 488545 503280 477875 519292 517119 448720 515968 502388 448671 515086 521647 457222 512296 456754 498449 503150 total = 131.219854 per ms 07:24:37.128 16 switches: flows: 292551 487476 446943 558644 332123 464652 377489 448833 262737 259618 344778 267405 340436 408030 258595 399497 total = 98.996013 per ms 07:25:37.710 16 switches: flows: 523987 516312 273008 564287 179680 339733 334892 319229 377238 324960 524657 315850 319330 323926 474210 307635 total = 99.353100 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.205 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.237" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.237:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed May 27 07:25:41 UTC 2026 System load: 0.45 Processes: 105 Usage of /: 19.9% of 38.58GB Users logged in: 0 Memory usage: 5% IPv4 address for ens3: 10.30.171.237 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Wed May 27 07:16:21 2026 from 10.30.170.250 [?2004h[jenkins@releng-48317-731-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.205 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.205. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 07:26:47.230 16 switches: flows: 0 0 0 0 0 0 124827 0 123756 0 0 0 0 0 122541 0 total = 6.185400 per ms 07:27:47.331 16 switches: flows: 103324 105964 105524 104847 103559 103437 105791 104879 102728 104032 103551 103136 103631 101281 102770 99798 total = 27.591428 per ms 07:28:47.431 16 switches: flows: 119654 120019 120536 118682 118462 119801 119083 119008 118386 117393 117879 117868 118160 116078 115439 114773 total = 31.467739 per ms 07:29:47.532 16 switches: flows: 120997 122124 121002 119332 119219 120050 121114 120668 119615 119879 118936 118721 120645 117786 117773 115602 total = 31.837833 per ms 07:30:47.632 16 switches: flows: 120292 121522 121290 118678 118382 120431 120621 119870 118520 118164 117002 116566 119095 116224 115473 114958 total = 31.565392 per ms 07:31:47.732 16 switches: flows: 97616 98184 97884 97467 97181 96193 97649 97253 95968 95019 96773 97034 96432 94069 94272 92090 total = 25.641869 per ms 07:32:47.833 16 switches: flows: 105357 108335 104541 105925 104297 104893 106290 108359 105319 105285 104806 105100 104576 103074 105777 101165 total = 28.004851 per ms 07:33:47.933 16 switches: flows: 116375 117036 116215 116178 115053 115506 115625 116181 113952 115782 115019 114540 113947 113436 112271 110150 total = 30.570065 per ms 07:34:48.033 16 switches: flows: 109161 111854 109129 109525 110797 110415 110038 110759 107598 108872 108310 108861 108981 106437 105684 106846 total = 29.005990 per ms 07:35:48.134 16 switches: flows: 112206 112980 112972 109529 111427 110462 113640 112024 111506 109806 109627 110023 109641 109944 110317 107196 total = 29.505692 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 25641.87/31837.83/29465.65/10022.03 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.205:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.205. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 07:26:47.230 16 switches: flows: 0 0 0 0 0 0 124827 0 123756 0 0 0 0 0 122541 0 total = 6.185400 per ms 07:27:47.331 16 switches: flows: 103324 105964 105524 104847 103559 103437 105791 104879 102728 104032 103551 103136 103631 101281 102770 99798 total = 27.591428 per ms 07:28:47.431 16 switches: flows: 119654 120019 120536 118682 118462 119801 119083 119008 118386 117393 117879 117868 118160 116078 115439 114773 total = 31.467739 per ms 07:29:47.532 16 switches: flows: 120997 122124 121002 119332 119219 120050 121114 120668 119615 119879 118936 118721 120645 117786 117773 115602 total = 31.837833 per ms 07:30:47.632 16 switches: flows: 120292 121522 121290 118678 118382 120431 120621 119870 118520 118164 117002 116566 119095 116224 115473 114958 total = 31.565392 per ms 07:31:47.732 16 switches: flows: 97616 98184 97884 97467 97181 96193 97649 97253 95968 95019 96773 97034 96432 94069 94272 92090 total = 25.641869 per ms 07:32:47.833 16 switches: flows: 105357 108335 104541 105925 104297 104893 106290 108359 105319 105285 104806 105100 104576 103074 105777 101165 total = 28.004851 per ms 07:33:47.933 16 switches: flows: 116375 117036 116215 116178 115053 115506 115625 116181 113952 115782 115019 114540 113947 113436 112271 110150 total = 30.570065 per ms 07:34:48.033 16 switches: flows: 109161 111854 109129 109525 110797 110415 110038 110759 107598 108872 108310 108861 108981 106437 105684 106846 total = 29.005990 per ms 07:35:48.134 16 switches: flows: 112206 112980 112972 109529 111427 110462 113640 112024 111506 109806 109627 110023 109641 109944 110317 107196 total = 29.505692 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 25641.87/31837.83/29465.65/10022.03 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 25641.87/31837.83/29465.65/10022.03 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 25641.87/31837.83/29465.65/10022.03 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 25641.87/31837.83/29465.65/10022.03 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 25641.87 | 31837.83 | 29465.65 | 10022.03 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 25641.87 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 31837.83 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 29465.65 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10022.03 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 25641.87 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 31837.83 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 29465.65 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10022.03 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-05-27 07:35:48 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-05-27 07:35:48,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,25641.87,31837.83,29465.65,10022.03 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt