Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.67:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.67 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-chromium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-chromium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-chromium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-chromium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.163:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Thu Aug 13 02:02:13 UTC 2026 System load: 0.09 Processes: 110 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.163 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-00446-55-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.67:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 1.0.0 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 1.0.0 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 1.0.0 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 1.0.0 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.67 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.67:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.67 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.67 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.163" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.163:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Thu Aug 13 02:02:13 UTC 2026 System load: 0.09 Processes: 110 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.163 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Thu Aug 13 02:02:53 2026 from 10.30.170.137 [?2004h[jenkins@releng-00446-55-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.67 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:03:59.387 16 switches: flows: 107101 107002 111689 107630 108132 108485 107816 109994 106251 107087 109996 106902 106619 108540 107318 106969 total = 28.792183 per ms 02:04:59.490 16 switches: flows: 117313 118034 117859 115725 116581 116392 117606 118004 116927 113542 114956 118618 117152 116279 117169 113976 total = 31.049909 per ms 02:05:59.592 16 switches: flows: 126385 125535 126067 123109 123884 125745 126328 126234 122194 119720 124586 125578 124966 124510 125312 122454 total = 33.154666 per ms 02:06:59.693 16 switches: flows: 128617 127416 127590 125502 126209 126499 127676 127663 123216 122767 125483 127090 126427 126362 126381 124007 total = 33.592318 per ms 02:07:59.793 16 switches: flows: 117711 115896 115953 114064 114971 114318 116338 116251 112544 111210 114523 115832 115948 115983 116044 112251 total = 30.612835 per ms 02:08:59.893 16 switches: flows: 118137 115727 117149 114480 114382 113117 113001 117649 112674 110804 111440 115096 115286 113927 114977 113007 total = 30.463343 per ms 02:09:59.994 16 switches: flows: 130216 128529 129714 127553 126626 125278 126094 128886 122716 123875 124651 125921 126176 125225 127234 124585 total = 33.665095 per ms 02:11:00.094 16 switches: flows: 123582 123013 124342 120679 121069 120152 119594 122843 117328 119218 118265 122028 121376 119282 120884 118806 total = 32.153850 per ms 02:12:00.195 16 switches: flows: 120650 120981 121528 117700 118074 118307 119416 121744 119418 116249 116298 120332 119184 117462 121283 117960 total = 31.723407 per ms 02:13:00.295 16 switches: flows: 125878 123975 125758 122602 123444 123230 123165 125056 122890 119922 121123 124189 123240 121695 125398 123478 total = 32.862516 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 30463.34/33665.10/32141.99/10778.58 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:03:59.387 16 switches: flows: 107101 107002 111689 107630 108132 108485 107816 109994 106251 107087 109996 106902 106619 108540 107318 106969 total = 28.792183 per ms 02:04:59.490 16 switches: flows: 117313 118034 117859 115725 116581 116392 117606 118004 116927 113542 114956 118618 117152 116279 117169 113976 total = 31.049909 per ms 02:05:59.592 16 switches: flows: 126385 125535 126067 123109 123884 125745 126328 126234 122194 119720 124586 125578 124966 124510 125312 122454 total = 33.154666 per ms 02:06:59.693 16 switches: flows: 128617 127416 127590 125502 126209 126499 127676 127663 123216 122767 125483 127090 126427 126362 126381 124007 total = 33.592318 per ms 02:07:59.793 16 switches: flows: 117711 115896 115953 114064 114971 114318 116338 116251 112544 111210 114523 115832 115948 115983 116044 112251 total = 30.612835 per ms 02:08:59.893 16 switches: flows: 118137 115727 117149 114480 114382 113117 113001 117649 112674 110804 111440 115096 115286 113927 114977 113007 total = 30.463343 per ms 02:09:59.994 16 switches: flows: 130216 128529 129714 127553 126626 125278 126094 128886 122716 123875 124651 125921 126176 125225 127234 124585 total = 33.665095 per ms 02:11:00.094 16 switches: flows: 123582 123013 124342 120679 121069 120152 119594 122843 117328 119218 118265 122028 121376 119282 120884 118806 total = 32.153850 per ms 02:12:00.195 16 switches: flows: 120650 120981 121528 117700 118074 118307 119416 121744 119418 116249 116298 120332 119184 117462 121283 117960 total = 31.723407 per ms 02:13:00.295 16 switches: flows: 125878 123975 125758 122602 123444 123230 123165 125056 122890 119922 121123 124189 123240 121695 125398 123478 total = 32.862516 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 30463.34/33665.10/32141.99/10778.58 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 30463.34/33665.10/32141.99/10778.58 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 30463.34/33665.10/32141.99/10778.58 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 30463.34/33665.10/32141.99/10778.58 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 30463.34 | 33665.10 | 32141.99 | 10778.58 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 30463.34 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 33665.10 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 32141.99 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10778.58 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 30463.34 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 33665.10 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 32141.99 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10778.58 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-13 02:13:00 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-13 02:13:00,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,30463.34,33665.10,32141.99,10778.58 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-chromium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-chromium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.67 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.163" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.163:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Thu Aug 13 02:13:00 UTC 2026 System load: 1.0 Processes: 105 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.163 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Thu Aug 13 02:02:54 2026 from 10.30.170.137 [?2004h[jenkins@releng-00446-55-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.67 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:06.098 16 switches: flows: 526063 532189 520824 536769 523944 532351 526656 524769 495691 504233 515326 512106 516968 519004 520960 506899 total = 138.579200 per ms 02:15:06.201 16 switches: flows: 514774 517844 526240 522134 526611 512520 502775 512270 524434 528730 522056 520585 523183 530301 489156 519930 total = 137.991563 per ms 02:16:06.303 16 switches: flows: 529859 532340 551392 517916 529627 541823 541678 533228 533252 525823 522784 535377 519159 520625 524195 531549 total = 141.271964 per ms 02:17:06.405 16 switches: flows: 439135 435807 440637 430646 449295 446208 446263 436255 444565 452970 449657 449520 441624 444497 446032 447836 total = 118.149761 per ms 02:18:06.507 16 switches: flows: 511563 499147 512244 504967 503328 509289 504747 508426 511226 503384 509432 511482 499778 502680 503986 503196 total = 134.753335 per ms 02:19:06.609 16 switches: flows: 605629 607314 609687 596708 601929 606828 601907 604014 598622 609998 602939 599386 606921 606234 600781 594582 total = 160.619650 per ms controller msgbuf_read() = 0: closed connection ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:06.098 16 switches: flows: 526063 532189 520824 536769 523944 532351 526656 524769 495691 504233 515326 512106 516968 519004 520960 506899 total = 138.579200 per ms 02:15:06.201 16 switches: flows: 514774 517844 526240 522134 526611 512520 502775 512270 524434 528730 522056 520585 523183 530301 489156 519930 total = 137.991563 per ms 02:16:06.303 16 switches: flows: 529859 532340 551392 517916 529627 541823 541678 533228 533252 525823 522784 535377 519159 520625 524195 531549 total = 141.271964 per ms 02:17:06.405 16 switches: flows: 439135 435807 440637 430646 449295 446208 446263 436255 444565 452970 449657 449520 441624 444497 446032 447836 total = 118.149761 per ms 02:18:06.507 16 switches: flows: 511563 499147 512244 504967 503328 509289 504747 508426 511226 503384 509432 511482 499778 502680 503986 503196 total = 134.753335 per ms 02:19:06.609 16 switches: flows: 605629 607314 609687 596708 601929 606828 601907 604014 598622 609998 602939 599386 606921 606234 600781 594582 total = 160.619650 per ms controller msgbuf_read() = 0: closed connection ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:06.098 16 switches: flows: 526063 532189 520824 536769 523944 532351 526656 524769 495691 504233 515326 512106 516968 519004 520960 506899 total = 138.579200 per ms 02:15:06.201 16 switches: flows: 514774 517844 526240 522134 526611 512520 502775 512270 524434 528730 522056 520585 523183 530301 489156 519930 total = 137.991563 per ms 02:16:06.303 16 switches: flows: 529859 532340 551392 517916 529627 541823 541678 533228 533252 525823 522784 535377 519159 520625 524195 531549 total = 141.271964 per ms 02:17:06.405 16 switches: flows: 439135 435807 440637 430646 449295 446208 446263 436255 444565 452970 449657 449520 441624 444497 446032 447836 total = 118.149761 per ms 02:18:06.507 16 switches: flows: 511563 499147 512244 504967 503328 509289 504747 508426 511226 503384 509432 511482 499778 502680 503986 503196 total = 134.753335 per ms 02:19:06.609 16 switches: flows: 605629 607314 609687 596708 601929 606828 601907 604014 598622 609998 602939 599386 606921 606234 600781 594582 total = 160.619650 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:06.098 16 switches: flows: 526063 532189 520824 536769 523944 532351 526656 524769 495691 504233 515326 512106 516968 519004 520960 506899 total = 138.579200 per ms 02:15:06.201 16 switches: flows: 514774 517844 526240 522134 526611 512520 502775 512270 524434 528730 522056 520585 523183 530301 489156 519930 total = 137.991563 per ms 02:16:06.303 16 switches: flows: 529859 532340 551392 517916 529627 541823 541678 533228 533252 525823 522784 535377 519159 520625 524195 531549 total = 141.271964 per ms 02:17:06.405 16 switches: flows: 439135 435807 440637 430646 449295 446208 446263 436255 444565 452970 449657 449520 441624 444497 446032 447836 total = 118.149761 per ms 02:18:06.507 16 switches: flows: 511563 499147 512244 504967 503328 509289 504747 508426 511226 503384 509432 511482 499778 502680 503986 503196 total = 134.753335 per ms 02:19:06.609 16 switches: flows: 605629 607314 609687 596708 601929 606828 601907 604014 598622 609998 602939 599386 606921 606234 600781 594582 total = 160.619650 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:06.098 16 switches: flows: 526063 532189 520824 536769 523944 532351 526656 524769 495691 504233 515326 512106 516968 519004 520960 506899 total = 138.579200 per ms 02:15:06.201 16 switches: flows: 514774 517844 526240 522134 526611 512520 502775 512270 524434 528730 522056 520585 523183 530301 489156 519930 total = 137.991563 per ms 02:16:06.303 16 switches: flows: 529859 532340 551392 517916 529627 541823 541678 533228 533252 525823 522784 535377 519159 520625 524195 531549 total = 141.271964 per ms 02:17:06.405 16 switches: flows: 439135 435807 440637 430646 449295 446208 446263 436255 444565 452970 449657 449520 441624 444497 446032 447836 total = 118.149761 per ms 02:18:06.507 16 switches: flows: 511563 499147 512244 504967 503328 509289 504747 508426 511226 503384 509432 511482 499778 502680 503986 503196 total = 134.753335 per ms 02:19:06.609 16 switches: flows: 605629 607314 609687 596708 601929 606828 601907 604014 598622 609998 602939 599386 606921 606234 600781 594582 total = 160.619650 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:06.098 16 switches: flows: 526063 532189 520824 536769 523944 532351 526656 524769 495691 504233 515326 512106 516968 519004 520960 506899 total = 138.579200 per ms 02:15:06.201 16 switches: flows: 514774 517844 526240 522134 526611 512520 502775 512270 524434 528730 522056 520585 523183 530301 489156 519930 total = 137.991563 per ms 02:16:06.303 16 switches: flows: 529859 532340 551392 517916 529627 541823 541678 533228 533252 525823 522784 535377 519159 520625 524195 531549 total = 141.271964 per ms 02:17:06.405 16 switches: flows: 439135 435807 440637 430646 449295 446208 446263 436255 444565 452970 449657 449520 441624 444497 446032 447836 total = 118.149761 per ms 02:18:06.507 16 switches: flows: 511563 499147 512244 504967 503328 509289 504747 508426 511226 503384 509432 511482 499778 502680 503986 503196 total = 134.753335 per ms 02:19:06.609 16 switches: flows: 605629 607314 609687 596708 601929 606828 601907 604014 598622 609998 602939 599386 606921 606234 600781 594582 total = 160.619650 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.67 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.163" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.163:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Thu Aug 13 02:19:57 UTC 2026 System load: 0.33 Processes: 105 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.163 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Thu Aug 13 02:13:00 2026 from 10.30.170.137 [?2004h[jenkins@releng-00446-55-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.67 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:21:03.124 16 switches: flows: 102690 102205 103234 102736 102597 101373 103865 103783 100564 112738 101615 103947 102022 99403 106680 102552 total = 27.533400 per ms 02:22:03.226 16 switches: flows: 125291 124360 122404 125891 123440 124099 124200 124956 120859 126186 125478 120927 125030 121329 122535 122766 total = 32.940695 per ms 02:23:03.327 16 switches: flows: 121579 118854 117760 122687 119033 119212 120560 121384 117942 121781 119918 117233 120513 118177 117918 118305 total = 31.827797 per ms 02:24:03.428 16 switches: flows: 110227 108471 106965 111264 108400 107318 108625 109215 106514 109262 109209 106644 110703 107737 108280 107145 total = 28.884766 per ms 02:25:03.529 16 switches: flows: 110671 108463 109440 111277 110467 109324 110614 110189 107974 110769 111118 107103 111249 108615 108240 107541 total = 29.168865 per ms 02:26:03.630 16 switches: flows: 113104 113445 112658 111804 113911 110338 113751 111819 109635 110528 110381 113281 114878 110168 107725 112762 total = 29.786704 per ms 02:27:03.731 16 switches: flows: 113311 113076 113199 111893 113233 111698 115671 113682 108694 109934 111768 113416 114281 111293 109561 113591 total = 29.921667 per ms 02:28:03.833 16 switches: flows: 114452 113505 113380 112713 115039 112215 115999 114199 110459 111331 111372 115081 115038 111872 110587 113579 total = 30.130051 per ms 02:29:03.934 16 switches: flows: 91015 89815 89637 88844 94357 87492 92403 85998 86357 88123 87895 88231 86932 85295 89120 88952 total = 23.634981 per ms 02:30:04.035 16 switches: flows: 117191 119818 118425 119810 119593 121157 119856 118132 117447 117440 118096 115842 115263 113536 115663 117359 total = 31.358076 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 23634.98/32940.70/29739.29/10220.69 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:21:03.124 16 switches: flows: 102690 102205 103234 102736 102597 101373 103865 103783 100564 112738 101615 103947 102022 99403 106680 102552 total = 27.533400 per ms 02:22:03.226 16 switches: flows: 125291 124360 122404 125891 123440 124099 124200 124956 120859 126186 125478 120927 125030 121329 122535 122766 total = 32.940695 per ms 02:23:03.327 16 switches: flows: 121579 118854 117760 122687 119033 119212 120560 121384 117942 121781 119918 117233 120513 118177 117918 118305 total = 31.827797 per ms 02:24:03.428 16 switches: flows: 110227 108471 106965 111264 108400 107318 108625 109215 106514 109262 109209 106644 110703 107737 108280 107145 total = 28.884766 per ms 02:25:03.529 16 switches: flows: 110671 108463 109440 111277 110467 109324 110614 110189 107974 110769 111118 107103 111249 108615 108240 107541 total = 29.168865 per ms 02:26:03.630 16 switches: flows: 113104 113445 112658 111804 113911 110338 113751 111819 109635 110528 110381 113281 114878 110168 107725 112762 total = 29.786704 per ms 02:27:03.731 16 switches: flows: 113311 113076 113199 111893 113233 111698 115671 113682 108694 109934 111768 113416 114281 111293 109561 113591 total = 29.921667 per ms 02:28:03.833 16 switches: flows: 114452 113505 113380 112713 115039 112215 115999 114199 110459 111331 111372 115081 115038 111872 110587 113579 total = 30.130051 per ms 02:29:03.934 16 switches: flows: 91015 89815 89637 88844 94357 87492 92403 85998 86357 88123 87895 88231 86932 85295 89120 88952 total = 23.634981 per ms 02:30:04.035 16 switches: flows: 117191 119818 118425 119810 119593 121157 119856 118132 117447 117440 118096 115842 115263 113536 115663 117359 total = 31.358076 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 23634.98/32940.70/29739.29/10220.69 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 23634.98/32940.70/29739.29/10220.69 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 23634.98/32940.70/29739.29/10220.69 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 23634.98/32940.70/29739.29/10220.69 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 23634.98 | 32940.70 | 29739.29 | 10220.69 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 23634.98 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 32940.70 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 29739.29 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10220.69 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 23634.98 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 32940.70 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 29739.29 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10220.69 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-13 02:30:04 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-13 02:30:04,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,23634.98,32940.70,29739.29,10220.69 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-chromium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-chromium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt