Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.67:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.67 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.182:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Sat Apr 25 01:56:21 UTC 2026 System load: 0.09 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.182 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-48317-700-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.67:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.67 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.67:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.67 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.67 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.182" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.182:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Sat Apr 25 01:56:21 UTC 2026 System load: 0.09 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.182 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Sat Apr 25 01:56:22 2026 from 10.30.170.16 [?2004h[jenkins@releng-48317-700-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.67 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:57:28.259 16 switches: flows: 97389 94128 94016 93098 92723 94588 94038 93095 93618 90389 89572 90126 89227 91472 89783 90827 total = 24.634817 per ms 01:58:28.360 16 switches: flows: 111958 110012 107789 109017 109552 109404 108561 106557 105990 106123 105701 105196 107043 105231 103685 107551 total = 28.608372 per ms 01:59:28.461 16 switches: flows: 112141 110772 109039 109418 108436 110104 109145 106896 105914 105089 106895 107085 107784 105554 103655 106381 total = 28.690597 per ms 02:00:28.562 16 switches: flows: 113740 113498 111222 109886 110673 110878 112189 108268 106781 106846 108344 108290 108293 105751 106219 108206 total = 29.102823 per ms 02:01:28.663 16 switches: flows: 114381 112584 109603 110941 111382 111676 111335 109768 108196 107171 108526 108713 107423 106408 106062 108136 total = 29.156381 per ms 02:02:28.764 16 switches: flows: 112595 113913 113190 111901 111176 111610 111157 108610 110739 107763 107587 108178 107667 107288 107637 108184 total = 29.270989 per ms 02:03:28.865 16 switches: flows: 116923 117407 117741 115472 116888 116750 116221 113470 116438 111487 111648 112209 111035 110866 110502 112659 total = 30.411140 per ms 02:04:28.966 16 switches: flows: 114422 113801 114525 113340 113546 114336 113222 111838 113406 108133 109412 110584 108978 108932 108073 110442 total = 29.733523 per ms 02:05:29.067 16 switches: flows: 106248 106301 105992 105221 106050 106860 105128 103204 105290 100975 101234 102321 101687 101489 100837 102301 total = 27.639489 per ms 02:06:29.169 16 switches: flows: 111681 114314 112673 111522 112417 110224 109065 111275 110848 107073 108200 109116 106628 108420 108443 107957 total = 29.282022 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 27639.49/30411.14/29099.48/9726.87 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:57:28.259 16 switches: flows: 97389 94128 94016 93098 92723 94588 94038 93095 93618 90389 89572 90126 89227 91472 89783 90827 total = 24.634817 per ms 01:58:28.360 16 switches: flows: 111958 110012 107789 109017 109552 109404 108561 106557 105990 106123 105701 105196 107043 105231 103685 107551 total = 28.608372 per ms 01:59:28.461 16 switches: flows: 112141 110772 109039 109418 108436 110104 109145 106896 105914 105089 106895 107085 107784 105554 103655 106381 total = 28.690597 per ms 02:00:28.562 16 switches: flows: 113740 113498 111222 109886 110673 110878 112189 108268 106781 106846 108344 108290 108293 105751 106219 108206 total = 29.102823 per ms 02:01:28.663 16 switches: flows: 114381 112584 109603 110941 111382 111676 111335 109768 108196 107171 108526 108713 107423 106408 106062 108136 total = 29.156381 per ms 02:02:28.764 16 switches: flows: 112595 113913 113190 111901 111176 111610 111157 108610 110739 107763 107587 108178 107667 107288 107637 108184 total = 29.270989 per ms 02:03:28.865 16 switches: flows: 116923 117407 117741 115472 116888 116750 116221 113470 116438 111487 111648 112209 111035 110866 110502 112659 total = 30.411140 per ms 02:04:28.966 16 switches: flows: 114422 113801 114525 113340 113546 114336 113222 111838 113406 108133 109412 110584 108978 108932 108073 110442 total = 29.733523 per ms 02:05:29.067 16 switches: flows: 106248 106301 105992 105221 106050 106860 105128 103204 105290 100975 101234 102321 101687 101489 100837 102301 total = 27.639489 per ms 02:06:29.169 16 switches: flows: 111681 114314 112673 111522 112417 110224 109065 111275 110848 107073 108200 109116 106628 108420 108443 107957 total = 29.282022 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 27639.49/30411.14/29099.48/9726.87 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 27639.49/30411.14/29099.48/9726.87 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 27639.49/30411.14/29099.48/9726.87 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 27639.49/30411.14/29099.48/9726.87 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 27639.49 | 30411.14 | 29099.48 | 9726.87 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 27639.49 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 30411.14 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 29099.48 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 9726.87 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 27639.49 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 30411.14 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 29099.48 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 9726.87 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-04-25 02:06:29 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-04-25 02:06:29,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,27639.49,30411.14,29099.48,9726.87 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.67 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.182" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.182:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Sat Apr 25 02:06:29 UTC 2026 System load: 0.92 Processes: 105 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.182 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Sat Apr 25 01:56:22 2026 from 10.30.170.16 [?2004h[jenkins@releng-48317-700-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.67 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:07:35.019 16 switches: flows: 434669 459515 443190 444858 451002 450861 460398 447954 461381 432976 438882 442705 435551 449527 431136 437394 total = 118.699983 per ms 02:08:35.121 16 switches: flows: 375551 377860 373229 378804 372918 388005 372078 384389 378414 365332 386384 387653 385660 378307 385760 375717 total = 100.931365 per ms 02:09:36.272 16 switches: flows: 582569 583386 581325 588137 582068 581732 581918 588640 591286 587290 590392 589150 590844 583214 593074 582597 total = 153.351290 per ms 02:10:36.375 16 switches: flows: 597211 593957 598890 566014 597161 606819 612581 606495 598150 596774 600513 605746 585048 599024 575215 602326 total = 158.763854 per ms 02:11:36.476 16 switches: flows: 598031 595699 596859 593778 600192 595766 595874 599070 591481 594518 592063 595550 595933 593300 598365 596893 total = 158.623714 per ms 02:12:36.577 16 switches: flows: 549934 562968 556566 561675 560721 557855 563725 556711 559996 564588 556989 555303 561253 560702 562251 558208 total = 148.906807 per ms 02:13:36.679 16 switches: flows: 509743 439722 423310 523410 528802 520840 519066 528613 521476 512423 522046 514249 434870 517063 516968 516760 total = 133.930828 per ms controller msgbuf_read() = 0: closed connection ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with ... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:07:35.019 16 switches: flows: 434669 459515 443190 444858 451002 450861 460398 447954 461381 432976 438882 442705 435551 449527 431136 437394 total = 118.699983 per ms 02:08:35.121 16 switches: flows: 375551 377860 373229 378804 372918 388005 372078 384389 378414 365332 386384 387653 385660 378307 385760 375717 total = 100.931365 per ms 02:09:36.272 16 switches: flows: 582569 583386 581325 588137 582068 581732 581918 588640 591286 587290 590392 589150 590844 583214 593074 582597 total = 153.351290 per ms 02:10:36.375 16 switches: flows: 597211 593957 598890 566014 597161 606819 612581 606495 598150 596774 600513 605746 585048 599024 575215 602326 total = 158.763854 per ms 02:11:36.476 16 switches: flows: 598031 595699 596859 593778 600192 595766 595874 599070 591481 594518 592063 595550 595933 593300 598365 596893 total = 158.623714 per ms 02:12:36.577 16 switches: flows: 549934 562968 556566 561675 560721 557855 563725 556711 559996 564588 556989 555303 561253 560702 562251 558208 total = 148.906807 per ms 02:13:36.679 16 switches: flows: 509743 439722 423310 523410 528802 520840 519066 528613 521476 512423 522046 514249 434870 517063 516968 516760 total = 133.930828 per ms controller msgbuf_read() = 0: closed connection ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:07:35.019 16 switches: flows: 434669 459515 443190 444858 451002 450861 460398 447954 461381 432976 438882 442705 435551 449527 431136 437394 total = 118.699983 per ms 02:08:35.121 16 switches: flows: 375551 377860 373229 378804 372918 388005 372078 384389 378414 365332 386384 387653 385660 378307 385760 375717 total = 100.931365 per ms 02:09:36.272 16 switches: flows: 582569 583386 581325 588137 582068 581732 581918 588640 591286 587290 590392 589150 590844 583214 593074 582597 total = 153.351290 per ms 02:10:36.375 16 switches: flows: 597211 593957 598890 566014 597161 606819 612581 606495 598150 596774 600513 605746 585048 599024 575215 602326 total = 158.763854 per ms 02:11:36.476 16 switches: flows: 598031 595699 596859 593778 600192 595766 595874 599070 591481 594518 592063 595550 595933 593300 598365 596893 total = 158.623714 per ms 02:12:36.577 16 switches: flows: 549934 562968 556566 561675 560721 557855 563725 556711 559996 564588 556989 555303 561253 560702 562251 558208 total = 148.906807 per ms 02:13:36.679 16 switches: flows: 509743 439722 423310 523410 528802 520840 519066 528613 521476 512423 522046 514249 434870 517063 516968 516760 total = 133.930828 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:07:35.019 16 switches: flows: 434669 459515 443190 444858 451002 450861 460398 447954 461381 432976 438882 442705 435551 449527 431136 437394 total = 118.699983 per ms 02:08:35.121 16 switches: flows: 375551 377860 373229 378804 372918 388005 372078 384389 378414 365332 386384 387653 385660 378307 385760 375717 total = 100.931365 per ms 02:09:36.272 16 switches: flows: 582569 583386 581325 588137 582068 581732 581918 588640 591286 587290 590392 589150 590844 583214 593074 582597 total = 153.351290 per ms 02:10:36.375 16 switches: flows: 597211 593957 598890 566014 597161 606819 612581 606495 598150 596774 600513 605746 585048 599024 575215 602326 total = 158.763854 per ms 02:11:36.476 16 switches: flows: 598031 595699 596859 593778 600192 595766 595874 599070 591481 594518 592063 595550 595933 593300 598365 596893 total = 158.623714 per ms 02:12:36.577 16 switches: flows: 549934 562968 556566 561675 560721 557855 563725 556711 559996 564588 556989 555303 561253 560702 562251 558208 total = 148.906807 per ms 02:13:36.679 16 switches: flows: 509743 439722 423310 523410 528802 520840 519066 528613 521476 512423 522046 514249 434870 517063 516968 516760 total = 133.930828 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:07:35.019 16 switches: flows: 434669 459515 443190 444858 451002 450861 460398 447954 461381 432976 438882 442705 435551 449527 431136 437394 total = 118.699983 per ms 02:08:35.121 16 switches: flows: 375551 377860 373229 378804 372918 388005 372078 384389 378414 365332 386384 387653 385660 378307 385760 375717 total = 100.931365 per ms 02:09:36.272 16 switches: flows: 582569 583386 581325 588137 582068 581732 581918 588640 591286 587290 590392 589150 590844 583214 593074 582597 total = 153.351290 per ms 02:10:36.375 16 switches: flows: 597211 593957 598890 566014 597161 606819 612581 606495 598150 596774 600513 605746 585048 599024 575215 602326 total = 158.763854 per ms 02:11:36.476 16 switches: flows: 598031 595699 596859 593778 600192 595766 595874 599070 591481 594518 592063 595550 595933 593300 598365 596893 total = 158.623714 per ms 02:12:36.577 16 switches: flows: 549934 562968 556566 561675 560721 557855 563725 556711 559996 564588 556989 555303 561253 560702 562251 558208 total = 148.906807 per ms 02:13:36.679 16 switches: flows: 509743 439722 423310 523410 528802 520840 519066 528613 521476 512423 522046 514249 434870 517063 516968 516760 total = 133.930828 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:07:35.019 16 switches: flows: 434669 459515 443190 444858 451002 450861 460398 447954 461381 432976 438882 442705 435551 449527 431136 437394 total = 118.699983 per ms 02:08:35.121 16 switches: flows: 375551 377860 373229 378804 372918 388005 372078 384389 378414 365332 386384 387653 385660 378307 385760 375717 total = 100.931365 per ms 02:09:36.272 16 switches: flows: 582569 583386 581325 588137 582068 581732 581918 588640 591286 587290 590392 589150 590844 583214 593074 582597 total = 153.351290 per ms 02:10:36.375 16 switches: flows: 597211 593957 598890 566014 597161 606819 612581 606495 598150 596774 600513 605746 585048 599024 575215 602326 total = 158.763854 per ms 02:11:36.476 16 switches: flows: 598031 595699 596859 593778 600192 595766 595874 599070 591481 594518 592063 595550 595933 593300 598365 596893 total = 158.623714 per ms 02:12:36.577 16 switches: flows: 549934 562968 556566 561675 560721 557855 563725 556711 559996 564588 556989 555303 561253 560702 562251 558208 total = 148.906807 per ms 02:13:36.679 16 switches: flows: 509743 439722 423310 523410 528802 520840 519066 528613 521476 512423 522046 514249 434870 517063 516968 516760 total = 133.930828 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.67 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.182" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.182:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Sat Apr 25 02:13:40 UTC 2026 System load: 0.25 Processes: 105 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.182 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Sat Apr 25 02:06:29 2026 from 10.30.170.16 [?2004h[jenkins@releng-48317-700-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.67 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:45.715 16 switches: flows: 96655 88085 95705 96783 95078 94402 94860 89448 96076 95933 94743 94958 94240 94318 94295 95549 total = 25.185467 per ms 02:15:45.815 16 switches: flows: 109346 99140 107109 107768 107974 108968 107753 100090 107705 108186 106067 107125 105087 106588 106377 107280 total = 28.328635 per ms 02:16:45.915 16 switches: flows: 112836 102868 110595 111330 112828 112090 110948 103430 109854 111855 111221 111286 108180 108579 111088 110696 total = 29.279166 per ms 02:17:46.016 16 switches: flows: 110282 98925 106879 107591 108308 107257 106431 99834 107360 107493 107517 106536 106280 105582 106850 106611 total = 28.281714 per ms 02:18:46.116 16 switches: flows: 113723 106489 113423 113704 114372 112836 112808 106743 111826 112765 112368 111877 112824 113518 113590 112411 total = 29.871313 per ms 02:19:46.217 16 switches: flows: 108569 100505 109744 108771 111574 108314 108908 101252 107841 107032 108654 109002 107635 107576 108748 108021 total = 28.654592 per ms 02:20:46.317 16 switches: flows: 110911 103986 110734 110047 112411 109632 111069 104975 110309 110684 109488 110612 108945 110211 110040 111058 total = 29.203050 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:45.715 16 switches: flows: 96655 88085 95705 96783 95078 94402 94860 89448 96076 95933 94743 94958 94240 94318 94295 95549 total = 25.185467 per ms 02:15:45.815 16 switches: flows: 109346 99140 107109 107768 107974 108968 107753 100090 107705 108186 106067 107125 105087 106588 106377 107280 total = 28.328635 per ms 02:16:45.915 16 switches: flows: 112836 102868 110595 111330 112828 112090 110948 103430 109854 111855 111221 111286 108180 108579 111088 110696 total = 29.279166 per ms 02:17:46.016 16 switches: flows: 110282 98925 106879 107591 108308 107257 106431 99834 107360 107493 107517 106536 106280 105582 106850 106611 total = 28.281714 per ms 02:18:46.116 16 switches: flows: 113723 106489 113423 113704 114372 112836 112808 106743 111826 112765 112368 111877 112824 113518 113590 112411 total = 29.871313 per ms 02:19:46.217 16 switches: flows: 108569 100505 109744 108771 111574 108314 108908 101252 107841 107032 108654 109002 107635 107576 108748 108021 total = 28.654592 per ms 02:20:46.317 16 switches: flows: 110911 103986 110734 110047 112411 109632 111069 104975 110309 110684 109488 110612 108945 110211 110040 111058 total = 29.203050 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:45.715 16 switches: flows: 96655 88085 95705 96783 95078 94402 94860 89448 96076 95933 94743 94958 94240 94318 94295 95549 total = 25.185467 per ms 02:15:45.815 16 switches: flows: 109346 99140 107109 107768 107974 108968 107753 100090 107705 108186 106067 107125 105087 106588 106377 107280 total = 28.328635 per ms 02:16:45.915 16 switches: flows: 112836 102868 110595 111330 112828 112090 110948 103430 109854 111855 111221 111286 108180 108579 111088 110696 total = 29.279166 per ms 02:17:46.016 16 switches: flows: 110282 98925 106879 107591 108308 107257 106431 99834 107360 107493 107517 106536 106280 105582 106850 106611 total = 28.281714 per ms 02:18:46.116 16 switches: flows: 113723 106489 113423 113704 114372 112836 112808 106743 111826 112765 112368 111877 112824 113518 113590 112411 total = 29.871313 per ms 02:19:46.217 16 switches: flows: 108569 100505 109744 108771 111574 108314 108908 101252 107841 107032 108654 109002 107635 107576 108748 108021 total = 28.654592 per ms 02:20:46.317 16 switches: flows: 110911 103986 110734 110047 112411 109632 111069 104975 110309 110684 109488 110612 108945 110211 110040 111058 total = 29.203050 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:45.715 16 switches: flows: 96655 88085 95705 96783 95078 94402 94860 89448 96076 95933 94743 94958 94240 94318 94295 95549 total = 25.185467 per ms 02:15:45.815 16 switches: flows: 109346 99140 107109 107768 107974 108968 107753 100090 107705 108186 106067 107125 105087 106588 106377 107280 total = 28.328635 per ms 02:16:45.915 16 switches: flows: 112836 102868 110595 111330 112828 112090 110948 103430 109854 111855 111221 111286 108180 108579 111088 110696 total = 29.279166 per ms 02:17:46.016 16 switches: flows: 110282 98925 106879 107591 108308 107257 106431 99834 107360 107493 107517 106536 106280 105582 106850 106611 total = 28.281714 per ms 02:18:46.116 16 switches: flows: 113723 106489 113423 113704 114372 112836 112808 106743 111826 112765 112368 111877 112824 113518 113590 112411 total = 29.871313 per ms 02:19:46.217 16 switches: flows: 108569 100505 109744 108771 111574 108314 108908 101252 107841 107032 108654 109002 107635 107576 108748 108021 total = 28.654592 per ms 02:20:46.317 16 switches: flows: 110911 103986 110734 110047 112411 109632 111069 104975 110309 110684 109488 110612 108945 110211 110040 111058 total = 29.203050 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:45.715 16 switches: flows: 96655 88085 95705 96783 95078 94402 94860 89448 96076 95933 94743 94958 94240 94318 94295 95549 total = 25.185467 per ms 02:15:45.815 16 switches: flows: 109346 99140 107109 107768 107974 108968 107753 100090 107705 108186 106067 107125 105087 106588 106377 107280 total = 28.328635 per ms 02:16:45.915 16 switches: flows: 112836 102868 110595 111330 112828 112090 110948 103430 109854 111855 111221 111286 108180 108579 111088 110696 total = 29.279166 per ms 02:17:46.016 16 switches: flows: 110282 98925 106879 107591 108308 107257 106431 99834 107360 107493 107517 106536 106280 105582 106850 106611 total = 28.281714 per ms 02:18:46.116 16 switches: flows: 113723 106489 113423 113704 114372 112836 112808 106743 111826 112765 112368 111877 112824 113518 113590 112411 total = 29.871313 per ms 02:19:46.217 16 switches: flows: 108569 100505 109744 108771 111574 108314 108908 101252 107841 107032 108654 109002 107635 107576 108748 108021 total = 28.654592 per ms 02:20:46.317 16 switches: flows: 110911 103986 110734 110047 112411 109632 111069 104975 110309 110684 109488 110612 108945 110211 110040 111058 total = 29.203050 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. '6176' does not contain '-' ${number} - Fails if ``container`` does not contain ``item`` one or more times. '6176' does not contain '-' ${match} = False ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} = https://bugs.opendaylight.org/show_bug.cgi?id=6176 ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} = This test fails due to https://bugs.opendaylight.org/show_bug.cgi?id=6176 ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} = ${newline} chr(10) Evaluates the given expression in Python and returns the result. Set test message to: This test fails due to https://bugs.opendaylight.org/show_bug.cgi?id=6176 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:45.715 16 switches: flows: 96655 88085 95705 96783 95078 94402 94860 89448 96076 95933 94743 94958 94240 94318 94295 95549 total = 25.185467 per ms 02:15:45.815 16 switches: flows: 109346 99140 107109 107768 107974 108968 107753 100090 107705 108186 106067 107125 105087 106588 106377 107280 total = 28.328635 per ms 02:16:45.915 16 switches: flows: 112836 102868 110595 111330 112828 112090 110948 103430 109854 111855 111221 111286 108180 108579 111088 110696 total = 29.279166 per ms 02:17:46.016 16 switches: flows: 110282 98925 106879 107591 108308 107257 106431 99834 107360 107493 107517 106536 106280 105582 106850 106611 total = 28.281714 per ms 02:18:46.116 16 switches: flows: 113723 106489 113423 113704 114372 112836 112808 106743 111826 112765 112368 111877 112824 113518 113590 112411 total = 29.871313 per ms 02:19:46.217 16 switches: flows: 108569 100505 109744 108771 111574 108314 108908 101252 107841 107032 108654 109002 107635 107576 108748 108021 total = 28.654592 per ms 02:20:46.317 16 switches: flows: 110911 103986 110734 110047 112411 109632 111069 104975 110309 110684 109488 110612 108945 110211 110040 111058 total = 29.203050 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. This test fails due to https://bugs.opendaylight.org/show_bug.cgi?id=6176 ${msg} Logs the given message with the given level. Set tag 'https://bugs.opendaylight.org/show_bug.cgi?id=6176'. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench https://bugs.opendaylight.org/show_bug.cgi?id=6176 latency This test fails due to https://bugs.opendaylight.org/show_bug.cgi?id=6176 'cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.67:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.67. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:14:45.715 16 switches: flows: 96655 88085 95705 96783 95078 94402 94860 89448 96076 95933 94743 94958 94240 94318 94295 95549 total = 25.185467 per ms 02:15:45.815 16 switches: flows: 109346 99140 107109 107768 107974 108968 107753 100090 107705 108186 106067 107125 105087 106588 106377 107280 total = 28.328635 per ms 02:16:45.915 16 switches: flows: 112836 102868 110595 111330 112828 112090 110948 103430 109854 111855 111221 111286 108180 108579 111088 110696 total = 29.279166 per ms 02:17:46.016 16 switches: flows: 110282 98925 106879 107591 108308 107257 106431 99834 107360 107493 107517 106536 106280 105582 106850 106611 total = 28.281714 per ms 02:18:46.116 16 switches: flows: 113723 106489 113423 113704 114372 112836 112808 106743 111826 112765 112368 111877 112824 113518 113590 112411 total = 29.871313 per ms 02:19:46.217 16 switches: flows: 108569 100505 109744 108771 111574 108314 108908 101252 107841 107032 108654 109002 107635 107576 108748 108021 total = 28.654592 per ms 02:20:46.317 16 switches: flows: 110911 103986 110734 110047 112411 109632 111069 104975 110309 110684 109488 110612 108945 110211 110040 111058 total = 29.203050 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench https://bugs.opendaylight.org/show_bug.cgi?id=6176 latency throughput openflowplugin-cbench.txt