Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.242:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.242 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.98:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Jul 21 01:55:26 UTC 2026 System load: 0.05 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.98 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-48317-786-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.242:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.20.2 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.242 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.242:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.242 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.242 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.98" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.98:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Jul 21 01:55:26 UTC 2026 System load: 0.05 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.98 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue Jul 21 01:55:26 2026 from 10.30.171.20 [?2004h[jenkins@releng-48317-786-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.242 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.242. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:56:32.634 16 switches: flows: 97517 94146 94532 95095 96245 94029 94149 95256 93541 91833 90689 91870 90255 91506 91466 91021 total = 24.885833 per ms 01:57:32.735 16 switches: flows: 117803 116380 115807 117826 117644 115030 115554 116038 112485 112580 111539 111007 108785 112752 114113 110292 total = 30.376484 per ms 01:58:32.835 16 switches: flows: 105666 106841 106871 104730 105647 102628 105054 105058 102297 103538 101105 99441 100682 103571 103494 102433 total = 27.604831 per ms 01:59:32.936 16 switches: flows: 80546 75422 80050 80924 78417 78997 79501 78812 78471 79079 75062 76491 76652 79030 76881 75849 total = 20.801654 per ms 02:00:33.037 16 switches: flows: 111891 113819 113297 110482 111511 108290 110257 111835 110250 109414 107521 108010 107533 108929 107786 108472 total = 29.272735 per ms 02:01:33.138 16 switches: flows: 110294 107367 110372 109196 109326 107408 107631 109265 104290 104349 105783 106700 103439 106076 102625 105877 total = 28.452426 per ms 02:02:33.240 16 switches: flows: 105562 105870 106074 106087 105329 104332 105029 105114 100580 101815 99756 101157 101103 101346 99968 101176 total = 27.459080 per ms 02:03:33.341 16 switches: flows: 108376 107273 109891 107865 107597 107467 109038 109011 105537 106505 102648 102613 102837 103535 103451 103837 total = 28.244190 per ms 02:04:33.442 16 switches: flows: 99564 100475 100768 101177 100437 99444 100818 99719 95223 97882 96452 97005 95472 97274 97870 96715 total = 26.227732 per ms 02:05:33.544 16 switches: flows: 109229 108294 107782 110661 109514 106918 107692 107492 106234 106390 103777 104134 104150 105540 104437 103637 total = 28.383947 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 20801.65/30376.48/27424.79/9499.86 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.242. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:56:32.634 16 switches: flows: 97517 94146 94532 95095 96245 94029 94149 95256 93541 91833 90689 91870 90255 91506 91466 91021 total = 24.885833 per ms 01:57:32.735 16 switches: flows: 117803 116380 115807 117826 117644 115030 115554 116038 112485 112580 111539 111007 108785 112752 114113 110292 total = 30.376484 per ms 01:58:32.835 16 switches: flows: 105666 106841 106871 104730 105647 102628 105054 105058 102297 103538 101105 99441 100682 103571 103494 102433 total = 27.604831 per ms 01:59:32.936 16 switches: flows: 80546 75422 80050 80924 78417 78997 79501 78812 78471 79079 75062 76491 76652 79030 76881 75849 total = 20.801654 per ms 02:00:33.037 16 switches: flows: 111891 113819 113297 110482 111511 108290 110257 111835 110250 109414 107521 108010 107533 108929 107786 108472 total = 29.272735 per ms 02:01:33.138 16 switches: flows: 110294 107367 110372 109196 109326 107408 107631 109265 104290 104349 105783 106700 103439 106076 102625 105877 total = 28.452426 per ms 02:02:33.240 16 switches: flows: 105562 105870 106074 106087 105329 104332 105029 105114 100580 101815 99756 101157 101103 101346 99968 101176 total = 27.459080 per ms 02:03:33.341 16 switches: flows: 108376 107273 109891 107865 107597 107467 109038 109011 105537 106505 102648 102613 102837 103535 103451 103837 total = 28.244190 per ms 02:04:33.442 16 switches: flows: 99564 100475 100768 101177 100437 99444 100818 99719 95223 97882 96452 97005 95472 97274 97870 96715 total = 26.227732 per ms 02:05:33.544 16 switches: flows: 109229 108294 107782 110661 109514 106918 107692 107492 106234 106390 103777 104134 104150 105540 104437 103637 total = 28.383947 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 20801.65/30376.48/27424.79/9499.86 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 20801.65/30376.48/27424.79/9499.86 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 20801.65/30376.48/27424.79/9499.86 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 20801.65/30376.48/27424.79/9499.86 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 20801.65 | 30376.48 | 27424.79 | 9499.86 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 20801.65 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 30376.48 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 27424.79 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 9499.86 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 20801.65 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 30376.48 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 27424.79 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 9499.86 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-07-21 02:05:33 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-07-21 02:05:33,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,20801.65,30376.48,27424.79,9499.86 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.242 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.98" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.98:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Jul 21 02:05:33 UTC 2026 System load: 1.01 Processes: 104 Usage of /: 19.8% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.98 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue Jul 21 01:55:27 2026 from 10.30.171.20 [?2004h[jenkins@releng-48317-786-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.242 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.242. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:06:39.344 16 switches: flows: 425772 424518 414489 435021 418633 433724 428564 431923 421290 416194 426901 400578 416430 422461 414131 408059 total = 112.311467 per ms 02:07:39.445 16 switches: flows: 348958 351996 364797 341430 353870 350230 366602 357722 345940 348493 348425 363905 338388 355174 348378 349352 total = 93.736253 per ms 02:08:39.547 16 switches: flows: 502678 514740 517497 506025 496792 509441 515499 462281 464198 504185 503505 505016 460721 510073 518187 516541 total = 133.231475 per ms 02:09:39.649 16 switches: flows: 502168 452946 504180 513329 499510 515525 509504 499089 507616 519304 505335 512126 510770 500837 511551 507231 total = 134.290565 per ms 02:10:39.752 16 switches: flows: 570875 567046 566514 573252 564740 570570 576165 570517 558729 579736 573134 573225 567830 582774 569070 556575 total = 151.755225 per ms 02:11:46.638 16 switches: flows: 400421 462331 399064 396524 400300 392719 398512 463698 465557 469673 474936 453727 476891 380715 459440 415699 total = 103.313174 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.242. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:06:39.344 16 switches: flows: 425772 424518 414489 435021 418633 433724 428564 431923 421290 416194 426901 400578 416430 422461 414131 408059 total = 112.311467 per ms 02:07:39.445 16 switches: flows: 348958 351996 364797 341430 353870 350230 366602 357722 345940 348493 348425 363905 338388 355174 348378 349352 total = 93.736253 per ms 02:08:39.547 16 switches: flows: 502678 514740 517497 506025 496792 509441 515499 462281 464198 504185 503505 505016 460721 510073 518187 516541 total = 133.231475 per ms 02:09:39.649 16 switches: flows: 502168 452946 504180 513329 499510 515525 509504 499089 507616 519304 505335 512126 510770 500837 511551 507231 total = 134.290565 per ms 02:10:39.752 16 switches: flows: 570875 567046 566514 573252 564740 570570 576165 570517 558729 579736 573134 573225 567830 582774 569070 556575 total = 151.755225 per ms 02:11:46.638 16 switches: flows: 400421 462331 399064 396524 400300 392719 398512 463698 465557 469673 474936 453727 476891 380715 459440 415699 total = 103.313174 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.242. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:06:39.344 16 switches: flows: 425772 424518 414489 435021 418633 433724 428564 431923 421290 416194 426901 400578 416430 422461 414131 408059 total = 112.311467 per ms 02:07:39.445 16 switches: flows: 348958 351996 364797 341430 353870 350230 366602 357722 345940 348493 348425 363905 338388 355174 348378 349352 total = 93.736253 per ms 02:08:39.547 16 switches: flows: 502678 514740 517497 506025 496792 509441 515499 462281 464198 504185 503505 505016 460721 510073 518187 516541 total = 133.231475 per ms 02:09:39.649 16 switches: flows: 502168 452946 504180 513329 499510 515525 509504 499089 507616 519304 505335 512126 510770 500837 511551 507231 total = 134.290565 per ms 02:10:39.752 16 switches: flows: 570875 567046 566514 573252 564740 570570 576165 570517 558729 579736 573134 573225 567830 582774 569070 556575 total = 151.755225 per ms 02:11:46.638 16 switches: flows: 400421 462331 399064 396524 400300 392719 398512 463698 465557 469673 474936 453727 476891 380715 459440 415699 total = 103.313174 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.242. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:06:39.344 16 switches: flows: 425772 424518 414489 435021 418633 433724 428564 431923 421290 416194 426901 400578 416430 422461 414131 408059 total = 112.311467 per ms 02:07:39.445 16 switches: flows: 348958 351996 364797 341430 353870 350230 366602 357722 345940 348493 348425 363905 338388 355174 348378 349352 total = 93.736253 per ms 02:08:39.547 16 switches: flows: 502678 514740 517497 506025 496792 509441 515499 462281 464198 504185 503505 505016 460721 510073 518187 516541 total = 133.231475 per ms 02:09:39.649 16 switches: flows: 502168 452946 504180 513329 499510 515525 509504 499089 507616 519304 505335 512126 510770 500837 511551 507231 total = 134.290565 per ms 02:10:39.752 16 switches: flows: 570875 567046 566514 573252 564740 570570 576165 570517 558729 579736 573134 573225 567830 582774 569070 556575 total = 151.755225 per ms 02:11:46.638 16 switches: flows: 400421 462331 399064 396524 400300 392719 398512 463698 465557 469673 474936 453727 476891 380715 459440 415699 total = 103.313174 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.242. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:06:39.344 16 switches: flows: 425772 424518 414489 435021 418633 433724 428564 431923 421290 416194 426901 400578 416430 422461 414131 408059 total = 112.311467 per ms 02:07:39.445 16 switches: flows: 348958 351996 364797 341430 353870 350230 366602 357722 345940 348493 348425 363905 338388 355174 348378 349352 total = 93.736253 per ms 02:08:39.547 16 switches: flows: 502678 514740 517497 506025 496792 509441 515499 462281 464198 504185 503505 505016 460721 510073 518187 516541 total = 133.231475 per ms 02:09:39.649 16 switches: flows: 502168 452946 504180 513329 499510 515525 509504 499089 507616 519304 505335 512126 510770 500837 511551 507231 total = 134.290565 per ms 02:10:39.752 16 switches: flows: 570875 567046 566514 573252 564740 570570 576165 570517 558729 579736 573134 573225 567830 582774 569070 556575 total = 151.755225 per ms 02:11:46.638 16 switches: flows: 400421 462331 399064 396524 400300 392719 398512 463698 465557 469673 474936 453727 476891 380715 459440 415699 total = 103.313174 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.242. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:06:39.344 16 switches: flows: 425772 424518 414489 435021 418633 433724 428564 431923 421290 416194 426901 400578 416430 422461 414131 408059 total = 112.311467 per ms 02:07:39.445 16 switches: flows: 348958 351996 364797 341430 353870 350230 366602 357722 345940 348493 348425 363905 338388 355174 348378 349352 total = 93.736253 per ms 02:08:39.547 16 switches: flows: 502678 514740 517497 506025 496792 509441 515499 462281 464198 504185 503505 505016 460721 510073 518187 516541 total = 133.231475 per ms 02:09:39.649 16 switches: flows: 502168 452946 504180 513329 499510 515525 509504 499089 507616 519304 505335 512126 510770 500837 511551 507231 total = 134.290565 per ms 02:10:39.752 16 switches: flows: 570875 567046 566514 573252 564740 570570 576165 570517 558729 579736 573134 573225 567830 582774 569070 556575 total = 151.755225 per ms 02:11:46.638 16 switches: flows: 400421 462331 399064 396524 400300 392719 398512 463698 465557 469673 474936 453727 476891 380715 459440 415699 total = 103.313174 per ms controller msgbuf_read() = -1: msgbuf_read: Connection reset by peer ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.242 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.98" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.98:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Jul 21 02:12:11 UTC 2026 System load: 0.26 Processes: 105 Usage of /: 19.8% of 38.58GB Users logged in: 0 Memory usage: 5% IPv4 address for ens3: 10.30.170.98 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue Jul 21 02:05:34 2026 from 10.30.171.20 [?2004h[jenkins@releng-48317-786-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.242 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.242. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:13:16.662 16 switches: flows: 81545 80385 76786 81396 81061 80991 79746 79663 79775 79102 79371 80515 79075 79004 78239 79450 total = 21.268400 per ms 02:14:16.762 16 switches: flows: 101695 100653 96494 101311 101719 102218 99828 101195 100872 99264 100479 100279 98035 98501 99348 100159 total = 26.656315 per ms 02:15:16.862 16 switches: flows: 101983 99854 96554 99630 100190 100943 101123 99657 100866 98536 99310 100743 98707 98708 99986 97536 total = 26.527774 per ms 02:16:16.963 16 switches: flows: 93022 92150 88930 91666 91873 92423 91799 92615 92141 90371 91374 92439 90861 89659 91044 90624 total = 24.342464 per ms 02:17:17.063 16 switches: flows: 105565 105316 101765 104976 105326 104191 103411 104603 102652 101483 101868 102247 102079 102127 103192 101443 total = 27.491432 per ms 02:18:17.163 16 switches: flows: 105049 105225 101327 104312 105670 104465 103943 103136 102114 100566 102529 101205 100377 102127 102148 101346 total = 27.379907 per ms 02:19:17.266 16 switches: flows: 106303 107464 100661 105916 106274 104691 103534 104778 103282 101583 101872 102308 101470 101188 102909 102543 total = 27.565889 per ms 02:20:17.366 16 switches: flows: 106505 106757 101380 105664 106251 105793 102745 104899 104082 100661 102464 102464 102179 103127 102572 102452 total = 27.620436 per ms 02:21:17.467 16 switches: flows: 104461 105334 99910 105708 105138 104827 101759 102649 103143 100573 101156 101637 102050 101684 102834 100811 total = 27.348827 per ms 02:22:17.567 16 switches: flows: 105728 108049 102012 106302 106589 105822 103054 104375 103000 101111 101763 101785 102661 101962 102466 102251 total = 27.602583 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 24342.46/27620.44/26948.40/9038.02 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.242:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.242. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 02:13:16.662 16 switches: flows: 81545 80385 76786 81396 81061 80991 79746 79663 79775 79102 79371 80515 79075 79004 78239 79450 total = 21.268400 per ms 02:14:16.762 16 switches: flows: 101695 100653 96494 101311 101719 102218 99828 101195 100872 99264 100479 100279 98035 98501 99348 100159 total = 26.656315 per ms 02:15:16.862 16 switches: flows: 101983 99854 96554 99630 100190 100943 101123 99657 100866 98536 99310 100743 98707 98708 99986 97536 total = 26.527774 per ms 02:16:16.963 16 switches: flows: 93022 92150 88930 91666 91873 92423 91799 92615 92141 90371 91374 92439 90861 89659 91044 90624 total = 24.342464 per ms 02:17:17.063 16 switches: flows: 105565 105316 101765 104976 105326 104191 103411 104603 102652 101483 101868 102247 102079 102127 103192 101443 total = 27.491432 per ms 02:18:17.163 16 switches: flows: 105049 105225 101327 104312 105670 104465 103943 103136 102114 100566 102529 101205 100377 102127 102148 101346 total = 27.379907 per ms 02:19:17.266 16 switches: flows: 106303 107464 100661 105916 106274 104691 103534 104778 103282 101583 101872 102308 101470 101188 102909 102543 total = 27.565889 per ms 02:20:17.366 16 switches: flows: 106505 106757 101380 105664 106251 105793 102745 104899 104082 100661 102464 102464 102179 103127 102572 102452 total = 27.620436 per ms 02:21:17.467 16 switches: flows: 104461 105334 99910 105708 105138 104827 101759 102649 103143 100573 101156 101637 102050 101684 102834 100811 total = 27.348827 per ms 02:22:17.567 16 switches: flows: 105728 108049 102012 106302 106589 105822 103054 104375 103000 101111 101763 101785 102661 101962 102466 102251 total = 27.602583 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 24342.46/27620.44/26948.40/9038.02 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 24342.46/27620.44/26948.40/9038.02 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 24342.46/27620.44/26948.40/9038.02 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 24342.46/27620.44/26948.40/9038.02 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 24342.46 | 27620.44 | 26948.40 | 9038.02 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 24342.46 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 27620.44 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 26948.40 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 9038.02 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 24342.46 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 27620.44 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 26948.40 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 9038.02 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-07-21 02:22:17 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-07-21 02:22:17,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,24342.46,27620.44,26948.40,9038.02 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-titanium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-titanium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt