Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.121:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.121 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.7:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed Aug 26 00:39:15 UTC 2026 System load: 0.23 Processes: 109 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.7 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-63164-380-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.121:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.4 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.4 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.4 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.4 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.121 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.171.121:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.171.121 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.121 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.7" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.7:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed Aug 26 00:39:15 UTC 2026 System load: 0.23 Processes: 109 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.7 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Wed Aug 26 00:39:43 2026 from 10.30.170.106 [?2004h[jenkins@releng-63164-380-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.121 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.121. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:40:50.238 16 switches: flows: 97428 97515 97183 97426 95542 95963 95391 98647 96186 94869 95255 94955 94206 93555 93342 95093 total = 25.542600 per ms 00:41:50.339 16 switches: flows: 118836 117282 116123 115975 117500 115190 117616 117882 113082 113782 113143 113855 111951 110468 114551 111477 total = 30.594151 per ms 00:42:50.439 16 switches: flows: 116694 116097 114091 114662 115860 114142 114800 115714 110559 112981 110901 113723 108796 108535 111927 111026 total = 30.124819 per ms 00:43:50.539 16 switches: flows: 119837 116830 116072 117260 118692 116934 117211 117331 112701 116599 113931 115690 111343 110537 113409 111862 total = 30.719357 per ms 00:44:50.639 16 switches: flows: 118294 114999 115635 115952 118850 115722 117535 118072 112526 114482 113631 115261 110736 109982 114490 110802 total = 30.565092 per ms 00:45:50.740 16 switches: flows: 120252 118995 117643 119520 120355 118713 119910 119506 115205 116849 115865 116932 114072 113711 115166 114400 total = 31.232749 per ms 00:46:50.840 16 switches: flows: 122834 121678 119585 119961 121691 120425 119101 119438 117583 117932 116903 116840 116602 115911 116570 114707 total = 31.576431 per ms 00:47:50.941 16 switches: flows: 122234 121393 120701 120543 121432 119645 120643 119895 116895 117230 117872 118031 115742 114909 117175 115785 total = 31.615912 per ms 00:48:51.041 16 switches: flows: 121604 121979 120700 120154 122256 119692 120871 119995 118137 119010 117704 118345 116590 114899 117566 115765 total = 31.701525 per ms 00:49:51.141 16 switches: flows: 121240 123558 120699 121550 119499 119892 120899 119233 117527 116194 116398 116179 117024 115355 116010 115722 total = 31.563624 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 30124.82/31701.52/31077.07/10373.61 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.121. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:40:50.238 16 switches: flows: 97428 97515 97183 97426 95542 95963 95391 98647 96186 94869 95255 94955 94206 93555 93342 95093 total = 25.542600 per ms 00:41:50.339 16 switches: flows: 118836 117282 116123 115975 117500 115190 117616 117882 113082 113782 113143 113855 111951 110468 114551 111477 total = 30.594151 per ms 00:42:50.439 16 switches: flows: 116694 116097 114091 114662 115860 114142 114800 115714 110559 112981 110901 113723 108796 108535 111927 111026 total = 30.124819 per ms 00:43:50.539 16 switches: flows: 119837 116830 116072 117260 118692 116934 117211 117331 112701 116599 113931 115690 111343 110537 113409 111862 total = 30.719357 per ms 00:44:50.639 16 switches: flows: 118294 114999 115635 115952 118850 115722 117535 118072 112526 114482 113631 115261 110736 109982 114490 110802 total = 30.565092 per ms 00:45:50.740 16 switches: flows: 120252 118995 117643 119520 120355 118713 119910 119506 115205 116849 115865 116932 114072 113711 115166 114400 total = 31.232749 per ms 00:46:50.840 16 switches: flows: 122834 121678 119585 119961 121691 120425 119101 119438 117583 117932 116903 116840 116602 115911 116570 114707 total = 31.576431 per ms 00:47:50.941 16 switches: flows: 122234 121393 120701 120543 121432 119645 120643 119895 116895 117230 117872 118031 115742 114909 117175 115785 total = 31.615912 per ms 00:48:51.041 16 switches: flows: 121604 121979 120700 120154 122256 119692 120871 119995 118137 119010 117704 118345 116590 114899 117566 115765 total = 31.701525 per ms 00:49:51.141 16 switches: flows: 121240 123558 120699 121550 119499 119892 120899 119233 117527 116194 116398 116179 117024 115355 116010 115722 total = 31.563624 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 30124.82/31701.52/31077.07/10373.61 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 30124.82/31701.52/31077.07/10373.61 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 30124.82/31701.52/31077.07/10373.61 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 30124.82/31701.52/31077.07/10373.61 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 30124.82 | 31701.52 | 31077.07 | 10373.61 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 30124.82 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 31701.52 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 31077.07 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10373.61 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 30124.82 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 31701.52 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 31077.07 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10373.61 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-26 00:49:51 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-26 00:49:51,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,30124.82,31701.52,31077.07,10373.61 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.121 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.7" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.7:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed Aug 26 00:49:51 UTC 2026 System load: 1.01 Processes: 104 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.7 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Wed Aug 26 00:39:44 2026 from 10.30.170.106 [?2004h[jenkins@releng-63164-380-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.121 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.121. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:50:56.942 16 switches: flows: 511783 487160 496984 501713 494668 503264 497165 518299 468420 489196 495459 476654 483768 496188 503318 482454 total = 131.774883 per ms 00:51:57.043 16 switches: flows: 581978 568778 570189 573748 563175 578869 569161 565892 574384 557041 575971 563607 569782 571411 574948 580260 total = 152.064067 per ms 00:52:57.147 16 switches: flows: 602691 605408 599981 592578 602349 603145 600231 605845 592457 590185 598480 591094 596545 598217 595431 591036 total = 159.154588 per ms 00:53:57.250 16 switches: flows: 534445 520832 541889 537951 533910 537954 475775 527611 528334 530706 530316 528054 541990 532379 529430 532384 total = 140.828216 per ms 00:54:57.352 16 switches: flows: 540584 542651 540265 535165 537511 529898 533530 536342 526826 538591 532937 540086 533060 535676 538343 534458 total = 142.690121 per ms 00:55:57.453 16 switches: flows: 498791 537947 543120 541306 543166 537886 538168 545694 545812 533381 543242 539460 529345 545122 542620 535751 total = 143.106893 per ms 00:56:58.274 16 switches: flows: 484956 511244 510609 513639 502005 505316 526077 508299 514243 505092 514089 522892 525443 510674 505569 520499 total = 134.502567 per ms 00:57:58.376 16 switches: flows: 562492 564717 559417 563669 564580 562414 562344 507843 549603 556792 563992 560975 554148 559655 558218 553677 total = 148.160002 per ms 00:58:58.477 16 switches: flows: 560145 561049 564715 561186 573944 573973 566077 572618 564088 557650 566584 571746 561188 556247 567044 562179 total = 150.421609 per ms controller msgbuf_read() = 0: closed connection ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.121. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:50:56.942 16 switches: flows: 511783 487160 496984 501713 494668 503264 497165 518299 468420 489196 495459 476654 483768 496188 503318 482454 total = 131.774883 per ms 00:51:57.043 16 switches: flows: 581978 568778 570189 573748 563175 578869 569161 565892 574384 557041 575971 563607 569782 571411 574948 580260 total = 152.064067 per ms 00:52:57.147 16 switches: flows: 602691 605408 599981 592578 602349 603145 600231 605845 592457 590185 598480 591094 596545 598217 595431 591036 total = 159.154588 per ms 00:53:57.250 16 switches: flows: 534445 520832 541889 537951 533910 537954 475775 527611 528334 530706 530316 528054 541990 532379 529430 532384 total = 140.828216 per ms 00:54:57.352 16 switches: flows: 540584 542651 540265 535165 537511 529898 533530 536342 526826 538591 532937 540086 533060 535676 538343 534458 total = 142.690121 per ms 00:55:57.453 16 switches: flows: 498791 537947 543120 541306 543166 537886 538168 545694 545812 533381 543242 539460 529345 545122 542620 535751 total = 143.106893 per ms 00:56:58.274 16 switches: flows: 484956 511244 510609 513639 502005 505316 526077 508299 514243 505092 514089 522892 525443 510674 505569 520499 total = 134.502567 per ms 00:57:58.376 16 switches: flows: 562492 564717 559417 563669 564580 562414 562344 507843 549603 556792 563992 560975 554148 559655 558218 553677 total = 148.160002 per ms 00:58:58.477 16 switches: flows: 560145 561049 564715 561186 573944 573973 566077 572618 564088 557650 566584 571746 561188 556247 567044 562179 total = 150.421609 per ms controller msgbuf_read() = 0: closed connection ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.121. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:50:56.942 16 switches: flows: 511783 487160 496984 501713 494668 503264 497165 518299 468420 489196 495459 476654 483768 496188 503318 482454 total = 131.774883 per ms 00:51:57.043 16 switches: flows: 581978 568778 570189 573748 563175 578869 569161 565892 574384 557041 575971 563607 569782 571411 574948 580260 total = 152.064067 per ms 00:52:57.147 16 switches: flows: 602691 605408 599981 592578 602349 603145 600231 605845 592457 590185 598480 591094 596545 598217 595431 591036 total = 159.154588 per ms 00:53:57.250 16 switches: flows: 534445 520832 541889 537951 533910 537954 475775 527611 528334 530706 530316 528054 541990 532379 529430 532384 total = 140.828216 per ms 00:54:57.352 16 switches: flows: 540584 542651 540265 535165 537511 529898 533530 536342 526826 538591 532937 540086 533060 535676 538343 534458 total = 142.690121 per ms 00:55:57.453 16 switches: flows: 498791 537947 543120 541306 543166 537886 538168 545694 545812 533381 543242 539460 529345 545122 542620 535751 total = 143.106893 per ms 00:56:58.274 16 switches: flows: 484956 511244 510609 513639 502005 505316 526077 508299 514243 505092 514089 522892 525443 510674 505569 520499 total = 134.502567 per ms 00:57:58.376 16 switches: flows: 562492 564717 559417 563669 564580 562414 562344 507843 549603 556792 563992 560975 554148 559655 558218 553677 total = 148.160002 per ms 00:58:58.477 16 switches: flows: 560145 561049 564715 561186 573944 573973 566077 572618 564088 557650 566584 571746 561188 556247 567044 562179 total = 150.421609 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.121. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:50:56.942 16 switches: flows: 511783 487160 496984 501713 494668 503264 497165 518299 468420 489196 495459 476654 483768 496188 503318 482454 total = 131.774883 per ms 00:51:57.043 16 switches: flows: 581978 568778 570189 573748 563175 578869 569161 565892 574384 557041 575971 563607 569782 571411 574948 580260 total = 152.064067 per ms [ Message content over the limit has been removed. ] 00:53:57.250 16 switches: flows: 534445 520832 541889 537951 533910 537954 475775 527611 528334 530706 530316 528054 541990 532379 529430 532384 total = 140.828216 per ms 00:54:57.352 16 switches: flows: 540584 542651 540265 535165 537511 529898 533530 536342 526826 538591 532937 540086 533060 535676 538343 534458 total = 142.690121 per ms 00:55:57.453 16 switches: flows: 498791 537947 543120 541306 543166 537886 538168 545694 545812 533381 543242 539460 529345 545122 542620 535751 total = 143.106893 per ms 00:56:58.274 16 switches: flows: 484956 511244 510609 513639 502005 505316 526077 508299 514243 505092 514089 522892 525443 510674 505569 520499 total = 134.502567 per ms 00:57:58.376 16 switches: flows: 562492 564717 559417 563669 564580 562414 562344 507843 549603 556792 563992 560975 554148 559655 558218 553677 total = 148.160002 per ms 00:58:58.477 16 switches: flows: 560145 561049 564715 561186 573944 573973 566077 572618 564088 557650 566584 571746 561188 556247 567044 562179 total = 150.421609 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.121. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:50:56.942 16 switches: flows: 511783 487160 496984 501713 494668 503264 497165 518299 468420 489196 495459 476654 483768 496188 503318 482454 total = 131.774883 per ms 00:51:57.043 16 switches: flows: 581978 568778 570189 573748 563175 578869 569161 565892 574384 557041 575971 563607 569782 571411 574948 580260 total = 152.064067 per ms [ Message content over the limit has been removed. ] 00:53:57.250 16 switches: flows: 534445 520832 541889 537951 533910 537954 475775 527611 528334 530706 530316 528054 541990 532379 529430 532384 total = 140.828216 per ms 00:54:57.352 16 switches: flows: 540584 542651 540265 535165 537511 529898 533530 536342 526826 538591 532937 540086 533060 535676 538343 534458 total = 142.690121 per ms 00:55:57.453 16 switches: flows: 498791 537947 543120 541306 543166 537886 538168 545694 545812 533381 543242 539460 529345 545122 542620 535751 total = 143.106893 per ms 00:56:58.274 16 switches: flows: 484956 511244 510609 513639 502005 505316 526077 508299 514243 505092 514089 522892 525443 510674 505569 520499 total = 134.502567 per ms 00:57:58.376 16 switches: flows: 562492 564717 559417 563669 564580 562414 562344 507843 549603 556792 563992 560975 554148 559655 558218 553677 total = 148.160002 per ms 00:58:58.477 16 switches: flows: 560145 561049 564715 561186 573944 573973 566077 572618 564088 557650 566584 571746 561188 556247 567044 562179 total = 150.421609 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.121. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:50:56.942 16 switches: flows: 511783 487160 496984 501713 494668 503264 497165 518299 468420 489196 495459 476654 483768 496188 503318 482454 total = 131.774883 per ms 00:51:57.043 16 switches: flows: 581978 568778 570189 573748 563175 578869 569161 565892 574384 557041 575971 563607 569782 571411 574948 580260 total = 152.064067 per ms [ Message content over the limit has been removed. ] 00:53:57.250 16 switches: flows: 534445 520832 541889 537951 533910 537954 475775 527611 528334 530706 530316 528054 541990 532379 529430 532384 total = 140.828216 per ms 00:54:57.352 16 switches: flows: 540584 542651 540265 535165 537511 529898 533530 536342 526826 538591 532937 540086 533060 535676 538343 534458 total = 142.690121 per ms 00:55:57.453 16 switches: flows: 498791 537947 543120 541306 543166 537886 538168 545694 545812 533381 543242 539460 529345 545122 542620 535751 total = 143.106893 per ms 00:56:58.274 16 switches: flows: 484956 511244 510609 513639 502005 505316 526077 508299 514243 505092 514089 522892 525443 510674 505569 520499 total = 134.502567 per ms 00:57:58.376 16 switches: flows: 562492 564717 559417 563669 564580 562414 562344 507843 549603 556792 563992 560975 554148 559655 558218 553677 total = 148.160002 per ms 00:58:58.477 16 switches: flows: 560145 561049 564715 561186 573944 573973 566077 572618 564088 557650 566584 571746 561188 556247 567044 562179 total = 150.421609 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.171.121 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.171.7" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.171.7:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed Aug 26 00:59:23 UTC 2026 System load: 0.2 Processes: 103 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.171.7 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Wed Aug 26 00:49:51 2026 from 10.30.170.106 [?2004h[jenkins@releng-63164-380-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.171.121 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.121. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:00:28.787 16 switches: flows: 118477 104602 106355 105570 105460 104326 104290 106453 103695 104600 103991 103570 102936 102040 101557 104330 total = 28.037533 per ms 01:01:28.888 16 switches: flows: 116236 113241 116333 113905 113923 112910 113627 112156 110779 113338 112040 112372 109708 112304 110706 112999 total = 30.058886 per ms 01:02:28.989 16 switches: flows: 103481 102361 104247 102774 103974 102882 101549 102734 101574 103729 101279 101520 100965 101538 101219 100876 total = 27.232892 per ms 01:03:29.089 16 switches: flows: 113492 114331 115889 116170 115684 116001 115253 115483 114721 113305 112847 111423 110683 112634 114223 112291 total = 30.356482 per ms 01:04:29.189 16 switches: flows: 116573 115450 118275 115461 116994 116342 115729 117752 115279 114860 114590 114141 112822 112581 113993 114227 total = 30.699908 per ms 01:05:29.292 16 switches: flows: 120225 115634 117546 118121 118959 119858 118387 119217 117543 118311 118379 117099 116309 115057 116670 115853 total = 31.332383 per ms 01:06:29.393 16 switches: flows: 120739 116472 118431 118192 120061 120932 118375 119514 118943 119691 118340 117215 117903 115305 116673 115427 total = 31.484262 per ms 01:07:29.493 16 switches: flows: 122460 119090 119396 120137 121092 121723 120169 119976 119800 120928 119547 119196 117056 115396 117395 115324 total = 31.758417 per ms 01:08:29.593 16 switches: flows: 122870 120247 120581 120579 121619 121231 121511 121029 120731 120382 120324 118614 117467 117692 117208 116811 total = 31.928289 per ms 01:09:29.693 16 switches: flows: 124082 120234 124698 121938 122794 122273 123521 123421 122902 120850 122676 120722 119743 118889 118835 119234 total = 32.392789 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 27232.89/32392.79/30804.92/10370.38 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.171.121:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.171.121. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:00:28.787 16 switches: flows: 118477 104602 106355 105570 105460 104326 104290 106453 103695 104600 103991 103570 102936 102040 101557 104330 total = 28.037533 per ms 01:01:28.888 16 switches: flows: 116236 113241 116333 113905 113923 112910 113627 112156 110779 113338 112040 112372 109708 112304 110706 112999 total = 30.058886 per ms 01:02:28.989 16 switches: flows: 103481 102361 104247 102774 103974 102882 101549 102734 101574 103729 101279 101520 100965 101538 101219 100876 total = 27.232892 per ms 01:03:29.089 16 switches: flows: 113492 114331 115889 116170 115684 116001 115253 115483 114721 113305 112847 111423 110683 112634 114223 112291 total = 30.356482 per ms 01:04:29.189 16 switches: flows: 116573 115450 118275 115461 116994 116342 115729 117752 115279 114860 114590 114141 112822 112581 113993 114227 total = 30.699908 per ms 01:05:29.292 16 switches: flows: 120225 115634 117546 118121 118959 119858 118387 119217 117543 118311 118379 117099 116309 115057 116670 115853 total = 31.332383 per ms 01:06:29.393 16 switches: flows: 120739 116472 118431 118192 120061 120932 118375 119514 118943 119691 118340 117215 117903 115305 116673 115427 total = 31.484262 per ms 01:07:29.493 16 switches: flows: 122460 119090 119396 120137 121092 121723 120169 119976 119800 120928 119547 119196 117056 115396 117395 115324 total = 31.758417 per ms 01:08:29.593 16 switches: flows: 122870 120247 120581 120579 121619 121231 121511 121029 120731 120382 120324 118614 117467 117692 117208 116811 total = 31.928289 per ms 01:09:29.693 16 switches: flows: 124082 120234 124698 121938 122794 122273 123521 123421 122902 120850 122676 120722 119743 118889 118835 119234 total = 32.392789 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 27232.89/32392.79/30804.92/10370.38 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 27232.89/32392.79/30804.92/10370.38 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 27232.89/32392.79/30804.92/10370.38 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 27232.89/32392.79/30804.92/10370.38 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 27232.89 | 32392.79 | 30804.92 | 10370.38 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 27232.89 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 32392.79 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 30804.92 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10370.38 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 27232.89 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 32392.79 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 30804.92 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10370.38 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-26 01:09:29 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-26 01:09:29,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,27232.89,32392.79,30804.92,10370.38 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt