Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.115:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.115 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.39:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed Aug 19 00:44:00 UTC 2026 System load: 0.18 Processes: 110 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.39 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-63164-375-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.115:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 0.21.3 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.115 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.115:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.115 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.115 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.39" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.39:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed Aug 19 00:44:00 UTC 2026 System load: 0.18 Processes: 110 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.39 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Wed Aug 19 00:44:30 2026 from 10.30.171.158 [?2004h[jenkins@releng-63164-375-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.115 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.115. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:45:36.281 16 switches: flows: 116179 114462 116394 116385 116967 118088 115619 113306 116674 112547 115693 114533 115663 111245 115312 115120 total = 30.736450 per ms 00:46:36.382 16 switches: flows: 124200 121675 123680 124038 123741 125464 123189 122665 124213 120363 123395 120177 121479 118872 122682 121764 total = 32.638592 per ms 00:47:36.483 16 switches: flows: 108439 107834 108815 107955 107715 109574 108812 108595 108003 106791 109019 104956 105412 105785 107234 105020 total = 28.618185 per ms 00:48:36.584 16 switches: flows: 127233 128537 128007 130790 129517 129854 126312 129775 128675 126021 127355 123813 123553 124005 127077 123216 total = 33.839146 per ms 00:49:36.686 16 switches: flows: 100928 98824 100538 102779 101414 99209 99579 98454 99419 98953 100416 97631 97699 97060 98974 96269 total = 26.424962 per ms 00:50:36.787 16 switches: flows: 132944 131100 130317 131691 132060 129027 131149 133608 129144 125798 130838 126498 125801 128249 129884 127507 total = 34.535908 per ms 00:51:36.888 16 switches: flows: 132378 132618 130011 130750 131457 129301 131523 131746 128743 127525 128507 125793 125722 127044 127927 127169 total = 34.412724 per ms 00:52:36.990 16 switches: flows: 133144 133114 131282 130698 132264 128855 130551 131939 127818 125722 128830 125443 126256 126970 127618 125188 total = 34.370724 per ms 00:53:37.091 16 switches: flows: 134158 132245 131008 132404 134050 129431 132797 132577 129061 125726 130121 126859 126835 129058 127399 127152 total = 34.623540 per ms 00:54:37.191 16 switches: flows: 132489 131923 130647 130470 132575 128939 131329 131284 128493 125964 129360 124522 125286 128708 126660 125653 total = 34.347686 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 26424.96/34623.54/32645.72/11247.54 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.115. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:45:36.281 16 switches: flows: 116179 114462 116394 116385 116967 118088 115619 113306 116674 112547 115693 114533 115663 111245 115312 115120 total = 30.736450 per ms 00:46:36.382 16 switches: flows: 124200 121675 123680 124038 123741 125464 123189 122665 124213 120363 123395 120177 121479 118872 122682 121764 total = 32.638592 per ms 00:47:36.483 16 switches: flows: 108439 107834 108815 107955 107715 109574 108812 108595 108003 106791 109019 104956 105412 105785 107234 105020 total = 28.618185 per ms 00:48:36.584 16 switches: flows: 127233 128537 128007 130790 129517 129854 126312 129775 128675 126021 127355 123813 123553 124005 127077 123216 total = 33.839146 per ms 00:49:36.686 16 switches: flows: 100928 98824 100538 102779 101414 99209 99579 98454 99419 98953 100416 97631 97699 97060 98974 96269 total = 26.424962 per ms 00:50:36.787 16 switches: flows: 132944 131100 130317 131691 132060 129027 131149 133608 129144 125798 130838 126498 125801 128249 129884 127507 total = 34.535908 per ms 00:51:36.888 16 switches: flows: 132378 132618 130011 130750 131457 129301 131523 131746 128743 127525 128507 125793 125722 127044 127927 127169 total = 34.412724 per ms 00:52:36.990 16 switches: flows: 133144 133114 131282 130698 132264 128855 130551 131939 127818 125722 128830 125443 126256 126970 127618 125188 total = 34.370724 per ms 00:53:37.091 16 switches: flows: 134158 132245 131008 132404 134050 129431 132797 132577 129061 125726 130121 126859 126835 129058 127399 127152 total = 34.623540 per ms 00:54:37.191 16 switches: flows: 132489 131923 130647 130470 132575 128939 131329 131284 128493 125964 129360 124522 125286 128708 126660 125653 total = 34.347686 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 26424.96/34623.54/32645.72/11247.54 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 26424.96/34623.54/32645.72/11247.54 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 26424.96/34623.54/32645.72/11247.54 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 26424.96/34623.54/32645.72/11247.54 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 26424.96 | 34623.54 | 32645.72 | 11247.54 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 26424.96 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 34623.54 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 32645.72 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 11247.54 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 26424.96 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 34623.54 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 32645.72 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 11247.54 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-19 00:54:37 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-19 00:54:37,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,26424.96,34623.54,32645.72,11247.54 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.115 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.39" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.39:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed Aug 19 00:54:37 UTC 2026 System load: 1.02 Processes: 105 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.39 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Wed Aug 19 00:44:31 2026 from 10.30.171.158 [?2004h[jenkins@releng-63164-375-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.115 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.115. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:55:42.985 16 switches: flows: 529776 526111 547747 524223 514970 529815 535527 542503 523973 537764 515297 516345 522766 526911 511458 532029 total = 140.620250 per ms 00:56:43.086 16 switches: flows: 475288 469673 482100 446690 491620 438936 484999 474058 450926 482692 466396 449533 472106 478681 463303 470920 total = 124.755887 per ms 00:57:43.309 16 switches: flows: 488850 500323 509389 498751 490491 499198 495407 480386 499506 492133 490614 500416 509408 507976 503752 500190 total = 132.290691 per ms 00:58:43.411 16 switches: flows: 555366 557724 557553 554859 554909 547770 547598 446058 547677 554688 551158 542856 552767 561284 555985 557686 total = 145.519875 per ms 00:59:43.514 16 switches: flows: 532887 528978 530535 537473 538942 531624 537218 544589 538137 533468 536807 538443 530937 536809 535842 533402 total = 142.527933 per ms 01:00:43.616 16 switches: flows: 551749 547790 553387 543117 550986 557830 539300 558094 556325 557737 550146 556365 555741 549401 533956 550545 total = 146.627475 per ms 01:01:43.717 16 switches: flows: 563541 556333 530657 560793 536380 566106 568365 570620 566798 557358 559076 566645 561492 569275 561072 561624 total = 149.018268 per ms 01:02:47.137 16 switches: flows: 508125 503315 494840 503247 494284 496678 492750 498773 495426 415168 487771 499063 497343 505228 491006 489127 total = 124.126800 per ms controller msgbuf_read() = 0: closed connection ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.115. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:55:42.985 16 switches: flows: 529776 526111 547747 524223 514970 529815 535527 542503 523973 537764 515297 516345 522766 526911 511458 532029 total = 140.620250 per ms 00:56:43.086 16 switches: flows: 475288 469673 482100 446690 491620 438936 484999 474058 450926 482692 466396 449533 472106 478681 463303 470920 total = 124.755887 per ms 00:57:43.309 16 switches: flows: 488850 500323 509389 498751 490491 499198 495407 480386 499506 492133 490614 500416 509408 507976 503752 500190 total = 132.290691 per ms 00:58:43.411 16 switches: flows: 555366 557724 557553 554859 554909 547770 547598 446058 547677 554688 551158 542856 552767 561284 555985 557686 total = 145.519875 per ms 00:59:43.514 16 switches: flows: 532887 528978 530535 537473 538942 531624 537218 544589 538137 533468 536807 538443 530937 536809 535842 533402 total = 142.527933 per ms 01:00:43.616 16 switches: flows: 551749 547790 553387 543117 550986 557830 539300 558094 556325 557737 550146 556365 555741 549401 533956 550545 total = 146.627475 per ms 01:01:43.717 16 switches: flows: 563541 556333 530657 560793 536380 566106 568365 570620 566798 557358 559076 566645 561492 569275 561072 561624 total = 149.018268 per ms 01:02:47.137 16 switches: flows: 508125 503315 494840 503247 494284 496678 492750 498773 495426 415168 487771 499063 497343 505228 491006 489127 total = 124.126800 per ms controller msgbuf_read() = 0: closed connection ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.115. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:55:42.985 16 switches: flows: 529776 526111 547747 524223 514970 529815 535527 542503 523973 537764 515297 516345 522766 526911 511458 532029 total = 140.620250 per ms 00:56:43.086 16 switches: flows: 475288 469673 482100 446690 491620 438936 484999 474058 450926 482692 466396 449533 472106 478681 463303 470920 total = 124.755887 per ms 00:57:43.309 16 switches: flows: 488850 500323 509389 498751 490491 499198 495407 480386 499506 492133 490614 500416 509408 507976 503752 500190 total = 132.290691 per ms 00:58:43.411 16 switches: flows: 555366 557724 557553 554859 554909 547770 547598 446058 547677 554688 551158 542856 552767 561284 555985 557686 total = 145.519875 per ms 00:59:43.514 16 switches: flows: 532887 528978 530535 537473 538942 531624 537218 544589 538137 533468 536807 538443 530937 536809 535842 533402 total = 142.527933 per ms 01:00:43.616 16 switches: flows: 551749 547790 553387 543117 550986 557830 539300 558094 556325 557737 550146 556365 555741 549401 533956 550545 total = 146.627475 per ms 01:01:43.717 16 switches: flows: 563541 556333 530657 560793 536380 566106 568365 570620 566798 557358 559076 566645 561492 569275 561072 561624 total = 149.018268 per ms 01:02:47.137 16 switches: flows: 508125 503315 494840 503247 494284 496678 492750 498773 495426 415168 487771 499063 497343 505228 491006 489127 total = 124.126800 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.115. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:55:42.985 16 switches: flows: 529776 526111 547747 524223 514970 529815 535527 542503 523973 537764 515297 516345 522766 526911 511458 532029 total = 140.620250 per ms 00:56:43.086 16 switches: flows: 475288 469673 482100 446690 491620 438936 484999 474058 450926 482692 466396 449533 472106 478681 463303 470920 total = 124.755887 per ms 00:57:43.309 16 switches: flows: 488850 500323 509389 498751 490491 499198 495407 480386 499506 492133 490614 500416 509408 507976 503752 500190 total = 132.290691 per ms 00:58:43.411 16 switches: flows: 555366 557724 557553 554859 554909 547770 547598 446058 547677 554688 551158 542856 552767 561284 555985 557686 total = 145.519875 per ms 00:59:43.514 16 switches: flows: 532887 528978 530535 537473 538942 531624 537218 544589 538137 533468 536807 538443 530937 536809 535842 533402 total = 142.527933 per ms 01:00:43.616 16 switches: flows: 551749 547790 553387 543117 550986 557830 539300 558094 556325 557737 550146 556365 555741 549401 533956 550545 total = 146.627475 per ms 01:01:43.717 16 switches: flows: 563541 556333 530657 560793 536380 566106 568365 570620 566798 557358 559076 566645 561492 569275 561072 561624 total = 149.018268 per ms 01:02:47.137 16 switches: flows: 508125 503315 494840 503247 494284 496678 492750 498773 495426 415168 487771 499063 497343 505228 491006 489127 total = 124.126800 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.115. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:55:42.985 16 switches: flows: 529776 526111 547747 524223 514970 529815 535527 542503 523973 537764 515297 516345 522766 526911 511458 532029 total = 140.620250 per ms 00:56:43.086 16 switches: flows: 475288 469673 482100 446690 491620 438936 484999 474058 450926 482692 466396 449533 472106 478681 463303 470920 total = 124.755887 per ms 00:57:43.309 16 switches: flows: 488850 500323 509389 498751 490491 499198 495407 480386 499506 492133 490614 500416 509408 507976 503752 500190 total = 132.290691 per ms 00:58:43.411 16 switches: flows: 555366 557724 557553 554859 554909 547770 547598 446058 547677 554688 551158 542856 552767 561284 555985 557686 total = 145.519875 per ms 00:59:43.514 16 switches: flows: 532887 528978 530535 537473 538942 531624 537218 544589 538137 533468 536807 538443 530937 536809 535842 533402 total = 142.527933 per ms 01:00:43.616 16 switches: flows: 551749 547790 553387 543117 550986 557830 539300 558094 556325 557737 550146 556365 555741 549401 533956 550545 total = 146.627475 per ms 01:01:43.717 16 switches: flows: 563541 556333 530657 560793 536380 566106 568365 570620 566798 557358 559076 566645 561492 569275 561072 561624 total = 149.018268 per ms 01:02:47.137 16 switches: flows: 508125 503315 494840 503247 494284 496678 492750 498773 495426 415168 487771 499063 497343 505228 491006 489127 total = 124.126800 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.115. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 00:55:42.985 16 switches: flows: 529776 526111 547747 524223 514970 529815 535527 542503 523973 537764 515297 516345 522766 526911 511458 532029 total = 140.620250 per ms 00:56:43.086 16 switches: flows: 475288 469673 482100 446690 491620 438936 484999 474058 450926 482692 466396 449533 472106 478681 463303 470920 total = 124.755887 per ms 00:57:43.309 16 switches: flows: 488850 500323 509389 498751 490491 499198 495407 480386 499506 492133 490614 500416 509408 507976 503752 500190 total = 132.290691 per ms 00:58:43.411 16 switches: flows: 555366 557724 557553 554859 554909 547770 547598 446058 547677 554688 551158 542856 552767 561284 555985 557686 total = 145.519875 per ms 00:59:43.514 16 switches: flows: 532887 528978 530535 537473 538942 531624 537218 544589 538137 533468 536807 538443 530937 536809 535842 533402 total = 142.527933 per ms 01:00:43.616 16 switches: flows: 551749 547790 553387 543117 550986 557830 539300 558094 556325 557737 550146 556365 555741 549401 533956 550545 total = 146.627475 per ms 01:01:43.717 16 switches: flows: 563541 556333 530657 560793 536380 566106 568365 570620 566798 557358 559076 566645 561492 569275 561072 561624 total = 149.018268 per ms 01:02:47.137 16 switches: flows: 508125 503315 494840 503247 494284 496678 492750 498773 495426 415168 487771 499063 497343 505228 491006 489127 total = 124.126800 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.115 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.39" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.39:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-186-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Wed Aug 19 01:03:06 UTC 2026 System load: 0.46 Processes: 105 Usage of /: 19.7% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.39 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 14 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Wed Aug 19 00:54:37 2026 from 10.30.171.158 [?2004h[jenkins@releng-63164-375-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.115 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.115. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:04:11.561 16 switches: flows: 119038 121259 121398 119498 118582 121735 116058 119716 123162 119594 119964 128214 116831 120182 118059 116189 total = 31.991317 per ms 01:05:11.661 16 switches: flows: 126256 126286 125476 124595 122754 123580 121385 122069 121721 121318 122981 120224 121272 120424 120435 118627 total = 32.602307 per ms 01:06:11.761 16 switches: flows: 131089 133128 131967 130215 129665 130179 126978 129263 130095 128786 125575 124747 126432 125128 127491 124749 total = 34.201024 per ms 01:07:11.862 16 switches: flows: 123896 123936 124152 120928 120965 119847 119590 121977 120326 120850 119774 117942 118889 116277 118701 118306 total = 32.052400 per ms 01:08:11.962 16 switches: flows: 102221 102215 102501 101427 101194 102983 100482 101157 99771 101295 100118 99034 100602 100573 99405 97647 total = 26.832244 per ms 01:09:12.062 16 switches: flows: 131508 128304 129633 130492 128157 130110 125119 126540 127621 128891 129748 123254 124022 125465 127720 124858 total = 33.967323 per ms 01:10:12.163 16 switches: flows: 108261 108724 106189 108301 105911 107540 106486 107520 105298 106121 105881 102822 106076 104965 103434 104112 total = 28.246835 per ms 01:11:12.263 16 switches: flows: 106435 105449 107430 104830 104361 106324 105420 105859 104641 102328 103972 100868 101833 103605 103756 102355 total = 27.778034 per ms 01:12:12.363 16 switches: flows: 131375 133854 133031 131363 132204 132954 129191 131141 132446 129200 128587 128260 129543 129311 131372 126263 total = 34.776839 per ms 01:13:12.464 16 switches: flows: 122955 123376 123897 121282 120976 122941 119708 122254 123320 119053 118834 117305 118840 118307 120177 118224 total = 32.137153 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 26832.24/34776.84/31399.35/10842.81 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.115:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.115. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 01:04:11.561 16 switches: flows: 119038 121259 121398 119498 118582 121735 116058 119716 123162 119594 119964 128214 116831 120182 118059 116189 total = 31.991317 per ms 01:05:11.661 16 switches: flows: 126256 126286 125476 124595 122754 123580 121385 122069 121721 121318 122981 120224 121272 120424 120435 118627 total = 32.602307 per ms 01:06:11.761 16 switches: flows: 131089 133128 131967 130215 129665 130179 126978 129263 130095 128786 125575 124747 126432 125128 127491 124749 total = 34.201024 per ms 01:07:11.862 16 switches: flows: 123896 123936 124152 120928 120965 119847 119590 121977 120326 120850 119774 117942 118889 116277 118701 118306 total = 32.052400 per ms 01:08:11.962 16 switches: flows: 102221 102215 102501 101427 101194 102983 100482 101157 99771 101295 100118 99034 100602 100573 99405 97647 total = 26.832244 per ms 01:09:12.062 16 switches: flows: 131508 128304 129633 130492 128157 130110 125119 126540 127621 128891 129748 123254 124022 125465 127720 124858 total = 33.967323 per ms 01:10:12.163 16 switches: flows: 108261 108724 106189 108301 105911 107540 106486 107520 105298 106121 105881 102822 106076 104965 103434 104112 total = 28.246835 per ms 01:11:12.263 16 switches: flows: 106435 105449 107430 104830 104361 106324 105420 105859 104641 102328 103972 100868 101833 103605 103756 102355 total = 27.778034 per ms 01:12:12.363 16 switches: flows: 131375 133854 133031 131363 132204 132954 129191 131141 132446 129200 128587 128260 129543 129311 131372 126263 total = 34.776839 per ms 01:13:12.464 16 switches: flows: 122955 123376 123897 121282 120976 122941 119708 122254 123320 119053 118834 117305 118840 118307 120177 118224 total = 32.137153 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 26832.24/34776.84/31399.35/10842.81 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 26832.24/34776.84/31399.35/10842.81 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 26832.24/34776.84/31399.35/10842.81 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 26832.24/34776.84/31399.35/10842.81 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 26832.24 | 34776.84 | 31399.35 | 10842.81 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 26832.24 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 34776.84 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 31399.35 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 10842.81 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 26832.24 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 34776.84 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 31399.35 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 10842.81 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-08-19 01:13:12 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-08-19 01:13:12,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,26832.24,34776.84,31399.35,10842.81 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-vanadium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt