Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.209:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>log:set ERROR ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} log:set ${log_level} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.209 Note that this keyword will open&close new SSH connection, without switching back to previously current session. 3x 1s KarafKeywords.Issue Command On Karaf Console log:set ${log_level} Runs the specified keyword and retries if it fails. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-chromium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-chromium/latency.csv</a>'. ${latency_results_file} LATENCY_MIN,LATENCY_MAX,LATENCY_AVERAGE\n Appends the given content to the specified file. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-chromium/throughput.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-chromium/throughput.csv</a>'. ${throughput_results_file} THROUGHPUT_MIN,THROUGHPUT_MAX,THROUGHPUT_AVERAGE\n Appends the given content to the specified file. ${duration_in_ms} = 60000 ${duration_in_ms} ${duration_in_secs} * 1000 Evaluates the given expression in Python and returns the result. ${duration_in_ms} = 60000 ${duration_in_ms} Makes a variable available everywhere within the scope of the current suite. ${test_timeout} = 900.0 ${test_timeout} (${loops} * ${duration_in_secs}) * 1.5 Evaluates the given expression in Python and returns the result. ${test_timeout} = 900.0 ${test_timeout} Makes a variable available everywhere within the scope of the current suite. ${cbench_executable} Fails unless the given ``path`` points to an existing file. ${conn_id} = 2 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.146:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Fri Jul 24 06:25:52 UTC 2026 System load: 0.11 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.146 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-00446-35-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. [chan 1] Opened sftp connection (server version 3) ${file} Fails if the given ``path`` does NOT point to an existing file. Closes the current connection. ${cbench_system} ${cbench_executable} Will create connection with public key and will PASS if the given ${file} exists, otherwise will FAIL ${loops} >= 2 If number of loops is less than 2, cbench will not run Fails if the given condition is not true. Not A Karaf App Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.209:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>feature:list -i | 0[C 0g[Krep odl-openflowplugin-drop-test ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 1.0.0 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 1.0.0 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 1.0.0 x x x Started x [31;1modl-openflowplugin-drop-test[0m x OpenDaylight :: Openflow Plugin :: Drop Test [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} ${output} = [?1l>[?2004l[31;1modl-openflowplugin-drop-test[0m x 1.0.0 x x x Started x [31;1modl-openflowplugin-drop-test[0m ... ${output} feature:list -i | grep ${feature_name} ${controller} ${karaf_port} Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.209 Note that this keyword will open&close new SSH connection, without switching back to previously current session. ${output} ${feature_name} Fails if ``container`` does not contain ``item`` one or more times. ${output} odl-openflowplugin-drop-test Will Succeed if the given ${feature_name} is found in the output of "feature:list -i" Not A Karaf App ${controller} port=${karaf_port} prompt=${KARAF_PROMPT_LOGIN} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Logging into '10.30.170.209:8101' as 'karaf'. Read output: [33m [33m ________ ________ .__ .__ .__ __ [33m \_____ \ ______ ____ ____ \______ \ _____ ___.__.| | |__| ____ | |___/ |_ [33m / | \\____ \_/ __ \ / \ | | \\__ \< | || | | |/ ___\| | \ __\ [33m / | \ |_> > ___/| | \| ` \/ __ \\___ || |_| / /_/ > Y \ | [33m \_______ / __/ \___ >___| /_______ (____ / ____||____/__\___ /|___| /__| [33m \/|__| \/ \/ \/ \/\/ /_____/ \/ [33m Hit '[1m<tab>[0m' for a list of available commands and '[1m[cmd] --help[0m' for help on a specific command. Hit '[1m<ctrl-d>[0m' or type '[1msystem:shutdown[0m' or '[1mlogout[0m' to shutdown OpenDaylight. [?1h=[90m~[0m [?2004hopendaylight-user ${KARAF_USER} ${KARAF_PASSWORD} loglevel=${loglevel} Logs into the SSH server with the given ``username`` and ``password``. @root>dropallpacketsrpc on ${cmd} Writes the given ``text`` on the remote machine and appends a newline. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} = [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} ${KARAF_PROMPT} Consumes and returns the server output until a match to ``regexp`` is found. logout\n Writes the given ``text`` on the remote machine without appending a newline. Closes the current connection. [?1l>[?2004lDropAllFlows transitions to on [?1h=[90m~[0m [?2004hopendaylight-user@root> ${output} Logs the given message with the given level. ${output} dropallpacketsrpc on Will execute the given ${cmd} by ssh'ing to the karaf console running on 10.30.170.209 Note that this keyword will open&close new SSH connection, without switching back to previously current session. Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = latency.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.209 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.146" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 5 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.146:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Fri Jul 24 06:25:52 UTC 2026 System load: 0.11 Processes: 111 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.146 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Fri Jul 24 06:25:52 2026 from 10.30.170.247 [?2004h[jenkins@releng-00446-35-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.209 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.209. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 06:26:58.642 16 switches: flows: 55170 67857 68138 67026 65636 64468 68984 67785 68240 64390 66113 66750 63836 63026 67498 65820 total = 17.512283 per ms 06:27:58.743 16 switches: flows: 98003 96476 98214 96961 97629 97750 95197 95661 93993 91001 94580 96266 90915 93529 92047 93676 total = 25.322690 per ms 06:28:58.843 16 switches: flows: 107232 106342 105520 105688 105177 104914 106026 101882 99445 101636 102496 101719 102125 100893 102841 102133 total = 27.555093 per ms 06:29:58.943 16 switches: flows: 110365 107462 108869 110145 108308 108037 108936 104947 104232 104714 104682 104791 104609 103872 105823 106091 total = 28.383974 per ms 06:30:59.044 16 switches: flows: 100647 99501 98472 100451 98738 101258 99916 97285 96221 97800 97012 91970 95949 94487 96695 96144 total = 25.998997 per ms 06:31:59.144 16 switches: flows: 86821 85874 86015 86706 85327 85649 85491 85979 84919 83275 84212 83613 81043 82955 83219 83653 total = 22.541566 per ms 06:32:59.244 16 switches: flows: 70690 69816 70798 71129 69785 69936 70238 68290 65800 67454 68716 69246 67588 67322 67734 67784 total = 18.341472 per ms 06:33:59.345 16 switches: flows: 74488 75612 73977 75746 73984 75566 73846 73635 72243 72191 72765 72796 71274 71312 72990 73239 total = 19.561663 per ms 06:34:59.445 16 switches: flows: 102903 103563 103544 104584 101248 102337 104091 100806 98133 98270 98821 100342 98168 100194 99616 99104 total = 26.883798 per ms 06:35:59.545 16 switches: flows: 106649 107408 106277 105842 103715 106011 105447 103805 99095 101587 101761 103570 100180 102983 100932 102620 total = 27.585285 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 18341.47/28383.97/24686.06/8930.50 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.209. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 06:26:58.642 16 switches: flows: 55170 67857 68138 67026 65636 64468 68984 67785 68240 64390 66113 66750 63836 63026 67498 65820 total = 17.512283 per ms 06:27:58.743 16 switches: flows: 98003 96476 98214 96961 97629 97750 95197 95661 93993 91001 94580 96266 90915 93529 92047 93676 total = 25.322690 per ms 06:28:58.843 16 switches: flows: 107232 106342 105520 105688 105177 104914 106026 101882 99445 101636 102496 101719 102125 100893 102841 102133 total = 27.555093 per ms 06:29:58.943 16 switches: flows: 110365 107462 108869 110145 108308 108037 108936 104947 104232 104714 104682 104791 104609 103872 105823 106091 total = 28.383974 per ms 06:30:59.044 16 switches: flows: 100647 99501 98472 100451 98738 101258 99916 97285 96221 97800 97012 91970 95949 94487 96695 96144 total = 25.998997 per ms 06:31:59.144 16 switches: flows: 86821 85874 86015 86706 85327 85649 85491 85979 84919 83275 84212 83613 81043 82955 83219 83653 total = 22.541566 per ms 06:32:59.244 16 switches: flows: 70690 69816 70798 71129 69785 69936 70238 68290 65800 67454 68716 69246 67588 67322 67734 67784 total = 18.341472 per ms 06:33:59.345 16 switches: flows: 74488 75612 73977 75746 73984 75566 73846 73635 72243 72191 72765 72796 71274 71312 72990 73239 total = 19.561663 per ms 06:34:59.445 16 switches: flows: 102903 103563 103544 104584 101248 102337 104091 100806 98133 98270 98821 100342 98168 100194 99616 99104 total = 26.883798 per ms 06:35:59.545 16 switches: flows: 106649 107408 106277 105842 103715 106011 105447 103805 99095 101587 101761 103570 100180 102983 100932 102620 total = 27.585285 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 18341.47/28383.97/24686.06/8930.50 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 18341.47/28383.97/24686.06/8930.50 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 18341.47/28383.97/24686.06/8930.50 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 18341.47/28383.97/24686.06/8930.50 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 18341.47 | 28383.97 | 24686.06 | 8930.50 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 18341.47 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 28383.97 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 24686.06 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 8930.50 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 18341.47 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 28383.97 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 24686.06 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 8930.50 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-07-24 06:35:59 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-07-24 06:35:59,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,18341.47,28383.97,24686.06,8930.50 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-chromium/latency.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-chromium/latency.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} ${latency_results_file} Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in default latency mode. Test parameters have defaults, but can be overridden on the pybot command line cbench latency Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = throughput.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.209 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.146" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 7 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.146:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Fri Jul 24 06:35:59 UTC 2026 System load: 1.05 Processes: 104 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 4% IPv4 address for ens3: 10.30.170.146 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Fri Jul 24 06:25:53 2026 from 10.30.170.247 [?2004h[jenkins@releng-00446-35-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.209 -t -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 1. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.209. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 06:37:08.280 16 switches: flows: 369996 306625 367469 356414 361862 372875 359985 359210 360487 363163 344749 362807 327696 370717 355247 346849 total = 94.769183 per ms 06:38:08.383 16 switches: flows: 307152 316758 300553 294503 308865 302204 298274 93931 309562 298062 315680 293440 303322 309741 299307 300003 total = 77.391378 per ms 06:39:08.484 16 switches: flows: 409569 419886 416101 420550 411303 432994 417251 428944 418626 416726 423431 415384 389891 403946 420555 429583 total = 111.057546 per ms 06:40:08.587 16 switches: flows: 536217 537276 536502 540585 526397 537626 538152 545580 539761 542177 540170 535873 536929 524800 537813 533936 total = 142.919865 per ms 06:41:08.688 16 switches: flows: 561992 540625 564789 564615 546301 546648 550218 544347 538383 571576 549751 553973 561971 552476 538446 554504 total = 147.095228 per ms 06:42:08.789 16 switches: flows: 431372 432587 408935 419095 419346 383517 336666 432264 417194 423381 426092 427510 420939 431157 439319 415660 total = 110.897782 per ms 06:43:08.890 16 switches: flows: 454070 458164 407991 414349 447384 448109 452350 452959 430630 403278 396895 431903 449417 396138 376737 424648 total = 113.892016 per ms 06:44:08.993 16 switches: flows: 433201 438179 442942 438606 372651 420453 430164 441915 438392 437097 415179 374093 444912 427166 415933 425718 total = 113.083358 per ms 06:45:28.913 16 switches: flows: 369751 363182 391101 369197 354825 391899 366843 360426 388212 395128 366553 386414 366570 375787 370705 367276 total = 74.872857 per ms controller msgbuf_read() = 0: closed connection ... exiting ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.209. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 06:37:08.280 16 switches: flows: 369996 306625 367469 356414 361862 372875 359985 359210 360487 363163 344749 362807 327696 370717 355247 346849 total = 94.769183 per ms 06:38:08.383 16 switches: flows: 307152 316758 300553 294503 308865 302204 298274 93931 309562 298062 315680 293440 303322 309741 299307 300003 total = 77.391378 per ms 06:39:08.484 16 switches: flows: 409569 419886 416101 420550 411303 432994 417251 428944 418626 416726 423431 415384 389891 403946 420555 429583 total = 111.057546 per ms 06:40:08.587 16 switches: flows: 536217 537276 536502 540585 526397 537626 538152 545580 539761 542177 540170 535873 536929 524800 537813 533936 total = 142.919865 per ms 06:41:08.688 16 switches: flows: 561992 540625 564789 564615 546301 546648 550218 544347 538383 571576 549751 553973 561971 552476 538446 554504 total = 147.095228 per ms 06:42:08.789 16 switches: flows: 431372 432587 408935 419095 419346 383517 336666 432264 417194 423381 426092 427510 420939 431157 439319 415660 total = 110.897782 per ms 06:43:08.890 16 switches: flows: 454070 458164 407991 414349 447384 448109 452350 452959 430630 403278 396895 431903 449417 396138 376737 424648 total = 113.892016 per ms 06:44:08.993 16 switches: flows: 433201 438179 442942 438606 372651 420453 430164 441915 438392 437097 415179 374093 444912 427166 415933 425718 total = 113.083358 per ms 06:45:28.913 16 switches: flows: 369751 363182 391101 369197 354825 391899 366843 360426 388212 395128 366553 386414 366570 375787 370705 367276 total = 74.872857 per ms controller msgbuf_read() = 0: closed connection ... exiting ${output} Logs the given message with the given level. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.209. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 06:37:08.280 16 switches: flows: 369996 306625 367469 356414 361862 372875 359985 359210 360487 363163 344749 362807 327696 370717 355247 346849 total = 94.769183 per ms 06:38:08.383 16 switches: flows: 307152 316758 300553 294503 308865 302204 298274 93931 309562 298062 315680 293440 303322 309741 299307 300003 total = 77.391378 per ms 06:39:08.484 16 switches: flows: 409569 419886 416101 420550 411303 432994 417251 428944 418626 416726 423431 415384 389891 403946 420555 429583 total = 111.057546 per ms 06:40:08.587 16 switches: flows: 536217 537276 536502 540585 526397 537626 538152 545580 539761 542177 540170 535873 536929 524800 537813 533936 total = 142.919865 per ms 06:41:08.688 16 switches: flows: 561992 540625 564789 564615 546301 546648 550218 544347 538383 571576 549751 553973 561971 552476 538446 554504 total = 147.095228 per ms 06:42:08.789 16 switches: flows: 431372 432587 408935 419095 419346 383517 336666 432264 417194 423381 426092 427510 420939 431157 439319 415660 total = 110.897782 per ms 06:43:08.890 16 switches: flows: 454070 458164 407991 414349 447384 448109 452350 452959 430630 403278 396895 431903 449417 396138 376737 424648 total = 113.892016 per ms 06:44:08.993 16 switches: flows: 433201 438179 442942 438606 372651 420453 430164 441915 438392 437097 415179 374093 444912 427166 415933 425718 total = 113.083358 per ms 06:45:28.913 16 switches: flows: 369751 363182 391101 369197 354825 391899 366843 360426 388212 395128 366553 386414 366570 375787 370705 367276 total = 74.872857 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.209. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 06:37:08.280 16 switches: flows: 369996 306625 367469 356414 361862 372875 359985 359210 360487 363163 344749 362807 327696 370717 355247 346849 total = 94.769183 per ms 06:38:08.383 16 switches: flows: 307152 316758 300553 294503 308865 302204 298274 93931 309562 298062 315680 293440 303322 309741 299307 300003 total = 77.391378 per ms [ Message content over the limit has been removed. ] 06:40:08.587 16 switches: flows: 536217 537276 536502 540585 526397 537626 538152 545580 539761 542177 540170 535873 536929 524800 537813 533936 total = 142.919865 per ms 06:41:08.688 16 switches: flows: 561992 540625 564789 564615 546301 546648 550218 544347 538383 571576 549751 553973 561971 552476 538446 554504 total = 147.095228 per ms 06:42:08.789 16 switches: flows: 431372 432587 408935 419095 419346 383517 336666 432264 417194 423381 426092 427510 420939 431157 439319 415660 total = 110.897782 per ms 06:43:08.890 16 switches: flows: 454070 458164 407991 414349 447384 448109 452350 452959 430630 403278 396895 431903 449417 396138 376737 424648 total = 113.892016 per ms 06:44:08.993 16 switches: flows: 433201 438179 442942 438606 372651 420453 430164 441915 438392 437097 415179 374093 444912 427166 415933 425718 total = 113.083358 per ms 06:45:28.913 16 switches: flows: 369751 363182 391101 369197 354825 391899 366843 360426 388212 395128 366553 386414 366570 375787 370705 367276 total = 74.872857 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. ${results_list[5]} Logs the given message with the given level. ${results_list[7]} Logs the given message with the given level. @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. ${i} 0 ${num_stats} ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} d,m,s Returns the given time in the requested format. CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. ${min} ${max} ${average} ${average_threshold} ${output_filename} -t -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${throughput_threshold} ${throughput_results_file} 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.209. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 06:37:08.280 16 switches: flows: 369996 306625 367469 356414 361862 372875 359985 359210 360487 363163 344749 362807 327696 370717 355247 346849 total = 94.769183 per ms 06:38:08.383 16 switches: flows: 307152 316758 300553 294503 308865 302204 298274 93931 309562 298062 315680 293440 303322 309741 299307 300003 total = 77.391378 per ms [ Message content over the limit has been removed. ] 06:40:08.587 16 switches: flows: 536217 537276 536502 540585 526397 537626 538152 545580 539761 542177 540170 535873 536929 524800 537813 533936 total = 142.919865 per ms 06:41:08.688 16 switches: flows: 561992 540625 564789 564615 546301 546648 550218 544347 538383 571576 549751 553973 561971 552476 538446 554504 total = 147.095228 per ms 06:42:08.789 16 switches: flows: 431372 432587 408935 419095 419346 383517 336666 432264 417194 423381 426092 427510 420939 431157 439319 415660 total = 110.897782 per ms 06:43:08.890 16 switches: flows: 454070 458164 407991 414349 447384 448109 452350 452959 430630 403278 396895 431903 449417 396138 376737 424648 total = 113.892016 per ms 06:44:08.993 16 switches: flows: 433201 438179 442942 438606 372651 420453 430164 441915 438392 437097 415179 374093 444912 427166 415933 425718 total = 113.083358 per ms 06:45:28.913 16 switches: flows: 369751 363182 391101 369197 354825 391899 366843 360426 388212 395128 366553 386414 366570 375787 370705 367276 total = 74.872857 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' ${test_delay} Pauses the test executed for the given time. Log Results And Determine Status 0 0 0 0 ${output_filename} Runs the given keyword if either a test or a keyword timeout has occurred. cbench executed in throughput mode (-t). Test parameters have defaults, but can be overridden on the pybot command line cbench throughput 'cbench: controller benchmarking tool running in mode 'throughput' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.209. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 06:37:08.280 16 switches: flows: 369996 306625 367469 356414 361862 372875 359985 359210 360487 363163 344749 362807 327696 370717 355247 346849 total = 94.769183 per ms 06:38:08.383 16 switches: flows: 307152 316758 300553 294503 308865 302204 298274 93931 309562 298062 315680 293440 303322 309741 299307 300003 total = 77.391378 per ms [ Message content over the limit has been removed. ] 06:40:08.587 16 switches: flows: 536217 537276 536502 540585 526397 537626 538152 545580 539761 542177 540170 535873 536929 524800 537813 533936 total = 142.919865 per ms 06:41:08.688 16 switches: flows: 561992 540625 564789 564615 546301 546648 550218 544347 538383 571576 549751 553973 561971 552476 538446 554504 total = 147.095228 per ms 06:42:08.789 16 switches: flows: 431372 432587 408935 419095 419346 383517 336666 432264 417194 423381 426092 427510 420939 431157 439319 415660 total = 110.897782 per ms 06:43:08.890 16 switches: flows: 454070 458164 407991 414349 447384 448109 452350 452959 430630 403278 396895 431903 449417 396138 376737 424648 total = 113.892016 per ms 06:44:08.993 16 switches: flows: 433201 438179 442942 438606 372651 420453 430164 441915 438392 437097 415179 374093 444912 427166 415933 425718 total = 113.083358 per ms 06:45:28.913 16 switches: flows: 369751 363182 391101 369197 354825 391899 366843 360426 388212 395128 366553 386414 366570 375787 370705 367276 total = 74.872857 per ms controller msgbuf_read() = 0: closed connection ... exiting' does not contain 'RESULT' Cbench tests using 10 iterations of 60 second tests. Switch Count: 16. Unique MACS to cycle: 100 Cbench tests using ${loops} iterations of ${duration_in_secs} second tests. Switch Count: ${switch_count}. Unique MACS to cycle: ${num_of_unique_macs} Logs the given message with the given level. ${output_filename} = bug.csv ${output_filename} Makes a variable available everywhere within the scope of the current suite. ${output} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} _This keyword is considered deprecated. Use the [http://robotframework.org/robotframework/latest/libraries/Process.html| Process] library instead._ At least one of {return_stdout} or {return_stderr} args should be set to True Fails the test with the given message and optionally alters its tags. index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=None host=None alias=None port=22 timeout=3 seconds newline= prompt=None term_type=vt100 width=80 height=24 path_separator=/ encoding=utf8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. Attempting to execute command "/usr/local/bin/cbench -c 10.30.170.209 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633" on remote system "10.30.170.146" by user "jenkins" with keyfile pass "any" and prompt ">" and password "" Attempting to execute command "${cmd}" on remote system "${system}" by user "${user}" with keyfile pass "${keyfile_pass}" and prompt "${prompt}" and password "${password}" Logs the given message with the given level. ${conn_id} = 9 ${conn_id} ${system} prompt=${prompt} timeout=${prompt_timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.146:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-153-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Fri Jul 24 06:45:29 UTC 2026 System load: 0.18 Processes: 104 Usage of /: 19.3% of 38.58GB Users logged in: 0 Memory usage: 5% IPv4 address for ens3: 10.30.170.146 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 9 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Fri Jul 24 06:36:00 2026 from 10.30.170.247 [?2004h[jenkins@releng-00446-35-1-mininet-ovs-217-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${user} ${password} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Executing command '/usr/local/bin/cbench -c 10.30.170.209 -m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633'. Command exited with return code 0. ${stdout} = ${stderr} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${stdout} ${stderr} ${cmd} return_stderr=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.209. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 06:46:34.641 16 switches: flows: 84069 84224 85072 83640 83118 82689 82261 82019 81556 82539 80915 79697 81742 81307 80812 81998 total = 21.960967 per ms 06:47:34.742 16 switches: flows: 111289 108546 111645 111300 106432 106573 109279 107557 108141 105677 103693 104240 107611 104227 105454 106611 total = 28.590191 per ms 06:48:34.844 16 switches: flows: 111661 109593 111862 110252 106426 108642 109401 106890 108488 107623 107033 104228 107621 106719 106102 106792 total = 28.773896 per ms 06:49:34.945 16 switches: flows: 101080 101719 102294 101981 98291 100977 101019 100205 99866 98688 97531 97259 98717 97866 98454 98976 total = 26.537756 per ms 06:50:35.046 16 switches: flows: 66085 66248 67024 65770 62685 55848 65024 64119 63687 63304 64380 62479 63606 64485 62225 63812 total = 16.984563 per ms 06:51:35.147 16 switches: flows: 102867 100730 101727 100141 98806 99472 99742 97706 97721 98033 97140 96422 98024 96261 96919 96985 total = 26.267740 per ms 06:52:35.249 16 switches: flows: 100626 101906 101037 99595 99262 100277 100144 99051 97776 97899 96399 97448 98110 97031 95462 97006 total = 26.273268 per ms 06:53:35.350 16 switches: flows: 96002 94330 95323 95038 91589 94082 93562 92597 91475 91702 91368 90036 92259 92367 90371 90627 total = 24.670935 per ms 06:54:35.451 16 switches: flows: 94553 94884 96517 95371 92978 92098 94198 92978 91165 91894 90710 89593 92800 89771 91261 91768 total = 24.667591 per ms 06:55:35.553 16 switches: flows: 116003 115804 115866 116375 113365 114009 115859 113735 113556 114146 111207 109735 111916 113214 114128 111729 total = 30.293519 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 16984.56/30293.52/25895.50/9360.51 responses/s ${stderr} Logs the given message with the given level. ${stderr} ${stdout} ${stdout} ${stderr} ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. ${output} = cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 10... ${output} ${cbench_system} ${cbench_executable} -c ${ODL_SYSTEM_IP} ${cbench_args} prompt_timeout=${test_timeout} return_stdout=False return_stderr=True Reduces the common work of running a command on a remote system to a single higher level robot keyword, taking care to log in with a public key and. The command given is written and the return value depends on the passed argument values of return_stdout (default: True) and return_stderr (default: False). At least one should be True, or the keyword will exit and FAIL. If both are True, the resulting return value will be a two element list containing both. Otherwise the resulting return value is a string. No test conditions are checked. cbench: controller benchmarking tool running in mode 'latency' connecting to controller at 10.30.170.209:6633 faking 16 switches with 1 threads :: 10 tests each; 60000 ms per test with 100 unique source MACs per switch learning destination mac addresses before the test starting test with 5000 ms delay after features_reply ignoring first 1 "warmup" and last 0 "cooldown" loops debugging info is off Master Thread: Creating thread-0! Thread-0: All switches initialized. Running at node 10.30.170.209. So far 1 cbench instances have initialized their switches. Waiting for other cbench-instances Thread-0: Total switches from ALL cbench-instances initialized. 06:46:34.641 16 switches: flows: 84069 84224 85072 83640 83118 82689 82261 82019 81556 82539 80915 79697 81742 81307 80812 81998 total = 21.960967 per ms 06:47:34.742 16 switches: flows: 111289 108546 111645 111300 106432 106573 109279 107557 108141 105677 103693 104240 107611 104227 105454 106611 total = 28.590191 per ms 06:48:34.844 16 switches: flows: 111661 109593 111862 110252 106426 108642 109401 106890 108488 107623 107033 104228 107621 106719 106102 106792 total = 28.773896 per ms 06:49:34.945 16 switches: flows: 101080 101719 102294 101981 98291 100977 101019 100205 99866 98688 97531 97259 98717 97866 98454 98976 total = 26.537756 per ms 06:50:35.046 16 switches: flows: 66085 66248 67024 65770 62685 55848 65024 64119 63687 63304 64380 62479 63606 64485 62225 63812 total = 16.984563 per ms 06:51:35.147 16 switches: flows: 102867 100730 101727 100141 98806 99472 99742 97706 97721 98033 97140 96422 98024 96261 96919 96985 total = 26.267740 per ms 06:52:35.249 16 switches: flows: 100626 101906 101037 99595 99262 100277 100144 99051 97776 97899 96399 97448 98110 97031 95462 97006 total = 26.273268 per ms 06:53:35.350 16 switches: flows: 96002 94330 95323 95038 91589 94082 93562 92597 91475 91702 91368 90036 92259 92367 90371 90627 total = 24.670935 per ms 06:54:35.451 16 switches: flows: 94553 94884 96517 95371 92978 92098 94198 92978 91165 91894 90710 89593 92800 89771 91261 91768 total = 24.667591 per ms 06:55:35.553 16 switches: flows: 116003 115804 115866 116375 113365 114009 115859 113735 113556 114146 111207 109735 111916 113214 114128 111729 total = 30.293519 per ms RESULT: 16 switches 9 tests min/max/avg/stdev = 16984.56/30293.52/25895.50/9360.51 responses/s ${output} Logs the given message with the given level. ${output} RESULT Fails if ``container`` does not contain ``item`` one or more times. 1 out of 23 lines matched. ${result_line} = RESULT: 16 switches 9 tests min/max/avg/stdev = 16984.56/30293.52/25895.50/9360.51 responses/s ${result_line} ${output} RESULT Returns lines of the given ``string`` that contain the ``pattern``. @{results_list} = [ RESULT: | 16 | switches | 9 | tests | min/max/avg/stdev | = | 16984.56/30293.52/25895.50/9360.51 | responses/s ] @{results_list} ${result_line} Splits the ``string`` using ``separator`` as a delimiter string. min/max/avg/stdev ${results_list[5]} Logs the given message with the given level. 16984.56/30293.52/25895.50/9360.51 ${results_list[7]} Logs the given message with the given level. @{result_name_list} = [ min | max | avg | stdev ] @{result_name_list} ${results_list[5]} / Splits the ``string`` using ``separator`` as a delimiter string. @{result_value_list} = [ 16984.56 | 30293.52 | 25895.50 | 9360.51 ] @{result_value_list} ${results_list[7]} / Splits the ``string`` using ``separator`` as a delimiter string. Length is 4. ${num_stats} = 4 ${num_stats} ${result_name_list} Returns and logs the length of the given item as an integer. min :: 16984.56 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 0 max :: 30293.52 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 1 avg :: 25895.50 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 2 stdev :: 9360.51 ${result_name_list[${i}]} :: ${result_value_list[${i}]} Logs the given message with the given level. 3 ${i} 0 ${num_stats} ${min} = 16984.56 ${min} ${result_value_list[${0}]} Returns the given values which can then be assigned to a variables. ${max} = 30293.52 ${max} ${result_value_list[${1}]} Returns the given values which can then be assigned to a variables. ${average} = 25895.50 ${average} ${result_value_list[${2}]} Returns the given values which can then be assigned to a variables. ${stdev} = 9360.51 ${stdev} ${result_value_list[${3}]} Returns the given values which can then be assigned to a variables. ${date} = 2026-07-24 06:55:35 ${date} d,m,s Returns the given time in the requested format. CBench Result: 2026-07-24 06:55:35,-m 60000 -M 100 -S 16 -l 10 -D 5000 -p 6633,16984.56,30293.52,25895.50,9360.51 CBench Result: ${date},${cbench_args},${min},${max},${average},${stdev} Logs the given message with the given level. Appended to file '<a href="file:///w/workspace/openflowplugin-csit-1node-cbench-only-chromium/bug.csv">/w/workspace/openflowplugin-csit-1node-cbench-only-chromium/bug.csv</a>'. ${output_file} ${min},${max},${average}\n Appends the given content to the specified file. ${average} > ${threshold} ${average} flow_mods per/sec did not exceed threshold of ${threshold} Fails if the given condition is not true. ${min} ${max} ${average} ${average_threshold} ${output_filename} -m ${duration_in_ms} -M ${num_of_unique_macs} -S ${switch_count} -l ${loops} -D ${start_delay} -p ${of_port} ${latency_threshold} bug.csv Slept 0 seconds. ${test_delay} Pauses the test executed for the given time. ${test_skipped} = False ${test_skipped} len(re.findall('SKIPPED', """${TEST_MESSAGE}""")) > 0 modules=re Evaluates the given expression in Python and returns the result. Jira tickets are {PROJECT}-{NUMBER} while Bugzilla tickets are {NUMBER} Displays the given messages in the log file as keyword arguments. ${match} Should Contain ${number} - Runs the specified keyword and returns the status as a Boolean value. ${bug_url} ${match} https://jira.opendaylight.org/browse/${number} https://bugs.opendaylight.org/show_bug.cgi?id=${number} Sets variable based on the given condition. ${msg} This test fails due to ${bug_url} Returns the given values which can then be assigned to a variables. ${newline} chr(10) Evaluates the given expression in Python and returns the result. ${msg}${newline}${newline}${TEST_MESSAGE} Sets message for the current test case. ${msg} Logs the given message with the given level. ${bug_url} Adds given ``tags`` for the current test or all tests in a suite. 6176 Report that a test failed due to a known Bugzilla bug whose number is provided as an argument. Not FAILED (incl. SKIPPED) test are not reported. This keyword must be used in the [Teardown] setting of the affected test or as the first line of the test if FastFail module is not being used. It reports the URL of the bug on console and also puts it into the Robot log file. cbench executed in latency mode to see if controller is healthy cbench latency Cbench Latency and Throughput tests can be run from an external cbench. If cbench is run with a medium number of switches or higher (e.g. 32+) the normal openflow operations seem to break. BUG: https://bugs.opendaylight.org/show_bug.cgi?id=2897 All Tests cbench latency throughput openflowplugin-cbench.txt