${SuiteFastFail} = False ${SuiteFastFail} False Makes a variable available everywhere within the scope of the current suite. Set suite to not fail fast. ${PCCMOCKVM_IP} = 10.30.170.224 ${PCCMOCKVM_IP} ${ODL_SYSTEM_IP} Makes a variable available everywhere within the scope of the current suite. ${PCCMOCKVM_PASSWORD} = ${PCCMOCKVM_PASSWORD} ${ODL_SYSTEM_PASSWORD} Makes a variable available everywhere within the scope of the current suite. ${PCCMOCKVM_PROMPT} = > ${PCCMOCKVM_PROMPT} ${ODL_SYSTEM_PROMPT} Makes a variable available everywhere within the scope of the current suite. ${PCCMOCKVM_WORKSPACE} = /tmp ${PCCMOCKVM_WORKSPACE} ${ODL_SYSTEM_WORKSPACE} Makes a variable available everywhere within the scope of the current suite. ${LOG_PATH} = /tmp ${LOG_PATH} ${ODL_SYSTEM_WORKSPACE} Makes a variable available everywhere within the scope of the current suite. Copy Odl_System values to Pccmock VM variables. ${UPDATERVM_IP} = 10.30.170.224 ${UPDATERVM_IP} ${ODL_SYSTEM_IP} Makes a variable available everywhere within the scope of the current suite. ${UPDATERVM_PASSWORD} = ${UPDATERVM_PASSWORD} ${ODL_SYSTEM_PASSWORD} Makes a variable available everywhere within the scope of the current suite. ${UPDATERVM_PROMPT} = > ${UPDATERVM_PROMPT} ${ODL_SYSTEM_PROMPT} Makes a variable available everywhere within the scope of the current suite. ${UPDATERVM_WORKSPACE} = /tmp ${UPDATERVM_WORKSPACE} ${ODL_SYSTEM_WORKSPACE} Makes a variable available everywhere within the scope of the current suite. Copy Odl_System values to Uprater VM variables. ${FIRST_PCC_IP} = 10.30.170.224 ${FIRST_PCC_IP} ${PCCMOCKVM_IP} Makes a variable available everywhere within the scope of the current suite. Check the tools system variable and assigns the PCC Mock ${odl_connection} = 1 ${odl_connection} ${ip_address} prompt=${ODL_SYSTEM_PROMPT} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.224:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-171-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Apr 7 09:49:15 UTC 2026 System load: 0.05 Processes: 118 Usage of /: 10.3% of 77.35GB Users logged in: 0 Memory usage: 2% IPv4 address for ens3: 10.30.170.224 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 10 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. [?2004h[jenkins@releng-25826-167-0-builder-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. user=${user} password=${password} delay=${delay} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Returning from the enclosing user keyword. Flexible SSH Login user=${user} password=${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Call Flexible SSH Login, but with default values suitable for Controller machine. ${odl_connection} ${odl} = 1 ${odl} Open a connection to the ODL system at ${ip_address} and return its identifier. [chan 1] Opened sftp connection (server version 3) '/w/workspace/bgpcep-csit-1node-throughpcep-all-vanadium/test/csit/libraries/../../tools/deployment/search.sh' -> '/home/jenkins//search.sh' /w/workspace/bgpcep-csit-1node-throughpcep-all-vanadium/test/csit/libraries/../../tools/deployment/search.sh Uploads file(s) from the local machine to the remote machine. Closes the current connection. Open a connection to the tools system at ${ip_address} and return its identifier. tools_system_connect=False Places search utility to ODL system, which will be needed for version detection. By default also initialize a SSH connection to Tools system, as following Keywords assume a working connection towards target system. ${pcc_ip} alias=${ssh_alias} Opens a new SSH connection to the given ``host`` and ``port``. timeout=10s Update the `configuration` of the current connection. prompt=${pcc_prompt} Update the `configuration` of the current connection. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.224:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-171-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Apr 7 09:49:15 UTC 2026 System load: 0.05 Processes: 118 Usage of /: 10.3% of 77.35GB Users logged in: 0 Memory usage: 2% IPv4 address for ens3: 10.30.170.224 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 10 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue Apr 7 09:49:17 2026 from 10.30.171.3 [?2004h[jenkins@releng-25826-167-0-builder-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. ${pcc_user} ${pcc_password} delay=4s On active SSH session: if given non-empty password, do Login, else do Login With Public Key. ${name_prefix} = pcep-pcc-mock- ${name_prefix} ${artifact}- Returns the given values which can then be assigned to a variables. ${extension} = jar ${extension} '${component}'=='odl-micro' tar jar Sets variable based on the given condition. ${name_suffix} = -executable.jar ${name_suffix} "${suffix}" != "" -${suffix}.${extension} .${extension} Sets variable based on the given condition. """${explicit_url}""" != "" Deploy_From_Url ${explicit_url} Runs the specified keyword and returns from the enclosing user keyword. ${urlbase} = https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot ${urlbase} ${BUNDLE_URL} /org/opendaylight Returns contents of the ``string`` before the first occurrence of ``marker``. ${urlbase} = https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot ${urlbase} '${urlbase}' != '${BUNDLE_URL}' ${urlbase} ${fallback_url} Sets variable based on the given condition. ${Stream_dict}[${ODL_STREAM}] <= ${Stream_dict}[${upper_bound}] ${kw_name} @{varargs} &{kwargs} Runs the specified keyword and returns from the enclosing user keyword. magnesium ${kw_name} @{varargs} &{kwargs} Compare ${upper_bound} to vanadium and in case vanadium is at most ${upper_bound}, run Collections.Remove_Values_From_List [['mdsal', 'odlparent', 'yangtools', 'carpeople', 'netconf', 'bgpcep'], 'carpeople'] {} and return its value. Returning from the enclosing user keyword. Run_Keyword_If_At_Most magnesium ${kw_name} @{varargs} &{kwargs} Runs the specified keyword and returns from the enclosing user keyword. Collections.Remove_Values_From_List ${RELEASE_INTEGRATED_COMPONENTS} carpeople Compare magnesium to vanadium and in case vanadium is at most magnesium, run ${kw_name} @{varargs} &{kwargs} and return its value. ${Stream_dict}[${ODL_STREAM}] <= ${Stream_dict}[${upper_bound}] ${kw_name} @{varargs} &{kwargs} Runs the specified keyword and returns from the enclosing user keyword. aluminium ${kw_name} @{varargs} &{kwargs} Compare ${upper_bound} to vanadium and in case vanadium is at most ${upper_bound}, run Collections.Remove_Values_From_List [['mdsal', 'odlparent', 'yangtools', 'carpeople', 'netconf', 'bgpcep'], 'netconf'] {} and return its value. Returning from the enclosing user keyword. Run_Keyword_If_At_Most aluminium ${kw_name} @{varargs} &{kwargs} Runs the specified keyword and returns from the enclosing user keyword. Collections.Remove_Values_From_List ${RELEASE_INTEGRATED_COMPONENTS} netconf Compare aluminium to vanadium and in case vanadium is at most aluminium, run ${kw_name} @{varargs} &{kwargs} and return its value. ${Stream_dict}[${ODL_STREAM}] <= ${Stream_dict}[${upper_bound}] ${kw_name} @{varargs} &{kwargs} Runs the specified keyword and returns from the enclosing user keyword. silicon ${kw_name} @{varargs} &{kwargs} Compare ${upper_bound} to vanadium and in case vanadium is at most ${upper_bound}, run Collections.Remove_Values_From_List [['mdsal', 'odlparent', 'yangtools', 'carpeople', 'netconf', 'bgpcep'], 'bgpcep'] {} and return its value. Returning from the enclosing user keyword. Run_Keyword_If_At_Most silicon ${kw_name} @{varargs} &{kwargs} Runs the specified keyword and returns from the enclosing user keyword. Collections.Remove_Values_From_List ${RELEASE_INTEGRATED_COMPONENTS} bgpcep Compare silicon to vanadium and in case vanadium is at most silicon, run ${kw_name} @{varargs} &{kwargs} and return its value. ${COMPONENT_MAPPING} ${component} Component not supported by NexusKeywords version detection: ${component} Fails if ``key`` is not found from ``dictionary``. ${COMPONENT_MAPPING} ${component} Returns a value from the given ``dictionary`` based on the given ``key``. Returning from the enclosing user keyword. Collections.Get_From_Dictionary ${COMPONENT_MAPPING} ${component} Runs the specified keyword and returns from the enclosing user keyword. ${itemlist} = pcep-impl ${itemlist} ${component} Get a list of items that might contain the version number that we are looking for. index=2 host=10.30.170.224 alias=pccmock port=22 timeout=10 seconds newline= prompt=> term_type=vt100 width=80 height=24 path_separator=/ encoding=UTF-8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} = index=2 host=10.30.170.224 alias=pccmock port=22 timeout=10 seconds newline= prompt=> term_type=vt100 width=80 height=24 path_separator=/ encoding=UTF-8 escape_ansi=False encoding_errors=strict ${current_ssh_connection} Returns information about the connection. ${odl_connection} = 3 ${odl_connection} ${ip_address} prompt=${ODL_SYSTEM_PROMPT} timeout=${timeout} Opens a new SSH connection to the given ``host`` and ``port``. Length is 0. ${pwd_length} = 0 ${pwd_length} ${password} Returns and logs the length of the given item as an integer. ${pwd_length} > 0 SSHLibrary.Login ${user} ${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Logging into '10.30.170.224:22' as 'jenkins'. Read output: Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-171-generic x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro System information as of Tue Apr 7 09:49:15 UTC 2026 System load: 0.05 Processes: 118 Usage of /: 10.3% of 77.35GB Users logged in: 0 Memory usage: 2% IPv4 address for ens3: 10.30.170.224 Swap usage: 0% Expanded Security Maintenance for Applications is not enabled. 0 updates can be applied immediately. 10 additional security updates can be applied with ESM Apps. Learn more about enabling ESM Apps service at https://ubuntu.com/esm The list of available updates is more than a week old. To check for new updates run: sudo apt update New release '24.04.4 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Tue Apr 7 09:49:17 2026 from 10.30.171.3 [?2004h[jenkins@releng-25826-167-0-builder-0 ~]> ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Logs into the SSH server using key-based authentication. Returning from the enclosing user keyword. SSHLibrary.Login With Public Key ${user} ${USER_HOME}/.ssh/${SSH_KEY} ${KEYFILE_PASS} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. user=${user} password=${password} delay=${delay} On active SSH session: if given non-empty password, do Login, else do Login With Public Key. Returning from the enclosing user keyword. Flexible SSH Login user=${user} password=${password} delay=${delay} Runs the specified keyword and returns from the enclosing user keyword. Call Flexible SSH Login, but with default values suitable for Controller machine. ${odl_connection} Open a connection to the ODL system at ${ip_address} and return its identifier. Executing command 'sh search.sh /tmp/karaf-0.23.1-SNAPSHOT/system pcep-impl'. Command exited with return code 1. ${version} = Path '/tmp/karaf-0.23.1-SNAPSHOT/system' does not exist or is not a directory ${result} = 1 ${version} ${result} sh search.sh ${WORKSPACE}/${BUNDLEFOLDER}/system ${itemlist} return_rc=True Executes ``command`` on the remote machine and returns its outputs. Closes the current connection. ${connection_index} Switches the active connection by index or alias. Returning from the enclosing user keyword. ${connection_index} is not None SSHLibrary.Switch Connection ${connection_index} Runs the specified keyword and returns from the enclosing user keyword. 127.0.0.1 Opens a new SSH connection to the given ``host`` and ``port``. Closes the current connection. ${current_ssh_connection.index} Restore active SSH connection in SSHLibrary to given index. Path '/tmp/karaf-0.23.1-SNAPSHOT/system' does not exist or is not a directory ${version} Logs the given message with the given level. Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Component "${component}": searching for "${itemlist}" found no version, cannot locate test tool. Fails the test with the given message and optionally alters its tags. Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. ${version} ${location} ${version} max_split=1 Splits the ``string`` using ``separator`` as a delimiter string. ${version} ${location} ${version} ${location} ${component} Determine the exact Nexus directory to be used as a source for a particular test tool Figure out what version of the tool needs to be pulled out of the Nexus by looking at the version directory of the subsystem from which the tool is being pulled. This code is REALLY UGLY but there is no way around it until the bug https://bugs.opendaylight.org/show_bug.cgi?id=5206 gets fixed. I also don't want to depend on maven-metadata-local.xml and other bits and pieces of ODL distribution which are not required for ODL to function properly. Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. ${version} ${location} ${build_version} ${build_location} Returns the given values which can then be assigned to a variables. Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. ${RELEASE_INTEGRATED_COMPONENTS} netconf bgpcep Removes all occurrences of given ``values`` from ``list``. ${is_staged} "opendaylight.release" not in '${urlbase}' and "opendaylight.snapshot" not in '${urlbase}' "TRUE" "FALSE" Sets variable based on the given condition. ${is_mri_component} '${component}' in ${RELEASE_INTEGRATED_COMPONENTS} "TRUE" "FALSE" Sets variable based on the given condition. ${urlbase} ${is_mri_component} == "TRUE" and ${is_staged} == "FALSE" ${NEXUS_RELEASE_BASE_URL} ${urlbase} Sets variable based on the given condition. ${url} ${urlbase}/${location}/${artifact}/${version} Returns the given values which can then be assigned to a variables. ${metadata} curl -L ${url}/maven-metadata.xml A wrapper for Execute_Command_Passes with return_success_only=False Also, log_on_success defaults to True (but is customizable, unlike return_success_only).. ${status} ${namepart} SSHKeywords.Execute_Command_Should_Pass echo "${metadata}" | grep value | head -n 1 | cut -d '>' -f 2 | cut -d '<' -f 1 stderr_must_be_empty=${True} Runs the given keyword with the given arguments and ignores possible error. ${length} ${namepart} Returns and logs the length of the given item as an integer. ${namepart} "${status}" != "PASS" or ${length} == 0 ${version} ${namepart} Sets variable based on the given condition. ${filename} ${name_prefix}${namepart}${name_suffix} Returns the given values which can then be assigned to a variables. ${filename} Logs the given message with the given level. ${url} ${url}/${filename} Returns the given values which can then be assigned to a variables. ${response} ${result} wget -q -N '${url}' 2>&1 return_rc=True Executes ``command`` on the remote machine and returns its outputs. ${response} Logs the given message with the given level. ${filename} ${release_url} ${url} autorelease-[0-9]{4} opendaylight.release Replaces ``pattern`` in the given ``string`` with ``replace_with``. ${response} ${result} wget -q -N '${release_url}' 2>&1 return_rc=True Executes ``command`` on the remote machine and returns its outputs. Artifact "${artifact}" in component "${component}" could not be downloaded from ${release_url} nor ${url} Fails the test with the given message and optionally alters its tags. ${filename} ${filename} ${component} ${artifact} ${name_prefix} ${name_suffix} ${fallback_url} ${explicit_url} ${build_version} ${build_location} Deploy the specified artifact from Nexus to the cwd of the machine to which the active SSHLibrary connection points. bgpcep is a name part of an artifact present in system/ of ODl installation with the same version as pcep-pcc-mock should have. Must have https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.23.1-SNAPSHOT/karaf-.zip variable set to the URL from which the tested ODL distribution was downloaded and this place must be inside a repository created by a standard distribution construction job. If this is detected to ne be the case, fallback URL is used. If is non-empty, Deploy_From_Utrl is called instead. TODO: Allow deploying to a specific directory, we have SSHKeywords.Execute_Command_At_Cwd_Should_Pass now. Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. ${filename} ${file_name} bgpcep pcep-pcc-mock Deploy a test tool. The test tools have naming convention of the form "<repository_url>/some/dir/somewhere/<tool-name>/<tool-name>-<version-tag>-${suffix}.jar" where "<tool-name>" is the name of the tool and "<version-tag>" is the version tag that is digged out of the maven metadata. This keyword calculates ${name_prefix} and ${name_suffix} for "Deploy_Artifact" and then calls "Deploy_Artifact" to do the real work of deploying the artifact. Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. ${mock_location} ${file_name} Makes a variable available everywhere within the scope of the current suite. SSH login to pcc-mock VM, download latest pcc-mock executable from Nexus. Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Open SSH session to updater VM, copy the utility there, including dependencies, also prepare direct http session. Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. If requested, temporarily enable TCP port reuse on Updater VM to allow for high rate of TCP connections. Do not start failing fast. Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, PCEP topology is present, with no PCC connected. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, PCEP topology contains correct numbers of LSPs. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Run updater tool to change hops, using 1 blocking http thread. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, the correct number of new hops is in PCEP topology. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Run updater tool to change hops again, using 2 blocking http threads. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, the correct number of new hops is in PCEP topology. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Run updater tool to change hops again, using 4 blocking http threads. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, the correct number of new hops is in PCEP topology. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Run updater tool to change hops again, using 8 blocking http threads. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, the correct number of new hops is in PCEP topology. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Run updater tool to change hops again, using 16 blocking http threads. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, the correct number of new hops is in PCEP topology. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Run updater tool to change hops again, using 32 blocking http threads. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, the correct number of new hops is in PCEP topology. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Run updater tool to change hops again, using 64 blocking http threads. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, the correct number of new hops is in PCEP topology. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Run updater tool to change hops again, using 128 blocking http threads. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, the correct number of new hops is in PCEP topology. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Run updater tool to change hops again, using 256 blocking http threads. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, the correct number of new hops is in PCEP topology. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Run updater tool to change hops again, using 512 blocking http threads. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, the correct number of new hops is in PCEP topology. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Run updater tool to revoke the delegate for the given hop, using 1 blocking http thread. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Download and start PCC Mock in tools vm and do updation Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Send ctrl+c to pcc-mock, see prompt again within timeout. Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Flapping PCEP sessions and perform LSP updates within flapping Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Flapping PCEP sessions and perform LSP updates alongside flapping Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Transfer pcc-mock output from pcc-mock VM to robot VM. Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Verify that within timeout, PCEP topology contains no PCCs again. critical Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. If requested, restore the old value if enabling TCP reuse was successful on Updater VM. Parent suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. Closes all open connections. Explicitly close all SSH connections. PCEP performance suite, uses restconf with configurable authentication. Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html General Overview: This is a suite which has both scale and performance aspects. Given scale target, suite reports failures if functional error is detected, or if various time limits expire. For passing test cases, their duration is the performance metric. ODL acts as a translation layer between PCEP capable devices and users employing RESTCONF. Performance measurement focuses on two different workflows. The first workflow is initial synchronization, when ODL learns the state of PCEP topology as devices connect to it, while restconf user reads the state repeatedly. The second workflow is mass update, when restconf users issue RPCs to updale Layer Switched Paths on Path Computation Clients. This suite uses pcc-mock (downloaded from Nexus) to simulate PCCs. It needs segment of bindable IP addresses, one for each simulated PCC; so running pcc-mock from remote machine is only viable when just single PCC is simulated. Testing with multiple PCCs works best when pcc-mock runs on the same VM as ODL, so 127.0.0.0/8 subnet can be used. Library AuthStandalone is used directly for restconf reads in the first workflow. That library transparently handles several http authentication methods, based on credentials and pybot arguments. In the second workflow, updater.py utility is used for issuing rapid restconf requests. It can use multiple worker threads, as http requests are blocking. Due to CPython interpreter itself being single threaded, amounts of threads above 8-16 are actually slightly slower (which may roughly correspond to network traffic being more limiting factor than CPU). This suite starts updater utility bound to single CPU, as this setup was the most performant in other tests. In case of failed test case, other tests are skipped (unless this is overriden by [Setup]) to finish test run sooner. Variables and test case names refer to Controller(ODL_SYSTEM) and Mininet (TOOLS_SYSTEM), those are assumed to be separate remote VMs, one to host ODL, other to host tools. In case updater and pcc-mock are desired to run from separate machines, their parameters use Mininet(TOOLS_SYSTEM) values as default. If both updater VM and pcc-mock VM parameters are specified, Mininet(TOOLS_SYSTEM) parameters may be skipped. Variable False decides the pcc-mock running machine. Some launch scripts put restrictions on how pybot options can be specified, so there are utility variables to help with copying Controller related value to apply fo updater of pccmock. Having a tool co-located with ODL reduces network latency, but puts more pressure on CPU and memory on Controller VM. In some environments, issues with TIME-WAIT prevent high restconf rates, so TCP reuse is temporarily allowed during the suite run, if possible (and if not disabled by UPDATERVM_ENABLE_TCP_RW_REUSE option value). See http://vincent.bernat.im/en/blog/2014-tcp-time-wait-state-linux.html This suite ignores possible failures when changing reuse. Similarly, in some environments, handling of requests.Session object matters try changing RESTCONF_REUSE value to see if it helps. Variables to override (only if needed) in pybot command: (Look into Variables table to see the default values.) FIRST_PCC_IP: Set in case bind address is different from public pcc-mock VM address. LOG_NAME: Filename (without path) to save pcc-mock output into. LOG_PATH: Override if not the same as pccmock VM workspace. LSPS: Number of LSPs per PCC to simulate and test. MOCK_FILE: Filename to use for mock-pcc executable instead of the timestamped one. ODL_SYSTEM_IP: Numeric IP address of VM where ODL runs. ODL_SYSTEM_USER: Username for ssh login to ODL VM. ODL_SYSTEM_PASSWORD: Ssh password, empty means public keys are used instead. ODL_SYSTEM_PROMPT: Substring to identify Linux prompt on ODL VM. ODL_SYSTEM_WORKSPACE: Path to where files can be written on ODL VM. PCCDOWNLOAD_HOSTHEADER: Download server may check checks this header before showing content. PCCDOWNLOAD_URLBASE: URL to pcep-pcc-mock folder in Nexus (use numberic IP if DNS has problems). PCCMOCK_COLOCATED: If True, set PCCMOCKVM* to mirror ODL_SYSTEM* PCCMOCKVM_IP: Override TOOLS_SYSTEM for pcc-mock usage. PCCMOCKVM_*: Override corresponding TOOLS_SYSTEM_* for pcc-mock usage. PCCS: Number of PCCs to simulate and test. PCEP_READY_VERIFY_TIMEOUT: Grace period for pcep-topology to appear. Lower if ODL is ready. RESTCONF_*: USER, PASSWORD and SCOPE to authenticate with, REUSE session. (Note: If SCOPE is not empty, token-based authentication is used.) TOOLS_SYSTEM_IP: Numeric IP address of VM to run pcc-mock and updater from by default. TOOLS_SYSTEM_PASSWORD: Linux password to go with the username (empty means keys). TOOLS_SYSTEM_PROMPT: Substring to identify Linux prompt on TOOLS_SYSTEM VM. TOOLS_SYSTEM_USER: Linux username to SSH to on TOOLS_SYSTEM VM. TOOLS_SYSTEM_WORKSPACE: Path to where files may be created on TOOLS_SYSTEM VM. UPDATER_COLOCATED: If True, overrides UPDATERVM_* parameters to point at ODL_SYSTEM (The purpose is to provide an option without ability to unpack ODL_SYSTEM value.) UPDATER_ODLADDRESS: Override if public ODL_SYSTEM address is not best fit. UPDATER_REFRESH: Main updater thread may sleep this long. Balance precision with overhead. UPDATER_TIMEOUT: If updater stops itself if running more than this time. (Set this limit according to your performance target.) UPDATERVM_ENABLE_TCP_RW_REUSE: Set to false if changing Linux configuration is not desired. UPDATERVM_IP: Override TOOLS_SYSTEM for updater.py usage. UPDATERVM_*: Override corresponding TOOLS_SYSTEM_* for updater.py usage. Suite setup failed: Component "bgpcep": searching for "pcep-impl" found no version, cannot locate test tool. All Tests critical bgpcep-throughpcep.txt bgpcep-throughpcep.txt.Cases Error in file '/w/workspace/bgpcep-csit-1node-throughpcep-all-vanadium/test/csit/libraries/BGPSpeaker.robot' on line 27: Suite 'bgpcep-throughpcep.txt.Cases' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-throughpcep-all-vanadium/test/csit/libraries/RemoteBash.robot' on line 25: Suite 'bgpcep-throughpcep.txt.Cases' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-throughpcep-all-vanadium/test/csit/libraries/SSHKeywords.robot' on line 16: Suite 'bgpcep-throughpcep.txt.Cases' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-throughpcep-all-vanadium/test/csit/libraries/Utils.robot' on line 4: Suite 'bgpcep-throughpcep.txt.Cases' has already imported library 'SSHLibrary' with different arguments. This import is ignored. Error in file '/w/workspace/bgpcep-csit-1node-throughpcep-all-vanadium/test/csit/libraries/NexusKeywords.robot' on line 20: Suite 'bgpcep-throughpcep.txt.Cases' has already imported library 'SSHLibrary' with different arguments. This import is ignored.