08:13:41 Started by upstream project "integration-distribution-test-titanium" build number 688 08:13:41 originally caused by: 08:13:41 Started by upstream project "autorelease-release-titanium-mvn39-openjdk21" build number 583 08:13:41 originally caused by: 08:13:41 Started by timer 08:13:41 Running as SYSTEM 08:13:42 [EnvInject] - Loading node environment variables. 08:13:43 Building remotely on prd-ubuntu2404-robot-2c-8g-54476 (ubuntu2404-robot-2c-8g) in workspace /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium 08:13:43 [ssh-agent] Looking for ssh-agent implementation... 08:13:43 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 08:13:43 $ ssh-agent 08:13:43 SSH_AUTH_SOCK=/tmp/ssh-imuauaraq4uy/agent.3145 08:13:43 SSH_AGENT_PID=3147 08:13:43 [ssh-agent] Started. 08:13:43 Running ssh-add (command line suppressed) 08:13:44 Identity added: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium@tmp/private_key_12755073575965822497.key (/w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium@tmp/private_key_12755073575965822497.key) 08:13:44 [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) 08:13:44 The recommended git tool is: NONE 08:13:51 using credential opendaylight-jenkins-ssh 08:13:51 Wiping out workspace first. 08:13:51 Cloning the remote Git repository 08:13:51 Cloning repository git://devvexx.opendaylight.org/mirror/integration/test 08:13:52 > git init /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test # timeout=10 08:13:52 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test 08:13:52 > git --version # timeout=10 08:13:52 > git --version # 'git version 2.43.0' 08:13:52 using GIT_SSH to set credentials Release Engineering Jenkins Key 08:13:52 Verifying host key using known hosts file, will automatically accept unseen keys 08:13:52 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 08:13:54 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 08:13:54 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 08:13:55 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 08:13:55 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test 08:13:55 using GIT_SSH to set credentials Release Engineering Jenkins Key 08:13:55 Verifying host key using known hosts file, will automatically accept unseen keys 08:13:55 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 08:13:56 > git rev-parse FETCH_HEAD^{commit} # timeout=10 08:13:56 Checking out Revision 901c7e139945b436d95a44b3b592904c3d7a4f9f (origin/master) 08:13:56 > git config core.sparsecheckout # timeout=10 08:13:56 > git checkout -f 901c7e139945b436d95a44b3b592904c3d7a4f9f # timeout=10 08:13:56 Commit message: "Adapt updater.py to use new lsp-flags container" 08:13:56 > git rev-parse FETCH_HEAD^{commit} # timeout=10 08:13:56 > git rev-list --no-walk f65244a2a093016c71f9a7a564be7d086941e15c # timeout=10 08:13:57 No emails were triggered. 08:13:57 provisioning config files... 08:13:57 copy managed file [npmrc] to file:/home/jenkins/.npmrc 08:13:57 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 08:13:57 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 08:13:57 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins2240895674081781476.sh 08:13:57 ---> python-tools-install.sh 08:13:57 Setup pyenv: 08:13:57 * system (set by /opt/pyenv/version) 08:13:57 * 3.8.20 (set by /opt/pyenv/version) 08:13:57 * 3.9.20 (set by /opt/pyenv/version) 08:13:57 3.10.15 08:13:57 3.11.10 08:14:02 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-z5Bd 08:14:02 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 08:14:02 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 08:14:02 lf-activate-venv(): INFO: Attempting to install with network-safe options... 08:14:06 lf-activate-venv(): INFO: Base packages installed successfully 08:14:06 lf-activate-venv(): INFO: Installing additional packages: lftools 08:14:31 lf-activate-venv(): INFO: Adding /tmp/venv-z5Bd/bin to PATH 08:14:31 Generating Requirements File 08:14:49 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 08:14:49 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 08:14:49 Python 3.11.10 08:14:49 pip 26.0.1 from /tmp/venv-z5Bd/lib/python3.11/site-packages/pip (python 3.11) 08:14:49 appdirs==1.4.4 08:14:49 argcomplete==3.6.3 08:14:49 aspy.yaml==1.3.0 08:14:49 attrs==26.1.0 08:14:49 autopage==0.6.0 08:14:49 beautifulsoup4==4.14.3 08:14:49 boto3==1.42.79 08:14:49 botocore==1.42.79 08:14:49 bs4==0.0.2 08:14:49 certifi==2026.2.25 08:14:49 cffi==2.0.0 08:14:49 cfgv==3.5.0 08:14:49 chardet==7.4.0.post2 08:14:49 charset-normalizer==3.4.6 08:14:49 click==8.3.1 08:14:49 cliff==4.13.2 08:14:49 cmd2==3.4.0 08:14:49 cryptography==3.3.2 08:14:49 debtcollector==3.1.0 08:14:49 decorator==5.2.1 08:14:49 defusedxml==0.7.1 08:14:49 Deprecated==1.3.1 08:14:49 distlib==0.4.0 08:14:49 dnspython==2.8.0 08:14:49 docker==7.1.0 08:14:49 dogpile.cache==1.5.0 08:14:49 durationpy==0.10 08:14:49 email-validator==2.3.0 08:14:49 filelock==3.25.2 08:14:49 future==1.0.0 08:14:49 gitdb==4.0.12 08:14:49 GitPython==3.1.46 08:14:49 httplib2==0.30.2 08:14:49 identify==2.6.18 08:14:49 idna==3.11 08:14:49 importlib-resources==1.5.0 08:14:49 iso8601==2.1.0 08:14:49 Jinja2==3.1.6 08:14:49 jmespath==1.1.0 08:14:49 jsonpatch==1.33 08:14:49 jsonpointer==3.1.1 08:14:49 jsonschema==4.26.0 08:14:49 jsonschema-specifications==2025.9.1 08:14:49 keystoneauth1==5.13.1 08:14:49 kubernetes==35.0.0 08:14:49 lftools==0.37.22 08:14:49 lxml==6.0.2 08:14:49 markdown-it-py==4.0.0 08:14:49 MarkupSafe==3.0.3 08:14:49 mdurl==0.1.2 08:14:49 msgpack==1.1.2 08:14:49 multi_key_dict==2.0.3 08:14:49 munch==4.0.0 08:14:49 netaddr==1.3.0 08:14:49 niet==1.4.2 08:14:49 nodeenv==1.10.0 08:14:49 oauth2client==4.1.3 08:14:49 oauthlib==3.3.1 08:14:49 openstacksdk==4.10.0 08:14:49 os-service-types==1.8.2 08:14:49 osc-lib==4.4.0 08:14:49 oslo.config==10.3.0 08:14:49 oslo.context==6.3.0 08:14:49 oslo.i18n==6.7.2 08:14:49 oslo.log==8.1.0 08:14:49 oslo.serialization==5.9.1 08:14:49 oslo.utils==10.0.0 08:14:49 packaging==26.0 08:14:49 pbr==7.0.3 08:14:49 platformdirs==4.9.4 08:14:49 prettytable==3.17.0 08:14:49 psutil==7.2.2 08:14:49 pyasn1==0.6.3 08:14:49 pyasn1_modules==0.4.2 08:14:49 pycparser==3.0 08:14:49 pygerrit2==2.0.15 08:14:49 PyGithub==2.9.0 08:14:49 Pygments==2.20.0 08:14:49 PyJWT==2.12.1 08:14:49 PyNaCl==1.6.2 08:14:49 pyparsing==2.4.7 08:14:49 pyperclip==1.11.0 08:14:49 pyrsistent==0.20.0 08:14:49 python-cinderclient==9.9.0 08:14:49 python-dateutil==2.9.0.post0 08:14:49 python-discovery==1.2.1 08:14:49 python-heatclient==5.1.0 08:14:49 python-jenkins==1.8.3 08:14:49 python-keystoneclient==5.8.0 08:14:49 python-magnumclient==4.10.0 08:14:49 python-openstackclient==9.0.0 08:14:49 python-swiftclient==4.10.0 08:14:49 PyYAML==6.0.3 08:14:49 referencing==0.37.0 08:14:49 requests==2.33.1 08:14:49 requests-oauthlib==2.0.0 08:14:49 requestsexceptions==1.4.0 08:14:49 rfc3986==2.0.0 08:14:49 rich==14.3.3 08:14:49 rich-argparse==1.7.2 08:14:49 rpds-py==0.30.0 08:14:49 rsa==4.9.1 08:14:49 ruamel.yaml==0.19.1 08:14:49 ruamel.yaml.clib==0.2.15 08:14:49 s3transfer==0.16.0 08:14:49 simplejson==3.20.2 08:14:49 six==1.17.0 08:14:49 smmap==5.0.3 08:14:49 soupsieve==2.8.3 08:14:49 stevedore==5.7.0 08:14:49 tabulate==0.10.0 08:14:49 toml==0.10.2 08:14:49 tomlkit==0.14.0 08:14:49 tqdm==4.67.3 08:14:49 typing_extensions==4.15.0 08:14:49 urllib3==1.26.20 08:14:49 virtualenv==21.2.0 08:14:49 wcwidth==0.6.0 08:14:49 websocket-client==1.9.0 08:14:49 wrapt==2.1.2 08:14:49 xdg==6.0.0 08:14:49 xmltodict==1.0.4 08:14:49 yq==3.4.3 08:14:50 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/sh /tmp/jenkins11864868943764317517.sh 08:14:50 ---> uv-install.sh 08:14:50 Installing uv/uvx (latest) using shell installer 08:14:50 2026-03-31 08:14:50 URL:https://release-assets.githubusercontent.com/github-production-release-asset/699532645/23829516-dcc2-44de-97ee-6c98471a68af?sp=r&sv=2018-11-09&sr=b&spr=https&se=2026-03-31T08%3A54%3A53Z&rscd=attachment%3B+filename%3Duv-installer.sh&rsct=application%2Foctet-stream&skoid=96c2d410-5711-43a1-aedd-ab1947aa7ab0&sktid=398a6654-997b-47e9-b12b-9515b896b4de&skt=2026-03-31T07%3A54%3A11Z&ske=2026-03-31T08%3A54%3A53Z&sks=b&skv=2018-11-09&sig=3Hc4WqBSRehJACasIRx18BivNQXUUyrKrp%2F8n0dI%2BXk%3D&jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmVsZWFzZS1hc3NldHMuZ2l0aHVidXNlcmNvbnRlbnQuY29tIiwia2V5Ijoia2V5MSIsImV4cCI6MTc3NDk0NTA3OSwibmJmIjoxNzc0OTQ0Nzc5LCJwYXRoIjoicmVsZWFzZWFzc2V0cHJvZHVjdGlvbi5ibG9iLmNvcmUud2luZG93cy5uZXQifQ.NTdRXIG1G6lcRTeLwxKeHhngG47KHCX8wyQ142XCkaE&response-content-disposition=attachment%3B%20filename%3Duv-installer.sh&response-content-type=application%2Foctet-stream [72114/72114] -> "/tmp/uv-install-f1VzLW.sh" [1] 08:14:50 downloading uv 0.11.2 x86_64-unknown-linux-gnu 08:14:51 installing to /home/jenkins/.local/bin 08:14:51 uv 08:14:51 uvx 08:14:51 everything's installed! 08:14:51 08:14:51 To add $HOME/.local/bin to your PATH, either restart your shell or run: 08:14:51 08:14:51 source $HOME/.local/bin/env (sh, bash, zsh) 08:14:51 source $HOME/.local/bin/env.fish (fish) 08:14:51 Adding install location to PATH 08:14:51 ---> Validating uv/uvx install 08:14:51 uvx 0.11.2 (x86_64-unknown-linux-gnu) 08:14:51 [EnvInject] - Injecting environment variables from a build step. 08:14:51 [EnvInject] - Injecting as environment variables the properties content 08:14:51 OS_STACK_TEMPLATE=csit-2-instance-type.yaml 08:14:51 OS_CLOUD=vex 08:14:51 OS_STACK_NAME=releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675 08:14:51 OS_STACK_TEMPLATE_DIR=openstack-hot 08:14:51 08:14:51 [EnvInject] - Variables injected successfully. 08:14:51 provisioning config files... 08:14:52 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 08:14:52 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins6324666264502021368.sh 08:14:52 ---> Create parameters file for OpenStack HOT 08:14:52 OpenStack Heat parameters generated 08:14:52 ----------------------------------- 08:14:52 parameters: 08:14:52 vm_0_count: '3' 08:14:52 vm_0_flavor: 'v3-standard-4' 08:14:52 vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260301-010217.216' 08:14:52 vm_1_count: '1' 08:14:52 vm_1_flavor: 'v3-standard-2' 08:14:52 vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654' 08:14:52 08:14:52 job_name: '36866-675' 08:14:52 silo: 'releng' 08:14:52 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash -l /tmp/jenkins9515225989437517484.sh 08:14:52 ---> Create HEAT stack 08:14:52 + source /home/jenkins/lf-env.sh 08:14:52 + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 08:14:52 ++ mktemp -d /tmp/venv-XXXX 08:14:52 + lf_venv=/tmp/venv-gr34 08:14:52 + local venv_file=/tmp/.os_lf_venv 08:14:52 + local python=python3 08:14:52 + local options 08:14:52 + local set_path=true 08:14:52 + local install_args= 08:14:52 ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 08:14:52 + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' 08:14:52 + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' 08:14:52 ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 08:14:52 + true 08:14:52 + case $1 in 08:14:52 + python=python3 08:14:52 + shift 2 08:14:52 + true 08:14:52 + case $1 in 08:14:52 + shift 08:14:52 + break 08:14:52 + case $python in 08:14:52 + local pkg_list= 08:14:52 + [[ -d /opt/pyenv ]] 08:14:52 + echo 'Setup pyenv:' 08:14:52 Setup pyenv: 08:14:52 + export PYENV_ROOT=/opt/pyenv 08:14:52 + PYENV_ROOT=/opt/pyenv 08:14:52 + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 08:14:52 + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 08:14:52 + pyenv versions 08:14:52 system 08:14:52 3.8.20 08:14:52 3.9.20 08:14:52 3.10.15 08:14:52 * 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/.python-version) 08:14:52 + command -v pyenv 08:14:52 ++ pyenv init - --no-rehash 08:14:52 + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 08:14:52 for i in ${!paths[@]}; do 08:14:52 if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 08:14:52 fi; done; 08:14:52 echo "${paths[*]}"'\'')" 08:14:52 export PATH="/opt/pyenv/shims:${PATH}" 08:14:52 export PYENV_SHELL=bash 08:14:52 source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' 08:14:52 pyenv() { 08:14:52 local command 08:14:52 command="${1:-}" 08:14:52 if [ "$#" -gt 0 ]; then 08:14:52 shift 08:14:52 fi 08:14:52 08:14:52 case "$command" in 08:14:52 rehash|shell) 08:14:52 eval "$(pyenv "sh-$command" "$@")" 08:14:52 ;; 08:14:52 *) 08:14:52 command pyenv "$command" "$@" 08:14:52 ;; 08:14:52 esac 08:14:52 }' 08:14:52 +++ bash --norc -ec 'IFS=:; paths=($PATH); 08:14:52 for i in ${!paths[@]}; do 08:14:52 if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 08:14:52 fi; done; 08:14:52 echo "${paths[*]}"' 08:14:52 ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 08:14:52 ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 08:14:52 ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 08:14:52 ++ export PYENV_SHELL=bash 08:14:52 ++ PYENV_SHELL=bash 08:14:52 ++ source /opt/pyenv/libexec/../completions/pyenv.bash 08:14:52 +++ complete -F _pyenv pyenv 08:14:52 ++ lf-pyver python3 08:14:52 ++ local py_version_xy=python3 08:14:52 ++ local py_version_xyz= 08:14:52 ++ pyenv versions 08:14:52 ++ local command 08:14:52 ++ command=versions 08:14:52 ++ '[' 1 -gt 0 ']' 08:14:52 ++ shift 08:14:52 ++ case "$command" in 08:14:52 ++ command pyenv versions 08:14:52 ++ sed 's/^[ *]* //' 08:14:52 ++ grep -E '^[0-9.]*[0-9]$' 08:14:52 ++ awk '{ print $1 }' 08:14:52 ++ [[ ! -s /tmp/.pyenv_versions ]] 08:14:52 +++ grep '^3' /tmp/.pyenv_versions 08:14:52 +++ sort -V 08:14:52 +++ tail -n 1 08:14:52 ++ py_version_xyz=3.11.10 08:14:52 ++ [[ -z 3.11.10 ]] 08:14:52 ++ echo 3.11.10 08:14:52 ++ return 0 08:14:52 + pyenv local 3.11.10 08:14:52 + local command 08:14:52 + command=local 08:14:52 + '[' 2 -gt 0 ']' 08:14:52 + shift 08:14:52 + case "$command" in 08:14:52 + command pyenv local 3.11.10 08:14:52 + for arg in "$@" 08:14:52 + case $arg in 08:14:52 + pkg_list+='lftools[openstack] ' 08:14:52 + for arg in "$@" 08:14:52 + case $arg in 08:14:52 + pkg_list+='kubernetes ' 08:14:52 + for arg in "$@" 08:14:52 + case $arg in 08:14:52 + pkg_list+='niet ' 08:14:52 + for arg in "$@" 08:14:52 + case $arg in 08:14:52 + pkg_list+='python-heatclient ' 08:14:52 + for arg in "$@" 08:14:52 + case $arg in 08:14:52 + pkg_list+='python-openstackclient ' 08:14:52 + for arg in "$@" 08:14:52 + case $arg in 08:14:52 + pkg_list+='python-magnumclient ' 08:14:52 + for arg in "$@" 08:14:52 + case $arg in 08:14:52 + pkg_list+='urllib3~=1.26.15 ' 08:14:52 + for arg in "$@" 08:14:52 + case $arg in 08:14:52 + pkg_list+='yq ' 08:14:52 + [[ -f /tmp/.os_lf_venv ]] 08:14:52 ++ cat /tmp/.os_lf_venv 08:14:52 + lf_venv=/tmp/venv-z5Bd 08:14:52 + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-z5Bd from' file:/tmp/.os_lf_venv 08:14:52 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-z5Bd from file:/tmp/.os_lf_venv 08:14:52 + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)' 08:14:52 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 08:14:52 + local 'pip_opts=--upgrade --quiet' 08:14:52 + pip_opts='--upgrade --quiet --trusted-host pypi.org' 08:14:52 + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org' 08:14:52 + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org' 08:14:52 + [[ -n '' ]] 08:14:52 + [[ -n '' ]] 08:14:52 + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...' 08:14:52 lf-activate-venv(): INFO: Attempting to install with network-safe options... 08:14:52 + /tmp/venv-z5Bd/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv 08:14:54 + echo 'lf-activate-venv(): INFO: Base packages installed successfully' 08:14:54 lf-activate-venv(): INFO: Base packages installed successfully 08:14:54 + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ]] 08:14:54 + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ' 08:14:54 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 08:14:54 + /tmp/venv-z5Bd/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 08:15:11 + type python3 08:15:11 + true 08:15:11 + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-z5Bd/bin to PATH' 08:15:11 lf-activate-venv(): INFO: Adding /tmp/venv-z5Bd/bin to PATH 08:15:11 + PATH=/tmp/venv-z5Bd/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 08:15:11 + return 0 08:15:11 + openstack --os-cloud vex limits show --absolute 08:15:12 +--------------------------+---------+ 08:15:12 | Name | Value | 08:15:12 +--------------------------+---------+ 08:15:12 | maxTotalInstances | -1 | 08:15:12 | maxTotalCores | 450 | 08:15:12 | maxTotalRAMSize | 1000000 | 08:15:12 | maxServerMeta | 128 | 08:15:12 | maxImageMeta | 128 | 08:15:12 | maxPersonality | 5 | 08:15:12 | maxPersonalitySize | 10240 | 08:15:12 | maxTotalKeypairs | 100 | 08:15:12 | maxServerGroups | 10 | 08:15:12 | maxServerGroupMembers | 10 | 08:15:12 | maxTotalFloatingIps | -1 | 08:15:12 | maxSecurityGroups | -1 | 08:15:12 | maxSecurityGroupRules | -1 | 08:15:12 | totalRAMUsed | 999424 | 08:15:12 | totalCoresUsed | 244 | 08:15:12 | totalInstancesUsed | 75 | 08:15:12 | totalFloatingIpsUsed | 0 | 08:15:12 | totalSecurityGroupsUsed | 0 | 08:15:12 | totalServerGroupsUsed | 0 | 08:15:12 | maxTotalVolumes | -1 | 08:15:12 | maxTotalSnapshots | 10 | 08:15:12 | maxTotalVolumeGigabytes | 4096 | 08:15:12 | maxTotalBackups | 10 | 08:15:12 | maxTotalBackupGigabytes | 1000 | 08:15:12 | totalVolumesUsed | 0 | 08:15:12 | totalGigabytesUsed | 0 | 08:15:12 | totalSnapshotsUsed | 0 | 08:15:12 | totalBackupsUsed | 0 | 08:15:12 | totalBackupGigabytesUsed | 0 | 08:15:12 +--------------------------+---------+ 08:15:13 + pushd /opt/ciman/openstack-hot 08:15:13 /opt/ciman/openstack-hot /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium 08:15:13 + lftools openstack --os-cloud vex stack create releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675 csit-2-instance-type.yaml /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/stack-parameters.yaml 08:16:32 Creating stack releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675 08:16:32 WARN: Failed to initialize stack. Reason: Resource CREATE failed: Forbidden: resources.vm_0_group.resources[0].resources.instance: Quota exceeded for ram: Requested 16384, but already used 999424 of 1000000 ram (HTTP 403) (Request-ID: req-7d0e7c62-438d-44f1-a539-1b947b7d28a7) 08:16:32 Deleting stack c287f66c-3ee1-4861-9810-d5eed7393455 08:16:32 Waiting for stack to delete... 08:16:32 Successfully deleted stack c287f66c-3ee1-4861-9810-d5eed7393455 08:16:32 WARN: Failed to initialize stack. Reason: Resource CREATE failed: Forbidden: resources.vm_0_group.resources[0].resources.instance: Quota exceeded for ram: Requested 16384, but already used 991232 of 1000000 ram (HTTP 403) (Request-ID: req-0c7c0771-ee7c-4e68-ae2f-193ac646a673) 08:16:32 Deleting stack 48b26a3b-58d3-4ee4-89f5-696b670f2035 08:16:32 Waiting for stack to delete... 08:16:32 Waiting for stack to delete... 08:16:32 Successfully deleted stack 48b26a3b-58d3-4ee4-89f5-696b670f2035 08:16:32 ------------------------------------ 08:16:32 Stack Details 08:16:32 ------------------------------------ 08:16:32 {'added': None, 08:16:32 'capabilities': [], 08:16:32 'created_at': '2026-03-31T08:15:50Z', 08:16:32 'deleted': None, 08:16:32 'deleted_at': None, 08:16:32 'description': 'No description', 08:16:32 'environment': None, 08:16:32 'environment_files': None, 08:16:32 'files': None, 08:16:32 'files_container': None, 08:16:32 'id': '48b26a3b-58d3-4ee4-89f5-696b670f2035', 08:16:32 'is_rollback_disabled': True, 08:16:32 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675/48b26a3b-58d3-4ee4-89f5-696b670f2035', 08:16:32 'rel': 'self'}], 08:16:32 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 08:16:32 'name': 'releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675', 08:16:32 'notification_topics': [], 08:16:32 'outputs': [{'description': 'IP addresses of the 1st vm types', 08:16:32 'output_key': 'vm_0_ips', 08:16:32 'output_value': [None, None, None]}, 08:16:32 {'description': 'IP addresses of the 2nd vm types', 08:16:32 'output_key': 'vm_1_ips', 08:16:32 'output_value': [None]}], 08:16:32 'owner_id': ****, 08:16:32 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 08:16:32 'OS::stack_id': '48b26a3b-58d3-4ee4-89f5-696b670f2035', 08:16:32 'OS::stack_name': 'releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675', 08:16:32 'job_name': '36866-675', 08:16:32 'silo': 'releng', 08:16:32 'vm_0_count': '3', 08:16:32 'vm_0_flavor': 'v3-standard-4', 08:16:32 'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - ' 08:16:32 '20260301-010217.216', 08:16:32 'vm_1_count': '1', 08:16:32 'vm_1_flavor': 'v3-standard-2', 08:16:32 'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 ' 08:16:32 '- 20250917-133034.654'}, 08:16:32 'parent_id': None, 08:16:32 'replaced': None, 08:16:32 'status': 'CREATE_FAILED', 08:16:32 'status_reason': 'Resource CREATE failed: Forbidden: ' 08:16:32 'resources.vm_0_group.resources[0].resources.instance: Quota ' 08:16:32 'exceeded for ram: Requested 16384, but already used 991232 ' 08:16:32 'of 1000000 ram (HTTP 403) (Request-ID: ' 08:16:32 'req-0c7c0771-ee7c-4e68-ae2f-193ac646a673)', 08:16:32 'tags': [], 08:16:32 'template': None, 08:16:32 'template_description': 'No description', 08:16:32 'template_url': None, 08:16:32 'timeout_mins': 15, 08:16:32 'unchanged': None, 08:16:32 'updated': None, 08:16:32 'updated_at': None, 08:16:32 'user_project_id': 'de8b17c086244ef49e181ed049d3c7b9'} 08:16:32 ------------------------------------ 08:16:32 + popd 08:16:32 /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium 08:16:32 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash -l /tmp/jenkins4800754790902166029.sh 08:16:32 ---> Copy SSH public keys to CSIT lab 08:16:32 Setup pyenv: 08:16:32 system 08:16:32 3.8.20 08:16:32 3.9.20 08:16:32 3.10.15 08:16:32 * 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/.python-version) 08:16:32 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-z5Bd from file:/tmp/.os_lf_venv 08:16:32 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 08:16:32 lf-activate-venv(): INFO: Attempting to install with network-safe options... 08:16:34 lf-activate-venv(): INFO: Base packages installed successfully 08:16:34 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 08:16:47 lf-activate-venv(): INFO: Adding /tmp/venv-z5Bd/bin to PATH 08:16:48 Stack not found: releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675 08:16:48 SSH ready on all stack servers. 08:16:48 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash -l /tmp/jenkins3319300318728401523.sh 08:16:48 Setup pyenv: 08:16:48 system 08:16:48 3.8.20 08:16:48 3.9.20 08:16:48 3.10.15 08:16:48 * 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/.python-version) 08:16:52 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-bckF 08:16:52 lf-activate-venv(): INFO: Save venv in file: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/.robot_venv 08:16:52 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 08:16:52 lf-activate-venv(): INFO: Attempting to install with network-safe options... 08:16:56 lf-activate-venv(): INFO: Base packages installed successfully 08:16:56 lf-activate-venv(): INFO: Installing additional packages: setuptools wheel 08:16:58 lf-activate-venv(): INFO: Adding /tmp/venv-bckF/bin to PATH 08:16:58 + echo 'Installing Python Requirements' 08:16:58 Installing Python Requirements 08:16:58 + cat 08:16:58 + python -m pip install -r requirements.txt 08:16:58 Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple 08:16:58 Collecting docker-py (from -r requirements.txt (line 1)) 08:16:58 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) 08:16:59 Collecting ipaddr (from -r requirements.txt (line 2)) 08:16:59 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) 08:16:59 Installing build dependencies: started 08:16:59 Installing build dependencies: finished with status 'done' 08:16:59 Getting requirements to build wheel: started 08:17:00 Getting requirements to build wheel: finished with status 'done' 08:17:00 Preparing metadata (pyproject.toml): started 08:17:00 Preparing metadata (pyproject.toml): finished with status 'done' 08:17:00 Collecting netaddr (from -r requirements.txt (line 3)) 08:17:00 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB) 08:17:00 Collecting netifaces (from -r requirements.txt (line 4)) 08:17:00 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB) 08:17:00 Installing build dependencies: started 08:17:01 Installing build dependencies: finished with status 'done' 08:17:01 Getting requirements to build wheel: started 08:17:01 Getting requirements to build wheel: finished with status 'done' 08:17:01 Preparing metadata (pyproject.toml): started 08:17:02 Preparing metadata (pyproject.toml): finished with status 'done' 08:17:02 Collecting pyhocon (from -r requirements.txt (line 5)) 08:17:02 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.63/pyhocon-0.3.63.tar.gz (307 kB) 08:17:02 Installing build dependencies: started 08:17:03 Installing build dependencies: finished with status 'done' 08:17:03 Getting requirements to build wheel: started 08:17:03 Getting requirements to build wheel: finished with status 'done' 08:17:03 Preparing metadata (pyproject.toml): started 08:17:03 Preparing metadata (pyproject.toml): finished with status 'done' 08:17:03 Collecting requests (from -r requirements.txt (line 6)) 08:17:03 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.33.1/requests-2.33.1-py3-none-any.whl (64 kB) 08:17:03 Collecting robotframework (from -r requirements.txt (line 7)) 08:17:03 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.4.2/robotframework-7.4.2-py3-none-any.whl (807 kB) 08:17:04 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 807.1/807.1 kB 35.0 MB/s 0:00:00 08:17:04 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) 08:17:04 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) 08:17:04 Installing build dependencies: started 08:17:04 Installing build dependencies: finished with status 'done' 08:17:04 Getting requirements to build wheel: started 08:17:05 Getting requirements to build wheel: finished with status 'done' 08:17:05 Preparing metadata (pyproject.toml): started 08:17:05 Preparing metadata (pyproject.toml): finished with status 'done' 08:17:05 Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9)) 08:17:05 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB) 08:17:05 Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) 08:17:05 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) 08:17:05 Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) 08:17:05 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) 08:17:05 Installing build dependencies: started 08:17:06 Installing build dependencies: finished with status 'done' 08:17:06 Getting requirements to build wheel: started 08:17:07 Getting requirements to build wheel: finished with status 'done' 08:17:07 Preparing metadata (pyproject.toml): started 08:17:07 Preparing metadata (pyproject.toml): finished with status 'done' 08:17:07 Collecting scapy (from -r requirements.txt (line 12)) 08:17:07 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.7.0/scapy-2.7.0-py3-none-any.whl (2.6 MB) 08:17:07 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 21.7 MB/s 0:00:00 08:17:07 Collecting jsonpath-rw (from -r requirements.txt (line 15)) 08:17:07 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) 08:17:07 Installing build dependencies: started 08:17:08 Installing build dependencies: finished with status 'done' 08:17:08 Getting requirements to build wheel: started 08:17:08 Getting requirements to build wheel: finished with status 'done' 08:17:08 Preparing metadata (pyproject.toml): started 08:17:08 Preparing metadata (pyproject.toml): finished with status 'done' 08:17:09 Collecting elasticsearch (from -r requirements.txt (line 18)) 08:17:09 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.3.0/elasticsearch-9.3.0-py3-none-any.whl (979 kB) 08:17:09 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 979.4/979.4 kB 34.4 MB/s 0:00:00 08:17:09 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) 08:17:09 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB) 08:17:09 Collecting pyangbind (from -r requirements.txt (line 22)) 08:17:09 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.7/pyangbind-0.8.7-py3-none-any.whl (52 kB) 08:17:09 Collecting isodate (from -r requirements.txt (line 25)) 08:17:09 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB) 08:17:09 Collecting jmespath (from -r requirements.txt (line 28)) 08:17:09 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.1.0/jmespath-1.1.0-py3-none-any.whl (20 kB) 08:17:09 Collecting jsonpatch (from -r requirements.txt (line 31)) 08:17:09 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) 08:17:09 Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 08:17:09 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/4.0.0/paramiko-4.0.0-py3-none-any.whl (223 kB) 08:17:09 Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 08:17:09 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB) 08:17:09 Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) 08:17:09 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) 08:17:09 Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) 08:17:09 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB) 08:17:09 Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) 08:17:09 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.9.0/websocket_client-1.9.0-py3-none-any.whl (82 kB) 08:17:09 Collecting pyparsing>=3.0.0 (from pyhocon->-r requirements.txt (line 5)) 08:17:09 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.3.2/pyparsing-3.3.2-py3-none-any.whl (122 kB) 08:17:10 Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) 08:17:10 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.6/charset_normalizer-3.4.6-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (204 kB) 08:17:10 Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) 08:17:10 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.11/idna-3.11-py3-none-any.whl (71 kB) 08:17:10 Collecting urllib3<3,>=1.26 (from requests->-r requirements.txt (line 6)) 08:17:10 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.6.3/urllib3-2.6.3-py3-none-any.whl (131 kB) 08:17:10 Collecting certifi>=2023.5.7 (from requests->-r requirements.txt (line 6)) 08:17:10 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2026.2.25/certifi-2026.2.25-py3-none-any.whl (153 kB) 08:17:10 Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) 08:17:10 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.7/webtest-3.0.7-py3-none-any.whl (32 kB) 08:17:10 Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) 08:17:10 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.1.1/jsonpointer-3.1.1-py3-none-any.whl (7.7 kB) 08:17:10 Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) 08:17:10 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.8.0/robotframework_seleniumlibrary-6.8.0-py3-none-any.whl (104 kB) 08:17:10 Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) 08:17:10 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) 08:17:10 Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) 08:17:10 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB) 08:17:10 Collecting anyio (from elasticsearch->-r requirements.txt (line 18)) 08:17:10 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/anyio/4.13.0/anyio-4.13.0-py3-none-any.whl (114 kB) 08:17:10 Collecting elastic-transport<10,>=9.2.0 (from elasticsearch->-r requirements.txt (line 18)) 08:17:10 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/9.2.1/elastic_transport-9.2.1-py3-none-any.whl (65 kB) 08:17:10 Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18)) 08:17:10 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 08:17:10 Collecting sniffio (from elasticsearch->-r requirements.txt (line 18)) 08:17:10 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) 08:17:10 Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18)) 08:17:10 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.15.0/typing_extensions-4.15.0-py3-none-any.whl (44 kB) 08:17:10 Collecting elasticsearch (from -r requirements.txt (line 18)) 08:17:10 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.19.3/elasticsearch-8.19.3-py3-none-any.whl (952 kB) 08:17:11 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 952.8/952.8 kB 36.4 MB/s 0:00:00 08:17:11 INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while. 08:17:11 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) 08:17:11 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB) 08:17:11 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.0/elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB) 08:17:11 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.16.0/elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB) 08:17:11 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.15.4/elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB) 08:17:11 Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18)) 08:17:11 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB) 08:17:11 Collecting pyang (from pyangbind->-r requirements.txt (line 22)) 08:17:11 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.7.1/pyang-2.7.1-py2.py3-none-any.whl (598 kB) 08:17:11 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 22.9 MB/s 0:00:00 08:17:11 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) 08:17:11 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.0.2/lxml-6.0.2-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB) 08:17:12 Collecting regex (from pyangbind->-r requirements.txt (line 22)) 08:17:12 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2026.3.32/regex-2026.3.32-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (798 kB) 08:17:12 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 798.3/798.3 kB 27.5 MB/s 0:00:00 08:17:12 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) 08:17:12 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) 08:17:13 Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 08:17:13 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/5.0.0/bcrypt-5.0.0-cp39-abi3-manylinux_2_34_x86_64.whl (278 kB) 08:17:13 Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 08:17:13 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/46.0.6/cryptography-46.0.6-cp311-abi3-manylinux_2_34_x86_64.whl (4.5 MB) 08:17:13 Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 08:17:13 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/invoke/2.2.1/invoke-2.2.1-py3-none-any.whl (160 kB) 08:17:13 Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 08:17:13 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.6.2/pynacl-1.6.2-cp38-abi3-manylinux_2_34_x86_64.whl (1.4 MB) 08:17:13 Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 08:17:14 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/2.0.0/cffi-2.0.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (215 kB) 08:17:14 Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 08:17:14 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/3.0/pycparser-3.0-py3-none-any.whl (48 kB) 08:17:14 Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 08:17:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.41.0/selenium-4.41.0-py3-none-any.whl (9.5 MB) 08:17:14 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.5/9.5 MB 71.6 MB/s 0:00:00 08:17:14 Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 08:17:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.5.0/robotframework_pythonlibcore-4.5.0-py3-none-any.whl (19 kB) 08:17:14 Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 08:17:14 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.3.1/click-8.3.1-py3-none-any.whl (108 kB) 08:17:14 Collecting trio<1.0,>=0.31.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 08:17:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.33.0/trio-0.33.0-py3-none-any.whl (510 kB) 08:17:14 Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 08:17:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB) 08:17:14 Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 08:17:14 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/26.1.0/attrs-26.1.0-py3-none-any.whl (67 kB) 08:17:14 Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 08:17:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) 08:17:14 Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 08:17:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) 08:17:14 Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 08:17:15 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.3.2/wsproto-1.3.2-py3-none-any.whl (24 kB) 08:17:15 Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.6.3->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 08:17:15 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) 08:17:15 Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 08:17:15 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB) 08:17:15 Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 08:17:15 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB) 08:17:15 Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 08:17:15 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.14.3/beautifulsoup4-4.14.3-py3-none-any.whl (107 kB) 08:17:15 Collecting h11<1,>=0.16.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 08:17:15 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB) 08:17:15 Collecting soupsieve>=1.6.1 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 08:17:15 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.8.3/soupsieve-2.8.3-py3-none-any.whl (37 kB) 08:17:15 Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, pyhocon, robotframework-httplibrary, jsonpath-rw 08:17:15 Building wheel for robotframework-sshlibrary (pyproject.toml): started 08:17:15 Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done' 08:17:15 Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=6953911c309940cec16ecab73f6f60def53be8f219edb4af9ff772a1d99bd762 08:17:15 Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc 08:17:15 Building wheel for ipaddr (pyproject.toml): started 08:17:15 Building wheel for ipaddr (pyproject.toml): finished with status 'done' 08:17:15 Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18355 sha256=dab5cf809a9ed2cd305bf06d8df8ab02630833de79e1be405a6216bdad8134df 08:17:15 Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf 08:17:15 Building wheel for netifaces (pyproject.toml): started 08:17:19 Building wheel for netifaces (pyproject.toml): finished with status 'done' 08:17:19 Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=34977 sha256=87904d4ad1e09288b82848c8f4fa2a243a038c808aeb4996acebe1c8c127304e 08:17:19 Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9 08:17:19 Building wheel for pyhocon (pyproject.toml): started 08:17:19 Building wheel for pyhocon (pyproject.toml): finished with status 'done' 08:17:19 Created wheel for pyhocon: filename=pyhocon-0.3.63-py3-none-any.whl size=24721 sha256=2b53ee7691c5c6c9e93513650b0c133cd62e20565d15b76d364686adeb5e83c8 08:17:19 Stored in directory: /home/jenkins/.cache/pip/wheels/ce/9e/92/cb17e17d79fafd46a767074b3ed1dca8f78036163f9bea914d 08:17:19 Building wheel for robotframework-httplibrary (pyproject.toml): started 08:17:20 Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done' 08:17:20 Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10014 sha256=54883074becc493f2b7bc2e74a739e157a597d645dbfdf9313f64d1db89b824e 08:17:20 Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed 08:17:20 Building wheel for jsonpath-rw (pyproject.toml): started 08:17:20 Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done' 08:17:20 Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=e5b64ff3fd1d969b43afd33f93ba7bbfd77e5a5bb4eb952927aa06a1ee59e0d4 08:17:20 Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb 08:17:20 Successfully built robotframework-sshlibrary ipaddr netifaces pyhocon robotframework-httplibrary jsonpath-rw 08:17:20 Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library 08:17:28 08:17:28 Successfully installed WebOb-1.8.9 attrs-26.1.0 bcrypt-5.0.0 beautifulsoup4-4.14.3 certifi-2026.2.25 cffi-2.0.0 charset_normalizer-3.4.6 click-8.3.1 cryptography-46.0.6 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.19.3 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.11 invoke-2.2.1 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.1.0 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.1.1 lxml-6.0.2 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-4.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.7 pycparser-3.0 pyhocon-0.3.63 pynacl-1.6.2 pyparsing-3.3.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2026.3.32 requests-2.33.1 robotframework-7.4.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.5.0 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.8.0 robotframework-sshlibrary-3.8.0 scapy-2.7.0 scp-0.15.0 selenium-4.41.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.8.3 trio-0.33.0 trio-websocket-0.12.2 typing-extensions-4.15.0 urllib3-2.6.3 waitress-3.0.2 websocket-client-1.9.0 webtest-3.0.7 wsproto-1.3.2 08:17:28 + pip freeze 08:17:28 attrs==26.1.0 08:17:28 bcrypt==5.0.0 08:17:28 beautifulsoup4==4.14.3 08:17:28 certifi==2026.2.25 08:17:28 cffi==2.0.0 08:17:28 charset-normalizer==3.4.6 08:17:28 click==8.3.1 08:17:28 cryptography==46.0.6 08:17:28 decorator==5.2.1 08:17:28 distlib==0.4.0 08:17:28 docker-py==1.10.6 08:17:28 docker-pycreds==0.4.0 08:17:28 elastic-transport==8.17.1 08:17:28 elasticsearch==8.19.3 08:17:28 elasticsearch-dsl==8.15.4 08:17:28 enum34==1.1.10 08:17:28 filelock==3.25.2 08:17:28 h11==0.16.0 08:17:28 idna==3.11 08:17:28 invoke==2.2.1 08:17:28 ipaddr==2.2.0 08:17:28 isodate==0.7.2 08:17:28 jmespath==1.1.0 08:17:28 jsonpatch==1.33 08:17:28 jsonpath-rw==1.4.0 08:17:28 jsonpointer==3.1.1 08:17:28 lxml==6.0.2 08:17:28 netaddr==1.3.0 08:17:28 netifaces==0.11.0 08:17:28 outcome==1.3.0.post0 08:17:28 packaging==26.0 08:17:28 paramiko==4.0.0 08:17:28 platformdirs==4.9.4 08:17:28 ply==3.11 08:17:28 pyang==2.7.1 08:17:28 pyangbind==0.8.7 08:17:28 pycparser==3.0 08:17:28 pyhocon==0.3.63 08:17:28 PyNaCl==1.6.2 08:17:28 pyparsing==3.3.2 08:17:28 PySocks==1.7.1 08:17:28 python-dateutil==2.9.0.post0 08:17:28 python-discovery==1.2.1 08:17:28 regex==2026.3.32 08:17:28 requests==2.33.1 08:17:28 robotframework==7.4.2 08:17:28 robotframework-httplibrary==0.4.2 08:17:28 robotframework-pythonlibcore==4.5.0 08:17:28 robotframework-requests==0.9.7 08:17:28 robotframework-selenium2library==3.0.0 08:17:28 robotframework-seleniumlibrary==6.8.0 08:17:28 robotframework-sshlibrary==3.8.0 08:17:28 scapy==2.7.0 08:17:28 scp==0.15.0 08:17:28 selenium==4.41.0 08:17:28 six==1.17.0 08:17:28 sniffio==1.3.1 08:17:28 sortedcontainers==2.4.0 08:17:28 soupsieve==2.8.3 08:17:28 trio==0.33.0 08:17:28 trio-websocket==0.12.2 08:17:28 typing_extensions==4.15.0 08:17:28 urllib3==2.6.3 08:17:28 virtualenv==21.2.0 08:17:28 waitress==3.0.2 08:17:28 WebOb==1.8.9 08:17:28 websocket-client==1.9.0 08:17:28 WebTest==3.0.7 08:17:28 wsproto==1.3.2 08:17:28 [EnvInject] - Injecting environment variables from a build step. 08:17:28 [EnvInject] - Injecting as environment variables the properties file path 'env.properties' 08:17:28 [EnvInject] - Variables injected successfully. 08:17:28 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash -l /tmp/jenkins3901223864748164512.sh 08:17:28 Setup pyenv: 08:17:28 system 08:17:28 3.8.20 08:17:28 3.9.20 08:17:28 3.10.15 08:17:28 * 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/.python-version) 08:17:29 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-z5Bd from file:/tmp/.os_lf_venv 08:17:29 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 08:17:29 lf-activate-venv(): INFO: Attempting to install with network-safe options... 08:17:31 lf-activate-venv(): INFO: Base packages installed successfully 08:17:31 lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq 08:17:38 lf-activate-venv(): INFO: Adding /tmp/venv-z5Bd/bin to PATH 08:17:38 + ODL_SYSTEM=() 08:17:38 + TOOLS_SYSTEM=() 08:17:38 + OPENSTACK_SYSTEM=() 08:17:38 + OPENSTACK_CONTROLLERS=() 08:17:38 + mapfile -t ADDR 08:17:38 ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' 08:17:38 ++ openstack stack show -f json -c outputs releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675 08:17:40 Stack not found: releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675 08:17:40 + for i in "${ADDR[@]}" 08:17:40 ++ ssh '' hostname -s 08:17:40 ssh: Could not resolve hostname : Device or resource busy 08:17:40 + REMHOST= 08:17:40 + case ${REMHOST} in 08:17:40 + TOOLS_SYSTEM=("${TOOLS_SYSTEM[@]}" "${i}") 08:17:40 + echo NUM_ODL_SYSTEM=0 08:17:40 + echo NUM_TOOLS_SYSTEM=1 08:17:40 + '[' '' == yes ']' 08:17:40 + NUM_OPENSTACK_SYSTEM=0 08:17:40 + echo NUM_OPENSTACK_SYSTEM=0 08:17:40 + '[' 0 -eq 2 ']' 08:17:40 + echo ODL_SYSTEM_IP= 08:17:40 ++ seq 0 -1 08:17:40 + echo TOOLS_SYSTEM_IP= 08:17:40 ++ seq 0 0 08:17:40 + for i in $(seq 0 $(( ${#TOOLS_SYSTEM[@]} - 1 ))) 08:17:40 + echo TOOLS_SYSTEM_1_IP= 08:17:40 + openstack_index=0 08:17:40 + NUM_OPENSTACK_CONTROL_NODES=1 08:17:40 + echo NUM_OPENSTACK_CONTROL_NODES=1 08:17:40 ++ seq 0 0 08:17:40 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) 08:17:40 + echo OPENSTACK_CONTROL_NODE_1_IP= 08:17:40 + NUM_OPENSTACK_COMPUTE_NODES=-1 08:17:40 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 08:17:40 + '[' -1 -ge 2 ']' 08:17:40 ++ seq 0 -2 08:17:40 + NUM_OPENSTACK_HAPROXY_NODES=0 08:17:40 + echo NUM_OPENSTACK_HAPROXY_NODES=0 08:17:40 ++ seq 0 -1 08:17:40 + echo 'Contents of slave_addresses.txt:' 08:17:40 Contents of slave_addresses.txt: 08:17:40 + cat slave_addresses.txt 08:17:40 NUM_ODL_SYSTEM=0 08:17:40 NUM_TOOLS_SYSTEM=1 08:17:40 NUM_OPENSTACK_SYSTEM=0 08:17:40 ODL_SYSTEM_IP= 08:17:40 TOOLS_SYSTEM_IP= 08:17:40 TOOLS_SYSTEM_1_IP= 08:17:40 NUM_OPENSTACK_CONTROL_NODES=1 08:17:40 OPENSTACK_CONTROL_NODE_1_IP= 08:17:40 NUM_OPENSTACK_COMPUTE_NODES=-1 08:17:40 NUM_OPENSTACK_HAPROXY_NODES=0 08:17:40 [EnvInject] - Injecting environment variables from a build step. 08:17:40 [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' 08:17:40 [EnvInject] - Variables injected successfully. 08:17:40 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/sh /tmp/jenkins6882234740533345540.sh 08:17:40 Preparing for JRE Version 21 08:17:40 Karaf artifact is karaf 08:17:40 Karaf project is integration 08:17:40 Java home is /usr/lib/jvm/java-21-openjdk-amd64 08:17:40 [EnvInject] - Injecting environment variables from a build step. 08:17:40 [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' 08:17:40 [EnvInject] - Variables injected successfully. 08:17:40 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins14854992893874068960.sh 08:17:40 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories//autorelease-9697/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip 08:17:40 Distribution bundle is karaf-0.22.2.zip 08:17:40 Distribution bundle version is 0.22.2 08:17:40 Distribution folder is karaf-0.22.2 08:17:40 Nexus prefix is https://nexus.opendaylight.org 08:17:40 [EnvInject] - Injecting environment variables from a build step. 08:17:40 [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' 08:17:40 [EnvInject] - Variables injected successfully. 08:17:40 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash -l /tmp/jenkins4109572946964296503.sh 08:17:40 Setup pyenv: 08:17:40 system 08:17:40 3.8.20 08:17:40 3.9.20 08:17:40 3.10.15 08:17:40 * 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/.python-version) 08:17:40 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-z5Bd from file:/tmp/.os_lf_venv 08:17:40 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 08:17:40 lf-activate-venv(): INFO: Attempting to install with network-safe options... 08:17:42 lf-activate-venv(): INFO: Base packages installed successfully 08:17:42 lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient 08:17:47 lf-activate-venv(): INFO: Adding /tmp/venv-z5Bd/bin to PATH 08:17:47 Copying common-functions.sh to /tmp 08:17:49 Stack not found: releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675 08:17:49 Copying common-functions.sh to :/tmp 08:17:49 cp: cannot create regular file ':/tmp': No such file or directory 08:17:49 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins5982252502477185194.sh 08:17:49 common-functions.sh is being sourced 08:17:49 common-functions environment: 08:17:49 MAVENCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg 08:17:49 ACTUALFEATURES: 08:17:49 FEATURESCONF: /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg 08:17:49 CUSTOMPROP: /tmp/karaf-0.22.2/etc/custom.properties 08:17:49 LOGCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg 08:17:49 MEMCONF: /tmp/karaf-0.22.2/bin/setenv 08:17:49 CONTROLLERMEM: 2048m 08:17:49 AKKACONF: /tmp/karaf-0.22.2/configuration/initial/pekko.conf 08:17:49 MODULESCONF: /tmp/karaf-0.22.2/configuration/initial/modules.conf 08:17:49 MODULESHARDSCONF: /tmp/karaf-0.22.2/configuration/initial/module-shards.conf 08:17:49 SUITES: 08:17:49 08:17:49 ################################################# 08:17:49 ## Configure Cluster and Start ## 08:17:49 ################################################# 08:17:49 ACTUALFEATURES: odl-infrautils-ready,odl-jolokia,odl-ovsdb-southbound-impl-rest 08:17:49 SPACE_SEPARATED_FEATURES: odl-infrautils-ready odl-jolokia odl-ovsdb-southbound-impl-rest 08:17:49 Locating script plan to use... 08:17:49 Finished running script plans 08:17:49 Locating config plan to use... 08:17:49 Finished running config plans 08:17:49 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins1411731757328952959.sh 08:17:49 common-functions.sh is being sourced 08:17:49 common-functions environment: 08:17:49 MAVENCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg 08:17:49 ACTUALFEATURES: 08:17:49 FEATURESCONF: /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg 08:17:49 CUSTOMPROP: /tmp/karaf-0.22.2/etc/custom.properties 08:17:49 LOGCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg 08:17:49 MEMCONF: /tmp/karaf-0.22.2/bin/setenv 08:17:49 CONTROLLERMEM: 2048m 08:17:49 AKKACONF: /tmp/karaf-0.22.2/configuration/initial/pekko.conf 08:17:49 MODULESCONF: /tmp/karaf-0.22.2/configuration/initial/modules.conf 08:17:49 MODULESHARDSCONF: /tmp/karaf-0.22.2/configuration/initial/module-shards.conf 08:17:49 SUITES: 08:17:49 08:17:49 + echo '#################################################' 08:17:49 ################################################# 08:17:49 + echo '## Verify Cluster is UP ##' 08:17:49 ## Verify Cluster is UP ## 08:17:49 + echo '#################################################' 08:17:49 ################################################# 08:17:49 + create_post_startup_script 08:17:49 + cat 08:17:49 + copy_and_run_post_startup_script 08:17:49 + seed_index=1 08:17:49 ++ seq 1 0 08:17:49 + dump_controller_threads 08:17:49 ++ seq 1 0 08:17:49 + '[' 0 -gt 0 ']' 08:17:49 + echo 'Generating controller variables...' 08:17:49 Generating controller variables... 08:17:49 ++ seq 1 0 08:17:49 + echo 'Generating mininet variables...' 08:17:49 Generating mininet variables... 08:17:49 ++ seq 1 1 08:17:49 + for i in $(seq 1 "${NUM_TOOLS_SYSTEM}") 08:17:49 + MININETIP=TOOLS_SYSTEM_1_IP 08:17:49 + tools_variables=' -v TOOLS_SYSTEM_1_IP:' 08:17:49 + get_test_suites SUITES 08:17:49 + local __suite_list=SUITES 08:17:49 + echo 'Locating test plan to use...' 08:17:49 Locating test plan to use... 08:17:49 + testplan_filepath=/w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/testplans/ovsdb-upstream-clustering-titanium.txt 08:17:49 + '[' '!' -f /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/testplans/ovsdb-upstream-clustering-titanium.txt ']' 08:17:49 + testplan_filepath=/w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/testplans/ovsdb-upstream-clustering.txt 08:17:49 + '[' disabled '!=' disabled ']' 08:17:49 + echo 'Changing the testplan path...' 08:17:49 Changing the testplan path... 08:17:49 + sed s:integration:/w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/testplans/ovsdb-upstream-clustering.txt 08:17:49 + cat testplan.txt 08:17:49 # Place the suites in run order: 08:17:49 /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster 08:17:49 /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster 08:17:49 + '[' -z '' ']' 08:17:49 ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt 08:17:49 ++ tr '\012' ' ' 08:17:49 + suite_list='/w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster ' 08:17:49 + eval 'SUITES='\''/w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster '\''' 08:17:49 ++ SUITES='/w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster ' 08:17:49 + echo 'Starting Robot test suites /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster ...' 08:17:49 Starting Robot test suites /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster ... 08:17:49 + robot -N ovsdb-upstream-clustering.txt --removekeywords wuks -e exclude -e skip_if_titanium -v BUNDLEFOLDER:karaf-0.22.2 -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories//autorelease-9697/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip -v CONTROLLER: -v CONTROLLER1: -v CONTROLLER2: -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:0 -v NUM_TOOLS_SYSTEM:1 -v ODL_STREAM:titanium -v ODL_SYSTEM_IP: -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_1_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/test/csit/suites/ovsdb/Southbound_Cluster 08:17:49 ============================================================================== 08:17:49 ovsdb-upstream-clustering.txt 08:17:49 ============================================================================== 08:17:49 ovsdb-upstream-clustering.txt.Southbound Cluster 08:17:49 ============================================================================== 08:17:50 ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster :... 08:17:50 ============================================================================== 08:17:50 Check Shards Status Before Fail :: Check Status for all shards in ... | FAIL | 08:17:50 No leader found. 08:17:50 ------------------------------------------------------------------------------ 08:17:50 Start OVS Multiple Connections :: Connect OVS to all cluster insta... | FAIL | 08:17:50 OSError: [Errno 16] Device or resource busy 08:17:50 ------------------------------------------------------------------------------ 08:17:50 Check Entity Owner Status And Find Owner and Candidate Before Fail... | FAIL | 08:17:50 Variable '${ovsdb_uuid}' not found. 08:17:50 ------------------------------------------------------------------------------ 08:17:50 Create Bridge Manually and Verify Before Fail :: Create bridge wit... | FAIL | 08:17:50 OSError: [Errno 16] Device or resource busy 08:17:50 ------------------------------------------------------------------------------ 08:17:50 Add Port Manually and Verify Before Fail :: Add port with OVS comm... | FAIL | 08:17:50 OSError: [Errno 16] Device or resource busy 08:17:50 ------------------------------------------------------------------------------ 08:17:50 Create Tap Device Before Fail :: Create tap devices to add to the ... | FAIL | 08:17:50 OSError: [Errno 16] Device or resource busy 08:17:50 ------------------------------------------------------------------------------ 08:17:50 Add Tap Device Manually and Verify Before Fail :: Add tap devices ... | FAIL | 08:17:50 OSError: [Errno 16] Device or resource busy 08:17:50 ------------------------------------------------------------------------------ 08:17:50 Delete the Bridge Manually and Verify Before Fail :: Delete bridge... | FAIL | 08:17:50 OSError: [Errno 16] Device or resource busy 08:17:50 ------------------------------------------------------------------------------ 08:17:50 Create Bridge In Owner and Verify Before Fail :: Create Bridge in ... | FAIL | 08:17:50 Variable '${original_owner}' not found. 08:17:50 ------------------------------------------------------------------------------ 08:17:50 Create Port In Owner and Verify Before Fail :: Create Port in Owne... | FAIL | 08:17:50 Variable '${original_owner}' not found. 08:17:50 ------------------------------------------------------------------------------ 08:17:50 Modify the destination IP of Port In Owner Before Fail :: Modify t... | FAIL | 08:17:50 Variable '${original_owner}' not found. 08:17:50 ------------------------------------------------------------------------------ 08:17:50 Verify Port Is Modified Before Fail :: Verify port is modified in ... | FAIL | 08:17:56 Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Delete Port In Owner Before Fail :: Delete port in Owner and verif... | FAIL | 08:17:56 Variable '${original_owner}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Delete Bridge In Owner And Verify Before Fail :: Delete bridge in ... | FAIL | 08:17:56 Variable '${original_owner}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Kill Owner Instance :: Kill Owner Instance and verify it is dead | FAIL | 08:17:56 Variable '${original_owner}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Check Shards Status After Fail :: Create original cluster list and... | FAIL | 08:17:56 Variable '${new_cluster_list}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Check Entity Owner Status And Find Owner and Candidate After Fail ... | FAIL | 08:17:56 Variable '${ovsdb_uuid}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Create Bridge Manually and Verify After Fail :: Create bridge with... | FAIL | 08:17:56 Variable '${new_cluster_list}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Add Port Manually and Verify After Fail :: Add port with OVS comma... | FAIL | 08:17:56 Variable '${new_cluster_list}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Create Tap Device After Fail :: Create tap devices to add to the b... | FAIL | 08:17:56 OSError: [Errno 16] Device or resource busy 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Add Tap Device Manually and Verify After Fail :: Add tap devices t... | FAIL | 08:17:56 Variable '${new_cluster_list}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Delete the Bridge Manually and Verify After Fail :: Delete bridge ... | FAIL | 08:17:56 Variable '${new_cluster_list}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Create Bridge In Owner and Verify After Fail :: Create Bridge in O... | FAIL | 08:17:56 Variable '${new_owner}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Create Port In Owner and Verify After Fail :: Create Port in Owner... | FAIL | 08:17:56 Variable '${new_owner}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Modify the destination IP of Port In Owner After Fail :: Modify th... | FAIL | 08:17:56 Variable '${new_owner}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Verify Port Is Modified After Fail :: Verify port is modified in a... | FAIL | 08:17:56 Variable '${new_cluster_list}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Start Old Owner Instance :: Start Owner Instance and verify it is ... | FAIL | 08:17:56 Variable '${original_owner}' not found. 08:17:56 ------------------------------------------------------------------------------ 08:17:56 Check Shards Status After Recover :: Create original cluster list ... | FAIL | 08:19:26 Keyword 'Check Ovsdb Shards Status' failed after retrying for 1 minute 30 seconds. The last error was: No leader found. 08:19:26 ------------------------------------------------------------------------------ 08:19:26 Check Entity Owner Status After Recover :: Check Entity Owner Stat... | FAIL | 08:19:26 Variable '${ovsdb_uuid}' not found. 08:19:26 ------------------------------------------------------------------------------ 08:19:26 Create Bridge Manually and Verify After Recover :: Create bridge w... | FAIL | 08:19:26 OSError: [Errno 16] Device or resource busy 08:19:26 ------------------------------------------------------------------------------ 08:19:26 Add Port Manually and Verify After Recover :: Add port with OVS co... | FAIL | 08:19:26 OSError: [Errno 16] Device or resource busy 08:19:26 ------------------------------------------------------------------------------ 08:19:26 Create Tap Device After Recover :: Create tap devices to add to th... | FAIL | 08:19:26 OSError: [Errno 16] Device or resource busy 08:19:26 ------------------------------------------------------------------------------ 08:19:26 Add Tap Device Manually and Verify After Recover :: Add tap device... | FAIL | 08:19:26 OSError: [Errno 16] Device or resource busy 08:19:26 ------------------------------------------------------------------------------ 08:19:26 Delete the Bridge Manually and Verify After Recover :: Delete brid... | FAIL | 08:19:26 OSError: [Errno 16] Device or resource busy 08:19:26 ------------------------------------------------------------------------------ 08:19:26 Verify Modified Port After Recover :: Verify modified port exists ... | FAIL | 08:19:32 Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found. 08:19:32 ------------------------------------------------------------------------------ 08:19:32 Delete Port In New Owner After Recover :: Delete port in Owner and... | FAIL | 08:19:32 Variable '${new_owner}' not found. 08:19:32 ------------------------------------------------------------------------------ 08:19:32 Delete Bridge In New Owner And Verify After Recover :: Delete brid... | FAIL | 08:19:32 Variable '${new_owner}' not found. 08:19:32 ------------------------------------------------------------------------------ 08:19:32 Create Bridge In Old Owner and Verify After Recover :: Create Brid... | FAIL | 08:19:32 Variable '${original_owner}' not found. 08:19:32 ------------------------------------------------------------------------------ 08:19:32 Create Port In Old Owner and Verify After Recover :: Create Port i... | FAIL | 08:19:32 Variable '${original_owner}' not found. 08:19:32 ------------------------------------------------------------------------------ 08:19:32 Modify the destination IP of Port In Old Owner After Recover :: Mo... | FAIL | 08:19:32 Variable '${original_owner}' not found. 08:19:32 ------------------------------------------------------------------------------ 08:19:32 Verify Port Is Modified After Recover :: Verify port is modified i... | FAIL | 08:19:37 Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found. 08:19:37 ------------------------------------------------------------------------------ 08:19:37 Delete Port In Old Owner After Recover :: Delete port in Owner and... | FAIL | 08:19:37 Variable '${original_owner}' not found. 08:19:37 ------------------------------------------------------------------------------ 08:19:37 Delete Bridge In Old Owner And Verify After Recover :: Delete brid... | FAIL | 08:19:37 Variable '${original_owner}' not found. 08:19:37 ------------------------------------------------------------------------------ 08:19:37 Cleans Up Test Environment For Next Suite :: Cleans up test enviro... | FAIL | 08:19:37 OSError: [Errno 16] Device or resource busy 08:19:37 ------------------------------------------------------------------------------ 08:19:37 ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound ... | FAIL | 08:19:37 44 tests, 0 passed, 44 failed 08:19:37 ============================================================================== 08:19:37 ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluster Extensi... 08:19:37 ============================================================================== 08:19:37 Check Shards Status Before Fail :: Check Status for all shards in ... | FAIL | 08:19:37 No leader found. 08:19:37 ------------------------------------------------------------------------------ 08:19:37 Start OVS Multiple Connections :: Connect OVS to all cluster insta... | FAIL | 08:19:37 OSError: [Errno 16] Device or resource busy 08:19:37 ------------------------------------------------------------------------------ 08:19:37 Check Entity Owner Status And Find Owner and Candidate Before Fail... | FAIL | 08:19:37 Variable '${ovsdb_uuid}' not found. 08:19:37 ------------------------------------------------------------------------------ 08:19:37 Create Bridge Manually and Verify Before Fail :: Create bridge wit... | FAIL | 08:19:37 OSError: [Errno 16] Device or resource busy 08:19:37 ------------------------------------------------------------------------------ 08:19:37 Add Port Manually and Verify Before Fail :: Add port with OVS comm... | FAIL | 08:19:37 OSError: [Errno 16] Device or resource busy 08:19:37 ------------------------------------------------------------------------------ 08:19:37 Delete the Bridge Manually and Verify Before Fail :: Delete bridge... | FAIL | 08:19:37 OSError: [Errno 16] Device or resource busy 08:19:37 ------------------------------------------------------------------------------ 08:19:37 Create Bridge In Owner and Verify Before Fail :: Create Bridge in ... | FAIL | 08:19:37 Variable '${original_owner}' not found. 08:19:37 ------------------------------------------------------------------------------ 08:19:37 Create Port In Owner and Verify Before Fail :: Create Port in Owne... | FAIL | 08:19:37 Variable '${original_owner}' not found. 08:19:37 ------------------------------------------------------------------------------ 08:19:37 Modify the destination IP of Port In Owner Before Fail :: Modify t... | FAIL | 08:19:37 Variable '${original_owner}' not found. 08:19:37 ------------------------------------------------------------------------------ 08:19:37 Verify Port Is Modified Before Fail :: Verify port is modified in ... | FAIL | 08:19:42 Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found. 08:19:42 ------------------------------------------------------------------------------ 08:19:42 Delete Port In Owner Before Fail :: Delete port in Owner and verif... | FAIL | 08:19:42 Variable '${original_owner}' not found. 08:19:42 ------------------------------------------------------------------------------ 08:19:42 Delete Bridge In Owner And Verify Before Fail :: Delete bridge in ... | FAIL | 08:19:42 Variable '${original_owner}' not found. 08:19:42 ------------------------------------------------------------------------------ 08:19:42 Kill Candidate Instance :: Kill Owner Instance and verify it is dead | FAIL | 08:19:42 Variable '${original_candidate}' not found. 08:19:42 ------------------------------------------------------------------------------ 08:19:42 Check Shards Status After Fail :: Create original cluster list and... | FAIL | 08:19:42 Variable '${new_cluster_list}' not found. 08:19:42 ------------------------------------------------------------------------------ 08:19:42 Check Entity Owner Status And Find Owner and Candidate After Fail ... | FAIL | 08:19:43 Variable '${ovsdb_uuid}' not found. 08:19:43 ------------------------------------------------------------------------------ 08:19:43 Create Bridge Manually and Verify After Fail :: Create bridge with... | FAIL | 08:19:43 Variable '${new_cluster_list}' not found. 08:19:43 ------------------------------------------------------------------------------ 08:19:43 Add Port Manually and Verify After Fail :: Add port with OVS comma... | FAIL | 08:19:43 Variable '${new_cluster_list}' not found. 08:19:43 ------------------------------------------------------------------------------ 08:19:43 Delete the Bridge Manually and Verify After Fail :: Delete bridge ... | FAIL | 08:19:43 Variable '${new_cluster_list}' not found. 08:19:43 ------------------------------------------------------------------------------ 08:19:43 Create Bridge In Owner and Verify After Fail :: Create Bridge in O... | FAIL | 08:19:43 Variable '${new_owner}' not found. 08:19:43 ------------------------------------------------------------------------------ 08:19:43 Create Port In Owner and Verify After Fail :: Create Port in Owner... | FAIL | 08:19:43 Variable '${new_owner}' not found. 08:19:43 ------------------------------------------------------------------------------ 08:19:43 Modify the destination IP of Port In Owner After Fail :: Modify th... | FAIL | 08:19:43 Variable '${new_owner}' not found. 08:19:43 ------------------------------------------------------------------------------ 08:19:43 Verify Port Is Modified After Fail :: Verify port is modified in a... | FAIL | 08:19:43 Variable '${new_cluster_list}' not found. 08:19:43 ------------------------------------------------------------------------------ 08:19:43 Start Old Candidate Instance :: Start Owner Instance and verify it... | FAIL | 08:19:43 Variable '${original_candidate}' not found. 08:19:43 ------------------------------------------------------------------------------ 08:19:43 Check Shards Status After Recover :: Create original cluster list ... | FAIL | 08:21:13 Keyword 'Check Ovsdb Shards Status' failed after retrying for 1 minute 30 seconds. The last error was: No leader found. 08:21:13 ------------------------------------------------------------------------------ 08:21:13 Check Entity Owner Status After Recover :: Check Entity Owner Stat... | FAIL | 08:21:13 Variable '${ovsdb_uuid}' not found. 08:21:13 ------------------------------------------------------------------------------ 08:21:13 Create Bridge Manually and Verify After Recover :: Create bridge w... | FAIL | 08:21:13 OSError: [Errno 16] Device or resource busy 08:21:13 ------------------------------------------------------------------------------ 08:21:13 Add Port Manually and Verify After Recover :: Add port with OVS co... | FAIL | 08:21:13 OSError: [Errno 16] Device or resource busy 08:21:13 ------------------------------------------------------------------------------ 08:21:13 Delete the Bridge Manually and Verify After Recover :: Delete brid... | FAIL | 08:21:13 OSError: [Errno 16] Device or resource busy 08:21:13 ------------------------------------------------------------------------------ 08:21:13 Verify Modified Port After Recover :: Verify modified port exists ... | FAIL | 08:21:18 Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found. 08:21:18 ------------------------------------------------------------------------------ 08:21:18 Delete Port In New Owner After Recover :: Delete port in Owner and... | FAIL | 08:21:18 Variable '${new_owner}' not found. 08:21:18 ------------------------------------------------------------------------------ 08:21:18 Delete Bridge In New Owner And Verify After Recover :: Delete brid... | FAIL | 08:21:18 Variable '${new_owner}' not found. 08:21:18 ------------------------------------------------------------------------------ 08:21:18 Create Bridge In Old Candidate and Verify After Recover :: Create ... | FAIL | 08:21:18 Variable '${original_candidate}' not found. 08:21:18 ------------------------------------------------------------------------------ 08:21:18 Create Port In Old Owner and Verify After Recover :: Create Port i... | FAIL | 08:21:18 Variable '${original_candidate}' not found. 08:21:18 ------------------------------------------------------------------------------ 08:21:18 Modify the destination IP of Port In Old Owner After Recover :: Mo... | FAIL | 08:21:19 Variable '${original_candidate}' not found. 08:21:19 ------------------------------------------------------------------------------ 08:21:19 Verify Port Is Modified After Recover :: Verify port is modified i... | FAIL | 08:21:24 Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found. 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Delete Port In Old Owner After Recover :: Delete port in Owner and... | FAIL | 08:21:24 Variable '${original_candidate}' not found. 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Delete Bridge In Old Owner And Verify After Recover :: Delete brid... | FAIL | 08:21:24 Variable '${original_candidate}' not found. 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Cleans Up Test Environment For Next Suite :: Cleans up test enviro... | FAIL | 08:21:24 OSError: [Errno 16] Device or resource busy 08:21:24 ------------------------------------------------------------------------------ 08:21:24 ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluste... | FAIL | 08:21:24 38 tests, 0 passed, 38 failed 08:21:24 ============================================================================== 08:21:24 ovsdb-upstream-clustering.txt.Southbound Cluster | FAIL | 08:21:24 82 tests, 0 passed, 82 failed 08:21:24 ============================================================================== 08:21:24 ovsdb-upstream-clustering.txt.Southbound Cluster 08:21:24 ============================================================================== 08:21:24 ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster :... 08:21:24 ============================================================================== 08:21:24 Check Shards Status Before Fail :: Check Status for all shards in ... | FAIL | 08:21:24 No leader found. 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Start OVS Multiple Connections :: Connect OVS to all cluster insta... | FAIL | 08:21:24 OSError: [Errno 16] Device or resource busy 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Check Entity Owner Status And Find Owner and Candidate Before Fail... | FAIL | 08:21:24 Variable '${ovsdb_uuid}' not found. 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Create Bridge Manually and Verify Before Fail :: Create bridge wit... | FAIL | 08:21:24 OSError: [Errno 16] Device or resource busy 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Add Port Manually and Verify Before Fail :: Add port with OVS comm... | FAIL | 08:21:24 OSError: [Errno 16] Device or resource busy 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Create Tap Device Before Fail :: Create tap devices to add to the ... | FAIL | 08:21:24 OSError: [Errno 16] Device or resource busy 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Add Tap Device Manually and Verify Before Fail :: Add tap devices ... | FAIL | 08:21:24 OSError: [Errno 16] Device or resource busy 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Delete the Bridge Manually and Verify Before Fail :: Delete bridge... | FAIL | 08:21:24 OSError: [Errno 16] Device or resource busy 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Create Bridge In Owner and Verify Before Fail :: Create Bridge in ... | FAIL | 08:21:24 Variable '${original_owner}' not found. 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Create Port In Owner and Verify Before Fail :: Create Port in Owne... | FAIL | 08:21:24 Variable '${original_owner}' not found. 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Modify the destination IP of Port In Owner Before Fail :: Modify t... | FAIL | 08:21:24 Variable '${original_owner}' not found. 08:21:24 ------------------------------------------------------------------------------ 08:21:24 Verify Port Is Modified Before Fail :: Verify port is modified in ... | FAIL | 08:21:29 Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found. 08:21:29 ------------------------------------------------------------------------------ 08:21:29 Delete Port In Owner Before Fail :: Delete port in Owner and verif... | FAIL | 08:21:29 Variable '${original_owner}' not found. 08:21:29 ------------------------------------------------------------------------------ 08:21:29 Delete Bridge In Owner And Verify Before Fail :: Delete bridge in ... | FAIL | 08:21:29 Variable '${original_owner}' not found. 08:21:29 ------------------------------------------------------------------------------ 08:21:29 Kill Owner Instance :: Kill Owner Instance and verify it is dead | FAIL | 08:21:29 Variable '${original_owner}' not found. 08:21:29 ------------------------------------------------------------------------------ 08:21:29 Check Shards Status After Fail :: Create original cluster list and... | FAIL | 08:21:29 Variable '${new_cluster_list}' not found. 08:21:29 ------------------------------------------------------------------------------ 08:21:29 Check Entity Owner Status And Find Owner and Candidate After Fail ... | FAIL | 08:21:29 Variable '${ovsdb_uuid}' not found. 08:21:29 ------------------------------------------------------------------------------ 08:21:29 Create Bridge Manually and Verify After Fail :: Create bridge with... | FAIL | 08:21:29 Variable '${new_cluster_list}' not found. 08:21:29 ------------------------------------------------------------------------------ 08:21:29 Add Port Manually and Verify After Fail :: Add port with OVS comma... | FAIL | 08:21:29 Variable '${new_cluster_list}' not found. 08:21:29 ------------------------------------------------------------------------------ 08:21:29 Create Tap Device After Fail :: Create tap devices to add to the b... | FAIL | 08:21:29 OSError: [Errno 16] Device or resource busy 08:21:29 ------------------------------------------------------------------------------ 08:21:29 Add Tap Device Manually and Verify After Fail :: Add tap devices t... | FAIL | 08:21:30 Variable '${new_cluster_list}' not found. 08:21:30 ------------------------------------------------------------------------------ 08:21:30 Delete the Bridge Manually and Verify After Fail :: Delete bridge ... | FAIL | 08:21:30 Variable '${new_cluster_list}' not found. 08:21:30 ------------------------------------------------------------------------------ 08:21:30 Create Bridge In Owner and Verify After Fail :: Create Bridge in O... | FAIL | 08:21:30 Variable '${new_owner}' not found. 08:21:30 ------------------------------------------------------------------------------ 08:21:30 Create Port In Owner and Verify After Fail :: Create Port in Owner... | FAIL | 08:21:30 Variable '${new_owner}' not found. 08:21:30 ------------------------------------------------------------------------------ 08:21:30 Modify the destination IP of Port In Owner After Fail :: Modify th... | FAIL | 08:21:30 Variable '${new_owner}' not found. 08:21:30 ------------------------------------------------------------------------------ 08:21:30 Verify Port Is Modified After Fail :: Verify port is modified in a... | FAIL | 08:21:30 Variable '${new_cluster_list}' not found. 08:21:30 ------------------------------------------------------------------------------ 08:21:30 Start Old Owner Instance :: Start Owner Instance and verify it is ... | FAIL | 08:21:30 Variable '${original_owner}' not found. 08:21:30 ------------------------------------------------------------------------------ 08:21:30 Check Shards Status After Recover :: Create original cluster list ... | FAIL | 08:23:00 Keyword 'Check Ovsdb Shards Status' failed after retrying for 1 minute 30 seconds. The last error was: No leader found. 08:23:00 ------------------------------------------------------------------------------ 08:23:00 Check Entity Owner Status After Recover :: Check Entity Owner Stat... | FAIL | 08:23:00 Variable '${ovsdb_uuid}' not found. 08:23:00 ------------------------------------------------------------------------------ 08:23:00 Create Bridge Manually and Verify After Recover :: Create bridge w... | FAIL | 08:23:00 OSError: [Errno 16] Device or resource busy 08:23:00 ------------------------------------------------------------------------------ 08:23:00 Add Port Manually and Verify After Recover :: Add port with OVS co... | FAIL | 08:23:00 OSError: [Errno 16] Device or resource busy 08:23:00 ------------------------------------------------------------------------------ 08:23:00 Create Tap Device After Recover :: Create tap devices to add to th... | FAIL | 08:23:00 OSError: [Errno 16] Device or resource busy 08:23:00 ------------------------------------------------------------------------------ 08:23:00 Add Tap Device Manually and Verify After Recover :: Add tap device... | FAIL | 08:23:00 OSError: [Errno 16] Device or resource busy 08:23:00 ------------------------------------------------------------------------------ 08:23:00 Delete the Bridge Manually and Verify After Recover :: Delete brid... | FAIL | 08:23:00 OSError: [Errno 16] Device or resource busy 08:23:00 ------------------------------------------------------------------------------ 08:23:00 Verify Modified Port After Recover :: Verify modified port exists ... | FAIL | 08:23:05 Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found. 08:23:05 ------------------------------------------------------------------------------ 08:23:05 Delete Port In New Owner After Recover :: Delete port in Owner and... | FAIL | 08:23:05 Variable '${new_owner}' not found. 08:23:05 ------------------------------------------------------------------------------ 08:23:05 Delete Bridge In New Owner And Verify After Recover :: Delete brid... | FAIL | 08:23:05 Variable '${new_owner}' not found. 08:23:05 ------------------------------------------------------------------------------ 08:23:05 Create Bridge In Old Owner and Verify After Recover :: Create Brid... | FAIL | 08:23:05 Variable '${original_owner}' not found. 08:23:05 ------------------------------------------------------------------------------ 08:23:05 Create Port In Old Owner and Verify After Recover :: Create Port i... | FAIL | 08:23:05 Variable '${original_owner}' not found. 08:23:05 ------------------------------------------------------------------------------ 08:23:05 Modify the destination IP of Port In Old Owner After Recover :: Mo... | FAIL | 08:23:05 Variable '${original_owner}' not found. 08:23:05 ------------------------------------------------------------------------------ 08:23:05 Verify Port Is Modified After Recover :: Verify port is modified i... | FAIL | 08:23:11 Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found. 08:23:11 ------------------------------------------------------------------------------ 08:23:11 Delete Port In Old Owner After Recover :: Delete port in Owner and... | FAIL | 08:23:11 Variable '${original_owner}' not found. 08:23:11 ------------------------------------------------------------------------------ 08:23:11 Delete Bridge In Old Owner And Verify After Recover :: Delete brid... | FAIL | 08:23:11 Variable '${original_owner}' not found. 08:23:11 ------------------------------------------------------------------------------ 08:23:11 Cleans Up Test Environment For Next Suite :: Cleans up test enviro... | FAIL | 08:23:11 OSError: [Errno 16] Device or resource busy 08:23:11 ------------------------------------------------------------------------------ 08:23:11 ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound ... | FAIL | 08:23:11 44 tests, 0 passed, 44 failed 08:23:11 ============================================================================== 08:23:11 ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluster Extensi... 08:23:11 ============================================================================== 08:23:11 Check Shards Status Before Fail :: Check Status for all shards in ... | FAIL | 08:23:11 No leader found. 08:23:11 ------------------------------------------------------------------------------ 08:23:11 Start OVS Multiple Connections :: Connect OVS to all cluster insta... | FAIL | 08:23:11 OSError: [Errno 16] Device or resource busy 08:23:11 ------------------------------------------------------------------------------ 08:23:11 Check Entity Owner Status And Find Owner and Candidate Before Fail... | FAIL | 08:23:11 Variable '${ovsdb_uuid}' not found. 08:23:11 ------------------------------------------------------------------------------ 08:23:11 Create Bridge Manually and Verify Before Fail :: Create bridge wit... | FAIL | 08:23:11 OSError: [Errno 16] Device or resource busy 08:23:11 ------------------------------------------------------------------------------ 08:23:11 Add Port Manually and Verify Before Fail :: Add port with OVS comm... | FAIL | 08:23:11 OSError: [Errno 16] Device or resource busy 08:23:11 ------------------------------------------------------------------------------ 08:23:11 Delete the Bridge Manually and Verify Before Fail :: Delete bridge... | FAIL | 08:23:11 OSError: [Errno 16] Device or resource busy 08:23:11 ------------------------------------------------------------------------------ 08:23:11 Create Bridge In Owner and Verify Before Fail :: Create Bridge in ... | FAIL | 08:23:11 Variable '${original_owner}' not found. 08:23:11 ------------------------------------------------------------------------------ 08:23:11 Create Port In Owner and Verify Before Fail :: Create Port in Owne... | FAIL | 08:23:11 Variable '${original_owner}' not found. 08:23:11 ------------------------------------------------------------------------------ 08:23:11 Modify the destination IP of Port In Owner Before Fail :: Modify t... | FAIL | 08:23:11 Variable '${original_owner}' not found. 08:23:11 ------------------------------------------------------------------------------ 08:23:11 Verify Port Is Modified Before Fail :: Verify port is modified in ... | FAIL | 08:23:16 Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Delete Port In Owner Before Fail :: Delete port in Owner and verif... | FAIL | 08:23:16 Variable '${original_owner}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Delete Bridge In Owner And Verify Before Fail :: Delete bridge in ... | FAIL | 08:23:16 Variable '${original_owner}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Kill Candidate Instance :: Kill Owner Instance and verify it is dead | FAIL | 08:23:16 Variable '${original_candidate}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Check Shards Status After Fail :: Create original cluster list and... | FAIL | 08:23:16 Variable '${new_cluster_list}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Check Entity Owner Status And Find Owner and Candidate After Fail ... | FAIL | 08:23:16 Variable '${ovsdb_uuid}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Create Bridge Manually and Verify After Fail :: Create bridge with... | FAIL | 08:23:16 Variable '${new_cluster_list}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Add Port Manually and Verify After Fail :: Add port with OVS comma... | FAIL | 08:23:16 Variable '${new_cluster_list}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Delete the Bridge Manually and Verify After Fail :: Delete bridge ... | FAIL | 08:23:16 Variable '${new_cluster_list}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Create Bridge In Owner and Verify After Fail :: Create Bridge in O... | FAIL | 08:23:16 Variable '${new_owner}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Create Port In Owner and Verify After Fail :: Create Port in Owner... | FAIL | 08:23:16 Variable '${new_owner}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Modify the destination IP of Port In Owner After Fail :: Modify th... | FAIL | 08:23:16 Variable '${new_owner}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Verify Port Is Modified After Fail :: Verify port is modified in a... | FAIL | 08:23:16 Variable '${new_cluster_list}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Start Old Candidate Instance :: Start Owner Instance and verify it... | FAIL | 08:23:16 Variable '${original_candidate}' not found. 08:23:16 ------------------------------------------------------------------------------ 08:23:16 Check Shards Status After Recover :: Create original cluster list ... | FAIL | 08:24:47 Keyword 'Check Ovsdb Shards Status' failed after retrying for 1 minute 30 seconds. The last error was: No leader found. 08:24:47 ------------------------------------------------------------------------------ 08:24:47 Check Entity Owner Status After Recover :: Check Entity Owner Stat... | FAIL | 08:24:47 Variable '${ovsdb_uuid}' not found. 08:24:47 ------------------------------------------------------------------------------ 08:24:47 Create Bridge Manually and Verify After Recover :: Create bridge w... | FAIL | 08:24:47 OSError: [Errno 16] Device or resource busy 08:24:47 ------------------------------------------------------------------------------ 08:24:47 Add Port Manually and Verify After Recover :: Add port with OVS co... | FAIL | 08:24:47 OSError: [Errno 16] Device or resource busy 08:24:47 ------------------------------------------------------------------------------ 08:24:47 Delete the Bridge Manually and Verify After Recover :: Delete brid... | FAIL | 08:24:47 OSError: [Errno 16] Device or resource busy 08:24:47 ------------------------------------------------------------------------------ 08:24:47 Verify Modified Port After Recover :: Verify modified port exists ... | FAIL | 08:24:52 Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found. 08:24:52 ------------------------------------------------------------------------------ 08:24:52 Delete Port In New Owner After Recover :: Delete port in Owner and... | FAIL | 08:24:52 Variable '${new_owner}' not found. 08:24:52 ------------------------------------------------------------------------------ 08:24:52 Delete Bridge In New Owner And Verify After Recover :: Delete brid... | FAIL | 08:24:52 Variable '${new_owner}' not found. 08:24:52 ------------------------------------------------------------------------------ 08:24:52 Create Bridge In Old Candidate and Verify After Recover :: Create ... | FAIL | 08:24:52 Variable '${original_candidate}' not found. 08:24:52 ------------------------------------------------------------------------------ 08:24:52 Create Port In Old Owner and Verify After Recover :: Create Port i... | FAIL | 08:24:52 Variable '${original_candidate}' not found. 08:24:52 ------------------------------------------------------------------------------ 08:24:52 Modify the destination IP of Port In Old Owner After Recover :: Mo... | FAIL | 08:24:52 Variable '${original_candidate}' not found. 08:24:52 ------------------------------------------------------------------------------ 08:24:52 Verify Port Is Modified After Recover :: Verify port is modified i... | FAIL | 08:24:57 Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found. 08:24:57 ------------------------------------------------------------------------------ 08:24:57 Delete Port In Old Owner After Recover :: Delete port in Owner and... | FAIL | 08:24:57 Variable '${original_candidate}' not found. 08:24:57 ------------------------------------------------------------------------------ 08:24:57 Delete Bridge In Old Owner And Verify After Recover :: Delete brid... | FAIL | 08:24:57 Variable '${original_candidate}' not found. 08:24:57 ------------------------------------------------------------------------------ 08:24:57 Cleans Up Test Environment For Next Suite :: Cleans up test enviro... | FAIL | 08:24:57 OSError: [Errno 16] Device or resource busy 08:24:57 ------------------------------------------------------------------------------ 08:24:57 ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluste... | FAIL | 08:24:57 38 tests, 0 passed, 38 failed 08:24:57 ============================================================================== 08:24:57 ovsdb-upstream-clustering.txt.Southbound Cluster | FAIL | 08:24:57 82 tests, 0 passed, 82 failed 08:24:57 ============================================================================== 08:24:57 ovsdb-upstream-clustering.txt | FAIL | 08:24:57 164 tests, 0 passed, 164 failed 08:24:57 ============================================================================== 08:24:57 Output: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/output.xml 08:24:58 Log: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/log.html 08:24:58 Report: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/report.html 08:24:59 + true 08:24:59 + echo 'Examining the files in data/log and checking filesize' 08:24:59 Examining the files in data/log and checking filesize 08:24:59 + ssh '' 'ls -altr /tmp/karaf-0.22.2/data/log/' 08:24:59 ssh: Could not resolve hostname : Device or resource busy 08:24:59 Build step 'Execute shell' marked build as failure 08:24:59 $ ssh-agent -k 08:24:59 unset SSH_AUTH_SOCK; 08:24:59 unset SSH_AGENT_PID; 08:24:59 echo Agent pid 3147 killed; 08:24:59 [ssh-agent] Stopped. 08:24:59 Recording plot data 08:24:59 Robot results publisher started... 08:24:59 INFO: Checking test criticality is deprecated and will be dropped in a future release! 08:24:59 -Parsing output xml: 08:25:00 Done! 08:25:00 -Copying log files to build dir: 08:25:00 Done! 08:25:00 -Assigning results to build: 08:25:00 Done! 08:25:00 -Checking thresholds: 08:25:00 Done! 08:25:00 Done publishing Robot results. 08:25:00 [PostBuildScript] - [INFO] Executing post build scripts. 08:25:00 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins13952395043367014704.sh 08:25:00 Archiving csit artifacts 08:25:00 % Total % Received % Xferd Average Speed Time Time Time Current 08:25:00 Dload Upload Total Spent Left Speed 08:25:00 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 516k 0 516k 0 0 1258k 0 --:--:-- --:--:-- --:--:-- 1258k 08:25:01 Archive: robot-plugin.zip 08:25:01 inflating: ./archives/robot-plugin/log.html 08:25:01 inflating: ./archives/robot-plugin/output.xml 08:25:01 inflating: ./archives/robot-plugin/report.html 08:25:01 mv: cannot stat '*.log': No such file or directory 08:25:01 mv: cannot stat '*.log.gz': No such file or directory 08:25:01 mv: cannot stat '*.csv': No such file or directory 08:25:01 mv: cannot stat '*.png': No such file or directory 08:25:01 [PostBuildScript] - [INFO] Executing post build scripts. 08:25:01 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins7673614306818661320.sh 08:25:01 [PostBuildScript] - [INFO] Executing post build scripts. 08:25:01 [EnvInject] - Injecting environment variables from a build step. 08:25:01 [EnvInject] - Injecting as environment variables the properties content 08:25:01 OS_CLOUD=vex 08:25:01 OS_STACK_NAME=releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675 08:25:01 08:25:01 [EnvInject] - Variables injected successfully. 08:25:01 provisioning config files... 08:25:01 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 08:25:02 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins4096852023551493284.sh 08:25:02 ---> openstack-stack-delete.sh 08:25:02 Setup pyenv: 08:25:02 system 08:25:02 3.8.20 08:25:02 3.9.20 08:25:02 3.10.15 08:25:02 * 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/.python-version) 08:25:02 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-z5Bd from file:/tmp/.os_lf_venv 08:25:02 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 08:25:02 lf-activate-venv(): INFO: Attempting to install with network-safe options... 08:25:04 lf-activate-venv(): INFO: Base packages installed successfully 08:25:04 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 08:25:17 lf-activate-venv(): INFO: Adding /tmp/venv-z5Bd/bin to PATH 08:25:17 INFO: Stack cost retrieval disabled, setting cost to 0 08:25:29 INFO: Deleting stack releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675 08:25:29 Successfully deleted stack releng-ovsdb-csit-3node-upstream-clustering-only-titanium-675 08:25:29 [PostBuildScript] - [INFO] Executing post build scripts. 08:25:29 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins6667585266865909390.sh 08:25:29 ---> sysstat.sh 08:25:29 /tmp/jenkins6667585266865909390.sh: line 19: facter: command not found 08:25:29 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins15002320197349898272.sh 08:25:29 ---> package-listing.sh 08:25:29 ++ facter osfamily 08:25:29 ++ tr '[:upper:]' '[:lower:]' 08:25:29 /tmp/jenkins15002320197349898272.sh: line 19: facter: command not found 08:25:29 + OS_FAMILY= 08:25:29 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins438116499896684943.sh 08:25:29 ---> capture-instance-metadata.sh 08:25:29 Setup pyenv: 08:25:29 system 08:25:29 3.8.20 08:25:29 3.9.20 08:25:29 3.10.15 08:25:29 * 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/.python-version) 08:25:29 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-z5Bd from file:/tmp/.os_lf_venv 08:25:29 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 08:25:29 lf-activate-venv(): INFO: Attempting to install with network-safe options... 08:25:31 lf-activate-venv(): INFO: Base packages installed successfully 08:25:31 lf-activate-venv(): INFO: Installing additional packages: lftools 08:25:43 lf-activate-venv(): INFO: Adding /tmp/venv-z5Bd/bin to PATH 08:25:43 INFO: Running in OpenStack, capturing instance metadata 08:25:43 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins3508574653493548489.sh 08:25:43 provisioning config files... 08:25:44 Could not find credentials [logs] for ovsdb-csit-3node-upstream-clustering-only-titanium #675 08:25:44 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium@tmp/config3377724325125356896tmp 08:25:44 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 08:25:44 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 08:25:44 provisioning config files... 08:25:44 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 08:25:44 [EnvInject] - Injecting environment variables from a build step. 08:25:44 [EnvInject] - Injecting as environment variables the properties content 08:25:44 SERVER_ID=logs 08:25:44 08:25:44 [EnvInject] - Variables injected successfully. 08:25:44 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins2957329735559180227.sh 08:25:44 ---> create-netrc.sh 08:25:44 WARN: Log server credential not found. 08:25:44 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins8040776517762289509.sh 08:25:44 ---> python-tools-install.sh 08:25:44 Setup pyenv: 08:25:44 system 08:25:44 3.8.20 08:25:44 3.9.20 08:25:44 3.10.15 08:25:44 * 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/.python-version) 08:25:44 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-z5Bd from file:/tmp/.os_lf_venv 08:25:44 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 08:25:44 lf-activate-venv(): INFO: Attempting to install with network-safe options... 08:25:46 lf-activate-venv(): INFO: Base packages installed successfully 08:25:46 lf-activate-venv(): INFO: Installing additional packages: lftools 08:25:55 lf-activate-venv(): INFO: Adding /tmp/venv-z5Bd/bin to PATH 08:25:55 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/sh /tmp/jenkins3931217753193426428.sh 08:25:55 ---> uv-install.sh 08:25:55 uv 0.11.2 is already installed 08:25:55 uvx 0.11.2 (x86_64-unknown-linux-gnu) 08:25:55 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins8147448912472952192.sh 08:25:55 ---> sudo-logs.sh 08:25:55 Archiving 'sudo' log.. 08:25:55 /tmp/jenkins8147448912472952192.sh: line 41: facter: command not found 08:25:56 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash /tmp/jenkins6677231819845333133.sh 08:25:56 ---> job-cost.sh 08:25:56 INFO: Activating Python virtual environment... 08:25:56 Setup pyenv: 08:25:56 system 08:25:56 3.8.20 08:25:56 3.9.20 08:25:56 3.10.15 08:25:56 * 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/.python-version) 08:25:56 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-z5Bd from file:/tmp/.os_lf_venv 08:25:56 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 08:25:56 lf-activate-venv(): INFO: Attempting to install with network-safe options... 08:25:58 lf-activate-venv(): INFO: Base packages installed successfully 08:25:58 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 08:26:06 lf-activate-venv(): INFO: Adding /tmp/venv-z5Bd/bin to PATH 08:26:06 DEBUG: Contents of stack-cost file: 08:26:06 total: 0 08:26:06 INFO: Retrieving Stack Cost... 08:26:06 INFO: Stack cost: 0 08:26:06 INFO: Instance uptime: 774s 08:26:06 INFO: Fetching instance metadata (attempt 1 of 3)... 08:26:06 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 08:26:07 INFO: Successfully fetched instance metadata 08:26:07 INFO: Instance type: v3-standard-2 08:26:07 INFO: Retrieving pricing info for: v3-standard-2 08:26:07 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 08:26:07 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=774 08:26:07 INFO: Successfully fetched Vexxhost pricing API 08:26:07 INFO: Retrieved cost: 0.06 08:26:07 INFO: Retrieved resource: v3-standard-2 08:26:07 INFO: Creating archive directory: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/archives/cost 08:26:07 INFO: Archiving costs to: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/archives/cost.csv 08:26:07 INFO: Successfully archived job cost data 08:26:07 DEBUG: Cost data: ovsdb-csit-3node-upstream-clustering-only-titanium,675,2026-03-31 08:26:07,v3-standard-2,774,0.06,0.00,FAILURE 08:26:07 [ovsdb-csit-3node-upstream-clustering-only-titanium] $ /bin/bash -l /tmp/jenkins12133832640453652268.sh 08:26:07 ---> logs-deploy.sh 08:26:07 Setup pyenv: 08:26:07 system 08:26:07 3.8.20 08:26:07 3.9.20 08:26:07 3.10.15 08:26:07 * 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-titanium/.python-version) 08:26:08 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-z5Bd from file:/tmp/.os_lf_venv 08:26:08 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 08:26:08 lf-activate-venv(): INFO: Attempting to install with network-safe options... 08:26:09 lf-activate-venv(): INFO: Base packages installed successfully 08:26:09 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 08:26:19 lf-activate-venv(): INFO: Adding /tmp/venv-z5Bd/bin to PATH 08:26:19 WARNING: Nexus logging server not set 08:26:19 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/ovsdb-csit-3node-upstream-clustering-only-titanium/675/ 08:26:19 INFO: archiving logs to S3 08:26:20 ---> uname -a: 08:26:20 Linux prd-ubuntu2404-robot-2c-8g-54476 6.8.0-90-generic #91-Ubuntu SMP PREEMPT_DYNAMIC Tue Nov 18 14:14:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux 08:26:20 08:26:20 08:26:20 ---> lscpu: 08:26:20 Architecture: x86_64 08:26:20 CPU op-mode(s): 32-bit, 64-bit 08:26:20 Address sizes: 40 bits physical, 48 bits virtual 08:26:20 Byte Order: Little Endian 08:26:20 CPU(s): 2 08:26:20 On-line CPU(s) list: 0,1 08:26:20 Vendor ID: AuthenticAMD 08:26:20 Model name: AMD EPYC-Rome Processor 08:26:20 CPU family: 23 08:26:20 Model: 49 08:26:20 Thread(s) per core: 1 08:26:20 Core(s) per socket: 1 08:26:20 Socket(s): 2 08:26:20 Stepping: 0 08:26:20 BogoMIPS: 5599.94 08:26:20 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 08:26:20 Virtualization: AMD-V 08:26:20 Hypervisor vendor: KVM 08:26:20 Virtualization type: full 08:26:20 L1d cache: 64 KiB (2 instances) 08:26:20 L1i cache: 64 KiB (2 instances) 08:26:20 L2 cache: 1 MiB (2 instances) 08:26:20 L3 cache: 32 MiB (2 instances) 08:26:20 NUMA node(s): 1 08:26:20 NUMA node0 CPU(s): 0,1 08:26:20 Vulnerability Gather data sampling: Not affected 08:26:20 Vulnerability Itlb multihit: Not affected 08:26:20 Vulnerability L1tf: Not affected 08:26:20 Vulnerability Mds: Not affected 08:26:20 Vulnerability Meltdown: Not affected 08:26:20 Vulnerability Mmio stale data: Not affected 08:26:20 Vulnerability Reg file data sampling: Not affected 08:26:20 Vulnerability Retbleed: Mitigation; untrained return thunk; SMT disabled 08:26:20 Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode 08:26:20 Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl 08:26:20 Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization 08:26:20 Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected 08:26:20 Vulnerability Srbds: Not affected 08:26:20 Vulnerability Tsx async abort: Not affected 08:26:20 Vulnerability Vmscape: Not affected 08:26:20 08:26:20 08:26:20 ---> nproc: 08:26:20 2 08:26:20 08:26:20 08:26:20 ---> df -h: 08:26:20 Filesystem Size Used Avail Use% Mounted on 08:26:20 tmpfs 795M 1.1M 794M 1% /run 08:26:20 /dev/vda1 38G 8.0G 30G 22% / 08:26:20 tmpfs 3.9G 0 3.9G 0% /dev/shm 08:26:20 tmpfs 5.0M 0 5.0M 0% /run/lock 08:26:20 /dev/vda16 881M 117M 703M 15% /boot 08:26:20 /dev/vda15 105M 6.2M 99M 6% /boot/efi 08:26:20 tmpfs 795M 16K 795M 1% /run/user/1001 08:26:20 08:26:20 08:26:20 ---> free -m: 08:26:20 total used free shared buff/cache available 08:26:20 Mem: 7941 788 5104 4 2345 7153 08:26:20 Swap: 1023 0 1023 08:26:20 08:26:20 08:26:20 ---> ip addr: 08:26:20 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 08:26:20 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 08:26:20 inet 127.0.0.1/8 scope host lo 08:26:20 valid_lft forever preferred_lft forever 08:26:20 inet6 ::1/128 scope host noprefixroute 08:26:20 valid_lft forever preferred_lft forever 08:26:20 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 08:26:20 link/ether fa:16:3e:c2:25:44 brd ff:ff:ff:ff:ff:ff 08:26:20 altname enp0s3 08:26:20 inet 10.30.171.240/23 metric 100 brd 10.30.171.255 scope global dynamic ens3 08:26:20 valid_lft 85622sec preferred_lft 85622sec 08:26:20 inet6 fe80::f816:3eff:fec2:2544/64 scope link 08:26:20 valid_lft forever preferred_lft forever 08:26:20 08:26:20 08:26:20 ---> sar -b -r -n DEV: 08:26:20 Linux 6.8.0-90-generic (prd-ubuntu2404-robot-2c-8g-54476) 03/31/26 _x86_64_ (2 CPU) 08:26:20 08:26:20 08:13:24 LINUX RESTART (2 CPU) 08:26:20 08:26:20 08:26:20 ---> sar -P ALL: 08:26:20 Linux 6.8.0-90-generic (prd-ubuntu2404-robot-2c-8g-54476) 03/31/26 _x86_64_ (2 CPU) 08:26:20 08:26:20 08:13:24 LINUX RESTART (2 CPU) 08:26:20 08:26:20 08:26:20