Started by upstream project "integration-distribution-test-vanadium" build number 137 originally caused by: Started by upstream project "autorelease-release-chromium-mvn39-openjdk21" build number 59 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-ubuntu2404-robot-2c-8g-6567 (ubuntu2404-robot-2c-8g) in workspace /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-ORbUZ8Nc0HCs/agent.6675 SSH_AGENT_PID=6677 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium@tmp/private_key_13916972930892057873.key (/w/workspace/daexim-csit-3node-clustering-basic-only-vanadium@tmp/private_key_13916972930892057873.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key Verifying host key using known hosts file, will automatically accept unseen keys > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key Verifying host key using known hosts file, will automatically accept unseen keys > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 901c7e139945b436d95a44b3b592904c3d7a4f9f (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 901c7e139945b436d95a44b3b592904c3d7a4f9f # timeout=10 Commit message: "Adapt updater.py to use new lsp-flags container" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk f65244a2a093016c71f9a7a564be7d086941e15c # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins4164695162413651859.sh ---> python-tools-install.sh Setup pyenv: * system (set by /opt/pyenv/version) * 3.8.20 (set by /opt/pyenv/version) * 3.9.20 (set by /opt/pyenv/version) 3.10.15 3.11.10 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-IM2I lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-IM2I/bin to PATH Generating Requirements File ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. Python 3.11.10 pip 26.0.1 from /tmp/venv-IM2I/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.6.3 aspy.yaml==1.3.0 attrs==26.1.0 autopage==0.6.0 beautifulsoup4==4.14.3 boto3==1.42.73 botocore==1.42.73 bs4==0.0.2 certifi==2026.2.25 cffi==2.0.0 cfgv==3.5.0 chardet==7.2.0 charset-normalizer==3.4.6 click==8.3.1 cliff==4.13.2 cmd2==3.4.0 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.2.1 defusedxml==0.7.1 Deprecated==1.3.1 distlib==0.4.0 dnspython==2.8.0 docker==7.1.0 dogpile.cache==1.5.0 durationpy==0.10 email-validator==2.3.0 filelock==3.25.2 future==1.0.0 gitdb==4.0.12 GitPython==3.1.46 httplib2==0.30.2 identify==2.6.18 idna==3.11 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.6 jmespath==1.1.0 jsonpatch==1.33 jsonpointer==3.1.0 jsonschema==4.26.0 jsonschema-specifications==2025.9.1 keystoneauth1==5.13.1 kubernetes==35.0.0 lftools==0.37.22 lxml==6.0.2 markdown-it-py==4.0.0 MarkupSafe==3.0.3 mdurl==0.1.2 msgpack==1.1.2 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.3.0 niet==1.4.2 nodeenv==1.10.0 oauth2client==4.1.3 oauthlib==3.3.1 openstacksdk==4.10.0 os-service-types==1.8.2 osc-lib==4.4.0 oslo.config==10.3.0 oslo.context==6.3.0 oslo.i18n==6.7.2 oslo.log==8.1.0 oslo.serialization==5.9.1 oslo.utils==10.0.0 packaging==26.0 pbr==7.0.3 platformdirs==4.9.4 prettytable==3.17.0 psutil==7.2.2 pyasn1==0.6.3 pyasn1_modules==0.4.2 pycparser==3.0 pygerrit2==2.0.15 PyGithub==2.8.1 Pygments==2.19.2 PyJWT==2.12.1 PyNaCl==1.6.2 pyparsing==2.4.7 pyperclip==1.11.0 pyrsistent==0.20.0 python-cinderclient==9.9.0 python-dateutil==2.9.0.post0 python-discovery==1.2.0 python-heatclient==5.1.0 python-jenkins==1.8.3 python-keystoneclient==5.8.0 python-magnumclient==4.10.0 python-openstackclient==9.0.0 python-swiftclient==4.10.0 PyYAML==6.0.3 referencing==0.37.0 requests==2.32.5 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rich==14.3.3 rich-argparse==1.7.2 rpds-py==0.30.0 rsa==4.9.1 ruamel.yaml==0.19.1 ruamel.yaml.clib==0.2.15 s3transfer==0.16.0 simplejson==3.20.2 six==1.17.0 smmap==5.0.3 soupsieve==2.8.3 stevedore==5.7.0 tabulate==0.10.0 toml==0.10.2 tomlkit==0.14.0 tqdm==4.67.3 typing_extensions==4.15.0 urllib3==1.26.20 virtualenv==21.2.0 wcwidth==0.6.0 websocket-client==1.9.0 wrapt==2.1.2 xdg==6.0.0 xmltodict==1.0.4 yq==3.4.3 [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/sh /tmp/jenkins11488637890910128704.sh ---> uv-install.sh Installing uv/uvx (latest) using shell installer 2026-03-21 02:57:04 URL:https://release-assets.githubusercontent.com/github-production-release-asset/699532645/a8cf105a-0f51-4ec6-8013-26a6c9ea2ca7?sp=r&sv=2018-11-09&sr=b&spr=https&se=2026-03-21T03%3A44%3A20Z&rscd=attachment%3B+filename%3Duv-installer.sh&rsct=application%2Foctet-stream&skoid=96c2d410-5711-43a1-aedd-ab1947aa7ab0&sktid=398a6654-997b-47e9-b12b-9515b896b4de&skt=2026-03-21T02%3A44%3A17Z&ske=2026-03-21T03%3A44%3A20Z&sks=b&skv=2018-11-09&sig=633rutEW%2BgN%2B1OMavCqz2t9oehHzywU%2FifGnFdFop8w%3D&jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmVsZWFzZS1hc3NldHMuZ2l0aHVidXNlcmNvbnRlbnQuY29tIiwia2V5Ijoia2V5MSIsImV4cCI6MTc3NDA2MjA2MywibmJmIjoxNzc0MDYxNzYzLCJwYXRoIjoicmVsZWFzZWFzc2V0cHJvZHVjdGlvbi5ibG9iLmNvcmUud2luZG93cy5uZXQifQ.afW2I06I04SSQnkglyehc4O2Ke4OkBlcHxX_3FJlCi0&response-content-disposition=attachment%3B%20filename%3Duv-installer.sh&response-content-type=application%2Foctet-stream [68286/68286] -> "/tmp/uv-install-hFc99L.sh" [1] downloading uv 0.10.12 x86_64-unknown-linux-gnu no checksums to verify installing to /home/jenkins/.local/bin uv uvx everything's installed! To add $HOME/.local/bin to your PATH, either restart your shell or run: source $HOME/.local/bin/env (sh, bash, zsh) source $HOME/.local/bin/env.fish (fish) Adding install location to PATH ---> Validating uv/uvx install uvx 0.10.12 (x86_64-unknown-linux-gnu) [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-daexim-csit-3node-clustering-basic-only-vanadium-135 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins18151451050273122625.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260301-010217.216' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654' job_name: '23298-135' silo: 'releng' [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash -l /tmp/jenkins16029411093903736345.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-lmDK + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin + pyenv versions system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ awk '{ print $1 }' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ tail -n 1 +++ sort -V ++ py_version_xyz=3.11.10 ++ [[ -z 3.11.10 ]] ++ echo 3.11.10 ++ return 0 + pyenv local 3.11.10 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.10 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='urllib3~=1.26.15 ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-IM2I + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-IM2I from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-IM2I from file:/tmp/.os_lf_venv + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)' lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) + local 'pip_opts=--upgrade --quiet' + pip_opts='--upgrade --quiet --trusted-host pypi.org' + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org' + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org' + [[ -n '' ]] + [[ -n '' ]] + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...' lf-activate-venv(): INFO: Attempting to install with network-safe options... + /tmp/venv-IM2I/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv + echo 'lf-activate-venv(): INFO: Base packages installed successfully' lf-activate-venv(): INFO: Base packages installed successfully + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ]] + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ' lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + /tmp/venv-IM2I/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-IM2I/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-IM2I/bin to PATH + PATH=/tmp/venv-IM2I/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin + return 0 + openstack --os-cloud vex limits show --absolute /tmp/venv-IM2I/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (1.26.20) or chardet (7.2.0)/charset_normalizer (3.4.6) doesn't match a supported version! warnings.warn( +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 180224 | | totalCoresUsed | 44 | | totalInstancesUsed | 14 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 0 | | totalGigabytesUsed | 0 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium + lftools openstack --os-cloud vex stack create releng-daexim-csit-3node-clustering-basic-only-vanadium-135 csit-2-instance-type.yaml /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium/stack-parameters.yaml /tmp/venv-IM2I/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (1.26.20) or chardet (7.2.0)/charset_normalizer (3.4.6) doesn't match a supported version! warnings.warn( Creating stack releng-daexim-csit-3node-clustering-basic-only-vanadium-135 Waiting to initialize infrastructure... WARN: Failed to initialize stack. Reason: Resource CREATE failed: DBConnectionError: resources.vm_0_group: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') (Background on this error at: http://sqlalche.me/e/13/e3q8) Deleting stack 62200421-7f47-4d37-8625-fe9b1a1f1fe3 Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... WARN: Failed to delete $STACK_NAME. Reason: Resource DELETE failed: ClientException: resources.vm_0_group.resources[1].resources.instance: Unexpected API Error. Please report this at http: //bugs.launchpad.net/nova/ and attach the Nova API log if possible. (HTTP 500) (Request-ID: req-240a5500-c112-4514-a39f-49ebef1bc937) Retrying delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... WARN: Failed to delete $STACK_NAME. Reason: Resource DELETE failed: ClientException: resources.vm_0_group.resources[1].resources.instance: Unexpected API Error. Please report this at http: //bugs.launchpad.net/nova/ and attach the Nova API log if possible. (HTTP 500) (Request-ID: req-500c9068-61ff-488c-8e66-f5c61f1bf4ad) Retrying delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Failed to delete stack 62200421-7f47-4d37-8625-fe9b1a1f1fe3 Stack with name releng-daexim-csit-3node-clustering-basic-only-vanadium-135 already exists. Build step 'Execute shell' marked build as failure $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 6677 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Failed! hudson.AbortException: No files found in path /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium with configured filemask: output.xml at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:81) at hudson.plugins.robot.RobotParser$RobotParserCallable.invoke(RobotParser.java:52) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3616) at hudson.remoting.UserRequest.perform(UserRequest.java:211) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:377) at hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:78) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1583) Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to prd-ubuntu2404-robot-2c-8g-6567 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1787) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356) at hudson.remoting.Channel.call(Channel.java:1003) at hudson.FilePath.act(FilePath.java:1230) at hudson.FilePath.act(FilePath.java:1219) at hudson.plugins.robot.RobotParser.parse(RobotParser.java:48) at hudson.plugins.robot.RobotPublisher.parse(RobotPublisher.java:246) at hudson.plugins.robot.RobotPublisher.perform(RobotPublisher.java:268) at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:80) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:767) at hudson.model.Build$BuildExecution.post2(Build.java:179) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:711) at hudson.model.Run.execute(Run.java:1918) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:442) [PostBuildScript] - [INFO] Executing post build scripts. [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins16289633933690897060.sh Archiving csit artifacts seq: invalid floating point argument: ‘’ Try 'seq --help' for more information. % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 1156 0 1156 0 0 9749 0 --:--:-- --:--:-- --:--:-- 9796 Archive: robot-plugin.zip End-of-central-directory signature not found. Either this file is not a zipfile, or it constitutes one disk of a multi-part archive. In the latter case the central directory and zipfile comment will be found on the last disk(s) of this archive. unzip: cannot find zipfile directory in one of robot-plugin.zip or robot-plugin.zip.zip, and cannot find robot-plugin.zip.ZIP, period. mv: cannot stat '*.log': No such file or directory mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins16990080444365329579.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-daexim-csit-3node-clustering-basic-only-vanadium-135 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins16750508760331595629.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-IM2I from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-IM2I/bin to PATH INFO: Stack cost retrieval disabled, setting cost to 0 /tmp/venv-IM2I/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (1.26.20) or chardet (7.2.0)/charset_normalizer (3.4.6) doesn't match a supported version! warnings.warn( INFO: Deleting stack releng-daexim-csit-3node-clustering-basic-only-vanadium-135 Successfully deleted stack releng-daexim-csit-3node-clustering-basic-only-vanadium-135 [PostBuildScript] - [INFO] Executing post build scripts. [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins8241922278414778022.sh ---> sysstat.sh /tmp/jenkins8241922278414778022.sh: line 19: facter: command not found [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins16279912132350490837.sh ---> package-listing.sh ++ facter osfamily /tmp/jenkins16279912132350490837.sh: line 19: facter: command not found ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY= [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins14640048028751107580.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-IM2I from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-IM2I/bin to PATH INFO: Running in OpenStack, capturing instance metadata [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins17804345857964780569.sh provisioning config files... Could not find credentials [logs] for daexim-csit-3node-clustering-basic-only-vanadium #135 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/daexim-csit-3node-clustering-basic-only-vanadium@tmp/config7724245004605966180tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins13035126020308359279.sh ---> create-netrc.sh WARN: Log server credential not found. [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins7655214717797536234.sh ---> python-tools-install.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-IM2I from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-IM2I/bin to PATH [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/sh /tmp/jenkins15704868621561635550.sh ---> uv-install.sh uv 0.10.12 is already installed uvx 0.10.12 (x86_64-unknown-linux-gnu) [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins7522213169071837178.sh ---> sudo-logs.sh Archiving 'sudo' log.. /tmp/jenkins7522213169071837178.sh: line 41: facter: command not found [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash /tmp/jenkins9207104426762539214.sh ---> job-cost.sh INFO: Activating Python virtual environment... Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-IM2I from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-IM2I/bin to PATH DEBUG: Contents of stack-cost file: total: 0 INFO: Retrieving Stack Cost... INFO: Stack cost: 0 INFO: Instance uptime: 4879s INFO: Fetching instance metadata (attempt 1 of 3)... DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type INFO: Successfully fetched instance metadata INFO: Instance type: v3-standard-2 INFO: Retrieving pricing info for: v3-standard-2 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=4879 INFO: Successfully fetched Vexxhost pricing API INFO: Retrieved cost: 0.11 INFO: Retrieved resource: v3-standard-2 INFO: Creating archive directory: /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium/archives/cost INFO: Archiving costs to: /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium/archives/cost.csv INFO: Successfully archived job cost data DEBUG: Cost data: daexim-csit-3node-clustering-basic-only-vanadium,135,2026-03-21 03:14:43,v3-standard-2,4879,0.11,0.00,FAILURE [daexim-csit-3node-clustering-basic-only-vanadium] $ /bin/bash -l /tmp/jenkins3095459659020909414.sh ---> logs-deploy.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/daexim-csit-3node-clustering-basic-only-vanadium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-IM2I from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-IM2I/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/daexim-csit-3node-clustering-basic-only-vanadium/135/ INFO: archiving logs to S3 /tmp/venv-IM2I/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (1.26.20) or chardet (7.2.0)/charset_normalizer (3.4.6) doesn't match a supported version! warnings.warn( ---> uname -a: Linux prd-ubuntu2404-robot-2c-8g-6567 6.8.0-90-generic #91-Ubuntu SMP PREEMPT_DYNAMIC Tue Nov 18 14:14:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 40 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Vendor ID: AuthenticAMD Model name: AMD EPYC-Rome Processor CPU family: 23 Model: 49 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 Stepping: 0 BogoMIPS: 5600.00 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 64 KiB (2 instances) L1i cache: 64 KiB (2 instances) L2 cache: 1 MiB (2 instances) L3 cache: 32 MiB (2 instances) NUMA node(s): 1 NUMA node0 CPU(s): 0,1 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Mitigation; untrained return thunk; SMT disabled Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on tmpfs 795M 1.1M 794M 1% /run /dev/vda1 38G 7.8G 30G 21% / tmpfs 3.9G 0 3.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock /dev/vda16 881M 117M 703M 15% /boot /dev/vda15 105M 6.2M 99M 6% /boot/efi tmpfs 795M 16K 795M 1% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7941 766 5368 4 2092 7175 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host noprefixroute valid_lft forever preferred_lft forever 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:94:ba:59 brd ff:ff:ff:ff:ff:ff altname enp0s3 inet 10.30.171.200/23 metric 100 brd 10.30.171.255 scope global dynamic ens3 valid_lft 81515sec preferred_lft 81515sec inet6 fe80::f816:3eff:fe94:ba59/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 6.8.0-90-generic (prd-ubuntu2404-robot-2c-8g-6567) 03/21/26 _x86_64_ (2 CPU) 01:53:35 LINUX RESTART (2 CPU) 02:00:02 tps rtps wtps dtps bread/s bwrtn/s bdscd/s 02:10:01 1.31 0.01 1.30 0.00 0.05 15.95 0.24 02:20:18 1.36 0.00 1.36 0.00 0.01 16.40 0.00 02:30:18 1.61 0.00 1.59 0.02 0.00 19.53 654.00 02:40:00 1.30 0.00 1.30 0.00 0.00 15.50 0.00 02:50:18 2.04 0.31 1.72 0.01 38.94 72.41 0.25 03:00:12 13.83 1.77 11.05 1.00 118.54 2056.84 648.00 03:10:01 1.11 0.00 1.09 0.02 0.00 13.79 0.99 Average: 3.21 0.30 2.76 0.15 22.52 313.48 185.42 02:00:02 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 02:10:01 6287212 7533568 286684 3.53 30664 1421568 534876 5.83 451464 1183316 124 02:20:18 6286456 7533336 286856 3.53 30852 1421908 534884 5.83 451492 1183836 152 02:30:18 6271356 7518768 301452 3.71 31036 1422232 534960 5.83 453452 1184352 136 02:40:00 6276688 7524592 295616 3.63 31196 1422552 534960 5.83 453528 1184832 148 02:50:18 6231348 7508312 311364 3.83 31564 1450868 535264 5.83 465448 1202012 132 03:00:12 5519652 7359400 425468 5.23 69388 1946192 668296 7.28 626996 1718736 132 03:10:01 5518836 7359064 425852 5.24 69560 1946516 669220 7.29 627912 1719232 172 Average: 6055935 7476720 333327 4.10 42037 1575977 573209 6.24 504327 1339474 142 02:00:02 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 02:10:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 02:10:01 ens3 0.51 0.04 0.06 0.01 0.00 0.00 0.00 0.00 02:20:18 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 02:20:18 ens3 0.38 0.04 0.21 0.01 0.00 0.00 0.00 0.00 02:30:18 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 02:30:18 ens3 0.36 0.07 0.09 0.04 0.00 0.00 0.00 0.00 02:40:00 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 02:40:00 ens3 0.38 0.08 0.11 0.05 0.00 0.00 0.00 0.00 02:50:18 lo 1.02 1.02 0.05 0.05 0.00 0.00 0.00 0.00 02:50:18 ens3 0.50 0.33 2.98 0.51 0.00 0.00 0.00 0.00 03:00:12 lo 1.17 1.17 0.07 0.07 0.00 0.00 0.00 0.00 03:00:12 ens3 36.85 22.37 258.95 5.83 0.00 0.00 0.00 0.00 03:10:01 lo 1.01 1.01 0.05 0.05 0.00 0.00 0.00 0.00 03:10:01 ens3 3.28 0.55 0.84 0.30 0.00 0.00 0.00 0.00 Average: lo 1.03 1.03 0.05 0.05 0.00 0.00 0.00 0.00 Average: ens3 5.98 3.33 37.29 0.96 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 6.8.0-90-generic (prd-ubuntu2404-robot-2c-8g-6567) 03/21/26 _x86_64_ (2 CPU) 01:53:35 LINUX RESTART (2 CPU) 02:00:02 CPU %user %nice %system %iowait %steal %idle 02:10:01 all 0.21 0.00 0.07 0.01 0.04 99.66 02:10:01 0 0.04 0.00 0.08 0.02 0.05 99.81 02:10:01 1 0.38 0.00 0.06 0.00 0.03 99.52 02:20:18 all 0.25 0.00 0.08 0.03 0.04 99.60 02:20:18 0 0.06 0.00 0.09 0.02 0.04 99.79 02:20:18 1 0.44 0.00 0.07 0.03 0.03 99.42 02:30:18 all 0.27 0.00 0.16 0.02 0.04 99.51 02:30:18 0 0.42 0.00 0.16 0.01 0.03 99.38 02:30:18 1 0.13 0.00 0.16 0.03 0.04 99.64 02:40:00 all 0.25 0.00 0.08 0.12 0.03 99.52 02:40:00 0 0.19 0.00 0.08 0.02 0.03 99.68 02:40:00 1 0.31 0.00 0.07 0.22 0.03 99.37 02:50:18 all 0.35 0.00 0.11 0.03 0.02 99.48 02:50:18 0 0.27 0.00 0.14 0.03 0.03 99.53 02:50:18 1 0.44 0.00 0.08 0.03 0.02 99.44 03:00:12 all 5.83 0.00 1.02 0.50 0.04 92.62 03:00:12 0 4.92 0.00 0.96 0.51 0.04 93.57 03:00:12 1 6.73 0.00 1.08 0.49 0.03 91.67 03:10:01 all 0.39 0.00 0.10 0.02 0.02 99.47 03:10:01 0 0.23 0.00 0.11 0.01 0.02 99.63 03:10:01 1 0.54 0.00 0.10 0.02 0.02 99.32 Average: all 1.07 0.00 0.23 0.10 0.03 98.56 Average: 0 0.87 0.00 0.23 0.09 0.03 98.78 Average: 1 1.27 0.00 0.23 0.12 0.03 98.35