Started by upstream project "integration-distribution-test-vanadium" build number 230
originally caused by:
 Started by upstream project "autorelease-release-chromium-mvn39-openjdk21" build number 106
 originally caused by:
  Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-ubuntu2404-robot-2c-8g-11620 (ubuntu2404-robot-2c-8g) in workspace /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-S4GvYx3AkEO5/agent.3112
SSH_AGENT_PID=3114
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium@tmp/private_key_6508699318675757209.key (/w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium@tmp/private_key_6508699318675757209.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
 > git init /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
 > git --version # timeout=10
 > git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
Verifying host key using known hosts file, will automatically accept unseen keys
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
Verifying host key using known hosts file, will automatically accept unseen keys
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision 901c7e139945b436d95a44b3b592904c3d7a4f9f (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 901c7e139945b436d95a44b3b592904c3d7a4f9f # timeout=10
Commit message: "Adapt updater.py to use new lsp-flags container"
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
 > git rev-list --no-walk f65244a2a093016c71f9a7a564be7d086941e15c # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins13171913440477682821.sh
---> python-tools-install.sh
Setup pyenv:
* system (set by /opt/pyenv/version)
* 3.8.20 (set by /opt/pyenv/version)
* 3.9.20 (set by /opt/pyenv/version)
  3.10.15
  3.11.10
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-teoA
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-teoA/bin to PATH
Generating Requirements File
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
Python 3.11.10
pip 26.1.1 from /tmp/venv-teoA/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.6.3
aspy.yaml==1.3.0
attrs==26.1.0
autopage==0.6.0
beautifulsoup4==4.14.3
boto3==1.43.5
botocore==1.43.5
bs4==0.0.2
certifi==2026.4.22
cffi==2.0.0
cfgv==3.5.0
chardet==7.4.3
charset-normalizer==3.4.7
click==8.3.3
cliff==4.13.3
cmd2==3.5.1
cryptography==3.3.2
debtcollector==3.1.0
decorator==5.2.1
defusedxml==0.7.1
Deprecated==1.3.1
distlib==0.4.0
dnspython==2.8.0
docker==7.1.0
dogpile.cache==1.5.0
durationpy==0.10
email-validator==2.3.0
filelock==3.29.0
future==1.0.0
gitdb==4.0.12
GitPython==3.1.50
httplib2==0.30.2
identify==2.6.19
idna==3.13
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.6
jmespath==1.1.0
jsonpatch==1.33
jsonpointer==3.1.1
jsonschema==4.26.0
jsonschema-specifications==2025.9.1
keystoneauth1==5.13.1
kubernetes==35.0.0
lftools==0.37.22
lxml==6.1.0
markdown-it-py==4.1.0
MarkupSafe==3.0.3
mdurl==0.1.2
msgpack==1.1.2
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.3.0
niet==1.4.2
nodeenv==1.10.0
oauth2client==4.1.3
oauthlib==3.3.1
openstacksdk==4.12.0
os-service-types==1.8.2
osc-lib==4.6.0
oslo.config==10.3.0
oslo.context==6.3.0
oslo.i18n==6.7.2
oslo.log==8.1.0
oslo.serialization==5.9.1
oslo.utils==10.0.1
packaging==26.2
pbr==7.0.3
platformdirs==4.9.6
prettytable==3.17.0
psutil==7.2.2
pyasn1==0.6.3
pyasn1_modules==0.4.2
pycparser==3.0
pygerrit2==2.0.15
PyGithub==2.9.1
Pygments==2.20.0
PyJWT==2.12.1
PyNaCl==1.6.2
pyparsing==2.4.7
pyperclip==1.11.0
pyrsistent==0.20.0
python-cinderclient==9.9.0
python-dateutil==2.9.0.post0
python-discovery==1.3.0
python-heatclient==5.1.0
python-jenkins==1.8.3
python-keystoneclient==5.8.0
python-magnumclient==4.10.0
python-openstackclient==9.0.0
python-swiftclient==4.10.0
PyYAML==6.0.3
referencing==0.37.0
requests==2.33.1
requests-oauthlib==2.0.0
rfc3986==2.0.0
rich==15.0.0
rich-argparse==1.8.0
rpds-py==0.30.0
rsa==4.9.1
ruamel.yaml==0.19.1
ruamel.yaml.clib==0.2.15
s3transfer==0.17.0
simplejson==4.1.1
six==1.17.0
smmap==5.0.3
soupsieve==2.8.3
stevedore==5.7.0
tabulate==0.10.0
toml==0.10.2
tomlkit==0.14.0
tqdm==4.67.3
typing_extensions==4.15.0
urllib3==1.26.20
virtualenv==21.3.1
wcwidth==0.7.0
websocket-client==1.9.0
wrapt==2.1.2
xdg==6.0.0
xmltodict==1.0.4
yq==3.4.3
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/sh /tmp/jenkins17192412472255905454.sh
---> uv-install.sh
Installing uv/uvx (latest) using shell installer
2026-05-07 02:57:40 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71233/71233] -> "/tmp/uv-install-Dogsqq.sh" [1]
downloading uv 0.11.11 x86_64-unknown-linux-gnu
installing to /home/jenkins/.local/bin
  uv
  uvx
everything's installed!

To add $HOME/.local/bin to your PATH, either restart your shell or run:

    source $HOME/.local/bin/env (sh, bash, zsh)
    source $HOME/.local/bin/env.fish (fish)
Adding install location to PATH
---> Validating uv/uvx install
uvx 0.11.11 (x86_64-unknown-linux-gnu)
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228
OS_STACK_TEMPLATE_DIR=openstack-hot

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins16669358224838234296.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
    vm_0_count: '3'
    vm_0_flavor: 'v3-standard-4'
    vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260401-010115.623'
    vm_1_count: '1'
    vm_1_flavor: 'v3-standard-2'
    vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654'
    
    job_name: '51713-228'
    silo: 'releng'
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash -l /tmp/jenkins17235238762806138963.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-MCKL
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
+ pyenv versions
  system
  3.8.20
  3.9.20
  3.10.15
* 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
fi; done; 
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
  local command
  command="${1:-}"
  if [ "$#" -gt 0 ]; then
    shift
  fi

  case "$command" in
  rehash|shell)
    eval "$(pyenv "sh-$command" "$@")"
    ;;
  *)
    command pyenv "$command" "$@"
    ;;
  esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
fi; done; 
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ awk '{ print $1 }'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ grep '^3' /tmp/.pyenv_versions
+++ sort -V
+++ tail -n 1
++ py_version_xyz=3.11.10
++ [[ -z 3.11.10 ]]
++ echo 3.11.10
++ return 0
+ pyenv local 3.11.10
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.10
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='urllib3~=1.26.15 '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-teoA
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-teoA from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-teoA from file:/tmp/.os_lf_venv
+ echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
+ local 'pip_opts=--upgrade --quiet'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
+ [[ -n '' ]]
+ [[ -n '' ]]
+ echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
lf-activate-venv(): INFO: Attempting to install with network-safe options...
+ /tmp/venv-teoA/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
+ echo 'lf-activate-venv(): INFO: Base packages installed successfully'
lf-activate-venv(): INFO: Base packages installed successfully
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq  ]]
+ echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq '
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
+ /tmp/venv-teoA/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-teoA/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-teoA/bin to PATH
+ PATH=/tmp/venv-teoA/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name                     |   Value |
+--------------------------+---------+
| maxTotalInstances        |      -1 |
| maxTotalCores            |     450 |
| maxTotalRAMSize          | 1000000 |
| maxServerMeta            |     128 |
| maxImageMeta             |     128 |
| maxPersonality           |       5 |
| maxPersonalitySize       |   10240 |
| maxTotalKeypairs         |     100 |
| maxServerGroups          |      10 |
| maxServerGroupMembers    |      10 |
| maxTotalFloatingIps      |      -1 |
| maxSecurityGroups        |      -1 |
| maxSecurityGroupRules    |      -1 |
| totalRAMUsed             |  713728 |
| totalCoresUsed           |     175 |
| totalInstancesUsed       |      63 |
| totalFloatingIpsUsed     |       0 |
| totalSecurityGroupsUsed  |       0 |
| totalServerGroupsUsed    |       0 |
| maxTotalVolumes          |      -1 |
| maxTotalSnapshots        |      10 |
| maxTotalVolumeGigabytes  |    4096 |
| maxTotalBackups          |      10 |
| maxTotalBackupGigabytes  |    1000 |
| totalVolumesUsed         |       1 |
| totalGigabytesUsed       |      20 |
| totalSnapshotsUsed       |       0 |
| totalBackupsUsed         |       0 |
| totalBackupGigabytesUsed |       0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium
+ lftools openstack --os-cloud vex stack create releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228 csit-2-instance-type.yaml /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/stack-parameters.yaml
Creating stack releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
WARN: Failed to initialize stack. Reason: Resource CREATE failed: ResourceInError: resources.vm_0_group.resources[1].resources.instance: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500"
Deleting stack 2686da57-2dd0-457b-ab53-b71e986c8ad6
Successfully deleted stack 2686da57-2dd0-457b-ab53-b71e986c8ad6
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
WARN: Failed to initialize stack. Reason: Resource CREATE failed: ResourceInError: resources.vm_0_group.resources[2].resources.instance: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500"
Deleting stack 16e6eef6-3b11-481d-862b-1b062aa5655c
Successfully deleted stack 16e6eef6-3b11-481d-862b-1b062aa5655c
------------------------------------
Stack Details
------------------------------------
{'added': None,
 'capabilities': [],
 'created_at': '2026-05-07T03:00:06Z',
 'deleted': None,
 'deleted_at': None,
 'description': 'No description',
 'environment': None,
 'environment_files': None,
 'files': None,
 'files_container': None,
 'id': '16e6eef6-3b11-481d-862b-1b062aa5655c',
 'is_rollback_disabled': True,
 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228/16e6eef6-3b11-481d-862b-1b062aa5655c',
            'rel': 'self'}],
 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
 'name': 'releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228',
 'notification_topics': [],
 'outputs': [{'description': 'IP addresses of the 1st vm types',
              'output_key': 'vm_0_ips',
              'output_value': ['10.30.171.60', '10.30.170.247', None]},
             {'description': 'IP addresses of the 2nd vm types',
              'output_key': 'vm_1_ips',
              'output_value': ['10.30.171.50']}],
 'owner_id': ****,
 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
                'OS::stack_id': '16e6eef6-3b11-481d-862b-1b062aa5655c',
                'OS::stack_name': 'releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228',
                'job_name': '51713-228',
                'silo': 'releng',
                'vm_0_count': '3',
                'vm_0_flavor': 'v3-standard-4',
                'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - '
                              '20260401-010115.623',
                'vm_1_count': '1',
                'vm_1_flavor': 'v3-standard-2',
                'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 '
                              '- 20250917-133034.654'},
 'parent_id': None,
 'replaced': None,
 'status': 'CREATE_FAILED',
 'status_reason': 'Resource CREATE failed: ResourceInError: '
                  'resources.vm_0_group.resources[2].resources.instance: Went '
                  'to status ERROR due to "Message: No valid host was found. '
                  'There are not enough hosts available., Code: 500"',
 'tags': [],
 'template': None,
 'template_description': 'No description',
 'template_url': None,
 'timeout_mins': 15,
 'unchanged': None,
 'updated': None,
 'updated_at': None,
 'user_project_id': '07abf2c5ab2943699d4d822d9fa6b5da'}
------------------------------------
+ popd
/w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash -l /tmp/jenkins5862981326821480608.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
  system
  3.8.20
  3.9.20
  3.10.15
* 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-teoA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-teoA/bin to PATH
Stack not found: releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228
SSH ready on all stack servers.
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash -l /tmp/jenkins12537589488224445489.sh
Setup pyenv:
  system
  3.8.20
  3.9.20
  3.10.15
* 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-Pxhi
lf-activate-venv(): INFO: Save venv in file: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/.robot_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: setuptools wheel 
lf-activate-venv(): INFO: Adding /tmp/venv-Pxhi/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
  Downloading docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
Collecting ipaddr (from -r requirements.txt (line 2))
  Downloading ipaddr-2.2.0.tar.gz (26 kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
  Using cached netaddr-1.3.0-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
  Downloading netifaces-0.11.0.tar.gz (30 kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Collecting pyhocon (from -r requirements.txt (line 5))
  Downloading pyhocon-0.3.63.tar.gz (307 kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Collecting requests (from -r requirements.txt (line 6))
  Using cached requests-2.33.1-py3-none-any.whl (64 kB)
Collecting robotframework (from -r requirements.txt (line 7))
  Downloading robotframework-7.4.2-py3-none-any.whl (807 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 807.1/807.1 kB 2.5 MB/s  0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
  Downloading robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
  Downloading robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
  Downloading robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
  Downloading robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
  Downloading scapy-2.7.0-py3-none-any.whl (2.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 3.8 MB/s  0:00:00
Collecting jsonpath-rw (from -r requirements.txt (line 15))
  Downloading jsonpath-rw-1.4.0.tar.gz (13 kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
  Downloading elasticsearch-9.4.0-py3-none-any.whl (992 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 992.7/992.7 kB 2.2 MB/s  0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
  Downloading elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB)
Collecting pyangbind (from -r requirements.txt (line 22))
  Downloading pyangbind-0.8.7-py3-none-any.whl (52 kB)
Collecting isodate (from -r requirements.txt (line 25))
  Downloading isodate-0.7.2-py3-none-any.whl (22 kB)
Collecting jmespath (from -r requirements.txt (line 28))
  Using cached jmespath-1.1.0-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
  Using cached jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading paramiko-4.0.0-py3-none-any.whl (223 kB)
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
  Downloading docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
  Using cached six-1.17.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
  Using cached websocket_client-1.9.0-py3-none-any.whl (82 kB)
Collecting pyparsing>=3.0.0 (from pyhocon->-r requirements.txt (line 5))
  Using cached pyparsing-3.3.2-py3-none-any.whl (122 kB)
Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
  Using cached charset_normalizer-3.4.7-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (214 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
  Using cached idna-3.13-py3-none-any.whl (68 kB)
Collecting urllib3<3,>=1.26 (from requests->-r requirements.txt (line 6))
  Using cached urllib3-2.6.3-py3-none-any.whl (131 kB)
Collecting certifi>=2023.5.7 (from requests->-r requirements.txt (line 6))
  Using cached certifi-2026.4.22-py3-none-any.whl (135 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading webtest-3.0.7-py3-none-any.whl (32 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached jsonpointer-3.1.1-py3-none-any.whl (7.7 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading robotframework_seleniumlibrary-6.8.0-py3-none-any.whl (104 kB)
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
  Downloading ply-3.11-py2.py3-none-any.whl (49 kB)
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
  Using cached decorator-5.2.1-py3-none-any.whl (9.2 kB)
Collecting anyio (from elasticsearch->-r requirements.txt (line 18))
  Downloading anyio-4.13.0-py3-none-any.whl (114 kB)
Collecting elastic-transport<10,>=9.2.0 (from elasticsearch->-r requirements.txt (line 18))
  Downloading elastic_transport-9.4.0-py3-none-any.whl (65 kB)
Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18))
  Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting sniffio (from elasticsearch->-r requirements.txt (line 18))
  Downloading sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18))
  Using cached typing_extensions-4.15.0-py3-none-any.whl (44 kB)
Collecting elasticsearch (from -r requirements.txt (line 18))
  Downloading elasticsearch-8.19.3-py3-none-any.whl (952 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 952.8/952.8 kB 5.3 MB/s  0:00:00
INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while.
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
  Downloading elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB)
  Downloading elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB)
  Downloading elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB)
  Downloading elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB)
Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
  Downloading elastic_transport-8.17.1-py3-none-any.whl (64 kB)
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
  Downloading pyang-2.7.1-py2.py3-none-any.whl (598 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 3.2 MB/s  0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
  Using cached lxml-6.1.0-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
  Downloading regex-2026.4.4-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (799 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 799.8/799.8 kB 6.9 MB/s  0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
  Downloading enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading bcrypt-5.0.0-cp39-abi3-manylinux_2_34_x86_64.whl (278 kB)
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached cryptography-48.0.0-cp311-abi3-manylinux_2_34_x86_64.whl (4.7 MB)
Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading invoke-3.0.3-py3-none-any.whl (160 kB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached pynacl-1.6.2-cp38-abi3-manylinux_2_34_x86_64.whl (1.4 MB)
Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached cffi-2.0.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (215 kB)
Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached pycparser-3.0-py3-none-any.whl (48 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading selenium-4.43.0-py3-none-any.whl (9.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.6/9.6 MB 37.5 MB/s  0:00:00
Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading robotframework_pythonlibcore-4.5.0-py3-none-any.whl (19 kB)
Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached click-8.3.3-py3-none-any.whl (110 kB)
Collecting trio<1.0,>=0.31.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading trio-0.33.0-py3-none-any.whl (510 kB)
Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading trio_websocket-0.12.2-py3-none-any.whl (21 kB)
Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached attrs-26.1.0-py3-none-any.whl (67 kB)
Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading wsproto-1.3.2-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.6.3->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading WebOb-1.8.9-py2.py3-none-any.whl (115 kB)
Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading waitress-3.0.2-py3-none-any.whl (56 kB)
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached beautifulsoup4-4.14.3-py3-none-any.whl (107 kB)
Collecting h11<1,>=0.16.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading h11-0.16.0-py3-none-any.whl (37 kB)
Collecting soupsieve>=1.6.1 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached soupsieve-2.8.3-py3-none-any.whl (37 kB)
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, pyhocon, robotframework-httplibrary, jsonpath-rw
  Building wheel for robotframework-sshlibrary (pyproject.toml): started
  Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done'
  Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=4e31a3ef58773f97660e8bf9374b98aecae5db58b448954567d8537825ee00d4
  Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
  Building wheel for ipaddr (pyproject.toml): started
  Building wheel for ipaddr (pyproject.toml): finished with status 'done'
  Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18355 sha256=491e900a912aad4f4c23331b97ce478f3fe43dd370d3d07eb43a04db54c60894
  Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
  Building wheel for netifaces (pyproject.toml): started
  Building wheel for netifaces (pyproject.toml): finished with status 'done'
  Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=34976 sha256=fdc1ab73af0869f386fc346a9820faa7067678bf2aa4d9b893ea42024391827b
  Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
  Building wheel for pyhocon (pyproject.toml): started
  Building wheel for pyhocon (pyproject.toml): finished with status 'done'
  Created wheel for pyhocon: filename=pyhocon-0.3.63-py3-none-any.whl size=24721 sha256=732fbaef5ca743b02bde47663051d3ea1cb6f30e53b30b3b9553a39baef8dbdf
  Stored in directory: /home/jenkins/.cache/pip/wheels/ce/9e/92/cb17e17d79fafd46a767074b3ed1dca8f78036163f9bea914d
  Building wheel for robotframework-httplibrary (pyproject.toml): started
  Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done'
  Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10014 sha256=9a9685da129d20aa85d152a83417cb6e12cd58d85ab78ed8308466d5c881b10d
  Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
  Building wheel for jsonpath-rw (pyproject.toml): started
  Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done'
  Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=6e231fd5a6232d657b7fd460827432a357f56063f3ef75b1b41117fed7d7f326
  Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr netifaces pyhocon robotframework-httplibrary jsonpath-rw
Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library

Successfully installed WebOb-1.8.9 attrs-26.1.0 bcrypt-5.0.0 beautifulsoup4-4.14.3 certifi-2026.4.22 cffi-2.0.0 charset_normalizer-3.4.7 click-8.3.3 cryptography-48.0.0 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.19.3 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.13 invoke-3.0.3 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.1.0 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.1.1 lxml-6.1.0 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-4.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.7 pycparser-3.0 pyhocon-0.3.63 pynacl-1.6.2 pyparsing-3.3.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2026.4.4 requests-2.33.1 robotframework-7.4.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.5.0 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.8.0 robotframework-sshlibrary-3.8.0 scapy-2.7.0 scp-0.15.0 selenium-4.43.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.8.3 trio-0.33.0 trio-websocket-0.12.2 typing-extensions-4.15.0 urllib3-2.6.3 waitress-3.0.2 websocket-client-1.9.0 webtest-3.0.7 wsproto-1.3.2
+ pip freeze
attrs==26.1.0
bcrypt==5.0.0
beautifulsoup4==4.14.3
certifi==2026.4.22
cffi==2.0.0
charset-normalizer==3.4.7
click==8.3.3
cryptography==48.0.0
decorator==5.2.1
distlib==0.4.0
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.17.1
elasticsearch==8.19.3
elasticsearch-dsl==8.15.4
enum34==1.1.10
filelock==3.29.0
h11==0.16.0
idna==3.13
invoke==3.0.3
ipaddr==2.2.0
isodate==0.7.2
jmespath==1.1.0
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==3.1.1
lxml==6.1.0
netaddr==1.3.0
netifaces==0.11.0
outcome==1.3.0.post0
packaging==26.2
paramiko==4.0.0
platformdirs==4.9.6
ply==3.11
pyang==2.7.1
pyangbind==0.8.7
pycparser==3.0
pyhocon==0.3.63
PyNaCl==1.6.2
pyparsing==3.3.2
PySocks==1.7.1
python-dateutil==2.9.0.post0
python-discovery==1.3.0
regex==2026.4.4
requests==2.33.1
robotframework==7.4.2
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.5.0
robotframework-requests==0.9.7
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.8.0
robotframework-sshlibrary==3.8.0
scapy==2.7.0
scp==0.15.0
selenium==4.43.0
six==1.17.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.8.3
trio==0.33.0
trio-websocket==0.12.2
typing_extensions==4.15.0
urllib3==2.6.3
virtualenv==21.3.1
waitress==3.0.2
WebOb==1.8.9
websocket-client==1.9.0
WebTest==3.0.7
wsproto==1.3.2
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash -l /tmp/jenkins1858110407277276940.sh
Setup pyenv:
  system
  3.8.20
  3.9.20
  3.10.15
* 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-teoA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq 
lf-activate-venv(): INFO: Adding /tmp/venv-teoA/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
++ openstack stack show -f json -c outputs releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228
Stack not found: releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228
+ for i in "${ADDR[@]}"
++ ssh '' hostname -s
ssh: Could not resolve hostname : Device or resource busy
+ REMHOST=
+ case ${REMHOST} in
+ TOOLS_SYSTEM=("${TOOLS_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=0
+ echo NUM_TOOLS_SYSTEM=1
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=
++ seq 0 -1
+ echo TOOLS_SYSTEM_IP=
++ seq 0 0
+ for i in $(seq 0 $(( ${#TOOLS_SYSTEM[@]} - 1 )))
+ echo TOOLS_SYSTEM_1_IP=
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=0
NUM_TOOLS_SYSTEM=1
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=
TOOLS_SYSTEM_IP=
TOOLS_SYSTEM_1_IP=
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/sh /tmp/jenkins15864437870406534777.sh
Preparing for JRE Version 21
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-21-openjdk-amd64
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins10389803536819172950.sh
2026-05-07 03:04:06 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/stable/vanadium/pom.xml [2619/2619] -> "pom.xml" [1]
Bundle version is 0.23.2-SNAPSHOT
--2026-05-07 03:04:06--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.23.2-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 963 [application/xml]
Saving to: ‘maven-metadata.xml’

     0K                                                       100%  759M=0s

2026-05-07 03:04:06 (759 MB/s) - ‘maven-metadata.xml’ saved [963/963]

<?xml version="1.0" encoding="UTF-8"?>
<metadata modelVersion="1.1.0">
  <groupId>org.opendaylight.integration</groupId>
  <artifactId>karaf</artifactId>
  <versioning>
    <lastUpdated>20260422074133</lastUpdated>
    <snapshot>
      <timestamp>20260422.074133</timestamp>
      <buildNumber>1</buildNumber>
    </snapshot>
    <snapshotVersions>
      <snapshotVersion>
        <extension>pom</extension>
        <value>0.23.2-20260422.074133-1</value>
        <updated>20260422074133</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>tar.gz</extension>
        <value>0.23.2-20260422.074133-1</value>
        <updated>20260422074133</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>zip</extension>
        <value>0.23.2-20260422.074133-1</value>
        <updated>20260422074133</updated>
      </snapshotVersion>
    </snapshotVersions>
  </versioning>
  <version>0.23.2-SNAPSHOT</version>
</metadata>
Nexus timestamp is 0.23.2-20260422.074133-1
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.23.2-SNAPSHOT/karaf-0.23.2-20260422.074133-1.zip
Distribution bundle is karaf-0.23.2-20260422.074133-1.zip
Distribution bundle version is 0.23.2-SNAPSHOT
Distribution folder is karaf-0.23.2-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash -l /tmp/jenkins3434984999921848163.sh
Setup pyenv:
  system
  3.8.20
  3.9.20
  3.10.15
* 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-teoA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-teoA/bin to PATH
Copying common-functions.sh to /tmp
Stack not found: releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228
Copying common-functions.sh to :/tmp
cp: cannot create regular file ':/tmp': No such file or directory
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins16824169207942722108.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.23.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.23.2-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.23.2-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.23.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.23.2-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.23.2-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.23.2-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.23.2-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

#################################################
##         Configure Cluster and Start         ##
#################################################
ACTUALFEATURES: odl-infrautils-ready,odl-jolokia,odl-ovsdb-southbound-impl-rest
SPACE_SEPARATED_FEATURES: odl-infrautils-ready odl-jolokia odl-ovsdb-southbound-impl-rest
Locating script plan to use...
Finished running script plans
Locating config plan to use...
Finished running config plans
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins10096368670335048528.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.23.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.23.2-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.23.2-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.23.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.23.2-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.23.2-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.23.2-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.23.2-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

+ echo '#################################################'
#################################################
+ echo '##         Verify Cluster is UP                ##'
##         Verify Cluster is UP                ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 0
+ dump_controller_threads
++ seq 1 0
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 0
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 1
+ for i in $(seq 1 "${NUM_TOOLS_SYSTEM}")
+ MININETIP=TOOLS_SYSTEM_1_IP
+ tools_variables=' -v TOOLS_SYSTEM_1_IP:'
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/testplans/ovsdb-upstream-clustering-vanadium.txt
+ '[' '!' -f /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/testplans/ovsdb-upstream-clustering-vanadium.txt ']'
+ testplan_filepath=/w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/testplans/ovsdb-upstream-clustering.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/testplans/ovsdb-upstream-clustering.txt
+ cat testplan.txt
# Place the suites in run order:
/w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster
/w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster '
+ eval 'SUITES='\''/w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster '\'''
++ SUITES='/w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster '
+ echo 'Starting Robot test suites /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster  ...'
Starting Robot test suites /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster  ...
+ robot -N ovsdb-upstream-clustering.txt --removekeywords wuks -e exclude -e skip_if_vanadium -v BUNDLEFOLDER:karaf-0.23.2-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.23.2-SNAPSHOT/karaf-0.23.2-20260422.074133-1.zip -v CONTROLLER: -v CONTROLLER1: -v CONTROLLER2: -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:0 -v NUM_TOOLS_SYSTEM:1 -v ODL_STREAM:vanadium -v ODL_SYSTEM_IP: -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_1_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/test/csit/suites/ovsdb/Southbound_Cluster
==============================================================================
ovsdb-upstream-clustering.txt                                                 
==============================================================================
ovsdb-upstream-clustering.txt.Southbound Cluster                              
==============================================================================
ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster :...
==============================================================================
Check Shards Status Before Fail :: Check Status for all shards in ... | FAIL |
No leader found.
------------------------------------------------------------------------------
Start OVS Multiple Connections :: Connect OVS to all cluster insta... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Check Entity Owner Status And Find Owner and Candidate Before Fail... | FAIL |
Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Create Bridge Manually and Verify Before Fail :: Create bridge wit... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Port Manually and Verify Before Fail :: Add port with OVS comm... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Create Tap Device Before Fail :: Create tap devices to add to the ... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Tap Device Manually and Verify Before Fail :: Add tap devices ... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Delete the Bridge Manually and Verify Before Fail :: Delete bridge... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Create Bridge In Owner and Verify Before Fail :: Create Bridge in ... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Create Port In Owner and Verify Before Fail :: Create Port in Owne... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Modify the destination IP of Port In Owner Before Fail :: Modify t... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Verify Port Is Modified Before Fail :: Verify port is modified in ... | FAIL |
Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Delete Port In Owner Before Fail :: Delete port in Owner and verif... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Delete Bridge In Owner And Verify Before Fail :: Delete bridge in ... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Kill Owner Instance :: Kill Owner Instance and verify it is dead      | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Check Shards Status After Fail :: Create original cluster list and... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Check Entity Owner Status And Find Owner and Candidate After Fail ... | FAIL |
Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Create Bridge Manually and Verify After Fail :: Create bridge with... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Add Port Manually and Verify After Fail :: Add port with OVS comma... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Create Tap Device After Fail :: Create tap devices to add to the b... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Tap Device Manually and Verify After Fail :: Add tap devices t... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Delete the Bridge Manually and Verify After Fail :: Delete bridge ... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Create Bridge In Owner and Verify After Fail :: Create Bridge in O... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Create Port In Owner and Verify After Fail :: Create Port in Owner... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Modify the destination IP of Port In Owner After Fail :: Modify th... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Verify Port Is Modified After Fail :: Verify port is modified in a... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Start Old Owner Instance :: Start Owner Instance and verify it is ... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Check Shards Status After Recover :: Create original cluster list ... | FAIL |
Keyword 'Check Ovsdb Shards Status' failed after retrying for 1 minute 30 seconds. The last error was: No leader found.
------------------------------------------------------------------------------
Check Entity Owner Status After Recover :: Check Entity Owner Stat... | FAIL |
Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Create Bridge Manually and Verify After Recover :: Create bridge w... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Port Manually and Verify After Recover :: Add port with OVS co... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Create Tap Device After Recover :: Create tap devices to add to th... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Tap Device Manually and Verify After Recover :: Add tap device... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Delete the Bridge Manually and Verify After Recover :: Delete brid... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Verify Modified Port After Recover :: Verify modified port exists ... | FAIL |
Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Delete Port In New Owner After Recover :: Delete port in Owner and... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Delete Bridge In New Owner And Verify After Recover :: Delete brid... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Create Bridge In Old Owner and Verify After Recover :: Create Brid... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Create Port In Old Owner and Verify After Recover :: Create Port i... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Modify the destination IP of Port In Old Owner After Recover :: Mo... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Verify Port Is Modified After Recover :: Verify port is modified i... | FAIL |
Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Delete Port In Old Owner After Recover :: Delete port in Owner and... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Delete Bridge In Old Owner And Verify After Recover :: Delete brid... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Cleans Up Test Environment For Next Suite :: Cleans up test enviro... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound ... | FAIL |
44 tests, 0 passed, 44 failed
==============================================================================
ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluster Extensi...
==============================================================================
Check Shards Status Before Fail :: Check Status for all shards in ... | FAIL |
No leader found.
------------------------------------------------------------------------------
Start OVS Multiple Connections :: Connect OVS to all cluster insta... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Check Entity Owner Status And Find Owner and Candidate Before Fail... | FAIL |
Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Create Bridge Manually and Verify Before Fail :: Create bridge wit... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Port Manually and Verify Before Fail :: Add port with OVS comm... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Delete the Bridge Manually and Verify Before Fail :: Delete bridge... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Create Bridge In Owner and Verify Before Fail :: Create Bridge in ... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Create Port In Owner and Verify Before Fail :: Create Port in Owne... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Modify the destination IP of Port In Owner Before Fail :: Modify t... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Verify Port Is Modified Before Fail :: Verify port is modified in ... | FAIL |
Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Delete Port In Owner Before Fail :: Delete port in Owner and verif... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Delete Bridge In Owner And Verify Before Fail :: Delete bridge in ... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Kill Candidate Instance :: Kill Owner Instance and verify it is dead  | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Check Shards Status After Fail :: Create original cluster list and... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Check Entity Owner Status And Find Owner and Candidate After Fail ... | FAIL |
Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Create Bridge Manually and Verify After Fail :: Create bridge with... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Add Port Manually and Verify After Fail :: Add port with OVS comma... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Delete the Bridge Manually and Verify After Fail :: Delete bridge ... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Create Bridge In Owner and Verify After Fail :: Create Bridge in O... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Create Port In Owner and Verify After Fail :: Create Port in Owner... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Modify the destination IP of Port In Owner After Fail :: Modify th... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Verify Port Is Modified After Fail :: Verify port is modified in a... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Start Old Candidate Instance :: Start Owner Instance and verify it... | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Check Shards Status After Recover :: Create original cluster list ... | FAIL |
Keyword 'Check Ovsdb Shards Status' failed after retrying for 1 minute 30 seconds. The last error was: No leader found.
------------------------------------------------------------------------------
Check Entity Owner Status After Recover :: Check Entity Owner Stat... | FAIL |
Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Create Bridge Manually and Verify After Recover :: Create bridge w... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Port Manually and Verify After Recover :: Add port with OVS co... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Delete the Bridge Manually and Verify After Recover :: Delete brid... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Verify Modified Port After Recover :: Verify modified port exists ... | FAIL |
Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Delete Port In New Owner After Recover :: Delete port in Owner and... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Delete Bridge In New Owner And Verify After Recover :: Delete brid... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Create Bridge In Old Candidate and Verify After Recover :: Create ... | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Create Port In Old Owner and Verify After Recover :: Create Port i... | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Modify the destination IP of Port In Old Owner After Recover :: Mo... | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Verify Port Is Modified After Recover :: Verify port is modified i... | FAIL |
Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Delete Port In Old Owner After Recover :: Delete port in Owner and... | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Delete Bridge In Old Owner And Verify After Recover :: Delete brid... | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Cleans Up Test Environment For Next Suite :: Cleans up test enviro... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluste... | FAIL |
38 tests, 0 passed, 38 failed
==============================================================================
ovsdb-upstream-clustering.txt.Southbound Cluster                      | FAIL |
82 tests, 0 passed, 82 failed
==============================================================================
ovsdb-upstream-clustering.txt.Southbound Cluster                              
==============================================================================
ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster :...
==============================================================================
Check Shards Status Before Fail :: Check Status for all shards in ... | FAIL |
No leader found.
------------------------------------------------------------------------------
Start OVS Multiple Connections :: Connect OVS to all cluster insta... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Check Entity Owner Status And Find Owner and Candidate Before Fail... | FAIL |
Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Create Bridge Manually and Verify Before Fail :: Create bridge wit... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Port Manually and Verify Before Fail :: Add port with OVS comm... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Create Tap Device Before Fail :: Create tap devices to add to the ... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Tap Device Manually and Verify Before Fail :: Add tap devices ... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Delete the Bridge Manually and Verify Before Fail :: Delete bridge... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Create Bridge In Owner and Verify Before Fail :: Create Bridge in ... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Create Port In Owner and Verify Before Fail :: Create Port in Owne... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Modify the destination IP of Port In Owner Before Fail :: Modify t... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Verify Port Is Modified Before Fail :: Verify port is modified in ... | FAIL |
Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Delete Port In Owner Before Fail :: Delete port in Owner and verif... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Delete Bridge In Owner And Verify Before Fail :: Delete bridge in ... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Kill Owner Instance :: Kill Owner Instance and verify it is dead      | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Check Shards Status After Fail :: Create original cluster list and... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Check Entity Owner Status And Find Owner and Candidate After Fail ... | FAIL |
Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Create Bridge Manually and Verify After Fail :: Create bridge with... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Add Port Manually and Verify After Fail :: Add port with OVS comma... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Create Tap Device After Fail :: Create tap devices to add to the b... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Tap Device Manually and Verify After Fail :: Add tap devices t... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Delete the Bridge Manually and Verify After Fail :: Delete bridge ... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Create Bridge In Owner and Verify After Fail :: Create Bridge in O... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Create Port In Owner and Verify After Fail :: Create Port in Owner... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Modify the destination IP of Port In Owner After Fail :: Modify th... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Verify Port Is Modified After Fail :: Verify port is modified in a... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Start Old Owner Instance :: Start Owner Instance and verify it is ... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Check Shards Status After Recover :: Create original cluster list ... | FAIL |
Keyword 'Check Ovsdb Shards Status' failed after retrying for 1 minute 30 seconds. The last error was: No leader found.
------------------------------------------------------------------------------
Check Entity Owner Status After Recover :: Check Entity Owner Stat... | FAIL |
Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Create Bridge Manually and Verify After Recover :: Create bridge w... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Port Manually and Verify After Recover :: Add port with OVS co... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Create Tap Device After Recover :: Create tap devices to add to th... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Tap Device Manually and Verify After Recover :: Add tap device... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Delete the Bridge Manually and Verify After Recover :: Delete brid... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Verify Modified Port After Recover :: Verify modified port exists ... | FAIL |
Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Delete Port In New Owner After Recover :: Delete port in Owner and... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Delete Bridge In New Owner And Verify After Recover :: Delete brid... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Create Bridge In Old Owner and Verify After Recover :: Create Brid... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Create Port In Old Owner and Verify After Recover :: Create Port i... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Modify the destination IP of Port In Old Owner After Recover :: Mo... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Verify Port Is Modified After Recover :: Verify port is modified i... | FAIL |
Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Delete Port In Old Owner After Recover :: Delete port in Owner and... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Delete Bridge In Old Owner And Verify After Recover :: Delete brid... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Cleans Up Test Environment For Next Suite :: Cleans up test enviro... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound ... | FAIL |
44 tests, 0 passed, 44 failed
==============================================================================
ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluster Extensi...
==============================================================================
Check Shards Status Before Fail :: Check Status for all shards in ... | FAIL |
No leader found.
------------------------------------------------------------------------------
Start OVS Multiple Connections :: Connect OVS to all cluster insta... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Check Entity Owner Status And Find Owner and Candidate Before Fail... | FAIL |
Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Create Bridge Manually and Verify Before Fail :: Create bridge wit... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Port Manually and Verify Before Fail :: Add port with OVS comm... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Delete the Bridge Manually and Verify Before Fail :: Delete bridge... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Create Bridge In Owner and Verify Before Fail :: Create Bridge in ... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Create Port In Owner and Verify Before Fail :: Create Port in Owne... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Modify the destination IP of Port In Owner Before Fail :: Modify t... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Verify Port Is Modified Before Fail :: Verify port is modified in ... | FAIL |
Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Delete Port In Owner Before Fail :: Delete port in Owner and verif... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Delete Bridge In Owner And Verify Before Fail :: Delete bridge in ... | FAIL |
Variable '${original_owner}' not found.
------------------------------------------------------------------------------
Kill Candidate Instance :: Kill Owner Instance and verify it is dead  | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Check Shards Status After Fail :: Create original cluster list and... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Check Entity Owner Status And Find Owner and Candidate After Fail ... | FAIL |
Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Create Bridge Manually and Verify After Fail :: Create bridge with... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Add Port Manually and Verify After Fail :: Add port with OVS comma... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Delete the Bridge Manually and Verify After Fail :: Delete bridge ... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Create Bridge In Owner and Verify After Fail :: Create Bridge in O... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Create Port In Owner and Verify After Fail :: Create Port in Owner... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Modify the destination IP of Port In Owner After Fail :: Modify th... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Verify Port Is Modified After Fail :: Verify port is modified in a... | FAIL |
Variable '${new_cluster_list}' not found.
------------------------------------------------------------------------------
Start Old Candidate Instance :: Start Owner Instance and verify it... | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Check Shards Status After Recover :: Create original cluster list ... | FAIL |
Keyword 'Check Ovsdb Shards Status' failed after retrying for 1 minute 30 seconds. The last error was: No leader found.
------------------------------------------------------------------------------
Check Entity Owner Status After Recover :: Check Entity Owner Stat... | FAIL |
Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Create Bridge Manually and Verify After Recover :: Create bridge w... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Add Port Manually and Verify After Recover :: Add port with OVS co... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Delete the Bridge Manually and Verify After Recover :: Delete brid... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
Verify Modified Port After Recover :: Verify modified port exists ... | FAIL |
Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Delete Port In New Owner After Recover :: Delete port in Owner and... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Delete Bridge In New Owner And Verify After Recover :: Delete brid... | FAIL |
Variable '${new_owner}' not found.
------------------------------------------------------------------------------
Create Bridge In Old Candidate and Verify After Recover :: Create ... | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Create Port In Old Owner and Verify After Recover :: Create Port i... | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Modify the destination IP of Port In Old Owner After Recover :: Mo... | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Verify Port Is Modified After Recover :: Verify port is modified i... | FAIL |
Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: Variable '${ovsdb_uuid}' not found.
------------------------------------------------------------------------------
Delete Port In Old Owner After Recover :: Delete port in Owner and... | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Delete Bridge In Old Owner And Verify After Recover :: Delete brid... | FAIL |
Variable '${original_candidate}' not found.
------------------------------------------------------------------------------
Cleans Up Test Environment For Next Suite :: Cleans up test enviro... | FAIL |
OSError: [Errno 16] Device or resource busy
------------------------------------------------------------------------------
ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluste... | FAIL |
38 tests, 0 passed, 38 failed
==============================================================================
ovsdb-upstream-clustering.txt.Southbound Cluster                      | FAIL |
82 tests, 0 passed, 82 failed
==============================================================================
ovsdb-upstream-clustering.txt                                         | FAIL |
164 tests, 0 passed, 164 failed
==============================================================================
Output:  /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/output.xml
Log:     /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/log.html
Report:  /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh '' 'ls -altr /tmp/karaf-0.23.2-SNAPSHOT/data/log/'
ssh: Could not resolve hostname : Device or resource busy
Build step 'Execute shell' marked build as failure
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 3114 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
[PostBuildScript] - [INFO] Executing post build scripts.
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins10061346322009601371.sh
Archiving csit artifacts
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  519k    0  519k    0     0   973k      0 --:--:-- --:--:-- --:--:--  974k
Archive:  robot-plugin.zip
  inflating: ./archives/robot-plugin/log.html  
  inflating: ./archives/robot-plugin/output.xml  
  inflating: ./archives/robot-plugin/report.html  
mv: cannot stat '*.log': No such file or directory
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins4226138877468063439.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_CLOUD=vex
OS_STACK_NAME=releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins3424606985115994100.sh
---> openstack-stack-delete.sh
Setup pyenv:
  system
  3.8.20
  3.9.20
  3.10.15
* 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-teoA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-teoA/bin to PATH
INFO: Stack cost retrieval disabled, setting cost to 0
INFO: Deleting stack releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228
Successfully deleted stack releng-ovsdb-csit-3node-upstream-clustering-only-vanadium-228
[PostBuildScript] - [INFO] Executing post build scripts.
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins9170340990260956593.sh
---> sysstat.sh
/tmp/jenkins9170340990260956593.sh: line 19: facter: command not found
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins10771512373454446106.sh
---> package-listing.sh
++ facter osfamily
/tmp/jenkins10771512373454446106.sh: line 19: facter: command not found
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins11683728060819707676.sh
---> capture-instance-metadata.sh
Setup pyenv:
  system
  3.8.20
  3.9.20
  3.10.15
* 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-teoA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-teoA/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins4682500687002446549.sh
provisioning config files...
Could not find credentials [logs] for ovsdb-csit-3node-upstream-clustering-only-vanadium #228
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium@tmp/config7982146945945119660tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
SERVER_ID=logs

[EnvInject] - Variables injected successfully.
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins850992944530145131.sh
---> create-netrc.sh
WARN: Log server credential not found.
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins13394272126682708050.sh
---> python-tools-install.sh
Setup pyenv:
  system
  3.8.20
  3.9.20
  3.10.15
* 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-teoA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-teoA/bin to PATH
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/sh /tmp/jenkins16420050545575641062.sh
---> uv-install.sh
uv 0.11.11 is already installed
uvx 0.11.11 (x86_64-unknown-linux-gnu)
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins14187776970742846502.sh
---> sudo-logs.sh
Archiving 'sudo' log..
/tmp/jenkins14187776970742846502.sh: line 41: facter: command not found
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash /tmp/jenkins7995151381274860646.sh
---> job-cost.sh
INFO: Activating Python virtual environment...
Setup pyenv:
  system
  3.8.20
  3.9.20
  3.10.15
* 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-teoA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-teoA/bin to PATH
DEBUG: Contents of stack-cost file:
total: 0
INFO: Retrieving Stack Cost...
INFO: Stack cost: 0
INFO: Instance uptime: 1016s
INFO: Fetching instance metadata (attempt 1 of 3)...
DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
INFO: Successfully fetched instance metadata
INFO: Instance type: v3-standard-2
INFO: Retrieving pricing info for: v3-standard-2
INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=1016
INFO: Successfully fetched Vexxhost pricing API
INFO: Retrieved cost: 0.06
INFO: Retrieved resource: v3-standard-2
INFO: Creating archive directory: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/archives/cost
INFO: Archiving costs to: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/archives/cost.csv
INFO: Successfully archived job cost data
DEBUG: Cost data: ovsdb-csit-3node-upstream-clustering-only-vanadium,228,2026-05-07 03:12:39,v3-standard-2,1016,0.06,0.00,FAILURE
[ovsdb-csit-3node-upstream-clustering-only-vanadium] $ /bin/bash -l /tmp/jenkins18178509770491579525.sh
---> logs-deploy.sh
Setup pyenv:
  system
  3.8.20
  3.9.20
  3.10.15
* 3.11.10 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-teoA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-teoA/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/ovsdb-csit-3node-upstream-clustering-only-vanadium/228/
INFO: archiving logs to S3
---> uname -a:
Linux prd-ubuntu2404-robot-2c-8g-11620 6.8.0-90-generic #91-Ubuntu SMP PREEMPT_DYNAMIC Tue Nov 18 14:14:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux


---> lscpu:
Architecture:                         x86_64
CPU op-mode(s):                       32-bit, 64-bit
Address sizes:                        40 bits physical, 48 bits virtual
Byte Order:                           Little Endian
CPU(s):                               2
On-line CPU(s) list:                  0,1
Vendor ID:                            AuthenticAMD
Model name:                           AMD EPYC-Rome Processor
CPU family:                           23
Model:                                49
Thread(s) per core:                   1
Core(s) per socket:                   1
Socket(s):                            2
Stepping:                             0
BogoMIPS:                             5600.00
Flags:                                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
Virtualization:                       AMD-V
Hypervisor vendor:                    KVM
Virtualization type:                  full
L1d cache:                            64 KiB (2 instances)
L1i cache:                            64 KiB (2 instances)
L2 cache:                             1 MiB (2 instances)
L3 cache:                             32 MiB (2 instances)
NUMA node(s):                         1
NUMA node0 CPU(s):                    0,1
Vulnerability Gather data sampling:   Not affected
Vulnerability Itlb multihit:          Not affected
Vulnerability L1tf:                   Not affected
Vulnerability Mds:                    Not affected
Vulnerability Meltdown:               Not affected
Vulnerability Mmio stale data:        Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed:               Mitigation; untrained return thunk; SMT disabled
Vulnerability Spec rstack overflow:   Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:      Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:             Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:             Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                  Not affected
Vulnerability Tsx async abort:        Not affected
Vulnerability Vmscape:                Not affected


---> nproc:
2


---> df -h:
Filesystem      Size  Used Avail Use% Mounted on
tmpfs           795M  1.1M  794M   1% /run
/dev/vda1        38G  8.1G   30G  22% /
tmpfs           3.9G     0  3.9G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
/dev/vda16      881M  117M  703M  15% /boot
/dev/vda15      105M  6.2M   99M   6% /boot/efi
tmpfs           795M   16K  795M   1% /run/user/1001


---> free -m:
               total        used        free      shared  buff/cache   available
Mem:            7941         764        5090           4        2383        7177
Swap:           1023           0        1023


---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute 
       valid_lft forever preferred_lft forever
2: ens3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:35:dd:b4 brd ff:ff:ff:ff:ff:ff
    altname enp0s3
    inet 10.30.170.248/23 metric 100 brd 10.30.171.255 scope global dynamic ens3
       valid_lft 85378sec preferred_lft 85378sec
    inet6 fe80::f816:3eff:fe35:ddb4/64 scope link 
       valid_lft forever preferred_lft forever


---> sar -b -r -n DEV:
Linux 6.8.0-90-generic (prd-ubuntu2404-robot-2c-8g-11620) 	05/07/26 	_x86_64_	(2 CPU)

02:55:54     LINUX RESTART	(2 CPU)

03:00:08          tps      rtps      wtps      dtps   bread/s   bwrtn/s   bdscd/s
03:10:09        12.04      1.66      9.08      1.30    144.83   1364.67   1111.24
Average:        12.04      1.66      9.08      1.30    144.83   1364.67   1111.24

03:00:08    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
03:10:09      5278444   7398156    373680      4.59     84848   2199172    804420      8.76    601272   1960296       496
Average:      5278444   7398156    373680      4.59     84848   2199172    804420      8.76    601272   1960296       496

03:00:08        IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
03:10:09           lo      1.19      1.19      0.07      0.07      0.00      0.00      0.00      0.00
03:10:09         ens3      8.39      6.71     38.79      1.81      0.00      0.00      0.00      0.00
Average:           lo      1.19      1.19      0.07      0.07      0.00      0.00      0.00      0.00
Average:         ens3      8.39      6.71     38.79      1.81      0.00      0.00      0.00      0.00


---> sar -P ALL:
Linux 6.8.0-90-generic (prd-ubuntu2404-robot-2c-8g-11620) 	05/07/26 	_x86_64_	(2 CPU)

02:55:54     LINUX RESTART	(2 CPU)

03:00:08        CPU     %user     %nice   %system   %iowait    %steal     %idle
03:10:09        all      7.35      0.00      0.95      4.76      0.05     86.89
03:10:09          0      8.28      0.00      0.97      8.27      0.06     82.42
03:10:09          1      6.41      0.00      0.93      1.25      0.04     91.36
Average:        all      7.35      0.00      0.95      4.76      0.05     86.89
Average:          0      8.28      0.00      0.97      8.27      0.06     82.42
Average:          1      6.41      0.00      0.93      1.25      0.04     91.36