13:41:34  Started by upstream project "integration-distribution-mri-test-vanadium" build number 59
13:41:34  originally caused by:
13:41:34   Started by timer
13:41:34  Running as SYSTEM
13:41:34  [EnvInject] - Loading node environment variables.
13:41:34  Building remotely on prd-ubuntu2404-robot-2c-8g-53532 (ubuntu2404-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-vanadium
13:41:35  [ssh-agent] Looking for ssh-agent implementation...
13:41:36  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
13:41:36  $ ssh-agent
13:41:36  SSH_AUTH_SOCK=/tmp/ssh-vGvbPhiZ71c9/agent.3146
13:41:36  SSH_AGENT_PID=3148
13:41:36  [ssh-agent] Started.
13:41:36  Running ssh-add (command line suppressed)
13:41:36  Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-vanadium@tmp/private_key_17144152112826771393.key (/w/workspace/controller-csit-3node-clustering-tell-all-vanadium@tmp/private_key_17144152112826771393.key)
13:41:36  [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
13:41:36  The recommended git tool is: NONE
13:41:55  using credential opendaylight-jenkins-ssh
13:41:55  Wiping out workspace first.
13:41:55  Cloning the remote Git repository
13:41:55  Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
13:41:55   > git init /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test # timeout=10
13:41:55  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
13:41:55   > git --version # timeout=10
13:41:55   > git --version # 'git version 2.43.0'
13:41:55  using GIT_SSH to set credentials Release Engineering Jenkins Key
13:41:55  Verifying host key using known hosts file, will automatically accept unseen keys
13:41:55   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
13:42:06   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
13:42:06   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
13:42:06   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
13:42:06  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
13:42:06  using GIT_SSH to set credentials Release Engineering Jenkins Key
13:42:06  Verifying host key using known hosts file, will automatically accept unseen keys
13:42:06   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
13:42:07   > git rev-parse FETCH_HEAD^{commit} # timeout=10
13:42:07  Checking out Revision 901c7e139945b436d95a44b3b592904c3d7a4f9f (origin/master)
13:42:07   > git config core.sparsecheckout # timeout=10
13:42:07   > git checkout -f 901c7e139945b436d95a44b3b592904c3d7a4f9f # timeout=10
13:42:07  Commit message: "Adapt updater.py to use new lsp-flags container"
13:42:08   > git rev-parse FETCH_HEAD^{commit} # timeout=10
13:42:08   > git rev-list --no-walk f65244a2a093016c71f9a7a564be7d086941e15c # timeout=10
13:42:08  No emails were triggered.
13:42:08  provisioning config files...
13:42:08  copy managed file [npmrc] to file:/home/jenkins/.npmrc
13:42:08  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
13:42:12  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
13:42:12  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins5283358052047358849.sh
13:42:12  ---> python-tools-install.sh
13:42:12  Setup pyenv:
13:42:12  * system (set by /opt/pyenv/version)
13:42:12  * 3.8.20 (set by /opt/pyenv/version)
13:42:12  * 3.9.20 (set by /opt/pyenv/version)
13:42:12    3.10.15
13:42:12    3.11.10
13:42:17  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-vBj7
13:42:17  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
13:42:17  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
13:42:21  lf-activate-venv(): INFO: Installing additional packages: lftools 
13:42:46  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
13:42:46  virtualenv 21.9.1 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.1 which is incompatible.
13:42:46  lf-activate-venv(): INFO: Adding /tmp/venv-vBj7/bin to PATH
13:42:46  Generating Requirements File
13:43:11  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
13:43:11  httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
13:43:11  Python 3.11.10
13:43:12  pip 26.2.1 from /tmp/venv-vBj7/lib/python3.11/site-packages/pip (python 3.11)
13:43:12  aiohappyeyeballs==2.7.1
13:43:12  aiohttp==3.14.3
13:43:12  aiosignal==1.4.0
13:43:12  appdirs==1.4.4
13:43:12  argcomplete==3.7.2
13:43:12  aspy.yaml==1.3.0
13:43:12  attrs==26.1.0
13:43:12  autopage==0.6.0
13:43:12  beautifulsoup4==4.15.0
13:43:12  boto3==1.43.99
13:43:12  botocore==1.43.99
13:43:12  bs4==0.0.2
13:43:12  certifi==2026.7.22
13:43:12  cffi==2.1.1
13:43:12  cfgv==3.5.0
13:43:12  chardet==7.6.0
13:43:12  charset-normalizer==3.5.1
13:43:12  click==8.5.0
13:43:12  cliff==4.16.0
13:43:12  cmd2==4.2.4
13:43:12  cryptography==3.3.2
13:43:12  debtcollector==3.1.0
13:43:12  decorator==5.3.1
13:43:12  defusedxml==0.7.1
13:43:12  Deprecated==1.3.1
13:43:12  distlib==0.4.3
13:43:12  dnspython==2.8.0
13:43:12  docker==7.2.0
13:43:12  dogpile.cache==1.5.0
13:43:12  durationpy==0.11
13:43:12  email-validator==2.3.0
13:43:12  filelock==4.0.1
13:43:12  frozenlist==1.8.0
13:43:12  future==1.0.0
13:43:12  gitdb==4.0.12
13:43:12  GitPython==3.1.62
13:43:12  httplib2==0.30.2
13:43:12  identify==2.6.19
13:43:12  idna==3.20
13:43:12  importlib-resources==1.5.0
13:43:12  iso8601==2.1.0
13:43:12  Jinja2==3.1.6
13:43:12  jmespath==1.1.0
13:43:12  jsonpatch==1.33
13:43:12  jsonpointer==3.1.1
13:43:12  jsonschema==4.26.0
13:43:12  jsonschema-specifications==2025.9.1
13:43:12  keystoneauth1==5.17.0
13:43:12  kubernetes==36.0.3
13:43:12  lftools==0.37.23
13:43:12  lxml==6.1.3
13:43:12  markdown-it-py==4.2.0
13:43:12  MarkupSafe==3.0.3
13:43:12  mdurl==0.1.2
13:43:12  msgpack==1.2.2
13:43:12  multi_key_dict==2.0.3
13:43:12  multidict==6.9.1
13:43:12  munch==4.0.0
13:43:12  netaddr==1.3.0
13:43:12  niet==1.4.2
13:43:12  nodeenv==1.10.0
13:43:12  oauth2client==4.1.3
13:43:12  oauthlib==3.3.1
13:43:12  openstacksdk==4.20.0
13:43:12  os-service-types==1.9.0
13:43:12  osc-lib==4.7.0
13:43:12  oslo.config==10.7.0
13:43:12  oslo.context==6.5.0
13:43:12  oslo.i18n==6.9.0
13:43:12  oslo.log==8.3.2
13:43:12  oslo.serialization==5.11.0
13:43:12  oslo.utils==10.2.0
13:43:12  packaging==26.3
13:43:12  pbr==7.0.3
13:43:12  platformdirs==4.11.12
13:43:12  prettytable==3.18.0
13:43:12  prompt_toolkit==3.0.53
13:43:12  propcache==0.5.4
13:43:12  psutil==7.2.2
13:43:12  pyasn1==0.6.4
13:43:12  pyasn1_modules==0.4.2
13:43:12  pycparser==3.0
13:43:12  pygerrit2==2.0.15
13:43:12  PyGithub==2.10.0
13:43:12  Pygments==2.21.0
13:43:12  PyJWT==2.14.0
13:43:12  PyNaCl==1.6.2
13:43:12  pyparsing==2.4.7
13:43:12  pyperclip==1.11.0
13:43:12  pyrsistent==0.20.0
13:43:12  python-dateutil==2.9.0.post0
13:43:12  python-discovery==1.6.1
13:43:12  python-heatclient==5.3.0
13:43:12  python-jenkins==1.8.3
13:43:12  python-keystoneclient==6.0.0
13:43:12  python-magnumclient==5.0.0
13:43:12  python-manilaclient==6.3.0
13:43:12  python-openstackclient==10.3.0
13:43:12  python-swiftclient==4.11.0
13:43:12  PyYAML==6.0.3
13:43:12  referencing==0.37.0
13:43:12  requests==2.34.2
13:43:12  requests-oauthlib==2.0.0
13:43:12  rfc3986==2.0.0
13:43:12  rich==15.0.0
13:43:12  rich-argparse==1.8.0
13:43:12  rpds-py==2026.6.3
13:43:12  rsa==4.9.1
13:43:12  ruamel.yaml==0.19.1
13:43:12  ruamel.yaml.clib==0.2.15
13:43:12  s3transfer==0.19.2
13:43:12  simplejson==4.1.2
13:43:12  six==1.17.0
13:43:12  smmap==5.0.3
13:43:12  soupsieve==2.9.2
13:43:12  stevedore==5.9.1
13:43:12  tabulate==0.10.0
13:43:12  toml==0.10.2
13:43:12  tomlkit==0.15.1
13:43:12  tqdm==4.70.1
13:43:12  typing_extensions==4.16.0
13:43:12  urllib3==1.26.20
13:43:12  virtualenv==21.9.1
13:43:12  wcwidth==0.8.4
13:43:12  websocket-client==1.9.2
13:43:12  wrapt==2.4.1
13:43:12  xdg==6.0.0
13:43:12  xmltodict==1.0.4
13:43:12  yarl==1.25.1
13:43:12  yq==4.2.0
13:43:12  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/sh /tmp/jenkins12071417135081536881.sh
13:43:12  ---> uv-install.sh
13:43:12  Installing uv/uvx (latest) using shell installer
13:43:12  2026-09-22 13:43:12 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71308/71308] -> "/tmp/uv-install-rfuKYk.sh" [1]
13:43:12  downloading uv 0.12.17 x86_64-unknown-linux-gnu
13:43:13  installing to /home/jenkins/.local/bin
13:43:13    uv
13:43:13    uvx
13:43:13  everything's installed!
13:43:13  
13:43:13  To add $HOME/.local/bin to your PATH, either restart your shell or run:
13:43:13  
13:43:13      source $HOME/.local/bin/env (sh, bash, zsh)
13:43:13      source $HOME/.local/bin/env.fish (fish)
13:43:13  Adding install location to PATH
13:43:13  ---> Validating uv/uvx install
13:43:13  uvx 0.12.17 (x86_64-unknown-linux-gnu)
13:43:13  [EnvInject] - Injecting environment variables from a build step.
13:43:13  [EnvInject] - Injecting as environment variables the properties content 
13:43:13  OS_STACK_TEMPLATE=csit-2-instance-type.yaml
13:43:13  OS_CLOUD=vex
13:43:13  OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-vanadium-59
13:43:13  OS_STACK_TEMPLATE_DIR=openstack-hot
13:43:13  
13:43:13  [EnvInject] - Variables injected successfully.
13:43:13  provisioning config files...
13:43:19  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
13:43:19  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins17612734997845166280.sh
13:43:19  ---> Create parameters file for OpenStack HOT
13:43:19  OpenStack Heat parameters generated
13:43:19  -----------------------------------
13:43:19  parameters:
13:43:19      vm_0_count: '3'
13:43:19      vm_0_flavor: 'v3-standard-4'
13:43:19      vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260824-071601.077'
13:43:19      vm_1_count: '0'
13:43:19      vm_1_flavor: 'v3-standard-2'
13:43:19      vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20260811-083858.899'
13:43:19      
13:43:19      job_name: '29596-59'
13:43:19      silo: 'releng'
13:43:19  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash -l /tmp/jenkins2302273293109268204.sh
13:43:19  ---> Create HEAT stack
13:43:19  + source /home/jenkins/lf-env.sh
13:43:19  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
13:43:19  ++ mktemp -d /tmp/venv-XXXX
13:43:19  + lf_venv=/tmp/venv-A1cr
13:43:19  + local venv_file=/tmp/.os_lf_venv
13:43:19  + local python=python3
13:43:19  + local options
13:43:19  + local set_path=true
13:43:19  + local install_args=
13:43:19  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
13:43:19  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
13:43:19  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
13:43:19  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
13:43:19  + true
13:43:19  + case $1 in
13:43:19  + python=python3
13:43:19  + shift 2
13:43:19  + true
13:43:19  + case $1 in
13:43:19  + shift
13:43:19  + break
13:43:19  + case $python in
13:43:19  + local pkg_list=
13:43:19  + [[ -d /opt/pyenv ]]
13:43:19  + echo 'Setup pyenv:'
13:43:19  Setup pyenv:
13:43:19  + export PYENV_ROOT=/opt/pyenv
13:43:19  + PYENV_ROOT=/opt/pyenv
13:43:19  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
13:43:19  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
13:43:19  + pyenv versions
13:43:19    system
13:43:19    3.8.20
13:43:19    3.9.20
13:43:19    3.10.15
13:43:19  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
13:43:19  + command -v pyenv
13:43:19  ++ pyenv init - --no-rehash
13:43:19  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
13:43:19  for i in ${!paths[@]}; do 
13:43:19  if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
13:43:19  fi; done; 
13:43:19  echo "${paths[*]}"'\'')"
13:43:19  export PATH="/opt/pyenv/shims:${PATH}"
13:43:19  export PYENV_SHELL=bash
13:43:19  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
13:43:19  pyenv() {
13:43:19    local command
13:43:19    command="${1:-}"
13:43:19    if [ "$#" -gt 0 ]; then
13:43:19      shift
13:43:19    fi
13:43:19  
13:43:19    case "$command" in
13:43:19    rehash|shell)
13:43:19      eval "$(pyenv "sh-$command" "$@")"
13:43:19      ;;
13:43:19    *)
13:43:19      command pyenv "$command" "$@"
13:43:19      ;;
13:43:19    esac
13:43:19  }'
13:43:19  +++ bash --norc -ec 'IFS=:; paths=($PATH); 
13:43:19  for i in ${!paths[@]}; do 
13:43:19  if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
13:43:19  fi; done; 
13:43:19  echo "${paths[*]}"'
13:43:19  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
13:43:19  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
13:43:19  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
13:43:19  ++ export PYENV_SHELL=bash
13:43:19  ++ PYENV_SHELL=bash
13:43:19  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
13:43:19  +++ complete -F _pyenv pyenv
13:43:19  ++ lf-pyver python3
13:43:19  ++ local py_version_xy=python3
13:43:19  ++ local py_version_xyz=
13:43:19  ++ pyenv versions
13:43:19  ++ local command
13:43:19  ++ command=versions
13:43:19  ++ '[' 1 -gt 0 ']'
13:43:19  ++ shift
13:43:19  ++ case "$command" in
13:43:19  ++ command pyenv versions
13:43:19  ++ sed 's/^[ *]* //'
13:43:19  ++ awk '{ print $1 }'
13:43:19  ++ grep -E '^[0-9.]*[0-9]$'
13:43:19  ++ [[ ! -s /tmp/.pyenv_versions ]]
13:43:19  +++ grep '^3' /tmp/.pyenv_versions
13:43:19  +++ sort -V
13:43:19  +++ tail -n 1
13:43:19  ++ py_version_xyz=3.11.10
13:43:19  ++ [[ -z 3.11.10 ]]
13:43:19  ++ echo 3.11.10
13:43:19  ++ return 0
13:43:19  + pyenv local 3.11.10
13:43:19  + local command
13:43:19  + command=local
13:43:19  + '[' 2 -gt 0 ']'
13:43:19  + shift
13:43:19  + case "$command" in
13:43:19  + command pyenv local 3.11.10
13:43:19  + for arg in "$@"
13:43:19  + case $arg in
13:43:19  + pkg_list+='lftools[openstack] '
13:43:19  + for arg in "$@"
13:43:19  + case $arg in
13:43:19  + pkg_list+='kubernetes '
13:43:19  + for arg in "$@"
13:43:19  + case $arg in
13:43:19  + pkg_list+='niet '
13:43:19  + for arg in "$@"
13:43:19  + case $arg in
13:43:19  + pkg_list+='python-heatclient '
13:43:19  + for arg in "$@"
13:43:19  + case $arg in
13:43:19  + pkg_list+='python-openstackclient '
13:43:19  + for arg in "$@"
13:43:19  + case $arg in
13:43:19  + pkg_list+='python-magnumclient '
13:43:19  + for arg in "$@"
13:43:19  + case $arg in
13:43:19  + pkg_list+='urllib3~=1.26.15 '
13:43:19  + for arg in "$@"
13:43:19  + case $arg in
13:43:19  + pkg_list+='yq '
13:43:19  + [[ -f /tmp/.os_lf_venv ]]
13:43:19  ++ cat /tmp/.os_lf_venv
13:43:19  + lf_venv=/tmp/venv-vBj7
13:43:19  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vBj7 from' file:/tmp/.os_lf_venv
13:43:19  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vBj7 from file:/tmp/.os_lf_venv
13:43:19  + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
13:43:19  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
13:43:19  + local 'pip_opts=--upgrade --quiet'
13:43:19  + pip_opts='--upgrade --quiet --trusted-host pypi.org'
13:43:19  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
13:43:19  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
13:43:19  + [[ -n '' ]]
13:43:19  + [[ -n '' ]]
13:43:19  + lf-venv-pip-install /tmp/venv-vBj7/bin/python3 --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
13:43:19  + local venv_python=/tmp/venv-vBj7/bin/python3
13:43:19  + shift
13:43:19  + local upstream=https://pypi.org/simple
13:43:19  + /tmp/venv-vBj7/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
13:43:21  + return 0
13:43:21  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq  ]]
13:43:21  + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq '
13:43:21  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
13:43:21  + lf-venv-pip-install /tmp/venv-vBj7/bin/python3 --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
13:43:21  + local venv_python=/tmp/venv-vBj7/bin/python3
13:43:21  + shift
13:43:21  + local upstream=https://pypi.org/simple
13:43:21  + /tmp/venv-vBj7/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
13:43:39  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
13:43:39  virtualenv 21.9.1 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.1 which is incompatible.
13:43:39  python-manilaclient 6.3.0 requires osc-lib>=3.2.0, but you have osc-lib 2.2.1 which is incompatible.
13:43:39  + return 0
13:43:39  + type python3
13:43:39  + true
13:43:39  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-vBj7/bin to PATH'
13:43:39  lf-activate-venv(): INFO: Adding /tmp/venv-vBj7/bin to PATH
13:43:39  + PATH=/tmp/venv-vBj7/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
13:43:39  + return 0
13:43:39  + openstack --os-cloud vex limits show --absolute
13:43:41  +--------------------------+---------+
13:43:41  | Name                     |   Value |
13:43:41  +--------------------------+---------+
13:43:41  | maxTotalInstances        |      -1 |
13:43:41  | maxTotalCores            |     450 |
13:43:41  | maxTotalRAMSize          | 1000000 |
13:43:41  | maxServerMeta            |     128 |
13:43:41  | maxImageMeta             |     128 |
13:43:41  | maxPersonality           |       5 |
13:43:41  | maxPersonalitySize       |   10240 |
13:43:41  | maxTotalKeypairs         |     100 |
13:43:41  | maxServerGroups          |      10 |
13:43:41  | maxServerGroupMembers    |      10 |
13:43:41  | maxTotalFloatingIps      |      -1 |
13:43:41  | maxSecurityGroups        |      -1 |
13:43:41  | maxSecurityGroupRules    |      -1 |
13:43:41  | totalRAMUsed             |  992256 |
13:43:41  | totalCoresUsed           |     243 |
13:43:41  | totalInstancesUsed       |      64 |
13:43:41  | totalFloatingIpsUsed     |       0 |
13:43:41  | totalSecurityGroupsUsed  |       0 |
13:43:41  | totalServerGroupsUsed    |       0 |
13:43:41  | maxTotalVolumes          |      -1 |
13:43:41  | maxTotalSnapshots        |      10 |
13:43:41  | maxTotalVolumeGigabytes  |    4096 |
13:43:41  | maxTotalBackups          |      10 |
13:43:41  | maxTotalBackupGigabytes  |    1000 |
13:43:41  | totalVolumesUsed         |       4 |
13:43:41  | totalGigabytesUsed       |      80 |
13:43:41  | totalSnapshotsUsed       |       0 |
13:43:41  | totalBackupsUsed         |       0 |
13:43:41  | totalBackupGigabytesUsed |       0 |
13:43:41  +--------------------------+---------+
13:43:41  + pushd /opt/ciman/openstack-hot
13:43:41  /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium
13:43:41  + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-vanadium-59 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/stack-parameters.yaml
13:44:31  Creating stack releng-controller-csit-3node-clustering-tell-all-vanadium-59
13:44:31  WARN: Failed to initialize stack. Reason: Resource CREATE failed: Forbidden: resources.vm_0_group.resources[0].resources.instance: Quota exceeded for ram: Requested 16384, but already used 992256 of 1000000 ram (HTTP 403) (Request-ID: req-897175cc-5f9b-43a7-9114-10646967a5cd)
13:44:31  Deleting stack ca5c8255-6816-418c-baf9-195c9adb578c
13:44:31  Successfully deleted stack ca5c8255-6816-418c-baf9-195c9adb578c
13:44:31  WARN: Failed to initialize stack. Reason: Resource CREATE failed: Forbidden: resources.vm_0_group.resources[2].resources.instance: Quota exceeded for ram: Requested 16384, but already used 992256 of 1000000 ram (HTTP 403) (Request-ID: req-54c8e275-6862-4802-a728-47f9bb402336)
13:44:31  Deleting stack 9093f4f5-84da-4ff7-b330-76c10c2ff6ce
13:44:31  Successfully deleted stack 9093f4f5-84da-4ff7-b330-76c10c2ff6ce
13:44:31  ------------------------------------
13:44:31  Stack Details
13:44:31  ------------------------------------
13:44:31  openstack.orchestration.v1.stack.Stack(id=9093f4f5-84da-4ff7-b330-76c10c2ff6ce, stack_name=releng-controller-csit-3node-clustering-tell-all-vanadium-59, links=[{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-vanadium-59/9093f4f5-84da-4ff7-b330-76c10c2ff6ce', 'rel': 'self'}], creation_time=2026-09-22T13:44:09Z, updated_time=None, deletion_time=None, notification_topics=[], parameters={'OS::stack_id': '9093f4f5-84da-4ff7-b330-76c10c2ff6ce', 'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-vanadium-59', 'job_name': '29596-59', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260824-071601.077', 'vm_1_count': '0', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20260811-083858.899'}, description=No description, template_description=No description, capabilities=[], disable_rollback=True, timeout_mins=15, stack_owner=****, parent=None, stack_user_project_id=78ecb7624a2646d68b554cefad7c4f25, tags=[], stack_status=CREATE_FAILED, stack_status_reason=Resource CREATE failed: Forbidden: resources.vm_0_group.resources[2].resources.instance: Quota exceeded for ram: Requested 16384, but already used 992256 of 1000000 ram (HTTP 403) (Request-ID: req-54c8e275-6862-4802-a728-47f9bb402336), outputs=[{'output_key': 'vm_1_ips', 'description': 'IP addresses of the 2nd vm types', 'output_value': []}, {'output_key': 'vm_0_ips', 'description': 'IP addresses of the 1st vm types', 'output_value': [None, None, None]}], location=Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}))
13:44:31  ------------------------------------
13:44:31  + popd
13:44:31  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium
13:44:31  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash -l /tmp/jenkins6422507404438782672.sh
13:44:31  ---> Copy SSH public keys to CSIT lab
13:44:31  Setup pyenv:
13:44:31    system
13:44:31    3.8.20
13:44:31    3.9.20
13:44:31    3.10.15
13:44:31  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
13:44:31  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vBj7 from file:/tmp/.os_lf_venv
13:44:31  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
13:44:33  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 
13:44:48  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
13:44:48  virtualenv 21.9.1 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.1 which is incompatible.
13:44:49  lf-activate-venv(): INFO: Adding /tmp/venv-vBj7/bin to PATH
13:44:51  Stack not found: releng-controller-csit-3node-clustering-tell-all-vanadium-59
13:44:51  SSH ready on all stack servers.
13:44:51  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash -l /tmp/jenkins11915891517385896314.sh
13:44:51  Setup pyenv:
13:44:51    system
13:44:51    3.8.20
13:44:51    3.9.20
13:44:51    3.10.15
13:44:51  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
13:44:55  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-nmrC
13:44:55  lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.robot_venv
13:44:55  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
13:44:59  lf-activate-venv(): INFO: Installing additional packages: setuptools wheel 
13:45:00  lf-activate-venv(): INFO: Adding /tmp/venv-nmrC/bin to PATH
13:45:00  + echo 'Installing Python Requirements'
13:45:00  Installing Python Requirements
13:45:00  + cat
13:45:00  + python -m pip install -r requirements.txt
13:45:01  Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
13:45:01  Collecting docker-py (from -r requirements.txt (line 1))
13:45:01    Downloading docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
13:45:01  Collecting ipaddr (from -r requirements.txt (line 2))
13:45:01    Downloading ipaddr-2.2.0.tar.gz (26 kB)
13:45:01    Installing build dependencies: started
13:45:01    Installing build dependencies: finished with status 'done'
13:45:02    Getting requirements to build wheel: started
13:45:02    Getting requirements to build wheel: finished with status 'done'
13:45:02    Preparing metadata (pyproject.toml): started
13:45:02    Preparing metadata (pyproject.toml): finished with status 'done'
13:45:02  Collecting netaddr (from -r requirements.txt (line 3))
13:45:02    Using cached netaddr-1.3.0-py3-none-any.whl (2.3 MB)
13:45:02  Collecting netifaces (from -r requirements.txt (line 4))
13:45:02    Downloading netifaces-0.11.0.tar.gz (30 kB)
13:45:02    Installing build dependencies: started
13:45:03    Installing build dependencies: finished with status 'done'
13:45:03    Getting requirements to build wheel: started
13:45:03    Getting requirements to build wheel: finished with status 'done'
13:45:03    Preparing metadata (pyproject.toml): started
13:45:04    Preparing metadata (pyproject.toml): finished with status 'done'
13:45:04  Collecting pyhocon (from -r requirements.txt (line 5))
13:45:04    Downloading pyhocon-0.3.63.tar.gz (307 kB)
13:45:04    Installing build dependencies: started
13:45:05    Installing build dependencies: finished with status 'done'
13:45:05    Getting requirements to build wheel: started
13:45:05    Getting requirements to build wheel: finished with status 'done'
13:45:05    Preparing metadata (pyproject.toml): started
13:45:05    Preparing metadata (pyproject.toml): finished with status 'done'
13:45:05  Collecting requests (from -r requirements.txt (line 6))
13:45:05    Using cached requests-2.34.2-py3-none-any.whl (73 kB)
13:45:05  Collecting robotframework (from -r requirements.txt (line 7))
13:45:05    Downloading robotframework-7.5-py3-none-any.whl (842 kB)
13:45:05       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 842.5/842.5 kB 27.2 MB/s  0:00:00
13:45:05  Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
13:45:05    Downloading robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
13:45:05    Installing build dependencies: started
13:45:06    Installing build dependencies: finished with status 'done'
13:45:06    Getting requirements to build wheel: started
13:45:06    Getting requirements to build wheel: finished with status 'done'
13:45:06    Preparing metadata (pyproject.toml): started
13:45:07    Preparing metadata (pyproject.toml): finished with status 'done'
13:45:07  Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
13:45:07    Downloading robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
13:45:07  Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
13:45:07    Downloading robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
13:45:07  Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
13:45:07    Downloading robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
13:45:07    Installing build dependencies: started
13:45:08    Installing build dependencies: finished with status 'done'
13:45:08    Getting requirements to build wheel: started
13:45:08    Getting requirements to build wheel: finished with status 'done'
13:45:08    Preparing metadata (pyproject.toml): started
13:45:08    Preparing metadata (pyproject.toml): finished with status 'done'
13:45:08  Collecting scapy (from -r requirements.txt (line 12))
13:45:08    Downloading scapy-2.7.0-py3-none-any.whl (2.6 MB)
13:45:08       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 31.5 MB/s  0:00:00
13:45:09  Collecting jsonpath-rw (from -r requirements.txt (line 15))
13:45:09    Downloading jsonpath-rw-1.4.0.tar.gz (13 kB)
13:45:09    Installing build dependencies: started
13:45:09    Installing build dependencies: finished with status 'done'
13:45:09    Getting requirements to build wheel: started
13:45:10    Getting requirements to build wheel: finished with status 'done'
13:45:10    Preparing metadata (pyproject.toml): started
13:45:10    Preparing metadata (pyproject.toml): finished with status 'done'
13:45:10  Collecting elasticsearch (from -r requirements.txt (line 18))
13:45:10    Downloading elasticsearch-9.5.1-py3-none-any.whl (1.0 MB)
13:45:10       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.0/1.0 MB 32.4 MB/s  0:00:00
13:45:10  Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
13:45:10    Downloading elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB)
13:45:10  Collecting pyangbind (from -r requirements.txt (line 22))
13:45:10    Downloading pyangbind-0.8.7-py3-none-any.whl (52 kB)
13:45:10  Collecting isodate (from -r requirements.txt (line 25))
13:45:10    Downloading isodate-0.7.2-py3-none-any.whl (22 kB)
13:45:10  Collecting jmespath (from -r requirements.txt (line 28))
13:45:10    Using cached jmespath-1.1.0-py3-none-any.whl (20 kB)
13:45:10  Collecting jsonpatch (from -r requirements.txt (line 31))
13:45:10    Using cached jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
13:45:10  Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
13:45:10    Downloading paramiko-5.0.0-py3-none-any.whl (208 kB)
13:45:10  Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
13:45:10    Downloading scp-0.16.1-py2.py3-none-any.whl (8.9 kB)
13:45:10  Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
13:45:10    Downloading docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
13:45:10  Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
13:45:10    Using cached six-1.17.0-py2.py3-none-any.whl (11 kB)
13:45:10  Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
13:45:10    Using cached websocket_client-1.9.2-py3-none-any.whl (95 kB)
13:45:11  Collecting pyparsing>=3.0.0 (from pyhocon->-r requirements.txt (line 5))
13:45:11    Using cached pyparsing-3.3.3-py3-none-any.whl (126 kB)
13:45:11  Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
13:45:11    Using cached charset_normalizer-3.5.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (262 kB)
13:45:11  Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
13:45:11    Using cached idna-3.20-py3-none-any.whl (69 kB)
13:45:11  Collecting urllib3<3,>=1.26 (from requests->-r requirements.txt (line 6))
13:45:11    Using cached urllib3-2.8.0-py3-none-any.whl (135 kB)
13:45:11  Collecting certifi>=2023.5.7 (from requests->-r requirements.txt (line 6))
13:45:11    Using cached certifi-2026.7.22-py3-none-any.whl (136 kB)
13:45:11  Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
13:45:11    Downloading webtest-3.0.7-py3-none-any.whl (32 kB)
13:45:11  Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
13:45:11    Using cached jsonpointer-3.1.1-py3-none-any.whl (7.7 kB)
13:45:11  Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
13:45:11    Downloading robotframework_seleniumlibrary-6.9.0-py3-none-any.whl (105 kB)
13:45:11  Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
13:45:11    Downloading ply-3.11-py2.py3-none-any.whl (49 kB)
13:45:11  Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
13:45:11    Using cached decorator-5.3.1-py3-none-any.whl (10 kB)
13:45:11  Collecting anyio (from elasticsearch->-r requirements.txt (line 18))
13:45:11    Downloading anyio-4.15.1-py3-none-any.whl (132 kB)
13:45:11  Collecting elastic-transport<10,>=9.4.1 (from elasticsearch->-r requirements.txt (line 18))
13:45:11    Downloading elastic_transport-9.4.2-py3-none-any.whl (66 kB)
13:45:11  Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18))
13:45:11    Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
13:45:11  Collecting sniffio (from elasticsearch->-r requirements.txt (line 18))
13:45:11    Downloading sniffio-1.3.1-py3-none-any.whl (10 kB)
13:45:11  Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18))
13:45:11    Using cached typing_extensions-4.16.0-py3-none-any.whl (45 kB)
13:45:11  Collecting elasticsearch (from -r requirements.txt (line 18))
13:45:11    Downloading elasticsearch-8.19.3-py3-none-any.whl (952 kB)
13:45:11       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 952.8/952.8 kB 36.1 MB/s  0:00:00
13:45:11  INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while.
13:45:11  Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
13:45:11    Downloading elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB)
13:45:11    Downloading elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB)
13:45:11    Downloading elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB)
13:45:12    Downloading elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB)
13:45:12  Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
13:45:12    Downloading elastic_transport-8.19.0-py3-none-any.whl (65 kB)
13:45:12  Collecting pyang (from pyangbind->-r requirements.txt (line 22))
13:45:12    Downloading pyang-2.7.1-py2.py3-none-any.whl (598 kB)
13:45:12       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 19.1 MB/s  0:00:00
13:45:12  Collecting lxml (from pyangbind->-r requirements.txt (line 22))
13:45:12    Using cached lxml-6.1.3-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB)
13:45:13  Collecting regex (from pyangbind->-r requirements.txt (line 22))
13:45:13    Downloading regex-2026.9.10-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (802 kB)
13:45:13       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 803.0/803.0 kB 27.5 MB/s  0:00:00
13:45:13  Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
13:45:13    Downloading enum34-1.1.10-py3-none-any.whl (11 kB)
13:45:13  Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
13:45:13    Downloading bcrypt-5.0.0-cp39-abi3-manylinux_2_34_x86_64.whl (278 kB)
13:45:14  Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
13:45:14    Using cached cryptography-50.0.1-cp311-abi3-manylinux_2_34_x86_64.whl (4.7 MB)
13:45:14  Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
13:45:14    Downloading invoke-3.0.3-py3-none-any.whl (160 kB)
13:45:14  Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
13:45:14    Using cached pynacl-1.6.2-cp38-abi3-manylinux_2_34_x86_64.whl (1.4 MB)
13:45:14  Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
13:45:14    Using cached cffi-2.1.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (217 kB)
13:45:14  Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
13:45:14    Using cached pycparser-3.0-py3-none-any.whl (48 kB)
13:45:14  Collecting selenium>=4.25.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
13:45:14    Downloading selenium-4.49.0-py3-none-any.whl (11.8 MB)
13:45:15       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.8/11.8 MB 78.4 MB/s  0:00:00
13:45:15  Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
13:45:15    Downloading robotframework_pythonlibcore-4.6.0-py3-none-any.whl (20 kB)
13:45:15  Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
13:45:15    Using cached click-8.5.0-py3-none-any.whl (125 kB)
13:45:15  Collecting trio<1.0,>=0.31.0 (from selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
13:45:15    Downloading trio-0.34.0-py3-none-any.whl (511 kB)
13:45:15  Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
13:45:15    Downloading trio_websocket-0.12.2-py3-none-any.whl (21 kB)
13:45:15  Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
13:45:15    Using cached attrs-26.1.0-py3-none-any.whl (67 kB)
13:45:15  Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
13:45:15    Downloading sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
13:45:15  Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
13:45:15    Downloading outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
13:45:15  Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
13:45:15    Downloading wsproto-1.3.2-py3-none-any.whl (24 kB)
13:45:15  Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.6.3->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
13:45:15    Downloading PySocks-1.7.1-py3-none-any.whl (16 kB)
13:45:15  Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
13:45:15    Downloading webob-1.8.11-py2.py3-none-any.whl (118 kB)
13:45:15  Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
13:45:15    Downloading waitress-3.0.2-py3-none-any.whl (56 kB)
13:45:15  Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
13:45:15    Using cached beautifulsoup4-4.15.0-py3-none-any.whl (109 kB)
13:45:15  Collecting h11<1,>=0.16.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
13:45:15    Downloading h11-0.16.0-py3-none-any.whl (37 kB)
13:45:16  Collecting soupsieve>=1.6.1 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
13:45:16    Using cached soupsieve-2.9.2-py3-none-any.whl (37 kB)
13:45:16  Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, pyhocon, robotframework-httplibrary, jsonpath-rw
13:45:16    Building wheel for robotframework-sshlibrary (pyproject.toml): started
13:45:16    Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done'
13:45:16    Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55206 sha256=afe0f84021d7cd564a85e56c44d890e6c9bc698d9c76500c915f28c1436e0e97
13:45:16    Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
13:45:16    Building wheel for ipaddr (pyproject.toml): started
13:45:16    Building wheel for ipaddr (pyproject.toml): finished with status 'done'
13:45:16    Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18353 sha256=0e238e4db1eb3ac7b69367ca13585cd7649455180d7922de36d732e74c79e8a5
13:45:16    Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
13:45:16    Building wheel for netifaces (pyproject.toml): started
13:45:19    Building wheel for netifaces (pyproject.toml): finished with status 'done'
13:45:19    Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=34977 sha256=b25ebdcaa9b9536d3e3319fbc7c1b5941dbf8f3607d6fb27c9f8b82dca6eed62
13:45:19    Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
13:45:19    Building wheel for pyhocon (pyproject.toml): started
13:45:20    Building wheel for pyhocon (pyproject.toml): finished with status 'done'
13:45:20    Created wheel for pyhocon: filename=pyhocon-0.3.63-py3-none-any.whl size=24721 sha256=d65a8869578a64a28b1f7a1f00794db5ed267b3268db45b72b89dbc629a90003
13:45:20    Stored in directory: /home/jenkins/.cache/pip/wheels/ce/9e/92/cb17e17d79fafd46a767074b3ed1dca8f78036163f9bea914d
13:45:20    Building wheel for robotframework-httplibrary (pyproject.toml): started
13:45:20    Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done'
13:45:20    Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10015 sha256=f5ac79e950231ca484cf2c0b4634590b85f463cea6324cf6370489eb43c05eaa
13:45:20    Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
13:45:20    Building wheel for jsonpath-rw (pyproject.toml): started
13:45:20    Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done'
13:45:20    Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15175 sha256=a79cbbd7c65b76316d1435c1279639b878c801f91b2cb1bfd5cf053d3169260c
13:45:20    Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
13:45:20  Successfully built robotframework-sshlibrary ipaddr netifaces pyhocon robotframework-httplibrary jsonpath-rw
13:45:20  Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
13:45:27  
13:45:27  Successfully installed WebOb-1.8.11 attrs-26.1.0 bcrypt-5.0.0 beautifulsoup4-4.15.0 certifi-2026.7.22 cffi-2.1.1 charset_normalizer-3.5.1 click-8.5.0 cryptography-50.0.1 decorator-5.3.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.19.0 elasticsearch-8.19.3 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.20 invoke-3.0.3 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.1.0 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.1.1 lxml-6.1.3 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-5.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.7 pycparser-3.0 pyhocon-0.3.63 pynacl-1.6.2 pyparsing-3.3.3 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2026.9.10 requests-2.34.2 robotframework-7.5 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.6.0 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.9.0 robotframework-sshlibrary-3.8.0 scapy-2.7.0 scp-0.16.1 selenium-4.49.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.9.2 trio-0.34.0 trio-websocket-0.12.2 typing-extensions-4.16.0 urllib3-2.8.0 waitress-3.0.2 websocket-client-1.9.2 webtest-3.0.7 wsproto-1.3.2
13:45:27  + pip freeze
13:45:28  attrs==26.1.0
13:45:28  bcrypt==5.0.0
13:45:28  beautifulsoup4==4.15.0
13:45:28  certifi==2026.7.22
13:45:28  cffi==2.1.1
13:45:28  charset-normalizer==3.5.1
13:45:28  click==8.5.0
13:45:28  cryptography==50.0.1
13:45:28  decorator==5.3.1
13:45:28  distlib==0.4.3
13:45:28  docker-py==1.10.6
13:45:28  docker-pycreds==0.4.0
13:45:28  elastic-transport==8.19.0
13:45:28  elasticsearch==8.19.3
13:45:28  elasticsearch-dsl==8.15.4
13:45:28  enum34==1.1.10
13:45:28  filelock==3.32.7
13:45:28  h11==0.16.0
13:45:28  idna==3.20
13:45:28  invoke==3.0.3
13:45:28  ipaddr==2.2.0
13:45:28  isodate==0.7.2
13:45:28  jmespath==1.1.0
13:45:28  jsonpatch==1.33
13:45:28  jsonpath-rw==1.4.0
13:45:28  jsonpointer==3.1.1
13:45:28  lxml==6.1.3
13:45:28  netaddr==1.3.0
13:45:28  netifaces==0.11.0
13:45:28  outcome==1.3.0.post0
13:45:28  packaging==26.3
13:45:28  paramiko==5.0.0
13:45:28  platformdirs==4.11.12
13:45:28  ply==3.11
13:45:28  pyang==2.7.1
13:45:28  pyangbind==0.8.7
13:45:28  pycparser==3.0
13:45:28  pyhocon==0.3.63
13:45:28  PyNaCl==1.6.2
13:45:28  pyparsing==3.3.3
13:45:28  PySocks==1.7.1
13:45:28  python-dateutil==2.9.0.post0
13:45:28  python-discovery==1.6.1
13:45:28  regex==2026.9.10
13:45:28  requests==2.34.2
13:45:28  robotframework==7.5
13:45:28  robotframework-httplibrary==0.4.2
13:45:28  robotframework-pythonlibcore==4.6.0
13:45:28  robotframework-requests==0.9.7
13:45:28  robotframework-selenium2library==3.0.0
13:45:28  robotframework-seleniumlibrary==6.9.0
13:45:28  robotframework-sshlibrary==3.8.0
13:45:28  scapy==2.7.0
13:45:28  scp==0.16.1
13:45:28  selenium==4.49.0
13:45:28  six==1.17.0
13:45:28  sniffio==1.3.1
13:45:28  sortedcontainers==2.4.0
13:45:28  soupsieve==2.9.2
13:45:28  trio==0.34.0
13:45:28  trio-websocket==0.12.2
13:45:28  typing_extensions==4.16.0
13:45:28  urllib3==2.8.0
13:45:28  virtualenv==21.9.1
13:45:28  waitress==3.0.2
13:45:28  WebOb==1.8.11
13:45:28  websocket-client==1.9.2
13:45:28  WebTest==3.0.7
13:45:28  wsproto==1.3.2
13:45:28  [EnvInject] - Injecting environment variables from a build step.
13:45:28  [EnvInject] - Injecting as environment variables the properties file path 'env.properties'
13:45:28  [EnvInject] - Variables injected successfully.
13:45:28  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash -l /tmp/jenkins5271820111694848339.sh
13:45:28  Setup pyenv:
13:45:28    system
13:45:28    3.8.20
13:45:28    3.9.20
13:45:28    3.10.15
13:45:28  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
13:45:28  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vBj7 from file:/tmp/.os_lf_venv
13:45:28  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
13:45:30  lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq 
13:45:37  lf-activate-venv(): INFO: Adding /tmp/venv-vBj7/bin to PATH
13:45:37  + ODL_SYSTEM=()
13:45:37  + TOOLS_SYSTEM=()
13:45:37  + OPENSTACK_SYSTEM=()
13:45:37  + OPENSTACK_CONTROLLERS=()
13:45:37  + mapfile -t ADDR
13:45:37  ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-vanadium-59
13:45:37  ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
13:45:39  Stack not found: releng-controller-csit-3node-clustering-tell-all-vanadium-59
13:45:39  + for i in "${ADDR[@]}"
13:45:39  ++ ssh '' hostname -s
13:45:39  ssh: Could not resolve hostname : Device or resource busy
13:45:39  + REMHOST=
13:45:39  + case ${REMHOST} in
13:45:39  + TOOLS_SYSTEM=("${TOOLS_SYSTEM[@]}" "${i}")
13:45:39  + echo NUM_ODL_SYSTEM=0
13:45:39  + echo NUM_TOOLS_SYSTEM=1
13:45:39  + '[' '' == yes ']'
13:45:39  + NUM_OPENSTACK_SYSTEM=0
13:45:39  + echo NUM_OPENSTACK_SYSTEM=0
13:45:39  + '[' 0 -eq 2 ']'
13:45:39  + echo ODL_SYSTEM_IP=
13:45:39  ++ seq 0 -1
13:45:39  + echo TOOLS_SYSTEM_IP=
13:45:39  ++ seq 0 0
13:45:39  + for i in $(seq 0 $(( ${#TOOLS_SYSTEM[@]} - 1 )))
13:45:39  + echo TOOLS_SYSTEM_1_IP=
13:45:39  + openstack_index=0
13:45:39  + NUM_OPENSTACK_CONTROL_NODES=1
13:45:39  + echo NUM_OPENSTACK_CONTROL_NODES=1
13:45:39  ++ seq 0 0
13:45:39  + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
13:45:39  + echo OPENSTACK_CONTROL_NODE_1_IP=
13:45:39  + NUM_OPENSTACK_COMPUTE_NODES=-1
13:45:39  + echo NUM_OPENSTACK_COMPUTE_NODES=-1
13:45:39  + '[' -1 -ge 2 ']'
13:45:39  ++ seq 0 -2
13:45:39  + NUM_OPENSTACK_HAPROXY_NODES=0
13:45:39  + echo NUM_OPENSTACK_HAPROXY_NODES=0
13:45:39  ++ seq 0 -1
13:45:39  + echo 'Contents of slave_addresses.txt:'
13:45:39  Contents of slave_addresses.txt:
13:45:39  + cat slave_addresses.txt
13:45:39  NUM_ODL_SYSTEM=0
13:45:39  NUM_TOOLS_SYSTEM=1
13:45:39  NUM_OPENSTACK_SYSTEM=0
13:45:39  ODL_SYSTEM_IP=
13:45:39  TOOLS_SYSTEM_IP=
13:45:39  TOOLS_SYSTEM_1_IP=
13:45:39  NUM_OPENSTACK_CONTROL_NODES=1
13:45:39  OPENSTACK_CONTROL_NODE_1_IP=
13:45:39  NUM_OPENSTACK_COMPUTE_NODES=-1
13:45:39  NUM_OPENSTACK_HAPROXY_NODES=0
13:45:39  [EnvInject] - Injecting environment variables from a build step.
13:45:39  [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
13:45:39  [EnvInject] - Variables injected successfully.
13:45:39  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/sh /tmp/jenkins7109906991742203933.sh
13:45:39  Preparing for JRE Version 21
13:45:39  Karaf artifact is karaf
13:45:39  Karaf project is integration
13:45:39  Java home is /usr/lib/jvm/java-21-openjdk-amd64
13:45:39  [EnvInject] - Injecting environment variables from a build step.
13:45:39  [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
13:45:39  [EnvInject] - Variables injected successfully.
13:45:39  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins14664736434705405661.sh
13:45:39  2026-09-22 13:45:39 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/stable/vanadium/pom.xml [2619/2619] -> "pom.xml" [1]
13:45:39  Bundle version is 0.23.2-SNAPSHOT
13:45:39  --2026-09-22 13:45:39--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.23.2-SNAPSHOT/maven-metadata.xml
13:45:39  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
13:45:39  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
13:45:39  HTTP request sent, awaiting response... 200 OK
13:45:39  Length: 1410 (1.4K) [application/xml]
13:45:39  Saving to: ‘maven-metadata.xml’
13:45:39  
13:45:39       0K .                                                     100% 2.74G=0s
13:45:39  
13:45:39  2026-09-22 13:45:39 (2.74 GB/s) - ‘maven-metadata.xml’ saved [1410/1410]
13:45:39  
13:45:39  <?xml version="1.0" encoding="UTF-8"?>
13:45:39  <metadata modelVersion="1.1.0">
13:45:39    <groupId>org.opendaylight.integration</groupId>
13:45:39    <artifactId>karaf</artifactId>
13:45:39    <version>0.23.2-SNAPSHOT</version>
13:45:39    <versioning>
13:45:39      <snapshot>
13:45:39        <timestamp>20260922.130440</timestamp>
13:45:39        <buildNumber>404</buildNumber>
13:45:39      </snapshot>
13:45:39      <lastUpdated>20260922130440</lastUpdated>
13:45:39      <snapshotVersions>
13:45:39        <snapshotVersion>
13:45:39          <extension>pom</extension>
13:45:39          <value>0.23.2-20260922.130440-404</value>
13:45:39          <updated>20260922130440</updated>
13:45:39        </snapshotVersion>
13:45:39        <snapshotVersion>
13:45:39          <extension>tar.gz</extension>
13:45:39          <value>0.23.2-20260922.130440-404</value>
13:45:39          <updated>20260922130440</updated>
13:45:39        </snapshotVersion>
13:45:39        <snapshotVersion>
13:45:39          <extension>zip</extension>
13:45:39          <value>0.23.2-20260922.130440-404</value>
13:45:39          <updated>20260922130440</updated>
13:45:39        </snapshotVersion>
13:45:39        <snapshotVersion>
13:45:39          <classifier>cyclonedx</classifier>
13:45:39          <extension>xml</extension>
13:45:39          <value>0.23.2-20260922.130440-404</value>
13:45:39          <updated>20260922130440</updated>
13:45:39        </snapshotVersion>
13:45:39        <snapshotVersion>
13:45:39          <classifier>cyclonedx</classifier>
13:45:39          <extension>json</extension>
13:45:39          <value>0.23.2-20260922.130440-404</value>
13:45:39          <updated>20260922130440</updated>
13:45:39        </snapshotVersion>
13:45:39      </snapshotVersions>
13:45:39    </versioning>
13:45:39  </metadata>
13:45:39  Nexus timestamp is 0.23.2-20260922.130440-404
13:45:39  Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.23.2-SNAPSHOT/karaf-0.23.2-20260922.130440-404.zip
13:45:39  Distribution bundle is karaf-0.23.2-20260922.130440-404.zip
13:45:39  Distribution bundle version is 0.23.2-SNAPSHOT
13:45:39  Distribution folder is karaf-0.23.2-SNAPSHOT
13:45:39  Nexus prefix is https://nexus.opendaylight.org
13:45:39  [EnvInject] - Injecting environment variables from a build step.
13:45:39  [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
13:45:39  [EnvInject] - Variables injected successfully.
13:45:39  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash -l /tmp/jenkins13003155191870818275.sh
13:45:40  Setup pyenv:
13:45:40    system
13:45:40    3.8.20
13:45:40    3.9.20
13:45:40    3.10.15
13:45:40  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
13:45:40  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vBj7 from file:/tmp/.os_lf_venv
13:45:40  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
13:45:41  lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient 
13:45:47  lf-activate-venv(): INFO: Adding /tmp/venv-vBj7/bin to PATH
13:45:47  Copying common-functions.sh to /tmp
13:45:49  Stack not found: releng-controller-csit-3node-clustering-tell-all-vanadium-59
13:45:49  Copying common-functions.sh to :/tmp
13:45:49  cp: cannot create regular file ':/tmp': No such file or directory
13:45:49  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins5406627645939094412.sh
13:45:49  common-functions.sh is being sourced
13:45:49  common-functions environment:
13:45:49  MAVENCONF: /tmp/karaf-0.23.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
13:45:49  ACTUALFEATURES: 
13:45:49  FEATURESCONF: /tmp/karaf-0.23.2-SNAPSHOT/etc/org.apache.karaf.features.cfg
13:45:49  CUSTOMPROP: /tmp/karaf-0.23.2-SNAPSHOT/etc/custom.properties
13:45:49  LOGCONF: /tmp/karaf-0.23.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
13:45:49  MEMCONF: /tmp/karaf-0.23.2-SNAPSHOT/bin/setenv
13:45:49  CONTROLLERMEM: 2048m
13:45:49  AKKACONF: /tmp/karaf-0.23.2-SNAPSHOT/configuration/initial/akka.conf
13:45:49  MODULESCONF: /tmp/karaf-0.23.2-SNAPSHOT/configuration/initial/modules.conf
13:45:49  MODULESHARDSCONF: /tmp/karaf-0.23.2-SNAPSHOT/configuration/initial/module-shards.conf
13:45:49  SUITES: 
13:45:49  
13:45:49  #################################################
13:45:49  ##         Configure Cluster and Start         ##
13:45:49  #################################################
13:45:49  ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
13:45:49  SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
13:45:49  Locating script plan to use...
13:45:49  script plan exists!!!
13:45:49  Changing the script plan path...
13:45:49  # Place the scripts in run order:
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/scripts/car_people_shard.sh
13:45:49  Executing /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/scripts/car_people_shard.sh...
13:45:49  Add car-people shards file
13:45:49  Finished running script plans
13:45:49  Locating config plan to use...
13:45:49  Finished running config plans
13:45:49  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins14723942543493341775.sh
13:45:49  common-functions.sh is being sourced
13:45:49  common-functions environment:
13:45:49  MAVENCONF: /tmp/karaf-0.23.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
13:45:49  ACTUALFEATURES: 
13:45:49  FEATURESCONF: /tmp/karaf-0.23.2-SNAPSHOT/etc/org.apache.karaf.features.cfg
13:45:49  CUSTOMPROP: /tmp/karaf-0.23.2-SNAPSHOT/etc/custom.properties
13:45:49  LOGCONF: /tmp/karaf-0.23.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
13:45:49  MEMCONF: /tmp/karaf-0.23.2-SNAPSHOT/bin/setenv
13:45:49  CONTROLLERMEM: 2048m
13:45:49  AKKACONF: /tmp/karaf-0.23.2-SNAPSHOT/configuration/initial/akka.conf
13:45:49  MODULESCONF: /tmp/karaf-0.23.2-SNAPSHOT/configuration/initial/modules.conf
13:45:49  MODULESHARDSCONF: /tmp/karaf-0.23.2-SNAPSHOT/configuration/initial/module-shards.conf
13:45:49  SUITES: 
13:45:49  
13:45:49  + echo '#################################################'
13:45:49  #################################################
13:45:49  + echo '##         Verify Cluster is UP                ##'
13:45:49  ##         Verify Cluster is UP                ##
13:45:49  + echo '#################################################'
13:45:49  #################################################
13:45:49  + create_post_startup_script
13:45:49  + cat
13:45:49  + copy_and_run_post_startup_script
13:45:49  + seed_index=1
13:45:49  ++ seq 1 0
13:45:49  + dump_controller_threads
13:45:49  ++ seq 1 0
13:45:49  + '[' 0 -gt 0 ']'
13:45:49  + echo 'Generating controller variables...'
13:45:49  Generating controller variables...
13:45:49  ++ seq 1 0
13:45:49  + echo 'Generating mininet variables...'
13:45:49  Generating mininet variables...
13:45:49  ++ seq 1 1
13:45:49  + for i in $(seq 1 "${NUM_TOOLS_SYSTEM}")
13:45:49  + MININETIP=TOOLS_SYSTEM_1_IP
13:45:49  + tools_variables=' -v TOOLS_SYSTEM_1_IP:'
13:45:49  + get_test_suites SUITES
13:45:49  + local __suite_list=SUITES
13:45:49  + echo 'Locating test plan to use...'
13:45:49  Locating test plan to use...
13:45:49  + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/testplans/controller-clustering-tell-vanadium.txt
13:45:49  + '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/testplans/controller-clustering-tell-vanadium.txt ']'
13:45:49  + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/testplans/controller-clustering-tell.txt
13:45:49  + '[' disabled '!=' disabled ']'
13:45:49  + echo 'Changing the testplan path...'
13:45:49  Changing the testplan path...
13:45:49  + sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-vanadium: /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/testplans/controller-clustering-tell.txt
13:45:49  + cat testplan.txt
13:45:49  # Place the suites in run order:
13:45:49  
13:45:49  # disabling all "prefix based" suites. This functionality was newly
13:45:49  # introduced with these tests in 2017. The assumption is that
13:45:49  # development stopped in that area, but may continue at a later
13:45:49  # time. Still, the tests are failing and no resources to solve the
13:45:49  # failures at this time. If/When this changes, we can uncomment
13:45:49  # those suites. Note that every suite is commented out with it's
13:45:49  # accompanying "restart_with_tell_based_true" setup suite.
13:45:49  
13:45:49  
13:45:49  # /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  # /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot
13:45:49  # /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  # /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot
13:45:49  # /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  # /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot
13:45:49  # /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  # /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot
13:45:49  # /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  # /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot
13:45:49  # /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  # /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
13:45:49  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
13:45:49  + '[' -z '' ']'
13:45:49  ++ tr '\012' ' '
13:45:49  ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
13:45:49  + suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
13:45:49  + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
13:45:49  ++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
13:45:49  + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...'
13:45:49  Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...
13:45:49  + robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_vanadium -v BUNDLEFOLDER:karaf-0.23.2-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.23.2-SNAPSHOT/karaf-0.23.2-20260922.130440-404.zip -v CONTROLLER: -v CONTROLLER1: -v CONTROLLER2: -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-vanadium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:0 -v NUM_TOOLS_SYSTEM:1 -v ODL_STREAM:vanadium -v ODL_SYSTEM_IP: -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_1_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
13:45:49  ==============================================================================
13:45:49  controller-clustering-tell.txt                                                
13:45:49  ==============================================================================
13:45:50  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
13:45:50  ==============================================================================
13:45:50  Stop_All_Members :: Stop every odl node.                              | PASS |
13:45:50  ------------------------------------------------------------------------------
13:45:50  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
13:45:50  ------------------------------------------------------------------------------
13:45:50  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
13:50:51  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
13:50:51  ------------------------------------------------------------------------------
13:50:51  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
13:50:51  3 tests, 2 passed, 1 failed
13:50:51  ==============================================================================
13:50:52  controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes...
13:50:52  ==============================================================================
13:50:52  Get_Shard_Role :: Get shard role.                                     | PASS |
13:50:52  ------------------------------------------------------------------------------
13:50:52  Subscribe_Listener_To_Leader :: Subscribe listener to leader.         | FAIL |
13:50:52  ... click for list of related bugs or create a new one if needed (with the
13:50:52  "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader"
13:50:52  reference somewhere inside)
13:50:52  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status"
13:50:52  
13:50:52  No leader found.
13:50:52  ------------------------------------------------------------------------------
13:50:52  Subscribe_Listener_To_Follower :: Subscribe listener to follower.     | FAIL |
13:50:52  ... click for list of related bugs or create a new one if needed (with the
13:50:52  "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower"
13:50:52  reference somewhere inside)
13:50:52  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status"
13:50:52  
13:50:52  No leader found.
13:50:52  ------------------------------------------------------------------------------
13:50:52  Make_Leader_Local :: Make the loeader local and verify.               | FAIL |
13:50:52  ... click for list of related bugs or create a new one if needed (with the
13:50:52  "controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local"
13:50:52  reference somewhere inside)
13:50:52  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status"
13:50:52  
13:50:52  No leader found.
13:50:52  ------------------------------------------------------------------------------
13:50:52  Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL |
13:50:52  ... click for list of related bugs or create a new one if needed (with the
13:50:52  "controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back"
13:50:52  reference somewhere inside)
13:50:52  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status"
13:50:52  
13:50:52  No leader found.
13:50:52  ------------------------------------------------------------------------------
13:50:52  Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL |
13:50:52  ... click for list of related bugs or create a new one if needed (with the
13:50:52  "controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back"
13:50:52  reference somewhere inside)
13:50:52  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status"
13:50:52  
13:50:52  No leader found.
13:50:52  ------------------------------------------------------------------------------
13:50:52  Write_Transactions_One_Node_Leader :: Write transactions.             | FAIL |
13:50:52  ... click for list of related bugs or create a new one if needed (with the
13:50:52  "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader"
13:50:52  reference somewhere inside)
13:50:52  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status"
13:50:52  
13:50:52  No leader found.
13:50:52  ------------------------------------------------------------------------------
13:50:52  Write_Transactions_One_Node_Follower :: Write transactions.           | FAIL |
13:50:52  ... click for list of related bugs or create a new one if needed (with the
13:50:52  "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower"
13:50:52  reference somewhere inside)
13:50:52  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status"
13:50:52  
13:50:52  No leader found.
13:50:52  ------------------------------------------------------------------------------
13:50:52  Write_Transactions_All_Nodes :: Write transactions.                   | PASS |
13:50:52  ------------------------------------------------------------------------------
13:50:52  controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL |
13:50:52  9 tests, 2 passed, 7 failed
13:50:52  ==============================================================================
13:50:52  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
13:50:52  ==============================================================================
13:50:52  Stop_All_Members :: Stop every odl node.                              | PASS |
13:50:52  ------------------------------------------------------------------------------
13:50:52  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
13:50:52  ------------------------------------------------------------------------------
13:50:52  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
13:55:53  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
13:55:53  ------------------------------------------------------------------------------
13:55:53  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
13:55:53  3 tests, 2 passed, 1 failed
13:55:53  ==============================================================================
13:55:53  controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi...
13:55:53  ==============================================================================
13:55:53  Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL |
13:57:54  ... click for list of related bugs or create a new one if needed (with the
13:57:54  "controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown"
13:57:54  reference somewhere inside)
13:57:54  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status"
13:57:54  
13:57:54  No leader found.
13:57:54  ------------------------------------------------------------------------------
13:57:54  Restart :: Restart odl                                                | FAIL |
14:02:55  ... click for list of related bugs or create a new one if needed (with the
14:02:55  "controller_clustering_tell_txt_clean_leader_shutdown_restart"
14:02:55  reference somewhere inside)
14:02:55  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status"
14:02:55  
14:02:55  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
14:02:55  ------------------------------------------------------------------------------
14:02:55  Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL |
14:04:55  ... click for list of related bugs or create a new one if needed (with the
14:04:55  "controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown"
14:04:55  reference somewhere inside)
14:04:55  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status"
14:04:55  
14:04:55  No leader found.
14:04:55  ------------------------------------------------------------------------------
14:04:55  controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL |
14:04:55  3 tests, 0 passed, 3 failed
14:04:55  ==============================================================================
14:04:55  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
14:04:55  ==============================================================================
14:04:55  Stop_All_Members :: Stop every odl node.                              | PASS |
14:04:55  ------------------------------------------------------------------------------
14:04:55  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
14:04:55  ------------------------------------------------------------------------------
14:04:55  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
14:09:57  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
14:09:57  ------------------------------------------------------------------------------
14:09:57  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
14:09:57  3 tests, 2 passed, 1 failed
14:09:57  ==============================================================================
14:09:57  controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te...
14:09:57  ==============================================================================
14:09:57  Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL |
14:09:57  ... click for list of related bugs or create a new one if needed (with the
14:09:57  "controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement"
14:09:57  reference somewhere inside)
14:09:57  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status"
14:09:57  
14:09:57  No leader found.
14:09:57  ------------------------------------------------------------------------------
14:09:57  Restart1 :: Restart odl                                               | FAIL |
14:14:59  ... click for list of related bugs or create a new one if needed (with the
14:14:59  "controller_clustering_tell_txt_explicit_leader_movement_restart1"
14:14:59  reference somewhere inside)
14:14:59  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status"
14:14:59  
14:14:59  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
14:14:59  ------------------------------------------------------------------------------
14:14:59  Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL |
14:14:59  ... click for list of related bugs or create a new one if needed (with the
14:14:59  "controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement"
14:14:59  reference somewhere inside)
14:14:59  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status"
14:14:59  
14:14:59  No leader found.
14:14:59  ------------------------------------------------------------------------------
14:14:59  Restart2 :: Restart odl                                               | FAIL |
14:20:00  ... click for list of related bugs or create a new one if needed (with the
14:20:00  "controller_clustering_tell_txt_explicit_leader_movement_restart2"
14:20:00  reference somewhere inside)
14:20:00  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status"
14:20:00  
14:20:00  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
14:20:00  ------------------------------------------------------------------------------
14:20:00  Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL |
14:20:00  ... click for list of related bugs or create a new one if needed (with the
14:20:00  "controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement"
14:20:00  reference somewhere inside)
14:20:00  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status"
14:20:00  
14:20:00  No leader found.
14:20:00  ------------------------------------------------------------------------------
14:20:00  controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL |
14:20:00  5 tests, 0 passed, 5 failed
14:20:00  ==============================================================================
14:20:00  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
14:20:00  ==============================================================================
14:20:00  Stop_All_Members :: Stop every odl node.                              | PASS |
14:20:00  ------------------------------------------------------------------------------
14:20:00  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
14:20:00  ------------------------------------------------------------------------------
14:20:00  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
14:25:02  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
14:25:02  ------------------------------------------------------------------------------
14:25:02  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
14:25:02  3 tests, 2 passed, 1 failed
14:25:02  ==============================================================================
14:25:02  controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L...
14:25:02  ==============================================================================
14:25:02  Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL |
14:25:02  ... click for list of related bugs or create a new one if needed (with the
14:25:02  "controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout"
14:25:02  reference somewhere inside)
14:25:02  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status"
14:25:02  
14:25:02  No leader found.
14:25:02  ------------------------------------------------------------------------------
14:25:02  Restart :: Restart odl                                                | FAIL |
14:30:03  ... click for list of related bugs or create a new one if needed (with the
14:30:03  "controller_clustering_tell_txt_leader_isolation_restart"
14:30:03  reference somewhere inside)
14:30:03  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status"
14:30:03  
14:30:03  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
14:30:03  ------------------------------------------------------------------------------
14:30:03  Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL |
14:30:03  ... click for list of related bugs or create a new one if needed (with the
14:30:03  "controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout"
14:30:03  reference somewhere inside)
14:30:03  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status"
14:30:03  
14:30:03  No leader found.
14:30:03  ------------------------------------------------------------------------------
14:30:03  controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL |
14:30:03  3 tests, 0 passed, 3 failed
14:30:03  ==============================================================================
14:30:03  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
14:30:03  ==============================================================================
14:30:03  Stop_All_Members :: Stop every odl node.                              | PASS |
14:30:03  ------------------------------------------------------------------------------
14:30:03  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
14:30:04  ------------------------------------------------------------------------------
14:30:04  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
14:35:05  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
14:35:05  ------------------------------------------------------------------------------
14:35:05  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
14:35:05  3 tests, 2 passed, 1 failed
14:35:05  ==============================================================================
14:35:05  controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C...
14:35:05  ==============================================================================
14:35:05  Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL |
14:36:16  ... click for list of related bugs or create a new one if needed (with the
14:36:16  "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx"
14:36:16  reference somewhere inside)
14:36:16  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status"
14:36:16  
14:36:16  No leader found.
14:36:16  
14:36:16  Also keyword teardown failed:
14:36:16  Several failures occurred:
14:36:16  
14:36:16  1) Variable '${client_node_dst}' not found.
14:36:16  
14:36:16  2) Variable '${client_node_dst}' not found.
14:36:16  
14:36:16  3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
14:36:16  
14:36:16  1) No leader found.
14:36:16  
14:36:16  2) Too many Leaders.
14:36:16  
14:36:16  3) IndexError: Given index 0 is out of the range 0--1.
14:36:16  
14:36:16  4) No leader found.
14:36:16  
14:36:16      [ Message content over the limit has been removed. ]
14:36:16  
14:36:16  10) No leader found.
14:36:16  
14:36:16  11) Too many Leaders.
14:36:16  
14:36:16  12) IndexError: Given index 0 is out of the range 0--1.
14:36:16  
14:36:16  13) No leader found.
14:36:16  
14:36:16  14) Too many Leaders.
14:36:16  
14:36:16  15) IndexError: Given index 0 is out of the range 0--1.
14:36:16  
14:36:16  16) No leader found.
14:36:16  
14:36:16  17) Too many Leaders.
14:36:16  
14:36:16  18) IndexError: Given index 0 is out of the range 0--1.
14:36:16  
14:36:16  4) KeyError: 'threads'
14:36:16  ------------------------------------------------------------------------------
14:36:16  Restart1 :: Restart odl                                               | FAIL |
14:41:18  ... click for list of related bugs or create a new one if needed (with the
14:41:18  "controller_clustering_tell_txt_client_isolation_restart1"
14:41:18  reference somewhere inside)
14:41:18  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status"
14:41:18  
14:41:18  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
14:41:18  ------------------------------------------------------------------------------
14:41:18  Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL |
14:42:28  ... click for list of related bugs or create a new one if needed (with the
14:42:28  "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx"
14:42:28  reference somewhere inside)
14:42:28  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status"
14:42:28  
14:42:28  No leader found.
14:42:28  
14:42:28  Also keyword teardown failed:
14:42:28  Several failures occurred:
14:42:28  
14:42:28  1) Variable '${client_node_dst}' not found.
14:42:28  
14:42:28  2) Variable '${client_node_dst}' not found.
14:42:28  
14:42:28  3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
14:42:28  
14:42:28  1) No leader found.
14:42:28  
14:42:28  2) Too many Leaders.
14:42:28  
14:42:28  3) IndexError: Given index 0 is out of the range 0--1.
14:42:28  
14:42:28  4) No leader found.
14:42:28  
14:42:28      [ Message content over the limit has been removed. ]
14:42:28  
14:42:28  10) No leader found.
14:42:28  
14:42:28  11) Too many Leaders.
14:42:28  
14:42:28  12) IndexError: Given index 0 is out of the range 0--1.
14:42:28  
14:42:28  13) No leader found.
14:42:28  
14:42:28  14) Too many Leaders.
14:42:28  
14:42:28  15) IndexError: Given index 0 is out of the range 0--1.
14:42:28  
14:42:28  16) No leader found.
14:42:28  
14:42:28  17) Too many Leaders.
14:42:28  
14:42:28  18) IndexError: Given index 0 is out of the range 0--1.
14:42:28  
14:42:28  4) KeyError: 'threads'
14:42:28  ------------------------------------------------------------------------------
14:42:28  Restart2 :: Restart odl                                               | FAIL |
14:47:30  ... click for list of related bugs or create a new one if needed (with the
14:47:30  "controller_clustering_tell_txt_client_isolation_restart2"
14:47:30  reference somewhere inside)
14:47:30  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart2&order=bug_status"
14:47:30  
14:47:30  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
14:47:30  ------------------------------------------------------------------------------
14:47:30  Producer_On_Shard_Non_Leader_Node_ChainedTx :: Client isolation wi... | FAIL |
14:48:41  ... click for list of related bugs or create a new one if needed (with the
14:48:41  "controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx"
14:48:41  reference somewhere inside)
14:48:41  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx&order=bug_status"
14:48:41  
14:48:41  No leader found.
14:48:41  
14:48:41  Also keyword teardown failed:
14:48:41  Several failures occurred:
14:48:41  
14:48:41  1) Variable '${client_node_dst}' not found.
14:48:41  
14:48:41  2) Variable '${client_node_dst}' not found.
14:48:41  
14:48:41  3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
14:48:41  
14:48:41  1) No leader found.
14:48:41  
14:48:41  2) Too many Leaders.
14:48:41  
14:48:41  3) IndexError: Given index 0 is out of the range 0--1.
14:48:41  
14:48:41  4) No leader found.
14:48:41  
14:48:41      [ Message content over the limit has been removed. ]
14:48:41  
14:48:41  10) No leader found.
14:48:41  
14:48:41  11) Too many Leaders.
14:48:41  
14:48:41  12) IndexError: Given index 0 is out of the range 0--1.
14:48:41  
14:48:41  13) No leader found.
14:48:41  
14:48:41  14) Too many Leaders.
14:48:41  
14:48:41  15) IndexError: Given index 0 is out of the range 0--1.
14:48:41  
14:48:41  16) No leader found.
14:48:41  
14:48:41  17) Too many Leaders.
14:48:41  
14:48:41  18) IndexError: Given index 0 is out of the range 0--1.
14:48:41  
14:48:41  4) KeyError: 'threads'
14:48:41  ------------------------------------------------------------------------------
14:48:41  Restart3 :: Restart odl                                               | FAIL |
14:53:42  ... click for list of related bugs or create a new one if needed (with the
14:53:42  "controller_clustering_tell_txt_client_isolation_restart3"
14:53:42  reference somewhere inside)
14:53:42  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart3&order=bug_status"
14:53:42  
14:53:42  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
14:53:42  ------------------------------------------------------------------------------
14:53:42  Producer_On_Shard_Non_Leader_Node_SimpleTx :: Client isolation wit... | FAIL |
14:54:53  ... click for list of related bugs or create a new one if needed (with the
14:54:53  "controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx"
14:54:53  reference somewhere inside)
14:54:53  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx&order=bug_status"
14:54:53  
14:54:53  No leader found.
14:54:53  
14:54:53  Also keyword teardown failed:
14:54:53  Several failures occurred:
14:54:53  
14:54:53  1) Variable '${client_node_dst}' not found.
14:54:53  
14:54:53  2) Variable '${client_node_dst}' not found.
14:54:53  
14:54:53  3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
14:54:53  
14:54:53  1) No leader found.
14:54:53  
14:54:53  2) Too many Leaders.
14:54:53  
14:54:53  3) IndexError: Given index 0 is out of the range 0--1.
14:54:53  
14:54:53  4) No leader found.
14:54:53  
14:54:53      [ Message content over the limit has been removed. ]
14:54:53  
14:54:53  10) No leader found.
14:54:53  
14:54:53  11) Too many Leaders.
14:54:53  
14:54:53  12) IndexError: Given index 0 is out of the range 0--1.
14:54:53  
14:54:53  13) No leader found.
14:54:53  
14:54:53  14) Too many Leaders.
14:54:53  
14:54:53  15) IndexError: Given index 0 is out of the range 0--1.
14:54:53  
14:54:53  16) No leader found.
14:54:53  
14:54:53  17) Too many Leaders.
14:54:53  
14:54:53  18) IndexError: Given index 0 is out of the range 0--1.
14:54:53  
14:54:53  4) KeyError: 'threads'
14:54:53  ------------------------------------------------------------------------------
14:54:53  controller-clustering-tell.txt.Client Isolation :: DOMDataBroker t... | FAIL |
14:54:53  7 tests, 0 passed, 7 failed
14:54:53  ==============================================================================
14:54:53  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
14:54:53  ==============================================================================
14:54:53  Stop_All_Members :: Stop every odl node.                              | PASS |
14:54:53  ------------------------------------------------------------------------------
14:54:53  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
14:54:53  ------------------------------------------------------------------------------
14:54:53  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
14:59:55  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
14:59:55  ------------------------------------------------------------------------------
14:59:55  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
14:59:55  3 tests, 2 passed, 1 failed
14:59:55  ==============================================================================
14:59:55  controller-clustering-tell.txt.Listener Stability :: DOMDataBroker testing:...
14:59:55  ==============================================================================
14:59:55  Move_Leader_From_Listener_Local_To_Remote :: Listener runs on lead... | FAIL |
14:59:55  ... click for list of related bugs or create a new one if needed (with the
14:59:55  "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote"
14:59:55  reference somewhere inside)
14:59:55  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote&order=bug_status"
14:59:55  
14:59:55  No leader found.
14:59:55  ------------------------------------------------------------------------------
14:59:55  Restart_1 :: Restart odl.                                             | FAIL |
15:04:56  ... click for list of related bugs or create a new one if needed (with the
15:04:56  "controller_clustering_tell_txt_listener_stability_restart_1"
15:04:56  reference somewhere inside)
15:04:56  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_1&order=bug_status"
15:04:56  
15:04:56  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
15:04:56  ------------------------------------------------------------------------------
15:04:56  Move_Leader_From_Listener_Remote_To_Other_Remote :: Listener runs ... | FAIL |
15:04:56  ... click for list of related bugs or create a new one if needed (with the
15:04:56  "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote"
15:04:56  reference somewhere inside)
15:04:56  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote&order=bug_status"
15:04:56  
15:04:56  No leader found.
15:04:56  ------------------------------------------------------------------------------
15:04:56  Restart_2 :: Restart odl.                                             | FAIL |
15:09:58  ... click for list of related bugs or create a new one if needed (with the
15:09:58  "controller_clustering_tell_txt_listener_stability_restart_2"
15:09:58  reference somewhere inside)
15:09:58  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status"
15:09:58  
15:09:58  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
15:09:58  ------------------------------------------------------------------------------
15:09:58  Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL |
15:09:58  ... click for list of related bugs or create a new one if needed (with the
15:09:58  "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local"
15:09:58  reference somewhere inside)
15:09:58  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status"
15:09:58  
15:09:58  No leader found.
15:09:58  ------------------------------------------------------------------------------
15:09:58  controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL |
15:09:58  5 tests, 0 passed, 5 failed
15:09:58  ==============================================================================
15:09:58  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
15:09:58  ==============================================================================
15:09:58  Stop_All_Members :: Stop every odl node.                              | PASS |
15:09:58  ------------------------------------------------------------------------------
15:09:58  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
15:09:58  ------------------------------------------------------------------------------
15:09:58  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
15:15:00  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
15:15:00  ------------------------------------------------------------------------------
15:15:00  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
15:15:00  3 tests, 2 passed, 1 failed
15:15:00  ==============================================================================
15:15:00  controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin...
15:15:00  ==============================================================================
15:15:00  Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
15:15:00  ... click for list of related bugs or create a new one if needed (with the
15:15:00  "controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
15:15:00  reference somewhere inside)
15:15:00  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"
15:15:00  
15:15:00  Could not parse owner and candidates for device get-singleton-constant-service']
15:15:00  ------------------------------------------------------------------------------
15:15:00  Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
15:15:00  ... click for list of related bugs or create a new one if needed (with the
15:15:00  "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node"
15:15:00  reference somewhere inside)
15:15:00  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"
15:15:00  
15:15:00  Variable '@{cs_candidates}' not found. Did you mean:
15:15:00      @{cs_exp_candidates}
15:15:00  ------------------------------------------------------------------------------
15:15:00  Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
15:15:00  ... click for list of related bugs or create a new one if needed (with the
15:15:00  "controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered"
15:15:00  reference somewhere inside)
15:15:00  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"
15:15:00  
15:15:00  Variable '${cs_owner}' not found.
15:15:00  ------------------------------------------------------------------------------
15:15:00  Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
15:15:00  ... click for list of related bugs or create a new one if needed (with the
15:15:00  "controller_clustering_tell_txt_master_stability_reregister_singleton_constant"
15:15:00  reference somewhere inside)
15:15:00  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status"
15:15:00  
15:15:00  Variable '${unregistered_node}' not found.
15:15:00  ------------------------------------------------------------------------------
15:15:00  Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
15:15:00  ... click for list of related bugs or create a new one if needed (with the
15:15:00  "controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration"
15:15:00  reference somewhere inside)
15:15:00  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status"
15:15:00  
15:15:00  Variable '${cs_owner}' not found.
15:15:00  ------------------------------------------------------------------------------
15:15:00  Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | PASS |
15:15:00  ------------------------------------------------------------------------------
15:15:00  controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL |
15:15:00  6 tests, 1 passed, 5 failed
15:15:00  ==============================================================================
15:15:00  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
15:15:00  ==============================================================================
15:15:00  Stop_All_Members :: Stop every odl node.                              | PASS |
15:15:00  ------------------------------------------------------------------------------
15:15:00  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
15:15:00  ------------------------------------------------------------------------------
15:15:00  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
15:20:01  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
15:20:01  ------------------------------------------------------------------------------
15:20:01  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
15:20:01  3 tests, 2 passed, 1 failed
15:20:01  ==============================================================================
15:20:01  controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test...
15:20:01  ==============================================================================
15:20:01  Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | PASS |
15:20:01  ------------------------------------------------------------------------------
15:20:01  Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
15:20:01  ... click for list of related bugs or create a new one if needed (with the
15:20:01  "controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node"
15:20:01  reference somewhere inside)
15:20:01  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"
15:20:01  
15:20:01  Could not parse owner and candidates for device get-singleton-constant-service']
15:20:01  ------------------------------------------------------------------------------
15:20:01  Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
15:20:01  ... click for list of related bugs or create a new one if needed (with the
15:20:01  "controller_clustering_tell_txt_partition_and_heal_isolate_owner_node"
15:20:01  reference somewhere inside)
15:20:01  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status"
15:20:01  
15:20:01  Variable '${cs_owner}' not found.
15:20:01  ------------------------------------------------------------------------------
15:20:01  Monitor_Stability_While_Isolated :: Monitor the stability of the s... | PASS |
15:22:02  ------------------------------------------------------------------------------
15:22:02  Rejoin_Isolated_node :: Rejoin isolated node.                         | FAIL |
15:22:02  ... click for list of related bugs or create a new one if needed (with the
15:22:02  "controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node"
15:22:02  reference somewhere inside)
15:22:02  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"
15:22:02  
15:22:02  Variable '${cs_isolated_index}' not found.
15:22:02  ------------------------------------------------------------------------------
15:22:02  Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | PASS |
15:22:02  ------------------------------------------------------------------------------
15:22:02  controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL |
15:22:02  6 tests, 3 passed, 3 failed
15:22:02  ==============================================================================
15:22:02  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
15:22:02  ==============================================================================
15:22:02  Stop_All_Members :: Stop every odl node.                              | PASS |
15:22:02  ------------------------------------------------------------------------------
15:22:02  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
15:22:02  ------------------------------------------------------------------------------
15:22:02  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
15:27:04  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
15:27:04  ------------------------------------------------------------------------------
15:27:04  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
15:27:04  3 tests, 2 passed, 1 failed
15:27:04  ==============================================================================
15:27:04  controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test...
15:27:04  ==============================================================================
15:27:04  Register_Candidates :: Register a candidate application on each no... | PASS |
15:27:04  ------------------------------------------------------------------------------
15:27:04  Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
15:28:04  ------------------------------------------------------------------------------
15:28:04  Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
15:28:04  ... click for list of related bugs or create a new one if needed (with the
15:28:04  "controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
15:28:04  reference somewhere inside)
15:28:04  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"
15:28:04  
15:28:04  Acceptance rate 5 not reached, actual rate is 0.0.
15:28:04  ------------------------------------------------------------------------------
15:28:04  controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL |
15:28:04  3 tests, 2 passed, 1 failed
15:28:04  ==============================================================================
15:28:04  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
15:28:04  ==============================================================================
15:28:04  Stop_All_Members :: Stop every odl node.                              | PASS |
15:28:04  ------------------------------------------------------------------------------
15:28:04  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
15:28:04  ------------------------------------------------------------------------------
15:28:04  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
15:33:05  Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
15:33:05  3 tests, 2 passed, 1 failed
15:33:05  ==============================================================================
15:33:05  controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic...
15:33:05  ==============================================================================
15:33:05  Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT.       | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Added_Cars_On_Followers :: The same check on other members.       | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Added_People_On_Followers :: The same check on other members.     | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Added_CarPeople_On_Followers :: The same check on other members.  | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL |
15:33:05  Suite setup failed:
15:33:05  No leader found.
15:33:05  
15:33:05  13 tests, 0 passed, 13 failed
15:33:05  ==============================================================================
15:33:05  controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper...
15:33:05  ==============================================================================
15:33:05  Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL |
15:33:05  Suite setup failed:
15:33:05  No leader found.
15:33:05  
15:33:05  16 tests, 0 passed, 16 failed
15:33:05  ==============================================================================
15:33:05  controller-clustering-tell.txt.Car Persistence Recovery :: This test restar...
15:33:05  ==============================================================================
15:33:05  Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Stop_All_Members :: Stop all controllers.                             | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Start_All_Members :: Start all controllers (should restore the per... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Memorize_Leader_And_Followers :: Locate current Leader of car Shard.  | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  See_Cars_On_Followers :: The same check on other members.             | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Delete_Cars_On_Leader :: Delete cars on the new Leader.               | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL |
15:33:05  Suite setup failed:
15:33:05  No leader found.
15:33:05  
15:33:05  7 tests, 0 passed, 7 failed
15:33:05  ==============================================================================
15:33:05  controller-clustering-tell.txt.Buycar Failover :: This test focuses on test...
15:33:05  ==============================================================================
15:33:05  Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
15:33:05  Parent suite setup failed:
15:33:05  No leader found.
15:33:05  ------------------------------------------------------------------------------
15:33:05  controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL |
15:33:05  Suite setup failed:
15:33:05  No leader found.
15:33:05  
15:33:05  10 tests, 0 passed, 10 failed
15:33:05  ==============================================================================
15:33:06  controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe...
15:33:06  ==============================================================================
15:33:06  Check All Shards Before Isolate :: Check all shards in controller.    | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Check All Shards After Isolate :: Check all shards in controller.     | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Rejoin Entity Leader :: Rejoin the entity-ownership Leader.           | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Check All Shards After Rejoin :: Check all shards in controller.      | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL |
15:33:06  Suite setup failed:
15:33:06  No leader found.
15:33:06  
15:33:06  5 tests, 0 passed, 5 failed
15:33:06  ==============================================================================
15:33:06  controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus...
15:33:06  ==============================================================================
15:33:06  Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL |
15:33:06  Suite setup failed:
15:33:06  No leader found.
15:33:06  
15:33:06  10 tests, 0 passed, 10 failed
15:33:06  ==============================================================================
15:33:06  controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ...
15:33:06  ==============================================================================
15:33:06  Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL |
15:33:06  Suite setup failed:
15:33:06  No leader found.
15:33:06  
15:33:06  16 tests, 0 passed, 16 failed
15:33:06  ==============================================================================
15:33:06  controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test...
15:33:06  ==============================================================================
15:33:06  Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower.     | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Start_Other_Followers :: Start other followers without persisted d... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  Delete_Cars_On_Leader :: Delete cars on Leader.                       | FAIL |
15:33:06  Parent suite setup failed:
15:33:06  No leader found.
15:33:06  ------------------------------------------------------------------------------
15:33:06  controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL |
15:33:06  Suite setup failed:
15:33:06  No leader found.
15:33:06  
15:33:06  8 tests, 0 passed, 8 failed
15:33:06  ==============================================================================
15:33:06  controller-clustering-tell.txt                                        | FAIL |
15:33:06  162 tests, 28 passed, 134 failed
15:33:06  ==============================================================================
15:33:06  Output:  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/output.xml
15:33:07  Log:     /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/log.html
15:33:07  Report:  /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/report.html
15:33:08  + true
15:33:08  + echo 'Examining the files in data/log and checking filesize'
15:33:08  Examining the files in data/log and checking filesize
15:33:08  + ssh '' 'ls -altr /tmp/karaf-0.23.2-SNAPSHOT/data/log/'
15:33:08  ssh: Could not resolve hostname : Device or resource busy
15:33:08  Build step 'Execute shell' marked build as failure
15:33:08  $ ssh-agent -k
15:33:08  unset SSH_AUTH_SOCK;
15:33:08  unset SSH_AGENT_PID;
15:33:08  echo Agent pid 3148 killed;
15:33:08  [ssh-agent] Stopped.
15:33:08  Recording plot data
15:33:08  Robot results publisher started...
15:33:08  INFO: Checking test criticality is deprecated and will be dropped in a future release!
15:33:08  -Parsing output xml:
15:33:09  Done!
15:33:09  -Copying log files to build dir:
15:33:09  Done!
15:33:09  -Assigning results to build:
15:33:09  Done!
15:33:09  -Checking thresholds:
15:33:09  Done!
15:33:09  Done publishing Robot results.
15:33:09  [PostBuildScript] - [INFO] Executing post build scripts.
15:33:09  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins815478060781143999.sh
15:33:09  Archiving csit artifacts
15:33:09    % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
15:33:09                                   Dload  Upload   Total   Spent    Left  Speed
15:33:09  
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 1124k    0 1124k    0     0  1536k      0 --:--:-- --:--:-- --:--:-- 1538k
15:33:10  Archive:  robot-plugin.zip
15:33:10    inflating: ./archives/robot-plugin/log.html  
15:33:10    inflating: ./archives/robot-plugin/output.xml  
15:33:10    inflating: ./archives/robot-plugin/report.html  
15:33:10  mv: cannot stat '*.log': No such file or directory
15:33:10  mv: cannot stat '*.log.gz': No such file or directory
15:33:10  mv: cannot stat '*.csv': No such file or directory
15:33:10  mv: cannot stat '*.png': No such file or directory
15:33:10  [PostBuildScript] - [INFO] Executing post build scripts.
15:33:10  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins15156451082067945269.sh
15:33:10  [PostBuildScript] - [INFO] Executing post build scripts.
15:33:10  [EnvInject] - Injecting environment variables from a build step.
15:33:10  [EnvInject] - Injecting as environment variables the properties content 
15:33:10  OS_CLOUD=vex
15:33:10  OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-vanadium-59
15:33:10  
15:33:10  [EnvInject] - Variables injected successfully.
15:33:10  provisioning config files...
15:33:11  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
15:33:11  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins12635055755241179092.sh
15:33:11  ---> openstack-stack-delete.sh
15:33:11  Setup pyenv:
15:33:11    system
15:33:11    3.8.20
15:33:11    3.9.20
15:33:11    3.10.15
15:33:11  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
15:33:11  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vBj7 from file:/tmp/.os_lf_venv
15:33:11  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:33:14  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 
15:33:39  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
15:33:39  virtualenv 21.9.1 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.1 which is incompatible.
15:33:39  python-manilaclient 6.3.0 requires osc-lib>=3.2.0, but you have osc-lib 2.2.1 which is incompatible.
15:33:40  lf-activate-venv(): INFO: Adding /tmp/venv-vBj7/bin to PATH
15:33:40  INFO: Stack cost retrieval disabled, setting cost to 0
15:33:52  INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-vanadium-59
15:33:52  Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-vanadium-59
15:33:52  [PostBuildScript] - [INFO] Executing post build scripts.
15:33:52  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins4987340466971245405.sh
15:33:52  ---> sysstat.sh
15:33:52  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins5000829649488981256.sh
15:33:52  ---> package-listing.sh
15:33:52  + '[' -f /etc/os-release ']'
15:33:52  + . /etc/os-release
15:33:52  ++ PRETTY_NAME='Ubuntu 24.04.4 LTS'
15:33:52  ++ NAME=Ubuntu
15:33:52  ++ VERSION_ID=24.04
15:33:52  ++ VERSION='24.04.4 LTS (Noble Numbat)'
15:33:52  ++ VERSION_CODENAME=noble
15:33:52  ++ ID=ubuntu
15:33:52  ++ ID_LIKE=debian
15:33:52  ++ HOME_URL=https://www.ubuntu.com/
15:33:52  ++ SUPPORT_URL=https://help.ubuntu.com/
15:33:52  ++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/
15:33:52  ++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy
15:33:52  ++ UBUNTU_CODENAME=noble
15:33:52  ++ LOGO=ubuntu-logo
15:33:52  + case " ${ID:-} ${ID_LIKE:-} " in
15:33:52  + OS_FAMILY=debian
15:33:52  + workspace=/w/workspace/controller-csit-3node-clustering-tell-all-vanadium
15:33:52  + START_PACKAGES=/tmp/packages_start.txt
15:33:52  + END_PACKAGES=/tmp/packages_end.txt
15:33:52  + DIFF_PACKAGES=/tmp/packages_diff.txt
15:33:52  + PACKAGES=/tmp/packages_start.txt
15:33:52  + '[' /w/workspace/controller-csit-3node-clustering-tell-all-vanadium ']'
15:33:52  + PACKAGES=/tmp/packages_end.txt
15:33:52  + case "${OS_FAMILY}" in
15:33:52  + dpkg -l
15:33:52  + grep '^ii'
15:33:52  + '[' -f /tmp/packages_start.txt ']'
15:33:52  + '[' -f /tmp/packages_end.txt ']'
15:33:52  + diff /tmp/packages_start.txt /tmp/packages_end.txt
15:33:52  + '[' /w/workspace/controller-csit-3node-clustering-tell-all-vanadium ']'
15:33:52  + mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/archives/
15:33:52  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/archives/
15:33:52  + exit 0
15:33:52  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins13928431094303520483.sh
15:33:52  ---> capture-instance-metadata.sh
15:33:52  Setup pyenv:
15:33:52    system
15:33:52    3.8.20
15:33:52    3.9.20
15:33:52    3.10.15
15:33:52  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
15:33:52  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vBj7 from file:/tmp/.os_lf_venv
15:33:52  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:33:54  lf-activate-venv(): INFO: Installing additional packages: lftools 
15:34:03  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
15:34:03  virtualenv 21.9.1 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.1 which is incompatible.
15:34:03  lf-activate-venv(): INFO: Adding /tmp/venv-vBj7/bin to PATH
15:34:03  INFO: Running in OpenStack, capturing instance metadata
15:34:03  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins13032562459537460272.sh
15:34:03  provisioning config files...
15:34:04  Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-vanadium #59
15:34:04  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-vanadium@tmp/config4773777352118331411tmp
15:34:04  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
15:34:04  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
15:34:04  provisioning config files...
15:34:04  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
15:34:04  [EnvInject] - Injecting environment variables from a build step.
15:34:04  [EnvInject] - Injecting as environment variables the properties content 
15:34:04  SERVER_ID=logs
15:34:04  
15:34:04  [EnvInject] - Variables injected successfully.
15:34:04  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins2513271556057535818.sh
15:34:04  ---> create-netrc.sh
15:34:04  WARN: Log server credential not found.
15:34:04  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins10831892780548597904.sh
15:34:04  ---> python-tools-install.sh
15:34:04  Setup pyenv:
15:34:04    system
15:34:04    3.8.20
15:34:04    3.9.20
15:34:04    3.10.15
15:34:04  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
15:34:05  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vBj7 from file:/tmp/.os_lf_venv
15:34:05  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:34:07  lf-activate-venv(): INFO: Installing additional packages: lftools 
15:34:15  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
15:34:15  virtualenv 21.9.1 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.1 which is incompatible.
15:34:16  lf-activate-venv(): INFO: Adding /tmp/venv-vBj7/bin to PATH
15:34:16  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/sh /tmp/jenkins4298969956124351441.sh
15:34:16  ---> uv-install.sh
15:34:16  uv 0.12.17 is already installed
15:34:16  uvx 0.12.17 (x86_64-unknown-linux-gnu)
15:34:16  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins5973975433543109013.sh
15:34:16  ---> sudo-logs.sh
15:34:16  Archiving 'sudo' log..
15:34:16  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins10830358841255309647.sh
15:34:16  ---> job-cost.sh
15:34:16  INFO: Activating Python virtual environment...
15:34:16  Setup pyenv:
15:34:16    system
15:34:16    3.8.20
15:34:16    3.9.20
15:34:16    3.10.15
15:34:16  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
15:34:16  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vBj7 from file:/tmp/.os_lf_venv
15:34:16  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:34:18  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
15:34:27  lf-activate-venv(): INFO: Adding /tmp/venv-vBj7/bin to PATH
15:34:27  DEBUG: Contents of stack-cost file:
15:34:27  total: 0
15:34:27  INFO: Retrieving Stack Cost...
15:34:27  INFO: Stack cost: 0
15:34:27  INFO: Instance uptime: 6835s
15:34:27  INFO: Fetching instance metadata (attempt 1 of 3)...
15:34:27  DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
15:34:27  INFO: Successfully fetched instance metadata
15:34:27  INFO: Instance type: v3-standard-2
15:34:27  INFO: Retrieving pricing info for: v3-standard-2
15:34:27  INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
15:34:27  DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=6835
15:34:27  INFO: Successfully fetched Vexxhost pricing API
15:34:27  INFO: Retrieved cost: 0.11
15:34:27  INFO: Retrieved resource: v3-standard-2
15:34:27  INFO: Creating archive directory: /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/archives/cost
15:34:27  INFO: Archiving costs to: /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/archives/cost.csv
15:34:27  INFO: Successfully archived job cost data
15:34:27  DEBUG: Cost data: controller-csit-3node-clustering-tell-all-vanadium,59,2026-09-22 15:34:27,v3-standard-2,6835,0.11,0.00,FAILURE
15:34:27  [controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash -l /tmp/jenkins4879904651409076251.sh
15:34:27  ---> logs-deploy.sh
15:34:27  Setup pyenv:
15:34:27    system
15:34:27    3.8.20
15:34:27    3.9.20
15:34:27    3.10.15
15:34:27  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
15:34:27  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vBj7 from file:/tmp/.os_lf_venv
15:34:27  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
15:34:29  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
15:34:43  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
15:34:43  virtualenv 21.9.1 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.1 which is incompatible.
15:34:44  lf-activate-venv(): INFO: Adding /tmp/venv-vBj7/bin to PATH
15:34:44  WARNING: Nexus logging server not set
15:34:44  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-vanadium/59/
15:34:44  INFO: archiving logs to S3
15:34:45  ---> uname -a:
15:34:45  Linux prd-ubuntu2404-robot-2c-8g-53532 6.8.0-138-generic #138-Ubuntu SMP PREEMPT_DYNAMIC Fri Jul 31 22:41:49 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
15:34:45  
15:34:45  
15:34:45  ---> lscpu:
15:34:45  Architecture:                            x86_64
15:34:45  CPU op-mode(s):                          32-bit, 64-bit
15:34:45  Address sizes:                           40 bits physical, 48 bits virtual
15:34:45  Byte Order:                              Little Endian
15:34:45  CPU(s):                                  2
15:34:45  On-line CPU(s) list:                     0,1
15:34:45  Vendor ID:                               AuthenticAMD
15:34:45  Model name:                              AMD EPYC-Rome Processor
15:34:45  CPU family:                              23
15:34:45  Model:                                   49
15:34:45  Thread(s) per core:                      1
15:34:45  Core(s) per socket:                      1
15:34:45  Socket(s):                               2
15:34:45  Stepping:                                0
15:34:45  BogoMIPS:                                5600.00
15:34:45  Flags:                                   fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt lbrv nrip_save tsc_scale vmcb_clean flushbyasid pausefilter pfthreshold v_vmsave_vmload vgif umip rdpid arch_capabilities
15:34:45  Virtualization:                          AMD-V
15:34:45  Hypervisor vendor:                       KVM
15:34:45  Virtualization type:                     full
15:34:45  L1d cache:                               64 KiB (2 instances)
15:34:45  L1i cache:                               64 KiB (2 instances)
15:34:45  L2 cache:                                1 MiB (2 instances)
15:34:45  L3 cache:                                32 MiB (2 instances)
15:34:45  NUMA node(s):                            1
15:34:45  NUMA node0 CPU(s):                       0,1
15:34:45  Vulnerability Gather data sampling:      Not affected
15:34:45  Vulnerability Indirect target selection: Not affected
15:34:45  Vulnerability Itlb multihit:             Not affected
15:34:45  Vulnerability L1tf:                      Not affected
15:34:45  Vulnerability Mds:                       Not affected
15:34:45  Vulnerability Meltdown:                  Not affected
15:34:45  Vulnerability Mmio stale data:           Not affected
15:34:45  Vulnerability Reg file data sampling:    Not affected
15:34:45  Vulnerability Retbleed:                  Mitigation; untrained return thunk; SMT disabled
15:34:45  Vulnerability Spec rstack overflow:      Vulnerable: Safe RET, no microcode
15:34:45  Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
15:34:45  Vulnerability Spectre v1:                Mitigation; usercopy/swapgs barriers and __user pointer sanitization
15:34:45  Vulnerability Spectre v2:                Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
15:34:45  Vulnerability Srbds:                     Not affected
15:34:45  Vulnerability Tsa:                       Not affected
15:34:45  Vulnerability Tsx async abort:           Not affected
15:34:45  Vulnerability Vmscape:                   Not affected
15:34:45  
15:34:45  
15:34:45  ---> nproc:
15:34:45  2
15:34:45  
15:34:45  
15:34:45  ---> df -h:
15:34:45  Filesystem      Size  Used Avail Use% Mounted on
15:34:45  tmpfs           795M  1.1M  794M   1% /run
15:34:45  /dev/vda1        38G  8.2G   30G  22% /
15:34:45  tmpfs           3.9G     0  3.9G   0% /dev/shm
15:34:45  tmpfs           5.0M     0  5.0M   0% /run/lock
15:34:45  /dev/vda16      881M  117M  703M  15% /boot
15:34:45  /dev/vda15      105M  6.2M   99M   6% /boot/efi
15:34:45  tmpfs           795M   16K  795M   1% /run/user/1001
15:34:45  
15:34:45  
15:34:45  ---> free -m:
15:34:45                 total        used        free      shared  buff/cache   available
15:34:45  Mem:            7941         813        4907           4        2523        7127
15:34:45  Swap:           1023           0        1023
15:34:45  
15:34:45  
15:34:45  ---> ip addr:
15:34:45  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
15:34:45      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
15:34:45      inet 127.0.0.1/8 scope host lo
15:34:45         valid_lft forever preferred_lft forever
15:34:45      inet6 ::1/128 scope host noprefixroute 
15:34:45         valid_lft forever preferred_lft forever
15:34:45  2: ens3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
15:34:45      link/ether fa:16:3e:5b:d0:d3 brd ff:ff:ff:ff:ff:ff
15:34:45      altname enp0s3
15:34:45      inet 10.30.170.139/23 metric 100 brd 10.30.171.255 scope global dynamic ens3
15:34:45         valid_lft 79557sec preferred_lft 79557sec
15:34:45      inet6 fe80::f816:3eff:fe5b:d0d3/64 scope link 
15:34:45         valid_lft forever preferred_lft forever
15:34:45  
15:34:45  
15:34:45  ---> sar -b -r -n DEV:
15:34:45  Linux 6.8.0-138-generic (prd-ubuntu2404-robot-2c-8g-53532) 	09/22/26 	_x86_64_	(2 CPU)
15:34:45  
15:34:45  13:40:44     LINUX RESTART	(2 CPU)
15:34:45  
15:34:45  13:50:14          tps      rtps      wtps      dtps   bread/s   bwrtn/s   bdscd/s
15:34:45  14:00:14         1.44      0.01      1.41      0.03      0.05     21.93      2.55
15:34:45  14:10:14        16.12      0.33      1.59     14.20     43.23    108.44 106381.99
15:34:45  14:20:14         1.26      0.00      1.26      0.00      0.01     19.68      0.00
15:34:45  14:30:14         1.56      0.01      1.54      0.02      0.11     22.19      1.87
15:34:45  14:40:14         1.42      0.00      1.42      0.00      0.00     21.13      0.00
15:34:45  14:50:06         1.21      0.00      1.21      0.00      0.00     20.93      0.00
15:34:45  15:00:14         1.38      0.00      1.37      0.01      0.00     21.82      1.80
15:34:45  15:10:14         1.42      0.00      1.42      0.00      0.00     20.45      0.00
15:34:45  15:20:14         1.24      0.00      1.24      0.00      0.00     18.81      0.00
15:34:45  15:30:06         1.44      0.00      1.42      0.02      0.00     20.80      1.85
15:34:45  Average:         2.85      0.03      1.39      1.43      4.35     29.63  10651.91
15:34:45  
15:34:45  13:50:14    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
15:34:45  14:00:14      5179760   7373200    393760      4.84     88408   2265944    645948      7.04    613444   2038840       220
15:34:45  14:10:14      5095356   7329068    437348      5.38     88852   2305672    849144      9.25    632408   2068908       304
15:34:45  14:20:14      5095104   7330208    436180      5.36     88980   2306940    849436      9.25    633396   2070296       184
15:34:45  14:30:14      5097460   7334116    432240      5.31     89108   2308332    849436      9.25    633624   2071760       168
15:34:45  14:40:14      5096996   7335524    430788      5.30     89224   2310084    849500      9.25    633932   2073496       192
15:34:45  14:50:06      5096520   7337280    429016      5.28     89320   2312188    850524      9.26    634632   2075700       216
15:34:45  15:00:14      5095520   7338348    427792      5.26     89484   2314048    850524      9.26    634852   2077588       392
15:34:45  15:10:14      5095520   7339780    426400      5.24     89632   2315324    850588      9.26    635156   2079004       124
15:34:45  15:20:14      5095520   7341312    424856      5.22     89780   2316680    850724      9.27    635200   2080516       220
15:34:45  15:30:06      5098564   7345740    420384      5.17     89916   2317904    850724      9.27    635260   2081876       248
15:34:45  Average:      5104632   7340458    425876      5.24     89270   2307312    829655      9.04    632190   2071798       227
15:34:45  
15:34:45  13:50:14        IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
15:34:45  14:00:14           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
15:34:45  14:00:14         ens3      1.20      0.23      0.21      0.10      0.00      0.00      0.00      0.00
15:34:45  14:10:14           lo      1.03      1.03      0.05      0.05      0.00      0.00      0.00      0.00
15:34:45  14:10:14         ens3      2.28      0.49      3.66      0.18      0.00      0.00      0.00      0.00
15:34:45  14:20:14           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
15:34:45  14:20:14         ens3      2.68      0.27      0.49      0.19      0.00      0.00      0.00      0.00
15:34:45  14:30:14           lo      1.01      1.01      0.05      0.05      0.00      0.00      0.00      0.00
15:34:45  14:30:14         ens3      3.26      0.25      0.54      0.17      0.00      0.00      0.00      0.00
15:34:45  14:40:14           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
15:34:45  14:40:14         ens3      0.69      0.18      0.20      0.12      0.00      0.00      0.00      0.00
15:34:45  14:50:06           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
15:34:45  14:50:06         ens3      0.38      0.10      0.09      0.06      0.00      0.00      0.00      0.00
15:34:45  15:00:14           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
15:34:45  15:00:14         ens3      0.35      0.10      0.05      0.04      0.00      0.00      0.00      0.00
15:34:45  15:10:14           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
15:34:45  15:10:14         ens3      0.35      0.11      0.10      0.07      0.00      0.00      0.00      0.00
15:34:45  15:20:14           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
15:34:45  15:20:14         ens3      0.36      0.18      0.08      0.06      0.00      0.00      0.00      0.00
15:34:45  15:30:06           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
15:34:45  15:30:06         ens3      0.42      0.21      0.10      0.07      0.00      0.00      0.00      0.00
15:34:45  Average:           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
15:34:45  Average:         ens3      1.20      0.21      0.55      0.10      0.00      0.00      0.00      0.00
15:34:45  
15:34:45  
15:34:45  ---> sar -P ALL:
15:34:45  Linux 6.8.0-138-generic (prd-ubuntu2404-robot-2c-8g-53532) 	09/22/26 	_x86_64_	(2 CPU)
15:34:45  
15:34:45  13:40:44     LINUX RESTART	(2 CPU)
15:34:45  
15:34:45  13:50:14        CPU     %user     %nice   %system   %iowait    %steal     %idle
15:34:45  14:00:14        all      0.61      0.00      0.22      0.01      0.01     99.15
15:34:45  14:00:14          0      0.65      0.00      0.23      0.01      0.01     99.10
15:34:45  14:00:14          1      0.56      0.00      0.21      0.02      0.00     99.21
15:34:45  14:10:14        all      0.68      0.00      0.20      0.06      0.01     99.06
15:34:45  14:10:14          0      0.78      0.00      0.17      0.03      0.01     99.02
15:34:45  14:10:14          1      0.58      0.00      0.23      0.09      0.01     99.09
15:34:45  14:20:14        all      0.61      0.00      0.13      0.02      0.01     99.24
15:34:45  14:20:14          0      0.69      0.00      0.14      0.02      0.01     99.14
15:34:45  14:20:14          1      0.52      0.00      0.11      0.02      0.01     99.34
15:34:45  14:30:14        all      0.65      0.00      0.24      0.05      0.02     99.05
15:34:45  14:30:14          0      0.73      0.00      0.21      0.01      0.01     99.03
15:34:45  14:30:14          1      0.58      0.00      0.27      0.08      0.02     99.06
15:34:45  14:40:14        all      0.62      0.00      0.14      0.01      0.01     99.22
15:34:45  14:40:14          0      0.65      0.00      0.16      0.00      0.01     99.18
15:34:45  14:40:14          1      0.59      0.00      0.13      0.02      0.01     99.25
15:34:45  14:50:06        all      0.66      0.00      0.13      0.01      0.01     99.19
15:34:45  14:50:06          0      0.74      0.00      0.15      0.00      0.01     99.10
15:34:45  14:50:06          1      0.58      0.00      0.10      0.02      0.01     99.29
15:34:45  15:00:14        all      0.66      0.00      0.21      0.01      0.00     99.12
15:34:45  15:00:14          0      0.73      0.00      0.20      0.00      0.00     99.06
15:34:45  15:00:14          1      0.59      0.00      0.21      0.02      0.00     99.18
15:34:45  15:10:14        all      0.59      0.00      0.12      0.01      0.00     99.28
15:34:45  15:10:14          0      0.51      0.00      0.10      0.01      0.00     99.39
15:34:45  15:10:14          1      0.67      0.00      0.14      0.02      0.01     99.17
15:34:45  15:20:14        all      0.58      0.00      0.12      0.01      0.00     99.28
15:34:45  15:20:14          0      0.56      0.00      0.13      0.01      0.00     99.30
15:34:45  15:20:14          1      0.61      0.00      0.10      0.02      0.00     99.26
15:34:45  15:30:06        all      0.58      0.00      0.22      0.01      0.01     99.18
15:34:45  15:30:06          0      0.55      0.00      0.23      0.00      0.01     99.21
15:34:45  15:30:06          1      0.62      0.00      0.20      0.02      0.01     99.15
15:34:45  Average:        all      0.62      0.00      0.17      0.02      0.01     99.18
15:34:45  Average:          0      0.66      0.00      0.17      0.01      0.01     99.15
15:34:45  Average:          1      0.59      0.00      0.17      0.03      0.01     99.20
15:34:45  
15:34:45  
15:34:45