02:36:54  Started by upstream project "integration-distribution-test-chromium" build number 91
02:36:54  originally caused by:
02:36:54   Started by upstream project "autorelease-release-chromium-mvn39-openjdk21" build number 240
02:36:54   originally caused by:
02:36:54    Started by timer
02:36:54  Running as SYSTEM
02:36:54  [EnvInject] - Loading node environment variables.
02:36:54  Building remotely on prd-ubuntu2404-robot-2c-8g-9193 (ubuntu2404-robot-2c-8g) in workspace /w/workspace/openflowplugin-csit-3node-clustering-only-chromium
02:36:55  [ssh-agent] Looking for ssh-agent implementation...
02:36:55  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
02:36:55  $ ssh-agent
02:36:55  SSH_AUTH_SOCK=/tmp/ssh-8dZXdavz6tAG/agent.3137
02:36:55  SSH_AGENT_PID=3139
02:36:55  [ssh-agent] Started.
02:36:55  Running ssh-add (command line suppressed)
02:36:55  Identity added: /w/workspace/openflowplugin-csit-3node-clustering-only-chromium@tmp/private_key_179721889056662062.key (/w/workspace/openflowplugin-csit-3node-clustering-only-chromium@tmp/private_key_179721889056662062.key)
02:36:55  [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
02:36:55  The recommended git tool is: NONE
02:36:58  using credential opendaylight-jenkins-ssh
02:36:58  Wiping out workspace first.
02:36:58  Cloning the remote Git repository
02:36:58  Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
02:36:58   > git init /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test # timeout=10
02:36:58  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
02:36:58   > git --version # timeout=10
02:36:58   > git --version # 'git version 2.43.0'
02:36:58  using GIT_SSH to set credentials Release Engineering Jenkins Key
02:36:58  Verifying host key using known hosts file, will automatically accept unseen keys
02:36:58   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
02:37:00   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
02:37:00   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
02:37:01   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
02:37:01  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
02:37:01  using GIT_SSH to set credentials Release Engineering Jenkins Key
02:37:01  Verifying host key using known hosts file, will automatically accept unseen keys
02:37:01   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
02:37:01   > git rev-parse FETCH_HEAD^{commit} # timeout=10
02:37:01  Checking out Revision 901c7e139945b436d95a44b3b592904c3d7a4f9f (origin/master)
02:37:01   > git config core.sparsecheckout # timeout=10
02:37:01   > git checkout -f 901c7e139945b436d95a44b3b592904c3d7a4f9f # timeout=10
02:37:01  Commit message: "Adapt updater.py to use new lsp-flags container"
02:37:01   > git rev-parse FETCH_HEAD^{commit} # timeout=10
02:37:02   > git rev-list --no-walk f65244a2a093016c71f9a7a564be7d086941e15c # timeout=10
02:37:02  No emails were triggered.
02:37:02  provisioning config files...
02:37:02  copy managed file [npmrc] to file:/home/jenkins/.npmrc
02:37:02  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
02:37:03  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
02:37:03  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins414163318235972677.sh
02:37:03  ---> python-tools-install.sh
02:37:03  Setup pyenv:
02:37:03  * system (set by /opt/pyenv/version)
02:37:03  * 3.8.20 (set by /opt/pyenv/version)
02:37:03  * 3.9.20 (set by /opt/pyenv/version)
02:37:03    3.10.15
02:37:03    3.11.10
02:37:08  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-DeYZ
02:37:08  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
02:37:08  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:37:13  lf-activate-venv(): INFO: Installing additional packages: lftools 
02:37:41  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
02:37:41  virtualenv 21.7.12 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.0 which is incompatible.
02:37:41  lf-activate-venv(): INFO: Adding /tmp/venv-DeYZ/bin to PATH
02:37:41  Generating Requirements File
02:38:08  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
02:38:08  httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
02:38:09  Python 3.11.10
02:38:09  pip 26.2.1 from /tmp/venv-DeYZ/lib/python3.11/site-packages/pip (python 3.11)
02:38:09  aiohappyeyeballs==2.7.1
02:38:09  aiohttp==3.14.3
02:38:09  aiosignal==1.4.0
02:38:09  appdirs==1.4.4
02:38:09  argcomplete==3.7.2
02:38:09  aspy.yaml==1.3.0
02:38:09  attrs==26.1.0
02:38:09  autopage==0.6.0
02:38:09  beautifulsoup4==4.15.0
02:38:09  boto3==1.43.97
02:38:09  botocore==1.43.97
02:38:09  bs4==0.0.2
02:38:09  certifi==2026.7.22
02:38:09  cffi==2.1.1
02:38:09  cfgv==3.5.0
02:38:09  chardet==7.6.0
02:38:09  charset-normalizer==3.5.1
02:38:09  click==8.5.0
02:38:09  cliff==4.16.0
02:38:09  cmd2==4.2.4
02:38:09  cryptography==3.3.2
02:38:09  debtcollector==3.1.0
02:38:09  decorator==5.3.1
02:38:09  defusedxml==0.7.1
02:38:09  Deprecated==1.3.1
02:38:09  distlib==0.4.3
02:38:09  dnspython==2.8.0
02:38:09  docker==7.2.0
02:38:09  dogpile.cache==1.5.0
02:38:09  durationpy==0.11
02:38:09  email-validator==2.3.0
02:38:09  filelock==4.0.0
02:38:09  frozenlist==1.8.0
02:38:09  future==1.0.0
02:38:09  gitdb==4.0.12
02:38:09  GitPython==3.1.62
02:38:09  httplib2==0.30.2
02:38:09  identify==2.6.19
02:38:09  idna==3.20
02:38:09  importlib-resources==1.5.0
02:38:09  iso8601==2.1.0
02:38:09  Jinja2==3.1.6
02:38:09  jmespath==1.1.0
02:38:09  jsonpatch==1.33
02:38:09  jsonpointer==3.1.1
02:38:09  jsonschema==4.26.0
02:38:09  jsonschema-specifications==2025.9.1
02:38:09  keystoneauth1==5.17.0
02:38:09  kubernetes==36.0.3
02:38:09  lftools==0.37.23
02:38:09  lxml==6.1.3
02:38:09  markdown-it-py==4.2.0
02:38:09  MarkupSafe==3.0.3
02:38:09  mdurl==0.1.2
02:38:09  msgpack==1.2.2
02:38:09  multi_key_dict==2.0.3
02:38:09  multidict==6.8.0
02:38:09  munch==4.0.0
02:38:09  netaddr==1.3.0
02:38:09  niet==1.4.2
02:38:09  nodeenv==1.10.0
02:38:09  oauth2client==4.1.3
02:38:09  oauthlib==3.3.1
02:38:09  openstacksdk==4.20.0
02:38:09  os-service-types==1.9.0
02:38:09  osc-lib==4.7.0
02:38:09  oslo.config==10.7.0
02:38:09  oslo.context==6.5.0
02:38:09  oslo.i18n==6.9.0
02:38:09  oslo.log==8.3.2
02:38:09  oslo.serialization==5.11.0
02:38:09  oslo.utils==10.2.0
02:38:09  packaging==26.3
02:38:09  pbr==7.0.3
02:38:09  platformdirs==4.11.10
02:38:09  prettytable==3.18.0
02:38:09  prompt_toolkit==3.0.53
02:38:09  propcache==0.5.4
02:38:09  psutil==7.2.2
02:38:09  pyasn1==0.6.4
02:38:09  pyasn1_modules==0.4.2
02:38:09  pycparser==3.0
02:38:09  pygerrit2==2.0.15
02:38:09  PyGithub==2.10.0
02:38:09  Pygments==2.21.0
02:38:09  PyJWT==2.14.0
02:38:09  PyNaCl==1.6.2
02:38:09  pyparsing==2.4.7
02:38:09  pyperclip==1.11.0
02:38:09  pyrsistent==0.20.0
02:38:09  python-dateutil==2.9.0.post0
02:38:09  python-discovery==1.6.1
02:38:09  python-heatclient==5.3.0
02:38:09  python-jenkins==1.8.3
02:38:09  python-keystoneclient==6.0.0
02:38:09  python-magnumclient==5.0.0
02:38:09  python-manilaclient==6.3.0
02:38:09  python-openstackclient==10.3.0
02:38:09  python-swiftclient==4.11.0
02:38:09  PyYAML==6.0.3
02:38:09  referencing==0.37.0
02:38:09  requests==2.34.2
02:38:09  requests-oauthlib==2.0.0
02:38:09  rfc3986==2.0.0
02:38:09  rich==15.0.0
02:38:09  rich-argparse==1.8.0
02:38:09  rpds-py==2026.6.3
02:38:09  rsa==4.9.1
02:38:09  ruamel.yaml==0.19.1
02:38:09  ruamel.yaml.clib==0.2.15
02:38:09  s3transfer==0.19.2
02:38:09  simplejson==4.1.2
02:38:09  six==1.17.0
02:38:09  smmap==5.0.3
02:38:09  soupsieve==2.9.2
02:38:09  stevedore==5.9.1
02:38:09  tabulate==0.10.0
02:38:09  toml==0.10.2
02:38:09  tomlkit==0.15.1
02:38:09  tqdm==4.70.1
02:38:09  typing_extensions==4.16.0
02:38:09  urllib3==1.26.20
02:38:09  virtualenv==21.7.12
02:38:09  wcwidth==0.8.4
02:38:09  websocket-client==1.9.2
02:38:09  wrapt==2.4.1
02:38:09  xdg==6.0.0
02:38:09  xmltodict==1.0.4
02:38:09  yarl==1.25.1
02:38:09  yq==4.1.2
02:38:09  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/sh /tmp/jenkins1726532776834553782.sh
02:38:09  ---> uv-install.sh
02:38:09  Installing uv/uvx (latest) using shell installer
02:38:10  2026-09-18 02:38:10 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71308/71308] -> "/tmp/uv-install-HoME2c.sh" [1]
02:38:10  downloading uv 0.12.16 x86_64-unknown-linux-gnu
02:38:10  installing to /home/jenkins/.local/bin
02:38:10    uv
02:38:10    uvx
02:38:10  everything's installed!
02:38:10  
02:38:10  To add $HOME/.local/bin to your PATH, either restart your shell or run:
02:38:10  
02:38:10      source $HOME/.local/bin/env (sh, bash, zsh)
02:38:10      source $HOME/.local/bin/env.fish (fish)
02:38:10  Adding install location to PATH
02:38:10  ---> Validating uv/uvx install
02:38:10  uvx 0.12.16 (x86_64-unknown-linux-gnu)
02:38:10  [EnvInject] - Injecting environment variables from a build step.
02:38:10  [EnvInject] - Injecting as environment variables the properties content 
02:38:10  OS_STACK_TEMPLATE=csit-2-instance-type.yaml
02:38:10  OS_CLOUD=vex
02:38:10  OS_STACK_NAME=releng-openflowplugin-csit-3node-clustering-only-chromium-89
02:38:10  OS_STACK_TEMPLATE_DIR=openstack-hot
02:38:10  
02:38:10  [EnvInject] - Variables injected successfully.
02:38:10  provisioning config files...
02:38:11  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
02:38:11  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins1617587781516167734.sh
02:38:11  ---> Create parameters file for OpenStack HOT
02:38:11  OpenStack Heat parameters generated
02:38:11  -----------------------------------
02:38:11  parameters:
02:38:11      vm_0_count: '3'
02:38:11      vm_0_flavor: 'v3-standard-4'
02:38:11      vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260824-071601.077'
02:38:11      vm_1_count: '1'
02:38:11      vm_1_flavor: 'v3-standard-2'
02:38:11      vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20260811-083858.899'
02:38:11      
02:38:11      job_name: '14186-89'
02:38:11      silo: 'releng'
02:38:11  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash -l /tmp/jenkins4086642119890691172.sh
02:38:11  ---> Create HEAT stack
02:38:11  + source /home/jenkins/lf-env.sh
02:38:11  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
02:38:11  ++ mktemp -d /tmp/venv-XXXX
02:38:11  + lf_venv=/tmp/venv-SFa7
02:38:11  + local venv_file=/tmp/.os_lf_venv
02:38:11  + local python=python3
02:38:11  + local options
02:38:11  + local set_path=true
02:38:11  + local install_args=
02:38:11  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
02:38:11  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
02:38:11  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
02:38:11  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
02:38:11  + true
02:38:11  + case $1 in
02:38:11  + python=python3
02:38:11  + shift 2
02:38:11  + true
02:38:11  + case $1 in
02:38:11  + shift
02:38:11  + break
02:38:11  + case $python in
02:38:11  + local pkg_list=
02:38:11  + [[ -d /opt/pyenv ]]
02:38:11  + echo 'Setup pyenv:'
02:38:11  Setup pyenv:
02:38:11  + export PYENV_ROOT=/opt/pyenv
02:38:11  + PYENV_ROOT=/opt/pyenv
02:38:11  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
02:38:11  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
02:38:11  + pyenv versions
02:38:11    system
02:38:11    3.8.20
02:38:11    3.9.20
02:38:11    3.10.15
02:38:11  * 3.11.10 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/.python-version)
02:38:11  + command -v pyenv
02:38:11  ++ pyenv init - --no-rehash
02:38:11  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
02:38:11  for i in ${!paths[@]}; do 
02:38:11  if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
02:38:11  fi; done; 
02:38:11  echo "${paths[*]}"'\'')"
02:38:11  export PATH="/opt/pyenv/shims:${PATH}"
02:38:11  export PYENV_SHELL=bash
02:38:11  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
02:38:11  pyenv() {
02:38:11    local command
02:38:11    command="${1:-}"
02:38:11    if [ "$#" -gt 0 ]; then
02:38:11      shift
02:38:11    fi
02:38:11  
02:38:11    case "$command" in
02:38:11    rehash|shell)
02:38:11      eval "$(pyenv "sh-$command" "$@")"
02:38:11      ;;
02:38:11    *)
02:38:11      command pyenv "$command" "$@"
02:38:11      ;;
02:38:11    esac
02:38:11  }'
02:38:11  +++ bash --norc -ec 'IFS=:; paths=($PATH); 
02:38:11  for i in ${!paths[@]}; do 
02:38:11  if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
02:38:11  fi; done; 
02:38:11  echo "${paths[*]}"'
02:38:11  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
02:38:11  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
02:38:11  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
02:38:11  ++ export PYENV_SHELL=bash
02:38:11  ++ PYENV_SHELL=bash
02:38:11  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
02:38:11  +++ complete -F _pyenv pyenv
02:38:11  ++ lf-pyver python3
02:38:11  ++ local py_version_xy=python3
02:38:11  ++ local py_version_xyz=
02:38:11  ++ pyenv versions
02:38:11  ++ local command
02:38:11  ++ command=versions
02:38:11  ++ '[' 1 -gt 0 ']'
02:38:11  ++ shift
02:38:11  ++ case "$command" in
02:38:11  ++ command pyenv versions
02:38:11  ++ grep -E '^[0-9.]*[0-9]$'
02:38:11  ++ awk '{ print $1 }'
02:38:11  ++ sed 's/^[ *]* //'
02:38:11  ++ [[ ! -s /tmp/.pyenv_versions ]]
02:38:11  +++ grep '^3' /tmp/.pyenv_versions
02:38:11  +++ sort -V
02:38:11  +++ tail -n 1
02:38:11  ++ py_version_xyz=3.11.10
02:38:11  ++ [[ -z 3.11.10 ]]
02:38:11  ++ echo 3.11.10
02:38:11  ++ return 0
02:38:11  + pyenv local 3.11.10
02:38:11  + local command
02:38:11  + command=local
02:38:11  + '[' 2 -gt 0 ']'
02:38:11  + shift
02:38:11  + case "$command" in
02:38:11  + command pyenv local 3.11.10
02:38:11  + for arg in "$@"
02:38:11  + case $arg in
02:38:11  + pkg_list+='lftools[openstack] '
02:38:11  + for arg in "$@"
02:38:11  + case $arg in
02:38:11  + pkg_list+='kubernetes '
02:38:11  + for arg in "$@"
02:38:11  + case $arg in
02:38:11  + pkg_list+='niet '
02:38:11  + for arg in "$@"
02:38:11  + case $arg in
02:38:11  + pkg_list+='python-heatclient '
02:38:11  + for arg in "$@"
02:38:11  + case $arg in
02:38:11  + pkg_list+='python-openstackclient '
02:38:11  + for arg in "$@"
02:38:11  + case $arg in
02:38:11  + pkg_list+='python-magnumclient '
02:38:11  + for arg in "$@"
02:38:11  + case $arg in
02:38:11  + pkg_list+='urllib3~=1.26.15 '
02:38:11  + for arg in "$@"
02:38:11  + case $arg in
02:38:11  + pkg_list+='yq '
02:38:11  + [[ -f /tmp/.os_lf_venv ]]
02:38:11  ++ cat /tmp/.os_lf_venv
02:38:11  + lf_venv=/tmp/venv-DeYZ
02:38:11  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DeYZ from' file:/tmp/.os_lf_venv
02:38:11  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DeYZ from file:/tmp/.os_lf_venv
02:38:11  + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
02:38:11  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:38:11  + local 'pip_opts=--upgrade --quiet'
02:38:11  + pip_opts='--upgrade --quiet --trusted-host pypi.org'
02:38:11  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
02:38:11  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
02:38:11  + [[ -n '' ]]
02:38:11  + [[ -n '' ]]
02:38:11  + lf-venv-pip-install /tmp/venv-DeYZ/bin/python3 --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
02:38:11  + local venv_python=/tmp/venv-DeYZ/bin/python3
02:38:11  + shift
02:38:11  + local upstream=https://pypi.org/simple
02:38:11  + /tmp/venv-DeYZ/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
02:38:13  + return 0
02:38:13  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq  ]]
02:38:13  + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq '
02:38:13  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
02:38:13  + lf-venv-pip-install /tmp/venv-DeYZ/bin/python3 --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
02:38:13  + local venv_python=/tmp/venv-DeYZ/bin/python3
02:38:13  + shift
02:38:13  + local upstream=https://pypi.org/simple
02:38:13  + /tmp/venv-DeYZ/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
02:38:44  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
02:38:44  python-manilaclient 6.3.0 requires osc-lib>=3.2.0, but you have osc-lib 2.2.1 which is incompatible.
02:38:44  virtualenv 21.7.12 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.0 which is incompatible.
02:38:44  + return 0
02:38:44  + type python3
02:38:44  + true
02:38:44  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-DeYZ/bin to PATH'
02:38:44  lf-activate-venv(): INFO: Adding /tmp/venv-DeYZ/bin to PATH
02:38:44  + PATH=/tmp/venv-DeYZ/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
02:38:44  + return 0
02:38:44  + openstack --os-cloud vex limits show --absolute
02:38:46  +--------------------------+---------+
02:38:46  | Name                     |   Value |
02:38:46  +--------------------------+---------+
02:38:46  | maxTotalInstances        |      -1 |
02:38:46  | maxTotalCores            |     450 |
02:38:46  | maxTotalRAMSize          | 1000000 |
02:38:46  | maxServerMeta            |     128 |
02:38:46  | maxImageMeta             |     128 |
02:38:46  | maxPersonality           |       5 |
02:38:46  | maxPersonalitySize       |   10240 |
02:38:46  | maxTotalKeypairs         |     100 |
02:38:46  | maxServerGroups          |      10 |
02:38:46  | maxServerGroupMembers    |      10 |
02:38:46  | maxTotalFloatingIps      |      -1 |
02:38:46  | maxSecurityGroups        |      -1 |
02:38:46  | maxSecurityGroupRules    |      -1 |
02:38:46  | totalRAMUsed             |  418816 |
02:38:46  | totalCoresUsed           |     103 |
02:38:46  | totalInstancesUsed       |      40 |
02:38:46  | totalFloatingIpsUsed     |       0 |
02:38:46  | totalSecurityGroupsUsed  |       0 |
02:38:46  | totalServerGroupsUsed    |       0 |
02:38:46  | maxTotalVolumes          |      -1 |
02:38:46  | maxTotalSnapshots        |      10 |
02:38:46  | maxTotalVolumeGigabytes  |    4096 |
02:38:46  | maxTotalBackups          |      10 |
02:38:46  | maxTotalBackupGigabytes  |    1000 |
02:38:46  | totalVolumesUsed         |       4 |
02:38:46  | totalGigabytesUsed       |      80 |
02:38:46  | totalSnapshotsUsed       |       0 |
02:38:46  | totalBackupsUsed         |       0 |
02:38:46  | totalBackupGigabytesUsed |       0 |
02:38:46  +--------------------------+---------+
02:38:46  + pushd /opt/ciman/openstack-hot
02:38:46  /opt/ciman/openstack-hot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium
02:38:46  + lftools openstack --os-cloud vex stack create releng-openflowplugin-csit-3node-clustering-only-chromium-89 csit-2-instance-type.yaml /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/stack-parameters.yaml
02:42:54  Creating stack releng-openflowplugin-csit-3node-clustering-only-chromium-89
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  WARN: Failed to initialize stack. Reason: Resource CREATE failed: ResourceInError: resources.vm_0_group.resources[0].resources.instance: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500"
02:42:54  Deleting stack 92059822-aff0-49f7-a635-f2b5e880158f
02:42:54  Successfully deleted stack 92059822-aff0-49f7-a635-f2b5e880158f
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  Waiting to initialize infrastructure...
02:42:54  WARN: Failed to initialize stack. Reason: Resource CREATE failed: ResourceInError: resources.vm_0_group.resources[0].resources.instance: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500"
02:42:54  Deleting stack b1e9a930-b816-4393-814b-1e51a0f1f42d
02:42:54  Successfully deleted stack b1e9a930-b816-4393-814b-1e51a0f1f42d
02:42:54  ------------------------------------
02:42:54  Stack Details
02:42:54  ------------------------------------
02:42:54  openstack.orchestration.v1.stack.Stack(id=b1e9a930-b816-4393-814b-1e51a0f1f42d, stack_name=releng-openflowplugin-csit-3node-clustering-only-chromium-89, links=[{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-openflowplugin-csit-3node-clustering-only-chromium-89/b1e9a930-b816-4393-814b-1e51a0f1f42d', 'rel': 'self'}], creation_time=2026-09-18T02:40:54Z, updated_time=None, deletion_time=None, notification_topics=[], parameters={'OS::stack_id': 'b1e9a930-b816-4393-814b-1e51a0f1f42d', 'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_name': 'releng-openflowplugin-csit-3node-clustering-only-chromium-89', 'job_name': '14186-89', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260824-071601.077', 'vm_1_count': '1', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20260811-083858.899'}, description=No description, template_description=No description, capabilities=[], disable_rollback=True, timeout_mins=15, stack_owner=****, parent=None, stack_user_project_id=3c6675536cc04b11936919aadcfc4d41, tags=[], stack_status=CREATE_FAILED, stack_status_reason=Resource CREATE failed: ResourceInError: resources.vm_0_group.resources[0].resources.instance: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500", outputs=[{'output_key': 'vm_0_ips', 'description': 'IP addresses of the 1st vm types', 'output_value': [None, '10.30.170.250', '10.30.171.70']}, {'output_key': 'vm_1_ips', 'description': 'IP addresses of the 2nd vm types', 'output_value': ['10.30.171.251']}], location=Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}))
02:42:54  ------------------------------------
02:42:54  + popd
02:42:54  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium
02:42:54  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash -l /tmp/jenkins12549326565400293125.sh
02:42:54  ---> Copy SSH public keys to CSIT lab
02:42:54  Setup pyenv:
02:42:54    system
02:42:54    3.8.20
02:42:54    3.9.20
02:42:54    3.10.15
02:42:54  * 3.11.10 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/.python-version)
02:42:54  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DeYZ from file:/tmp/.os_lf_venv
02:42:54  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:42:56  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 
02:43:18  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
02:43:18  virtualenv 21.7.12 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.0 which is incompatible.
02:43:19  lf-activate-venv(): INFO: Adding /tmp/venv-DeYZ/bin to PATH
02:43:21  Stack not found: releng-openflowplugin-csit-3node-clustering-only-chromium-89
02:43:21  SSH ready on all stack servers.
02:43:21  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash -l /tmp/jenkins4258675839894324142.sh
02:43:21  Setup pyenv:
02:43:21    system
02:43:21    3.8.20
02:43:21    3.9.20
02:43:21    3.10.15
02:43:21  * 3.11.10 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/.python-version)
02:43:26  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-jcU2
02:43:26  lf-activate-venv(): INFO: Save venv in file: /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/.robot_venv
02:43:26  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:43:30  lf-activate-venv(): INFO: Installing additional packages: setuptools wheel 
02:43:32  lf-activate-venv(): INFO: Adding /tmp/venv-jcU2/bin to PATH
02:43:32  + echo 'Installing Python Requirements'
02:43:32  Installing Python Requirements
02:43:32  + cat
02:43:32  + python -m pip install -r requirements.txt
02:43:32  Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
02:43:32  Collecting docker-py (from -r requirements.txt (line 1))
02:43:32    Downloading docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
02:43:32  Collecting ipaddr (from -r requirements.txt (line 2))
02:43:32    Downloading ipaddr-2.2.0.tar.gz (26 kB)
02:43:32    Installing build dependencies: started
02:43:33    Installing build dependencies: finished with status 'done'
02:43:33    Getting requirements to build wheel: started
02:43:34    Getting requirements to build wheel: finished with status 'done'
02:43:34    Preparing metadata (pyproject.toml): started
02:43:34    Preparing metadata (pyproject.toml): finished with status 'done'
02:43:34  Collecting netaddr (from -r requirements.txt (line 3))
02:43:34    Using cached netaddr-1.3.0-py3-none-any.whl (2.3 MB)
02:43:34  Collecting netifaces (from -r requirements.txt (line 4))
02:43:34    Downloading netifaces-0.11.0.tar.gz (30 kB)
02:43:34    Installing build dependencies: started
02:43:35    Installing build dependencies: finished with status 'done'
02:43:35    Getting requirements to build wheel: started
02:43:36    Getting requirements to build wheel: finished with status 'done'
02:43:36    Preparing metadata (pyproject.toml): started
02:43:36    Preparing metadata (pyproject.toml): finished with status 'done'
02:43:36  Collecting pyhocon (from -r requirements.txt (line 5))
02:43:36    Downloading pyhocon-0.3.63.tar.gz (307 kB)
02:43:36    Installing build dependencies: started
02:43:37    Installing build dependencies: finished with status 'done'
02:43:37    Getting requirements to build wheel: started
02:43:38    Getting requirements to build wheel: finished with status 'done'
02:43:38    Preparing metadata (pyproject.toml): started
02:43:38    Preparing metadata (pyproject.toml): finished with status 'done'
02:43:38  Collecting requests (from -r requirements.txt (line 6))
02:43:38    Using cached requests-2.34.2-py3-none-any.whl (73 kB)
02:43:38  Collecting robotframework (from -r requirements.txt (line 7))
02:43:38    Downloading robotframework-7.5-py3-none-any.whl (842 kB)
02:43:38       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 842.5/842.5 kB 22.4 MB/s  0:00:00
02:43:38  Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
02:43:38    Downloading robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
02:43:38    Installing build dependencies: started
02:43:39    Installing build dependencies: finished with status 'done'
02:43:39    Getting requirements to build wheel: started
02:43:40    Getting requirements to build wheel: finished with status 'done'
02:43:40    Preparing metadata (pyproject.toml): started
02:43:40    Preparing metadata (pyproject.toml): finished with status 'done'
02:43:40  Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
02:43:40    Downloading robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
02:43:40  Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
02:43:40    Downloading robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
02:43:41  Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
02:43:41    Downloading robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
02:43:41    Installing build dependencies: started
02:43:41    Installing build dependencies: finished with status 'done'
02:43:41    Getting requirements to build wheel: started
02:43:42    Getting requirements to build wheel: finished with status 'done'
02:43:42    Preparing metadata (pyproject.toml): started
02:43:42    Preparing metadata (pyproject.toml): finished with status 'done'
02:43:42  Collecting scapy (from -r requirements.txt (line 12))
02:43:42    Downloading scapy-2.7.0-py3-none-any.whl (2.6 MB)
02:43:42       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 29.3 MB/s  0:00:00
02:43:43  Collecting jsonpath-rw (from -r requirements.txt (line 15))
02:43:43    Downloading jsonpath-rw-1.4.0.tar.gz (13 kB)
02:43:43    Installing build dependencies: started
02:43:43    Installing build dependencies: finished with status 'done'
02:43:43    Getting requirements to build wheel: started
02:43:44    Getting requirements to build wheel: finished with status 'done'
02:43:44    Preparing metadata (pyproject.toml): started
02:43:44    Preparing metadata (pyproject.toml): finished with status 'done'
02:43:44  Collecting elasticsearch (from -r requirements.txt (line 18))
02:43:44    Downloading elasticsearch-9.5.1-py3-none-any.whl (1.0 MB)
02:43:44       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.0/1.0 MB 25.5 MB/s  0:00:00
02:43:44  Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
02:43:44    Downloading elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB)
02:43:45  Collecting pyangbind (from -r requirements.txt (line 22))
02:43:45    Downloading pyangbind-0.8.7-py3-none-any.whl (52 kB)
02:43:45  Collecting isodate (from -r requirements.txt (line 25))
02:43:45    Downloading isodate-0.7.2-py3-none-any.whl (22 kB)
02:43:45  Collecting jmespath (from -r requirements.txt (line 28))
02:43:45    Using cached jmespath-1.1.0-py3-none-any.whl (20 kB)
02:43:45  Collecting jsonpatch (from -r requirements.txt (line 31))
02:43:45    Using cached jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
02:43:45  Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
02:43:45    Downloading paramiko-5.0.0-py3-none-any.whl (208 kB)
02:43:45  Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
02:43:45    Downloading scp-0.16.1-py2.py3-none-any.whl (8.9 kB)
02:43:46  Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
02:43:46    Downloading docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
02:43:46  Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
02:43:46    Using cached six-1.17.0-py2.py3-none-any.whl (11 kB)
02:43:46  Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
02:43:46    Using cached websocket_client-1.9.2-py3-none-any.whl (95 kB)
02:43:46  Collecting pyparsing>=3.0.0 (from pyhocon->-r requirements.txt (line 5))
02:43:46    Using cached pyparsing-3.3.2-py3-none-any.whl (122 kB)
02:43:46  Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
02:43:46    Using cached charset_normalizer-3.5.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (262 kB)
02:43:46  Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
02:43:46    Using cached idna-3.20-py3-none-any.whl (69 kB)
02:43:46  Collecting urllib3<3,>=1.26 (from requests->-r requirements.txt (line 6))
02:43:46    Using cached urllib3-2.8.0-py3-none-any.whl (135 kB)
02:43:46  Collecting certifi>=2023.5.7 (from requests->-r requirements.txt (line 6))
02:43:46    Using cached certifi-2026.7.22-py3-none-any.whl (136 kB)
02:43:46  Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
02:43:46    Downloading webtest-3.0.7-py3-none-any.whl (32 kB)
02:43:47  Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
02:43:47    Using cached jsonpointer-3.1.1-py3-none-any.whl (7.7 kB)
02:43:47  Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
02:43:47    Downloading robotframework_seleniumlibrary-6.9.0-py3-none-any.whl (105 kB)
02:43:47  Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
02:43:47    Downloading ply-3.11-py2.py3-none-any.whl (49 kB)
02:43:47  Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
02:43:47    Using cached decorator-5.3.1-py3-none-any.whl (10 kB)
02:43:47  Collecting anyio (from elasticsearch->-r requirements.txt (line 18))
02:43:47    Downloading anyio-4.15.1-py3-none-any.whl (132 kB)
02:43:48  Collecting elastic-transport<10,>=9.4.1 (from elasticsearch->-r requirements.txt (line 18))
02:43:48    Downloading elastic_transport-9.4.2-py3-none-any.whl (66 kB)
02:43:48  Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18))
02:43:48    Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
02:43:48  Collecting sniffio (from elasticsearch->-r requirements.txt (line 18))
02:43:48    Downloading sniffio-1.3.1-py3-none-any.whl (10 kB)
02:43:48  Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18))
02:43:48    Using cached typing_extensions-4.16.0-py3-none-any.whl (45 kB)
02:43:48  Collecting elasticsearch (from -r requirements.txt (line 18))
02:43:48    Downloading elasticsearch-8.19.3-py3-none-any.whl (952 kB)
02:43:48       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 952.8/952.8 kB 14.7 MB/s  0:00:00
02:43:48  INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while.
02:43:48  Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
02:43:48    Downloading elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB)
02:43:48    Downloading elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB)
02:43:48    Downloading elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB)
02:43:48    Downloading elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB)
02:43:48  Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
02:43:48    Downloading elastic_transport-8.19.0-py3-none-any.whl (65 kB)
02:43:48  Collecting pyang (from pyangbind->-r requirements.txt (line 22))
02:43:48    Downloading pyang-2.7.1-py2.py3-none-any.whl (598 kB)
02:43:48       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 11.5 MB/s  0:00:00
02:43:49  Collecting lxml (from pyangbind->-r requirements.txt (line 22))
02:43:49    Using cached lxml-6.1.3-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB)
02:43:51  Collecting regex (from pyangbind->-r requirements.txt (line 22))
02:43:51    Downloading regex-2026.9.10-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (802 kB)
02:43:51       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 803.0/803.0 kB 15.4 MB/s  0:00:00
02:43:51  Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
02:43:51    Downloading enum34-1.1.10-py3-none-any.whl (11 kB)
02:43:51  Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
02:43:51    Downloading bcrypt-5.0.0-cp39-abi3-manylinux_2_34_x86_64.whl (278 kB)
02:43:52  Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
02:43:52    Using cached cryptography-50.0.1-cp311-abi3-manylinux_2_34_x86_64.whl (4.7 MB)
02:43:52  Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
02:43:52    Downloading invoke-3.0.3-py3-none-any.whl (160 kB)
02:43:52  Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
02:43:52    Using cached pynacl-1.6.2-cp38-abi3-manylinux_2_34_x86_64.whl (1.4 MB)
02:43:52  Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
02:43:52    Using cached cffi-2.1.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (217 kB)
02:43:52  Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
02:43:52    Using cached pycparser-3.0-py3-none-any.whl (48 kB)
02:43:53  Collecting selenium>=4.25.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
02:43:53    Downloading selenium-4.49.0-py3-none-any.whl (11.8 MB)
02:43:53       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.8/11.8 MB 46.0 MB/s  0:00:00
02:43:53  Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
02:43:53    Downloading robotframework_pythonlibcore-4.6.0-py3-none-any.whl (20 kB)
02:43:53  Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
02:43:53    Using cached click-8.5.0-py3-none-any.whl (125 kB)
02:43:54  Collecting trio<1.0,>=0.31.0 (from selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
02:43:54    Downloading trio-0.34.0-py3-none-any.whl (511 kB)
02:43:54  Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
02:43:54    Downloading trio_websocket-0.12.2-py3-none-any.whl (21 kB)
02:43:54  Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
02:43:54    Using cached attrs-26.1.0-py3-none-any.whl (67 kB)
02:43:54  Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
02:43:54    Downloading sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
02:43:54  Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
02:43:54    Downloading outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
02:43:54  Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
02:43:54    Downloading wsproto-1.3.2-py3-none-any.whl (24 kB)
02:43:55  Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.6.3->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
02:43:55    Downloading PySocks-1.7.1-py3-none-any.whl (16 kB)
02:43:55  Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
02:43:55    Downloading webob-1.8.11-py2.py3-none-any.whl (118 kB)
02:43:55  Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
02:43:55    Downloading waitress-3.0.2-py3-none-any.whl (56 kB)
02:43:55  Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
02:43:55    Using cached beautifulsoup4-4.15.0-py3-none-any.whl (109 kB)
02:43:55  Collecting h11<1,>=0.16.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
02:43:55    Downloading h11-0.16.0-py3-none-any.whl (37 kB)
02:43:56  Collecting soupsieve>=1.6.1 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
02:43:56    Using cached soupsieve-2.9.2-py3-none-any.whl (37 kB)
02:43:56  Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, pyhocon, robotframework-httplibrary, jsonpath-rw
02:43:56    Building wheel for robotframework-sshlibrary (pyproject.toml): started
02:43:56    Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done'
02:43:56    Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55206 sha256=585aea8586007d679c1c1e542204ed85fe6e7b90bfb616ec12850a52d526cd7b
02:43:56    Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
02:43:56    Building wheel for ipaddr (pyproject.toml): started
02:43:56    Building wheel for ipaddr (pyproject.toml): finished with status 'done'
02:43:56    Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18353 sha256=4e42cc47f5caa5ce9eb1ecf4de6cb2d3d861f54895a7c2f02ef021649c4e9aed
02:43:56    Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
02:43:56    Building wheel for netifaces (pyproject.toml): started
02:43:59    Building wheel for netifaces (pyproject.toml): finished with status 'done'
02:43:59    Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=34975 sha256=332a4d60b6dbede27b2ab593543bd2c4a6f74b9e75f8c93dc9f7aea4c68c2173
02:43:59    Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
02:43:59    Building wheel for pyhocon (pyproject.toml): started
02:44:00    Building wheel for pyhocon (pyproject.toml): finished with status 'done'
02:44:00    Created wheel for pyhocon: filename=pyhocon-0.3.63-py3-none-any.whl size=24721 sha256=630bebb4d46f1ec7e700815fa4ca10c35d6f1939d7bf96dd8c38903f11acb68e
02:44:00    Stored in directory: /home/jenkins/.cache/pip/wheels/ce/9e/92/cb17e17d79fafd46a767074b3ed1dca8f78036163f9bea914d
02:44:00    Building wheel for robotframework-httplibrary (pyproject.toml): started
02:44:00    Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done'
02:44:00    Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10015 sha256=e055fe1d06009cc938333101a14fe95b47611baf755d9ad65a399e8fbd5148c3
02:44:00    Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
02:44:00    Building wheel for jsonpath-rw (pyproject.toml): started
02:44:00    Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done'
02:44:00    Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15175 sha256=27646f71e9446f7a87518a1181dd6b91cdf0f9b54d66d3bca1582d99e9ac9cbb
02:44:00    Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
02:44:00  Successfully built robotframework-sshlibrary ipaddr netifaces pyhocon robotframework-httplibrary jsonpath-rw
02:44:00  Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
02:44:08  
02:44:08  Successfully installed WebOb-1.8.11 attrs-26.1.0 bcrypt-5.0.0 beautifulsoup4-4.15.0 certifi-2026.7.22 cffi-2.1.1 charset_normalizer-3.5.1 click-8.5.0 cryptography-50.0.1 decorator-5.3.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.19.0 elasticsearch-8.19.3 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.20 invoke-3.0.3 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.1.0 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.1.1 lxml-6.1.3 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-5.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.7 pycparser-3.0 pyhocon-0.3.63 pynacl-1.6.2 pyparsing-3.3.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2026.9.10 requests-2.34.2 robotframework-7.5 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.6.0 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.9.0 robotframework-sshlibrary-3.8.0 scapy-2.7.0 scp-0.16.1 selenium-4.49.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.9.2 trio-0.34.0 trio-websocket-0.12.2 typing-extensions-4.16.0 urllib3-2.8.0 waitress-3.0.2 websocket-client-1.9.2 webtest-3.0.7 wsproto-1.3.2
02:44:08  + pip freeze
02:44:08  attrs==26.1.0
02:44:08  bcrypt==5.0.0
02:44:08  beautifulsoup4==4.15.0
02:44:08  certifi==2026.7.22
02:44:08  cffi==2.1.1
02:44:08  charset-normalizer==3.5.1
02:44:08  click==8.5.0
02:44:08  cryptography==50.0.1
02:44:08  decorator==5.3.1
02:44:08  distlib==0.4.3
02:44:08  docker-py==1.10.6
02:44:08  docker-pycreds==0.4.0
02:44:08  elastic-transport==8.19.0
02:44:08  elasticsearch==8.19.3
02:44:08  elasticsearch-dsl==8.15.4
02:44:08  enum34==1.1.10
02:44:08  filelock==3.32.7
02:44:08  h11==0.16.0
02:44:08  idna==3.20
02:44:08  invoke==3.0.3
02:44:08  ipaddr==2.2.0
02:44:08  isodate==0.7.2
02:44:08  jmespath==1.1.0
02:44:08  jsonpatch==1.33
02:44:08  jsonpath-rw==1.4.0
02:44:08  jsonpointer==3.1.1
02:44:08  lxml==6.1.3
02:44:08  netaddr==1.3.0
02:44:08  netifaces==0.11.0
02:44:08  outcome==1.3.0.post0
02:44:08  packaging==26.3
02:44:08  paramiko==5.0.0
02:44:08  platformdirs==4.11.10
02:44:08  ply==3.11
02:44:08  pyang==2.7.1
02:44:08  pyangbind==0.8.7
02:44:08  pycparser==3.0
02:44:08  pyhocon==0.3.63
02:44:08  PyNaCl==1.6.2
02:44:08  pyparsing==3.3.2
02:44:08  PySocks==1.7.1
02:44:08  python-dateutil==2.9.0.post0
02:44:08  python-discovery==1.6.1
02:44:08  regex==2026.9.10
02:44:08  requests==2.34.2
02:44:08  robotframework==7.5
02:44:08  robotframework-httplibrary==0.4.2
02:44:08  robotframework-pythonlibcore==4.6.0
02:44:08  robotframework-requests==0.9.7
02:44:08  robotframework-selenium2library==3.0.0
02:44:08  robotframework-seleniumlibrary==6.9.0
02:44:08  robotframework-sshlibrary==3.8.0
02:44:08  scapy==2.7.0
02:44:08  scp==0.16.1
02:44:08  selenium==4.49.0
02:44:08  six==1.17.0
02:44:08  sniffio==1.3.1
02:44:08  sortedcontainers==2.4.0
02:44:08  soupsieve==2.9.2
02:44:08  trio==0.34.0
02:44:08  trio-websocket==0.12.2
02:44:08  typing_extensions==4.16.0
02:44:08  urllib3==2.8.0
02:44:08  virtualenv==21.7.12
02:44:08  waitress==3.0.2
02:44:08  WebOb==1.8.11
02:44:08  websocket-client==1.9.2
02:44:08  WebTest==3.0.7
02:44:08  wsproto==1.3.2
02:44:08  [EnvInject] - Injecting environment variables from a build step.
02:44:08  [EnvInject] - Injecting as environment variables the properties file path 'env.properties'
02:44:08  [EnvInject] - Variables injected successfully.
02:44:08  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash -l /tmp/jenkins15408159520667905922.sh
02:44:08  Setup pyenv:
02:44:09    system
02:44:09    3.8.20
02:44:09    3.9.20
02:44:09    3.10.15
02:44:09  * 3.11.10 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/.python-version)
02:44:09  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DeYZ from file:/tmp/.os_lf_venv
02:44:09  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:44:11  lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq 
02:44:19  lf-activate-venv(): INFO: Adding /tmp/venv-DeYZ/bin to PATH
02:44:19  + ODL_SYSTEM=()
02:44:19  + TOOLS_SYSTEM=()
02:44:19  + OPENSTACK_SYSTEM=()
02:44:19  + OPENSTACK_CONTROLLERS=()
02:44:19  + mapfile -t ADDR
02:44:19  ++ openstack stack show -f json -c outputs releng-openflowplugin-csit-3node-clustering-only-chromium-89
02:44:19  ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
02:44:21  Stack not found: releng-openflowplugin-csit-3node-clustering-only-chromium-89
02:44:22  + for i in "${ADDR[@]}"
02:44:22  ++ ssh '' hostname -s
02:44:22  ssh: Could not resolve hostname : Device or resource busy
02:44:22  + REMHOST=
02:44:22  + case ${REMHOST} in
02:44:22  + TOOLS_SYSTEM=("${TOOLS_SYSTEM[@]}" "${i}")
02:44:22  + echo NUM_ODL_SYSTEM=0
02:44:22  + echo NUM_TOOLS_SYSTEM=1
02:44:22  + '[' '' == yes ']'
02:44:22  + NUM_OPENSTACK_SYSTEM=0
02:44:22  + echo NUM_OPENSTACK_SYSTEM=0
02:44:22  + '[' 0 -eq 2 ']'
02:44:22  + echo ODL_SYSTEM_IP=
02:44:22  ++ seq 0 -1
02:44:22  + echo TOOLS_SYSTEM_IP=
02:44:22  ++ seq 0 0
02:44:22  + for i in $(seq 0 $(( ${#TOOLS_SYSTEM[@]} - 1 )))
02:44:22  + echo TOOLS_SYSTEM_1_IP=
02:44:22  + openstack_index=0
02:44:22  + NUM_OPENSTACK_CONTROL_NODES=1
02:44:22  + echo NUM_OPENSTACK_CONTROL_NODES=1
02:44:22  ++ seq 0 0
02:44:22  + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
02:44:22  + echo OPENSTACK_CONTROL_NODE_1_IP=
02:44:22  + NUM_OPENSTACK_COMPUTE_NODES=-1
02:44:22  + echo NUM_OPENSTACK_COMPUTE_NODES=-1
02:44:22  + '[' -1 -ge 2 ']'
02:44:22  ++ seq 0 -2
02:44:22  + NUM_OPENSTACK_HAPROXY_NODES=0
02:44:22  + echo NUM_OPENSTACK_HAPROXY_NODES=0
02:44:22  ++ seq 0 -1
02:44:22  + echo 'Contents of slave_addresses.txt:'
02:44:22  Contents of slave_addresses.txt:
02:44:22  + cat slave_addresses.txt
02:44:22  NUM_ODL_SYSTEM=0
02:44:22  NUM_TOOLS_SYSTEM=1
02:44:22  NUM_OPENSTACK_SYSTEM=0
02:44:22  ODL_SYSTEM_IP=
02:44:22  TOOLS_SYSTEM_IP=
02:44:22  TOOLS_SYSTEM_1_IP=
02:44:22  NUM_OPENSTACK_CONTROL_NODES=1
02:44:22  OPENSTACK_CONTROL_NODE_1_IP=
02:44:22  NUM_OPENSTACK_COMPUTE_NODES=-1
02:44:22  NUM_OPENSTACK_HAPROXY_NODES=0
02:44:22  [EnvInject] - Injecting environment variables from a build step.
02:44:22  [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
02:44:22  [EnvInject] - Variables injected successfully.
02:44:22  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/sh /tmp/jenkins6363419175467397935.sh
02:44:22  Preparing for JRE Version 21
02:44:22  Karaf artifact is karaf
02:44:22  Karaf project is integration
02:44:22  Java home is /usr/lib/jvm/java-21-openjdk-amd64
02:44:22  [EnvInject] - Injecting environment variables from a build step.
02:44:22  [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
02:44:22  [EnvInject] - Variables injected successfully.
02:44:22  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins15107325278467026621.sh
02:44:22  Distribution bundle URL is https://nexus.opendaylight.org/content/repositories//autorelease-10193/org/opendaylight/integration/karaf/0.24.1/karaf-0.24.1.zip
02:44:22  Distribution bundle is karaf-0.24.1.zip
02:44:22  Distribution bundle version is 0.24.1
02:44:22  Distribution folder is karaf-0.24.1
02:44:22  Nexus prefix is https://nexus.opendaylight.org
02:44:22  [EnvInject] - Injecting environment variables from a build step.
02:44:22  [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
02:44:22  [EnvInject] - Variables injected successfully.
02:44:22  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash -l /tmp/jenkins10677590452457942799.sh
02:44:22  Setup pyenv:
02:44:22    system
02:44:22    3.8.20
02:44:22    3.9.20
02:44:22    3.10.15
02:44:22  * 3.11.10 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/.python-version)
02:44:22  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DeYZ from file:/tmp/.os_lf_venv
02:44:22  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:44:24  lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient 
02:44:30  lf-activate-venv(): INFO: Adding /tmp/venv-DeYZ/bin to PATH
02:44:30  Copying common-functions.sh to /tmp
02:44:32  Stack not found: releng-openflowplugin-csit-3node-clustering-only-chromium-89
02:44:32  Copying common-functions.sh to :/tmp
02:44:32  cp: cannot create regular file ':/tmp': No such file or directory
02:44:32  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins5080289044871590943.sh
02:44:32  common-functions.sh is being sourced
02:44:32  common-functions environment:
02:44:32  MAVENCONF: /tmp/karaf-0.24.1/etc/org.ops4j.pax.url.mvn.cfg
02:44:32  ACTUALFEATURES: 
02:44:32  FEATURESCONF: /tmp/karaf-0.24.1/etc/org.apache.karaf.features.cfg
02:44:32  CUSTOMPROP: /tmp/karaf-0.24.1/etc/custom.properties
02:44:32  LOGCONF: /tmp/karaf-0.24.1/etc/org.ops4j.pax.logging.cfg
02:44:32  MEMCONF: /tmp/karaf-0.24.1/bin/setenv
02:44:32  CONTROLLERMEM: 2048m
02:44:32  AKKACONF: /tmp/karaf-0.24.1/configuration/initial/pekko.conf
02:44:32  MODULESCONF: /tmp/karaf-0.24.1/configuration/initial/modules.conf
02:44:32  MODULESHARDSCONF: /tmp/karaf-0.24.1/configuration/initial/module-shards.conf
02:44:32  SUITES: 
02:44:32  
02:44:32  #################################################
02:44:32  ##         Configure Cluster and Start         ##
02:44:32  #################################################
02:44:32  ACTUALFEATURES: odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-table-miss-enforcer
02:44:32  SPACE_SEPARATED_FEATURES: odl-infrautils-ready odl-jolokia odl-openflowplugin-flow-services-rest odl-openflowplugin-app-table-miss-enforcer
02:44:32  Locating script plan to use...
02:44:32  Finished running script plans
02:44:32  Locating config plan to use...
02:44:32  config plan exists!!!
02:44:32  Changing the config plan path...
02:44:32  # Place the suites in run order:
02:44:32  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/scripts/set_akka_debug.sh
02:44:32  Executing /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/scripts/set_akka_debug.sh...
02:44:32  Copying config files to ODL Controller folder
02:44:32  Finished running config plans
02:44:32  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins11134005009605563725.sh
02:44:32  common-functions.sh is being sourced
02:44:32  common-functions environment:
02:44:32  MAVENCONF: /tmp/karaf-0.24.1/etc/org.ops4j.pax.url.mvn.cfg
02:44:32  ACTUALFEATURES: 
02:44:32  FEATURESCONF: /tmp/karaf-0.24.1/etc/org.apache.karaf.features.cfg
02:44:32  CUSTOMPROP: /tmp/karaf-0.24.1/etc/custom.properties
02:44:32  LOGCONF: /tmp/karaf-0.24.1/etc/org.ops4j.pax.logging.cfg
02:44:32  MEMCONF: /tmp/karaf-0.24.1/bin/setenv
02:44:32  CONTROLLERMEM: 2048m
02:44:32  AKKACONF: /tmp/karaf-0.24.1/configuration/initial/pekko.conf
02:44:32  MODULESCONF: /tmp/karaf-0.24.1/configuration/initial/modules.conf
02:44:32  MODULESHARDSCONF: /tmp/karaf-0.24.1/configuration/initial/module-shards.conf
02:44:32  SUITES: 
02:44:32  
02:44:32  + echo '#################################################'
02:44:32  #################################################
02:44:32  + echo '##         Verify Cluster is UP                ##'
02:44:32  ##         Verify Cluster is UP                ##
02:44:32  + echo '#################################################'
02:44:32  #################################################
02:44:32  + create_post_startup_script
02:44:32  + cat
02:44:32  + copy_and_run_post_startup_script
02:44:32  + seed_index=1
02:44:32  ++ seq 1 0
02:44:32  + dump_controller_threads
02:44:32  ++ seq 1 0
02:44:32  + '[' 0 -gt 0 ']'
02:44:32  + echo 'Generating controller variables...'
02:44:32  Generating controller variables...
02:44:32  ++ seq 1 0
02:44:32  + echo 'Generating mininet variables...'
02:44:32  Generating mininet variables...
02:44:32  ++ seq 1 1
02:44:32  + for i in $(seq 1 "${NUM_TOOLS_SYSTEM}")
02:44:32  + MININETIP=TOOLS_SYSTEM_1_IP
02:44:32  + tools_variables=' -v TOOLS_SYSTEM_1_IP:'
02:44:32  + get_test_suites SUITES
02:44:32  + local __suite_list=SUITES
02:44:32  + echo 'Locating test plan to use...'
02:44:32  Locating test plan to use...
02:44:32  + testplan_filepath=/w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/testplans/openflowplugin-clustering-chromium.txt
02:44:32  + '[' '!' -f /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/testplans/openflowplugin-clustering-chromium.txt ']'
02:44:32  + testplan_filepath=/w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/testplans/openflowplugin-clustering.txt
02:44:32  + '[' disabled '!=' disabled ']'
02:44:32  + echo 'Changing the testplan path...'
02:44:32  Changing the testplan path...
02:44:32  + sed s:integration:/w/workspace/openflowplugin-csit-3node-clustering-only-chromium: /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/testplans/openflowplugin-clustering.txt
02:44:32  + cat testplan.txt
02:44:32  # Place the suites in run order:
02:44:32  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot
02:44:32  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot
02:44:32  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot
02:44:32  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot
02:44:32  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot
02:44:32  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot
02:44:32  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot
02:44:32  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot
02:44:32  + '[' -z '' ']'
02:44:32  ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
02:44:32  ++ tr '\012' ' '
02:44:32  + suite_list='/w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot '
02:44:32  + eval 'SUITES='\''/w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot '\'''
02:44:32  ++ SUITES='/w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot '
02:44:32  + echo 'Starting Robot test suites /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot  ...'
02:44:32  Starting Robot test suites /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot  ...
02:44:32  + robot -N openflowplugin-clustering.txt --removekeywords wuks -e exclude -e skip_if_chromium -v BUNDLEFOLDER:karaf-0.24.1 -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories//autorelease-10193/org/opendaylight/integration/karaf/0.24.1/karaf-0.24.1.zip -v CONTROLLER: -v CONTROLLER1: -v CONTROLLER2: -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/openflowplugin-csit-3node-clustering-only-chromium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:0 -v NUM_TOOLS_SYSTEM:1 -v ODL_STREAM:chromium -v ODL_SYSTEM_IP: -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_1_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp -v ODL_OF_PLUGIN:lithium /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot
02:44:33  ==============================================================================
02:44:33  openflowplugin-clustering.txt                                                 
02:44:33  ==============================================================================
02:44:33  openflowplugin-clustering.txt.Cluster HA Owner Failover :: Test suite for C...
02:44:33  ==============================================================================
02:44:33  Check Shards Status Before Fail :: Check Status for all shards in ... | FAIL |
02:44:33  Dictionary '${Stream_dict}' has no key 'chromium'.
02:44:33  ------------------------------------------------------------------------------
02:44:33  Start Mininet Multiple Connections :: Start mininet tree,2 with co... | FAIL |
02:44:33  OSError: [Errno 16] Device or resource busy
02:44:33  ------------------------------------------------------------------------------
02:44:33  Check Entity Owner Status And Find Owner and Successor Before Fail... | FAIL |
02:45:04  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 30 seconds. The last error was: Could not parse owner and candidates for device openflow:1
02:45:04  ------------------------------------------------------------------------------
02:45:04  Reconnect Extra Switches To Successors And Check OVS Connections :... | FAIL |
02:45:04  Variable '@{original_successor_list}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Check Network Operational Information Before Fail :: Check devices... | PASS |
02:45:04  ------------------------------------------------------------------------------
02:45:04  Add Configuration In Owner and Verify Before Fail :: Add Flow in O... | FAIL |
02:45:04  Variable '${original_owner}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Modify Configuration In Owner and Verify Before Fail :: Modify Flo... | FAIL |
02:45:04  Variable '${original_owner}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Delete Configuration In Owner and Verify Before Fail :: Delete Flo... | FAIL |
02:45:04  Variable '${original_owner}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Add Configuration In Successor and Verify Before Fail :: Add Flow ... | FAIL |
02:45:04  Variable '${original_successor}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Modify Configuration In Successor and Verify Before Fail :: Modify... | FAIL |
02:45:04  Variable '${original_successor}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Delete Configuration In Successor and Verify Before Fail :: Delete... | FAIL |
02:45:04  Variable '${original_successor}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Send RPC Add to Owner and Verify Before Fail :: Add Flow in Owner ... | FAIL |
02:45:04  Variable '${original_owner}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Send RPC Delete to Owner and Verify Before Fail :: Delete Flow in ... | FAIL |
02:45:04  Variable '${original_owner}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Send RPC Add to Successor and Verify Before Fail :: Add Flow in Su... | FAIL |
02:45:04  Variable '${original_successor}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Send RPC Delete to Successor and Verify Before Fail :: Delete Flow... | FAIL |
02:45:04  Variable '${original_successor}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Modify Network And Verify Before Fail :: Take a link down and veri... | FAIL |
02:45:04  Variable '${mininet_conn_id}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Restore Network And Verify Before Fail :: Take the link up and ver... | FAIL |
02:45:04  Variable '${mininet_conn_id}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Kill Owner Instance :: Kill Owner Instance and verify it is dead      | FAIL |
02:45:04  Variable '${original_owner}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Check Shards Status After Fail :: Create original cluster list and... | FAIL |
02:45:04  Variable '${new_cluster_list}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Check Entity Owner Status And Find Owner and Successor After Fail ... | FAIL |
02:45:04  Variable '${original_successor}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Check Network Operational Information After Fail :: Check devices ... | FAIL |
02:45:04  Variable '${new_cluster_list}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Add Configuration In Owner and Verify After Fail :: Add Flow in Ow... | FAIL |
02:45:04  Variable '${new_owner}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Modify Configuration In Owner and Verify After Fail :: Modify Flow... | FAIL |
02:45:04  Variable '${new_owner}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Delete Configuration In Owner and Verify After Fail :: Delete Flow... | FAIL |
02:45:04  Variable '${new_owner}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Add Configuration In Successor and Verify After Fail :: Add Flow i... | FAIL |
02:45:04  Variable '${new_successor}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Modify Configuration In Successor and Verify After Fail :: Modify ... | FAIL |
02:45:04  Variable '${new_successor}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Delete Configuration In Successor and Verify After Fail :: Delete ... | FAIL |
02:45:04  Variable '${new_successor}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Send RPC Add to Owner and Verify After Fail :: Add Flow in Owner a... | FAIL |
02:45:04  Variable '${new_owner}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Send RPC Delete to Owner and Verify After Fail :: Delete Flow in O... | FAIL |
02:45:04  Variable '${new_owner}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Send RPC Add to Successor and Verify After Fail :: Add Flow in Suc... | FAIL |
02:45:04  Variable '${new_successor}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Send RPC Delete to Successor and Verify After Fail :: Delete Flow ... | FAIL |
02:45:04  Variable '${new_successor}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Modify Network and Verify After Fail :: Take a link down and verif... | FAIL |
02:45:04  Variable '${new_cluster_list}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Restore Network and Verify After Fail :: Take the link up and veri... | FAIL |
02:45:04  Variable '${new_cluster_list}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Start Old Owner Instance :: Start old Owner Instance and verify it... | FAIL |
02:45:04  This test fails due to https://jira.opendaylight.org/browse/CONTROLLER-1849
02:45:04  
02:45:04  Variable '${original_owner}' not found.
02:45:04  ------------------------------------------------------------------------------
02:45:04  Check Shards Status After Recover :: Create original cluster list ... | FAIL |
02:46:35  Keyword 'ClusterOpenFlow.Check OpenFlow Shards Status' failed after retrying for 1 minute 30 seconds. The last error was: Dictionary '${Stream_dict}' has no key 'chromium'.
02:46:35  ------------------------------------------------------------------------------
02:46:35  Check Entity Owner Status After Recover :: Check Entity Owner Stat... | FAIL |
02:47:05  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 30 seconds. The last error was: Could not parse owner and candidates for device openflow:1
02:47:05  ------------------------------------------------------------------------------
02:47:05  Check Network Operational Information After Recover :: Check devic... | PASS |
02:47:05  ------------------------------------------------------------------------------
02:47:05  Add Configuration In Owner and Verify After Recover :: Add Flow in... | FAIL |
02:47:05  Variable '${new_owner}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Modify Configuration In Owner and Verify After Recover :: Modify F... | FAIL |
02:47:05  Variable '${new_owner}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Delete Configuration In Owner and Verify After Recover :: Delete F... | FAIL |
02:47:05  Variable '${new_owner}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Add Configuration In Old Owner and Verify After Recover :: Add Flo... | FAIL |
02:47:05  Variable '${original_owner}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Modify Configuration In Old Owner and Verify After Recover :: Modi... | FAIL |
02:47:05  Variable '${original_owner}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Delete Configuration In Old Owner and Verify After Recover :: Dele... | FAIL |
02:47:05  Variable '${original_owner}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Send RPC Add to Owner and Verify After Recover :: Add Flow in Owne... | FAIL |
02:47:05  Variable '${new_owner}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Send RPC Delete to Owner and Verify After Recover :: Delete Flow i... | FAIL |
02:47:05  Variable '${new_owner}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Send RPC Add to Old Owner and Verify After Recover :: Add Flow in ... | FAIL |
02:47:05  Variable '${original_owner}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Send RPC Delete to Old Owner and Verify After Recover :: Delete Fl... | FAIL |
02:47:05  Variable '${original_owner}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Modify Network and Verify After Recover :: Take a link down and ve... | FAIL |
02:47:05  Variable '${mininet_conn_id}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Restore Network and Verify After Recover :: Take the link up and v... | FAIL |
02:47:05  Variable '${mininet_conn_id}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Stop Mininet and Exit :: Stop mininet and exit connection.            | FAIL |
02:47:05  Variable '${mininet_conn_id}' not found.
02:47:05  ------------------------------------------------------------------------------
02:47:05  Check No Network Operational Information :: Check device is not in... | PASS |
02:47:05  ------------------------------------------------------------------------------
02:47:05  openflowplugin-clustering.txt.Cluster HA Owner Failover :: Test su... | FAIL |
02:47:05  51 tests, 3 passed, 48 failed
02:47:05  ==============================================================================
02:47:05  openflowplugin-clustering.txt.Cluster HA Owner Restart :: Test suite for Cl...
02:47:05  ==============================================================================
02:47:05  Check Shards Status Before Stop :: Check Status for all shards in ... | FAIL |
02:47:06  Dictionary '${Stream_dict}' has no key 'chromium'.
02:47:06  ------------------------------------------------------------------------------
02:47:06  Start Mininet Multiple Connections :: Start mininet tree,2 with co... | FAIL |
02:47:06  OSError: [Errno 16] Device or resource busy
02:47:06  ------------------------------------------------------------------------------
02:47:06  Check Entity Owner Status And Find Owner and Successor Before Stop... | FAIL |
02:47:37  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 30 seconds. The last error was: Could not parse owner and candidates for device openflow:1
02:47:37  ------------------------------------------------------------------------------
02:47:37  Reconnect Extra Switches To Successors And Check OVS Connections :... | FAIL |
02:47:37  Variable '@{original_successor_list}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Check Network Operational Information Before Stop :: Check devices... | PASS |
02:47:37  ------------------------------------------------------------------------------
02:47:37  Add Configuration In Owner and Verify Before Stop :: Add Flow in O... | FAIL |
02:47:37  Variable '${original_owner}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Modify Configuration In Owner and Verify Before Stop :: Modify Flo... | FAIL |
02:47:37  Variable '${original_owner}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Delete Configuration In Owner and Verify Before Stop :: Delete Flo... | FAIL |
02:47:37  Variable '${original_owner}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Add Configuration In Successor and Verify Before Stop :: Add Flow ... | FAIL |
02:47:37  Variable '${original_successor}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Modify Configuration In Successor and Verify Before Stop :: Modify... | FAIL |
02:47:37  Variable '${original_successor}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Delete Configuration In Successor and Verify Before Stop :: Delete... | FAIL |
02:47:37  Variable '${original_successor}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Send RPC Add to Owner and Verify Before Stop :: Add Flow in Owner ... | FAIL |
02:47:37  Variable '${original_owner}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Send RPC Delete to Owner and Verify Before Stop :: Delete Flow in ... | FAIL |
02:47:37  Variable '${original_owner}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Send RPC Add to Successor and Verify Before Stop :: Add Flow in Su... | FAIL |
02:47:37  Variable '${original_successor}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Send RPC Delete to Successor and Verify Before Stop :: Delete Flow... | FAIL |
02:47:37  Variable '${original_successor}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Modify Network And Verify Before Stop :: Take a link down and veri... | FAIL |
02:47:37  Variable '${mininet_conn_id}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Restore Network And Verify Before Stop :: Take the link up and ver... | FAIL |
02:47:37  Variable '${mininet_conn_id}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Stop Owner Instance :: Stop Owner Instance and verify it is dead      | FAIL |
02:47:37  Variable '${original_owner}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Check Shards Status After Stop :: Create original cluster list and... | FAIL |
02:47:37  Variable '${new_cluster_list}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Check Entity Owner Status And Find Owner and Successor After Stop ... | FAIL |
02:47:37  Variable '${original_successor}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Check Network Operational Information After Stop :: Check devices ... | FAIL |
02:47:37  Variable '${new_cluster_list}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Add Configuration In Owner and Verify After Stop :: Add Flow in Ow... | FAIL |
02:47:37  Variable '${new_owner}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Modify Configuration In Owner and Verify After Stop :: Modify Flow... | FAIL |
02:47:37  Variable '${new_owner}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Delete Configuration In Owner and Verify After Stop :: Delete Flow... | FAIL |
02:47:37  Variable '${new_owner}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Add Configuration In Successor and Verify After Stop :: Add Flow i... | FAIL |
02:47:37  Variable '${new_successor}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Modify Configuration In Successor and Verify After Stop :: Modify ... | FAIL |
02:47:37  Variable '${new_successor}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Delete Configuration In Successor and Verify After Stop :: Delete ... | FAIL |
02:47:37  Variable '${new_successor}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Send RPC Add to Owner and Verify After Stop :: Add Flow in Owner a... | FAIL |
02:47:37  Variable '${new_owner}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Send RPC Delete to Owner and Verify After Stop :: Delete Flow in O... | FAIL |
02:47:37  Variable '${new_owner}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Send RPC Add to Successor and Verify After Stop :: Add Flow in Suc... | FAIL |
02:47:37  Variable '${new_successor}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Send RPC Delete to Successor and Verify After Stop :: Delete Flow ... | FAIL |
02:47:37  Variable '${new_successor}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Modify Network and Verify After Stop :: Take a link down and verif... | FAIL |
02:47:37  Variable '${new_cluster_list}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Restore Network and Verify After Stop :: Take the link up and veri... | FAIL |
02:47:37  Variable '${new_cluster_list}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Start Old Owner Instance :: Start old Owner Instance and verify it... | FAIL |
02:47:37  Variable '${original_owner}' not found.
02:47:37  ------------------------------------------------------------------------------
02:47:37  Check Shards Status After Start :: Create original cluster list an... | FAIL |
02:49:08  Keyword 'ClusterOpenFlow.Check OpenFlow Shards Status' failed after retrying for 1 minute 30 seconds. The last error was: Dictionary '${Stream_dict}' has no key 'chromium'.
02:49:08  ------------------------------------------------------------------------------
02:49:08  Check Entity Owner Status After Start :: Check Entity Owner Status... | FAIL |
02:49:39  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 30 seconds. The last error was: Could not parse owner and candidates for device openflow:1
02:49:39  ------------------------------------------------------------------------------
02:49:39  Check Network Operational Information After Start :: Check devices... | PASS |
02:49:39  ------------------------------------------------------------------------------
02:49:39  Add Configuration In Owner and Verify After Start :: Add Flow in O... | FAIL |
02:49:39  Variable '${new_owner}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Modify Configuration In Owner and Verify After Start :: Modify Flo... | FAIL |
02:49:39  Variable '${new_owner}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Delete Configuration In Owner and Verify After Start :: Delete Flo... | FAIL |
02:49:39  Variable '${new_owner}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Add Configuration In Old Owner and Verify After Start :: Add Flow ... | FAIL |
02:49:39  Variable '${original_owner}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Modify Configuration In Old Owner and Verify After Start :: Modify... | FAIL |
02:49:39  Variable '${original_owner}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Delete Configuration In Old Owner and Verify After Start :: Delete... | FAIL |
02:49:39  Variable '${original_owner}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Send RPC Add to Owner and Verify After Start :: Add Flow in Owner ... | FAIL |
02:49:39  Variable '${new_owner}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Send RPC Delete to Owner and Verify After Start :: Delete Flow in ... | FAIL |
02:49:39  Variable '${new_owner}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Send RPC Add to Old Owner and Verify After Start :: Add Flow in Ow... | FAIL |
02:49:39  Variable '${original_owner}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Send RPC Delete to Old Owner and Verify After Start :: Delete Flow... | FAIL |
02:49:39  Variable '${original_owner}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Modify Network and Verify After Start :: Take a link down and veri... | FAIL |
02:49:39  Variable '${mininet_conn_id}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Restore Network and Verify After Start :: Take the link up and ver... | FAIL |
02:49:39  Variable '${mininet_conn_id}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Stop Mininet and Exit :: Stop mininet and exit connection.            | FAIL |
02:49:39  Variable '${mininet_conn_id}' not found.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Check No Network Operational Information :: Check device is not in... | PASS |
02:49:39  ------------------------------------------------------------------------------
02:49:39  openflowplugin-clustering.txt.Cluster HA Owner Restart :: Test sui... | FAIL |
02:49:39  51 tests, 3 passed, 48 failed
02:49:39  ==============================================================================
02:49:39  openflowplugin-clustering.txt.Cluster HA Data Recovery Leader Follower Fail...
02:49:39  ==============================================================================
02:49:39  Check Shards Status Before Leader Restart :: Check Status for all ... | FAIL |
02:49:39  Dictionary '${Stream_dict}' has no key 'chromium'.
02:49:39  ------------------------------------------------------------------------------
02:49:39  Get inventory Leader Before Leader Restart :: Find leader in the i... | FAIL |
02:49:49  Keyword 'ClusterManagement.Get_Leader_And_Followers_For_Shard' failed after retrying for 10 seconds. The last error was: No leader found.
02:49:49  ------------------------------------------------------------------------------
02:49:49  Start Mininet Connect To Follower Node1 :: Start mininet with conn... | FAIL |
02:49:49  Variable '${follower_node_1}' not found.
02:49:49  ------------------------------------------------------------------------------
02:49:49  Add Flows In Follower Node2 and Verify Before Leader Restart :: Ad... | FAIL |
02:49:49  Variable '${follower_node_2}' not found.
02:49:49  ------------------------------------------------------------------------------
02:49:49  Stop Mininet Connected To Follower Node1 and Exit :: Stop mininet ... | FAIL |
02:49:49  Variable '${mininet_conn_id}' not found.
02:49:49  ------------------------------------------------------------------------------
02:49:49  Restart Leader From Cluster Node :: Stop Leader Node and Start it ... | FAIL |
02:49:49  Variable '${inventory_leader}' not found.
02:49:49  ------------------------------------------------------------------------------
02:49:49  Get inventory Follower After Leader Restart :: Find new Followers ... | FAIL |
02:49:59  Keyword 'ClusterManagement.Get_Leader_And_Followers_For_Shard' failed after retrying for 10 seconds. The last error was: No leader found.
02:49:59  ------------------------------------------------------------------------------
02:49:59  Start Mininet Connect To Old Leader :: Start mininet with connecti... | FAIL |
02:49:59  Variable '${inventory_leader_old}' not found.
02:49:59  ------------------------------------------------------------------------------
02:49:59  Verify Flows In Switch After Leader Restart :: Verify flows are in... | PASS |
02:49:59  ------------------------------------------------------------------------------
02:49:59  Stop Mininet Connected To Old Leader and Exit :: Stop mininet and ... | FAIL |
02:49:59  Variable '${mininet_conn_id}' not found.
02:49:59  ------------------------------------------------------------------------------
02:49:59  Restart Follower Node2 :: Stop Follower Node2 and Start it Up, Ver... | FAIL |
02:49:59  Variable '${follower_node_2}' not found.
02:49:59  ------------------------------------------------------------------------------
02:49:59  Get inventory Follower After Follower Restart :: Find Followers an... | FAIL |
02:50:10  Keyword 'ClusterManagement.Get_Leader_And_Followers_For_Shard' failed after retrying for 10 seconds. The last error was: No leader found.
02:50:10  ------------------------------------------------------------------------------
02:50:10  Start Mininet Connect To Leader :: Start mininet with connection t... | FAIL |
02:50:10  Variable '${inventory_leader}' not found.
02:50:10  ------------------------------------------------------------------------------
02:50:10  Verify Flows In Switch After Follower Restart :: Verify flows are ... | PASS |
02:50:10  ------------------------------------------------------------------------------
02:50:10  Stop Mininet Connected To Leader and Exit :: Stop mininet Connecte... | FAIL |
02:50:10  Variable '${mininet_conn_id}' not found.
02:50:10  ------------------------------------------------------------------------------
02:50:10  Restart Full Cluster :: Stop all Cluster Nodes and Start it Up All.   | PASS |
02:50:10  ------------------------------------------------------------------------------
02:50:10  Get inventory Status After Cluster Restart :: Find New Followers a... | FAIL |
02:50:20  Keyword 'ClusterManagement.Get_Leader_And_Followers_For_Shard' failed after retrying for 10 seconds. The last error was: No leader found.
02:50:20  ------------------------------------------------------------------------------
02:50:20  Start Mininet Connect To Follower Node2 After Cluster Restart :: S... | FAIL |
02:50:20  Variable '${follower_node_2}' not found.
02:50:20  ------------------------------------------------------------------------------
02:50:20  Verify Flows In Switch After Cluster Restart :: Verify flows are i... | PASS |
02:50:20  ------------------------------------------------------------------------------
02:50:20  Delete Flows In Follower Node1 and Verify After Leader Restart :: ... | FAIL |
02:50:20  Variable '${follower_node_1}' not found.
02:50:20  ------------------------------------------------------------------------------
02:50:20  Stop Mininet Connected To Follower Node2 and Exit After Cluster Re... | FAIL |
02:50:20  Variable '${mininet_conn_id}' not found.
02:50:20  ------------------------------------------------------------------------------
02:50:20  openflowplugin-clustering.txt.Cluster HA Data Recovery Leader Foll... | FAIL |
02:50:20  21 tests, 4 passed, 17 failed
02:50:20  ==============================================================================
02:50:20  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/test/csit/libraries/VsctlListParser.py:61: SyntaxWarning: "is not" with a literal. Did you mean "!="?
02:50:20    if ctl_ref is not "":
02:50:20  openflowplugin-clustering.txt.010 Group Flows :: Switch connections and clu...
02:50:20  ==============================================================================
02:50:20  Add Groups And Flows :: Add 100 groups 1&2 and flows in every switch. | FAIL |
02:50:20  Non-existing index or alias 'ClusterManagement__session_1'.
02:50:20  ------------------------------------------------------------------------------
02:50:20  Start Mininet Multiple Connections :: Start mininet linear with co... | FAIL |
02:50:20  OSError: [Errno 16] Device or resource busy
02:50:20  ------------------------------------------------------------------------------
02:50:20  Check Linear Topology :: Check Linear Topology.                       | FAIL |
02:50:51  Keyword 'ClusterOpenFlow.Check Linear Topology On Member' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:50:51  ------------------------------------------------------------------------------
02:50:51  Check Stats Are Not Frozen :: Check that duration flow stat is inc... | FAIL |
02:51:21  Keyword 'Check Flow Stats Are Not Frozen' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:51:21  ------------------------------------------------------------------------------
02:51:21  Check Flows In Operational DS :: Check Flows in operational DS.       | FAIL |
02:51:31  Keyword 'ClusterOpenFlow.Check Number Of Flows On Member' failed after retrying for 10 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:51:31  ------------------------------------------------------------------------------
02:51:31  Check Groups In Operational DS :: Check Groups in operational DS.     | FAIL |
02:51:41  Keyword 'ClusterOpenFlow.Check Number Of Groups On Member' failed after retrying for 10 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:51:41  ------------------------------------------------------------------------------
02:51:41  Check Flows In Switch :: Check Flows in switch.                       | FAIL |
02:51:41  Variable '${mininet_conn_id}' not found.
02:51:41  ------------------------------------------------------------------------------
02:51:41  Check Entity Owner Status And Find Owner and Successor Before Fail... | FAIL |
02:52:12  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 30 seconds. The last error was: Could not parse owner and candidates for device openflow:1
02:52:12  ------------------------------------------------------------------------------
02:52:12  Disconnect Mininet From Owner :: Disconnect mininet from the owner    | FAIL |
02:52:12  Variable '${original_owner}' not found.
02:52:12  ------------------------------------------------------------------------------
02:52:12  Check Entity Owner Status And Find Owner and Successor After Fail ... | FAIL |
02:52:23  Keyword 'ClusterOpenFlow.Get OpenFlow Entity Owner Status For One Device' failed after retrying for 10 seconds. The last error was: Variable '${new_cluster_list}' not found.
02:52:23  ------------------------------------------------------------------------------
02:52:23  Check Switch Moves To New Master :: Check switch s1 is connected t... | FAIL |
02:52:23  Variable '${new_owner}' not found.
02:52:23  ------------------------------------------------------------------------------
02:52:23  Check Linear Topology After Disconnect :: Check Linear Topology.      | FAIL |
02:52:53  Keyword 'ClusterOpenFlow.Check Linear Topology On Member' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:52:53  ------------------------------------------------------------------------------
02:52:53  Check Stats Are Not Frozen After Disconnect :: Check that duration... | FAIL |
02:53:23  Keyword 'Check Flow Stats Are Not Frozen' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:53:23  ------------------------------------------------------------------------------
02:53:23  Remove Flows And Groups After Mininet Is Disconnected :: Remove 1 ... | FAIL |
02:53:23  Non-existing index or alias 'ClusterManagement__session_1'.
02:53:23  ------------------------------------------------------------------------------
02:53:23  Check Flows In Operational DS After Mininet Is Disconnected :: Che... | FAIL |
02:53:54  Keyword 'ClusterOpenFlow.Check Number Of Flows On Member' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:53:54  ------------------------------------------------------------------------------
02:53:54  Check Groups In Operational DS After Mininet Is Disconnected :: Ch... | FAIL |
02:54:04  Keyword 'ClusterOpenFlow.Check Number Of Groups On Member' failed after retrying for 10 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:54:04  ------------------------------------------------------------------------------
02:54:04  Check Flows In Switch After Mininet Is Disconnected :: Check Flows... | FAIL |
02:54:04  Variable '${mininet_conn_id}' not found.
02:54:04  ------------------------------------------------------------------------------
02:54:04  Reconnect Mininet To Owner :: Reconnect mininet to switch 1 owner.    | FAIL |
02:54:04  Variable '${original_owner_list}' not found.
02:54:04  ------------------------------------------------------------------------------
02:54:04  Check Entity Owner Status And Find Owner and Successor After Recon... | FAIL |
02:54:34  Keyword 'ClusterOpenFlow.Get OpenFlow Entity Owner Status For One Device' failed after retrying for 10 seconds. The last error was: Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 30 seconds. The last error was: Could not parse owner and candidates for device openflow:1
02:54:34  ------------------------------------------------------------------------------
02:54:34  Add Flows And Groups After Owner Reconnect :: Add 1 group type 1&2... | FAIL |
02:54:34  Non-existing index or alias 'ClusterManagement__session_1'.
02:54:34  ------------------------------------------------------------------------------
02:54:34  Check Stats Are Not Frozen After Owner Reconnect :: Check that dur... | FAIL |
02:55:04  Keyword 'Check Flow Stats Are Not Frozen' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:55:04  ------------------------------------------------------------------------------
02:55:04  Check Flows After Owner Reconnect In Operational DS :: Check Flows... | FAIL |
02:55:35  Keyword 'ClusterOpenFlow.Check Number Of Flows On Member' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:55:35  ------------------------------------------------------------------------------
02:55:35  Check Groups After Owner Reconnect In Operational DS :: Check Grou... | FAIL |
02:55:45  Keyword 'ClusterOpenFlow.Check Number Of Groups On Member' failed after retrying for 10 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:55:45  ------------------------------------------------------------------------------
02:55:45  Check Flows After Owner Reconnect In Switch :: Check Flows in switch. | FAIL |
02:55:45  Variable '${mininet_conn_id}' not found.
02:55:45  ------------------------------------------------------------------------------
02:55:45  Check Switches Generate Slave Connection :: Check switches are con... | FAIL |
02:55:45  Variable '${original_owner}' not found.
02:55:45  ------------------------------------------------------------------------------
02:55:45  Disconnect Mininet From Successor :: Disconnect mininet from the S... | FAIL |
02:55:45  Variable '${new_successor_list}' not found.
02:55:45  ------------------------------------------------------------------------------
02:55:45  Check Entity Owner Status And Find New Owner and Successor After D... | FAIL |
02:55:55  Keyword 'ClusterOpenFlow.Get OpenFlow Entity Owner Status For One Device' failed after retrying for 10 seconds. The last error was: Variable '${owner_list}' not found.
02:55:55  ------------------------------------------------------------------------------
02:55:55  Disconnect Mininet From Current Owner :: Disconnect mininet from t... | FAIL |
02:55:55  Variable '${current_owner}' not found.
02:55:55  ------------------------------------------------------------------------------
02:55:55  Check Entity Owner Status And Find Current Owner and Successor Aft... | FAIL |
02:56:05  Keyword 'ClusterOpenFlow.Get OpenFlow Entity Owner Status For One Device' failed after retrying for 10 seconds. The last error was: Variable '${original_owner_list}' not found.
02:56:05  ------------------------------------------------------------------------------
02:56:05  Check Switch Moves To Current Master :: Check switch s1 is connect... | FAIL |
02:56:05  Variable '${current_new_owner}' not found.
02:56:05  ------------------------------------------------------------------------------
02:56:05  Check Linear Topology After Owner Disconnect :: Check Linear Topol... | FAIL |
02:56:36  Keyword 'ClusterOpenFlow.Check Linear Topology On Member' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:56:36  ------------------------------------------------------------------------------
02:56:36  Check Stats Are Not Frozen After Owner Disconnect :: Check that du... | FAIL |
02:57:06  Keyword 'Check Flow Stats Are Not Frozen' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:57:06  ------------------------------------------------------------------------------
02:57:06  Remove Flows And Groups After Owner Disconnected :: Remove 1 group... | FAIL |
02:57:06  Non-existing index or alias 'ClusterManagement__session_1'.
02:57:06  ------------------------------------------------------------------------------
02:57:06  Check Flows In Operational DS After Owner Disconnected :: Check Fl... | FAIL |
02:57:36  Keyword 'ClusterOpenFlow.Check Number Of Flows On Member' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:57:36  ------------------------------------------------------------------------------
02:57:36  Check Groups In Operational DS After Owner Disconnected :: Check G... | FAIL |
02:57:46  Keyword 'ClusterOpenFlow.Check Number Of Groups On Member' failed after retrying for 10 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:57:46  ------------------------------------------------------------------------------
02:57:46  Check Flows In Switch After Owner Disconnected :: Check Flows in s... | FAIL |
02:57:46  Variable '${mininet_conn_id}' not found.
02:57:46  ------------------------------------------------------------------------------
02:57:46  Disconnect Mininet From Cluster :: Disconnect Mininet from Cluster.   | FAIL |
02:57:46  Variable '${original_owner_list}' not found.
02:57:46  ------------------------------------------------------------------------------
02:57:46  Check No Switches After Disconnect :: Check no switches in topology.  | FAIL |
02:58:17  Keyword 'ClusterOpenFlow.Check No Switches On Member' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:58:17  ------------------------------------------------------------------------------
02:58:17  Check Switch Is Not Connected :: Check switch s1 is not connected ... | FAIL |
02:58:17  Variable '@{cluster_index_list}' not found.
02:58:17  ------------------------------------------------------------------------------
02:58:17  Reconnect Mininet To Cluster :: Reconnect mininet to cluster by re... | PASS |
02:58:17  ------------------------------------------------------------------------------
02:58:17  Check Linear Topology After Mininet Reconnects :: Check Linear Top... | FAIL |
02:58:27  Keyword 'ClusterOpenFlow.Check Linear Topology On Member' failed after retrying for 10 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:58:27  ------------------------------------------------------------------------------
02:58:27  Add Flows And Groups After Mininet Reconnects :: Add 1 group type ... | FAIL |
02:58:27  Non-existing index or alias 'ClusterManagement__session_1'.
02:58:27  ------------------------------------------------------------------------------
02:58:27  Check Flows In Operational DS After Mininet Reconnects :: Check Fl... | FAIL |
02:58:57  Keyword 'ClusterOpenFlow.Check Number Of Flows On Member' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:58:57  ------------------------------------------------------------------------------
02:58:57  Check Groups In Operational DS After Mininet Reconnects :: Check G... | FAIL |
02:59:07  Keyword 'ClusterOpenFlow.Check Number Of Groups On Member' failed after retrying for 10 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
02:59:07  ------------------------------------------------------------------------------
02:59:07  Check Flows In Switch After Mininet Reconnects :: Check Flows in s... | FAIL |
02:59:07  Variable '${mininet_conn_id}' not found.
02:59:07  ------------------------------------------------------------------------------
02:59:07  Check Entity Owner Status And Find Owner and Successor Before Owne... | FAIL |
02:59:37  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 30 seconds. The last error was: Could not parse owner and candidates for device openflow:1
02:59:37  ------------------------------------------------------------------------------
02:59:37  Check Switch Generates Slave Connection Before Owner Stop :: Check... | FAIL |
02:59:37  Variable '${original_successor}' not found.
02:59:37  ------------------------------------------------------------------------------
02:59:37  Check Shards Status Before Owner Stop :: Check Status for all shar... | FAIL |
02:59:37  Dictionary '${Stream_dict}' has no key 'chromium'.
02:59:37  ------------------------------------------------------------------------------
02:59:37  Stop Owner Instance :: Stop Owner Instance and verify it is shutdown  | FAIL |
02:59:37  Variable '${original_owner}' not found.
02:59:37  ------------------------------------------------------------------------------
02:59:37  Check Shards Status After Stop :: Check Status for all shards in O... | FAIL |
02:59:37  Variable '${new_cluster_list}' not found.
02:59:37  ------------------------------------------------------------------------------
02:59:37  Check Entity Owner Status And Find Owner and Successor After Stop ... | FAIL |
02:59:38  Variable '${original_successor}' not found.
02:59:38  ------------------------------------------------------------------------------
02:59:38  Check Stats Are Not Frozen After Owner Stop :: Check that duration... | FAIL |
03:00:08  Keyword 'Check Flow Stats Are Not Frozen' failed after retrying for 30 seconds. The last error was: Variable '${new_owner}' not found.
03:00:08  ------------------------------------------------------------------------------
03:00:08  Remove Configuration In Owner and Verify After Owner Stop :: Remov... | FAIL |
03:00:08  Variable '${new_owner}' not found.
03:00:08  ------------------------------------------------------------------------------
03:00:08  Check Flows After Owner Stop In Operational DS :: Check Flows in O... | FAIL |
03:00:38  Keyword 'ClusterOpenFlow.Check Number Of Flows On Member' failed after retrying for 30 seconds. The last error was: Variable '${new_owner}' not found.
03:00:38  ------------------------------------------------------------------------------
03:00:38  Check Groups After Owner Stop In Operational DS :: Check Groups in... | FAIL |
03:00:48  Keyword 'ClusterOpenFlow.Check Number Of Groups On Member' failed after retrying for 10 seconds. The last error was: Variable '${new_owner}' not found.
03:00:48  ------------------------------------------------------------------------------
03:00:48  Check Flows In Switch After Owner Stop :: Check Flows in switch.      | FAIL |
03:00:48  Variable '${mininet_conn_id}' not found.
03:00:48  ------------------------------------------------------------------------------
03:00:48  Start Old Owner Instance :: Start old Owner Instance and verify it... | FAIL |
03:00:48  Variable '${original_owner}' not found.
03:00:48  ------------------------------------------------------------------------------
03:00:48  Check Entity Owner Status And Find Owner and Successor After Start... | FAIL |
03:01:18  Keyword 'ClusterOpenFlow.Get OpenFlow Entity Owner Status For One Device' failed after retrying for 10 seconds. The last error was: Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 30 seconds. The last error was: Could not parse owner and candidates for device openflow:1
03:01:18  ------------------------------------------------------------------------------
03:01:18  Check Linear Topology After Owner Restart :: Check Linear Topology.   | FAIL |
03:01:28  Keyword 'ClusterOpenFlow.Check Linear Topology On Member' failed after retrying for 10 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
03:01:28  ------------------------------------------------------------------------------
03:01:28  Add Configuration In Owner and Verify After Owner Restart :: Add 1... | FAIL |
03:01:28  Variable '${new_owner}' not found.
03:01:28  ------------------------------------------------------------------------------
03:01:28  Check Stats Are Not Frozen After Owner Restart :: Check that durat... | FAIL |
03:01:28  Variable '${new_owner}' not found.
03:01:28  ------------------------------------------------------------------------------
03:01:28  Check Flows In Operational DS After Owner Restart :: Check Flows i... | FAIL |
03:01:59  Keyword 'ClusterOpenFlow.Check Number Of Flows On Member' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
03:01:59  ------------------------------------------------------------------------------
03:01:59  Check Groups In Operational DS After Owner Restart :: Check Groups... | FAIL |
03:02:09  Keyword 'ClusterOpenFlow.Check Number Of Groups On Member' failed after retrying for 10 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
03:02:09  ------------------------------------------------------------------------------
03:02:09  Check Flows In Switch After Owner Restart :: Check Flows in switch.   | FAIL |
03:02:09  Variable '${mininet_conn_id}' not found.
03:02:09  ------------------------------------------------------------------------------
03:02:09  Restart Cluster :: Stop and Start cluster.                            | PASS |
03:02:09  ------------------------------------------------------------------------------
03:02:09  Check Linear Topology After Controller Restarts :: Check Linear To... | FAIL |
03:07:09  Keyword 'ClusterOpenFlow.Check Linear Topology On Member' failed after retrying for 5 minutes. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
03:07:09  ------------------------------------------------------------------------------
03:07:09  Check Stats Are Not Frozen After Cluster Restart :: Check that dur... | FAIL |
03:07:39  Keyword 'Check Flow Stats Are Not Frozen' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
03:07:39  ------------------------------------------------------------------------------
03:07:39  Check Flows In Operational DS After Controller Restarts :: Check F... | FAIL |
03:08:10  Keyword 'ClusterOpenFlow.Check Number Of Flows On Member' failed after retrying for 30 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
03:08:10  ------------------------------------------------------------------------------
03:08:10  Check Groups In Operational DS After Controller Restarts :: Check ... | FAIL |
03:08:20  Keyword 'ClusterOpenFlow.Check Number Of Groups On Member' failed after retrying for 10 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
03:08:20  ------------------------------------------------------------------------------
03:08:20  Check Flows In Switch After Controller Restarts :: Check Flows in ... | FAIL |
03:08:20  Variable '${mininet_conn_id}' not found.
03:08:20  ------------------------------------------------------------------------------
03:08:20  Stop Mininet :: Stop Mininet.                                         | FAIL |
03:08:20  No open connection.
03:08:20  ------------------------------------------------------------------------------
03:08:20  Check No Switches :: Check no switches in topology.                   | FAIL |
03:08:25  Keyword 'ClusterOpenFlow.Check No Switches On Member' failed after retrying for 5 seconds. The last error was: Non-existing index or alias 'ClusterManagement__session_1'.
03:08:25  ------------------------------------------------------------------------------
03:08:25  openflowplugin-clustering.txt.010 Group Flows :: Switch connection... | FAIL |
03:08:25  72 tests, 2 passed, 70 failed
03:08:25  ==============================================================================
03:08:25  openflowplugin-clustering.txt.010 Switch Disconnect :: Test suite for entit...
03:08:25  ==============================================================================
03:08:25  Switches To Be Connected To All Nodes :: Initial check for correct... | FAIL |
03:08:25  Parent suite setup failed:
03:08:25  OSError: [Errno 16] Device or resource busy
03:08:25  ------------------------------------------------------------------------------
03:08:25  Reconnecting Switch s1                                                | FAIL |
03:08:25  Parent suite setup failed:
03:08:25  OSError: [Errno 16] Device or resource busy
03:08:25  ------------------------------------------------------------------------------
03:08:25  Switches Still Be Connected To All Nodes                              | FAIL |
03:08:25  Parent suite setup failed:
03:08:25  OSError: [Errno 16] Device or resource busy
03:08:25  ------------------------------------------------------------------------------
03:08:25  openflowplugin-clustering.txt.010 Switch Disconnect :: Test suite ... | FAIL |
03:08:25  Suite setup failed:
03:08:25  OSError: [Errno 16] Device or resource busy
03:08:25  
03:08:25  Also suite teardown failed:
03:08:25  Several failures occurred:
03:08:25  
03:08:25  1) Cannot open session, you need to establish a connection first.
03:08:25  
03:08:25  2) Cannot open session, you need to establish a connection first.
03:08:25  
03:08:25  3) Cannot open session, you need to establish a connection first.
03:08:25  
03:08:25  3 tests, 0 passed, 3 failed
03:08:25  ==============================================================================
03:08:25  openflowplugin-clustering.txt.020 Cluster Node Failure :: Test suite for en...
03:08:25  ==============================================================================
03:08:25  Switches To Be Connected To All Nodes :: Initial check for correct... | FAIL |
03:08:25  Parent suite setup failed:
03:08:25  OSError: [Errno 16] Device or resource busy
03:08:25  ------------------------------------------------------------------------------
03:08:25  Restarting Owner Of Switch s1                                         | FAIL |
03:08:25  Parent suite setup failed:
03:08:25  OSError: [Errno 16] Device or resource busy
03:08:25  ------------------------------------------------------------------------------
03:08:25  Switches Still Be Connected To All Nodes                              | FAIL |
03:08:25  Parent suite setup failed:
03:08:25  OSError: [Errno 16] Device or resource busy
03:08:25  ------------------------------------------------------------------------------
03:08:25  openflowplugin-clustering.txt.020 Cluster Node Failure :: Test sui... | FAIL |
03:08:25  Suite setup failed:
03:08:25  OSError: [Errno 16] Device or resource busy
03:08:25  
03:08:25  Also suite teardown failed:
03:08:25  Several failures occurred:
03:08:25  
03:08:25  1) Cannot open session, you need to establish a connection first.
03:08:25  
03:08:25  2) Cannot open session, you need to establish a connection first.
03:08:25  
03:08:25  3) Cannot open session, you need to establish a connection first.
03:08:25  
03:08:25  3 tests, 0 passed, 3 failed
03:08:25  ==============================================================================
03:08:25  openflowplugin-clustering.txt.030 Cluster Sync Problems :: Test suite for e...
03:08:25  ==============================================================================
03:08:25  Start Mininet To All Nodes                                            | FAIL |
03:08:25  OSError: [Errno 16] Device or resource busy
03:08:25  ------------------------------------------------------------------------------
03:08:25  Switches To Be Connected To All Nodes :: Initial check for correct... | FAIL |
03:08:39  Keyword 'Check All Switches Connected To All Cluster Nodes' failed after retrying 15 times. The last error was: Cannot open session, you need to establish a connection first.
03:08:39  ------------------------------------------------------------------------------
03:08:39  Isolating Owner Of Switch s1                                          | FAIL |
03:08:39  This test fails due to https://bugs.opendaylight.org/show_bug.cgi?id=6177
03:08:39  
03:08:39  Variable '${active_member}' not found.
03:08:39  ------------------------------------------------------------------------------
03:08:39  Switches Still Be Connected To All Nodes                              | FAIL |
03:08:53  This test fails due to https://bugs.opendaylight.org/show_bug.cgi?id=6177
03:08:53  
03:08:53  Keyword 'Check All Switches Connected To All Cluster Nodes' failed after retrying 15 times. The last error was: Cannot open session, you need to establish a connection first.
03:08:53  ------------------------------------------------------------------------------
03:08:53  Stop Mininet And Verify No Owners                                     | FAIL |
03:08:54  This test fails due to https://bugs.opendaylight.org/show_bug.cgi?id=6177
03:08:54  
03:08:54  Cannot open session, you need to establish a connection first.
03:08:54  ------------------------------------------------------------------------------
03:08:54  openflowplugin-clustering.txt.030 Cluster Sync Problems :: Test su... | FAIL |
03:08:54  5 tests, 0 passed, 5 failed
03:08:54  ==============================================================================
03:08:54  openflowplugin-clustering.txt.9145 :: Switch connections and cluster are re...
03:08:54  ==============================================================================
03:08:54  Start Mininet Multiple Connections :: Start mininet linear with co... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
03:08:54  | FAIL |
03:08:54  OSError: [Errno 16] Device or resource busy
03:08:54  ------------------------------------------------------------------------------
03:08:54  Check Entity Owner Status And Find Owner and Successor :: Check En... | FAIL |
03:09:24  This test fails due to https://bugs.opendaylight.org/show_bug.cgi?id=9145
03:09:24  
03:09:24  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 30 seconds. The last error was: Could not parse owner and candidates for device openflow:1
03:09:24  ------------------------------------------------------------------------------
03:09:24  Stop Mininet :: Stop Mininet.                                         | FAIL |
03:09:24  Variable '${mininet_conn_id}' not found.
03:09:24  ------------------------------------------------------------------------------
03:09:24  openflowplugin-clustering.txt.9145 :: Switch connections and clust... | FAIL |
03:09:24  3 tests, 0 passed, 3 failed
03:09:24  ==============================================================================
03:09:24  openflowplugin-clustering.txt                                         | FAIL |
03:09:24  209 tests, 12 passed, 197 failed
03:09:24  ==============================================================================
03:09:24  Output:  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/output.xml
03:09:25  Log:     /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/log.html
03:09:25  Report:  /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/report.html
03:09:26  + true
03:09:26  + echo 'Examining the files in data/log and checking filesize'
03:09:26  Examining the files in data/log and checking filesize
03:09:26  + ssh '' 'ls -altr /tmp/karaf-0.24.1/data/log/'
03:09:26  ssh: Could not resolve hostname : Device or resource busy
03:09:26  Build step 'Execute shell' marked build as failure
03:09:26  $ ssh-agent -k
03:09:26  unset SSH_AUTH_SOCK;
03:09:26  unset SSH_AGENT_PID;
03:09:26  echo Agent pid 3139 killed;
03:09:26  [ssh-agent] Stopped.
03:09:26  Recording plot data
03:09:26  Robot results publisher started...
03:09:26  INFO: Checking test criticality is deprecated and will be dropped in a future release!
03:09:26  -Parsing output xml:
03:09:27  Done!
03:09:27  -Copying log files to build dir:
03:09:27  Done!
03:09:27  -Assigning results to build:
03:09:27  Done!
03:09:27  -Checking thresholds:
03:09:27  Done!
03:09:27  Done publishing Robot results.
03:09:27  [PostBuildScript] - [INFO] Executing post build scripts.
03:09:27  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins9677043646139348069.sh
03:09:27  Archiving csit artifacts
03:09:27    % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
03:09:27                                   Dload  Upload   Total   Spent    Left  Speed
03:09:27  
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  947k    0  947k    0     0  2294k      0 --:--:-- --:--:-- --:--:-- 2300k
03:09:28  Archive:  robot-plugin.zip
03:09:28    inflating: ./archives/robot-plugin/log.html  
03:09:28    inflating: ./archives/robot-plugin/output.xml  
03:09:28    inflating: ./archives/robot-plugin/report.html  
03:09:28  mv: cannot stat '*.log': No such file or directory
03:09:28  mv: cannot stat '*.log.gz': No such file or directory
03:09:28  mv: cannot stat '*.csv': No such file or directory
03:09:28  mv: cannot stat '*.png': No such file or directory
03:09:28  [PostBuildScript] - [INFO] Executing post build scripts.
03:09:28  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins7755373238199707202.sh
03:09:28  [PostBuildScript] - [INFO] Executing post build scripts.
03:09:28  [EnvInject] - Injecting environment variables from a build step.
03:09:28  [EnvInject] - Injecting as environment variables the properties content 
03:09:28  OS_CLOUD=vex
03:09:28  OS_STACK_NAME=releng-openflowplugin-csit-3node-clustering-only-chromium-89
03:09:28  
03:09:28  [EnvInject] - Variables injected successfully.
03:09:28  provisioning config files...
03:09:29  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
03:09:29  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins4220160788037413280.sh
03:09:29  ---> openstack-stack-delete.sh
03:09:29  Setup pyenv:
03:09:29    system
03:09:29    3.8.20
03:09:29    3.9.20
03:09:29    3.10.15
03:09:29  * 3.11.10 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/.python-version)
03:09:29  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DeYZ from file:/tmp/.os_lf_venv
03:09:29  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
03:09:32  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 
03:10:11  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
03:10:11  python-manilaclient 6.3.0 requires osc-lib>=3.2.0, but you have osc-lib 2.2.1 which is incompatible.
03:10:11  virtualenv 21.7.12 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.0 which is incompatible.
03:10:11  lf-activate-venv(): INFO: Adding /tmp/venv-DeYZ/bin to PATH
03:10:11  INFO: Stack cost retrieval disabled, setting cost to 0
03:10:23  INFO: Deleting stack releng-openflowplugin-csit-3node-clustering-only-chromium-89
03:10:23  Successfully deleted stack releng-openflowplugin-csit-3node-clustering-only-chromium-89
03:10:23  [PostBuildScript] - [INFO] Executing post build scripts.
03:10:23  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins6440525479870038280.sh
03:10:23  ---> sysstat.sh
03:10:23  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins12829329890240066913.sh
03:10:23  ---> package-listing.sh
03:10:23  + '[' -f /etc/os-release ']'
03:10:23  + . /etc/os-release
03:10:23  ++ PRETTY_NAME='Ubuntu 24.04.4 LTS'
03:10:23  ++ NAME=Ubuntu
03:10:23  ++ VERSION_ID=24.04
03:10:23  ++ VERSION='24.04.4 LTS (Noble Numbat)'
03:10:23  ++ VERSION_CODENAME=noble
03:10:23  ++ ID=ubuntu
03:10:23  ++ ID_LIKE=debian
03:10:23  ++ HOME_URL=https://www.ubuntu.com/
03:10:23  ++ SUPPORT_URL=https://help.ubuntu.com/
03:10:23  ++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/
03:10:23  ++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy
03:10:23  ++ UBUNTU_CODENAME=noble
03:10:23  ++ LOGO=ubuntu-logo
03:10:23  + case " ${ID:-} ${ID_LIKE:-} " in
03:10:23  + OS_FAMILY=debian
03:10:23  + workspace=/w/workspace/openflowplugin-csit-3node-clustering-only-chromium
03:10:23  + START_PACKAGES=/tmp/packages_start.txt
03:10:23  + END_PACKAGES=/tmp/packages_end.txt
03:10:23  + DIFF_PACKAGES=/tmp/packages_diff.txt
03:10:23  + PACKAGES=/tmp/packages_start.txt
03:10:23  + '[' /w/workspace/openflowplugin-csit-3node-clustering-only-chromium ']'
03:10:23  + PACKAGES=/tmp/packages_end.txt
03:10:23  + case "${OS_FAMILY}" in
03:10:23  + dpkg -l
03:10:23  + grep '^ii'
03:10:23  + '[' -f /tmp/packages_start.txt ']'
03:10:23  + '[' -f /tmp/packages_end.txt ']'
03:10:23  + diff /tmp/packages_start.txt /tmp/packages_end.txt
03:10:23  + '[' /w/workspace/openflowplugin-csit-3node-clustering-only-chromium ']'
03:10:23  + mkdir -p /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/archives/
03:10:23  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/archives/
03:10:23  + exit 0
03:10:23  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins14186414772943530164.sh
03:10:23  ---> capture-instance-metadata.sh
03:10:23  Setup pyenv:
03:10:23    system
03:10:23    3.8.20
03:10:23    3.9.20
03:10:23    3.10.15
03:10:23  * 3.11.10 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/.python-version)
03:10:24  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DeYZ from file:/tmp/.os_lf_venv
03:10:24  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
03:10:26  lf-activate-venv(): INFO: Installing additional packages: lftools 
03:10:35  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
03:10:35  virtualenv 21.7.12 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.0 which is incompatible.
03:10:35  lf-activate-venv(): INFO: Adding /tmp/venv-DeYZ/bin to PATH
03:10:35  INFO: Running in OpenStack, capturing instance metadata
03:10:36  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins12889366032463910090.sh
03:10:36  provisioning config files...
03:10:36  Could not find credentials [logs] for openflowplugin-csit-3node-clustering-only-chromium #89
03:10:36  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/openflowplugin-csit-3node-clustering-only-chromium@tmp/config7538561049366938424tmp
03:10:36  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
03:10:36  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
03:10:36  provisioning config files...
03:10:37  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
03:10:37  [EnvInject] - Injecting environment variables from a build step.
03:10:37  [EnvInject] - Injecting as environment variables the properties content 
03:10:37  SERVER_ID=logs
03:10:37  
03:10:37  [EnvInject] - Variables injected successfully.
03:10:37  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins11239264860752694206.sh
03:10:37  ---> create-netrc.sh
03:10:37  WARN: Log server credential not found.
03:10:37  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins16906075893679153524.sh
03:10:37  ---> python-tools-install.sh
03:10:37  Setup pyenv:
03:10:37    system
03:10:37    3.8.20
03:10:37    3.9.20
03:10:37    3.10.15
03:10:37  * 3.11.10 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/.python-version)
03:10:37  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DeYZ from file:/tmp/.os_lf_venv
03:10:37  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
03:10:40  lf-activate-venv(): INFO: Installing additional packages: lftools 
03:10:59  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
03:10:59  virtualenv 21.7.12 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.0 which is incompatible.
03:10:59  lf-activate-venv(): INFO: Adding /tmp/venv-DeYZ/bin to PATH
03:10:59  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/sh /tmp/jenkins6114617659416534802.sh
03:10:59  ---> uv-install.sh
03:10:59  uv 0.12.16 is already installed
03:10:59  uvx 0.12.16 (x86_64-unknown-linux-gnu)
03:10:59  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins13193748520682641240.sh
03:10:59  ---> sudo-logs.sh
03:10:59  Archiving 'sudo' log..
03:10:59  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash /tmp/jenkins16815486954873348027.sh
03:10:59  ---> job-cost.sh
03:10:59  INFO: Activating Python virtual environment...
03:10:59  Setup pyenv:
03:10:59    system
03:10:59    3.8.20
03:10:59    3.9.20
03:10:59    3.10.15
03:10:59  * 3.11.10 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/.python-version)
03:10:59  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DeYZ from file:/tmp/.os_lf_venv
03:10:59  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
03:11:01  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
03:11:22  lf-activate-venv(): INFO: Adding /tmp/venv-DeYZ/bin to PATH
03:11:22  DEBUG: Contents of stack-cost file:
03:11:23  total: 0
03:11:23  INFO: Retrieving Stack Cost...
03:11:23  INFO: Stack cost: 0
03:11:23  INFO: Instance uptime: 2116s
03:11:23  INFO: Fetching instance metadata (attempt 1 of 3)...
03:11:23  DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
03:11:23  INFO: Successfully fetched instance metadata
03:11:23  INFO: Instance type: v3-standard-2
03:11:23  INFO: Retrieving pricing info for: v3-standard-2
03:11:23  INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
03:11:23  DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=2116
03:11:23  INFO: Successfully fetched Vexxhost pricing API
03:11:23  INFO: Retrieved cost: 0.06
03:11:23  INFO: Retrieved resource: v3-standard-2
03:11:23  INFO: Creating archive directory: /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/archives/cost
03:11:24  INFO: Archiving costs to: /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/archives/cost.csv
03:11:24  INFO: Successfully archived job cost data
03:11:24  DEBUG: Cost data: openflowplugin-csit-3node-clustering-only-chromium,89,2026-09-18 03:11:23,v3-standard-2,2116,0.06,0.00,FAILURE
03:11:24  [openflowplugin-csit-3node-clustering-only-chromium] $ /bin/bash -l /tmp/jenkins16051890532696947935.sh
03:11:24  ---> logs-deploy.sh
03:11:24  Setup pyenv:
03:11:24    system
03:11:24    3.8.20
03:11:24    3.9.20
03:11:24    3.10.15
03:11:24  * 3.11.10 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-chromium/.python-version)
03:11:24  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DeYZ from file:/tmp/.os_lf_venv
03:11:24  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
03:11:26  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
03:11:37  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
03:11:37  virtualenv 21.7.12 requires filelock<4,>=3.24.2; python_version >= "3.10", but you have filelock 4.0.0 which is incompatible.
03:11:37  lf-activate-venv(): INFO: Adding /tmp/venv-DeYZ/bin to PATH
03:11:37  WARNING: Nexus logging server not set
03:11:37  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/openflowplugin-csit-3node-clustering-only-chromium/89/
03:11:37  INFO: archiving logs to S3
03:11:39  ---> uname -a:
03:11:39  Linux prd-ubuntu2404-robot-2c-8g-9193 6.8.0-138-generic #138-Ubuntu SMP PREEMPT_DYNAMIC Fri Jul 31 22:41:49 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
03:11:39  
03:11:39  
03:11:39  ---> lscpu:
03:11:39  Architecture:                            x86_64
03:11:39  CPU op-mode(s):                          32-bit, 64-bit
03:11:39  Address sizes:                           40 bits physical, 48 bits virtual
03:11:39  Byte Order:                              Little Endian
03:11:39  CPU(s):                                  2
03:11:39  On-line CPU(s) list:                     0,1
03:11:39  Vendor ID:                               AuthenticAMD
03:11:39  Model name:                              AMD EPYC-Rome Processor
03:11:39  CPU family:                              23
03:11:39  Model:                                   49
03:11:39  Thread(s) per core:                      1
03:11:39  Core(s) per socket:                      1
03:11:39  Socket(s):                               2
03:11:39  Stepping:                                0
03:11:39  BogoMIPS:                                5599.99
03:11:39  Flags:                                   fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt lbrv nrip_save tsc_scale vmcb_clean flushbyasid pausefilter pfthreshold v_vmsave_vmload vgif umip rdpid arch_capabilities
03:11:39  Virtualization:                          AMD-V
03:11:39  Hypervisor vendor:                       KVM
03:11:39  Virtualization type:                     full
03:11:39  L1d cache:                               64 KiB (2 instances)
03:11:39  L1i cache:                               64 KiB (2 instances)
03:11:39  L2 cache:                                1 MiB (2 instances)
03:11:39  L3 cache:                                32 MiB (2 instances)
03:11:39  NUMA node(s):                            1
03:11:39  NUMA node0 CPU(s):                       0,1
03:11:39  Vulnerability Gather data sampling:      Not affected
03:11:39  Vulnerability Indirect target selection: Not affected
03:11:39  Vulnerability Itlb multihit:             Not affected
03:11:39  Vulnerability L1tf:                      Not affected
03:11:39  Vulnerability Mds:                       Not affected
03:11:39  Vulnerability Meltdown:                  Not affected
03:11:39  Vulnerability Mmio stale data:           Not affected
03:11:39  Vulnerability Reg file data sampling:    Not affected
03:11:39  Vulnerability Retbleed:                  Mitigation; untrained return thunk; SMT disabled
03:11:39  Vulnerability Spec rstack overflow:      Vulnerable: Safe RET, no microcode
03:11:39  Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
03:11:39  Vulnerability Spectre v1:                Mitigation; usercopy/swapgs barriers and __user pointer sanitization
03:11:39  Vulnerability Spectre v2:                Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
03:11:39  Vulnerability Srbds:                     Not affected
03:11:39  Vulnerability Tsa:                       Not affected
03:11:39  Vulnerability Tsx async abort:           Not affected
03:11:39  Vulnerability Vmscape:                   Not affected
03:11:39  
03:11:39  
03:11:39  ---> nproc:
03:11:39  2
03:11:39  
03:11:39  
03:11:39  ---> df -h:
03:11:39  Filesystem      Size  Used Avail Use% Mounted on
03:11:39  tmpfs           795M  1.1M  794M   1% /run
03:11:39  /dev/vda1        38G  8.2G   30G  22% /
03:11:39  tmpfs           3.9G     0  3.9G   0% /dev/shm
03:11:39  tmpfs           5.0M     0  5.0M   0% /run/lock
03:11:39  /dev/vda16      881M  117M  703M  15% /boot
03:11:39  /dev/vda15      105M  6.2M   99M   6% /boot/efi
03:11:39  tmpfs           795M   16K  795M   1% /run/user/1001
03:11:39  
03:11:39  
03:11:39  ---> free -m:
03:11:39                 total        used        free      shared  buff/cache   available
03:11:39  Mem:            7941         784        4943           4        2516        7157
03:11:39  Swap:           1023           0        1023
03:11:39  
03:11:39  
03:11:39  ---> ip addr:
03:11:39  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
03:11:39      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
03:11:39      inet 127.0.0.1/8 scope host lo
03:11:39         valid_lft forever preferred_lft forever
03:11:39      inet6 ::1/128 scope host noprefixroute 
03:11:39         valid_lft forever preferred_lft forever
03:11:39  2: ens3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
03:11:39      link/ether fa:16:3e:c4:76:ed brd ff:ff:ff:ff:ff:ff
03:11:39      altname enp0s3
03:11:39      inet 10.30.170.122/23 metric 100 brd 10.30.171.255 scope global dynamic ens3
03:11:39         valid_lft 84281sec preferred_lft 84281sec
03:11:39      inet6 fe80::f816:3eff:fec4:76ed/64 scope link 
03:11:39         valid_lft forever preferred_lft forever
03:11:39  
03:11:39  
03:11:39  ---> sar -b -r -n DEV:
03:11:39  Linux 6.8.0-138-generic (prd-ubuntu2404-robot-2c-8g-9193) 	09/18/26 	_x86_64_	(2 CPU)
03:11:39  
03:11:39  02:36:22     LINUX RESTART	(2 CPU)
03:11:39  
03:11:39  02:40:03          tps      rtps      wtps      dtps   bread/s   bwrtn/s   bdscd/s
03:11:39  02:50:01        11.58      1.25      9.06      1.27    109.61   1210.65    709.28
03:11:39  03:00:03         2.08      0.33      1.72      0.03     42.94    126.70      1.25
03:11:39  03:10:03         2.67      0.04      2.33      0.30      1.35    163.49     30.44
03:11:39  Average:         5.43      0.54      4.36      0.53     51.20    498.63    245.91
03:11:39  
03:11:39  02:40:03    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
03:11:39  02:50:01      5210812   7402268    364964      4.49     87424   2265052    602480      6.56    575604   2036884       364
03:11:39  03:00:03      5157632   7393796    372520      4.58     87908   2309128    805392      8.77    594468   2071380       196
03:11:39  03:10:03      5000836   7310480    454552      5.59     89124   2380336    871956      9.50    686160   2143636     48272
03:11:39  Average:      5123093   7368848    397345      4.89     88152   2318172    759943      8.28    618744   2083967     16277
03:11:39  
03:11:39  02:40:03        IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
03:11:39  02:50:01           lo      1.17      1.17      0.07      0.07      0.00      0.00      0.00      0.00
03:11:39  02:50:01         ens3      9.96      7.23     40.12      1.90      0.00      0.00      0.00      0.00
03:11:39  03:00:03           lo      1.03      1.03      0.05      0.05      0.00      0.00      0.00      0.00
03:11:39  03:00:03         ens3      1.58      1.00      3.53      0.24      0.00      0.00      0.00      0.00
03:11:39  03:10:03           lo      1.02      1.02      0.05      0.05      0.00      0.00      0.00      0.00
03:11:39  03:10:03         ens3      5.10      3.64      8.60      8.51      0.00      0.00      0.00      0.00
03:11:39  Average:           lo      1.07      1.07      0.06      0.06      0.00      0.00      0.00      0.00
03:11:39  Average:         ens3      5.54      3.95     17.36      3.55      0.00      0.00      0.00      0.00
03:11:39  
03:11:39  
03:11:39  ---> sar -P ALL:
03:11:39  Linux 6.8.0-138-generic (prd-ubuntu2404-robot-2c-8g-9193) 	09/18/26 	_x86_64_	(2 CPU)
03:11:39  
03:11:39  02:36:22     LINUX RESTART	(2 CPU)
03:11:39  
03:11:39  02:40:03        CPU     %user     %nice   %system   %iowait    %steal     %idle
03:11:39  02:50:01        all      7.00      0.00      1.01      0.24      0.03     91.72
03:11:39  02:50:01          0      7.66      0.00      1.01      0.25      0.03     91.06
03:11:39  02:50:01          1      6.34      0.00      1.01      0.24      0.03     92.38
03:11:39  03:00:03        all      1.61      0.00      0.37      0.02      0.02     97.99
03:11:39  03:00:03          0      2.31      0.00      0.41      0.01      0.02     97.25
03:11:39  03:00:03          1      0.91      0.00      0.33      0.04      0.01     98.72
03:11:39  03:10:03        all      2.53      0.00      0.31      0.16      0.02     96.98
03:11:39  03:10:03          0      4.26      0.00      0.36      0.07      0.02     95.29
03:11:39  03:10:03          1      0.81      0.00      0.25      0.25      0.01     98.68
03:11:39  Average:        all      3.71      0.00      0.56      0.14      0.02     95.57
03:11:39  Average:          0      4.74      0.00      0.59      0.11      0.02     94.54
03:11:39  Average:          1      2.68      0.00      0.53      0.18      0.02     96.60
03:11:39  
03:11:39  
03:11:39