23:28:57  Started by upstream project "integration-distribution-mri-test-chromium" build number 17
23:28:57  originally caused by:
23:28:57   Started by timer
23:28:57  Running as SYSTEM
23:28:57  [EnvInject] - Loading node environment variables.
23:28:57  Building remotely on prd-ubuntu2404-robot-2c-8g-19386 (ubuntu2404-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-ask-all-chromium
23:28:58  [ssh-agent] Looking for ssh-agent implementation...
23:28:58  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
23:28:58  $ ssh-agent
23:28:58  SSH_AUTH_SOCK=/tmp/ssh-XK914EQvkYJ2/agent.3981
23:28:58  SSH_AGENT_PID=3983
23:28:58  [ssh-agent] Started.
23:28:58  Running ssh-add (command line suppressed)
23:28:58  Identity added: /w/workspace/controller-csit-3node-clustering-ask-all-chromium@tmp/private_key_5022174770674366402.key (/w/workspace/controller-csit-3node-clustering-ask-all-chromium@tmp/private_key_5022174770674366402.key)
23:28:58  [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
23:28:58  The recommended git tool is: NONE
23:29:00  using credential opendaylight-jenkins-ssh
23:29:00  Wiping out workspace first.
23:29:00  Cloning the remote Git repository
23:29:00  Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
23:29:00   > git init /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test # timeout=10
23:29:00  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
23:29:00   > git --version # timeout=10
23:29:00   > git --version # 'git version 2.43.0'
23:29:00  using GIT_SSH to set credentials Release Engineering Jenkins Key
23:29:00  Verifying host key using known hosts file, will automatically accept unseen keys
23:29:00   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
23:29:03   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
23:29:03   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
23:29:03   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
23:29:03  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
23:29:03  using GIT_SSH to set credentials Release Engineering Jenkins Key
23:29:03  Verifying host key using known hosts file, will automatically accept unseen keys
23:29:03   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
23:29:04   > git rev-parse FETCH_HEAD^{commit} # timeout=10
23:29:04  Checking out Revision 901c7e139945b436d95a44b3b592904c3d7a4f9f (origin/master)
23:29:04   > git config core.sparsecheckout # timeout=10
23:29:04   > git checkout -f 901c7e139945b436d95a44b3b592904c3d7a4f9f # timeout=10
23:29:04  Commit message: "Adapt updater.py to use new lsp-flags container"
23:29:04   > git rev-parse FETCH_HEAD^{commit} # timeout=10
23:29:04   > git rev-list --no-walk f65244a2a093016c71f9a7a564be7d086941e15c # timeout=10
23:29:04  No emails were triggered.
23:29:04  provisioning config files...
23:29:04  copy managed file [npmrc] to file:/home/jenkins/.npmrc
23:29:04  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
23:29:05  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
23:29:05  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins7421591984655709420.sh
23:29:05  ---> python-tools-install.sh
23:29:05  Setup pyenv:
23:29:05  * system (set by /opt/pyenv/version)
23:29:05  * 3.8.20 (set by /opt/pyenv/version)
23:29:05  * 3.9.20 (set by /opt/pyenv/version)
23:29:05    3.10.15
23:29:05    3.11.10
23:29:09  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-7P4t
23:29:09  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
23:29:09  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:29:09  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:29:14  lf-activate-venv(): INFO: Base packages installed successfully
23:29:14  lf-activate-venv(): INFO: Installing additional packages: lftools 
23:29:38  lf-activate-venv(): INFO: Adding /tmp/venv-7P4t/bin to PATH
23:29:38  Generating Requirements File
23:30:02  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
23:30:02  httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
23:30:02  Python 3.11.10
23:30:03  pip 26.1.1 from /tmp/venv-7P4t/lib/python3.11/site-packages/pip (python 3.11)
23:30:03  aiohappyeyeballs==2.6.2
23:30:03  aiohttp==3.13.5
23:30:03  aiosignal==1.4.0
23:30:03  appdirs==1.4.4
23:30:03  argcomplete==3.6.3
23:30:03  aspy.yaml==1.3.0
23:30:03  attrs==26.1.0
23:30:03  autopage==0.6.0
23:30:03  beautifulsoup4==4.14.3
23:30:03  boto3==1.43.14
23:30:03  botocore==1.43.14
23:30:03  bs4==0.0.2
23:30:03  certifi==2026.5.20
23:30:03  cffi==2.0.0
23:30:03  cfgv==3.5.0
23:30:03  chardet==7.4.3
23:30:03  charset-normalizer==3.4.7
23:30:03  click==8.4.1
23:30:03  cliff==4.14.0
23:30:03  cmd2==3.5.1
23:30:03  cryptography==3.3.2
23:30:03  debtcollector==3.1.0
23:30:03  decorator==5.3.1
23:30:03  defusedxml==0.7.1
23:30:03  Deprecated==1.3.1
23:30:03  distlib==0.4.0
23:30:03  dnspython==2.8.0
23:30:03  docker==7.1.0
23:30:03  dogpile.cache==1.5.0
23:30:03  durationpy==0.10
23:30:03  email-validator==2.3.0
23:30:03  filelock==3.29.0
23:30:03  frozenlist==1.8.0
23:30:03  future==1.0.0
23:30:03  gitdb==4.0.12
23:30:03  GitPython==3.1.50
23:30:03  httplib2==0.30.2
23:30:03  identify==2.6.19
23:30:03  idna==3.16
23:30:03  importlib-resources==1.5.0
23:30:03  iso8601==2.1.0
23:30:03  Jinja2==3.1.6
23:30:03  jmespath==1.1.0
23:30:03  jsonpatch==1.33
23:30:03  jsonpointer==3.1.1
23:30:03  jsonschema==4.26.0
23:30:03  jsonschema-specifications==2025.9.1
23:30:03  keystoneauth1==5.14.0
23:30:03  kubernetes==36.0.0
23:30:03  lftools==0.37.22
23:30:03  lxml==6.1.1
23:30:03  markdown-it-py==4.2.0
23:30:03  MarkupSafe==3.0.3
23:30:03  mdurl==0.1.2
23:30:03  msgpack==1.1.2
23:30:03  multi_key_dict==2.0.3
23:30:03  multidict==6.7.1
23:30:03  munch==4.0.0
23:30:03  netaddr==1.3.0
23:30:03  niet==1.4.2
23:30:03  nodeenv==1.10.0
23:30:03  oauth2client==4.1.3
23:30:03  oauthlib==3.3.1
23:30:03  openstacksdk==4.13.0
23:30:03  os-service-types==1.8.2
23:30:03  osc-lib==4.6.0
23:30:03  oslo.config==10.4.0
23:30:03  oslo.context==6.4.0
23:30:03  oslo.i18n==6.8.0
23:30:03  oslo.log==8.2.0
23:30:03  oslo.serialization==5.10.0
23:30:03  oslo.utils==10.0.1
23:30:03  packaging==26.2
23:30:03  pbr==7.0.3
23:30:03  platformdirs==4.9.6
23:30:03  prettytable==3.17.0
23:30:03  propcache==0.5.2
23:30:03  psutil==7.2.2
23:30:03  pyasn1==0.6.3
23:30:03  pyasn1_modules==0.4.2
23:30:03  pycparser==3.0
23:30:03  pygerrit2==2.0.15
23:30:03  PyGithub==2.9.1
23:30:03  Pygments==2.20.0
23:30:03  PyJWT==2.13.0
23:30:03  PyNaCl==1.6.2
23:30:03  pyparsing==2.4.7
23:30:03  pyperclip==1.11.0
23:30:03  pyrsistent==0.20.0
23:30:03  python-cinderclient==9.9.0
23:30:03  python-dateutil==2.9.0.post0
23:30:03  python-discovery==1.3.1
23:30:03  python-heatclient==5.2.0
23:30:03  python-jenkins==1.8.3
23:30:03  python-keystoneclient==5.8.0
23:30:03  python-magnumclient==4.10.0
23:30:03  python-openstackclient==10.0.0
23:30:03  python-swiftclient==4.10.0
23:30:03  PyYAML==6.0.3
23:30:03  referencing==0.37.0
23:30:03  requests==2.34.2
23:30:03  requests-oauthlib==2.0.0
23:30:03  rfc3986==2.0.0
23:30:03  rich==15.0.0
23:30:03  rich-argparse==1.8.0
23:30:03  rpds-py==0.30.0
23:30:03  rsa==4.9.1
23:30:03  ruamel.yaml==0.19.1
23:30:03  ruamel.yaml.clib==0.2.15
23:30:03  s3transfer==0.17.0
23:30:03  simplejson==4.1.1
23:30:03  six==1.17.0
23:30:03  smmap==5.0.3
23:30:03  soupsieve==2.8.3
23:30:03  stevedore==5.8.0
23:30:03  tabulate==0.10.0
23:30:03  toml==0.10.2
23:30:03  tomlkit==0.15.0
23:30:03  tqdm==4.67.3
23:30:03  typing_extensions==4.15.0
23:30:03  urllib3==1.26.20
23:30:03  virtualenv==21.3.3
23:30:03  wcwidth==0.7.0
23:30:03  websocket-client==1.9.0
23:30:03  wrapt==2.2.1
23:30:03  xdg==6.0.0
23:30:03  xmltodict==1.0.4
23:30:03  yarl==1.24.2
23:30:03  yq==3.4.3
23:30:03  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/sh /tmp/jenkins1707064263133593579.sh
23:30:03  ---> uv-install.sh
23:30:03  Installing uv/uvx (latest) using shell installer
23:30:03  2026-05-23 23:30:03 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71233/71233] -> "/tmp/uv-install-WKSWyk.sh" [1]
23:30:03  downloading uv 0.11.16 x86_64-unknown-linux-gnu
23:30:04  installing to /home/jenkins/.local/bin
23:30:04    uv
23:30:04    uvx
23:30:04  everything's installed!
23:30:04  
23:30:04  To add $HOME/.local/bin to your PATH, either restart your shell or run:
23:30:04  
23:30:04      source $HOME/.local/bin/env (sh, bash, zsh)
23:30:04      source $HOME/.local/bin/env.fish (fish)
23:30:04  Adding install location to PATH
23:30:04  ---> Validating uv/uvx install
23:30:04  uvx 0.11.16 (x86_64-unknown-linux-gnu)
23:30:04  [EnvInject] - Injecting environment variables from a build step.
23:30:04  [EnvInject] - Injecting as environment variables the properties content 
23:30:04  OS_STACK_TEMPLATE=csit-2-instance-type.yaml
23:30:04  OS_CLOUD=vex
23:30:04  OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-chromium-11
23:30:04  OS_STACK_TEMPLATE_DIR=openstack-hot
23:30:04  
23:30:04  [EnvInject] - Variables injected successfully.
23:30:04  provisioning config files...
23:30:05  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
23:30:05  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins4642367812056031957.sh
23:30:05  ---> Create parameters file for OpenStack HOT
23:30:05  OpenStack Heat parameters generated
23:30:05  -----------------------------------
23:30:05  parameters:
23:30:05      vm_0_count: '3'
23:30:05      vm_0_flavor: 'v3-standard-4'
23:30:05      vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260401-010115.623'
23:30:05      vm_1_count: '0'
23:30:05      vm_1_flavor: 'v3-standard-2'
23:30:05      vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654'
23:30:05      
23:30:05      job_name: '36847-11'
23:30:05      silo: 'releng'
23:30:05  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash -l /tmp/jenkins3863479802357677711.sh
23:30:05  ---> Create HEAT stack
23:30:05  + source /home/jenkins/lf-env.sh
23:30:05  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
23:30:05  ++ mktemp -d /tmp/venv-XXXX
23:30:05  + lf_venv=/tmp/venv-iRkV
23:30:05  + local venv_file=/tmp/.os_lf_venv
23:30:05  + local python=python3
23:30:05  + local options
23:30:05  + local set_path=true
23:30:05  + local install_args=
23:30:05  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
23:30:05  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
23:30:05  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
23:30:05  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
23:30:05  + true
23:30:05  + case $1 in
23:30:05  + python=python3
23:30:05  + shift 2
23:30:05  + true
23:30:05  + case $1 in
23:30:05  + shift
23:30:05  + break
23:30:05  + case $python in
23:30:05  + local pkg_list=
23:30:05  + [[ -d /opt/pyenv ]]
23:30:05  + echo 'Setup pyenv:'
23:30:05  Setup pyenv:
23:30:05  + export PYENV_ROOT=/opt/pyenv
23:30:05  + PYENV_ROOT=/opt/pyenv
23:30:05  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
23:30:05  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
23:30:05  + pyenv versions
23:30:05    system
23:30:05    3.8.20
23:30:05    3.9.20
23:30:05    3.10.15
23:30:05  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-ask-all-chromium/.python-version)
23:30:05  + command -v pyenv
23:30:05  ++ pyenv init - --no-rehash
23:30:05  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
23:30:05  for i in ${!paths[@]}; do 
23:30:05  if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
23:30:05  fi; done; 
23:30:05  echo "${paths[*]}"'\'')"
23:30:05  export PATH="/opt/pyenv/shims:${PATH}"
23:30:05  export PYENV_SHELL=bash
23:30:05  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
23:30:05  pyenv() {
23:30:05    local command
23:30:05    command="${1:-}"
23:30:05    if [ "$#" -gt 0 ]; then
23:30:05      shift
23:30:05    fi
23:30:05  
23:30:05    case "$command" in
23:30:05    rehash|shell)
23:30:05      eval "$(pyenv "sh-$command" "$@")"
23:30:05      ;;
23:30:05    *)
23:30:05      command pyenv "$command" "$@"
23:30:05      ;;
23:30:05    esac
23:30:05  }'
23:30:05  +++ bash --norc -ec 'IFS=:; paths=($PATH); 
23:30:05  for i in ${!paths[@]}; do 
23:30:05  if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
23:30:05  fi; done; 
23:30:05  echo "${paths[*]}"'
23:30:05  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
23:30:05  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
23:30:05  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
23:30:05  ++ export PYENV_SHELL=bash
23:30:05  ++ PYENV_SHELL=bash
23:30:05  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
23:30:05  +++ complete -F _pyenv pyenv
23:30:05  ++ lf-pyver python3
23:30:05  ++ local py_version_xy=python3
23:30:05  ++ local py_version_xyz=
23:30:05  ++ pyenv versions
23:30:05  ++ local command
23:30:05  ++ command=versions
23:30:05  ++ '[' 1 -gt 0 ']'
23:30:05  ++ shift
23:30:05  ++ case "$command" in
23:30:05  ++ command pyenv versions
23:30:05  ++ sed 's/^[ *]* //'
23:30:05  ++ awk '{ print $1 }'
23:30:05  ++ grep -E '^[0-9.]*[0-9]$'
23:30:05  ++ [[ ! -s /tmp/.pyenv_versions ]]
23:30:05  +++ grep '^3' /tmp/.pyenv_versions
23:30:05  +++ sort -V
23:30:05  +++ tail -n 1
23:30:05  ++ py_version_xyz=3.11.10
23:30:05  ++ [[ -z 3.11.10 ]]
23:30:05  ++ echo 3.11.10
23:30:05  ++ return 0
23:30:05  + pyenv local 3.11.10
23:30:05  + local command
23:30:05  + command=local
23:30:05  + '[' 2 -gt 0 ']'
23:30:05  + shift
23:30:05  + case "$command" in
23:30:05  + command pyenv local 3.11.10
23:30:05  + for arg in "$@"
23:30:05  + case $arg in
23:30:05  + pkg_list+='lftools[openstack] '
23:30:05  + for arg in "$@"
23:30:05  + case $arg in
23:30:05  + pkg_list+='kubernetes '
23:30:05  + for arg in "$@"
23:30:05  + case $arg in
23:30:05  + pkg_list+='niet '
23:30:05  + for arg in "$@"
23:30:05  + case $arg in
23:30:05  + pkg_list+='python-heatclient '
23:30:05  + for arg in "$@"
23:30:05  + case $arg in
23:30:05  + pkg_list+='python-openstackclient '
23:30:05  + for arg in "$@"
23:30:05  + case $arg in
23:30:05  + pkg_list+='python-magnumclient '
23:30:05  + for arg in "$@"
23:30:05  + case $arg in
23:30:05  + pkg_list+='urllib3~=1.26.15 '
23:30:05  + for arg in "$@"
23:30:05  + case $arg in
23:30:05  + pkg_list+='yq '
23:30:05  + [[ -f /tmp/.os_lf_venv ]]
23:30:05  ++ cat /tmp/.os_lf_venv
23:30:05  + lf_venv=/tmp/venv-7P4t
23:30:05  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7P4t from' file:/tmp/.os_lf_venv
23:30:05  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7P4t from file:/tmp/.os_lf_venv
23:30:05  + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
23:30:05  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:30:05  + local 'pip_opts=--upgrade --quiet'
23:30:05  + pip_opts='--upgrade --quiet --trusted-host pypi.org'
23:30:05  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
23:30:05  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
23:30:05  + [[ -n '' ]]
23:30:05  + [[ -n '' ]]
23:30:05  + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
23:30:05  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:30:05  + /tmp/venv-7P4t/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
23:30:07  + echo 'lf-activate-venv(): INFO: Base packages installed successfully'
23:30:07  lf-activate-venv(): INFO: Base packages installed successfully
23:30:07  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq  ]]
23:30:07  + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq '
23:30:07  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
23:30:07  + /tmp/venv-7P4t/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
23:30:25  + type python3
23:30:25  + true
23:30:25  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-7P4t/bin to PATH'
23:30:25  lf-activate-venv(): INFO: Adding /tmp/venv-7P4t/bin to PATH
23:30:25  + PATH=/tmp/venv-7P4t/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
23:30:25  + return 0
23:30:25  + openstack --os-cloud vex limits show --absolute
23:30:27  +--------------------------+---------+
23:30:27  | Name                     |   Value |
23:30:27  +--------------------------+---------+
23:30:27  | maxTotalInstances        |      -1 |
23:30:27  | maxTotalCores            |     450 |
23:30:27  | maxTotalRAMSize          | 1000000 |
23:30:27  | maxServerMeta            |     128 |
23:30:27  | maxImageMeta             |     128 |
23:30:27  | maxPersonality           |       5 |
23:30:27  | maxPersonalitySize       |   10240 |
23:30:27  | maxTotalKeypairs         |     100 |
23:30:27  | maxServerGroups          |      10 |
23:30:27  | maxServerGroupMembers    |      10 |
23:30:27  | maxTotalFloatingIps      |      -1 |
23:30:27  | maxSecurityGroups        |      -1 |
23:30:27  | maxSecurityGroupRules    |      -1 |
23:30:27  | totalRAMUsed             |  246784 |
23:30:27  | totalCoresUsed           |      61 |
23:30:27  | totalInstancesUsed       |      26 |
23:30:27  | totalFloatingIpsUsed     |       0 |
23:30:27  | totalSecurityGroupsUsed  |       0 |
23:30:27  | totalServerGroupsUsed    |       0 |
23:30:27  | maxTotalVolumes          |      -1 |
23:30:27  | maxTotalSnapshots        |      10 |
23:30:27  | maxTotalVolumeGigabytes  |    4096 |
23:30:27  | maxTotalBackups          |      10 |
23:30:27  | maxTotalBackupGigabytes  |    1000 |
23:30:27  | totalVolumesUsed         |       1 |
23:30:27  | totalGigabytesUsed       |      20 |
23:30:27  | totalSnapshotsUsed       |       0 |
23:30:27  | totalBackupsUsed         |       0 |
23:30:27  | totalBackupGigabytesUsed |       0 |
23:30:27  +--------------------------+---------+
23:30:27  + pushd /opt/ciman/openstack-hot
23:30:27  /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-ask-all-chromium
23:30:27  + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-ask-all-chromium-11 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-ask-all-chromium/stack-parameters.yaml
23:30:54  Creating stack releng-controller-csit-3node-clustering-ask-all-chromium-11
23:30:54  Waiting to initialize infrastructure...
23:30:54  Stack initialization successful.
23:30:54  ------------------------------------
23:30:54  Stack Details
23:30:54  ------------------------------------
23:30:54  {'added': None,
23:30:54   'capabilities': [],
23:30:54   'created_at': '2026-05-23T23:30:31Z',
23:30:54   'deleted': None,
23:30:54   'deleted_at': None,
23:30:54   'description': 'No description',
23:30:54   'environment': None,
23:30:54   'environment_files': None,
23:30:54   'files': None,
23:30:54   'files_container': None,
23:30:54   'id': '7ec76d7a-0e44-4580-8ef5-aaec4ed28b7d',
23:30:54   'is_rollback_disabled': True,
23:30:54   'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-ask-all-chromium-11/7ec76d7a-0e44-4580-8ef5-aaec4ed28b7d',
23:30:54              'rel': 'self'}],
23:30:54   'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
23:30:54   'name': 'releng-controller-csit-3node-clustering-ask-all-chromium-11',
23:30:54   'notification_topics': [],
23:30:54   'outputs': [{'description': 'IP addresses of the 1st vm types',
23:30:54                'output_key': 'vm_0_ips',
23:30:54                'output_value': ['10.30.171.74',
23:30:54                                 '10.30.171.136',
23:30:54                                 '10.30.170.57']},
23:30:54               {'description': 'IP addresses of the 2nd vm types',
23:30:54                'output_key': 'vm_1_ips',
23:30:54                'output_value': []}],
23:30:54   'owner_id': ****,
23:30:54   'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
23:30:54                  'OS::stack_id': '7ec76d7a-0e44-4580-8ef5-aaec4ed28b7d',
23:30:54                  'OS::stack_name': 'releng-controller-csit-3node-clustering-ask-all-chromium-11',
23:30:54                  'job_name': '36847-11',
23:30:54                  'silo': 'releng',
23:30:54                  'vm_0_count': '3',
23:30:54                  'vm_0_flavor': 'v3-standard-4',
23:30:54                  'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - '
23:30:54                                '20260401-010115.623',
23:30:54                  'vm_1_count': '0',
23:30:54                  'vm_1_flavor': 'v3-standard-2',
23:30:54                  'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 '
23:30:54                                '- 20250917-133034.654'},
23:30:54   'parent_id': None,
23:30:54   'replaced': None,
23:30:54   'status': 'CREATE_COMPLETE',
23:30:54   'status_reason': 'Stack CREATE completed successfully',
23:30:54   'tags': [],
23:30:54   'template': None,
23:30:54   'template_description': 'No description',
23:30:54   'template_url': None,
23:30:54   'timeout_mins': 15,
23:30:54   'unchanged': None,
23:30:54   'updated': None,
23:30:54   'updated_at': None,
23:30:54   'user_project_id': '3c44b7d56ad847689b4f0391b1ab2fcc'}
23:30:54  ------------------------------------
23:30:55  + popd
23:30:55  /w/workspace/controller-csit-3node-clustering-ask-all-chromium
23:30:55  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash -l /tmp/jenkins7540579691647165689.sh
23:30:55  ---> Copy SSH public keys to CSIT lab
23:30:55  Setup pyenv:
23:30:55    system
23:30:55    3.8.20
23:30:55    3.9.20
23:30:55    3.10.15
23:30:55  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-ask-all-chromium/.python-version)
23:30:55  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7P4t from file:/tmp/.os_lf_venv
23:30:55  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:30:55  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:30:57  lf-activate-venv(): INFO: Base packages installed successfully
23:30:57  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 
23:31:12  lf-activate-venv(): INFO: Adding /tmp/venv-7P4t/bin to PATH
23:31:14  SSH not responding on 10.30.171.136. Retrying in 10 seconds...
23:31:14  SSH not responding on 10.30.171.74. Retrying in 10 seconds...
23:31:14  SSH not responding on 10.30.170.57. Retrying in 10 seconds...
23:31:24  Ping to 10.30.171.136 successful.
23:31:24  Ping to 10.30.171.74 successful.
23:31:24  Ping to 10.30.170.57 successful.
23:31:25  SSH not responding on 10.30.171.136. Retrying in 10 seconds...
23:31:25  SSH not responding on 10.30.170.57. Retrying in 10 seconds...
23:31:25  SSH not responding on 10.30.171.74. Retrying in 10 seconds...
23:31:35  Ping to 10.30.171.136 successful.
23:31:35  Ping to 10.30.170.57 successful.
23:31:35  Ping to 10.30.171.74 successful.
23:31:36  SSH not responding on 10.30.171.136. Retrying in 10 seconds...
23:31:36  SSH not responding on 10.30.171.74. Retrying in 10 seconds...
23:31:39  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
23:31:40   releng-36847-11-0-builder-2
23:31:40  Successfully copied public keys to slave 10.30.170.57
23:31:46  Ping to 10.30.171.136 successful.
23:31:46  Ping to 10.30.171.74 successful.
23:31:47  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
23:31:47  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
23:31:48   releng-36847-11-0-builder-1
23:31:48   releng-36847-11-0-builder-0
23:31:48  Successfully copied public keys to slave 10.30.171.136
23:31:48  Successfully copied public keys to slave 10.30.171.74
23:31:48  Process 4925 ready.
23:31:48  Process 4926 ready.
23:31:48  Process 4927 ready.
23:31:48  SSH ready on all stack servers.
23:31:48  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash -l /tmp/jenkins11430205529431632906.sh
23:31:48  Setup pyenv:
23:31:48    system
23:31:48    3.8.20
23:31:48    3.9.20
23:31:48    3.10.15
23:31:48  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-ask-all-chromium/.python-version)
23:31:52  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-KJLs
23:31:52  lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-ask-all-chromium/.robot_venv
23:31:52  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:31:52  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:31:56  lf-activate-venv(): INFO: Base packages installed successfully
23:31:56  lf-activate-venv(): INFO: Installing additional packages: setuptools wheel 
23:31:58  lf-activate-venv(): INFO: Adding /tmp/venv-KJLs/bin to PATH
23:31:58  + echo 'Installing Python Requirements'
23:31:58  Installing Python Requirements
23:31:58  + cat
23:31:58  + python -m pip install -r requirements.txt
23:31:58  Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
23:31:58  Collecting docker-py (from -r requirements.txt (line 1))
23:31:58    Downloading docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
23:31:58  Collecting ipaddr (from -r requirements.txt (line 2))
23:31:58    Downloading ipaddr-2.2.0.tar.gz (26 kB)
23:31:59    Installing build dependencies: started
23:31:59    Installing build dependencies: finished with status 'done'
23:31:59    Getting requirements to build wheel: started
23:32:00    Getting requirements to build wheel: finished with status 'done'
23:32:00    Preparing metadata (pyproject.toml): started
23:32:00    Preparing metadata (pyproject.toml): finished with status 'done'
23:32:00  Collecting netaddr (from -r requirements.txt (line 3))
23:32:00    Using cached netaddr-1.3.0-py3-none-any.whl (2.3 MB)
23:32:00  Collecting netifaces (from -r requirements.txt (line 4))
23:32:00    Downloading netifaces-0.11.0.tar.gz (30 kB)
23:32:00    Installing build dependencies: started
23:32:01    Installing build dependencies: finished with status 'done'
23:32:01    Getting requirements to build wheel: started
23:32:01    Getting requirements to build wheel: finished with status 'done'
23:32:01    Preparing metadata (pyproject.toml): started
23:32:02    Preparing metadata (pyproject.toml): finished with status 'done'
23:32:02  Collecting pyhocon (from -r requirements.txt (line 5))
23:32:02    Downloading pyhocon-0.3.63.tar.gz (307 kB)
23:32:02    Installing build dependencies: started
23:32:03    Installing build dependencies: finished with status 'done'
23:32:03    Getting requirements to build wheel: started
23:32:03    Getting requirements to build wheel: finished with status 'done'
23:32:03    Preparing metadata (pyproject.toml): started
23:32:03    Preparing metadata (pyproject.toml): finished with status 'done'
23:32:03  Collecting requests (from -r requirements.txt (line 6))
23:32:03    Using cached requests-2.34.2-py3-none-any.whl (73 kB)
23:32:03  Collecting robotframework (from -r requirements.txt (line 7))
23:32:03    Downloading robotframework-7.4.2-py3-none-any.whl (807 kB)
23:32:03       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 807.1/807.1 kB 24.5 MB/s  0:00:00
23:32:03  Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
23:32:03    Downloading robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
23:32:03    Installing build dependencies: started
23:32:04    Installing build dependencies: finished with status 'done'
23:32:04    Getting requirements to build wheel: started
23:32:05    Getting requirements to build wheel: finished with status 'done'
23:32:05    Preparing metadata (pyproject.toml): started
23:32:05    Preparing metadata (pyproject.toml): finished with status 'done'
23:32:05  Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
23:32:05    Downloading robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
23:32:05  Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
23:32:05    Downloading robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
23:32:05  Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
23:32:05    Downloading robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
23:32:05    Installing build dependencies: started
23:32:06    Installing build dependencies: finished with status 'done'
23:32:06    Getting requirements to build wheel: started
23:32:06    Getting requirements to build wheel: finished with status 'done'
23:32:06    Preparing metadata (pyproject.toml): started
23:32:07    Preparing metadata (pyproject.toml): finished with status 'done'
23:32:07  Collecting scapy (from -r requirements.txt (line 12))
23:32:07    Downloading scapy-2.7.0-py3-none-any.whl (2.6 MB)
23:32:07       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 48.3 MB/s  0:00:00
23:32:07  Collecting jsonpath-rw (from -r requirements.txt (line 15))
23:32:07    Downloading jsonpath-rw-1.4.0.tar.gz (13 kB)
23:32:07    Installing build dependencies: started
23:32:08    Installing build dependencies: finished with status 'done'
23:32:08    Getting requirements to build wheel: started
23:32:08    Getting requirements to build wheel: finished with status 'done'
23:32:08    Preparing metadata (pyproject.toml): started
23:32:08    Preparing metadata (pyproject.toml): finished with status 'done'
23:32:08  Collecting elasticsearch (from -r requirements.txt (line 18))
23:32:08    Downloading elasticsearch-9.4.0-py3-none-any.whl (992 kB)
23:32:08       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 992.7/992.7 kB 39.9 MB/s  0:00:00
23:32:08  Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
23:32:08    Downloading elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB)
23:32:08  Collecting pyangbind (from -r requirements.txt (line 22))
23:32:08    Downloading pyangbind-0.8.7-py3-none-any.whl (52 kB)
23:32:09  Collecting isodate (from -r requirements.txt (line 25))
23:32:09    Downloading isodate-0.7.2-py3-none-any.whl (22 kB)
23:32:09  Collecting jmespath (from -r requirements.txt (line 28))
23:32:09    Using cached jmespath-1.1.0-py3-none-any.whl (20 kB)
23:32:09  Collecting jsonpatch (from -r requirements.txt (line 31))
23:32:09    Using cached jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
23:32:09  Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
23:32:09    Downloading paramiko-5.0.0-py3-none-any.whl (208 kB)
23:32:09  Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
23:32:09    Downloading scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
23:32:09  Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
23:32:09    Downloading docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
23:32:09  Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
23:32:09    Using cached six-1.17.0-py2.py3-none-any.whl (11 kB)
23:32:09  Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
23:32:09    Using cached websocket_client-1.9.0-py3-none-any.whl (82 kB)
23:32:09  Collecting pyparsing>=3.0.0 (from pyhocon->-r requirements.txt (line 5))
23:32:09    Using cached pyparsing-3.3.2-py3-none-any.whl (122 kB)
23:32:09  Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
23:32:09    Using cached charset_normalizer-3.4.7-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (214 kB)
23:32:09  Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
23:32:09    Using cached idna-3.16-py3-none-any.whl (74 kB)
23:32:09  Collecting urllib3<3,>=1.26 (from requests->-r requirements.txt (line 6))
23:32:09    Using cached urllib3-2.7.0-py3-none-any.whl (131 kB)
23:32:09  Collecting certifi>=2023.5.7 (from requests->-r requirements.txt (line 6))
23:32:09    Using cached certifi-2026.5.20-py3-none-any.whl (134 kB)
23:32:09  Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
23:32:09    Downloading webtest-3.0.7-py3-none-any.whl (32 kB)
23:32:09  Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
23:32:09    Using cached jsonpointer-3.1.1-py3-none-any.whl (7.7 kB)
23:32:10  Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
23:32:10    Downloading robotframework_seleniumlibrary-6.9.0-py3-none-any.whl (105 kB)
23:32:10  Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
23:32:10    Downloading ply-3.11-py2.py3-none-any.whl (49 kB)
23:32:10  Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
23:32:10    Using cached decorator-5.3.1-py3-none-any.whl (10 kB)
23:32:10  Collecting anyio (from elasticsearch->-r requirements.txt (line 18))
23:32:10    Downloading anyio-4.13.0-py3-none-any.whl (114 kB)
23:32:10  Collecting elastic-transport<10,>=9.2.0 (from elasticsearch->-r requirements.txt (line 18))
23:32:10    Downloading elastic_transport-9.4.0-py3-none-any.whl (65 kB)
23:32:10  Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18))
23:32:10    Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
23:32:10  Collecting sniffio (from elasticsearch->-r requirements.txt (line 18))
23:32:10    Downloading sniffio-1.3.1-py3-none-any.whl (10 kB)
23:32:10  Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18))
23:32:10    Using cached typing_extensions-4.15.0-py3-none-any.whl (44 kB)
23:32:10  Collecting elasticsearch (from -r requirements.txt (line 18))
23:32:10    Downloading elasticsearch-8.19.3-py3-none-any.whl (952 kB)
23:32:10       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 952.8/952.8 kB 33.3 MB/s  0:00:00
23:32:10  INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while.
23:32:10  Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
23:32:10    Downloading elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB)
23:32:10    Downloading elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB)
23:32:10    Downloading elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB)
23:32:10    Downloading elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB)
23:32:10  Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
23:32:10    Downloading elastic_transport-8.17.1-py3-none-any.whl (64 kB)
23:32:10  Collecting pyang (from pyangbind->-r requirements.txt (line 22))
23:32:10    Downloading pyang-2.7.1-py2.py3-none-any.whl (598 kB)
23:32:10       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 22.3 MB/s  0:00:00
23:32:11  Collecting lxml (from pyangbind->-r requirements.txt (line 22))
23:32:11    Using cached lxml-6.1.1-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB)
23:32:12  Collecting regex (from pyangbind->-r requirements.txt (line 22))
23:32:12    Downloading regex-2026.5.9-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (799 kB)
23:32:12       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 799.8/799.8 kB 34.3 MB/s  0:00:00
23:32:12  Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
23:32:12    Downloading enum34-1.1.10-py3-none-any.whl (11 kB)
23:32:12  Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
23:32:12    Downloading bcrypt-5.0.0-cp39-abi3-manylinux_2_34_x86_64.whl (278 kB)
23:32:12  Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
23:32:12    Using cached cryptography-48.0.0-cp311-abi3-manylinux_2_34_x86_64.whl (4.7 MB)
23:32:13  Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
23:32:13    Downloading invoke-3.0.3-py3-none-any.whl (160 kB)
23:32:13  Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
23:32:13    Using cached pynacl-1.6.2-cp38-abi3-manylinux_2_34_x86_64.whl (1.4 MB)
23:32:13  Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
23:32:13    Using cached cffi-2.0.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (215 kB)
23:32:13  Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
23:32:13    Using cached pycparser-3.0-py3-none-any.whl (48 kB)
23:32:13  Collecting selenium>=4.25.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
23:32:13    Downloading selenium-4.44.0-py3-none-any.whl (9.7 MB)
23:32:13       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.7/9.7 MB 65.3 MB/s  0:00:00
23:32:13  Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
23:32:13    Downloading robotframework_pythonlibcore-4.6.0-py3-none-any.whl (20 kB)
23:32:13  Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
23:32:13    Using cached click-8.4.1-py3-none-any.whl (116 kB)
23:32:13  Collecting trio<1.0,>=0.31.0 (from selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
23:32:13    Downloading trio-0.33.0-py3-none-any.whl (510 kB)
23:32:13  Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
23:32:13    Downloading trio_websocket-0.12.2-py3-none-any.whl (21 kB)
23:32:13  Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
23:32:13    Using cached attrs-26.1.0-py3-none-any.whl (67 kB)
23:32:13  Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
23:32:13    Downloading sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
23:32:14  Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
23:32:14    Downloading outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
23:32:14  Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
23:32:14    Downloading wsproto-1.3.2-py3-none-any.whl (24 kB)
23:32:14  Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.6.3->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
23:32:14    Downloading PySocks-1.7.1-py3-none-any.whl (16 kB)
23:32:14  Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
23:32:14    Downloading WebOb-1.8.9-py2.py3-none-any.whl (115 kB)
23:32:14  Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
23:32:14    Downloading waitress-3.0.2-py3-none-any.whl (56 kB)
23:32:14  Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
23:32:14    Using cached beautifulsoup4-4.14.3-py3-none-any.whl (107 kB)
23:32:14  Collecting h11<1,>=0.16.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.25.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
23:32:14    Downloading h11-0.16.0-py3-none-any.whl (37 kB)
23:32:14  Collecting soupsieve>=1.6.1 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
23:32:14    Using cached soupsieve-2.8.3-py3-none-any.whl (37 kB)
23:32:14  Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, pyhocon, robotframework-httplibrary, jsonpath-rw
23:32:14    Building wheel for robotframework-sshlibrary (pyproject.toml): started
23:32:14    Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done'
23:32:14    Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=0c95e8a9d0e67987372475d3fa4252d21ba4a757b1912f1bb71903a8160061b4
23:32:14    Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
23:32:14    Building wheel for ipaddr (pyproject.toml): started
23:32:14    Building wheel for ipaddr (pyproject.toml): finished with status 'done'
23:32:14    Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18355 sha256=1751ad47d08c29973dadfbc2c74e9e1694fc417507a1ff1a45c69650752f2c18
23:32:14    Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
23:32:14    Building wheel for netifaces (pyproject.toml): started
23:32:17    Building wheel for netifaces (pyproject.toml): finished with status 'done'
23:32:17    Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=34976 sha256=3d8df7d0a4102e53a473c7291ef29b7f7f23b8359bdd4c188f5a89472924cc36
23:32:17    Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
23:32:17    Building wheel for pyhocon (pyproject.toml): started
23:32:17    Building wheel for pyhocon (pyproject.toml): finished with status 'done'
23:32:17    Created wheel for pyhocon: filename=pyhocon-0.3.63-py3-none-any.whl size=24721 sha256=09a17976ad0a7c1ad24e62618ae78d15b6a21401371508896bb8dcd3abf3658a
23:32:17    Stored in directory: /home/jenkins/.cache/pip/wheels/ce/9e/92/cb17e17d79fafd46a767074b3ed1dca8f78036163f9bea914d
23:32:17    Building wheel for robotframework-httplibrary (pyproject.toml): started
23:32:18    Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done'
23:32:18    Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10014 sha256=1359ca5daac8bf8781df1b42f077b9c7748266970dda5a7b57f05d5c22d807f1
23:32:18    Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
23:32:18    Building wheel for jsonpath-rw (pyproject.toml): started
23:32:18    Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done'
23:32:18    Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=bd66830510b3021ebf2ecb4fd54ebab0933564af77378be6456e52004efbe534
23:32:18    Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
23:32:18  Successfully built robotframework-sshlibrary ipaddr netifaces pyhocon robotframework-httplibrary jsonpath-rw
23:32:18  Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
23:32:25  
23:32:25  Successfully installed WebOb-1.8.9 attrs-26.1.0 bcrypt-5.0.0 beautifulsoup4-4.14.3 certifi-2026.5.20 cffi-2.0.0 charset_normalizer-3.4.7 click-8.4.1 cryptography-48.0.0 decorator-5.3.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.19.3 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.16 invoke-3.0.3 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.1.0 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.1.1 lxml-6.1.1 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-5.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.7 pycparser-3.0 pyhocon-0.3.63 pynacl-1.6.2 pyparsing-3.3.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2026.5.9 requests-2.34.2 robotframework-7.4.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.6.0 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.9.0 robotframework-sshlibrary-3.8.0 scapy-2.7.0 scp-0.15.0 selenium-4.44.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.8.3 trio-0.33.0 trio-websocket-0.12.2 typing-extensions-4.15.0 urllib3-2.7.0 waitress-3.0.2 websocket-client-1.9.0 webtest-3.0.7 wsproto-1.3.2
23:32:26  + pip freeze
23:32:26  attrs==26.1.0
23:32:26  bcrypt==5.0.0
23:32:26  beautifulsoup4==4.14.3
23:32:26  certifi==2026.5.20
23:32:26  cffi==2.0.0
23:32:26  charset-normalizer==3.4.7
23:32:26  click==8.4.1
23:32:26  cryptography==48.0.0
23:32:26  decorator==5.3.1
23:32:26  distlib==0.4.0
23:32:26  docker-py==1.10.6
23:32:26  docker-pycreds==0.4.0
23:32:26  elastic-transport==8.17.1
23:32:26  elasticsearch==8.19.3
23:32:26  elasticsearch-dsl==8.15.4
23:32:26  enum34==1.1.10
23:32:26  filelock==3.29.0
23:32:26  h11==0.16.0
23:32:26  idna==3.16
23:32:26  invoke==3.0.3
23:32:26  ipaddr==2.2.0
23:32:26  isodate==0.7.2
23:32:26  jmespath==1.1.0
23:32:26  jsonpatch==1.33
23:32:26  jsonpath-rw==1.4.0
23:32:26  jsonpointer==3.1.1
23:32:26  lxml==6.1.1
23:32:26  netaddr==1.3.0
23:32:26  netifaces==0.11.0
23:32:26  outcome==1.3.0.post0
23:32:26  packaging==26.2
23:32:26  paramiko==5.0.0
23:32:26  platformdirs==4.9.6
23:32:26  ply==3.11
23:32:26  pyang==2.7.1
23:32:26  pyangbind==0.8.7
23:32:26  pycparser==3.0
23:32:26  pyhocon==0.3.63
23:32:26  PyNaCl==1.6.2
23:32:26  pyparsing==3.3.2
23:32:26  PySocks==1.7.1
23:32:26  python-dateutil==2.9.0.post0
23:32:26  python-discovery==1.3.1
23:32:26  regex==2026.5.9
23:32:26  requests==2.34.2
23:32:26  robotframework==7.4.2
23:32:26  robotframework-httplibrary==0.4.2
23:32:26  robotframework-pythonlibcore==4.6.0
23:32:26  robotframework-requests==0.9.7
23:32:26  robotframework-selenium2library==3.0.0
23:32:26  robotframework-seleniumlibrary==6.9.0
23:32:26  robotframework-sshlibrary==3.8.0
23:32:26  scapy==2.7.0
23:32:26  scp==0.15.0
23:32:26  selenium==4.44.0
23:32:26  six==1.17.0
23:32:26  sniffio==1.3.1
23:32:26  sortedcontainers==2.4.0
23:32:26  soupsieve==2.8.3
23:32:26  trio==0.33.0
23:32:26  trio-websocket==0.12.2
23:32:26  typing_extensions==4.15.0
23:32:26  urllib3==2.7.0
23:32:26  virtualenv==21.3.3
23:32:26  waitress==3.0.2
23:32:26  WebOb==1.8.9
23:32:26  websocket-client==1.9.0
23:32:26  WebTest==3.0.7
23:32:26  wsproto==1.3.2
23:32:26  [EnvInject] - Injecting environment variables from a build step.
23:32:26  [EnvInject] - Injecting as environment variables the properties file path 'env.properties'
23:32:26  [EnvInject] - Variables injected successfully.
23:32:26  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash -l /tmp/jenkins15338917410075566952.sh
23:32:26  Setup pyenv:
23:32:26    system
23:32:26    3.8.20
23:32:26    3.9.20
23:32:26    3.10.15
23:32:26  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-ask-all-chromium/.python-version)
23:32:26  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7P4t from file:/tmp/.os_lf_venv
23:32:26  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:32:26  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:32:28  lf-activate-venv(): INFO: Base packages installed successfully
23:32:28  lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq 
23:32:35  lf-activate-venv(): INFO: Adding /tmp/venv-7P4t/bin to PATH
23:32:35  + ODL_SYSTEM=()
23:32:35  + TOOLS_SYSTEM=()
23:32:35  + OPENSTACK_SYSTEM=()
23:32:35  + OPENSTACK_CONTROLLERS=()
23:32:35  + mapfile -t ADDR
23:32:35  ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-ask-all-chromium-11
23:32:35  ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
23:32:37  + for i in "${ADDR[@]}"
23:32:37  ++ ssh 10.30.171.74 hostname -s
23:32:37  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
23:32:38  + REMHOST=releng-36847-11-0-builder-0
23:32:38  + case ${REMHOST} in
23:32:38  + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
23:32:38  + for i in "${ADDR[@]}"
23:32:38  ++ ssh 10.30.171.136 hostname -s
23:32:38  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
23:32:38  + REMHOST=releng-36847-11-0-builder-1
23:32:38  + case ${REMHOST} in
23:32:38  + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
23:32:38  + for i in "${ADDR[@]}"
23:32:38  ++ ssh 10.30.170.57 hostname -s
23:32:38  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
23:32:39  + REMHOST=releng-36847-11-0-builder-2
23:32:39  + case ${REMHOST} in
23:32:39  + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
23:32:39  + echo NUM_ODL_SYSTEM=3
23:32:39  + echo NUM_TOOLS_SYSTEM=0
23:32:39  + '[' '' == yes ']'
23:32:39  + NUM_OPENSTACK_SYSTEM=0
23:32:39  + echo NUM_OPENSTACK_SYSTEM=0
23:32:39  + '[' 0 -eq 2 ']'
23:32:39  + echo ODL_SYSTEM_IP=10.30.171.74
23:32:39  ++ seq 0 2
23:32:39  + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
23:32:39  + echo ODL_SYSTEM_1_IP=10.30.171.74
23:32:39  + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
23:32:39  + echo ODL_SYSTEM_2_IP=10.30.171.136
23:32:39  + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
23:32:39  + echo ODL_SYSTEM_3_IP=10.30.170.57
23:32:39  + echo TOOLS_SYSTEM_IP=
23:32:39  ++ seq 0 -1
23:32:39  + openstack_index=0
23:32:39  + NUM_OPENSTACK_CONTROL_NODES=1
23:32:39  + echo NUM_OPENSTACK_CONTROL_NODES=1
23:32:39  ++ seq 0 0
23:32:39  + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
23:32:39  + echo OPENSTACK_CONTROL_NODE_1_IP=
23:32:39  + NUM_OPENSTACK_COMPUTE_NODES=-1
23:32:39  + echo NUM_OPENSTACK_COMPUTE_NODES=-1
23:32:39  + '[' -1 -ge 2 ']'
23:32:39  ++ seq 0 -2
23:32:39  + NUM_OPENSTACK_HAPROXY_NODES=0
23:32:39  + echo NUM_OPENSTACK_HAPROXY_NODES=0
23:32:39  ++ seq 0 -1
23:32:39  + echo 'Contents of slave_addresses.txt:'
23:32:39  Contents of slave_addresses.txt:
23:32:39  + cat slave_addresses.txt
23:32:39  NUM_ODL_SYSTEM=3
23:32:39  NUM_TOOLS_SYSTEM=0
23:32:39  NUM_OPENSTACK_SYSTEM=0
23:32:39  ODL_SYSTEM_IP=10.30.171.74
23:32:39  ODL_SYSTEM_1_IP=10.30.171.74
23:32:39  ODL_SYSTEM_2_IP=10.30.171.136
23:32:39  ODL_SYSTEM_3_IP=10.30.170.57
23:32:39  TOOLS_SYSTEM_IP=
23:32:39  NUM_OPENSTACK_CONTROL_NODES=1
23:32:39  OPENSTACK_CONTROL_NODE_1_IP=
23:32:39  NUM_OPENSTACK_COMPUTE_NODES=-1
23:32:39  NUM_OPENSTACK_HAPROXY_NODES=0
23:32:39  [EnvInject] - Injecting environment variables from a build step.
23:32:39  [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
23:32:39  [EnvInject] - Variables injected successfully.
23:32:39  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/sh /tmp/jenkins5809501836145802518.sh
23:32:39  Preparing for JRE Version 21
23:32:39  Karaf artifact is karaf
23:32:39  Karaf project is integration
23:32:39  Java home is /usr/lib/jvm/java-21-openjdk-amd64
23:32:39  [EnvInject] - Injecting environment variables from a build step.
23:32:39  [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
23:32:39  [EnvInject] - Variables injected successfully.
23:32:39  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins7999574769818143184.sh
23:32:39  2026-05-23 23:32:39 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/master/pom.xml [2619/2619] -> "pom.xml" [1]
23:32:39  Bundle version is 0.24.0-SNAPSHOT
23:32:39  --2026-05-23 23:32:39--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/maven-metadata.xml
23:32:39  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
23:32:39  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
23:32:39  HTTP request sent, awaiting response... 200 OK
23:32:39  Length: 1410 (1.4K) [application/xml]
23:32:39  Saving to: ‘maven-metadata.xml’
23:32:39  
23:32:39       0K .                                                     100% 2.19G=0s
23:32:39  
23:32:39  2026-05-23 23:32:39 (2.19 GB/s) - ‘maven-metadata.xml’ saved [1410/1410]
23:32:39  
23:32:39  <?xml version="1.0" encoding="UTF-8"?>
23:32:39  <metadata modelVersion="1.1.0">
23:32:39    <groupId>org.opendaylight.integration</groupId>
23:32:39    <artifactId>karaf</artifactId>
23:32:39    <version>0.24.0-SNAPSHOT</version>
23:32:39    <versioning>
23:32:39      <snapshot>
23:32:39        <timestamp>20260522.223604</timestamp>
23:32:39        <buildNumber>498</buildNumber>
23:32:39      </snapshot>
23:32:39      <lastUpdated>20260522223604</lastUpdated>
23:32:39      <snapshotVersions>
23:32:39        <snapshotVersion>
23:32:39          <extension>pom</extension>
23:32:39          <value>0.24.0-20260522.223604-498</value>
23:32:39          <updated>20260522223604</updated>
23:32:39        </snapshotVersion>
23:32:39        <snapshotVersion>
23:32:39          <extension>tar.gz</extension>
23:32:39          <value>0.24.0-20260522.223604-498</value>
23:32:39          <updated>20260522223604</updated>
23:32:39        </snapshotVersion>
23:32:39        <snapshotVersion>
23:32:39          <extension>zip</extension>
23:32:39          <value>0.24.0-20260522.223604-498</value>
23:32:39          <updated>20260522223604</updated>
23:32:39        </snapshotVersion>
23:32:39        <snapshotVersion>
23:32:39          <classifier>cyclonedx</classifier>
23:32:39          <extension>xml</extension>
23:32:39          <value>0.24.0-20260522.223604-498</value>
23:32:39          <updated>20260522223604</updated>
23:32:39        </snapshotVersion>
23:32:39        <snapshotVersion>
23:32:39          <classifier>cyclonedx</classifier>
23:32:39          <extension>json</extension>
23:32:39          <value>0.24.0-20260522.223604-498</value>
23:32:39          <updated>20260522223604</updated>
23:32:39        </snapshotVersion>
23:32:39      </snapshotVersions>
23:32:39    </versioning>
23:32:39  </metadata>
23:32:39  Nexus timestamp is 0.24.0-20260522.223604-498
23:32:39  Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip
23:32:39  Distribution bundle is karaf-0.24.0-20260522.223604-498.zip
23:32:39  Distribution bundle version is 0.24.0-SNAPSHOT
23:32:39  Distribution folder is karaf-0.24.0-SNAPSHOT
23:32:39  Nexus prefix is https://nexus.opendaylight.org
23:32:39  [EnvInject] - Injecting environment variables from a build step.
23:32:39  [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
23:32:39  [EnvInject] - Variables injected successfully.
23:32:39  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash -l /tmp/jenkins13424917882981022861.sh
23:32:39  Setup pyenv:
23:32:39    system
23:32:39    3.8.20
23:32:39    3.9.20
23:32:39    3.10.15
23:32:39  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-ask-all-chromium/.python-version)
23:32:39  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7P4t from file:/tmp/.os_lf_venv
23:32:39  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
23:32:39  lf-activate-venv(): INFO: Attempting to install with network-safe options...
23:32:41  lf-activate-venv(): INFO: Base packages installed successfully
23:32:41  lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient 
23:32:47  lf-activate-venv(): INFO: Adding /tmp/venv-7P4t/bin to PATH
23:32:47  Copying common-functions.sh to /tmp
23:32:49  Copying common-functions.sh to 10.30.171.74:/tmp
23:32:49  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
23:32:50  Copying common-functions.sh to 10.30.171.136:/tmp
23:32:50  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
23:32:51  Copying common-functions.sh to 10.30.170.57:/tmp
23:32:51  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
23:32:51  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins2567001688418592732.sh
23:32:51  common-functions.sh is being sourced
23:32:51  common-functions environment:
23:32:51  MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:32:51  ACTUALFEATURES: 
23:32:51  FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:32:51  CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
23:32:51  LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:32:51  MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:51  CONTROLLERMEM: 2048m
23:32:51  AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:32:51  MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:32:51  MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:32:51  SUITES: 
23:32:51  
23:32:51  #################################################
23:32:51  ##         Configure Cluster and Start         ##
23:32:51  #################################################
23:32:51  ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
23:32:51  SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
23:32:51  Locating script plan to use...
23:32:51  script plan exists!!!
23:32:51  Changing the script plan path...
23:32:51  # Place the scripts in run order:
23:32:51  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/scripts/car_people_shard.sh
23:32:51  Executing /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/scripts/car_people_shard.sh...
23:32:51  Add car-people shards file
23:32:51  Copy shard config to member-1 with IP address 10.30.171.74
23:32:51  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
23:32:51  Copy shard config to member-2 with IP address 10.30.171.136
23:32:52  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
23:32:52  Copy shard config to member-3 with IP address 10.30.170.57
23:32:52  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
23:32:52  Finished running script plans
23:32:52  Configuring member-1 with IP address 10.30.171.74
23:32:52  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
23:32:53  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
23:32:53  + source /tmp/common-functions.sh karaf-0.24.0-SNAPSHOT chromium
23:32:53  common-functions.sh is being sourced
23:32:53  ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
23:32:53  ++ echo 'common-functions.sh is being sourced'
23:32:53  ++ BUNDLEFOLDER=karaf-0.24.0-SNAPSHOT
23:32:53  ++ DISTROSTREAM=chromium
23:32:53  ++ export MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:32:53  ++ MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:32:53  ++ export FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:32:53  ++ FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:32:53  ++ export CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
23:32:53  ++ CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
23:32:53  ++ export LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:32:53  ++ LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:32:53  ++ export MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:53  ++ MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:53  ++ export CONTROLLERMEM=
23:32:53  ++ CONTROLLERMEM=
23:32:53  ++ case "${DISTROSTREAM}" in
23:32:53  ++ CLUSTER_SYSTEM=pekko
23:32:53  ++ export AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:32:53  ++ AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:32:53  ++ export MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:32:53  ++ MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:32:53  ++ export MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:32:53  ++ MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:32:53  ++ print_common_env
23:32:53  ++ cat
23:32:53  common-functions environment:
23:32:53  MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:32:53  ACTUALFEATURES: 
23:32:53  FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:32:53  CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
23:32:53  LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:32:53  MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:53  CONTROLLERMEM: 
23:32:53  AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:32:53  MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:32:53  MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:32:53  SUITES: 
23:32:53  
23:32:53  ++ SSH='ssh -t -t'
23:32:53  ++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
23:32:53  ++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
23:32:53  Changing to /tmp
23:32:53  Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip
23:32:53  + echo 'Changing to /tmp'
23:32:53  + cd /tmp
23:32:53  + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip'
23:32:53  + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip
23:32:53  --2026-05-23 23:32:53--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip
23:32:53  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
23:32:53  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
23:32:53  HTTP request sent, awaiting response... 200 OK
23:32:53  Length: 240368977 (229M) [application/zip]
23:32:53  Saving to: ‘karaf-0.24.0-20260522.223604-498.zip’
23:32:53  
23:32:53       0K ........ ........ ........ ........ ........ ........  1% 43.3M 5s
23:32:53    3072K ........ ........ ........ ........ ........ ........  2% 71.1M 4s
23:32:53    6144K ........ ........ ........ ........ ........ ........  3%  105M 3s
23:32:53    9216K ........ ........ ........ ........ ........ ........  5%  116M 3s
23:32:53   12288K ........ ........ ........ ........ ........ ........  6% 92.1M 3s
23:32:53   15360K ........ ........ ........ ........ ........ ........  7%  150M 3s
23:32:53   18432K ........ ........ ........ ........ ........ ........  9%  154M 2s
23:32:53   21504K ........ ........ ........ ........ ........ ........ 10%  175M 2s
23:32:53   24576K ........ ........ ........ ........ ........ ........ 11%  193M 2s
23:32:53   27648K ........ ........ ........ ........ ........ ........ 13%  197M 2s
23:32:53   30720K ........ ........ ........ ........ ........ ........ 14%  211M 2s
23:32:53   33792K ........ ........ ........ ........ ........ ........ 15%  221M 2s
23:32:53   36864K ........ ........ ........ ........ ........ ........ 17%  236M 2s
23:32:53   39936K ........ ........ ........ ........ ........ ........ 18%  243M 2s
23:32:53   43008K ........ ........ ........ ........ ........ ........ 19%  199M 1s
23:32:53   46080K ........ ........ ........ ........ ........ ........ 20%  256M 1s
23:32:53   49152K ........ ........ ........ ........ ........ ........ 22%  259M 1s
23:32:53   52224K ........ ........ ........ ........ ........ ........ 23%  241M 1s
23:32:53   55296K ........ ........ ........ ........ ........ ........ 24%  209M 1s
23:32:53   58368K ........ ........ ........ ........ ........ ........ 26%  239M 1s
23:32:53   61440K ........ ........ ........ ........ ........ ........ 27%  232M 1s
23:32:53   64512K ........ ........ ........ ........ ........ ........ 28%  247M 1s
23:32:53   67584K ........ ........ ........ ........ ........ ........ 30%  263M 1s
23:32:53   70656K ........ ........ ........ ........ ........ ........ 31%  273M 1s
23:32:53   73728K ........ ........ ........ ........ ........ ........ 32%  280M 1s
23:32:53   76800K ........ ........ ........ ........ ........ ........ 34%  270M 1s
23:32:53   79872K ........ ........ ........ ........ ........ ........ 35%  262M 1s
23:32:53   82944K ........ ........ ........ ........ ........ ........ 36%  230M 1s
23:32:53   86016K ........ ........ ........ ........ ........ ........ 37%  150M 1s
23:32:53   89088K ........ ........ ........ ........ ........ ........ 39%  326M 1s
23:32:53   92160K ........ ........ ........ ........ ........ ........ 40%  282M 1s
23:32:53   95232K ........ ........ ........ ........ ........ ........ 41%  291M 1s
23:32:53   98304K ........ ........ ........ ........ ........ ........ 43%  273M 1s
23:32:53  101376K ........ ........ ........ ........ ........ ........ 44%  282M 1s
23:32:53  104448K ........ ........ ........ ........ ........ ........ 45%  224M 1s
23:32:53  107520K ........ ........ ........ ........ ........ ........ 47%  247M 1s
23:32:53  110592K ........ ........ ........ ........ ........ ........ 48%  268M 1s
23:32:53  113664K ........ ........ ........ ........ ........ ........ 49%  280M 1s
23:32:53  116736K ........ ........ ........ ........ ........ ........ 51%  264M 1s
23:32:53  119808K ........ ........ ........ ........ ........ ........ 52%  268M 1s
23:32:53  122880K ........ ........ ........ ........ ........ ........ 53%  294M 1s
23:32:53  125952K ........ ........ ........ ........ ........ ........ 54%  272M 1s
23:32:53  129024K ........ ........ ........ ........ ........ ........ 56%  283M 1s
23:32:54  132096K ........ ........ ........ ........ ........ ........ 57%  270M 1s
23:32:54  135168K ........ ........ ........ ........ ........ ........ 58%  273M 0s
23:32:54  138240K ........ ........ ........ ........ ........ ........ 60%  276M 0s
23:32:54  141312K ........ ........ ........ ........ ........ ........ 61%  258M 0s
23:32:54  144384K ........ ........ ........ ........ ........ ........ 62%  291M 0s
23:32:54  147456K ........ ........ ........ ........ ........ ........ 64%  290M 0s
23:32:54  150528K ........ ........ ........ ........ ........ ........ 65%  290M 0s
23:32:54  153600K ........ ........ ........ ........ ........ ........ 66%  277M 0s
23:32:54  156672K ........ ........ ........ ........ ........ ........ 68%  288M 0s
23:32:54  159744K ........ ........ ........ ........ ........ ........ 69%  287M 0s
23:32:54  162816K ........ ........ ........ ........ ........ ........ 70%  244M 0s
23:32:54  165888K ........ ........ ........ ........ ........ ........ 71%  236M 0s
23:32:54  168960K ........ ........ ........ ........ ........ ........ 73%  269M 0s
23:32:54  172032K ........ ........ ........ ........ ........ ........ 74%  276M 0s
23:32:54  175104K ........ ........ ........ ........ ........ ........ 75%  249M 0s
23:32:54  178176K ........ ........ ........ ........ ........ ........ 77%  267M 0s
23:32:54  181248K ........ ........ ........ ........ ........ ........ 78%  262M 0s
23:32:54  184320K ........ ........ ........ ........ ........ ........ 79%  271M 0s
23:32:54  187392K ........ ........ ........ ........ ........ ........ 81%  234M 0s
23:32:54  190464K ........ ........ ........ ........ ........ ........ 82%  240M 0s
23:32:54  193536K ........ ........ ........ ........ ........ ........ 83%  274M 0s
23:32:54  196608K ........ ........ ........ ........ ........ ........ 85%  230M 0s
23:32:54  199680K ........ ........ ........ ........ ........ ........ 86%  224M 0s
23:32:54  202752K ........ ........ ........ ........ ........ ........ 87%  258M 0s
23:32:54  205824K ........ ........ ........ ........ ........ ........ 88%  259M 0s
23:32:54  208896K ........ ........ ........ ........ ........ ........ 90%  296M 0s
23:32:54  211968K ........ ........ ........ ........ ........ ........ 91%  279M 0s
23:32:54  215040K ........ ........ ........ ........ ........ ........ 92%  289M 0s
23:32:54  218112K ........ ........ ........ ........ ........ ........ 94%  295M 0s
23:32:54  221184K ........ ........ ........ ........ ........ ........ 95%  296M 0s
23:32:54  224256K ........ ........ ........ ........ ........ ........ 96%  288M 0s
23:32:54  227328K ........ ........ ........ ........ ........ ........ 98%  278M 0s
23:32:54  230400K ........ ........ ........ ........ ........ ........ 99%  254M 0s
23:32:54  233472K ........ ........ ...                                100%  288M=1.1s
23:32:54  
23:32:54  2026-05-23 23:32:54 (217 MB/s) - ‘karaf-0.24.0-20260522.223604-498.zip’ saved [240368977/240368977]
23:32:54  
23:32:54  Extracting the new controller...
23:32:54  + echo 'Extracting the new controller...'
23:32:54  + unzip -q karaf-0.24.0-20260522.223604-498.zip
23:32:56  Adding external repositories...
23:32:56  + echo 'Adding external repositories...'
23:32:56  + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:32:56  + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:32:56  ################################################################################
23:32:56  #
23:32:56  #    Licensed to the Apache Software Foundation (ASF) under one or more
23:32:56  #    contributor license agreements.  See the NOTICE file distributed with
23:32:56  #    this work for additional information regarding copyright ownership.
23:32:56  #    The ASF licenses this file to You under the Apache License, Version 2.0
23:32:56  #    (the "License"); you may not use this file except in compliance with
23:32:56  #    the License.  You may obtain a copy of the License at
23:32:56  #
23:32:56  #       http://www.apache.org/licenses/LICENSE-2.0
23:32:56  #
23:32:56  #    Unless required by applicable law or agreed to in writing, software
23:32:56  #    distributed under the License is distributed on an "AS IS" BASIS,
23:32:56  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
23:32:56  #    See the License for the specific language governing permissions and
23:32:56  #    limitations under the License.
23:32:56  #
23:32:56  ################################################################################
23:32:56  
23:32:56  #
23:32:56  # If set to true, the following property will not allow any certificate to be used
23:32:56  # when accessing Maven repositories through SSL
23:32:56  #
23:32:56  #org.ops4j.pax.url.mvn.certificateCheck=
23:32:56  
23:32:56  #
23:32:56  # Path to the local Maven settings file.
23:32:56  # The repositories defined in this file will be automatically added to the list
23:32:56  # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
23:32:56  # below is not set.
23:32:56  # The following locations are checked for the existence of the settings.xml file
23:32:56  #   * 1. looks for the specified url
23:32:56  #   * 2. if not found looks for ${user.home}/.m2/settings.xml
23:32:56  #   * 3. if not found looks for ${maven.home}/conf/settings.xml
23:32:56  #   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
23:32:56  #
23:32:56  #org.ops4j.pax.url.mvn.settings=
23:32:56  
23:32:56  #
23:32:56  # Path to the local Maven repository which is used to avoid downloading
23:32:56  # artifacts when they already exist locally.
23:32:56  # The value of this property will be extracted from the settings.xml file
23:32:56  # above, or defaulted to:
23:32:56  #     System.getProperty( "user.home" ) + "/.m2/repository"
23:32:56  #
23:32:56  org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
23:32:56  
23:32:56  #
23:32:56  # Default this to false. It's just weird to use undocumented repos
23:32:56  #
23:32:56  org.ops4j.pax.url.mvn.useFallbackRepositories=false
23:32:56  
23:32:56  #
23:32:56  # Uncomment if you don't wanna use the proxy settings
23:32:56  # from the Maven conf/settings.xml file
23:32:56  #
23:32:56  # org.ops4j.pax.url.mvn.proxySupport=false
23:32:56  
23:32:56  #
23:32:56  # Comma separated list of repositories scanned when resolving an artifact.
23:32:56  # Those repositories will be checked before iterating through the
23:32:56  #    below list of repositories and even before the local repository
23:32:56  # A repository url can be appended with zero or more of the following flags:
23:32:56  #    @snapshots  : the repository contains snaphots
23:32:56  #    @noreleases : the repository does not contain any released artifacts
23:32:56  #
23:32:56  # The following property value will add the system folder as a repo.
23:32:56  #
23:32:56  org.ops4j.pax.url.mvn.defaultRepositories=\
23:32:56      file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
23:32:56      file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
23:32:56      file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
23:32:56  
23:32:56  # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
23:32:56  #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
23:32:56  
23:32:56  #
23:32:56  # Comma separated list of repositories scanned when resolving an artifact.
23:32:56  # The default list includes the following repositories:
23:32:56  #    http://repo1.maven.org/maven2@id=central
23:32:56  #    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
23:32:56  #    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
23:32:56  #    http://zodiac.springsource.com/maven/bundles/release@id=gemini
23:32:56  #    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
23:32:56  #    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
23:32:56  #    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
23:32:56  # To add repositories to the default ones, prepend '+' to the list of repositories
23:32:56  # to add.
23:32:56  # A repository url can be appended with zero or more of the following flags:
23:32:56  #    @snapshots  : the repository contains snapshots
23:32:56  #    @noreleases : the repository does not contain any released artifacts
23:32:56  #    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
23:32:56  #
23:32:56  org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
23:32:56  
23:32:56  ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.
23:32:56  Configuring the startup features...
23:32:56  + [[ True == \T\r\u\e ]]
23:32:56  + echo 'Configuring the startup features...'
23:32:56  + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:32:56  + FEATURE_TEST_STRING=features-test
23:32:56  + FEATURE_TEST_VERSION=0.24.0-SNAPSHOT
23:32:56  + KARAF_VERSION=karaf4
23:32:56  + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
23:32:56  + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:32:56  + [[ ! -z '' ]]
23:32:56  + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:32:56  ################################################################################
23:32:56  #
23:32:56  #    Licensed to the Apache Software Foundation (ASF) under one or more
23:32:56  #    contributor license agreements.  See the NOTICE file distributed with
23:32:56  #    this work for additional information regarding copyright ownership.
23:32:56  #    The ASF licenses this file to You under the Apache License, Version 2.0
23:32:56  #    (the "License"); you may not use this file except in compliance with
23:32:56  #    the License.  You may obtain a copy of the License at
23:32:56  #
23:32:56  #       http://www.apache.org/licenses/LICENSE-2.0
23:32:56  #
23:32:56  #    Unless required by applicable law or agreed to in writing, software
23:32:56  #    distributed under the License is distributed on an "AS IS" BASIS,
23:32:56  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
23:32:56  #    See the License for the specific language governing permissions and
23:32:56  #    limitations under the License.
23:32:56  #
23:32:56  ################################################################################
23:32:56  
23:32:56  #
23:32:56  # Comma separated list of features repositories to register by default
23:32:56  #
23:32:56  featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/f971451c-c5be-4a98-99c8-e87cb35263f3.xml
23:32:56  
23:32:56  #
23:32:56  # Comma separated list of features to install at startup
23:32:56  #
23:32:56  featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, d304288b-5506-47e7-8268-e28eb4943257
23:32:56  
23:32:56  #
23:32:56  # Resource repositories (OBR) that the features resolver can use
23:32:56  # to resolve requirements/capabilities
23:32:56  #
23:32:56  # The format of the resourceRepositories is 
23:32:56  # resourceRepositories=[xml:url|json:url],...
23:32:56  # for Instance:
23:32:56  #
23:32:56  #resourceRepositories=xml:http://host/path/to/index.xml
23:32:56  # or
23:32:56  #resourceRepositories=json:http://host/path/to/index.json
23:32:56  #
23:32:56  
23:32:56  #
23:32:56  # Defines if the boot features are started in asynchronous mode (in a dedicated thread)
23:32:56  #
23:32:56  featuresBootAsynchronous=false
23:32:56  
23:32:56  #
23:32:56  # Service requirements enforcement
23:32:56  #
23:32:56  # By default, the feature resolver checks the service requirements/capabilities of
23:32:56  # bundles for new features (xml schema >= 1.3.0) in order to automatically installs
23:32:56  # the required bundles.
23:32:56  # The following flag can have those values:
23:32:56  #   - disable: service requirements are completely ignored
23:32:56  #   - default: service requirements are ignored for old features
23:32:56  #   - enforce: service requirements are always verified
23:32:56  #
23:32:56  #serviceRequirements=default
23:32:56  
23:32:56  #
23:32:56  # Store cfg file for config element in feature
23:32:56  #
23:32:56  #configCfgStore=true
23:32:56  
23:32:56  #
23:32:56  # Define if the feature service automatically refresh bundles
23:32:56  #
23:32:56  autoRefresh=true
23:32:56  
23:32:56  #
23:32:56  # Configuration of features processing mechanism (overrides, blacklisting, modification of features)
23:32:56  # XML file defines instructions related to features processing
23:32:56  # versions.properties may declare properties to resolve placeholders in XML file
23:32:56  # both files are relative to ${karaf.etc}
23:32:56  #
23:32:56  #featureProcessing=org.apache.karaf.features.xml
23:32:56  #featureProcessingVersions=versions.properties
23:32:56  + configure_karaf_log karaf4 ''
23:32:56  + local -r karaf_version=karaf4
23:32:56  + local -r controllerdebugmap=
23:32:56  + local logapi=log4j
23:32:56  + grep log4j2 /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:32:56  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
23:32:56  log4j2.rootLogger.level = INFO
23:32:56  #log4j2.rootLogger.type = asyncRoot
23:32:56  #log4j2.rootLogger.includeLocation = false
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
23:32:56  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
23:32:56  log4j2.rootLogger.appenderRef.Console.ref = Console
23:32:56  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
23:32:56  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
23:32:56  log4j2.logger.spifly.name = org.apache.aries.spifly
23:32:56  log4j2.logger.spifly.level = WARN
23:32:56  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
23:32:56  log4j2.logger.audit.level = INFO
23:32:56  log4j2.logger.audit.additivity = false
23:32:56  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
23:32:56  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
23:32:56  log4j2.appender.console.type = Console
23:32:56  log4j2.appender.console.name = Console
23:32:56  log4j2.appender.console.layout.type = PatternLayout
23:32:56  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
23:32:56  log4j2.appender.rolling.type = RollingRandomAccessFile
23:32:56  log4j2.appender.rolling.name = RollingFile
23:32:56  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
23:32:56  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
23:32:56  #log4j2.appender.rolling.immediateFlush = false
23:32:56  log4j2.appender.rolling.append = true
23:32:56  log4j2.appender.rolling.layout.type = PatternLayout
23:32:56  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
23:32:56  log4j2.appender.rolling.policies.type = Policies
23:32:56  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
23:32:56  log4j2.appender.rolling.policies.size.size = 64MB
23:32:56  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
23:32:56  log4j2.appender.rolling.strategy.max = 7
23:32:56  log4j2.appender.audit.type = RollingRandomAccessFile
23:32:56  log4j2.appender.audit.name = AuditRollingFile
23:32:56  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
23:32:56  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
23:32:56  log4j2.appender.audit.append = true
23:32:56  log4j2.appender.audit.layout.type = PatternLayout
23:32:56  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
23:32:56  log4j2.appender.audit.policies.type = Policies
23:32:56  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
23:32:56  log4j2.appender.audit.policies.size.size = 8MB
23:32:56  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
23:32:56  log4j2.appender.audit.strategy.max = 7
23:32:56  log4j2.appender.osgi.type = PaxOsgi
23:32:56  log4j2.appender.osgi.name = PaxOsgi
23:32:56  log4j2.appender.osgi.filter = *
23:32:56  #log4j2.logger.aether.name = shaded.org.eclipse.aether
23:32:56  #log4j2.logger.aether.level = TRACE
23:32:56  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
23:32:56  #log4j2.logger.http-headers.level = DEBUG
23:32:56  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
23:32:56  #log4j2.logger.maven.level = TRACE
23:32:56  Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
23:32:56  + logapi=log4j2
23:32:56  + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
23:32:56  + '[' log4j2 == log4j2 ']'
23:32:56  + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:32:56  + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
23:32:56  + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
23:32:56  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
23:32:56  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
23:32:56  controllerdebugmap: 
23:32:56  cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:32:56  + unset IFS
23:32:56  + echo 'controllerdebugmap: '
23:32:56  + '[' -n '' ']'
23:32:56  + echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
23:32:56  + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:32:56  ################################################################################
23:32:56  #
23:32:56  #    Licensed to the Apache Software Foundation (ASF) under one or more
23:32:56  #    contributor license agreements.  See the NOTICE file distributed with
23:32:56  #    this work for additional information regarding copyright ownership.
23:32:56  #    The ASF licenses this file to You under the Apache License, Version 2.0
23:32:56  #    (the "License"); you may not use this file except in compliance with
23:32:56  #    the License.  You may obtain a copy of the License at
23:32:56  #
23:32:56  #       http://www.apache.org/licenses/LICENSE-2.0
23:32:56  #
23:32:56  #    Unless required by applicable law or agreed to in writing, software
23:32:56  #    distributed under the License is distributed on an "AS IS" BASIS,
23:32:56  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
23:32:56  #    See the License for the specific language governing permissions and
23:32:56  #    limitations under the License.
23:32:56  #
23:32:56  ################################################################################
23:32:56  
23:32:56  # Common pattern layout for appenders
23:32:56  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
23:32:56  
23:32:56  # Root logger
23:32:56  log4j2.rootLogger.level = INFO
23:32:56  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
23:32:56  #log4j2.rootLogger.type = asyncRoot
23:32:56  #log4j2.rootLogger.includeLocation = false
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
23:32:56  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
23:32:56  log4j2.rootLogger.appenderRef.Console.ref = Console
23:32:56  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
23:32:56  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
23:32:56  
23:32:56  # Filters for logs marked by org.opendaylight.odlparent.Markers
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
23:32:56  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
23:32:56  
23:32:56  # Loggers configuration
23:32:56  
23:32:56  # Spifly logger
23:32:56  log4j2.logger.spifly.name = org.apache.aries.spifly
23:32:56  log4j2.logger.spifly.level = WARN
23:32:56  
23:32:56  # Security audit logger
23:32:56  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
23:32:56  log4j2.logger.audit.level = INFO
23:32:56  log4j2.logger.audit.additivity = false
23:32:56  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
23:32:56  
23:32:56  # Appenders configuration
23:32:56  
23:32:56  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
23:32:56  log4j2.appender.console.type = Console
23:32:56  log4j2.appender.console.name = Console
23:32:56  log4j2.appender.console.layout.type = PatternLayout
23:32:56  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
23:32:56  
23:32:56  # Rolling file appender
23:32:56  log4j2.appender.rolling.type = RollingRandomAccessFile
23:32:56  log4j2.appender.rolling.name = RollingFile
23:32:56  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
23:32:56  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
23:32:56  # uncomment to not force a disk flush
23:32:56  #log4j2.appender.rolling.immediateFlush = false
23:32:56  log4j2.appender.rolling.append = true
23:32:56  log4j2.appender.rolling.layout.type = PatternLayout
23:32:56  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
23:32:56  log4j2.appender.rolling.policies.type = Policies
23:32:56  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
23:32:56  log4j2.appender.rolling.policies.size.size = 1GB
23:32:56  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
23:32:56  log4j2.appender.rolling.strategy.max = 7
23:32:56  
23:32:56  # Audit file appender
23:32:56  log4j2.appender.audit.type = RollingRandomAccessFile
23:32:56  log4j2.appender.audit.name = AuditRollingFile
23:32:56  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
23:32:56  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
23:32:56  log4j2.appender.audit.append = true
23:32:56  log4j2.appender.audit.layout.type = PatternLayout
23:32:56  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
23:32:56  log4j2.appender.audit.policies.type = Policies
23:32:56  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
23:32:56  log4j2.appender.audit.policies.size.size = 8MB
23:32:56  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
23:32:56  log4j2.appender.audit.strategy.max = 7
23:32:56  
23:32:56  # OSGi appender
23:32:56  log4j2.appender.osgi.type = PaxOsgi
23:32:56  log4j2.appender.osgi.name = PaxOsgi
23:32:56  log4j2.appender.osgi.filter = *
23:32:56  
23:32:56  # help with identification of maven-related problems with pax-url-aether
23:32:56  #log4j2.logger.aether.name = shaded.org.eclipse.aether
23:32:56  #log4j2.logger.aether.level = TRACE
23:32:56  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
23:32:56  #log4j2.logger.http-headers.level = DEBUG
23:32:56  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
23:32:56  #log4j2.logger.maven.level = TRACE
23:32:56  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
23:32:56  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
23:32:56  + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:56  + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
23:32:56  + local -r controllermem=3072m
23:32:56  + local -r memconf=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:56  Configure
23:32:56      java home: /usr/lib/jvm/java-21-openjdk-amd64
23:32:56      max memory: 3072m
23:32:56      memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:56  + echo Configure
23:32:56  + echo '    java home: /usr/lib/jvm/java-21-openjdk-amd64'
23:32:56  + echo '    max memory: 3072m'
23:32:56  + echo '    memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
23:32:56  + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:56  + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:56  cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:56  + echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
23:32:56  + cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:56  #!/bin/sh
23:32:56  #
23:32:56  #    Licensed to the Apache Software Foundation (ASF) under one or more
23:32:56  #    contributor license agreements.  See the NOTICE file distributed with
23:32:56  #    this work for additional information regarding copyright ownership.
23:32:56  #    The ASF licenses this file to You under the Apache License, Version 2.0
23:32:56  #    (the "License"); you may not use this file except in compliance with
23:32:56  #    the License.  You may obtain a copy of the License at
23:32:56  #
23:32:56  #       http://www.apache.org/licenses/LICENSE-2.0
23:32:56  #
23:32:56  #    Unless required by applicable law or agreed to in writing, software
23:32:56  #    distributed under the License is distributed on an "AS IS" BASIS,
23:32:56  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
23:32:56  #    See the License for the specific language governing permissions and
23:32:56  #    limitations under the License.
23:32:56  #
23:32:56  
23:32:56  #
23:32:56  # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
23:32:56  # script: client, instance, shell, start, status, stop, karaf
23:32:56  #
23:32:56  # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
23:32:56  #   Actions go here...
23:32:56  # fi
23:32:56  
23:32:56  #
23:32:56  # general settings which should be applied for all scripts go here; please keep
23:32:56  # in mind that it is possible that scripts might be executed more than once, e.g.
23:32:56  # in example of the start script where the start script is executed first and the
23:32:56  # karaf script afterwards.
23:32:56  #
23:32:56  
23:32:56  #
23:32:56  # The following section shows the possible configuration options for the default 
23:32:56  # karaf scripts
23:32:56  #
23:32:56  export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
23:32:56  # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
23:32:56  # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
23:32:56  # export EXTRA_JAVA_OPTS # Additional JVM options
23:32:56  # export KARAF_HOME # Karaf home folder
23:32:56  # export KARAF_DATA # Karaf data folder
23:32:56  # export KARAF_BASE # Karaf base folder
23:32:56  # export KARAF_ETC  # Karaf etc  folder
23:32:56  # export KARAF_LOG  # Karaf log  folder
23:32:56  # export KARAF_SYSTEM_OPTS # First citizen Karaf options
23:32:56  # export KARAF_OPTS # Additional available Karaf options
23:32:56  # export KARAF_DEBUG # Enable debug mode
23:32:56  # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
23:32:56  # export KARAF_NOROOT # Prevent execution as root if set to true
23:32:56  Set Java version
23:32:56  + echo 'Set Java version'
23:32:56  + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
23:32:56  sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
23:32:56  sudo: a password is required
23:32:56  + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
23:32:56  sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
23:32:56  sudo: a password is required
23:32:56  + echo 'JDK default version ...'
23:32:56  JDK default version ...
23:32:56  + java -version
23:32:56  openjdk version "21.0.10" 2026-01-20
23:32:56  OpenJDK Runtime Environment (build 21.0.10+7-Ubuntu-122.04)
23:32:56  OpenJDK 64-Bit Server VM (build 21.0.10+7-Ubuntu-122.04, mixed mode, sharing)
23:32:56  Set JAVA_HOME
23:32:56  + echo 'Set JAVA_HOME'
23:32:56  + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
23:32:56  + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
23:32:56  ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
23:32:56  Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
23:32:56  Listing all open ports on controller system...
23:32:56  + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
23:32:56  + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
23:32:56  + echo 'Listing all open ports on controller system...'
23:32:56  + netstat -pnatu
23:32:56  /tmp/configuration-script.sh: line 40: netstat: command not found
23:32:56  Custom shard config exists!!!
23:32:56  Copying the shard config...
23:32:56  + '[' -f /tmp/custom_shard_config.txt ']'
23:32:56  + echo 'Custom shard config exists!!!'
23:32:56  + echo 'Copying the shard config...'
23:32:56  + cp /tmp/custom_shard_config.txt /tmp/karaf-0.24.0-SNAPSHOT/bin/
23:32:56  Configuring cluster
23:32:56  + echo 'Configuring cluster'
23:32:56  + /tmp/karaf-0.24.0-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.74 10.30.171.136 10.30.170.57
23:32:56  ################################################
23:32:56  ##             Configure Cluster              ##
23:32:56  ################################################
23:32:56   NOTE: Cluster configuration files not found. Copying from
23:32:56   /tmp/karaf-0.24.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/12.0.3
23:32:56  Configuring unique name in pekko.conf
23:32:56  Configuring hostname in pekko.conf
23:32:56  Configuring data and rpc seed nodes in pekko.conf
23:32:56  modules = [
23:32:56  	
23:32:56  	{
23:32:56  		name = "inventory"
23:32:56  		namespace = "urn:opendaylight:inventory"
23:32:56  		shard-strategy = "module"
23:32:56  	},
23:32:56  	{
23:32:56  		name = "topology"
23:32:56  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
23:32:56  		shard-strategy = "module"
23:32:56  	},
23:32:56  	{
23:32:56  		name = "toaster"
23:32:56  		namespace = "http://netconfcentral.org/ns/toaster"
23:32:56  		shard-strategy = "module"
23:32:56  	},
23:32:56  	{
23:32:56  		name = "car"
23:32:56  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
23:32:56  		shard-strategy = "module"
23:32:56  	},
23:32:56  	{
23:32:56  		name = "people"
23:32:56  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
23:32:56  		shard-strategy = "module"
23:32:56  	},
23:32:56  	{
23:32:56  		name = "car-people"
23:32:56  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
23:32:56  		shard-strategy = "module"
23:32:56  	}
23:32:56  ]
23:32:56  Configuring replication type in module-shards.conf
23:32:56  ################################################
23:32:56  ##   NOTE: Manually restart controller to     ##
23:32:56  ##         apply configuration.               ##
23:32:56  ################################################
23:32:56  Dump pekko.conf
23:32:56  + echo 'Dump pekko.conf'
23:32:56  + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:32:56  
23:32:56  odl-cluster-data {
23:32:56    pekko {
23:32:56      remote {
23:32:56        artery {
23:32:56          enabled = on
23:32:56          transport = tcp
23:32:56          canonical.hostname = "10.30.171.74"
23:32:56          canonical.port = 2550
23:32:56        }
23:32:56      }
23:32:56  
23:32:56      cluster {
23:32:56        # Using artery.
23:32:56        seed-nodes = ["pekko://opendaylight-cluster-data@10.30.171.74:2550",
23:32:56  				"pekko://opendaylight-cluster-data@10.30.171.136:2550",
23:32:56  				"pekko://opendaylight-cluster-data@10.30.170.57:2550"]
23:32:56  
23:32:56        roles = ["member-1"]
23:32:56  
23:32:56        # when under load we might trip a false positive on the failure detector
23:32:56        # failure-detector {
23:32:56          # heartbeat-interval = 4 s
23:32:56          # acceptable-heartbeat-pause = 16s
23:32:56        # }
23:32:56      }
23:32:56  
23:32:56      persistence {
23:32:56        # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
23:32:56        # modifying the following two properties. The directory location specified may be a relative or absolute path. 
23:32:56        # The relative path is always relative to KARAF_HOME.
23:32:56  
23:32:56        # snapshot-store.local.dir = "target/snapshots"
23:32:56      }
23:32:56      disable-default-actor-system-quarantined-event-handling = "false"
23:32:56    }
23:32:56  }
23:32:56  Dump modules.conf
23:32:56  + echo 'Dump modules.conf'
23:32:56  + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:32:56  modules = [
23:32:56  	
23:32:56  	{
23:32:56  		name = "inventory"
23:32:56  		namespace = "urn:opendaylight:inventory"
23:32:56  		shard-strategy = "module"
23:32:56  	},
23:32:56  	{
23:32:56  		name = "topology"
23:32:56  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
23:32:56  		shard-strategy = "module"
23:32:56  	},
23:32:56  	{
23:32:56  		name = "toaster"
23:32:56  		namespace = "http://netconfcentral.org/ns/toaster"
23:32:56  		shard-strategy = "module"
23:32:56  	},
23:32:56  	{
23:32:56  		name = "car"
23:32:56  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
23:32:56  		shard-strategy = "module"
23:32:56  	},
23:32:56  	{
23:32:56  		name = "people"
23:32:56  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
23:32:56  		shard-strategy = "module"
23:32:56  	},
23:32:56  	{
23:32:56  		name = "car-people"
23:32:56  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
23:32:56  		shard-strategy = "module"
23:32:56  	}
23:32:56  ]
23:32:56  Dump module-shards.conf
23:32:56  + echo 'Dump module-shards.conf'
23:32:56  + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:32:56  module-shards = [
23:32:56  	{
23:32:56  		name = "default"
23:32:56  		shards = [
23:32:56  			{
23:32:56  				name = "default"
23:32:56  				replicas = ["member-1",
23:32:56  				"member-2",
23:32:56  				"member-3"]
23:32:56  			}
23:32:56  		]
23:32:56  	},
23:32:56  	{
23:32:56  		name = "inventory"
23:32:56  		shards = [
23:32:56  			{
23:32:56  				name="inventory"
23:32:56  				replicas = ["member-1",
23:32:56  				"member-2",
23:32:56  				"member-3"]
23:32:56  			}
23:32:56  		]
23:32:56  	},
23:32:56  	{
23:32:56  		name = "topology"
23:32:56  		shards = [
23:32:56  			{
23:32:56  				name="topology"
23:32:56  				replicas = ["member-1",
23:32:56  				"member-2",
23:32:56  				"member-3"]
23:32:56  			}
23:32:56  		]
23:32:56  	},
23:32:56  	{
23:32:56  		name = "toaster"
23:32:56  		shards = [
23:32:56  			{
23:32:56  				name="toaster"
23:32:56  				replicas = ["member-1",
23:32:56  				"member-2",
23:32:56  				"member-3"]
23:32:56  			}
23:32:56  		]
23:32:56  	},
23:32:56  	{
23:32:56  		name = "car"
23:32:56  		shards = [
23:32:56  			{
23:32:56  				name="car"
23:32:56  				replicas = ["member-1",
23:32:56  				"member-2",
23:32:56  				"member-3"]
23:32:56  			}
23:32:56  		]
23:32:56  	},
23:32:56  	{
23:32:56  		name = "people"
23:32:56  		shards = [
23:32:56  			{
23:32:56  				name="people"
23:32:56  				replicas = ["member-1",
23:32:56  				"member-2",
23:32:56  				"member-3"]
23:32:56  			}
23:32:56  		]
23:32:56  	},
23:32:56  	{
23:32:56  		name = "car-people"
23:32:56  		shards = [
23:32:56  			{
23:32:56  				name="car-people"
23:32:56  				replicas = ["member-1",
23:32:56  				"member-2",
23:32:56  				"member-3"]
23:32:56  			}
23:32:56  		]
23:32:56  	}
23:32:56  ]
23:32:56  Configuring member-2 with IP address 10.30.171.136
23:32:56  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
23:32:57  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
23:32:57  + source /tmp/common-functions.sh karaf-0.24.0-SNAPSHOT chromium
23:32:57  common-functions.sh is being sourced
23:32:57  ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
23:32:57  ++ echo 'common-functions.sh is being sourced'
23:32:57  ++ BUNDLEFOLDER=karaf-0.24.0-SNAPSHOT
23:32:57  ++ DISTROSTREAM=chromium
23:32:57  ++ export MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:32:57  ++ MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:32:57  ++ export FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:32:57  ++ FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:32:57  ++ export CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
23:32:57  ++ CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
23:32:57  ++ export LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:32:57  ++ LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:32:57  ++ export MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:57  ++ MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:57  ++ export CONTROLLERMEM=
23:32:57  ++ CONTROLLERMEM=
23:32:57  ++ case "${DISTROSTREAM}" in
23:32:57  ++ CLUSTER_SYSTEM=pekko
23:32:57  ++ export AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:32:57  ++ AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:32:57  ++ export MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:32:57  ++ MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:32:57  ++ export MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:32:57  ++ MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:32:57  ++ print_common_env
23:32:57  ++ cat
23:32:57  common-functions environment:
23:32:57  MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:32:57  ACTUALFEATURES: 
23:32:57  FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:32:57  CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
23:32:57  LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:32:57  MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:32:57  CONTROLLERMEM: 
23:32:57  AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:32:57  MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:32:57  MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:32:57  SUITES: 
23:32:57  
23:32:57  ++ SSH='ssh -t -t'
23:32:57  ++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
23:32:57  ++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
23:32:57  Changing to /tmp
23:32:57  Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip
23:32:57  + echo 'Changing to /tmp'
23:32:57  + cd /tmp
23:32:57  + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip'
23:32:57  + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip
23:32:57  --2026-05-23 23:32:57--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip
23:32:57  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
23:32:57  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
23:32:57  HTTP request sent, awaiting response... 200 OK
23:32:57  Length: 240368977 (229M) [application/zip]
23:32:57  Saving to: ‘karaf-0.24.0-20260522.223604-498.zip’
23:32:57  
23:32:57       0K ........ ........ ........ ........ ........ ........  1% 64.5M 4s
23:32:57    3072K ........ ........ ........ ........ ........ ........  2%  116M 3s
23:32:57    6144K ........ ........ ........ ........ ........ ........  3%  147M 2s
23:32:57    9216K ........ ........ ........ ........ ........ ........  5%  132M 2s
23:32:57   12288K ........ ........ ........ ........ ........ ........  6%  156M 2s
23:32:58   15360K ........ ........ ........ ........ ........ ........  7%  168M 2s
23:32:59   18432K ........ ........ ........ ........ ........ ........  9%  180M 2s
23:32:59   21504K ........ ........ ........ ........ ........ ........ 10%  228M 2s
23:32:59   24576K ........ ........ ........ ........ ........ ........ 11%  243M 1s
23:32:59   27648K ........ ........ ........ ........ ........ ........ 13%  242M 1s
23:32:59   30720K ........ ........ ........ ........ ........ ........ 14%  250M 1s
23:32:59   33792K ........ ........ ........ ........ ........ ........ 15%  232M 1s
23:32:59   36864K ........ ........ ........ ........ ........ ........ 17%  240M 1s
23:32:59   39936K ........ ........ ........ ........ ........ ........ 18%  231M 1s
23:32:59   43008K ........ ........ ........ ........ ........ ........ 19%  236M 1s
23:32:59   46080K ........ ........ ........ ........ ........ ........ 20%  231M 1s
23:32:59   49152K ........ ........ ........ ........ ........ ........ 22%  232M 1s
23:32:59   52224K ........ ........ ........ ........ ........ ........ 23%  214M 1s
23:32:59   55296K ........ ........ ........ ........ ........ ........ 24%  245M 1s
23:32:59   58368K ........ ........ ........ ........ ........ ........ 26%  251M 1s
23:32:59   61440K ........ ........ ........ ........ ........ ........ 27%  312M 1s
23:32:59   64512K ........ ........ ........ ........ ........ ........ 28%  309M 1s
23:32:59   67584K ........ ........ ........ ........ ........ ........ 30%  321M 1s
23:32:59   70656K ........ ........ ........ ........ ........ ........ 31%  297M 1s
23:32:59   73728K ........ ........ ........ ........ ........ ........ 32%  307M 1s
23:32:59   76800K ........ ........ ........ ........ ........ ........ 34%  298M 1s
23:32:59   79872K ........ ........ ........ ........ ........ ........ 35%  307M 1s
23:32:59   82944K ........ ........ ........ ........ ........ ........ 36%  299M 1s
23:32:59   86016K ........ ........ ........ ........ ........ ........ 37%  192M 1s
23:32:59   89088K ........ ........ ........ ........ ........ ........ 39%  230M 1s
23:32:59   92160K ........ ........ ........ ........ ........ ........ 40%  277M 1s
23:32:59   95232K ........ ........ ........ ........ ........ ........ 41%  295M 1s
23:32:59   98304K ........ ........ ........ ........ ........ ........ 43%  312M 1s
23:32:59  101376K ........ ........ ........ ........ ........ ........ 44%  314M 1s
23:32:59  104448K ........ ........ ........ ........ ........ ........ 45%  309M 1s
23:32:59  107520K ........ ........ ........ ........ ........ ........ 47%  219M 1s
23:32:59  110592K ........ ........ ........ ........ ........ ........ 48%  354M 1s
23:32:59  113664K ........ ........ ........ ........ ........ ........ 49%  400M 1s
23:32:59  116736K ........ ........ ........ ........ ........ ........ 51%  302M 1s
23:32:59  119808K ........ ........ ........ ........ ........ ........ 52%  309M 0s
23:32:59  122880K ........ ........ ........ ........ ........ ........ 53%  301M 0s
23:32:59  125952K ........ ........ ........ ........ ........ ........ 54%  300M 0s
23:32:59  129024K ........ ........ ........ ........ ........ ........ 56%  305M 0s
23:32:59  132096K ........ ........ ........ ........ ........ ........ 57%  301M 0s
23:32:59  135168K ........ ........ ........ ........ ........ ........ 58%  290M 0s
23:32:59  138240K ........ ........ ........ ........ ........ ........ 60%  241M 0s
23:32:59  141312K ........ ........ ........ ........ ........ ........ 61%  225M 0s
23:32:59  144384K ........ ........ ........ ........ ........ ........ 62%  257M 0s
23:32:59  147456K ........ ........ ........ ........ ........ ........ 64%  266M 0s
23:32:59  150528K ........ ........ ........ ........ ........ ........ 65%  274M 0s
23:32:59  153600K ........ ........ ........ ........ ........ ........ 66%  314M 0s
23:32:59  156672K ........ ........ ........ ........ ........ ........ 68%  314M 0s
23:32:59  159744K ........ ........ ........ ........ ........ ........ 69%  304M 0s
23:32:59  162816K ........ ........ ........ ........ ........ ........ 70%  300M 0s
23:32:59  165888K ........ ........ ........ ........ ........ ........ 71%  306M 0s
23:32:59  168960K ........ ........ ........ ........ ........ ........ 73%  295M 0s
23:32:59  172032K ........ ........ ........ ........ ........ ........ 74%  302M 0s
23:32:59  175104K ........ ........ ........ ........ ........ ........ 75%  276M 0s
23:32:59  178176K ........ ........ ........ ........ ........ ........ 77%  316M 0s
23:32:59  181248K ........ ........ ........ ........ ........ ........ 78%  266M 0s
23:32:59  184320K ........ ........ ........ ........ ........ ........ 79%  310M 0s
23:32:59  187392K ........ ........ ........ ........ ........ ........ 81%  289M 0s
23:32:59  190464K ........ ........ ........ ........ ........ ........ 82%  266M 0s
23:32:59  193536K ........ ........ ........ ........ ........ ........ 83%  270M 0s
23:32:59  196608K ........ ........ ........ ........ ........ ........ 85%  285M 0s
23:32:59  199680K ........ ........ ........ ........ ........ ........ 86%  244M 0s
23:32:59  202752K ........ ........ ........ ........ ........ ........ 87%  266M 0s
23:32:59  205824K ........ ........ ........ ........ ........ ........ 88%  290M 0s
23:32:59  208896K ........ ........ ........ ........ ........ ........ 90%  282M 0s
23:32:59  211968K ........ ........ ........ ........ ........ ........ 91%  286M 0s
23:32:59  215040K ........ ........ ........ ........ ........ ........ 92%  245M 0s
23:32:59  218112K ........ ........ ........ ........ ........ ........ 94%  207M 0s
23:32:59  221184K ........ ........ ........ ........ ........ ........ 95%  221M 0s
23:32:59  224256K ........ ........ ........ ........ ........ ........ 96%  265M 0s
23:32:59  227328K ........ ........ ........ ........ ........ ........ 98%  280M 0s
23:32:59  230400K ........ ........ ........ ........ ........ ........ 99%  279M 0s
23:32:59  233472K ........ ........ ...                                100%  287M=0.9s
23:32:59  
23:32:59  2026-05-23 23:32:58 (245 MB/s) - ‘karaf-0.24.0-20260522.223604-498.zip’ saved [240368977/240368977]
23:32:59  
23:32:59  Extracting the new controller...
23:32:59  + echo 'Extracting the new controller...'
23:32:59  + unzip -q karaf-0.24.0-20260522.223604-498.zip
23:33:02  Adding external repositories...
23:33:02  + echo 'Adding external repositories...'
23:33:02  + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:33:02  + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:33:02  ################################################################################
23:33:02  #
23:33:02  #    Licensed to the Apache Software Foundation (ASF) under one or more
23:33:02  #    contributor license agreements.  See the NOTICE file distributed with
23:33:02  #    this work for additional information regarding copyright ownership.
23:33:02  #    The ASF licenses this file to You under the Apache License, Version 2.0
23:33:02  #    (the "License"); you may not use this file except in compliance with
23:33:02  #    the License.  You may obtain a copy of the License at
23:33:02  #
23:33:02  #       http://www.apache.org/licenses/LICENSE-2.0
23:33:02  #
23:33:02  #    Unless required by applicable law or agreed to in writing, software
23:33:02  #    distributed under the License is distributed on an "AS IS" BASIS,
23:33:02  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
23:33:02  #    See the License for the specific language governing permissions and
23:33:02  #    limitations under the License.
23:33:02  #
23:33:02  ################################################################################
23:33:02  
23:33:02  #
23:33:02  # If set to true, the following property will not allow any certificate to be used
23:33:02  # when accessing Maven repositories through SSL
23:33:02  #
23:33:02  #org.ops4j.pax.url.mvn.certificateCheck=
23:33:02  
23:33:02  #
23:33:02  # Path to the local Maven settings file.
23:33:02  # The repositories defined in this file will be automatically added to the list
23:33:02  # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
23:33:02  # below is not set.
23:33:02  # The following locations are checked for the existence of the settings.xml file
23:33:02  #   * 1. looks for the specified url
23:33:02  #   * 2. if not found looks for ${user.home}/.m2/settings.xml
23:33:02  #   * 3. if not found looks for ${maven.home}/conf/settings.xml
23:33:02  #   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
23:33:02  #
23:33:02  #org.ops4j.pax.url.mvn.settings=
23:33:02  
23:33:02  #
23:33:02  # Path to the local Maven repository which is used to avoid downloading
23:33:02  # artifacts when they already exist locally.
23:33:02  # The value of this property will be extracted from the settings.xml file
23:33:02  # above, or defaulted to:
23:33:02  #     System.getProperty( "user.home" ) + "/.m2/repository"
23:33:02  #
23:33:02  org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
23:33:02  
23:33:02  #
23:33:02  # Default this to false. It's just weird to use undocumented repos
23:33:02  #
23:33:02  org.ops4j.pax.url.mvn.useFallbackRepositories=false
23:33:02  
23:33:02  #
23:33:02  # Uncomment if you don't wanna use the proxy settings
23:33:02  # from the Maven conf/settings.xml file
23:33:02  #
23:33:02  # org.ops4j.pax.url.mvn.proxySupport=false
23:33:02  
23:33:02  #
23:33:02  # Comma separated list of repositories scanned when resolving an artifact.
23:33:02  # Those repositories will be checked before iterating through the
23:33:02  #    below list of repositories and even before the local repository
23:33:02  # A repository url can be appended with zero or more of the following flags:
23:33:02  #    @snapshots  : the repository contains snaphots
23:33:02  #    @noreleases : the repository does not contain any released artifacts
23:33:02  #
23:33:02  # The following property value will add the system folder as a repo.
23:33:02  #
23:33:02  org.ops4j.pax.url.mvn.defaultRepositories=\
23:33:02      file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
23:33:02      file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
23:33:02      file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
23:33:02  
23:33:02  # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
23:33:02  #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
23:33:02  
23:33:02  #
23:33:02  # Comma separated list of repositories scanned when resolving an artifact.
23:33:02  # The default list includes the following repositories:
23:33:02  #    http://repo1.maven.org/maven2@id=central
23:33:02  #    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
23:33:02  #    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
23:33:02  #    http://zodiac.springsource.com/maven/bundles/release@id=gemini
23:33:02  #    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
23:33:02  #    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
23:33:02  #    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
23:33:02  # To add repositories to the default ones, prepend '+' to the list of repositories
23:33:02  # to add.
23:33:02  # A repository url can be appended with zero or more of the following flags:
23:33:02  #    @snapshots  : the repository contains snapshots
23:33:02  #    @noreleases : the repository does not contain any released artifacts
23:33:02  #    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
23:33:02  #
23:33:02  org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
23:33:02  
23:33:02  ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.
23:33:02  Configuring the startup features...
23:33:02  + [[ True == \T\r\u\e ]]
23:33:02  + echo 'Configuring the startup features...'
23:33:02  + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:33:02  + FEATURE_TEST_STRING=features-test
23:33:02  + FEATURE_TEST_VERSION=0.24.0-SNAPSHOT
23:33:02  + KARAF_VERSION=karaf4
23:33:02  + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
23:33:02  + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:33:02  + [[ ! -z '' ]]
23:33:02  + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:33:02  ################################################################################
23:33:02  #
23:33:02  #    Licensed to the Apache Software Foundation (ASF) under one or more
23:33:02  #    contributor license agreements.  See the NOTICE file distributed with
23:33:02  #    this work for additional information regarding copyright ownership.
23:33:02  #    The ASF licenses this file to You under the Apache License, Version 2.0
23:33:02  #    (the "License"); you may not use this file except in compliance with
23:33:02  #    the License.  You may obtain a copy of the License at
23:33:02  #
23:33:02  #       http://www.apache.org/licenses/LICENSE-2.0
23:33:02  #
23:33:02  #    Unless required by applicable law or agreed to in writing, software
23:33:02  #    distributed under the License is distributed on an "AS IS" BASIS,
23:33:02  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
23:33:02  #    See the License for the specific language governing permissions and
23:33:02  #    limitations under the License.
23:33:02  #
23:33:02  ################################################################################
23:33:02  
23:33:02  #
23:33:02  # Comma separated list of features repositories to register by default
23:33:02  #
23:33:02  featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/f971451c-c5be-4a98-99c8-e87cb35263f3.xml
23:33:02  
23:33:02  #
23:33:02  # Comma separated list of features to install at startup
23:33:02  #
23:33:02  featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, d304288b-5506-47e7-8268-e28eb4943257
23:33:02  
23:33:02  #
23:33:02  # Resource repositories (OBR) that the features resolver can use
23:33:02  # to resolve requirements/capabilities
23:33:02  #
23:33:02  # The format of the resourceRepositories is 
23:33:02  # resourceRepositories=[xml:url|json:url],...
23:33:02  # for Instance:
23:33:02  #
23:33:02  #resourceRepositories=xml:http://host/path/to/index.xml
23:33:02  # or
23:33:02  #resourceRepositories=json:http://host/path/to/index.json
23:33:02  #
23:33:02  
23:33:02  #
23:33:02  # Defines if the boot features are started in asynchronous mode (in a dedicated thread)
23:33:02  #
23:33:02  featuresBootAsynchronous=false
23:33:02  
23:33:02  #
23:33:02  # Service requirements enforcement
23:33:02  #
23:33:02  # By default, the feature resolver checks the service requirements/capabilities of
23:33:02  # bundles for new features (xml schema >= 1.3.0) in order to automatically installs
23:33:02  # the required bundles.
23:33:02  # The following flag can have those values:
23:33:02  #   - disable: service requirements are completely ignored
23:33:02  #   - default: service requirements are ignored for old features
23:33:02  #   - enforce: service requirements are always verified
23:33:02  #
23:33:02  #serviceRequirements=default
23:33:02  
23:33:02  #
23:33:02  # Store cfg file for config element in feature
23:33:02  #
23:33:02  #configCfgStore=true
23:33:02  
23:33:02  #
23:33:02  # Define if the feature service automatically refresh bundles
23:33:02  #
23:33:02  autoRefresh=true
23:33:02  
23:33:02  #
23:33:02  # Configuration of features processing mechanism (overrides, blacklisting, modification of features)
23:33:02  # XML file defines instructions related to features processing
23:33:02  # versions.properties may declare properties to resolve placeholders in XML file
23:33:02  # both files are relative to ${karaf.etc}
23:33:02  #
23:33:02  #featureProcessing=org.apache.karaf.features.xml
23:33:02  #featureProcessingVersions=versions.properties
23:33:02  + configure_karaf_log karaf4 ''
23:33:02  + local -r karaf_version=karaf4
23:33:02  + local -r controllerdebugmap=
23:33:02  + local logapi=log4j
23:33:02  + grep log4j2 /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:33:02  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
23:33:02  log4j2.rootLogger.level = INFO
23:33:02  #log4j2.rootLogger.type = asyncRoot
23:33:02  #log4j2.rootLogger.includeLocation = false
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
23:33:02  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
23:33:02  log4j2.rootLogger.appenderRef.Console.ref = Console
23:33:02  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
23:33:02  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
23:33:02  log4j2.logger.spifly.name = org.apache.aries.spifly
23:33:02  log4j2.logger.spifly.level = WARN
23:33:02  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
23:33:02  log4j2.logger.audit.level = INFO
23:33:02  log4j2.logger.audit.additivity = false
23:33:02  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
23:33:02  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
23:33:02  log4j2.appender.console.type = Console
23:33:02  log4j2.appender.console.name = Console
23:33:02  log4j2.appender.console.layout.type = PatternLayout
23:33:02  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
23:33:02  log4j2.appender.rolling.type = RollingRandomAccessFile
23:33:02  log4j2.appender.rolling.name = RollingFile
23:33:02  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
23:33:02  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
23:33:02  #log4j2.appender.rolling.immediateFlush = false
23:33:02  log4j2.appender.rolling.append = true
23:33:02  log4j2.appender.rolling.layout.type = PatternLayout
23:33:02  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
23:33:02  log4j2.appender.rolling.policies.type = Policies
23:33:02  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
23:33:02  log4j2.appender.rolling.policies.size.size = 64MB
23:33:02  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
23:33:02  log4j2.appender.rolling.strategy.max = 7
23:33:02  log4j2.appender.audit.type = RollingRandomAccessFile
23:33:02  log4j2.appender.audit.name = AuditRollingFile
23:33:02  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
23:33:02  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
23:33:02  log4j2.appender.audit.append = true
23:33:02  log4j2.appender.audit.layout.type = PatternLayout
23:33:02  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
23:33:02  log4j2.appender.audit.policies.type = Policies
23:33:02  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
23:33:02  log4j2.appender.audit.policies.size.size = 8MB
23:33:02  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
23:33:02  log4j2.appender.audit.strategy.max = 7
23:33:02  log4j2.appender.osgi.type = PaxOsgi
23:33:02  log4j2.appender.osgi.name = PaxOsgi
23:33:02  log4j2.appender.osgi.filter = *
23:33:02  #log4j2.logger.aether.name = shaded.org.eclipse.aether
23:33:02  #log4j2.logger.aether.level = TRACE
23:33:02  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
23:33:02  #log4j2.logger.http-headers.level = DEBUG
23:33:02  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
23:33:02  #log4j2.logger.maven.level = TRACE
23:33:02  + logapi=log4j2
23:33:02  + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
23:33:02  Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
23:33:02  + '[' log4j2 == log4j2 ']'
23:33:02  + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:33:02  controllerdebugmap: 
23:33:02  cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:33:02  + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
23:33:02  + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
23:33:02  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
23:33:02  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
23:33:02  + unset IFS
23:33:02  + echo 'controllerdebugmap: '
23:33:02  + '[' -n '' ']'
23:33:02  + echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
23:33:02  + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:33:02  ################################################################################
23:33:02  #
23:33:02  #    Licensed to the Apache Software Foundation (ASF) under one or more
23:33:02  #    contributor license agreements.  See the NOTICE file distributed with
23:33:02  #    this work for additional information regarding copyright ownership.
23:33:02  #    The ASF licenses this file to You under the Apache License, Version 2.0
23:33:02  #    (the "License"); you may not use this file except in compliance with
23:33:02  #    the License.  You may obtain a copy of the License at
23:33:02  #
23:33:02  #       http://www.apache.org/licenses/LICENSE-2.0
23:33:02  #
23:33:02  #    Unless required by applicable law or agreed to in writing, software
23:33:02  #    distributed under the License is distributed on an "AS IS" BASIS,
23:33:02  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
23:33:02  #    See the License for the specific language governing permissions and
23:33:02  #    limitations under the License.
23:33:02  #
23:33:02  ################################################################################
23:33:02  
23:33:02  # Common pattern layout for appenders
23:33:02  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
23:33:02  
23:33:02  # Root logger
23:33:02  log4j2.rootLogger.level = INFO
23:33:02  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
23:33:02  #log4j2.rootLogger.type = asyncRoot
23:33:02  #log4j2.rootLogger.includeLocation = false
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
23:33:02  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
23:33:02  log4j2.rootLogger.appenderRef.Console.ref = Console
23:33:02  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
23:33:02  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
23:33:02  
23:33:02  # Filters for logs marked by org.opendaylight.odlparent.Markers
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
23:33:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
23:33:02  
23:33:02  # Loggers configuration
23:33:02  
23:33:02  # Spifly logger
23:33:02  log4j2.logger.spifly.name = org.apache.aries.spifly
23:33:02  log4j2.logger.spifly.level = WARN
23:33:02  
23:33:02  # Security audit logger
23:33:02  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
23:33:02  log4j2.logger.audit.level = INFO
23:33:02  log4j2.logger.audit.additivity = false
23:33:02  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
23:33:02  
23:33:02  # Appenders configuration
23:33:02  
23:33:02  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
23:33:02  log4j2.appender.console.type = Console
23:33:02  log4j2.appender.console.name = Console
23:33:02  log4j2.appender.console.layout.type = PatternLayout
23:33:02  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
23:33:02  
23:33:02  # Rolling file appender
23:33:02  log4j2.appender.rolling.type = RollingRandomAccessFile
23:33:02  log4j2.appender.rolling.name = RollingFile
23:33:02  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
23:33:02  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
23:33:02  # uncomment to not force a disk flush
23:33:02  #log4j2.appender.rolling.immediateFlush = false
23:33:02  log4j2.appender.rolling.append = true
23:33:02  log4j2.appender.rolling.layout.type = PatternLayout
23:33:02  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
23:33:02  log4j2.appender.rolling.policies.type = Policies
23:33:02  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
23:33:02  log4j2.appender.rolling.policies.size.size = 1GB
23:33:02  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
23:33:02  log4j2.appender.rolling.strategy.max = 7
23:33:02  
23:33:02  # Audit file appender
23:33:02  log4j2.appender.audit.type = RollingRandomAccessFile
23:33:02  log4j2.appender.audit.name = AuditRollingFile
23:33:02  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
23:33:02  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
23:33:02  log4j2.appender.audit.append = true
23:33:02  log4j2.appender.audit.layout.type = PatternLayout
23:33:02  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
23:33:02  log4j2.appender.audit.policies.type = Policies
23:33:02  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
23:33:02  log4j2.appender.audit.policies.size.size = 8MB
23:33:02  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
23:33:02  log4j2.appender.audit.strategy.max = 7
23:33:02  
23:33:02  # OSGi appender
23:33:02  log4j2.appender.osgi.type = PaxOsgi
23:33:02  log4j2.appender.osgi.name = PaxOsgi
23:33:02  log4j2.appender.osgi.filter = *
23:33:02  
23:33:02  # help with identification of maven-related problems with pax-url-aether
23:33:02  #log4j2.logger.aether.name = shaded.org.eclipse.aether
23:33:02  #log4j2.logger.aether.level = TRACE
23:33:02  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
23:33:02  #log4j2.logger.http-headers.level = DEBUG
23:33:02  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
23:33:02  #log4j2.logger.maven.level = TRACE
23:33:02  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
23:33:02  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
23:33:02  Configure
23:33:02      java home: /usr/lib/jvm/java-21-openjdk-amd64
23:33:02      max memory: 3072m
23:33:02      memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:02  + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:02  + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
23:33:02  + local -r controllermem=3072m
23:33:02  + local -r memconf=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:02  + echo Configure
23:33:02  + echo '    java home: /usr/lib/jvm/java-21-openjdk-amd64'
23:33:02  + echo '    max memory: 3072m'
23:33:02  + echo '    memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
23:33:02  + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:02  + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:02  cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:02  + echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
23:33:02  + cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:02  #!/bin/sh
23:33:02  #
23:33:02  #    Licensed to the Apache Software Foundation (ASF) under one or more
23:33:02  #    contributor license agreements.  See the NOTICE file distributed with
23:33:02  #    this work for additional information regarding copyright ownership.
23:33:02  #    The ASF licenses this file to You under the Apache License, Version 2.0
23:33:02  #    (the "License"); you may not use this file except in compliance with
23:33:02  #    the License.  You may obtain a copy of the License at
23:33:02  #
23:33:02  #       http://www.apache.org/licenses/LICENSE-2.0
23:33:02  #
23:33:02  #    Unless required by applicable law or agreed to in writing, software
23:33:02  #    distributed under the License is distributed on an "AS IS" BASIS,
23:33:02  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
23:33:02  #    See the License for the specific language governing permissions and
23:33:02  #    limitations under the License.
23:33:02  #
23:33:02  
23:33:02  #
23:33:02  # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
23:33:02  # script: client, instance, shell, start, status, stop, karaf
23:33:02  #
23:33:02  # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
23:33:02  #   Actions go here...
23:33:02  # fi
23:33:02  
23:33:02  #
23:33:02  # general settings which should be applied for all scripts go here; please keep
23:33:02  # in mind that it is possible that scripts might be executed more than once, e.g.
23:33:02  # in example of the start script where the start script is executed first and the
23:33:02  # karaf script afterwards.
23:33:02  #
23:33:02  
23:33:02  #
23:33:02  # The following section shows the possible configuration options for the default 
23:33:02  # karaf scripts
23:33:02  #
23:33:02  export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
23:33:02  # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
23:33:02  # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
23:33:02  # export EXTRA_JAVA_OPTS # Additional JVM options
23:33:02  # export KARAF_HOME # Karaf home folder
23:33:02  # export KARAF_DATA # Karaf data folder
23:33:02  # export KARAF_BASE # Karaf base folder
23:33:02  # export KARAF_ETC  # Karaf etc  folder
23:33:02  # export KARAF_LOG  # Karaf log  folder
23:33:02  # export KARAF_SYSTEM_OPTS # First citizen Karaf options
23:33:02  # export KARAF_OPTS # Additional available Karaf options
23:33:02  # export KARAF_DEBUG # Enable debug mode
23:33:02  # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
23:33:02  # export KARAF_NOROOT # Prevent execution as root if set to true
23:33:02  + echo 'Set Java version'
23:33:02  Set Java version
23:33:02  + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
23:33:02  sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
23:33:02  sudo: a password is required
23:33:02  + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
23:33:02  sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
23:33:02  sudo: a password is required
23:33:02  JDK default version ...
23:33:02  + echo 'JDK default version ...'
23:33:02  + java -version
23:33:02  openjdk version "21.0.10" 2026-01-20
23:33:02  OpenJDK Runtime Environment (build 21.0.10+7-Ubuntu-122.04)
23:33:02  OpenJDK 64-Bit Server VM (build 21.0.10+7-Ubuntu-122.04, mixed mode, sharing)
23:33:02  Set JAVA_HOME
23:33:02  + echo 'Set JAVA_HOME'
23:33:02  + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
23:33:02  + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
23:33:02  ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
23:33:02  + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
23:33:02  + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
23:33:02  Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
23:33:02  Listing all open ports on controller system...
23:33:02  + echo 'Listing all open ports on controller system...'
23:33:02  + netstat -pnatu
23:33:02  /tmp/configuration-script.sh: line 40: netstat: command not found
23:33:02  Custom shard config exists!!!
23:33:02  Copying the shard config...
23:33:02  + '[' -f /tmp/custom_shard_config.txt ']'
23:33:02  + echo 'Custom shard config exists!!!'
23:33:02  + echo 'Copying the shard config...'
23:33:02  + cp /tmp/custom_shard_config.txt /tmp/karaf-0.24.0-SNAPSHOT/bin/
23:33:02  Configuring cluster
23:33:02  + echo 'Configuring cluster'
23:33:02  + /tmp/karaf-0.24.0-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.74 10.30.171.136 10.30.170.57
23:33:02  ################################################
23:33:02  ##             Configure Cluster              ##
23:33:02  ################################################
23:33:02   NOTE: Cluster configuration files not found. Copying from
23:33:02   /tmp/karaf-0.24.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/12.0.3
23:33:02  Configuring unique name in pekko.conf
23:33:02  Configuring hostname in pekko.conf
23:33:02  Configuring data and rpc seed nodes in pekko.conf
23:33:02  modules = [
23:33:02  	
23:33:02  	{
23:33:02  		name = "inventory"
23:33:02  		namespace = "urn:opendaylight:inventory"
23:33:02  		shard-strategy = "module"
23:33:02  	},
23:33:02  	{
23:33:02  		name = "topology"
23:33:02  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
23:33:02  		shard-strategy = "module"
23:33:02  	},
23:33:02  	{
23:33:02  		name = "toaster"
23:33:02  		namespace = "http://netconfcentral.org/ns/toaster"
23:33:02  		shard-strategy = "module"
23:33:02  	},
23:33:02  	{
23:33:02  		name = "car"
23:33:02  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
23:33:02  		shard-strategy = "module"
23:33:02  	},
23:33:02  	{
23:33:02  		name = "people"
23:33:02  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
23:33:02  		shard-strategy = "module"
23:33:02  	},
23:33:02  	{
23:33:02  		name = "car-people"
23:33:02  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
23:33:02  		shard-strategy = "module"
23:33:02  	}
23:33:02  ]
23:33:02  Configuring replication type in module-shards.conf
23:33:02  ################################################
23:33:02  ##   NOTE: Manually restart controller to     ##
23:33:02  ##         apply configuration.               ##
23:33:02  ################################################
23:33:02  Dump pekko.conf
23:33:02  + echo 'Dump pekko.conf'
23:33:02  + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:33:02  
23:33:02  odl-cluster-data {
23:33:02    pekko {
23:33:02      remote {
23:33:02        artery {
23:33:02          enabled = on
23:33:02          transport = tcp
23:33:02          canonical.hostname = "10.30.171.136"
23:33:02          canonical.port = 2550
23:33:02        }
23:33:02      }
23:33:02  
23:33:02      cluster {
23:33:02        # Using artery.
23:33:02        seed-nodes = ["pekko://opendaylight-cluster-data@10.30.171.74:2550",
23:33:02  				"pekko://opendaylight-cluster-data@10.30.171.136:2550",
23:33:02  				"pekko://opendaylight-cluster-data@10.30.170.57:2550"]
23:33:02  
23:33:02        roles = ["member-2"]
23:33:02  
23:33:02        # when under load we might trip a false positive on the failure detector
23:33:02        # failure-detector {
23:33:02          # heartbeat-interval = 4 s
23:33:02          # acceptable-heartbeat-pause = 16s
23:33:02        # }
23:33:02      }
23:33:02  
23:33:02      persistence {
23:33:02        # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
23:33:02        # modifying the following two properties. The directory location specified may be a relative or absolute path. 
23:33:02        # The relative path is always relative to KARAF_HOME.
23:33:02  
23:33:02        # snapshot-store.local.dir = "target/snapshots"
23:33:02      }
23:33:02      disable-default-actor-system-quarantined-event-handling = "false"
23:33:02    }
23:33:02  }
23:33:02  Dump modules.conf
23:33:02  + echo 'Dump modules.conf'
23:33:02  + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:33:02  modules = [
23:33:02  	
23:33:02  	{
23:33:02  		name = "inventory"
23:33:02  		namespace = "urn:opendaylight:inventory"
23:33:02  		shard-strategy = "module"
23:33:02  	},
23:33:02  	{
23:33:02  		name = "topology"
23:33:02  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
23:33:02  		shard-strategy = "module"
23:33:02  	},
23:33:02  	{
23:33:02  		name = "toaster"
23:33:02  		namespace = "http://netconfcentral.org/ns/toaster"
23:33:02  		shard-strategy = "module"
23:33:02  	},
23:33:02  	{
23:33:02  		name = "car"
23:33:02  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
23:33:02  		shard-strategy = "module"
23:33:02  	},
23:33:02  	{
23:33:02  		name = "people"
23:33:02  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
23:33:02  		shard-strategy = "module"
23:33:02  	},
23:33:02  	{
23:33:02  		name = "car-people"
23:33:02  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
23:33:02  		shard-strategy = "module"
23:33:02  	}
23:33:02  ]
23:33:02  Dump module-shards.conf
23:33:02  + echo 'Dump module-shards.conf'
23:33:02  + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:33:02  module-shards = [
23:33:02  	{
23:33:02  		name = "default"
23:33:02  		shards = [
23:33:02  			{
23:33:02  				name = "default"
23:33:02  				replicas = ["member-1",
23:33:02  				"member-2",
23:33:02  				"member-3"]
23:33:02  			}
23:33:02  		]
23:33:02  	},
23:33:02  	{
23:33:02  		name = "inventory"
23:33:02  		shards = [
23:33:02  			{
23:33:02  				name="inventory"
23:33:02  				replicas = ["member-1",
23:33:02  				"member-2",
23:33:02  				"member-3"]
23:33:02  			}
23:33:02  		]
23:33:02  	},
23:33:02  	{
23:33:02  		name = "topology"
23:33:02  		shards = [
23:33:02  			{
23:33:02  				name="topology"
23:33:02  				replicas = ["member-1",
23:33:02  				"member-2",
23:33:02  				"member-3"]
23:33:02  			}
23:33:02  		]
23:33:02  	},
23:33:02  	{
23:33:02  		name = "toaster"
23:33:02  		shards = [
23:33:02  			{
23:33:02  				name="toaster"
23:33:02  				replicas = ["member-1",
23:33:02  				"member-2",
23:33:02  				"member-3"]
23:33:02  			}
23:33:02  		]
23:33:02  	},
23:33:02  	{
23:33:02  		name = "car"
23:33:02  		shards = [
23:33:02  			{
23:33:02  				name="car"
23:33:02  				replicas = ["member-1",
23:33:02  				"member-2",
23:33:02  				"member-3"]
23:33:02  			}
23:33:02  		]
23:33:02  	},
23:33:02  	{
23:33:02  		name = "people"
23:33:02  		shards = [
23:33:02  			{
23:33:02  				name="people"
23:33:02  				replicas = ["member-1",
23:33:02  				"member-2",
23:33:02  				"member-3"]
23:33:02  			}
23:33:02  		]
23:33:02  	},
23:33:02  	{
23:33:02  		name = "car-people"
23:33:02  		shards = [
23:33:02  			{
23:33:02  				name="car-people"
23:33:02  				replicas = ["member-1",
23:33:02  				"member-2",
23:33:02  				"member-3"]
23:33:02  			}
23:33:02  		]
23:33:02  	}
23:33:02  ]
23:33:02  Configuring member-3 with IP address 10.30.170.57
23:33:02  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
23:33:02  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
23:33:02  + source /tmp/common-functions.sh karaf-0.24.0-SNAPSHOT chromium
23:33:02  common-functions.sh is being sourced
23:33:02  ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
23:33:02  ++ echo 'common-functions.sh is being sourced'
23:33:02  ++ BUNDLEFOLDER=karaf-0.24.0-SNAPSHOT
23:33:02  ++ DISTROSTREAM=chromium
23:33:02  ++ export MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:33:02  ++ MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:33:02  ++ export FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:33:02  ++ FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:33:02  ++ export CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
23:33:02  ++ CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
23:33:02  ++ export LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:33:02  ++ LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:33:02  ++ export MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:02  ++ MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:02  ++ export CONTROLLERMEM=
23:33:02  ++ CONTROLLERMEM=
23:33:02  ++ case "${DISTROSTREAM}" in
23:33:02  ++ CLUSTER_SYSTEM=pekko
23:33:02  ++ export AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:33:02  ++ AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:33:02  ++ export MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:33:02  ++ MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:33:02  ++ export MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:33:02  ++ MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:33:02  ++ print_common_env
23:33:02  ++ cat
23:33:02  common-functions environment:
23:33:02  MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:33:02  ACTUALFEATURES: 
23:33:02  FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:33:02  CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
23:33:02  LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:33:02  MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:02  CONTROLLERMEM: 
23:33:02  AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:33:02  MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:33:02  MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:33:02  SUITES: 
23:33:02  
23:33:02  ++ SSH='ssh -t -t'
23:33:02  ++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
23:33:02  ++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
23:33:02  Changing to /tmp
23:33:02  Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip
23:33:02  + echo 'Changing to /tmp'
23:33:02  + cd /tmp
23:33:02  + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip'
23:33:02  + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip
23:33:02  --2026-05-23 23:33:01--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip
23:33:02  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
23:33:02  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
23:33:02  HTTP request sent, awaiting response... 200 OK
23:33:02  Length: 240368977 (229M) [application/zip]
23:33:02  Saving to: ‘karaf-0.24.0-20260522.223604-498.zip’
23:33:02  
23:33:02       0K ........ ........ ........ ........ ........ ........  1% 58.8M 4s
23:33:02    3072K ........ ........ ........ ........ ........ ........  2%  121M 3s
23:33:02    6144K ........ ........ ........ ........ ........ ........  3%  119M 2s
23:33:02    9216K ........ ........ ........ ........ ........ ........  5% 75.0M 3s
23:33:02   12288K ........ ........ ........ ........ ........ ........  6%  159M 2s
23:33:02   15360K ........ ........ ........ ........ ........ ........  7%  170M 2s
23:33:02   18432K ........ ........ ........ ........ ........ ........  9%  189M 2s
23:33:02   21504K ........ ........ ........ ........ ........ ........ 10%  178M 2s
23:33:02   24576K ........ ........ ........ ........ ........ ........ 11%  205M 2s
23:33:02   27648K ........ ........ ........ ........ ........ ........ 13%  224M 2s
23:33:02   30720K ........ ........ ........ ........ ........ ........ 14%  236M 1s
23:33:02   33792K ........ ........ ........ ........ ........ ........ 15%  240M 1s
23:33:02   36864K ........ ........ ........ ........ ........ ........ 17%  195M 1s
23:33:02   39936K ........ ........ ........ ........ ........ ........ 18%  221M 1s
23:33:02   43008K ........ ........ ........ ........ ........ ........ 19%  252M 1s
23:33:02   46080K ........ ........ ........ ........ ........ ........ 20%  217M 1s
23:33:02   49152K ........ ........ ........ ........ ........ ........ 22%  196M 1s
23:33:02   52224K ........ ........ ........ ........ ........ ........ 23%  176M 1s
23:33:02   55296K ........ ........ ........ ........ ........ ........ 24%  256M 1s
23:33:02   58368K ........ ........ ........ ........ ........ ........ 26%  244M 1s
23:33:02   61440K ........ ........ ........ ........ ........ ........ 27%  243M 1s
23:33:02   64512K ........ ........ ........ ........ ........ ........ 28%  209M 1s
23:33:02   67584K ........ ........ ........ ........ ........ ........ 30%  146M 1s
23:33:02   70656K ........ ........ ........ ........ ........ ........ 31%  209M 1s
23:33:02   73728K ........ ........ ........ ........ ........ ........ 32%  219M 1s
23:33:02   76800K ........ ........ ........ ........ ........ ........ 34%  206M 1s
23:33:02   79872K ........ ........ ........ ........ ........ ........ 35%  266M 1s
23:33:02   82944K ........ ........ ........ ........ ........ ........ 36%  261M 1s
23:33:02   86016K ........ ........ ........ ........ ........ ........ 37%  273M 1s
23:33:02   89088K ........ ........ ........ ........ ........ ........ 39%  237M 1s
23:33:02   92160K ........ ........ ........ ........ ........ ........ 40%  200M 1s
23:33:02   95232K ........ ........ ........ ........ ........ ........ 41%  269M 1s
23:33:02   98304K ........ ........ ........ ........ ........ ........ 43%  215M 1s
23:33:02  101376K ........ ........ ........ ........ ........ ........ 44%  192M 1s
23:33:02  104448K ........ ........ ........ ........ ........ ........ 45%  205M 1s
23:33:02  107520K ........ ........ ........ ........ ........ ........ 47%  244M 1s
23:33:02  110592K ........ ........ ........ ........ ........ ........ 48%  245M 1s
23:33:02  113664K ........ ........ ........ ........ ........ ........ 49%  257M 1s
23:33:02  116736K ........ ........ ........ ........ ........ ........ 51%  259M 1s
23:33:02  119808K ........ ........ ........ ........ ........ ........ 52%  292M 1s
23:33:02  122880K ........ ........ ........ ........ ........ ........ 53%  265M 1s
23:33:02  125952K ........ ........ ........ ........ ........ ........ 54%  286M 1s
23:33:02  129024K ........ ........ ........ ........ ........ ........ 56%  336M 1s
23:33:02  132096K ........ ........ ........ ........ ........ ........ 57%  321M 1s
23:33:02  135168K ........ ........ ........ ........ ........ ........ 58%  260M 0s
23:33:02  138240K ........ ........ ........ ........ ........ ........ 60%  253M 0s
23:33:02  141312K ........ ........ ........ ........ ........ ........ 61%  324M 0s
23:33:02  144384K ........ ........ ........ ........ ........ ........ 62%  291M 0s
23:33:02  147456K ........ ........ ........ ........ ........ ........ 64%  277M 0s
23:33:02  150528K ........ ........ ........ ........ ........ ........ 65%  289M 0s
23:33:02  153600K ........ ........ ........ ........ ........ ........ 66%  264M 0s
23:33:02  156672K ........ ........ ........ ........ ........ ........ 68%  279M 0s
23:33:02  159744K ........ ........ ........ ........ ........ ........ 69%  340M 0s
23:33:02  162816K ........ ........ ........ ........ ........ ........ 70%  333M 0s
23:33:02  165888K ........ ........ ........ ........ ........ ........ 71%  258M 0s
23:33:02  168960K ........ ........ ........ ........ ........ ........ 73%  354M 0s
23:33:02  172032K ........ ........ ........ ........ ........ ........ 74%  218M 0s
23:33:02  175104K ........ ........ ........ ........ ........ ........ 75%  285M 0s
23:33:02  178176K ........ ........ ........ ........ ........ ........ 77%  287M 0s
23:33:02  181248K ........ ........ ........ ........ ........ ........ 78%  337M 0s
23:33:02  184320K ........ ........ ........ ........ ........ ........ 79%  315M 0s
23:33:02  187392K ........ ........ ........ ........ ........ ........ 81%  218M 0s
23:33:02  190464K ........ ........ ........ ........ ........ ........ 82%  220M 0s
23:33:02  193536K ........ ........ ........ ........ ........ ........ 83%  222M 0s
23:33:02  196608K ........ ........ ........ ........ ........ ........ 85%  196M 0s
23:33:02  199680K ........ ........ ........ ........ ........ ........ 86%  281M 0s
23:33:02  202752K ........ ........ ........ ........ ........ ........ 87%  313M 0s
23:33:02  205824K ........ ........ ........ ........ ........ ........ 88%  249M 0s
23:33:02  208896K ........ ........ ........ ........ ........ ........ 90%  257M 0s
23:33:02  211968K ........ ........ ........ ........ ........ ........ 91%  276M 0s
23:33:02  215040K ........ ........ ........ ........ ........ ........ 92%  297M 0s
23:33:02  218112K ........ ........ ........ ........ ........ ........ 94%  272M 0s
23:33:02  221184K ........ ........ ........ ........ ........ ........ 95%  272M 0s
23:33:02  224256K ........ ........ ........ ........ ........ ........ 96%  287M 0s
23:33:02  227328K ........ ........ ........ ........ ........ ........ 98%  274M 0s
23:33:02  230400K ........ ........ ........ ........ ........ ........ 99%  318M 0s
23:33:02  233472K ........ ........ ...                                100%  252M=1.0s
23:33:02  
23:33:02  2026-05-23 23:33:02 (221 MB/s) - ‘karaf-0.24.0-20260522.223604-498.zip’ saved [240368977/240368977]
23:33:02  
23:33:02  Extracting the new controller...
23:33:02  + echo 'Extracting the new controller...'
23:33:02  + unzip -q karaf-0.24.0-20260522.223604-498.zip
23:33:04  Adding external repositories...
23:33:04  + echo 'Adding external repositories...'
23:33:04  + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:33:04  + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:33:04  ################################################################################
23:33:04  #
23:33:04  #    Licensed to the Apache Software Foundation (ASF) under one or more
23:33:04  #    contributor license agreements.  See the NOTICE file distributed with
23:33:04  #    this work for additional information regarding copyright ownership.
23:33:04  #    The ASF licenses this file to You under the Apache License, Version 2.0
23:33:04  #    (the "License"); you may not use this file except in compliance with
23:33:04  #    the License.  You may obtain a copy of the License at
23:33:04  #
23:33:04  #       http://www.apache.org/licenses/LICENSE-2.0
23:33:04  #
23:33:04  #    Unless required by applicable law or agreed to in writing, software
23:33:04  #    distributed under the License is distributed on an "AS IS" BASIS,
23:33:04  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
23:33:04  #    See the License for the specific language governing permissions and
23:33:04  #    limitations under the License.
23:33:04  #
23:33:04  ################################################################################
23:33:04  
23:33:04  #
23:33:04  # If set to true, the following property will not allow any certificate to be used
23:33:04  # when accessing Maven repositories through SSL
23:33:04  #
23:33:04  #org.ops4j.pax.url.mvn.certificateCheck=
23:33:04  
23:33:04  #
23:33:04  # Path to the local Maven settings file.
23:33:04  # The repositories defined in this file will be automatically added to the list
23:33:04  # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
23:33:04  # below is not set.
23:33:04  # The following locations are checked for the existence of the settings.xml file
23:33:04  #   * 1. looks for the specified url
23:33:04  #   * 2. if not found looks for ${user.home}/.m2/settings.xml
23:33:04  #   * 3. if not found looks for ${maven.home}/conf/settings.xml
23:33:04  #   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
23:33:04  #
23:33:04  #org.ops4j.pax.url.mvn.settings=
23:33:04  
23:33:04  #
23:33:04  # Path to the local Maven repository which is used to avoid downloading
23:33:04  # artifacts when they already exist locally.
23:33:04  # The value of this property will be extracted from the settings.xml file
23:33:04  # above, or defaulted to:
23:33:04  #     System.getProperty( "user.home" ) + "/.m2/repository"
23:33:04  #
23:33:04  org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
23:33:04  
23:33:04  #
23:33:04  # Default this to false. It's just weird to use undocumented repos
23:33:04  #
23:33:04  org.ops4j.pax.url.mvn.useFallbackRepositories=false
23:33:04  
23:33:04  #
23:33:04  # Uncomment if you don't wanna use the proxy settings
23:33:04  # from the Maven conf/settings.xml file
23:33:04  #
23:33:04  # org.ops4j.pax.url.mvn.proxySupport=false
23:33:04  
23:33:04  #
23:33:04  # Comma separated list of repositories scanned when resolving an artifact.
23:33:04  # Those repositories will be checked before iterating through the
23:33:04  #    below list of repositories and even before the local repository
23:33:04  # A repository url can be appended with zero or more of the following flags:
23:33:04  #    @snapshots  : the repository contains snaphots
23:33:04  #    @noreleases : the repository does not contain any released artifacts
23:33:04  #
23:33:04  # The following property value will add the system folder as a repo.
23:33:04  #
23:33:04  org.ops4j.pax.url.mvn.defaultRepositories=\
23:33:04      file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
23:33:04      file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
23:33:04      file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
23:33:04  
23:33:04  # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
23:33:04  #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
23:33:04  
23:33:04  #
23:33:04  # Comma separated list of repositories scanned when resolving an artifact.
23:33:04  # The default list includes the following repositories:
23:33:04  #    http://repo1.maven.org/maven2@id=central
23:33:04  #    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
23:33:04  #    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
23:33:04  #    http://zodiac.springsource.com/maven/bundles/release@id=gemini
23:33:04  #    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
23:33:04  #    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
23:33:04  #    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
23:33:04  # To add repositories to the default ones, prepend '+' to the list of repositories
23:33:04  # to add.
23:33:04  # A repository url can be appended with zero or more of the following flags:
23:33:04  #    @snapshots  : the repository contains snapshots
23:33:04  #    @noreleases : the repository does not contain any released artifacts
23:33:04  #    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
23:33:04  #
23:33:04  org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
23:33:04  
23:33:04  ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.
23:33:04  Configuring the startup features...
23:33:04  + [[ True == \T\r\u\e ]]
23:33:04  + echo 'Configuring the startup features...'
23:33:04  + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:33:04  + FEATURE_TEST_STRING=features-test
23:33:04  + FEATURE_TEST_VERSION=0.24.0-SNAPSHOT
23:33:04  + KARAF_VERSION=karaf4
23:33:04  + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
23:33:04  + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:33:04  + [[ ! -z '' ]]
23:33:04  + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:33:04  ################################################################################
23:33:04  #
23:33:04  #    Licensed to the Apache Software Foundation (ASF) under one or more
23:33:04  #    contributor license agreements.  See the NOTICE file distributed with
23:33:04  #    this work for additional information regarding copyright ownership.
23:33:04  #    The ASF licenses this file to You under the Apache License, Version 2.0
23:33:04  #    (the "License"); you may not use this file except in compliance with
23:33:04  #    the License.  You may obtain a copy of the License at
23:33:04  #
23:33:04  #       http://www.apache.org/licenses/LICENSE-2.0
23:33:04  #
23:33:04  #    Unless required by applicable law or agreed to in writing, software
23:33:04  #    distributed under the License is distributed on an "AS IS" BASIS,
23:33:04  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
23:33:04  #    See the License for the specific language governing permissions and
23:33:04  #    limitations under the License.
23:33:04  #
23:33:04  ################################################################################
23:33:04  
23:33:04  #
23:33:04  # Comma separated list of features repositories to register by default
23:33:04  #
23:33:04  featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/f971451c-c5be-4a98-99c8-e87cb35263f3.xml
23:33:04  
23:33:04  #
23:33:04  # Comma separated list of features to install at startup
23:33:04  #
23:33:04  featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, d304288b-5506-47e7-8268-e28eb4943257
23:33:04  
23:33:04  #
23:33:04  # Resource repositories (OBR) that the features resolver can use
23:33:04  # to resolve requirements/capabilities
23:33:04  #
23:33:04  # The format of the resourceRepositories is 
23:33:04  # resourceRepositories=[xml:url|json:url],...
23:33:04  # for Instance:
23:33:04  #
23:33:04  #resourceRepositories=xml:http://host/path/to/index.xml
23:33:04  # or
23:33:04  #resourceRepositories=json:http://host/path/to/index.json
23:33:04  #
23:33:04  
23:33:04  #
23:33:04  # Defines if the boot features are started in asynchronous mode (in a dedicated thread)
23:33:04  #
23:33:04  featuresBootAsynchronous=false
23:33:04  
23:33:04  #
23:33:04  # Service requirements enforcement
23:33:04  #
23:33:04  # By default, the feature resolver checks the service requirements/capabilities of
23:33:04  # bundles for new features (xml schema >= 1.3.0) in order to automatically installs
23:33:04  # the required bundles.
23:33:04  # The following flag can have those values:
23:33:04  #   - disable: service requirements are completely ignored
23:33:04  #   - default: service requirements are ignored for old features
23:33:04  #   - enforce: service requirements are always verified
23:33:04  #
23:33:04  #serviceRequirements=default
23:33:04  
23:33:04  #
23:33:04  # Store cfg file for config element in feature
23:33:04  #
23:33:04  #configCfgStore=true
23:33:04  
23:33:04  #
23:33:04  # Define if the feature service automatically refresh bundles
23:33:04  #
23:33:04  autoRefresh=true
23:33:04  
23:33:04  #
23:33:04  # Configuration of features processing mechanism (overrides, blacklisting, modification of features)
23:33:04  # XML file defines instructions related to features processing
23:33:04  # versions.properties may declare properties to resolve placeholders in XML file
23:33:04  # both files are relative to ${karaf.etc}
23:33:04  #
23:33:04  #featureProcessing=org.apache.karaf.features.xml
23:33:04  #featureProcessingVersions=versions.properties
23:33:04  + configure_karaf_log karaf4 ''
23:33:04  + local -r karaf_version=karaf4
23:33:04  + local -r controllerdebugmap=
23:33:04  + local logapi=log4j
23:33:04  + grep log4j2 /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:33:04  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
23:33:04  log4j2.rootLogger.level = INFO
23:33:04  #log4j2.rootLogger.type = asyncRoot
23:33:04  #log4j2.rootLogger.includeLocation = false
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
23:33:04  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
23:33:04  log4j2.rootLogger.appenderRef.Console.ref = Console
23:33:04  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
23:33:04  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
23:33:04  log4j2.logger.spifly.name = org.apache.aries.spifly
23:33:04  log4j2.logger.spifly.level = WARN
23:33:04  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
23:33:04  log4j2.logger.audit.level = INFO
23:33:04  log4j2.logger.audit.additivity = false
23:33:04  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
23:33:04  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
23:33:04  log4j2.appender.console.type = Console
23:33:04  log4j2.appender.console.name = Console
23:33:04  log4j2.appender.console.layout.type = PatternLayout
23:33:04  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
23:33:04  log4j2.appender.rolling.type = RollingRandomAccessFile
23:33:04  log4j2.appender.rolling.name = RollingFile
23:33:04  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
23:33:04  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
23:33:04  #log4j2.appender.rolling.immediateFlush = false
23:33:04  log4j2.appender.rolling.append = true
23:33:04  log4j2.appender.rolling.layout.type = PatternLayout
23:33:04  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
23:33:04  log4j2.appender.rolling.policies.type = Policies
23:33:04  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
23:33:04  log4j2.appender.rolling.policies.size.size = 64MB
23:33:04  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
23:33:04  log4j2.appender.rolling.strategy.max = 7
23:33:04  log4j2.appender.audit.type = RollingRandomAccessFile
23:33:04  log4j2.appender.audit.name = AuditRollingFile
23:33:04  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
23:33:04  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
23:33:04  log4j2.appender.audit.append = true
23:33:04  log4j2.appender.audit.layout.type = PatternLayout
23:33:04  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
23:33:04  log4j2.appender.audit.policies.type = Policies
23:33:04  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
23:33:04  log4j2.appender.audit.policies.size.size = 8MB
23:33:04  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
23:33:04  log4j2.appender.audit.strategy.max = 7
23:33:04  log4j2.appender.osgi.type = PaxOsgi
23:33:04  log4j2.appender.osgi.name = PaxOsgi
23:33:04  log4j2.appender.osgi.filter = *
23:33:04  #log4j2.logger.aether.name = shaded.org.eclipse.aether
23:33:04  #log4j2.logger.aether.level = TRACE
23:33:04  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
23:33:04  #log4j2.logger.http-headers.level = DEBUG
23:33:04  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
23:33:04  #log4j2.logger.maven.level = TRACE
23:33:04  Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
23:33:04  + logapi=log4j2
23:33:04  + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
23:33:04  + '[' log4j2 == log4j2 ']'
23:33:04  + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:33:04  + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
23:33:04  + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
23:33:04  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
23:33:04  controllerdebugmap: 
23:33:04  cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:33:04  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
23:33:04  + unset IFS
23:33:04  + echo 'controllerdebugmap: '
23:33:04  + '[' -n '' ']'
23:33:04  + echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
23:33:04  + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:33:04  ################################################################################
23:33:04  #
23:33:04  #    Licensed to the Apache Software Foundation (ASF) under one or more
23:33:04  #    contributor license agreements.  See the NOTICE file distributed with
23:33:04  #    this work for additional information regarding copyright ownership.
23:33:04  #    The ASF licenses this file to You under the Apache License, Version 2.0
23:33:04  #    (the "License"); you may not use this file except in compliance with
23:33:04  #    the License.  You may obtain a copy of the License at
23:33:04  #
23:33:04  #       http://www.apache.org/licenses/LICENSE-2.0
23:33:04  #
23:33:04  #    Unless required by applicable law or agreed to in writing, software
23:33:04  #    distributed under the License is distributed on an "AS IS" BASIS,
23:33:04  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
23:33:04  #    See the License for the specific language governing permissions and
23:33:04  #    limitations under the License.
23:33:04  #
23:33:04  ################################################################################
23:33:04  
23:33:04  # Common pattern layout for appenders
23:33:04  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
23:33:04  
23:33:04  # Root logger
23:33:04  log4j2.rootLogger.level = INFO
23:33:04  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
23:33:04  #log4j2.rootLogger.type = asyncRoot
23:33:04  #log4j2.rootLogger.includeLocation = false
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
23:33:04  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
23:33:04  log4j2.rootLogger.appenderRef.Console.ref = Console
23:33:04  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
23:33:04  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
23:33:04  
23:33:04  # Filters for logs marked by org.opendaylight.odlparent.Markers
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
23:33:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
23:33:04  
23:33:04  # Loggers configuration
23:33:04  
23:33:04  # Spifly logger
23:33:04  log4j2.logger.spifly.name = org.apache.aries.spifly
23:33:04  log4j2.logger.spifly.level = WARN
23:33:04  
23:33:04  # Security audit logger
23:33:04  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
23:33:04  log4j2.logger.audit.level = INFO
23:33:04  log4j2.logger.audit.additivity = false
23:33:04  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
23:33:04  
23:33:04  # Appenders configuration
23:33:04  
23:33:04  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
23:33:04  log4j2.appender.console.type = Console
23:33:04  log4j2.appender.console.name = Console
23:33:04  log4j2.appender.console.layout.type = PatternLayout
23:33:04  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
23:33:04  
23:33:04  # Rolling file appender
23:33:04  log4j2.appender.rolling.type = RollingRandomAccessFile
23:33:04  log4j2.appender.rolling.name = RollingFile
23:33:04  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
23:33:04  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
23:33:04  # uncomment to not force a disk flush
23:33:04  #log4j2.appender.rolling.immediateFlush = false
23:33:04  log4j2.appender.rolling.append = true
23:33:04  log4j2.appender.rolling.layout.type = PatternLayout
23:33:04  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
23:33:04  log4j2.appender.rolling.policies.type = Policies
23:33:04  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
23:33:04  log4j2.appender.rolling.policies.size.size = 1GB
23:33:04  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
23:33:04  log4j2.appender.rolling.strategy.max = 7
23:33:04  
23:33:04  # Audit file appender
23:33:04  log4j2.appender.audit.type = RollingRandomAccessFile
23:33:04  log4j2.appender.audit.name = AuditRollingFile
23:33:04  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
23:33:04  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
23:33:04  log4j2.appender.audit.append = true
23:33:04  log4j2.appender.audit.layout.type = PatternLayout
23:33:04  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
23:33:04  log4j2.appender.audit.policies.type = Policies
23:33:04  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
23:33:04  log4j2.appender.audit.policies.size.size = 8MB
23:33:04  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
23:33:04  log4j2.appender.audit.strategy.max = 7
23:33:04  
23:33:04  # OSGi appender
23:33:04  log4j2.appender.osgi.type = PaxOsgi
23:33:04  log4j2.appender.osgi.name = PaxOsgi
23:33:04  log4j2.appender.osgi.filter = *
23:33:04  
23:33:04  # help with identification of maven-related problems with pax-url-aether
23:33:04  #log4j2.logger.aether.name = shaded.org.eclipse.aether
23:33:04  #log4j2.logger.aether.level = TRACE
23:33:04  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
23:33:04  #log4j2.logger.http-headers.level = DEBUG
23:33:04  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
23:33:04  #log4j2.logger.maven.level = TRACE
23:33:04  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
23:33:04  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
23:33:04  + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:04  Configure
23:33:04      java home: /usr/lib/jvm/java-21-openjdk-amd64
23:33:04      max memory: 3072m
23:33:04      memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:04  + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
23:33:04  + local -r controllermem=3072m
23:33:04  + local -r memconf=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:04  + echo Configure
23:33:04  + echo '    java home: /usr/lib/jvm/java-21-openjdk-amd64'
23:33:04  + echo '    max memory: 3072m'
23:33:04  + echo '    memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
23:33:04  + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:04  + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:04  cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:04  + echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
23:33:04  + cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:04  #!/bin/sh
23:33:04  #
23:33:04  #    Licensed to the Apache Software Foundation (ASF) under one or more
23:33:04  #    contributor license agreements.  See the NOTICE file distributed with
23:33:04  #    this work for additional information regarding copyright ownership.
23:33:04  #    The ASF licenses this file to You under the Apache License, Version 2.0
23:33:04  #    (the "License"); you may not use this file except in compliance with
23:33:04  #    the License.  You may obtain a copy of the License at
23:33:04  #
23:33:04  #       http://www.apache.org/licenses/LICENSE-2.0
23:33:04  #
23:33:04  #    Unless required by applicable law or agreed to in writing, software
23:33:04  #    distributed under the License is distributed on an "AS IS" BASIS,
23:33:04  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
23:33:04  #    See the License for the specific language governing permissions and
23:33:04  #    limitations under the License.
23:33:04  #
23:33:04  
23:33:04  #
23:33:04  # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
23:33:04  # script: client, instance, shell, start, status, stop, karaf
23:33:04  #
23:33:04  # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
23:33:04  #   Actions go here...
23:33:04  # fi
23:33:04  
23:33:04  #
23:33:04  # general settings which should be applied for all scripts go here; please keep
23:33:04  # in mind that it is possible that scripts might be executed more than once, e.g.
23:33:04  # in example of the start script where the start script is executed first and the
23:33:04  # karaf script afterwards.
23:33:04  #
23:33:04  
23:33:04  #
23:33:04  # The following section shows the possible configuration options for the default 
23:33:04  # karaf scripts
23:33:04  #
23:33:04  export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
23:33:04  # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
23:33:04  # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
23:33:04  # export EXTRA_JAVA_OPTS # Additional JVM options
23:33:04  # export KARAF_HOME # Karaf home folder
23:33:04  # export KARAF_DATA # Karaf data folder
23:33:04  # export KARAF_BASE # Karaf base folder
23:33:04  # export KARAF_ETC  # Karaf etc  folder
23:33:04  # export KARAF_LOG  # Karaf log  folder
23:33:04  # export KARAF_SYSTEM_OPTS # First citizen Karaf options
23:33:04  # export KARAF_OPTS # Additional available Karaf options
23:33:04  # export KARAF_DEBUG # Enable debug mode
23:33:04  # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
23:33:04  # export KARAF_NOROOT # Prevent execution as root if set to true
23:33:04  Set Java version
23:33:04  + echo 'Set Java version'
23:33:04  + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
23:33:04  sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
23:33:04  sudo: a password is required
23:33:04  + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
23:33:04  sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
23:33:04  sudo: a password is required
23:33:04  JDK default version ...
23:33:04  + echo 'JDK default version ...'
23:33:04  + java -version
23:33:05  openjdk version "21.0.10" 2026-01-20
23:33:05  OpenJDK Runtime Environment (build 21.0.10+7-Ubuntu-122.04)
23:33:05  OpenJDK 64-Bit Server VM (build 21.0.10+7-Ubuntu-122.04, mixed mode, sharing)
23:33:05  Set JAVA_HOME
23:33:05  + echo 'Set JAVA_HOME'
23:33:05  + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
23:33:05  + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
23:33:05  ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
23:33:05  Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
23:33:05  Listing all open ports on controller system...
23:33:05  + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
23:33:05  + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
23:33:05  + echo 'Listing all open ports on controller system...'
23:33:05  + netstat -pnatu
23:33:05  /tmp/configuration-script.sh: line 40: netstat: command not found
23:33:05  Custom shard config exists!!!
23:33:05  + '[' -f /tmp/custom_shard_config.txt ']'
23:33:05  + echo 'Custom shard config exists!!!'
23:33:05  Copying the shard config...
23:33:05  + echo 'Copying the shard config...'
23:33:05  + cp /tmp/custom_shard_config.txt /tmp/karaf-0.24.0-SNAPSHOT/bin/
23:33:05  Configuring cluster
23:33:05  + echo 'Configuring cluster'
23:33:05  + /tmp/karaf-0.24.0-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.74 10.30.171.136 10.30.170.57
23:33:05  ################################################
23:33:05  ##             Configure Cluster              ##
23:33:05  ################################################
23:33:05   NOTE: Cluster configuration files not found. Copying from
23:33:05   /tmp/karaf-0.24.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/12.0.3
23:33:05  Configuring unique name in pekko.conf
23:33:05  Configuring hostname in pekko.conf
23:33:05  Configuring data and rpc seed nodes in pekko.conf
23:33:05  modules = [
23:33:05  	
23:33:05  	{
23:33:05  		name = "inventory"
23:33:05  		namespace = "urn:opendaylight:inventory"
23:33:05  		shard-strategy = "module"
23:33:05  	},
23:33:05  	{
23:33:05  		name = "topology"
23:33:05  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
23:33:05  		shard-strategy = "module"
23:33:05  	},
23:33:05  	{
23:33:05  		name = "toaster"
23:33:05  		namespace = "http://netconfcentral.org/ns/toaster"
23:33:05  		shard-strategy = "module"
23:33:05  	},
23:33:05  	{
23:33:05  		name = "car"
23:33:05  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
23:33:05  		shard-strategy = "module"
23:33:05  	},
23:33:05  	{
23:33:05  		name = "people"
23:33:05  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
23:33:05  		shard-strategy = "module"
23:33:05  	},
23:33:05  	{
23:33:05  		name = "car-people"
23:33:05  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
23:33:05  		shard-strategy = "module"
23:33:05  	}
23:33:05  ]
23:33:05  Configuring replication type in module-shards.conf
23:33:05  ################################################
23:33:05  ##   NOTE: Manually restart controller to     ##
23:33:05  ##         apply configuration.               ##
23:33:05  ################################################
23:33:05  Dump pekko.conf
23:33:05  + echo 'Dump pekko.conf'
23:33:05  + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:33:05  
23:33:05  odl-cluster-data {
23:33:05    pekko {
23:33:05      remote {
23:33:05        artery {
23:33:05          enabled = on
23:33:05          transport = tcp
23:33:05          canonical.hostname = "10.30.170.57"
23:33:05          canonical.port = 2550
23:33:05        }
23:33:05      }
23:33:05  
23:33:05      cluster {
23:33:05        # Using artery.
23:33:05        seed-nodes = ["pekko://opendaylight-cluster-data@10.30.171.74:2550",
23:33:05  				"pekko://opendaylight-cluster-data@10.30.171.136:2550",
23:33:05  				"pekko://opendaylight-cluster-data@10.30.170.57:2550"]
23:33:05  
23:33:05        roles = ["member-3"]
23:33:05  
23:33:05        # when under load we might trip a false positive on the failure detector
23:33:05        # failure-detector {
23:33:05          # heartbeat-interval = 4 s
23:33:05          # acceptable-heartbeat-pause = 16s
23:33:05        # }
23:33:05      }
23:33:05  
23:33:05      persistence {
23:33:05        # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
23:33:05        # modifying the following two properties. The directory location specified may be a relative or absolute path. 
23:33:05        # The relative path is always relative to KARAF_HOME.
23:33:05  
23:33:05        # snapshot-store.local.dir = "target/snapshots"
23:33:05      }
23:33:05      disable-default-actor-system-quarantined-event-handling = "false"
23:33:05    }
23:33:05  }
23:33:05  Dump modules.conf
23:33:05  + echo 'Dump modules.conf'
23:33:05  + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:33:05  modules = [
23:33:05  	
23:33:05  	{
23:33:05  		name = "inventory"
23:33:05  		namespace = "urn:opendaylight:inventory"
23:33:05  		shard-strategy = "module"
23:33:05  	},
23:33:05  	{
23:33:05  		name = "topology"
23:33:05  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
23:33:05  		shard-strategy = "module"
23:33:05  	},
23:33:05  	{
23:33:05  		name = "toaster"
23:33:05  		namespace = "http://netconfcentral.org/ns/toaster"
23:33:05  		shard-strategy = "module"
23:33:05  	},
23:33:05  	{
23:33:05  		name = "car"
23:33:05  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
23:33:05  		shard-strategy = "module"
23:33:05  	},
23:33:05  	{
23:33:05  		name = "people"
23:33:05  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
23:33:05  		shard-strategy = "module"
23:33:05  	},
23:33:05  	{
23:33:05  		name = "car-people"
23:33:05  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
23:33:05  		shard-strategy = "module"
23:33:05  	}
23:33:05  ]
23:33:05  Dump module-shards.conf
23:33:05  + echo 'Dump module-shards.conf'
23:33:05  + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:33:05  module-shards = [
23:33:05  	{
23:33:05  		name = "default"
23:33:05  		shards = [
23:33:05  			{
23:33:05  				name = "default"
23:33:05  				replicas = ["member-1",
23:33:05  				"member-2",
23:33:05  				"member-3"]
23:33:05  			}
23:33:05  		]
23:33:05  	},
23:33:05  	{
23:33:05  		name = "inventory"
23:33:05  		shards = [
23:33:05  			{
23:33:05  				name="inventory"
23:33:05  				replicas = ["member-1",
23:33:05  				"member-2",
23:33:05  				"member-3"]
23:33:05  			}
23:33:05  		]
23:33:05  	},
23:33:05  	{
23:33:05  		name = "topology"
23:33:05  		shards = [
23:33:05  			{
23:33:05  				name="topology"
23:33:05  				replicas = ["member-1",
23:33:05  				"member-2",
23:33:05  				"member-3"]
23:33:05  			}
23:33:05  		]
23:33:05  	},
23:33:05  	{
23:33:05  		name = "toaster"
23:33:05  		shards = [
23:33:05  			{
23:33:05  				name="toaster"
23:33:05  				replicas = ["member-1",
23:33:05  				"member-2",
23:33:05  				"member-3"]
23:33:05  			}
23:33:05  		]
23:33:05  	},
23:33:05  	{
23:33:05  		name = "car"
23:33:05  		shards = [
23:33:05  			{
23:33:05  				name="car"
23:33:05  				replicas = ["member-1",
23:33:05  				"member-2",
23:33:05  				"member-3"]
23:33:05  			}
23:33:05  		]
23:33:05  	},
23:33:05  	{
23:33:05  		name = "people"
23:33:05  		shards = [
23:33:05  			{
23:33:05  				name="people"
23:33:05  				replicas = ["member-1",
23:33:05  				"member-2",
23:33:05  				"member-3"]
23:33:05  			}
23:33:05  		]
23:33:05  	},
23:33:05  	{
23:33:05  		name = "car-people"
23:33:05  		shards = [
23:33:05  			{
23:33:05  				name="car-people"
23:33:05  				replicas = ["member-1",
23:33:05  				"member-2",
23:33:05  				"member-3"]
23:33:05  			}
23:33:05  		]
23:33:05  	}
23:33:05  ]
23:33:05  Locating config plan to use...
23:33:05  Finished running config plans
23:33:05  Starting member-1 with IP address 10.30.171.74
23:33:05  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
23:33:05  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
23:33:05  Redirecting karaf console output to karaf_console.log
23:33:05  Starting controller...
23:33:05  start: Redirecting Karaf output to /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
23:33:05  Starting member-2 with IP address 10.30.171.136
23:33:06  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
23:33:06  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
23:33:06  Redirecting karaf console output to karaf_console.log
23:33:06  Starting controller...
23:33:06  start: Redirecting Karaf output to /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
23:33:06  Starting member-3 with IP address 10.30.170.57
23:33:06  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
23:33:07  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
23:33:07  Redirecting karaf console output to karaf_console.log
23:33:07  Starting controller...
23:33:07  start: Redirecting Karaf output to /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
23:33:07  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins6676285467712425573.sh
23:33:07  common-functions.sh is being sourced
23:33:07  common-functions environment:
23:33:07  MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
23:33:07  ACTUALFEATURES: 
23:33:07  FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
23:33:07  CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
23:33:07  LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
23:33:07  MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
23:33:07  CONTROLLERMEM: 2048m
23:33:07  AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
23:33:07  MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
23:33:07  MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
23:33:07  SUITES: 
23:33:07  
23:33:07  + echo '#################################################'
23:33:07  #################################################
23:33:07  + echo '##         Verify Cluster is UP                ##'
23:33:07  ##         Verify Cluster is UP                ##
23:33:07  + echo '#################################################'
23:33:07  #################################################
23:33:07  + create_post_startup_script
23:33:07  + cat
23:33:07  + copy_and_run_post_startup_script
23:33:07  + seed_index=1
23:33:07  ++ seq 1 3
23:33:07  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
23:33:07  + CONTROLLERIP=ODL_SYSTEM_1_IP
23:33:07  + echo 'Execute the post startup script on controller 10.30.171.74'
23:33:07  Execute the post startup script on controller 10.30.171.74
23:33:07  + scp /w/workspace/controller-csit-3node-clustering-ask-all-chromium/post-startup-script.sh 10.30.171.74:/tmp/
23:33:07  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
23:33:08  + ssh 10.30.171.74 'bash /tmp/post-startup-script.sh 1'
23:33:08  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
23:33:08  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:33:13  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:33:18  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:33:23  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:33:28  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:33:33  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:33:38  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:33:43  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:33:48  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:33:53  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:33:58  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:34:03  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:34:08  Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
23:34:13  2026-05-23T23:33:50,546 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 323 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
23:34:13  Controller is UP
23:34:13  2026-05-23T23:33:50,546 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 323 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
23:34:13  Listing all open ports on controller system...
23:34:13  /tmp/post-startup-script.sh: line 51: netstat: command not found
23:34:13  looking for "BindException: Address already in use" in log file
23:34:13  looking for "server is unhealthy" in log file
23:34:13  + '[' 1 == 0 ']'
23:34:13  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
23:34:13  + CONTROLLERIP=ODL_SYSTEM_2_IP
23:34:13  + echo 'Execute the post startup script on controller 10.30.171.136'
23:34:13  Execute the post startup script on controller 10.30.171.136
23:34:13  + scp /w/workspace/controller-csit-3node-clustering-ask-all-chromium/post-startup-script.sh 10.30.171.136:/tmp/
23:34:13  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
23:34:14  + ssh 10.30.171.136 'bash /tmp/post-startup-script.sh 2'
23:34:14  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
23:34:14  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:34:19  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:34:24  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:34:29  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:34:34  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:34:39  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:34:44  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:34:49  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:34:54  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:34:59  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:35:04  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:35:09  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:35:14  Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
23:35:19  2026-05-23T23:33:51,398 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 323 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
23:35:19  Controller is UP
23:35:19  2026-05-23T23:33:51,398 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 323 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
23:35:19  Listing all open ports on controller system...
23:35:19  /tmp/post-startup-script.sh: line 51: netstat: command not found
23:35:19  looking for "BindException: Address already in use" in log file
23:35:19  looking for "server is unhealthy" in log file
23:35:19  + '[' 2 == 0 ']'
23:35:19  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
23:35:19  + CONTROLLERIP=ODL_SYSTEM_3_IP
23:35:19  + echo 'Execute the post startup script on controller 10.30.170.57'
23:35:19  Execute the post startup script on controller 10.30.170.57
23:35:19  + scp /w/workspace/controller-csit-3node-clustering-ask-all-chromium/post-startup-script.sh 10.30.170.57:/tmp/
23:35:19  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
23:35:20  + ssh 10.30.170.57 'bash /tmp/post-startup-script.sh 3'
23:35:20  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
23:35:20  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:35:25  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:35:30  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:35:35  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:35:40  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:35:45  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:35:50  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:35:55  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:36:00  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:36:05  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:36:10  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:36:15  /tmp/post-startup-script.sh: line 4: netstat: command not found
23:36:20  Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
23:36:25  2026-05-23T23:33:50,948 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 323 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
23:36:25  Controller is UP
23:36:25  2026-05-23T23:33:50,948 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 323 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
23:36:25  Listing all open ports on controller system...
23:36:25  /tmp/post-startup-script.sh: line 51: netstat: command not found
23:36:25  looking for "BindException: Address already in use" in log file
23:36:25  looking for "server is unhealthy" in log file
23:36:25  + '[' 0 == 0 ']'
23:36:25  + seed_index=1
23:36:25  + dump_controller_threads
23:36:25  ++ seq 1 3
23:36:25  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
23:36:25  + CONTROLLERIP=ODL_SYSTEM_1_IP
23:36:25  + echo 'Let'\''s take the karaf thread dump'
23:36:25  Let's take the karaf thread dump
23:36:25  + ssh 10.30.171.74 'sudo ps aux'
23:36:25  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
23:36:26  ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-chromium/ps_before.log
23:36:26  ++ grep -v grep
23:36:26  ++ cut -f2 '-d '
23:36:26  ++ tr -s ' '
23:36:26  + pid=2096
23:36:26  + echo 'karaf main: org.apache.karaf.main.Main, pid:2096'
23:36:26  karaf main: org.apache.karaf.main.Main, pid:2096
23:36:26  + ssh 10.30.171.74 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2096'
23:36:26  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
23:36:26  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
23:36:26  + CONTROLLERIP=ODL_SYSTEM_2_IP
23:36:26  + echo 'Let'\''s take the karaf thread dump'
23:36:26  Let's take the karaf thread dump
23:36:26  + ssh 10.30.171.136 'sudo ps aux'
23:36:26  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
23:36:27  ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-chromium/ps_before.log
23:36:27  ++ grep -v grep
23:36:27  ++ tr -s ' '
23:36:27  ++ cut -f2 '-d '
23:36:27  + pid=2095
23:36:27  + echo 'karaf main: org.apache.karaf.main.Main, pid:2095'
23:36:27  karaf main: org.apache.karaf.main.Main, pid:2095
23:36:27  + ssh 10.30.171.136 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2095'
23:36:27  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
23:36:28  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
23:36:28  + CONTROLLERIP=ODL_SYSTEM_3_IP
23:36:28  + echo 'Let'\''s take the karaf thread dump'
23:36:28  Let's take the karaf thread dump
23:36:28  + ssh 10.30.170.57 'sudo ps aux'
23:36:28  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
23:36:28  ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-chromium/ps_before.log
23:36:28  ++ grep -v grep
23:36:28  ++ cut -f2 '-d '
23:36:28  ++ tr -s ' '
23:36:28  + pid=2087
23:36:28  + echo 'karaf main: org.apache.karaf.main.Main, pid:2087'
23:36:28  karaf main: org.apache.karaf.main.Main, pid:2087
23:36:28  + ssh 10.30.170.57 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2087'
23:36:28  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
23:36:29  + '[' 0 -gt 0 ']'
23:36:29  + echo 'Generating controller variables...'
23:36:29  Generating controller variables...
23:36:29  ++ seq 1 3
23:36:29  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
23:36:29  + CONTROLLERIP=ODL_SYSTEM_1_IP
23:36:29  + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.74'
23:36:29  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
23:36:29  + CONTROLLERIP=ODL_SYSTEM_2_IP
23:36:29  + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.74 -v ODL_SYSTEM_2_IP:10.30.171.136'
23:36:29  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
23:36:29  + CONTROLLERIP=ODL_SYSTEM_3_IP
23:36:29  + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.74 -v ODL_SYSTEM_2_IP:10.30.171.136 -v ODL_SYSTEM_3_IP:10.30.170.57'
23:36:29  + echo 'Generating mininet variables...'
23:36:29  Generating mininet variables...
23:36:29  ++ seq 1 0
23:36:29  + get_test_suites SUITES
23:36:29  + local __suite_list=SUITES
23:36:29  + echo 'Locating test plan to use...'
23:36:29  Locating test plan to use...
23:36:29  + testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/testplans/controller-clustering-ask-chromium.txt
23:36:29  + '[' '!' -f /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/testplans/controller-clustering-ask-chromium.txt ']'
23:36:29  + testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/testplans/controller-clustering-ask.txt
23:36:29  + '[' disabled '!=' disabled ']'
23:36:29  + echo 'Changing the testplan path...'
23:36:29  Changing the testplan path...
23:36:29  + sed s:integration:/w/workspace/controller-csit-3node-clustering-ask-all-chromium: /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/testplans/controller-clustering-ask.txt
23:36:29  + cat testplan.txt
23:36:29  # Place the suites in run order:
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/master_stability.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
23:36:29  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
23:36:29  + '[' -z '' ']'
23:36:29  ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
23:36:29  ++ tr '\012' ' '
23:36:29  + suite_list='/w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
23:36:29  + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
23:36:29  ++ SUITES='/w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
23:36:29  + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...'
23:36:29  Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...
23:36:29  + robot -N controller-clustering-ask.txt --removekeywords wuks -e exclude -e skip_if_chromium -v BUNDLEFOLDER:karaf-0.24.0-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260522.223604-498.zip -v CONTROLLER:10.30.171.74 -v CONTROLLER1:10.30.171.136 -v CONTROLLER2:10.30.170.57 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-ask-all-chromium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:chromium -v ODL_SYSTEM_IP:10.30.171.74 -v ODL_SYSTEM_1_IP:10.30.171.74 -v ODL_SYSTEM_2_IP:10.30.171.136 -v ODL_SYSTEM_3_IP:10.30.170.57 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-chromium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
23:36:29  ==============================================================================
23:36:29  controller-clustering-ask.txt                                                 
23:36:29  ==============================================================================
23:36:30  controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
23:36:30  ==============================================================================
23:36:35  Stop_All_Members :: Stop every odl node.                              | FAIL |
23:42:46  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
23:42:46  ------------------------------------------------------------------------------
23:42:46  Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
23:42:56  ------------------------------------------------------------------------------
23:42:56  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
23:49:07  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.170.57', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.57', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
23:49:07  ------------------------------------------------------------------------------
23:49:07  controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
23:49:07  3 tests, 1 passed, 2 failed
23:49:07  ==============================================================================
23:49:07  controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBroker testi...
23:49:07  ==============================================================================
23:49:14  Register_Rpc_On_Each_Node :: Register global rpc on each node of t... | FAIL |
23:49:16  ... click for list of related bugs or create a new one if needed (with the
23:49:16  "controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node"
23:49:16  reference somewhere inside)
23:49:16  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node&order=bug_status"
23:49:16  
23:49:16  ConnectionError: HTTPConnectionPool(host='10.30.170.57', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:register-constant (Caused by NewConnectionError("HTTPConnection(host='10.30.170.57', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
23:49:16  ------------------------------------------------------------------------------
23:49:16  Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL |
23:49:17  ... click for list of related bugs or create a new one if needed (with the
23:49:17  "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node"
23:49:17  reference somewhere inside)
23:49:17  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node&order=bug_status"
23:49:17  
23:49:17  ConnectionError: HTTPConnectionPool(host='10.30.170.57', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-target:get-constant (Caused by NewConnectionError("HTTPConnection(host='10.30.170.57', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
23:49:17  ------------------------------------------------------------------------------
23:49:17  Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS |
23:49:17  ------------------------------------------------------------------------------
23:49:17  Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | FAIL |
23:49:18  ... click for list of related bugs or create a new one if needed (with the
23:49:18  "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc"
23:49:18  reference somewhere inside)
23:49:18  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc&order=bug_status"
23:49:18  
23:49:18  ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
23:49:18  ------------------------------------------------------------------------------
23:49:18  Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS |
23:49:18  ------------------------------------------------------------------------------
23:49:18  Reregister_Rpc_On_Node :: Reregister the rpc.                         | PASS |
23:49:19  ------------------------------------------------------------------------------
23:49:19  Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL |
23:49:20  ... click for list of related bugs or create a new one if needed (with the
23:49:20  "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again"
23:49:20  reference somewhere inside)
23:49:20  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status"
23:49:20  
23:49:20  ConnectionError: HTTPConnectionPool(host='10.30.170.57', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-target:get-constant (Caused by NewConnectionError("HTTPConnection(host='10.30.170.57', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
23:49:20  ------------------------------------------------------------------------------
23:49:20  Unregister_Rpc_On_Each_Node :: Unregister rpc on every node.          | FAIL |
23:49:21  ... click for list of related bugs or create a new one if needed (with the
23:49:21  "controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node"
23:49:21  reference somewhere inside)
23:49:21  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node&order=bug_status"
23:49:21  
23:49:21  ConnectionError: HTTPConnectionPool(host='10.30.170.57', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:unregister-constant (Caused by NewConnectionError("HTTPConnection(host='10.30.170.57', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
23:49:21  ------------------------------------------------------------------------------
23:49:21  controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBro... | FAIL |
23:49:21  8 tests, 3 passed, 5 failed
23:49:21  ==============================================================================
23:49:21  controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
23:49:21  ==============================================================================
23:49:26  Stop_All_Members :: Stop every odl node.                              | PASS |
23:53:37  ------------------------------------------------------------------------------
23:53:37  Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
23:53:45  ------------------------------------------------------------------------------
23:53:45  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
23:54:34  Got rc: 1 or stderr was not empty: sudo: netstat: command not found
23:54:34  ------------------------------------------------------------------------------
23:54:34  controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
23:54:34  3 tests, 2 passed, 1 failed
23:54:34  ==============================================================================
23:54:34  controller-clustering-ask.txt.Rpc Provider Partition And Heal :: DOMRpcBrok...
23:54:34  ==============================================================================
23:54:39  Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | PASS |
23:54:40  ------------------------------------------------------------------------------
23:54:40  Invoke_Rpc_On_Each_Node :: Invoke get-constant rpc on every node o... | FAIL |
23:54:50  ... click for list of related bugs or create a new one if needed (with the
23:54:50  "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node"
23:54:50  reference somewhere inside)
23:54:50  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status"
23:54:50  
23:54:50  Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
23:54:50  ------------------------------------------------------------------------------
23:54:50  Isolate_One_Node :: Isolate one node with registered rpc. From the... | FAIL |
23:54:51  ... click for list of related bugs or create a new one if needed (with the
23:54:51  "controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node"
23:54:51  reference somewhere inside)
23:54:51  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node&order=bug_status"
23:54:51  
23:54:51  ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
23:54:51  ------------------------------------------------------------------------------
23:54:51  Invoke_Rpc_On_Nonisolated_Nodes :: Invoke rpc on non-islolated nodes. | FAIL |
23:56:04  ... click for list of related bugs or create a new one if needed (with the
23:56:04  "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes"
23:56:04  reference somewhere inside)
23:56:04  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes&order=bug_status"
23:56:04  
23:56:04  Keyword 'DrbCommons.Verify_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
23:56:04  ------------------------------------------------------------------------------
23:56:04  Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
23:56:04  ... click for list of related bugs or create a new one if needed (with the
23:56:04  "controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member"
23:56:04  reference somewhere inside)
23:56:04  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member&order=bug_status"
23:56:04  
23:56:04  Variable '${isolated_idx}' not found.
23:56:04  ------------------------------------------------------------------------------
23:56:04  Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-constant on every ... | FAIL |
23:56:14  ... click for list of related bugs or create a new one if needed (with the
23:56:14  "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again"
23:56:14  reference somewhere inside)
23:56:14  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status"
23:56:14  
23:56:14  Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
23:56:14  ------------------------------------------------------------------------------
23:56:14  Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes.          | PASS |
23:56:15  ------------------------------------------------------------------------------
23:56:15  controller-clustering-ask.txt.Rpc Provider Partition And Heal :: D... | FAIL |
23:56:15  7 tests, 2 passed, 5 failed
23:56:15  ==============================================================================
23:56:15  controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
23:56:15  ==============================================================================
23:56:18  Stop_All_Members :: Stop every odl node.                              | FAIL |
00:02:30  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
00:02:30  ------------------------------------------------------------------------------
00:02:30  Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
00:02:40  ------------------------------------------------------------------------------
00:02:40  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
00:08:48  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False
00:08:48  ------------------------------------------------------------------------------
00:08:48  controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
00:08:48  3 tests, 1 passed, 2 failed
00:08:48  ==============================================================================
00:08:48  controller-clustering-ask.txt.Action Provider Precedence :: DOMRpcBroker te...
00:08:48  ==============================================================================
00:09:45  Register_Rpc_On_Each_Node :: Register routed rpc on each node of t... | FAIL |
00:10:31  ... click for list of related bugs or create a new one if needed (with the
00:10:31  "controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node"
00:10:31  reference somewhere inside)
00:10:31  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node&order=bug_status"
00:10:31  
00:10:31  ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
00:10:31  ------------------------------------------------------------------------------
00:10:31  Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL |
00:12:37  ... click for list of related bugs or create a new one if needed (with the
00:12:37  "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node"
00:12:37  reference somewhere inside)
00:12:37  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node&order=bug_status"
00:12:37  
00:12:37  ReadTimeout: HTTPConnectionPool(host='10.30.171.136', port=8181): Read timed out. (read timeout=125.0)
00:12:37  ------------------------------------------------------------------------------
00:12:37  Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS |
00:12:48  ------------------------------------------------------------------------------
00:12:48  Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | FAIL |
00:13:33  ... click for list of related bugs or create a new one if needed (with the
00:13:33  "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc"
00:13:33  reference somewhere inside)
00:13:33  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc&order=bug_status"
00:13:33  
00:13:33  HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/operations/odl-mdsal-lowlevel-target:get-contexted-constant
00:13:33  ------------------------------------------------------------------------------
00:13:33  Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS |
00:14:18  ------------------------------------------------------------------------------
00:14:18  Reregister_Rpc_On_Node :: Reregister the rpc.                         | PASS |
00:15:03  ------------------------------------------------------------------------------
00:15:03  Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL |
00:17:53  ... click for list of related bugs or create a new one if needed (with the
00:17:53  "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again"
00:17:53  reference somewhere inside)
00:17:53  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status"
00:17:53  
00:17:53  ReadTimeout: HTTPConnectionPool(host='10.30.171.136', port=8181): Read timed out. (read timeout=125.0)
00:17:53  ------------------------------------------------------------------------------
00:17:53  Unregister_Rpc_On_Each_Node :: Unregister rpc on every node.          | FAIL |
00:20:09  ... click for list of related bugs or create a new one if needed (with the
00:20:09  "controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node"
00:20:09  reference somewhere inside)
00:20:09  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node&order=bug_status"
00:20:09  
00:20:09  ReadTimeout: HTTPConnectionPool(host='10.30.171.136', port=8181): Read timed out. (read timeout=125.0)
00:20:09  ------------------------------------------------------------------------------
00:20:09  controller-clustering-ask.txt.Action Provider Precedence :: DOMRpc... | FAIL |
00:20:09  8 tests, 3 passed, 5 failed
00:20:09  ==============================================================================
00:20:09  controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
00:20:09  ==============================================================================
00:21:07  Stop_All_Members :: Stop every odl node.                              | FAIL |
00:27:12  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
00:27:12  ------------------------------------------------------------------------------
00:27:12  Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
00:27:22  ------------------------------------------------------------------------------
00:27:22  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
00:33:27  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.171.74', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.74', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
00:33:27  ------------------------------------------------------------------------------
00:33:27  controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
00:33:27  3 tests, 1 passed, 2 failed
00:33:27  ==============================================================================
00:33:27  controller-clustering-ask.txt.Action Provider Partition And Heal :: DOMRpcB...
00:33:27  ==============================================================================
00:33:36  Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | FAIL |
00:33:36  ... click for list of related bugs or create a new one if needed (with the
00:33:36  "controller_clustering_ask_txt_action_provider_partition_and_heal_register_rpc_on_two_nodes"
00:33:36  reference somewhere inside)
00:33:36  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_register_rpc_on_two_nodes&order=bug_status"
00:33:36  
00:33:36  ConnectionError: HTTPConnectionPool(host='10.30.171.74', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:register-bound-constant (Caused by NewConnectionError("HTTPConnection(host='10.30.171.74', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
00:33:36  ------------------------------------------------------------------------------
00:33:36  Invoke_Rpc_On_Each_Node :: Invoke get-contexted-constant rpc on ev... | FAIL |
00:33:47  ... click for list of related bugs or create a new one if needed (with the
00:33:47  "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node"
00:33:47  reference somewhere inside)
00:33:47  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status"
00:33:47  
00:33:47  Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.171.74', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-target:get-contexted-constant (Caused by NewConnectionError("HTTPConnection(host='10.30.171.74', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
00:33:47  ------------------------------------------------------------------------------
00:33:47  Isolate_One_Node :: Isolate one node with registered rpc.             | FAIL |
00:33:47  ... click for list of related bugs or create a new one if needed (with the
00:33:47  "controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node"
00:33:47  reference somewhere inside)
00:33:47  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node&order=bug_status"
00:33:47  
00:33:47  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.57:8181/rests/operations/odl-mdsal-lowlevel-target:get-contexted-constant
00:33:47  ------------------------------------------------------------------------------
00:33:47  Invoke_Rpc_On_Remaining_Nodes :: Invoke rpc on non-islolated nodes... | FAIL |
00:35:02  ... click for list of related bugs or create a new one if needed (with the
00:35:02  "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes"
00:35:02  reference somewhere inside)
00:35:02  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes&order=bug_status"
00:35:02  
00:35:02  Keyword 'DrbCommons.Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.171.74', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-target:get-contexted-constant (Caused by NewConnectionError("HTTPConnection(host='10.30.171.74', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
00:35:02  ------------------------------------------------------------------------------
00:35:02  Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
00:35:02  ... click for list of related bugs or create a new one if needed (with the
00:35:02  "controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member"
00:35:02  reference somewhere inside)
00:35:02  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member&order=bug_status"
00:35:02  
00:35:02  Variable '${isolated_idx}' not found.
00:35:02  ------------------------------------------------------------------------------
00:35:02  Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-contexted-constant... | FAIL |
00:35:14  ... click for list of related bugs or create a new one if needed (with the
00:35:14  "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again"
00:35:14  reference somewhere inside)
00:35:14  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status"
00:35:14  
00:35:14  Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.171.74', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-target:get-contexted-constant (Caused by NewConnectionError("HTTPConnection(host='10.30.171.74', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
00:35:14  ------------------------------------------------------------------------------
00:35:14  Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes.          | FAIL |
00:35:14  ... click for list of related bugs or create a new one if needed (with the
00:35:14  "controller_clustering_ask_txt_action_provider_partition_and_heal_unregister_rpc_on_each_node"
00:35:14  reference somewhere inside)
00:35:14  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_unregister_rpc_on_each_node&order=bug_status"
00:35:14  
00:35:14  ConnectionError: HTTPConnectionPool(host='10.30.171.74', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:unregister-bound-constant (Caused by NewConnectionError("HTTPConnection(host='10.30.171.74', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
00:35:14  ------------------------------------------------------------------------------
00:35:14  controller-clustering-ask.txt.Action Provider Partition And Heal :... | FAIL |
00:35:14  7 tests, 0 passed, 7 failed
00:35:14  ==============================================================================
00:35:14  controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
00:35:14  ==============================================================================
00:35:23  Stop_All_Members :: Stop every odl node.                              | PASS |
00:35:30  ------------------------------------------------------------------------------
00:35:30  Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
00:35:39  ------------------------------------------------------------------------------
00:35:39  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
00:43:08  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.136', port=8181): Read timed out. (read timeout=125.0)
00:43:08  ------------------------------------------------------------------------------
00:43:08  controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
00:43:08  3 tests, 2 passed, 1 failed
00:43:08  ==============================================================================
00:43:08  controller-clustering-ask.txt.Master Stability :: Cluster Singleton testing...
00:43:08  ==============================================================================
00:44:06  Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
00:46:57  ... click for list of related bugs or create a new one if needed (with the
00:46:57  "controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
00:46:57  reference somewhere inside)
00:46:57  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"
00:46:57  
00:46:57  ReadTimeout: HTTPConnectionPool(host='10.30.171.136', port=8181): Read timed out. (read timeout=125.0)
00:46:57  ------------------------------------------------------------------------------
00:46:57  Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
00:47:07  ... click for list of related bugs or create a new one if needed (with the
00:47:07  "controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node"
00:47:07  reference somewhere inside)
00:47:07  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"
00:47:07  
00:47:07  Variable '@{cs_candidates}' not found. Did you mean:
00:47:07      @{cs_exp_candidates}
00:47:07  ------------------------------------------------------------------------------
00:47:07  Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
00:47:52  ... click for list of related bugs or create a new one if needed (with the
00:47:52  "controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered"
00:47:52  reference somewhere inside)
00:47:52  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"
00:47:52  
00:47:52  Variable '${cs_owner}' not found.
00:47:52  ------------------------------------------------------------------------------
00:47:52  Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
00:48:37  ... click for list of related bugs or create a new one if needed (with the
00:48:37  "controller_clustering_ask_txt_master_stability_reregister_singleton_constant"
00:48:37  reference somewhere inside)
00:48:37  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_reregister_singleton_constant&order=bug_status"
00:48:37  
00:48:37  Variable '${unregistered_node}' not found.
00:48:37  ------------------------------------------------------------------------------
00:48:37  Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
00:49:22  ... click for list of related bugs or create a new one if needed (with the
00:49:22  "controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration"
00:49:22  reference somewhere inside)
00:49:22  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration&order=bug_status"
00:49:22  
00:49:22  Variable '${cs_owner}' not found.
00:49:22  ------------------------------------------------------------------------------
00:49:22  Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
00:52:13  ... click for list of related bugs or create a new one if needed (with the
00:52:13  "controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node"
00:52:13  reference somewhere inside)
00:52:13  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"
00:52:13  
00:52:13  ReadTimeout: HTTPConnectionPool(host='10.30.171.136', port=8181): Read timed out. (read timeout=125.0)
00:52:13  ------------------------------------------------------------------------------
00:52:13  controller-clustering-ask.txt.Master Stability :: Cluster Singleto... | FAIL |
00:52:13  6 tests, 0 passed, 6 failed
00:52:13  ==============================================================================
00:52:13  controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
00:52:13  ==============================================================================
00:53:11  Stop_All_Members :: Stop every odl node.                              | FAIL |
00:59:27  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
00:59:27  ------------------------------------------------------------------------------
00:59:27  Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
00:59:40  ------------------------------------------------------------------------------
00:59:40  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
01:05:48  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False
01:05:48  ------------------------------------------------------------------------------
01:05:48  controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
01:05:48  3 tests, 1 passed, 2 failed
01:05:48  ==============================================================================
01:05:48  controller-clustering-ask.txt.Partition And Heal :: Cluster Singleton testi...
01:05:48  ==============================================================================
01:07:05  Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
01:09:56  ... click for list of related bugs or create a new one if needed (with the
01:09:56  "controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node"
01:09:56  reference somewhere inside)
01:09:56  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"
01:09:56  
01:09:56  ReadTimeout: HTTPConnectionPool(host='10.30.171.136', port=8181): Read timed out. (read timeout=125.0)
01:09:56  ------------------------------------------------------------------------------
01:09:56  Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
01:10:27  ... click for list of related bugs or create a new one if needed (with the
01:10:27  "controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node"
01:10:27  reference somewhere inside)
01:10:27  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"
01:10:27  
01:10:27  Could not parse owner and candidates for device get-singleton-constant-service']
01:10:27  ------------------------------------------------------------------------------
01:10:27  Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
01:11:12  ... click for list of related bugs or create a new one if needed (with the
01:11:12  "controller_clustering_ask_txt_partition_and_heal_isolate_owner_node"
01:11:12  reference somewhere inside)
01:11:12  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_isolate_owner_node&order=bug_status"
01:11:12  
01:11:12  Variable '${cs_owner}' not found.
01:11:12  ------------------------------------------------------------------------------
01:11:12  Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
01:11:57  ... click for list of related bugs or create a new one if needed (with the
01:11:57  "controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated"
01:11:57  reference somewhere inside)
01:11:57  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"
01:11:57  
01:11:57  Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
01:11:57  ------------------------------------------------------------------------------
01:11:57  Rejoin_Isolated_node :: Rejoin isolated node.                         | FAIL |
01:12:42  ... click for list of related bugs or create a new one if needed (with the
01:12:42  "controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node"
01:12:42  reference somewhere inside)
01:12:42  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"
01:12:42  
01:12:42  Variable '${cs_isolated_index}' not found.
01:12:42  ------------------------------------------------------------------------------
01:12:42  Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
01:15:33  ... click for list of related bugs or create a new one if needed (with the
01:15:33  "controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
01:15:33  reference somewhere inside)
01:15:33  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"
01:15:33  
01:15:33  ReadTimeout: HTTPConnectionPool(host='10.30.171.136', port=8181): Read timed out. (read timeout=125.0)
01:15:33  ------------------------------------------------------------------------------
01:15:33  controller-clustering-ask.txt.Partition And Heal :: Cluster Single... | FAIL |
01:15:33  6 tests, 0 passed, 6 failed
01:15:33  ==============================================================================
01:15:33  controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
01:15:33  ==============================================================================
01:16:50  Stop_All_Members :: Stop every odl node.                              | FAIL |
01:25:00  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
01:25:00  ------------------------------------------------------------------------------
01:25:00  Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
01:25:09  ------------------------------------------------------------------------------
01:25:09  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
01:31:17  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False
01:31:17  ------------------------------------------------------------------------------
01:31:17  controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
01:31:17  3 tests, 1 passed, 2 failed
01:31:17  ==============================================================================
01:31:17  controller-clustering-ask.txt.Chasing The Leader :: Cluster Singleton testi...
01:31:17  ==============================================================================
01:31:53  Register_Candidates :: Register a candidate application on each no... | FAIL |
01:32:14  ... click for list of related bugs or create a new one if needed (with the
01:32:14  "controller_clustering_ask_txt_chasing_the_leader_register_candidates"
01:32:14  reference somewhere inside)
01:32:14  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_register_candidates&order=bug_status"
01:32:14  
01:32:14  ConnectionError: HTTPConnectionPool(host='10.30.171.136', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:register-flapping-singleton (Caused by NewConnectionError("HTTPConnection(host='10.30.171.136', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
01:32:14  ------------------------------------------------------------------------------
01:32:14  Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
01:33:34  ------------------------------------------------------------------------------
01:33:34  Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
01:33:55  ... click for list of related bugs or create a new one if needed (with the
01:33:55  "controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
01:33:55  reference somewhere inside)
01:33:55  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"
01:33:55  
01:33:55  ConnectionError: HTTPConnectionPool(host='10.30.171.136', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:unregister-flapping-singleton (Caused by NewConnectionError("HTTPConnection(host='10.30.171.136', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
01:33:55  ------------------------------------------------------------------------------
01:33:55  controller-clustering-ask.txt.Chasing The Leader :: Cluster Single... | FAIL |
01:33:55  3 tests, 1 passed, 2 failed
01:33:55  ==============================================================================
01:33:55  controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
01:33:55  ==============================================================================
01:34:31  Stop_All_Members :: Stop every odl node.                              | FAIL |
01:42:38  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
01:42:38  ------------------------------------------------------------------------------
01:42:38  Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
01:42:48  ------------------------------------------------------------------------------
01:42:48  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
01:48:56  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False
01:48:56  ------------------------------------------------------------------------------
01:48:56  controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
01:48:56  3 tests, 1 passed, 2 failed
01:48:56  ==============================================================================
01:48:56  controller-clustering-ask.txt.Global Rpc Kill :: Controller functional HA t...
01:48:56  ==============================================================================
01:50:23  Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
01:50:23  Parent suite setup failed:
01:50:23  SSHException: No existing session
01:50:23  ------------------------------------------------------------------------------
01:50:23  Rpc_Before_Stopping_On_Owner :: Run rpc on the service owner.         | FAIL |
01:50:23  Parent suite setup failed:
01:50:23  SSHException: No existing session
01:50:23  ------------------------------------------------------------------------------
01:50:23  Rpc_Before_Stop_On_Successors :: Run rpc on non owher cluster nodes.  | FAIL |
01:50:23  Parent suite setup failed:
01:50:23  SSHException: No existing session
01:50:23  ------------------------------------------------------------------------------
01:50:23  Stop_Current_Owner_Member :: Stop cluster node which is the owner.    | FAIL |
01:50:23  Parent suite setup failed:
01:50:23  SSHException: No existing session
01:50:23  ------------------------------------------------------------------------------
01:50:23  Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
01:50:23  Parent suite setup failed:
01:50:23  SSHException: No existing session
01:50:23  ------------------------------------------------------------------------------
01:50:23  Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes.   | FAIL |
01:50:23  Parent suite setup failed:
01:50:23  SSHException: No existing session
01:50:23  ------------------------------------------------------------------------------
01:50:23  Restart_Stopped_Member :: Restart stopped node                        | FAIL |
01:50:23  Parent suite setup failed:
01:50:23  SSHException: No existing session
01:50:23  ------------------------------------------------------------------------------
01:50:23  Verify_New_Owner_Remained_After_Rejoin :: Verify no owner change h... | FAIL |
01:50:23  Parent suite setup failed:
01:50:23  SSHException: No existing session
01:50:23  ------------------------------------------------------------------------------
01:50:23  Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
01:50:23  Parent suite setup failed:
01:50:23  SSHException: No existing session
01:50:23  ------------------------------------------------------------------------------
01:50:23  Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
01:50:23  Parent suite setup failed:
01:50:23  SSHException: No existing session
01:50:23  ------------------------------------------------------------------------------
01:50:23  Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
01:50:23  Parent suite setup failed:
01:50:23  SSHException: No existing session
01:50:23  ------------------------------------------------------------------------------
01:50:23  controller-clustering-ask.txt.Global Rpc Kill :: Controller functi... | FAIL |
01:50:23  Suite setup failed:
01:50:23  SSHException: No existing session
01:50:23  
01:50:23  11 tests, 0 passed, 11 failed
01:50:23  ==============================================================================
01:50:24  controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
01:50:24  ==============================================================================
01:51:41  Stop_All_Members :: Stop every odl node.                              | FAIL |
01:59:50  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
01:59:50  ------------------------------------------------------------------------------
01:59:50  Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
02:00:00  ------------------------------------------------------------------------------
02:00:00  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
02:06:07  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False
02:06:07  ------------------------------------------------------------------------------
02:06:07  controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
02:06:08  3 tests, 1 passed, 2 failed
02:06:08  ==============================================================================
02:06:08  controller-clustering-ask.txt.Global Rpc Freeze :: Controller functional HA...
02:06:08  ==============================================================================
02:07:35  Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
02:07:35  Parent suite setup failed:
02:07:35  SSHException: No existing session
02:07:35  ------------------------------------------------------------------------------
02:07:35  Rpc_Before_Freezing_On_Owner :: Run rpc on the service owner.         | FAIL |
02:07:35  Parent suite setup failed:
02:07:35  SSHException: No existing session
02:07:35  ------------------------------------------------------------------------------
02:07:35  Rpc_Before_Freeze_On_Successors :: Run rpc on non owher cluster no... | FAIL |
02:07:35  Parent suite setup failed:
02:07:35  SSHException: No existing session
02:07:35  ------------------------------------------------------------------------------
02:07:35  Freeze_Current_Owner_Member :: Stop cluster node which is the owner.  | FAIL |
02:07:35  Parent suite setup failed:
02:07:35  SSHException: No existing session
02:07:35  ------------------------------------------------------------------------------
02:07:35  Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
02:07:35  Parent suite setup failed:
02:07:35  SSHException: No existing session
02:07:35  ------------------------------------------------------------------------------
02:07:35  Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes.   | FAIL |
02:07:35  Parent suite setup failed:
02:07:35  SSHException: No existing session
02:07:35  ------------------------------------------------------------------------------
02:07:35  Unfreeze_Frozen_Member :: Restart frozen node                         | FAIL |
02:07:35  Parent suite setup failed:
02:07:35  SSHException: No existing session
02:07:35  ------------------------------------------------------------------------------
02:07:35  Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
02:07:35  Parent suite setup failed:
02:07:35  SSHException: No existing session
02:07:35  ------------------------------------------------------------------------------
02:07:35  Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
02:07:35  Parent suite setup failed:
02:07:35  SSHException: No existing session
02:07:35  ------------------------------------------------------------------------------
02:07:35  Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
02:07:35  Parent suite setup failed:
02:07:35  SSHException: No existing session
02:07:35  ------------------------------------------------------------------------------
02:07:35  controller-clustering-ask.txt.Global Rpc Freeze :: Controller func... | FAIL |
02:07:35  Suite setup failed:
02:07:35  SSHException: No existing session
02:07:35  
02:07:35  10 tests, 0 passed, 10 failed
02:07:35  ==============================================================================
02:07:35  controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
02:07:35  ==============================================================================
02:08:53  Stop_All_Members :: Stop every odl node.                              | FAIL |
02:17:02  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
02:17:02  ------------------------------------------------------------------------------
02:17:02  Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
02:17:12  ------------------------------------------------------------------------------
02:17:12  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
02:23:20  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False
02:23:20  ------------------------------------------------------------------------------
02:23:20  controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
02:23:20  3 tests, 1 passed, 2 failed
02:23:20  ==============================================================================
02:23:20  controller-clustering-ask.txt.Global Rpc Isolate :: Controller functional H...
02:23:20  ==============================================================================
02:23:56  Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
02:23:56  Parent suite setup failed:
02:23:56  NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.136
02:23:56  ------------------------------------------------------------------------------
02:23:56  Rpc_Before_Isolation_On_Owner :: Run rpc on the service owner.        | FAIL |
02:23:56  Parent suite setup failed:
02:23:56  NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.136
02:23:56  ------------------------------------------------------------------------------
02:23:56  Rpc_Before_Isolation_On_Successors :: Run rpc on non owher cluster... | FAIL |
02:23:56  Parent suite setup failed:
02:23:56  NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.136
02:23:56  ------------------------------------------------------------------------------
02:23:56  Isolate_Current_Owner_Member :: Isolating cluster node which is th... | FAIL |
02:23:56  Parent suite setup failed:
02:23:56  NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.136
02:23:56  ------------------------------------------------------------------------------
02:23:56  Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
02:23:56  Parent suite setup failed:
02:23:56  NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.136
02:23:56  ------------------------------------------------------------------------------
02:23:56  Rpc_On_Isolated_Node :: Run rpc on isolated cluster node.             | FAIL |
02:23:56  Parent suite setup failed:
02:23:56  NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.136
02:23:56  ------------------------------------------------------------------------------
02:23:56  Rpc_On_Non_Isolated_Cluster_Nodes :: Run rpc on remained cluster n... | FAIL |
02:23:56  Parent suite setup failed:
02:23:56  NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.136
02:23:56  ------------------------------------------------------------------------------
02:23:56  Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
02:23:56  Parent suite setup failed:
02:23:56  NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.136
02:23:56  ------------------------------------------------------------------------------
02:23:56  Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
02:23:56  Parent suite setup failed:
02:23:56  NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.136
02:23:56  ------------------------------------------------------------------------------
02:23:56  Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
02:23:56  Parent suite setup failed:
02:23:56  NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.136
02:23:56  ------------------------------------------------------------------------------
02:23:56  Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
02:23:56  Parent suite setup failed:
02:23:56  NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.136
02:23:56  ------------------------------------------------------------------------------
02:23:56  controller-clustering-ask.txt.Global Rpc Isolate :: Controller fun... | FAIL |
02:23:56  Suite setup failed:
02:23:56  NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.136
02:23:56  
02:23:56  11 tests, 0 passed, 11 failed
02:23:56  ==============================================================================
02:23:56  controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
02:23:56  ==============================================================================
02:24:31  Stop_All_Members :: Stop every odl node.                              | FAIL |
02:32:38  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
02:32:38  ------------------------------------------------------------------------------
02:32:38  Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
02:32:48  ------------------------------------------------------------------------------
02:32:48  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
02:38:56  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False
02:38:56  ------------------------------------------------------------------------------
02:38:56  controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
02:38:56  3 tests, 1 passed, 2 failed
02:38:56  ==============================================================================
02:38:56  controller-clustering-ask.txt.Carpeople Crud :: Suite for performing basic ...
02:38:56  ==============================================================================
02:39:33  Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT.       | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  See_Added_Cars_On_Followers :: The same check on other members.       | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  See_Added_People_On_Followers :: The same check on other members.     | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  See_Added_CarPeople_On_Followers :: The same check on other members.  | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
02:39:33  Parent suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  ------------------------------------------------------------------------------
02:39:33  controller-clustering-ask.txt.Carpeople Crud :: Suite for performi... | FAIL |
02:39:33  Suite setup failed:
02:39:33  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:39:33  
02:39:33  13 tests, 0 passed, 13 failed
02:39:33  ==============================================================================
02:39:33  controller-clustering-ask.txt.Car Failover Crud :: Suite mixing basic opera...
02:39:33  ==============================================================================
02:40:08  Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
02:40:08  Parent suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  ------------------------------------------------------------------------------
02:40:08  controller-clustering-ask.txt.Car Failover Crud :: Suite mixing ba... | FAIL |
02:40:08  Suite setup failed:
02:40:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:08  
02:40:08  16 tests, 0 passed, 16 failed
02:40:08  ==============================================================================
02:40:08  controller-clustering-ask.txt.Car Persistence Recovery :: This test restart...
02:40:08  ==============================================================================
02:40:44  Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
02:40:44  Parent suite setup failed:
02:40:44  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:44  ------------------------------------------------------------------------------
02:40:44  Stop_All_Members :: Stop all controllers.                             | FAIL |
02:40:44  Parent suite setup failed:
02:40:44  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:44  ------------------------------------------------------------------------------
02:40:44  Start_All_Members :: Start all controllers (should restore the per... | FAIL |
02:40:44  Parent suite setup failed:
02:40:44  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:44  ------------------------------------------------------------------------------
02:40:44  Memorize_Leader_And_Followers :: Locate current Leader of car Shard.  | FAIL |
02:40:44  Parent suite setup failed:
02:40:44  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:44  ------------------------------------------------------------------------------
02:40:44  See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
02:40:44  Parent suite setup failed:
02:40:44  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:44  ------------------------------------------------------------------------------
02:40:44  See_Cars_On_Followers :: The same check on other members.             | FAIL |
02:40:44  Parent suite setup failed:
02:40:44  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:44  ------------------------------------------------------------------------------
02:40:44  Delete_Cars_On_Leader :: Delete cars on the new Leader.               | FAIL |
02:40:44  Parent suite setup failed:
02:40:44  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:44  ------------------------------------------------------------------------------
02:40:44  controller-clustering-ask.txt.Car Persistence Recovery :: This tes... | FAIL |
02:40:44  Suite setup failed:
02:40:44  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:40:44  
02:40:44  7 tests, 0 passed, 7 failed
02:40:44  ==============================================================================
02:40:44  controller-clustering-ask.txt.Buycar Failover :: This test focuses on testi...
02:40:44  ==============================================================================
02:41:19  Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
02:41:19  Parent suite setup failed:
02:41:19  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:19  ------------------------------------------------------------------------------
02:41:19  Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
02:41:19  Parent suite setup failed:
02:41:19  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:19  ------------------------------------------------------------------------------
02:41:19  Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
02:41:19  Parent suite setup failed:
02:41:19  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:19  ------------------------------------------------------------------------------
02:41:19  Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
02:41:19  Parent suite setup failed:
02:41:19  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:19  ------------------------------------------------------------------------------
02:41:19  Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
02:41:19  Parent suite setup failed:
02:41:19  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:19  ------------------------------------------------------------------------------
02:41:19  Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
02:41:19  Parent suite setup failed:
02:41:19  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:19  ------------------------------------------------------------------------------
02:41:19  Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
02:41:19  Parent suite setup failed:
02:41:19  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:19  ------------------------------------------------------------------------------
02:41:19  Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
02:41:19  Parent suite setup failed:
02:41:19  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:19  ------------------------------------------------------------------------------
02:41:19  Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
02:41:19  Parent suite setup failed:
02:41:19  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:19  ------------------------------------------------------------------------------
02:41:19  Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
02:41:19  Parent suite setup failed:
02:41:19  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:19  ------------------------------------------------------------------------------
02:41:19  controller-clustering-ask.txt.Buycar Failover :: This test focuses... | FAIL |
02:41:19  Suite setup failed:
02:41:19  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:19  
02:41:19  10 tests, 0 passed, 10 failed
02:41:19  ==============================================================================
02:41:19  controller-clustering-ask.txt.Entity Isolate :: Suite for performing member...
02:41:19  ==============================================================================
02:41:55  Check All Shards Before Isolate :: Check all shards in controller.    | FAIL |
02:41:55  Parent suite setup failed:
02:41:55  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:55  ------------------------------------------------------------------------------
02:41:55  Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
02:41:55  Parent suite setup failed:
02:41:55  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:55  ------------------------------------------------------------------------------
02:41:55  Check All Shards After Isolate :: Check all shards in controller.     | FAIL |
02:41:55  Parent suite setup failed:
02:41:55  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:55  ------------------------------------------------------------------------------
02:41:55  Rejoin Entity Leader :: Rejoin the entity-ownership Leader.           | FAIL |
02:41:55  Parent suite setup failed:
02:41:55  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:55  ------------------------------------------------------------------------------
02:41:55  Check All Shards After Rejoin :: Check all shards in controller.      | FAIL |
02:41:55  Parent suite setup failed:
02:41:55  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:55  ------------------------------------------------------------------------------
02:41:57  controller-clustering-ask.txt.Entity Isolate :: Suite for performi... | FAIL |
02:41:57  Suite setup failed:
02:41:57  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:41:57  
02:41:57  5 tests, 0 passed, 5 failed
02:41:57  ==============================================================================
02:41:57  controller-clustering-ask.txt.Buycar Failover Isolation :: This test focuse...
02:41:57  ==============================================================================
02:42:32  Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
02:42:32  Parent suite setup failed:
02:42:32  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:42:32  ------------------------------------------------------------------------------
02:42:32  Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
02:42:32  Parent suite setup failed:
02:42:32  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:42:32  ------------------------------------------------------------------------------
02:42:32  Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
02:42:32  Parent suite setup failed:
02:42:32  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:42:32  ------------------------------------------------------------------------------
02:42:32  Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
02:42:32  Parent suite setup failed:
02:42:32  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:42:32  ------------------------------------------------------------------------------
02:42:32  Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
02:42:32  Parent suite setup failed:
02:42:32  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:42:32  ------------------------------------------------------------------------------
02:42:32  Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
02:42:32  Parent suite setup failed:
02:42:32  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:42:32  ------------------------------------------------------------------------------
02:42:32  Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
02:42:32  Parent suite setup failed:
02:42:32  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:42:32  ------------------------------------------------------------------------------
02:42:32  Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
02:42:32  Parent suite setup failed:
02:42:32  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:42:32  ------------------------------------------------------------------------------
02:42:32  Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
02:42:32  Parent suite setup failed:
02:42:32  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:42:32  ------------------------------------------------------------------------------
02:42:32  Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
02:42:32  Parent suite setup failed:
02:42:32  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:42:32  ------------------------------------------------------------------------------
02:42:32  controller-clustering-ask.txt.Buycar Failover Isolation :: This te... | FAIL |
02:42:32  Suite setup failed:
02:42:32  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:42:32  
02:42:32  10 tests, 0 passed, 10 failed
02:42:32  ==============================================================================
02:42:32  controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite mixing b...
02:42:32  ==============================================================================
02:43:08  Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
02:43:08  Parent suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  ------------------------------------------------------------------------------
02:43:08  controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite... | FAIL |
02:43:08  Suite setup failed:
02:43:08  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:08  
02:43:08  16 tests, 0 passed, 16 failed
02:43:08  ==============================================================================
02:43:08  controller-clustering-ask.txt.Car Outage Corners :: Cluster suite for testi...
02:43:08  ==============================================================================
02:43:43  Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
02:43:43  Parent suite setup failed:
02:43:43  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:43  ------------------------------------------------------------------------------
02:43:43  Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
02:43:43  Parent suite setup failed:
02:43:43  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:43  ------------------------------------------------------------------------------
02:43:43  Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
02:43:43  Parent suite setup failed:
02:43:43  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:43  ------------------------------------------------------------------------------
02:43:43  Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower.     | FAIL |
02:43:43  Parent suite setup failed:
02:43:43  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:43  ------------------------------------------------------------------------------
02:43:43  See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
02:43:43  Parent suite setup failed:
02:43:43  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:43  ------------------------------------------------------------------------------
02:43:43  Start_Other_Followers :: Start other followers without persisted d... | FAIL |
02:43:43  Parent suite setup failed:
02:43:43  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:43  ------------------------------------------------------------------------------
02:43:43  See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
02:43:43  Parent suite setup failed:
02:43:43  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:43  ------------------------------------------------------------------------------
02:43:43  Delete_Cars_On_Leader :: Delete cars on Leader.                       | FAIL |
02:43:43  Parent suite setup failed:
02:43:43  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:43  ------------------------------------------------------------------------------
02:43:43  controller-clustering-ask.txt.Car Outage Corners :: Cluster suite ... | FAIL |
02:43:43  Suite setup failed:
02:43:43  HTTPError: 409 Client Error: Conflict for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:43:43  
02:43:43  8 tests, 0 passed, 8 failed
02:43:43  ==============================================================================
02:43:43  controller-clustering-ask.txt                                         | FAIL |
02:43:43  195 tests, 22 passed, 173 failed
02:43:43  ==============================================================================
02:43:43  Output:  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/output.xml
02:43:55  Log:     /w/workspace/controller-csit-3node-clustering-ask-all-chromium/log.html
02:43:55  Report:  /w/workspace/controller-csit-3node-clustering-ask-all-chromium/report.html
02:43:55  + true
02:43:55  + echo 'Examining the files in data/log and checking filesize'
02:43:55  Examining the files in data/log and checking filesize
02:43:55  + ssh 10.30.171.74 'ls -altr /tmp/karaf-0.24.0-SNAPSHOT/data/log/'
02:43:55  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
02:43:55  total 23524
02:43:55  drwxrwxr-x 2 jenkins jenkins     4096 May 23 23:33 .
02:43:55  -rw-rw-r-- 1 jenkins jenkins     1720 May 23 23:33 karaf_console.log
02:43:55  drwxrwxr-x 9 jenkins jenkins     4096 May 24 02:33 ..
02:43:55  -rw-rw-r-- 1 jenkins jenkins 24071735 May 24 02:43 karaf.log
02:43:55  + ssh 10.30.171.74 'du -hs /tmp/karaf-0.24.0-SNAPSHOT/data/log/*'
02:43:55  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
02:43:56  23M	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
02:43:56  4.0K	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
02:43:56  + ssh 10.30.171.136 'ls -altr /tmp/karaf-0.24.0-SNAPSHOT/data/log/'
02:43:56  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
02:43:56  total 7755840
02:43:56  -rw-rw-r-- 1 jenkins jenkins       1720 May 23 23:33 karaf_console.log
02:43:56  -rw-rw-r-- 1 jenkins jenkins 1073742148 May 24 01:02 karaf.log.1
02:43:56  -rw-rw-r-- 1 jenkins jenkins 1073742038 May 24 01:07 karaf.log.2
02:43:56  -rw-rw-r-- 1 jenkins jenkins 1073743033 May 24 01:09 karaf.log.3
02:43:56  -rw-rw-r-- 1 jenkins jenkins 1073742014 May 24 01:45 karaf.log.4
02:43:56  -rw-rw-r-- 1 jenkins jenkins 1073741877 May 24 01:50 karaf.log.5
02:43:56  -rw-rw-r-- 1 jenkins jenkins 1073742580 May 24 02:02 karaf.log.6
02:43:56  -rw-rw-r-- 1 jenkins jenkins 1073741897 May 24 02:07 karaf.log.7
02:43:56  drwxrwxr-x 2 jenkins jenkins       4096 May 24 02:08 .
02:43:56  drwxrwxr-x 9 jenkins jenkins       4096 May 24 02:32 ..
02:43:56  -rw-rw-r-- 1 jenkins jenkins  425712137 May 24 02:34 karaf.log
02:43:56  + ssh 10.30.171.136 'du -hs /tmp/karaf-0.24.0-SNAPSHOT/data/log/*'
02:43:56  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
02:43:57  406M	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
02:43:57  1.1G	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.1
02:43:57  1.1G	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.2
02:43:57  1.1G	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.3
02:43:57  1.1G	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.4
02:43:57  1.1G	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.5
02:43:57  1.1G	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.6
02:43:57  1.1G	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.7
02:43:57  4.0K	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
02:43:57  + ssh 10.30.170.57 'ls -altr /tmp/karaf-0.24.0-SNAPSHOT/data/log/'
02:43:57  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
02:43:57  total 99480
02:43:57  drwxrwxr-x 2 jenkins jenkins      4096 May 23 23:33 .
02:43:57  -rw-rw-r-- 1 jenkins jenkins      8162 May 23 23:43 karaf_console.log
02:43:57  drwxrwxr-x 4 jenkins jenkins      4096 May 24 02:32 ..
02:43:57  -rw-rw-r-- 1 jenkins jenkins 101845895 May 24 02:43 karaf.log
02:43:57  + ssh 10.30.170.57 'du -hs /tmp/karaf-0.24.0-SNAPSHOT/data/log/*'
02:43:57  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
02:43:58  98M	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
02:43:58  8.0K	/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
02:43:58  + set +e
02:43:58  ++ seq 1 3
02:43:58  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
02:43:58  + CONTROLLERIP=ODL_SYSTEM_1_IP
02:43:58  + echo 'Let'\''s take the karaf thread dump again'
02:43:58  Let's take the karaf thread dump again
02:43:58  + ssh 10.30.171.74 'sudo ps aux'
02:43:58  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
02:43:58  ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-chromium/ps_after.log
02:43:58  ++ grep -v grep
02:43:58  ++ cut -f2 '-d '
02:43:58  ++ tr -s ' '
02:43:58  + pid=53220
02:43:58  + echo 'karaf main: org.apache.karaf.main.Main, pid:53220'
02:43:58  karaf main: org.apache.karaf.main.Main, pid:53220
02:43:58  + ssh 10.30.171.74 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 53220'
02:43:58  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
02:43:59  + echo 'killing karaf process...'
02:43:59  killing karaf process...
02:43:59  + ssh 10.30.171.74 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
02:43:59  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
02:43:59  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
02:43:59  + CONTROLLERIP=ODL_SYSTEM_2_IP
02:43:59  + echo 'Let'\''s take the karaf thread dump again'
02:43:59  Let's take the karaf thread dump again
02:43:59  + ssh 10.30.171.136 'sudo ps aux'
02:43:59  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
02:43:59  ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-chromium/ps_after.log
02:43:59  ++ grep -v grep
02:43:59  ++ tr -s ' '
02:43:59  ++ cut -f2 '-d '
02:43:59  + pid=
02:43:59  + echo 'karaf main: org.apache.karaf.main.Main, pid:'
02:43:59  karaf main: org.apache.karaf.main.Main, pid:
02:43:59  + ssh 10.30.171.136 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l '
02:43:59  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
02:44:00  Usage:
02:44:00      jstack [-l][-e] <pid>
02:44:00          (to connect to running process)
02:44:00  
02:44:00  Options:
02:44:00      -l  long listing. Prints additional information about locks
02:44:00      -e  extended listing. Prints additional information about threads
02:44:00      -? -h --help -help to print this help message
02:44:00  + true
02:44:00  + echo 'killing karaf process...'
02:44:00  killing karaf process...
02:44:00  + ssh 10.30.171.136 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
02:44:00  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
02:44:00  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
02:44:00  + CONTROLLERIP=ODL_SYSTEM_3_IP
02:44:00  + echo 'Let'\''s take the karaf thread dump again'
02:44:00  Let's take the karaf thread dump again
02:44:00  + ssh 10.30.170.57 'sudo ps aux'
02:44:00  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
02:44:00  ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-chromium/ps_after.log
02:44:00  ++ grep -v grep
02:44:00  ++ tr -s ' '
02:44:00  ++ cut -f2 '-d '
02:44:00  + pid=32307
02:44:00  + echo 'karaf main: org.apache.karaf.main.Main, pid:32307'
02:44:00  karaf main: org.apache.karaf.main.Main, pid:32307
02:44:00  + ssh 10.30.170.57 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 32307'
02:44:00  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
02:44:01  + echo 'killing karaf process...'
02:44:01  killing karaf process...
02:44:01  + ssh 10.30.170.57 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
02:44:01  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
02:44:01  + sleep 5
02:44:06  ++ seq 1 3
02:44:06  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
02:44:06  + CONTROLLERIP=ODL_SYSTEM_1_IP
02:44:06  + echo 'Compressing karaf.log 1'
02:44:06  Compressing karaf.log 1
02:44:06  + ssh 10.30.171.74 gzip --best /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
02:44:06  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
02:44:07  + echo 'Fetching compressed karaf.log 1'
02:44:07  Fetching compressed karaf.log 1
02:44:07  + scp 10.30.171.74:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
02:44:07  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
02:44:07  + ssh 10.30.171.74 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz
02:44:08  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
02:44:08  + scp 10.30.171.74:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
02:44:08  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
02:44:08  + ssh 10.30.171.74 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
02:44:08  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
02:44:08  + echo 'Fetch GC logs'
02:44:08  Fetch GC logs
02:44:08  + mkdir -p gclogs-1
02:44:08  + scp '10.30.171.74:/tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log' gclogs-1/
02:44:09  Warning: Permanently added '10.30.171.74' (ED25519) to the list of known hosts.
02:44:09  scp: /tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log: No such file or directory
02:44:09  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
02:44:09  + CONTROLLERIP=ODL_SYSTEM_2_IP
02:44:09  + echo 'Compressing karaf.log 2'
02:44:09  Compressing karaf.log 2
02:44:09  + ssh 10.30.171.136 gzip --best /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
02:44:09  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
02:44:13  + echo 'Fetching compressed karaf.log 2'
02:44:13  Fetching compressed karaf.log 2
02:44:13  + scp 10.30.171.136:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
02:44:13  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
02:44:14  + ssh 10.30.171.136 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz
02:44:14  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
02:44:14  + scp 10.30.171.136:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
02:44:14  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
02:44:14  + ssh 10.30.171.136 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
02:44:14  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
02:44:15  + echo 'Fetch GC logs'
02:44:15  Fetch GC logs
02:44:15  + mkdir -p gclogs-2
02:44:15  + scp '10.30.171.136:/tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log' gclogs-2/
02:44:15  Warning: Permanently added '10.30.171.136' (ED25519) to the list of known hosts.
02:44:15  scp: /tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log: No such file or directory
02:44:15  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
02:44:15  + CONTROLLERIP=ODL_SYSTEM_3_IP
02:44:15  + echo 'Compressing karaf.log 3'
02:44:15  Compressing karaf.log 3
02:44:15  + ssh 10.30.170.57 gzip --best /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
02:44:15  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
02:44:16  + echo 'Fetching compressed karaf.log 3'
02:44:16  Fetching compressed karaf.log 3
02:44:16  + scp 10.30.170.57:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
02:44:16  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
02:44:17  + ssh 10.30.170.57 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz
02:44:17  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
02:44:17  + scp 10.30.170.57:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
02:44:17  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
02:44:17  + ssh 10.30.170.57 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
02:44:17  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
02:44:18  + echo 'Fetch GC logs'
02:44:18  Fetch GC logs
02:44:18  + mkdir -p gclogs-3
02:44:18  + scp '10.30.170.57:/tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log' gclogs-3/
02:44:18  Warning: Permanently added '10.30.170.57' (ED25519) to the list of known hosts.
02:44:18  scp: /tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log: No such file or directory
02:44:18  + echo 'Examine copied files'
02:44:18  Examine copied files
02:44:18  + ls -lt
02:44:18  total 76600
02:44:18  drwxrwxr-x 2 jenkins jenkins     4096 May 24 02:44 gclogs-3
02:44:18  -rw-rw-r-- 1 jenkins jenkins     8162 May 24 02:44 odl3_karaf_console.log
02:44:18  -rw-rw-r-- 1 jenkins jenkins  1147160 May 24 02:44 odl3_karaf.log.gz
02:44:18  drwxrwxr-x 2 jenkins jenkins     4096 May 24 02:44 gclogs-2
02:44:18  -rw-rw-r-- 1 jenkins jenkins     1720 May 24 02:44 odl2_karaf_console.log
02:44:18  -rw-rw-r-- 1 jenkins jenkins  4796820 May 24 02:44 odl2_karaf.log.gz
02:44:18  drwxrwxr-x 2 jenkins jenkins     4096 May 24 02:44 gclogs-1
02:44:18  -rw-rw-r-- 1 jenkins jenkins     1720 May 24 02:44 odl1_karaf_console.log
02:44:18  -rw-rw-r-- 1 jenkins jenkins  1027934 May 24 02:44 odl1_karaf.log.gz
02:44:18  -rw-rw-r-- 1 jenkins jenkins   145403 May 24 02:44 karaf_3_32307_threads_after.log
02:44:18  -rw-rw-r-- 1 jenkins jenkins    13956 May 24 02:44 ps_after.log
02:44:18  -rw-rw-r-- 1 jenkins jenkins        0 May 24 02:43 karaf_2__threads_after.log
02:44:18  -rw-rw-r-- 1 jenkins jenkins   135800 May 24 02:43 karaf_1_53220_threads_after.log
02:44:18  -rw-rw-r-- 1 jenkins jenkins   302388 May 24 02:43 report.html
02:44:18  -rw-rw-r-- 1 jenkins jenkins  3430423 May 24 02:43 log.html
02:44:18  -rw-rw-r-- 1 jenkins jenkins 66940893 May 24 02:43 output.xml
02:44:18  -rw-rw-r-- 1 jenkins jenkins     4120 May 23 23:36 testplan.txt
02:44:18  -rw-rw-r-- 1 jenkins jenkins   116868 May 23 23:36 karaf_3_2087_threads_before.log
02:44:18  -rw-rw-r-- 1 jenkins jenkins    13760 May 23 23:36 ps_before.log
02:44:18  -rw-rw-r-- 1 jenkins jenkins   121675 May 23 23:36 karaf_2_2095_threads_before.log
02:44:18  -rw-rw-r-- 1 jenkins jenkins   117265 May 23 23:36 karaf_1_2096_threads_before.log
02:44:18  -rw-rw-r-- 1 jenkins jenkins     3106 May 23 23:33 post-startup-script.sh
02:44:18  -rw-rw-r-- 1 jenkins jenkins      252 May 23 23:32 startup-script.sh
02:44:18  -rw-rw-r-- 1 jenkins jenkins     3472 May 23 23:32 configuration-script.sh
02:44:18  -rw-rw-r-- 1 jenkins jenkins      695 May 23 23:32 custom_shard_config.txt
02:44:18  -rw-rw-r-- 1 jenkins jenkins      135 May 23 23:32 scriptplan.txt
02:44:18  -rw-rw-r-- 1 jenkins jenkins      337 May 23 23:32 detect_variables.env
02:44:18  -rw-rw-r-- 1 jenkins jenkins     2619 May 23 23:32 pom.xml
02:44:18  -rw-rw-r-- 1 jenkins jenkins       92 May 23 23:32 set_variables.env
02:44:18  -rw-rw-r-- 1 jenkins jenkins      311 May 23 23:32 slave_addresses.txt
02:44:18  -rw-rw-r-- 1 jenkins jenkins      570 May 23 23:31 requirements.txt
02:44:18  -rw-rw-r-- 1 jenkins jenkins       26 May 23 23:31 env.properties
02:44:18  -rw-rw-r-- 1 jenkins jenkins      333 May 23 23:30 stack-parameters.yaml
02:44:18  drwxrwxr-x 7 jenkins jenkins     4096 May 23 23:29 test
02:44:18  drwxrwxr-x 2 jenkins jenkins     4096 May 23 23:29 test@tmp
02:44:18  -rw-rw-r-- 1 jenkins jenkins     1410 May 22 22:36 maven-metadata.xml
02:44:18  + true
02:44:18  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/sh /tmp/jenkins8353746028711421535.sh
02:44:18  Cleaning up Robot installation...
02:44:18  $ ssh-agent -k
02:44:18  unset SSH_AUTH_SOCK;
02:44:18  unset SSH_AGENT_PID;
02:44:18  echo Agent pid 3983 killed;
02:44:18  [ssh-agent] Stopped.
02:44:18  Recording plot data
02:44:18  Robot results publisher started...
02:44:18  INFO: Checking test criticality is deprecated and will be dropped in a future release!
02:44:18  -Parsing output xml:
02:44:20  Done!
02:44:20  -Copying log files to build dir:
02:44:22  Done!
02:44:22  -Assigning results to build:
02:44:24  Done!
02:44:24  -Checking thresholds:
02:44:24  Done!
02:44:24  Done publishing Robot results.
02:44:24  Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
02:44:24  [PostBuildScript] - [INFO] Executing post build scripts.
02:44:24  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins4745989877863519535.sh
02:44:24  Archiving csit artifacts
02:44:24  mv: cannot stat '*_1.png': No such file or directory
02:44:24  mv: cannot stat '/tmp/odl1_*': No such file or directory
02:44:24  mv: cannot stat '*_2.png': No such file or directory
02:44:24  mv: cannot stat '/tmp/odl2_*': No such file or directory
02:44:24  mv: cannot stat '*_3.png': No such file or directory
02:44:24  mv: cannot stat '/tmp/odl3_*': No such file or directory
02:44:24    % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
02:44:24                                   Dload  Upload   Total   Spent    Left  Speed
02:44:24  
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 4192k    0 4192k    0     0  3843k      0 --:--:--  0:00:01 --:--:-- 3842k
100 6131k    0 6131k    0     0  3968k      0 --:--:--  0:00:01 --:--:-- 3968k
02:44:26  Archive:  robot-plugin.zip
02:44:26    inflating: ./archives/robot-plugin/log.html  
02:44:26    inflating: ./archives/robot-plugin/output.xml  
02:44:26    inflating: ./archives/robot-plugin/report.html  
02:44:26  mv: cannot stat '*.log.gz': No such file or directory
02:44:26  mv: cannot stat '*.csv': No such file or directory
02:44:26  mv: cannot stat '*.png': No such file or directory
02:44:26  [PostBuildScript] - [INFO] Executing post build scripts.
02:44:26  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins14932461846254784719.sh
02:44:26  [PostBuildScript] - [INFO] Executing post build scripts.
02:44:26  [EnvInject] - Injecting environment variables from a build step.
02:44:26  [EnvInject] - Injecting as environment variables the properties content 
02:44:26  OS_CLOUD=vex
02:44:26  OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-chromium-11
02:44:26  
02:44:26  [EnvInject] - Variables injected successfully.
02:44:26  provisioning config files...
02:44:27  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
02:44:27  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins10517276206765450229.sh
02:44:27  ---> openstack-stack-delete.sh
02:44:27  Setup pyenv:
02:44:27    system
02:44:27    3.8.20
02:44:27    3.9.20
02:44:27    3.10.15
02:44:27  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-ask-all-chromium/.python-version)
02:44:27  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7P4t from file:/tmp/.os_lf_venv
02:44:27  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:44:27  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:44:29  lf-activate-venv(): INFO: Base packages installed successfully
02:44:29  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 
02:44:50  lf-activate-venv(): INFO: Adding /tmp/venv-7P4t/bin to PATH
02:44:50  INFO: Stack cost retrieval disabled, setting cost to 0
02:45:02  INFO: Deleting stack releng-controller-csit-3node-clustering-ask-all-chromium-11
02:45:02  Successfully deleted stack releng-controller-csit-3node-clustering-ask-all-chromium-11
02:45:02  [PostBuildScript] - [INFO] Executing post build scripts.
02:45:02  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins7669303121200724171.sh
02:45:02  ---> sysstat.sh
02:45:02  /tmp/jenkins7669303121200724171.sh: line 19: facter: command not found
02:45:02  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins15671951017858168324.sh
02:45:02  ---> package-listing.sh
02:45:02  ++ facter osfamily
02:45:02  /tmp/jenkins15671951017858168324.sh: line 19: facter: command not found
02:45:02  ++ tr '[:upper:]' '[:lower:]'
02:45:02  + OS_FAMILY=
02:45:02  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins12992623692453964790.sh
02:45:02  ---> capture-instance-metadata.sh
02:45:02  Setup pyenv:
02:45:02    system
02:45:02    3.8.20
02:45:02    3.9.20
02:45:02    3.10.15
02:45:02  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-ask-all-chromium/.python-version)
02:45:02  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7P4t from file:/tmp/.os_lf_venv
02:45:02  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:45:02  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:45:04  lf-activate-venv(): INFO: Base packages installed successfully
02:45:04  lf-activate-venv(): INFO: Installing additional packages: lftools 
02:45:13  lf-activate-venv(): INFO: Adding /tmp/venv-7P4t/bin to PATH
02:45:13  INFO: Running in OpenStack, capturing instance metadata
02:45:14  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins11652332282312535963.sh
02:45:14  provisioning config files...
02:45:14  Could not find credentials [logs] for controller-csit-3node-clustering-ask-all-chromium #11
02:45:14  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-ask-all-chromium@tmp/config2232908844705972849tmp
02:45:14  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
02:45:14  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
02:45:14  provisioning config files...
02:45:14  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
02:45:14  [EnvInject] - Injecting environment variables from a build step.
02:45:14  [EnvInject] - Injecting as environment variables the properties content 
02:45:14  SERVER_ID=logs
02:45:14  
02:45:14  [EnvInject] - Variables injected successfully.
02:45:14  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins2215125765475301702.sh
02:45:14  ---> create-netrc.sh
02:45:14  WARN: Log server credential not found.
02:45:14  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins4378164563253940177.sh
02:45:14  ---> python-tools-install.sh
02:45:14  Setup pyenv:
02:45:14    system
02:45:14    3.8.20
02:45:14    3.9.20
02:45:14    3.10.15
02:45:14  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-ask-all-chromium/.python-version)
02:45:15  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7P4t from file:/tmp/.os_lf_venv
02:45:15  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:45:15  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:45:16  lf-activate-venv(): INFO: Base packages installed successfully
02:45:16  lf-activate-venv(): INFO: Installing additional packages: lftools 
02:45:25  lf-activate-venv(): INFO: Adding /tmp/venv-7P4t/bin to PATH
02:45:25  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/sh /tmp/jenkins7051400022138981411.sh
02:45:25  ---> uv-install.sh
02:45:25  uv 0.11.16 is already installed
02:45:25  uvx 0.11.16 (x86_64-unknown-linux-gnu)
02:45:26  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins9253287730177117467.sh
02:45:26  ---> sudo-logs.sh
02:45:26  Archiving 'sudo' log..
02:45:26  /tmp/jenkins9253287730177117467.sh: line 41: facter: command not found
02:45:26  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash /tmp/jenkins2739365225253659593.sh
02:45:26  ---> job-cost.sh
02:45:26  INFO: Activating Python virtual environment...
02:45:26  Setup pyenv:
02:45:26    system
02:45:26    3.8.20
02:45:26    3.9.20
02:45:26    3.10.15
02:45:26  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-ask-all-chromium/.python-version)
02:45:26  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7P4t from file:/tmp/.os_lf_venv
02:45:26  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:45:26  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:45:28  lf-activate-venv(): INFO: Base packages installed successfully
02:45:28  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
02:45:35  lf-activate-venv(): INFO: Adding /tmp/venv-7P4t/bin to PATH
02:45:35  DEBUG: Contents of stack-cost file:
02:45:35  total: 0
02:45:35  INFO: Retrieving Stack Cost...
02:45:35  INFO: Stack cost: 0
02:45:35  INFO: Instance uptime: 11863s
02:45:35  INFO: Fetching instance metadata (attempt 1 of 3)...
02:45:35  DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
02:45:35  INFO: Successfully fetched instance metadata
02:45:35  INFO: Instance type: v3-standard-2
02:45:35  INFO: Retrieving pricing info for: v3-standard-2
02:45:35  INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
02:45:35  DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=11863
02:45:35  INFO: Successfully fetched Vexxhost pricing API
02:45:35  INFO: Retrieved cost: 0.22
02:45:35  INFO: Retrieved resource: v3-standard-2
02:45:35  INFO: Creating archive directory: /w/workspace/controller-csit-3node-clustering-ask-all-chromium/archives/cost
02:45:35  INFO: Archiving costs to: /w/workspace/controller-csit-3node-clustering-ask-all-chromium/archives/cost.csv
02:45:35  INFO: Successfully archived job cost data
02:45:35  DEBUG: Cost data: controller-csit-3node-clustering-ask-all-chromium,11,2026-05-24 02:45:35,v3-standard-2,11863,0.22,0.00,UNSTABLE
02:45:35  [controller-csit-3node-clustering-ask-all-chromium] $ /bin/bash -l /tmp/jenkins1171846994688571771.sh
02:45:35  ---> logs-deploy.sh
02:45:36  Setup pyenv:
02:45:36    system
02:45:36    3.8.20
02:45:36    3.9.20
02:45:36    3.10.15
02:45:36  * 3.11.10 (set by /w/workspace/controller-csit-3node-clustering-ask-all-chromium/.python-version)
02:45:36  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7P4t from file:/tmp/.os_lf_venv
02:45:36  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
02:45:36  lf-activate-venv(): INFO: Attempting to install with network-safe options...
02:45:38  lf-activate-venv(): INFO: Base packages installed successfully
02:45:38  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
02:45:50  lf-activate-venv(): INFO: Adding /tmp/venv-7P4t/bin to PATH
02:45:50  WARNING: Nexus logging server not set
02:45:50  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-ask-all-chromium/11/
02:45:50  INFO: archiving logs to S3
02:45:51  ---> uname -a:
02:45:51  Linux prd-ubuntu2404-robot-2c-8g-19386 6.8.0-90-generic #91-Ubuntu SMP PREEMPT_DYNAMIC Tue Nov 18 14:14:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
02:45:51  
02:45:51  
02:45:51  ---> lscpu:
02:45:51  Architecture:                         x86_64
02:45:51  CPU op-mode(s):                       32-bit, 64-bit
02:45:51  Address sizes:                        40 bits physical, 48 bits virtual
02:45:51  Byte Order:                           Little Endian
02:45:51  CPU(s):                               2
02:45:51  On-line CPU(s) list:                  0,1
02:45:51  Vendor ID:                            AuthenticAMD
02:45:51  Model name:                           AMD EPYC-Rome Processor
02:45:51  CPU family:                           23
02:45:51  Model:                                49
02:45:51  Thread(s) per core:                   1
02:45:51  Core(s) per socket:                   1
02:45:51  Socket(s):                            2
02:45:51  Stepping:                             0
02:45:51  BogoMIPS:                             5599.99
02:45:51  Flags:                                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
02:45:51  Virtualization:                       AMD-V
02:45:51  Hypervisor vendor:                    KVM
02:45:51  Virtualization type:                  full
02:45:51  L1d cache:                            64 KiB (2 instances)
02:45:51  L1i cache:                            64 KiB (2 instances)
02:45:51  L2 cache:                             1 MiB (2 instances)
02:45:51  L3 cache:                             32 MiB (2 instances)
02:45:51  NUMA node(s):                         1
02:45:51  NUMA node0 CPU(s):                    0,1
02:45:51  Vulnerability Gather data sampling:   Not affected
02:45:51  Vulnerability Itlb multihit:          Not affected
02:45:51  Vulnerability L1tf:                   Not affected
02:45:51  Vulnerability Mds:                    Not affected
02:45:51  Vulnerability Meltdown:               Not affected
02:45:51  Vulnerability Mmio stale data:        Not affected
02:45:51  Vulnerability Reg file data sampling: Not affected
02:45:51  Vulnerability Retbleed:               Mitigation; untrained return thunk; SMT disabled
02:45:51  Vulnerability Spec rstack overflow:   Vulnerable: Safe RET, no microcode
02:45:51  Vulnerability Spec store bypass:      Mitigation; Speculative Store Bypass disabled via prctl
02:45:51  Vulnerability Spectre v1:             Mitigation; usercopy/swapgs barriers and __user pointer sanitization
02:45:51  Vulnerability Spectre v2:             Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
02:45:51  Vulnerability Srbds:                  Not affected
02:45:51  Vulnerability Tsx async abort:        Not affected
02:45:51  Vulnerability Vmscape:                Not affected
02:45:51  
02:45:51  
02:45:51  ---> nproc:
02:45:51  2
02:45:51  
02:45:51  
02:45:51  ---> df -h:
02:45:51  Filesystem      Size  Used Avail Use% Mounted on
02:45:51  tmpfs           795M  1.1M  794M   1% /run
02:45:51  /dev/vda1        38G  8.1G   30G  22% /
02:45:51  tmpfs           3.9G     0  3.9G   0% /dev/shm
02:45:51  tmpfs           5.0M     0  5.0M   0% /run/lock
02:45:51  /dev/vda16      881M  117M  703M  15% /boot
02:45:51  /dev/vda15      105M  6.2M   99M   6% /boot/efi
02:45:51  tmpfs           795M   16K  795M   1% /run/user/1001
02:45:51  
02:45:51  
02:45:51  ---> free -m:
02:45:51                 total        used        free      shared  buff/cache   available
02:45:51  Mem:            7941         868        4897           4        2476        7072
02:45:51  Swap:           1023           0        1023
02:45:51  
02:45:51  
02:45:51  ---> ip addr:
02:45:51  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
02:45:51      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
02:45:51      inet 127.0.0.1/8 scope host lo
02:45:51         valid_lft forever preferred_lft forever
02:45:51      inet6 ::1/128 scope host noprefixroute 
02:45:51         valid_lft forever preferred_lft forever
02:45:51  2: ens3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
02:45:51      link/ether fa:16:3e:86:b0:0f brd ff:ff:ff:ff:ff:ff
02:45:51      altname enp0s3
02:45:51      inet 10.30.170.162/23 metric 100 brd 10.30.171.255 scope global dynamic ens3
02:45:51         valid_lft 74554sec preferred_lft 74554sec
02:45:51      inet6 fe80::f816:3eff:fe86:b00f/64 scope link 
02:45:51         valid_lft forever preferred_lft forever
02:45:51  
02:45:51  
02:45:51  ---> sar -b -r -n DEV:
02:45:51  Linux 6.8.0-90-generic (prd-ubuntu2404-robot-2c-8g-19386) 	05/24/26 	_x86_64_	(2 CPU)
02:45:51  
02:45:51  00:00:19          tps      rtps      wtps      dtps   bread/s   bwrtn/s   bdscd/s
02:45:51  00:10:20         1.54      0.02      1.51      0.01      0.83     29.35      0.43
02:45:51  00:20:17         1.62      0.12      1.48      0.03      3.63     22.92     41.93
02:45:51  00:30:21         1.38      0.00      1.36      0.01      0.00     28.30      0.79
02:45:51  00:40:22         1.35      0.00      1.35      0.00      0.00     35.00      0.00
02:45:51  00:50:23        29.02     13.49      1.99     13.53    149.22     46.52 106190.10
02:45:51  01:00:17         1.57      0.00      1.53      0.04      0.00     29.71      4.72
02:45:51  01:10:25         1.43      0.00      1.38      0.05      0.00     22.98    396.40
02:45:51  01:20:17         1.47      0.00      1.41      0.06      0.00     23.65    405.96
02:45:51  01:30:26         1.53      0.00      1.48      0.06      0.00     30.47      7.86
02:45:51  01:40:07         1.48      0.00      1.43      0.04      0.00     29.33      6.08
02:45:51  01:50:26         1.37      0.00      1.32      0.05      0.00     26.53      7.09
02:45:51  02:00:17         1.60      0.00      1.55      0.05      0.00     32.41      7.71
02:45:51  02:10:26         1.52      0.01      1.46      0.05      0.59     25.37      7.24
02:45:51  02:20:26         1.59      0.00      1.54      0.05      0.00     31.36      6.71
02:45:51  02:30:07         1.61      0.00      1.58      0.03      0.00     31.06      2.17
02:45:51  02:40:26         1.34      0.00      1.32      0.02      0.00     27.05      1.16
02:45:51  Average:         3.21      0.85      1.48      0.88      9.66     29.49   6703.18
02:45:51  
02:45:51  00:00:19    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
02:45:51  00:10:20      5166816   7384792    382636      4.71     86764   2292024    847160      9.23    618240   2054972       196
02:45:51  00:20:17      5143776   7363356    403944      4.97     87068   2293280    846316      9.22    618468   2056164       228
02:45:51  00:30:21      5140280   7363568    403672      4.96     87208   2296760    846348      9.22    618504   2059800       328
02:45:51  00:40:22      5140028   7369360    397780      4.89     87356   2302604    846428      9.22    618596   2065764       176
02:45:51  00:50:23      5067368   7353412    404844      4.98     90344   2348000    846628      9.22    619332   2113544       244
02:45:51  01:00:17      5062840   7352492    405668      4.99     90500   2351364    854932      9.31    619320   2117060       196
02:45:51  01:10:25      5068220   7360160    397960      4.89     90696   2353452    846756      9.22    619596   2119192       328
02:45:51  01:20:17      5066972   7361352    396712      4.88     90896   2355628    846724      9.22    619820   2121600       384
02:45:51  01:30:26      5076324   7374628    383272      4.71     91100   2359304    846900      9.22    619656   2125464       452
02:45:51  01:40:07      5070280   7372244    385552      4.74     91288   2362724    846900      9.22    619824   2129076       348
02:45:51  01:50:26      5068276   7373776    384008      4.72     91460   2366040    846932      9.22    619896   2132568       360
02:45:51  02:00:17      5065520   7375336    382344      4.70     91628   2370124    846912      9.22    619984   2136692       236
02:45:51  02:10:26      5041944   7354776    402876      4.95     91824   2372912    846928      9.22    620228   2139548       544
02:45:51  02:20:26      5038420   7355432    402120      4.94     92028   2376836    846912      9.22    620252   2143672       348
02:45:51  02:30:07      5048548   7369280    388224      4.77     92172   2380332    847072      9.23    620392   2147332       216
02:45:51  02:40:26      5047792   7372552    384848      4.73     92324   2384156    855296      9.32    620564   2151180       492
02:45:51  Average:      5082088   7366032    394154      4.85     90291   2347846    847822      9.23    619542   2113352       317
02:45:51  
02:45:51  00:00:19        IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
02:45:51  00:10:20           lo      1.01      1.01      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  00:10:20         ens3      5.21      4.30      1.28      0.78      0.00      0.00      0.00      0.00
02:45:51  00:20:17           lo      1.06      1.06      0.06      0.06      0.00      0.00      0.00      0.00
02:45:51  00:20:17         ens3      5.82      2.17      0.95      0.63      0.00      0.00      0.00      0.00
02:45:51  00:30:21           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  00:30:21         ens3      9.13      7.13      2.20      1.35      0.00      0.00      0.00      0.00
02:45:51  00:40:22           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  00:40:22         ens3      5.86      4.63      1.19      0.67      0.00      0.00      0.00      0.00
02:45:51  00:50:23           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  00:50:23         ens3      6.35      3.71      0.95      0.37      0.00      0.00      0.00      0.00
02:45:51  01:00:17           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  01:00:17         ens3      9.97      8.01      2.33      1.45      0.00      0.00      0.00      0.00
02:45:51  01:10:25           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  01:10:25         ens3      2.49      1.55      5.53      0.22      0.00      0.00      0.00      0.00
02:45:51  01:20:17           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  01:20:17         ens3      5.89      4.86      1.34      0.84      0.00      0.00      0.00      0.00
02:45:51  01:30:26           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  01:30:26         ens3      6.95      5.61      1.73      1.08      0.00      0.00      0.00      0.00
02:45:51  01:40:07           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  01:40:07         ens3      9.26      7.59      2.16      1.36      0.00      0.00      0.00      0.00
02:45:51  01:50:26           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  01:50:26         ens3      7.46      4.59      1.71      0.96      0.00      0.00      0.00      0.00
02:45:51  02:00:17           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  02:00:17         ens3     12.15      9.21      2.82      1.73      0.00      0.00      0.00      0.00
02:45:51  02:10:26           lo      1.01      1.01      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  02:10:26         ens3      4.00      3.10      1.73      0.52      0.00      0.00      0.00      0.00
02:45:51  02:20:26           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  02:20:26         ens3      8.87      7.34      2.19      1.40      0.00      0.00      0.00      0.00
02:45:51  02:30:07           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  02:30:07         ens3      8.31      6.97      2.00      1.26      0.00      0.00      0.00      0.00
02:45:51  02:40:26           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  02:40:26         ens3      6.40      5.42      1.49      0.96      0.00      0.00      0.00      0.00
02:45:51  Average:           lo      1.00      1.00      0.05      0.05      0.00      0.00      0.00      0.00
02:45:51  Average:         ens3      7.11      5.37      1.98      0.97      0.00      0.00      0.00      0.00
02:45:51  
02:45:51  
02:45:51  ---> sar -P ALL:
02:45:51  Linux 6.8.0-90-generic (prd-ubuntu2404-robot-2c-8g-19386) 	05/24/26 	_x86_64_	(2 CPU)
02:45:51  
02:45:51  00:00:19        CPU     %user     %nice   %system   %iowait    %steal     %idle
02:45:51  00:10:20        all      2.01      0.00      0.29      0.01      0.09     97.61
02:45:51  00:10:20          0      0.95      0.00      0.19      0.01      0.06     98.79
02:45:51  00:10:20          1      3.07      0.00      0.39      0.01      0.11     96.43
02:45:51  00:20:17        all      0.84      0.00      0.25      0.04      0.05     98.82
02:45:51  00:20:17          0      0.77      0.00      0.24      0.04      0.04     98.92
02:45:51  00:20:17          1      0.92      0.00      0.26      0.05      0.05     98.72
02:45:51  00:30:21        all      3.36      0.00      0.46      0.01      0.09     96.08
02:45:51  00:30:21          0      2.54      0.00      0.42      0.01      0.09     96.95
02:45:51  00:30:21          1      4.19      0.00      0.49      0.02      0.08     95.22
02:45:51  00:40:22        all      2.36      0.00      0.27      0.01      0.07     97.29
02:45:51  00:40:22          0      2.35      0.00      0.24      0.00      0.08     97.33
02:45:51  00:40:22          1      2.36      0.00      0.31      0.01      0.07     97.25
02:45:51  00:50:23        all      0.58      0.18      0.23      0.19      0.05     98.77
02:45:51  00:50:23          0      0.45      0.01      0.18      0.03      0.05     99.28
02:45:51  00:50:23          1      0.71      0.35      0.28      0.36      0.05     98.26
02:45:51  01:00:17        all      3.43      0.00      0.45      0.01      0.08     96.02
02:45:51  01:00:17          0      2.13      0.00      0.35      0.01      0.07     97.44
02:45:51  01:00:17          1      4.74      0.00      0.55      0.01      0.09     94.61
02:45:51  01:10:25        all      1.63      0.00      0.36      0.01      0.07     97.92
02:45:51  01:10:25          0      2.36      0.00      0.60      0.01      0.07     96.95
02:45:51  01:10:25          1      0.91      0.00      0.12      0.01      0.07     98.89
02:45:51  01:20:17        all      3.58      0.00      0.36      0.01      0.07     95.98
02:45:51  01:20:17          0      3.90      0.00      0.41      0.01      0.07     95.61
02:45:51  01:20:17          1      3.25      0.00      0.32      0.01      0.07     96.35
02:45:51  01:30:26        all      2.86      0.00      0.39      0.01      0.09     96.65
02:45:51  01:30:26          0      2.27      0.00      0.33      0.01      0.09     97.30
02:45:51  01:30:26          1      3.46      0.00      0.44      0.02      0.09     95.99
02:45:51  01:40:07        all      4.88      0.00      0.59      0.01      0.09     94.42
02:45:51  01:40:07          0      4.49      0.00      0.42      0.01      0.09     94.98
02:45:51  01:40:07          1      5.28      0.00      0.77      0.01      0.10     93.85
02:45:51  01:50:26        all      2.51      0.00      0.42      0.01      0.09     96.97
02:45:51  01:50:26          0      2.45      0.00      0.31      0.01      0.06     97.17
02:45:51  01:50:26          1      2.57      0.00      0.53      0.01      0.11     96.78
02:45:51  
02:45:51  01:50:26        CPU     %user     %nice   %system   %iowait    %steal     %idle
02:45:51  02:00:17        all      4.72      0.00      0.56      0.02      0.08     94.62
02:45:51  02:00:17          0      3.11      0.00      0.44      0.02      0.07     96.36
02:45:51  02:00:17          1      6.33      0.00      0.69      0.02      0.09     92.87
02:45:51  02:10:26        all      2.58      0.00      0.49      0.01      0.07     96.85
02:45:51  02:10:26          0      2.45      0.00      0.28      0.02      0.06     97.19
02:45:51  02:10:26          1      2.71      0.00      0.70      0.00      0.08     96.50
02:45:51  02:20:26        all      3.57      0.00      0.38      0.01      0.09     95.95
02:45:51  02:20:26          0      4.97      0.00      0.49      0.01      0.11     94.41
02:45:51  02:20:26          1      2.16      0.00      0.27      0.01      0.07     97.49
02:45:51  02:30:07        all      4.24      0.00      0.69      0.01      0.10     94.97
02:45:51  02:30:07          0      3.14      0.00      0.51      0.00      0.10     96.25
02:45:51  02:30:07          1      5.32      0.00      0.86      0.02      0.09     93.70
02:45:51  02:40:26        all      3.81      0.00      0.83      0.01      0.09     95.27
02:45:51  02:40:26          0      2.59      0.00      0.29      0.01      0.10     97.01
02:45:51  02:40:26          1      5.02      0.00      1.37      0.01      0.08     93.53
02:45:51  Average:        all      2.92      0.01      0.44      0.02      0.08     96.52
02:45:51  Average:          0      2.55      0.00      0.35      0.01      0.08     97.00
02:45:51  Average:          1      3.30      0.02      0.52      0.04      0.08     96.04
02:45:51  
02:45:51  
02:45:51